[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:13:45.833552  1934 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.227.190:37509
I20260709 13:13:45.835263  1934 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:13:45.836400  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:45.854118  1940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:45.854125  1941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:45.854410  1943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:45.856791  1934 server_base.cc:1061] running on GCE node
I20260709 13:13:47.117729  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:47.118057  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:47.118217  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783602827118201 us; error 0 us; skew 500 ppm
I20260709 13:13:47.119029  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:47.125928  1934 webserver.cc:533] Webserver started at http://127.1.227.190:41563/ using document root <none> and password file <none>
I20260709 13:13:47.126832  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:47.127054  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:47.127501  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:47.133615  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602825662285-1934-0/minicluster-data/master-0-root/instance:
uuid: "6cb9c9cc6e6b4e8db81c62b0d8656b41"
format_stamp: "Formatted at 2026-07-09 13:13:47 on dist-test-slave-lfdf"
I20260709 13:13:47.142093  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:13:47.148123  1949 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:47.149493  1934 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:13:47.149948  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602825662285-1934-0/minicluster-data/master-0-root
uuid: "6cb9c9cc6e6b4e8db81c62b0d8656b41"
format_stamp: "Formatted at 2026-07-09 13:13:47 on dist-test-slave-lfdf"
I20260709 13:13:47.150405  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602825662285-1934-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602825662285-1934-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602825662285-1934-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:47.234844  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:47.236467  1934 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:13:47.236981  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:47.320168  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.190:37509
I20260709 13:13:47.320276  2000 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.190:37509 every 8 connection(s)
I20260709 13:13:47.329502  2001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:47.352065  2001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41: Bootstrap starting.
I20260709 13:13:47.358253  2001 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:47.360144  2001 log.cc:826] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41: Log is configured to *not* fsync() on all Append() calls
I20260709 13:13:47.364974  2001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41: No bootstrap required, opened a new log
I20260709 13:13:47.385982  2001 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb9c9cc6e6b4e8db81c62b0d8656b41" member_type: VOTER }
I20260709 13:13:47.386655  2001 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:47.386915  2001 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cb9c9cc6e6b4e8db81c62b0d8656b41, State: Initialized, Role: FOLLOWER
I20260709 13:13:47.387957  2001 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb9c9cc6e6b4e8db81c62b0d8656b41" member_type: VOTER }
I20260709 13:13:47.388490  2001 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:47.388798  2001 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:47.389176  2001 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:47.393392  2001 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb9c9cc6e6b4e8db81c62b0d8656b41" member_type: VOTER }
I20260709 13:13:47.394207  2001 leader_election.cc:304] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6cb9c9cc6e6b4e8db81c62b0d8656b41; no voters: 
I20260709 13:13:47.395974  2001 leader_election.cc:290] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:47.396560  2004 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:47.399406  2004 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41 [term 1 LEADER]: Becoming Leader. State: Replica: 6cb9c9cc6e6b4e8db81c62b0d8656b41, State: Running, Role: LEADER
I20260709 13:13:47.400364  2004 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb9c9cc6e6b4e8db81c62b0d8656b41" member_type: VOTER }
I20260709 13:13:47.401446  2001 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:47.412357  2006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cb9c9cc6e6b4e8db81c62b0d8656b41. Latest consensus state: current_term: 1 leader_uuid: "6cb9c9cc6e6b4e8db81c62b0d8656b41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb9c9cc6e6b4e8db81c62b0d8656b41" member_type: VOTER } }
I20260709 13:13:47.413475  2006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:47.412343  2005 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6cb9c9cc6e6b4e8db81c62b0d8656b41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb9c9cc6e6b4e8db81c62b0d8656b41" member_type: VOTER } }
I20260709 13:13:47.414273  2005 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:47.416750  2014 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:47.428105  2014 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:47.430555  1934 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:47.445267  2014 catalog_manager.cc:1383] Generated new cluster ID: b95df4556bc2407ca7b7a37274b806a4
I20260709 13:13:47.445605  2014 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:47.484758  2014 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:47.486584  2014 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:47.502876  2014 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41: Generated new TSK 0
I20260709 13:13:47.503901  2014 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:47.562959  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:47.573071  2023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:47.574281  2024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:47.578269  2026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:47.578469  1934 server_base.cc:1061] running on GCE node
I20260709 13:13:47.579283  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:47.579493  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:47.579713  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783602827579680 us; error 0 us; skew 500 ppm
I20260709 13:13:47.580354  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:47.584818  1934 webserver.cc:533] Webserver started at http://127.1.227.129:36471/ using document root <none> and password file <none>
I20260709 13:13:47.585383  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:47.585594  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:47.585930  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:47.587113  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602825662285-1934-0/minicluster-data/ts-0-root/instance:
uuid: "a9ba85a12f4440719ca1eb081b9bf874"
format_stamp: "Formatted at 2026-07-09 13:13:47 on dist-test-slave-lfdf"
I20260709 13:13:47.593838  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:47.598613  2031 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:47.599536  1934 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:13:47.599852  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602825662285-1934-0/minicluster-data/ts-0-root
uuid: "a9ba85a12f4440719ca1eb081b9bf874"
format_stamp: "Formatted at 2026-07-09 13:13:47 on dist-test-slave-lfdf"
I20260709 13:13:47.600139  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602825662285-1934-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602825662285-1934-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602825662285-1934-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:47.624159  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:47.625581  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:47.628525  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:47.633662  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:47.633967  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:13:47.634383  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:47.634549  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:47.740267  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.129:41415
I20260709 13:13:47.740340  2093 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.129:41415 every 8 connection(s)
I20260709 13:13:47.747928  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:47.759213  2098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:47.759317  2099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:47.772210  2102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:47.773937  1934 server_base.cc:1061] running on GCE node
I20260709 13:13:47.774997  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:47.775281  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:47.775506  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783602827775487 us; error 0 us; skew 500 ppm
I20260709 13:13:47.776321  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:47.776455  2094 heartbeater.cc:344] Connected to a master server at 127.1.227.190:37509
I20260709 13:13:47.776991  2094 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:47.778267  2094 heartbeater.cc:507] Master 127.1.227.190:37509 requested a full tablet report, sending...
I20260709 13:13:47.779603  1934 webserver.cc:533] Webserver started at http://127.1.227.130:46257/ using document root <none> and password file <none>
I20260709 13:13:47.780287  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:47.780544  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:47.780894  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:47.781543  1966 ts_manager.cc:194] Registered new tserver with Master: a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415)
I20260709 13:13:47.782474  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602825662285-1934-0/minicluster-data/ts-1-root/instance:
uuid: "a51c4c68e76941b59c71006c77272966"
format_stamp: "Formatted at 2026-07-09 13:13:47 on dist-test-slave-lfdf"
I20260709 13:13:47.783735  1966 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44834
I20260709 13:13:47.789242  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:13:47.794914  2106 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:47.795940  1934 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:13:47.796304  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602825662285-1934-0/minicluster-data/ts-1-root
uuid: "a51c4c68e76941b59c71006c77272966"
format_stamp: "Formatted at 2026-07-09 13:13:47 on dist-test-slave-lfdf"
I20260709 13:13:47.796666  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602825662285-1934-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602825662285-1934-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602825662285-1934-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:47.815405  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:47.817169  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:47.819842  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:47.823674  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:47.823966  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:47.824255  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:47.824481  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:47.915988  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.130:46403
I20260709 13:13:47.916042  2168 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.130:46403 every 8 connection(s)
I20260709 13:13:47.922766  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:47.934134  2173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:47.934175  2172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:47.946928  2175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:47.947496  1934 server_base.cc:1061] running on GCE node
I20260709 13:13:47.948901  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:47.949185  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:47.949385  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783602827949367 us; error 0 us; skew 500 ppm
I20260709 13:13:47.950227  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:47.950289  2169 heartbeater.cc:344] Connected to a master server at 127.1.227.190:37509
I20260709 13:13:47.950839  2169 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:47.951862  2169 heartbeater.cc:507] Master 127.1.227.190:37509 requested a full tablet report, sending...
I20260709 13:13:47.953333  1934 webserver.cc:533] Webserver started at http://127.1.227.131:44511/ using document root <none> and password file <none>
I20260709 13:13:47.954056  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:47.954303  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:47.954380  1966 ts_manager.cc:194] Registered new tserver with Master: a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403)
I20260709 13:13:47.954631  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:47.955852  1966 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44844
I20260709 13:13:47.956079  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602825662285-1934-0/minicluster-data/ts-2-root/instance:
uuid: "096950e469ac459c8e48c2760e0f56ff"
format_stamp: "Formatted at 2026-07-09 13:13:47 on dist-test-slave-lfdf"
I20260709 13:13:47.962321  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:13:47.966764  2180 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:47.967727  1934 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:13:47.968092  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602825662285-1934-0/minicluster-data/ts-2-root
uuid: "096950e469ac459c8e48c2760e0f56ff"
format_stamp: "Formatted at 2026-07-09 13:13:47 on dist-test-slave-lfdf"
I20260709 13:13:47.968473  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602825662285-1934-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602825662285-1934-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602825662285-1934-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:47.991405  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:47.993058  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:47.995754  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:47.999861  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:48.000160  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:48.000474  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:48.000681  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:48.095785  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.131:42021
I20260709 13:13:48.095846  2242 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.131:42021 every 8 connection(s)
I20260709 13:13:48.118574  2243 heartbeater.cc:344] Connected to a master server at 127.1.227.190:37509
I20260709 13:13:48.119118  2243 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:48.120023  2243 heartbeater.cc:507] Master 127.1.227.190:37509 requested a full tablet report, sending...
I20260709 13:13:48.122208  1966 ts_manager.cc:194] Registered new tserver with Master: 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:48.122750  1934 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017303303s
I20260709 13:13:48.124006  1966 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44856
I20260709 13:13:48.177634  1966 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44868:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:48.181622  1966 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:48.303563  2059 tablet_service.cc:1511] Processing CreateTablet for tablet a4507a96160e4dbbbaa47ee7adfdf167 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:48.305255  2059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4507a96160e4dbbbaa47ee7adfdf167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.305399  2134 tablet_service.cc:1511] Processing CreateTablet for tablet a4507a96160e4dbbbaa47ee7adfdf167 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:48.306998  2134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4507a96160e4dbbbaa47ee7adfdf167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.309639  2058 tablet_service.cc:1511] Processing CreateTablet for tablet 910bee8ef2a8424ab11eb9bc175b3c73 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:48.311179  2058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910bee8ef2a8424ab11eb9bc175b3c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.312575  2132 tablet_service.cc:1511] Processing CreateTablet for tablet 47edadac9a9f49fe96b4310b99745134 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:48.311203  2133 tablet_service.cc:1511] Processing CreateTablet for tablet 910bee8ef2a8424ab11eb9bc175b3c73 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:48.318719  2056 tablet_service.cc:1511] Processing CreateTablet for tablet eaaaff3a47de402a94f42a6637afbecc (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:48.322896  2132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47edadac9a9f49fe96b4310b99745134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.322383  2054 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb927f7bd87438c970a2cb051fea53e (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:48.329334  2131 tablet_service.cc:1511] Processing CreateTablet for tablet eaaaff3a47de402a94f42a6637afbecc (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:48.339781  2133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910bee8ef2a8424ab11eb9bc175b3c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.342602  2051 tablet_service.cc:1511] Processing CreateTablet for tablet b242b4def0cd410d9a5bbdf24c5a9645 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:48.345379  2056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaaaff3a47de402a94f42a6637afbecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.341670  2053 tablet_service.cc:1511] Processing CreateTablet for tablet df7e54fd225b4faf9ed557ab7f3067e0 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:48.349023  2129 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb927f7bd87438c970a2cb051fea53e (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:48.340214  2057 tablet_service.cc:1511] Processing CreateTablet for tablet 47edadac9a9f49fe96b4310b99745134 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:48.349089  2055 tablet_service.cc:1511] Processing CreateTablet for tablet 2d000d212ec343cea0340f6217aeb246 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:48.342496  2052 tablet_service.cc:1511] Processing CreateTablet for tablet 01a55788b5394d93b52dfcd4c04b0ea2 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:48.339752  2130 tablet_service.cc:1511] Processing CreateTablet for tablet 2d000d212ec343cea0340f6217aeb246 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:48.345906  2128 tablet_service.cc:1511] Processing CreateTablet for tablet df7e54fd225b4faf9ed557ab7f3067e0 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:48.353406  2127 tablet_service.cc:1511] Processing CreateTablet for tablet 01a55788b5394d93b52dfcd4c04b0ea2 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:48.355969  2126 tablet_service.cc:1511] Processing CreateTablet for tablet b242b4def0cd410d9a5bbdf24c5a9645 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:48.358335  2131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaaaff3a47de402a94f42a6637afbecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.363886  2130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d000d212ec343cea0340f6217aeb246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.365680  2129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb927f7bd87438c970a2cb051fea53e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.358074  2054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb927f7bd87438c970a2cb051fea53e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.368623  2127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a55788b5394d93b52dfcd4c04b0ea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.370424  2128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df7e54fd225b4faf9ed557ab7f3067e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.371744  2126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b242b4def0cd410d9a5bbdf24c5a9645. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.374696  2057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47edadac9a9f49fe96b4310b99745134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.381636  2053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df7e54fd225b4faf9ed557ab7f3067e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.386771  2055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d000d212ec343cea0340f6217aeb246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.397897  2051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b242b4def0cd410d9a5bbdf24c5a9645. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.403651  2052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a55788b5394d93b52dfcd4c04b0ea2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:48.420725  2013 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:48.442900  2208 tablet_service.cc:1511] Processing CreateTablet for tablet a4507a96160e4dbbbaa47ee7adfdf167 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:48.446775  2204 tablet_service.cc:1511] Processing CreateTablet for tablet 2d000d212ec343cea0340f6217aeb246 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:48.449383  2206 tablet_service.cc:1511] Processing CreateTablet for tablet 47edadac9a9f49fe96b4310b99745134 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:48.442828  2207 tablet_service.cc:1511] Processing CreateTablet for tablet 910bee8ef2a8424ab11eb9bc175b3c73 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:48.455893  2205 tablet_service.cc:1511] Processing CreateTablet for tablet eaaaff3a47de402a94f42a6637afbecc (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:48.458771  2202 tablet_service.cc:1511] Processing CreateTablet for tablet df7e54fd225b4faf9ed557ab7f3067e0 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:48.461962  2208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4507a96160e4dbbbaa47ee7adfdf167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.465386  2204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d000d212ec343cea0340f6217aeb246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.463519  2203 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb927f7bd87438c970a2cb051fea53e (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:48.477197  2201 tablet_service.cc:1511] Processing CreateTablet for tablet 01a55788b5394d93b52dfcd4c04b0ea2 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:48.478812  2202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df7e54fd225b4faf9ed557ab7f3067e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.480254  2206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47edadac9a9f49fe96b4310b99745134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.491530  2200 tablet_service.cc:1511] Processing CreateTablet for tablet b242b4def0cd410d9a5bbdf24c5a9645 (DEFAULT_TABLE table=test-workload [id=3b1a0dfc0a234669af022cf173ff9a8b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:48.517901  2205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaaaff3a47de402a94f42a6637afbecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.519882  2201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a55788b5394d93b52dfcd4c04b0ea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.535305  2203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb927f7bd87438c970a2cb051fea53e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.538194  2200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b242b4def0cd410d9a5bbdf24c5a9645. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.554370  2207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910bee8ef2a8424ab11eb9bc175b3c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:48.587286  2261 tablet_bootstrap.cc:492] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966: Bootstrap starting.
I20260709 13:13:48.606835  2262 tablet_bootstrap.cc:492] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874: Bootstrap starting.
I20260709 13:13:48.676883  2262 tablet_bootstrap.cc:654] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.682596  2261 tablet_bootstrap.cc:654] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.692960  2263 tablet_bootstrap.cc:492] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff: Bootstrap starting.
I20260709 13:13:48.695722  2261 tablet_bootstrap.cc:492] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966: No bootstrap required, opened a new log
I20260709 13:13:48.696331  2261 ts_tablet_manager.cc:1403] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966: Time spent bootstrapping tablet: real 0.130s	user 0.009s	sys 0.009s
I20260709 13:13:48.701644  2263 tablet_bootstrap.cc:654] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.707824  2261 raft_consensus.cc:359] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.708755  2261 raft_consensus.cc:385] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.709112  2261 raft_consensus.cc:740] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a51c4c68e76941b59c71006c77272966, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.710045  2261 consensus_queue.cc:260] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.716735  2263 tablet_bootstrap.cc:492] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff: No bootstrap required, opened a new log
I20260709 13:13:48.717288  2263 ts_tablet_manager.cc:1403] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.010s
I20260709 13:13:48.717427  2262 tablet_bootstrap.cc:492] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874: No bootstrap required, opened a new log
I20260709 13:13:48.717998  2262 ts_tablet_manager.cc:1403] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874: Time spent bootstrapping tablet: real 0.134s	user 0.000s	sys 0.024s
I20260709 13:13:48.720288  2261 ts_tablet_manager.cc:1434] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:13:48.725715  2261 tablet_bootstrap.cc:492] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966: Bootstrap starting.
I20260709 13:13:48.727705  2169 heartbeater.cc:499] Master 127.1.227.190:37509 was elected leader, sending a full tablet report...
I20260709 13:13:48.727617  2262 raft_consensus.cc:359] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.728652  2262 raft_consensus.cc:385] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.729143  2262 raft_consensus.cc:740] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9ba85a12f4440719ca1eb081b9bf874, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.730242  2262 consensus_queue.cc:260] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.733271  2261 tablet_bootstrap.cc:654] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.739593  2094 heartbeater.cc:499] Master 127.1.227.190:37509 was elected leader, sending a full tablet report...
I20260709 13:13:48.740901  2262 ts_tablet_manager.cc:1434] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874: Time spent starting tablet: real 0.023s	user 0.011s	sys 0.008s
I20260709 13:13:48.742062  2262 tablet_bootstrap.cc:492] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874: Bootstrap starting.
W20260709 13:13:48.748456  2095 tablet.cc:2406] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:48.750221  2262 tablet_bootstrap.cc:654] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.727289  2263 raft_consensus.cc:359] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.751276  2263 raft_consensus.cc:385] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.751930  2261 tablet_bootstrap.cc:492] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966: No bootstrap required, opened a new log
I20260709 13:13:48.752981  2263 raft_consensus.cc:740] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.753274  2261 ts_tablet_manager.cc:1403] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.004s
I20260709 13:13:48.753865  2263 consensus_queue.cc:260] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.758708  2262 tablet_bootstrap.cc:492] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874: No bootstrap required, opened a new log
I20260709 13:13:48.758236  2261 raft_consensus.cc:359] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.759364  2262 ts_tablet_manager.cc:1403] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.006s
I20260709 13:13:48.759318  2261 raft_consensus.cc:385] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.759912  2261 raft_consensus.cc:740] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a51c4c68e76941b59c71006c77272966, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.760803  2261 consensus_queue.cc:260] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.762696  2262 raft_consensus.cc:359] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.763478  2262 raft_consensus.cc:385] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.763516  2261 ts_tablet_manager.cc:1434] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:13:48.763907  2262 raft_consensus.cc:740] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9ba85a12f4440719ca1eb081b9bf874, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.764824  2261 tablet_bootstrap.cc:492] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966: Bootstrap starting.
I20260709 13:13:48.764745  2262 consensus_queue.cc:260] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.767041  2262 ts_tablet_manager.cc:1434] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:48.768168  2262 tablet_bootstrap.cc:492] T df7e54fd225b4faf9ed557ab7f3067e0 P a9ba85a12f4440719ca1eb081b9bf874: Bootstrap starting.
I20260709 13:13:48.773561  2261 tablet_bootstrap.cc:654] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.781338  2262 tablet_bootstrap.cc:654] T df7e54fd225b4faf9ed557ab7f3067e0 P a9ba85a12f4440719ca1eb081b9bf874: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.791919  2261 tablet_bootstrap.cc:492] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966: No bootstrap required, opened a new log
I20260709 13:13:48.792546  2261 ts_tablet_manager.cc:1403] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.014s
I20260709 13:13:48.793081  2243 heartbeater.cc:499] Master 127.1.227.190:37509 was elected leader, sending a full tablet report...
I20260709 13:13:48.794610  2263 ts_tablet_manager.cc:1434] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff: Time spent starting tablet: real 0.077s	user 0.013s	sys 0.004s
I20260709 13:13:48.795997  2263 tablet_bootstrap.cc:492] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff: Bootstrap starting.
I20260709 13:13:48.796130  2261 raft_consensus.cc:359] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.797402  2261 raft_consensus.cc:385] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.797896  2261 raft_consensus.cc:740] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a51c4c68e76941b59c71006c77272966, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.798803  2261 consensus_queue.cc:260] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.802284  2261 ts_tablet_manager.cc:1434] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.002s
I20260709 13:13:48.803684  2261 tablet_bootstrap.cc:492] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966: Bootstrap starting.
I20260709 13:13:48.804860  2262 tablet_bootstrap.cc:492] T df7e54fd225b4faf9ed557ab7f3067e0 P a9ba85a12f4440719ca1eb081b9bf874: No bootstrap required, opened a new log
I20260709 13:13:48.805418  2262 ts_tablet_manager.cc:1403] T df7e54fd225b4faf9ed557ab7f3067e0 P a9ba85a12f4440719ca1eb081b9bf874: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.013s
I20260709 13:13:48.808853  2262 raft_consensus.cc:359] T df7e54fd225b4faf9ed557ab7f3067e0 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.809700  2262 raft_consensus.cc:385] T df7e54fd225b4faf9ed557ab7f3067e0 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.810094  2262 raft_consensus.cc:740] T df7e54fd225b4faf9ed557ab7f3067e0 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9ba85a12f4440719ca1eb081b9bf874, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.810810  2261 tablet_bootstrap.cc:654] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.811002  2262 consensus_queue.cc:260] T df7e54fd225b4faf9ed557ab7f3067e0 P a9ba85a12f4440719ca1eb081b9bf874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.813622  2262 ts_tablet_manager.cc:1434] T df7e54fd225b4faf9ed557ab7f3067e0 P a9ba85a12f4440719ca1eb081b9bf874: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.003s
I20260709 13:13:48.815001  2262 tablet_bootstrap.cc:492] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874: Bootstrap starting.
I20260709 13:13:48.822805  2262 tablet_bootstrap.cc:654] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.830500  2261 tablet_bootstrap.cc:492] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966: No bootstrap required, opened a new log
I20260709 13:13:48.831045  2261 ts_tablet_manager.cc:1403] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.005s
I20260709 13:13:48.831274  2262 tablet_bootstrap.cc:492] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874: No bootstrap required, opened a new log
I20260709 13:13:48.831786  2262 ts_tablet_manager.cc:1403] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:13:48.834545  2262 raft_consensus.cc:359] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.834270  2261 raft_consensus.cc:359] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.835121  2262 raft_consensus.cc:385] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.835170  2261 raft_consensus.cc:385] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.835541  2262 raft_consensus.cc:740] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9ba85a12f4440719ca1eb081b9bf874, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.835573  2261 raft_consensus.cc:740] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a51c4c68e76941b59c71006c77272966, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.836387  2262 consensus_queue.cc:260] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.836575  2261 consensus_queue.cc:260] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.838723  2261 ts_tablet_manager.cc:1434] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:13:48.839720  2261 tablet_bootstrap.cc:492] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966: Bootstrap starting.
I20260709 13:13:48.844637  2263 tablet_bootstrap.cc:654] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.847723  2261 tablet_bootstrap.cc:654] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.848925  2262 ts_tablet_manager.cc:1434] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:13:48.850035  2262 tablet_bootstrap.cc:492] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874: Bootstrap starting.
I20260709 13:13:48.858816  2261 tablet_bootstrap.cc:492] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966: No bootstrap required, opened a new log
I20260709 13:13:48.859328  2261 ts_tablet_manager.cc:1403] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:13:48.860719  2263 tablet_bootstrap.cc:492] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff: No bootstrap required, opened a new log
I20260709 13:13:48.861228  2263 ts_tablet_manager.cc:1403] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff: Time spent bootstrapping tablet: real 0.066s	user 0.014s	sys 0.000s
I20260709 13:13:48.862445  2261 raft_consensus.cc:359] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.863226  2261 raft_consensus.cc:385] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.863552  2261 raft_consensus.cc:740] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a51c4c68e76941b59c71006c77272966, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.864212  2263 raft_consensus.cc:359] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.864385  2261 consensus_queue.cc:260] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.865522  2263 raft_consensus.cc:385] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.865885  2263 raft_consensus.cc:740] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.866696  2262 tablet_bootstrap.cc:654] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.866629  2263 consensus_queue.cc:260] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.867262  2261 ts_tablet_manager.cc:1434] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:13:48.868517  2261 tablet_bootstrap.cc:492] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966: Bootstrap starting.
I20260709 13:13:48.868860  2263 ts_tablet_manager.cc:1434] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:13:48.869767  2263 tablet_bootstrap.cc:492] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff: Bootstrap starting.
I20260709 13:13:48.875605  2261 tablet_bootstrap.cc:654] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.877960  2263 tablet_bootstrap.cc:654] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.893277  2271 raft_consensus.cc:493] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.893961  2271 raft_consensus.cc:515] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.895622  2261 tablet_bootstrap.cc:492] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966: No bootstrap required, opened a new log
I20260709 13:13:48.896113  2261 ts_tablet_manager.cc:1403] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.000s
I20260709 13:13:48.899672  2271 leader_election.cc:290] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403)
I20260709 13:13:48.899425  2261 raft_consensus.cc:359] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.900177  2261 raft_consensus.cc:385] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.900509  2261 raft_consensus.cc:740] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a51c4c68e76941b59c71006c77272966, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.901526  2261 consensus_queue.cc:260] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.904629  2261 ts_tablet_manager.cc:1434] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 13:13:48.905815  2262 tablet_bootstrap.cc:492] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874: No bootstrap required, opened a new log
I20260709 13:13:48.905900  2261 tablet_bootstrap.cc:492] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966: Bootstrap starting.
I20260709 13:13:48.906448  2262 ts_tablet_manager.cc:1403] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.000s
I20260709 13:13:48.910863  2262 raft_consensus.cc:359] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.911746  2262 raft_consensus.cc:385] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.912184  2262 raft_consensus.cc:740] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9ba85a12f4440719ca1eb081b9bf874, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.913951  2261 tablet_bootstrap.cc:654] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.920771  2262 consensus_queue.cc:260] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.925279  2262 ts_tablet_manager.cc:1434] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.007s
I20260709 13:13:48.926020  2261 tablet_bootstrap.cc:492] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966: No bootstrap required, opened a new log
I20260709 13:13:48.926381  2262 tablet_bootstrap.cc:492] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874: Bootstrap starting.
I20260709 13:13:48.926479  2261 ts_tablet_manager.cc:1403] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 13:13:48.929513  2261 raft_consensus.cc:359] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.930258  2261 raft_consensus.cc:385] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.930558  2261 raft_consensus.cc:740] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a51c4c68e76941b59c71006c77272966, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.931761  2261 consensus_queue.cc:260] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.934407  2261 ts_tablet_manager.cc:1434] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:13:48.935464  2261 tablet_bootstrap.cc:492] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966: Bootstrap starting.
I20260709 13:13:48.940611  2262 tablet_bootstrap.cc:654] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.942150  2261 tablet_bootstrap.cc:654] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.953296  2261 tablet_bootstrap.cc:492] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966: No bootstrap required, opened a new log
I20260709 13:13:48.953780  2261 ts_tablet_manager.cc:1403] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 13:13:48.956405  2261 raft_consensus.cc:359] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.957084  2261 raft_consensus.cc:385] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.957369  2261 raft_consensus.cc:740] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a51c4c68e76941b59c71006c77272966, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.958544  2262 tablet_bootstrap.cc:492] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874: No bootstrap required, opened a new log
I20260709 13:13:48.958222  2261 consensus_queue.cc:260] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.959124  2262 ts_tablet_manager.cc:1403] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.000s
I20260709 13:13:48.960487  2261 ts_tablet_manager.cc:1434] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:48.961385  2261 tablet_bootstrap.cc:492] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966: Bootstrap starting.
I20260709 13:13:48.962436  2262 raft_consensus.cc:359] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.963299  2263 tablet_bootstrap.cc:492] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff: No bootstrap required, opened a new log
I20260709 13:13:48.963940  2263 ts_tablet_manager.cc:1403] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff: Time spent bootstrapping tablet: real 0.094s	user 0.008s	sys 0.011s
I20260709 13:13:48.964510  2267 raft_consensus.cc:493] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.965037  2267 raft_consensus.cc:515] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.967186  2263 raft_consensus.cc:359] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.967658  2267 leader_election.cc:290] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:48.968015  2263 raft_consensus.cc:385] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.968314  2263 raft_consensus.cc:740] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.969139  2263 consensus_queue.cc:260] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.971725  2263 ts_tablet_manager.cc:1434] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:48.972040  2261 tablet_bootstrap.cc:654] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.972844  2263 tablet_bootstrap.cc:492] T df7e54fd225b4faf9ed557ab7f3067e0 P 096950e469ac459c8e48c2760e0f56ff: Bootstrap starting.
I20260709 13:13:48.979295  2261 tablet_bootstrap.cc:492] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966: No bootstrap required, opened a new log
I20260709 13:13:48.979775  2261 ts_tablet_manager.cc:1403] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:13:48.982661  2261 raft_consensus.cc:359] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.983390  2261 raft_consensus.cc:385] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:48.983668  2261 raft_consensus.cc:740] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a51c4c68e76941b59c71006c77272966, State: Initialized, Role: FOLLOWER
I20260709 13:13:48.984545  2261 consensus_queue.cc:260] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:48.985191  2263 tablet_bootstrap.cc:654] T df7e54fd225b4faf9ed557ab7f3067e0 P 096950e469ac459c8e48c2760e0f56ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:48.987406  2261 ts_tablet_manager.cc:1434] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:13:49.008888  2267 raft_consensus.cc:493] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.963243  2262 raft_consensus.cc:385] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.009580  2267 raft_consensus.cc:515] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.010053  2262 raft_consensus.cc:740] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9ba85a12f4440719ca1eb081b9bf874, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.013643  2268 raft_consensus.cc:493] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.015220  2267 leader_election.cc:290] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:49.015837  2267 raft_consensus.cc:493] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.015534  2262 consensus_queue.cc:260] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.016263  2267 raft_consensus.cc:515] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.014216  2268 raft_consensus.cc:515] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.018143  2271 raft_consensus.cc:493] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.020578  2271 raft_consensus.cc:515] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.023092  2267 leader_election.cc:290] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:49.025671  2268 leader_election.cc:290] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:49.026119  2271 leader_election.cc:290] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403)
I20260709 13:13:49.081463  2267 raft_consensus.cc:493] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.082772  2267 raft_consensus.cc:515] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.085211  2267 leader_election.cc:290] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:49.085352  2263 tablet_bootstrap.cc:492] T df7e54fd225b4faf9ed557ab7f3067e0 P 096950e469ac459c8e48c2760e0f56ff: No bootstrap required, opened a new log
I20260709 13:13:49.085726  2267 raft_consensus.cc:493] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.094228  2262 ts_tablet_manager.cc:1434] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874: Time spent starting tablet: real 0.135s	user 0.034s	sys 0.020s
I20260709 13:13:49.092413  2263 ts_tablet_manager.cc:1403] T df7e54fd225b4faf9ed557ab7f3067e0 P 096950e469ac459c8e48c2760e0f56ff: Time spent bootstrapping tablet: real 0.120s	user 0.024s	sys 0.053s
I20260709 13:13:49.093066  2267 raft_consensus.cc:515] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.102867  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a55788b5394d93b52dfcd4c04b0ea2" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096950e469ac459c8e48c2760e0f56ff" is_pre_election: true
I20260709 13:13:49.112125  2143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d000d212ec343cea0340f6217aeb246" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a51c4c68e76941b59c71006c77272966" is_pre_election: true
I20260709 13:13:49.097595  2144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47edadac9a9f49fe96b4310b99745134" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a51c4c68e76941b59c71006c77272966" is_pre_election: true
I20260709 13:13:49.117302  2144 raft_consensus.cc:2468] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 096950e469ac459c8e48c2760e0f56ff in term 0.
I20260709 13:13:49.117462  2143 raft_consensus.cc:2468] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 096950e469ac459c8e48c2760e0f56ff in term 0.
I20260709 13:13:49.125051  2262 tablet_bootstrap.cc:492] T b242b4def0cd410d9a5bbdf24c5a9645 P a9ba85a12f4440719ca1eb081b9bf874: Bootstrap starting.
I20260709 13:13:49.123353  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b242b4def0cd410d9a5bbdf24c5a9645" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096950e469ac459c8e48c2760e0f56ff" is_pre_election: true
I20260709 13:13:49.132593  2217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096950e469ac459c8e48c2760e0f56ff" is_pre_election: true
I20260709 13:13:49.131345  2267 leader_election.cc:290] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:49.130479  2216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaaff3a47de402a94f42a6637afbecc" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096950e469ac459c8e48c2760e0f56ff" is_pre_election: true
I20260709 13:13:49.130775  2218 raft_consensus.cc:2468] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 0.
I20260709 13:13:49.138613  2295 raft_consensus.cc:493] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.139665  2295 raft_consensus.cc:515] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.142027  2268 raft_consensus.cc:493] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.137882  2267 raft_consensus.cc:493] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.145407  2268 raft_consensus.cc:515] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.147749  2267 raft_consensus.cc:515] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.155431  2183 leader_election.cc:304] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a51c4c68e76941b59c71006c77272966; no voters: 
I20260709 13:13:49.155560  2295 leader_election.cc:290] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:49.156368  2268 leader_election.cc:290] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:49.157130  2271 raft_consensus.cc:2804] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.157482  2271 raft_consensus.cc:493] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.158471  2271 raft_consensus.cc:3060] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.167434  2267 leader_election.cc:290] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:49.214545  2271 raft_consensus.cc:515] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.214546  2063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d000d212ec343cea0340f6217aeb246" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874" is_pre_election: true
I20260709 13:13:49.238682  2267 raft_consensus.cc:493] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.238999  2183 leader_election.cc:304] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a51c4c68e76941b59c71006c77272966; no voters: 
I20260709 13:13:49.239202  2063 raft_consensus.cc:2468] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 0.
W20260709 13:13:49.166703  2110 leader_election.cc:343] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.240604  2108 leader_election.cc:304] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:49.172544  2294 raft_consensus.cc:493] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.213825  2263 raft_consensus.cc:359] T df7e54fd225b4faf9ed557ab7f3067e0 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.206823  2065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874" is_pre_election: true
I20260709 13:13:49.242089  2263 raft_consensus.cc:385] T df7e54fd225b4faf9ed557ab7f3067e0 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.242612  2263 raft_consensus.cc:740] T df7e54fd225b4faf9ed557ab7f3067e0 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.242005  2294 raft_consensus.cc:515] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
W20260709 13:13:49.240475  2110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:42021, user_credentials={real_user=slave}} blocked reactor thread for 109397us
I20260709 13:13:49.242664  2065 raft_consensus.cc:2468] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 0.
I20260709 13:13:49.239382  2267 raft_consensus.cc:515] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.241111  2063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47edadac9a9f49fe96b4310b99745134" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:49.197239  2067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a55788b5394d93b52dfcd4c04b0ea2" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874" is_pre_election: true
I20260709 13:13:49.244472  2268 raft_consensus.cc:493] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.247215  2263 consensus_queue.cc:260] T df7e54fd225b4faf9ed557ab7f3067e0 P 096950e469ac459c8e48c2760e0f56ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
W20260709 13:13:49.255031  2182 leader_election.cc:343] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.255939  2271 leader_election.cc:290] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403)
I20260709 13:13:49.256524  2271 raft_consensus.cc:2804] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.256875  2271 raft_consensus.cc:493] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.257247  2271 raft_consensus.cc:3060] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.255275  2268 raft_consensus.cc:515] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.259562  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d000d212ec343cea0340f6217aeb246" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096950e469ac459c8e48c2760e0f56ff" is_pre_election: true
I20260709 13:13:49.176376  2068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d000d212ec343cea0340f6217aeb246" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874" is_pre_election: true
I20260709 13:13:49.173213  2069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47edadac9a9f49fe96b4310b99745134" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874" is_pre_election: true
I20260709 13:13:49.262756  2268 leader_election.cc:290] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:49.265146  2294 leader_election.cc:290] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:49.265372  2216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb927f7bd87438c970a2cb051fea53e" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096950e469ac459c8e48c2760e0f56ff" is_pre_election: true
I20260709 13:13:49.265782  2299 raft_consensus.cc:2804] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.266211  2299 raft_consensus.cc:493] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.201439  2066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b242b4def0cd410d9a5bbdf24c5a9645" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874" is_pre_election: true
I20260709 13:13:49.223467  2062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb927f7bd87438c970a2cb051fea53e" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874" is_pre_election: true
I20260709 13:13:49.266534  2299 raft_consensus.cc:3060] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.207046  2064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaaff3a47de402a94f42a6637afbecc" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874" is_pre_election: true
I20260709 13:13:49.273976  2143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47edadac9a9f49fe96b4310b99745134" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a51c4c68e76941b59c71006c77272966"
I20260709 13:13:49.274853  2143 raft_consensus.cc:3060] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.276013  2063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7e54fd225b4faf9ed557ab7f3067e0" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874" is_pre_election: true
I20260709 13:13:49.260442  2067 raft_consensus.cc:2468] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 0.
I20260709 13:13:49.278712  2216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d000d212ec343cea0340f6217aeb246" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096950e469ac459c8e48c2760e0f56ff" is_pre_election: true
I20260709 13:13:49.278903  2217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910bee8ef2a8424ab11eb9bc175b3c73" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096950e469ac459c8e48c2760e0f56ff" is_pre_election: true
I20260709 13:13:49.279230  2064 raft_consensus.cc:2468] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 0.
I20260709 13:13:49.281096  2267 leader_election.cc:290] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:49.261592  2108 leader_election.cc:304] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:49.281939  2263 ts_tablet_manager.cc:1434] T df7e54fd225b4faf9ed557ab7f3067e0 P 096950e469ac459c8e48c2760e0f56ff: Time spent starting tablet: real 0.180s	user 0.049s	sys 0.027s
I20260709 13:13:49.282814  2217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a55788b5394d93b52dfcd4c04b0ea2" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096950e469ac459c8e48c2760e0f56ff" is_pre_election: true
W20260709 13:13:49.282761  2110 leader_election.cc:343] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.283389  2108 leader_election.cc:304] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:49.268175  2068 raft_consensus.cc:2468] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 096950e469ac459c8e48c2760e0f56ff in term 0.
I20260709 13:13:49.284526  2263 tablet_bootstrap.cc:492] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff: Bootstrap starting.
I20260709 13:13:49.284369  2108 leader_election.cc:304] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874; no voters: 096950e469ac459c8e48c2760e0f56ff
I20260709 13:13:49.285583  2216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096950e469ac459c8e48c2760e0f56ff" is_pre_election: true
I20260709 13:13:49.285597  2294 raft_consensus.cc:2804] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:13:49.285773  2182 leader_election.cc:343] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.286216  2294 raft_consensus.cc:493] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.286664  2294 raft_consensus.cc:3060] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.290334  2267 raft_consensus.cc:2804] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.290390  2262 tablet_bootstrap.cc:654] T b242b4def0cd410d9a5bbdf24c5a9645 P a9ba85a12f4440719ca1eb081b9bf874: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.281687  2271 raft_consensus.cc:515] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
W20260709 13:13:49.292613  2035 leader_election.cc:343] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:49.294190  2108 leader_election.cc:343] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:49.294214  2035 leader_election.cc:343] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.294886  2218 raft_consensus.cc:2393] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a51c4c68e76941b59c71006c77272966 in current term 1: Already voted for candidate 096950e469ac459c8e48c2760e0f56ff in this term.
W20260709 13:13:49.295248  2035 leader_election.cc:343] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.282186  2063 raft_consensus.cc:2468] T df7e54fd225b4faf9ed557ab7f3067e0 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 0.
I20260709 13:13:49.291249  2267 raft_consensus.cc:493] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.297948  2267 raft_consensus.cc:3060] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.298230  2144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d000d212ec343cea0340f6217aeb246" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a51c4c68e76941b59c71006c77272966"
I20260709 13:13:49.299353  2064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d000d212ec343cea0340f6217aeb246" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:49.300282  2064 raft_consensus.cc:3060] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:49.294922  2108 leader_election.cc:343] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.302210  2108 leader_election.cc:304] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:49.302767  2069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910bee8ef2a8424ab11eb9bc175b3c73" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874" is_pre_election: true
I20260709 13:13:49.304652  2069 raft_consensus.cc:2468] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 0.
W20260709 13:13:49.307088  2110 leader_election.cc:343] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.297492  2271 leader_election.cc:290] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403)
I20260709 13:13:49.310545  2302 raft_consensus.cc:2804] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.311014  2302 raft_consensus.cc:493] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.311374  2302 raft_consensus.cc:3060] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.314623  2143 raft_consensus.cc:2468] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 096950e469ac459c8e48c2760e0f56ff in term 1.
I20260709 13:13:49.315428  2294 raft_consensus.cc:515] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.315879  2110 leader_election.cc:304] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a51c4c68e76941b59c71006c77272966; no voters: a9ba85a12f4440719ca1eb081b9bf874
I20260709 13:13:49.317981  2183 leader_election.cc:304] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a51c4c68e76941b59c71006c77272966; no voters: a9ba85a12f4440719ca1eb081b9bf874
I20260709 13:13:49.320740  2271 raft_consensus.cc:2804] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:49.319643  2303 raft_consensus.cc:2804] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.322211  2303 raft_consensus.cc:493] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.322558  2303 raft_consensus.cc:3060] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.320425  2108 leader_election.cc:304] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:49.321568  2271 raft_consensus.cc:697] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 1 LEADER]: Becoming Leader. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Running, Role: LEADER
I20260709 13:13:49.328470  2294 leader_election.cc:290] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
W20260709 13:13:49.331012  2110 leader_election.cc:343] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.332386  2294 raft_consensus.cc:2804] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.334095  2069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:49.331476  2110 leader_election.cc:304] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a51c4c68e76941b59c71006c77272966; no voters: 096950e469ac459c8e48c2760e0f56ff, a9ba85a12f4440719ca1eb081b9bf874
I20260709 13:13:49.335490  2294 raft_consensus.cc:493] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.336545  2069 raft_consensus.cc:3060] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.336681  2294 raft_consensus.cc:3060] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.335809  2271 consensus_queue.cc:237] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.339888  2263 tablet_bootstrap.cc:654] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.343983  2064 raft_consensus.cc:2468] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 096950e469ac459c8e48c2760e0f56ff in term 1.
I20260709 13:13:49.345137  2182 leader_election.cc:304] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:49.345475  2304 raft_consensus.cc:2804] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.346236  2301 raft_consensus.cc:2804] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:49.347307  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7e54fd225b4faf9ed557ab7f3067e0" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096950e469ac459c8e48c2760e0f56ff" is_pre_election: true
I20260709 13:13:49.354013  2301 raft_consensus.cc:697] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 1 LEADER]: Becoming Leader. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Running, Role: LEADER
I20260709 13:13:49.354029  2218 raft_consensus.cc:2468] T df7e54fd225b4faf9ed557ab7f3067e0 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 0.
I20260709 13:13:49.343276  2305 raft_consensus.cc:2749] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:49.359372  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910bee8ef2a8424ab11eb9bc175b3c73" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096950e469ac459c8e48c2760e0f56ff" is_pre_election: true
I20260709 13:13:49.355165  2301 consensus_queue.cc:237] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
W20260709 13:13:49.365888  2110 leader_election.cc:343] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.363459  2216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:49.366389  2069 raft_consensus.cc:2468] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 1.
I20260709 13:13:49.356720  2304 raft_consensus.cc:493] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.368918  2304 raft_consensus.cc:3060] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.357563  2299 raft_consensus.cc:515] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
W20260709 13:13:49.372574  2110 leader_election.cc:343] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.375334  2267 raft_consensus.cc:515] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.376307  2108 leader_election.cc:304] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874; no voters: 096950e469ac459c8e48c2760e0f56ff
I20260709 13:13:49.379717  2305 raft_consensus.cc:2804] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:49.377584  2267 leader_election.cc:290] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:49.374794  1965 catalog_manager.cc:5697] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 096950e469ac459c8e48c2760e0f56ff (127.1.227.131). New cstate: current_term: 1 leader_uuid: "096950e469ac459c8e48c2760e0f56ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:49.384842  2299 leader_election.cc:290] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:49.387519  2305 raft_consensus.cc:697] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Becoming Leader. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:49.391850  2305 consensus_queue.cc:237] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.392455  2069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaaff3a47de402a94f42a6637afbecc" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:49.397025  2069 raft_consensus.cc:3060] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.402120  2144 raft_consensus.cc:2393] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 096950e469ac459c8e48c2760e0f56ff in current term 1: Already voted for candidate a51c4c68e76941b59c71006c77272966 in this term.
I20260709 13:13:49.388396  2303 raft_consensus.cc:515] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.397156  2140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a55788b5394d93b52dfcd4c04b0ea2" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a51c4c68e76941b59c71006c77272966" is_pre_election: true
I20260709 13:13:49.404783  2141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a51c4c68e76941b59c71006c77272966" is_pre_election: true
I20260709 13:13:49.409310  2262 tablet_bootstrap.cc:492] T b242b4def0cd410d9a5bbdf24c5a9645 P a9ba85a12f4440719ca1eb081b9bf874: No bootstrap required, opened a new log
I20260709 13:13:49.408722  2143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d000d212ec343cea0340f6217aeb246" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a51c4c68e76941b59c71006c77272966" is_pre_election: true
I20260709 13:13:49.408602  2142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910bee8ef2a8424ab11eb9bc175b3c73" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a51c4c68e76941b59c71006c77272966" is_pre_election: true
I20260709 13:13:49.410082  2216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaaff3a47de402a94f42a6637afbecc" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:49.410216  2064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d000d212ec343cea0340f6217aeb246" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:49.414855  2034 leader_election.cc:304] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9ba85a12f4440719ca1eb081b9bf874; no voters: 096950e469ac459c8e48c2760e0f56ff, a51c4c68e76941b59c71006c77272966
I20260709 13:13:49.415982  2294 raft_consensus.cc:515] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.413362  2262 ts_tablet_manager.cc:1403] T b242b4def0cd410d9a5bbdf24c5a9645 P a9ba85a12f4440719ca1eb081b9bf874: Time spent bootstrapping tablet: real 0.291s	user 0.016s	sys 0.007s
W20260709 13:13:49.417008  2110 leader_election.cc:343] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.420466  2064 raft_consensus.cc:2393] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a51c4c68e76941b59c71006c77272966 in current term 1: Already voted for candidate 096950e469ac459c8e48c2760e0f56ff in this term.
I20260709 13:13:49.421083  2268 raft_consensus.cc:2749] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:49.421897  2034 leader_election.cc:304] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9ba85a12f4440719ca1eb081b9bf874; no voters: 096950e469ac459c8e48c2760e0f56ff, a51c4c68e76941b59c71006c77272966
I20260709 13:13:49.422714  2295 raft_consensus.cc:2749] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:49.417549  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d000d212ec343cea0340f6217aeb246" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:49.423439  2262 raft_consensus.cc:359] T b242b4def0cd410d9a5bbdf24c5a9645 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
W20260709 13:13:49.424005  2013 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:49.424124  2262 raft_consensus.cc:385] T b242b4def0cd410d9a5bbdf24c5a9645 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.424548  2262 raft_consensus.cc:740] T b242b4def0cd410d9a5bbdf24c5a9645 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9ba85a12f4440719ca1eb081b9bf874, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.425449  2108 leader_election.cc:304] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a51c4c68e76941b59c71006c77272966; no voters: 096950e469ac459c8e48c2760e0f56ff, a9ba85a12f4440719ca1eb081b9bf874
I20260709 13:13:49.426680  2299 raft_consensus.cc:2749] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:49.425438  2262 consensus_queue.cc:260] T b242b4def0cd410d9a5bbdf24c5a9645 P a9ba85a12f4440719ca1eb081b9bf874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.441728  2064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b242b4def0cd410d9a5bbdf24c5a9645" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:49.442447  2064 raft_consensus.cc:3060] T b242b4def0cd410d9a5bbdf24c5a9645 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.435115  2302 raft_consensus.cc:515] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.445551  2304 raft_consensus.cc:515] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.457103  2140 raft_consensus.cc:2393] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9ba85a12f4440719ca1eb081b9bf874 in current term 1: Already voted for candidate a51c4c68e76941b59c71006c77272966 in this term.
I20260709 13:13:49.456568  2063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7e54fd225b4faf9ed557ab7f3067e0" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:49.459280  2063 raft_consensus.cc:3060] T df7e54fd225b4faf9ed557ab7f3067e0 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.459589  2262 ts_tablet_manager.cc:1434] T b242b4def0cd410d9a5bbdf24c5a9645 P a9ba85a12f4440719ca1eb081b9bf874: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:13:49.460682  2262 tablet_bootstrap.cc:492] T 2bb927f7bd87438c970a2cb051fea53e P a9ba85a12f4440719ca1eb081b9bf874: Bootstrap starting.
I20260709 13:13:49.460602  2034 leader_election.cc:304] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9ba85a12f4440719ca1eb081b9bf874; no voters: 096950e469ac459c8e48c2760e0f56ff, a51c4c68e76941b59c71006c77272966
I20260709 13:13:49.465405  2142 raft_consensus.cc:2393] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9ba85a12f4440719ca1eb081b9bf874 in current term 1: Already voted for candidate a51c4c68e76941b59c71006c77272966 in this term.
I20260709 13:13:49.462574  2268 raft_consensus.cc:3060] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.465849  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b242b4def0cd410d9a5bbdf24c5a9645" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:49.466364  2216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7e54fd225b4faf9ed557ab7f3067e0" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:49.461357  2294 leader_election.cc:290] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:49.466907  2218 raft_consensus.cc:3060] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.462239  2303 leader_election.cc:290] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:49.458316  2064 raft_consensus.cc:2468] T b242b4def0cd410d9a5bbdf24c5a9645 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 1.
I20260709 13:13:49.467432  2216 raft_consensus.cc:3060] T df7e54fd225b4faf9ed557ab7f3067e0 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.471648  2263 tablet_bootstrap.cc:492] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff: No bootstrap required, opened a new log
I20260709 13:13:49.472636  2263 ts_tablet_manager.cc:1403] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff: Time spent bootstrapping tablet: real 0.188s	user 0.022s	sys 0.020s
I20260709 13:13:49.473158  2108 leader_election.cc:304] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:49.473942  2034 leader_election.cc:304] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9ba85a12f4440719ca1eb081b9bf874; no voters: 096950e469ac459c8e48c2760e0f56ff, a51c4c68e76941b59c71006c77272966
I20260709 13:13:49.474736  2295 raft_consensus.cc:3060] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.478470  2063 raft_consensus.cc:2468] T df7e54fd225b4faf9ed557ab7f3067e0 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 1.
I20260709 13:13:49.479823  1966 catalog_manager.cc:5697] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 reported cstate change: term changed from 0 to 1, leader changed from <none> to a51c4c68e76941b59c71006c77272966 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "a51c4c68e76941b59c71006c77272966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:49.482124  2218 raft_consensus.cc:2468] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 1.
I20260709 13:13:49.484236  2108 leader_election.cc:304] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:49.485543  2064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a55788b5394d93b52dfcd4c04b0ea2" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:49.483784  2294 raft_consensus.cc:2804] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:49.490197  2294 raft_consensus.cc:697] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Becoming Leader. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:49.490852  2268 raft_consensus.cc:2749] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:49.490876  2295 raft_consensus.cc:2749] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:49.491050  2294 consensus_queue.cc:237] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.493906  2302 leader_election.cc:290] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:49.494395  2263 raft_consensus.cc:359] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.495097  2263 raft_consensus.cc:385] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.495210  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a55788b5394d93b52dfcd4c04b0ea2" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:49.495417  2263 raft_consensus.cc:740] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.488946  2216 raft_consensus.cc:2468] T df7e54fd225b4faf9ed557ab7f3067e0 P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 1.
I20260709 13:13:49.486454  2303 raft_consensus.cc:2804] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:49.498221  2303 raft_consensus.cc:697] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Becoming Leader. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:49.499279  2303 consensus_queue.cc:237] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.500083  2063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910bee8ef2a8424ab11eb9bc175b3c73" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:49.501425  2262 tablet_bootstrap.cc:654] T 2bb927f7bd87438c970a2cb051fea53e P a9ba85a12f4440719ca1eb081b9bf874: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.501235  2069 raft_consensus.cc:2468] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 1.
I20260709 13:13:49.503484  2304 leader_election.cc:290] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:49.505636  2216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910bee8ef2a8424ab11eb9bc175b3c73" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:49.509917  2108 leader_election.cc:304] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874; no voters: 096950e469ac459c8e48c2760e0f56ff
I20260709 13:13:49.517580  2263 consensus_queue.cc:260] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.518457  2304 raft_consensus.cc:2804] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:49.510299  2064 raft_consensus.cc:2468] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 1.
I20260709 13:13:49.526273  2263 ts_tablet_manager.cc:1434] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.004s
I20260709 13:13:49.522112  2304 raft_consensus.cc:697] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Becoming Leader. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:49.533589  2263 tablet_bootstrap.cc:492] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff: Bootstrap starting.
I20260709 13:13:49.535583  2304 consensus_queue.cc:237] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
W20260709 13:13:49.536633  2110 leader_election.cc:343] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:49.537390  2110 leader_election.cc:343] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.539217  2108 leader_election.cc:304] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874; no voters: 096950e469ac459c8e48c2760e0f56ff
I20260709 13:13:49.539316  2063 raft_consensus.cc:2468] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 1.
I20260709 13:13:49.540661  2108 leader_election.cc:304] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874; no voters: 096950e469ac459c8e48c2760e0f56ff
I20260709 13:13:49.541707  2294 raft_consensus.cc:2804] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:49.542886  2302 raft_consensus.cc:2804] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:49.544878  2302 raft_consensus.cc:697] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Becoming Leader. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:49.543026  2294 raft_consensus.cc:697] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Becoming Leader. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:49.545921  2302 consensus_queue.cc:237] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.546425  2294 consensus_queue.cc:237] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.549170  2263 tablet_bootstrap.cc:654] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.554404  2262 tablet_bootstrap.cc:492] T 2bb927f7bd87438c970a2cb051fea53e P a9ba85a12f4440719ca1eb081b9bf874: No bootstrap required, opened a new log
I20260709 13:13:49.556603  2262 ts_tablet_manager.cc:1403] T 2bb927f7bd87438c970a2cb051fea53e P a9ba85a12f4440719ca1eb081b9bf874: Time spent bootstrapping tablet: real 0.096s	user 0.008s	sys 0.016s
I20260709 13:13:49.560406  2262 raft_consensus.cc:359] T 2bb927f7bd87438c970a2cb051fea53e P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.561082  2262 raft_consensus.cc:385] T 2bb927f7bd87438c970a2cb051fea53e P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.561398  2262 raft_consensus.cc:740] T 2bb927f7bd87438c970a2cb051fea53e P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9ba85a12f4440719ca1eb081b9bf874, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.562180  2262 consensus_queue.cc:260] T 2bb927f7bd87438c970a2cb051fea53e P a9ba85a12f4440719ca1eb081b9bf874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.567008  2262 ts_tablet_manager.cc:1434] T 2bb927f7bd87438c970a2cb051fea53e P a9ba85a12f4440719ca1eb081b9bf874: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:13:49.568058  2262 tablet_bootstrap.cc:492] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874: Bootstrap starting.
I20260709 13:13:49.574121  2262 tablet_bootstrap.cc:654] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.578423  1965 catalog_manager.cc:5697] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 096950e469ac459c8e48c2760e0f56ff (127.1.227.131). New cstate: current_term: 1 leader_uuid: "096950e469ac459c8e48c2760e0f56ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:49.608505  2262 tablet_bootstrap.cc:492] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874: No bootstrap required, opened a new log
I20260709 13:13:49.609052  2262 ts_tablet_manager.cc:1403] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.003s
I20260709 13:13:49.609228  1966 catalog_manager.cc:5697] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 reported cstate change: term changed from 0 to 1, leader changed from <none> to a51c4c68e76941b59c71006c77272966 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "a51c4c68e76941b59c71006c77272966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:49.610827  1966 catalog_manager.cc:5697] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 reported cstate change: term changed from 0 to 1, leader changed from <none> to a51c4c68e76941b59c71006c77272966 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "a51c4c68e76941b59c71006c77272966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:49.611950  2262 raft_consensus.cc:359] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.611912  1966 catalog_manager.cc:5697] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 reported cstate change: term changed from 0 to 1, leader changed from <none> to a51c4c68e76941b59c71006c77272966 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "a51c4c68e76941b59c71006c77272966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:49.612758  2262 raft_consensus.cc:385] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.613108  2262 raft_consensus.cc:740] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9ba85a12f4440719ca1eb081b9bf874, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.613128  1966 catalog_manager.cc:5697] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 reported cstate change: term changed from 0 to 1, leader changed from <none> to a51c4c68e76941b59c71006c77272966 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "a51c4c68e76941b59c71006c77272966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:49.613983  2262 consensus_queue.cc:260] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.616393  2262 ts_tablet_manager.cc:1434] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:49.614917  1966 catalog_manager.cc:5697] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 reported cstate change: term changed from 0 to 1, leader changed from <none> to a51c4c68e76941b59c71006c77272966 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "a51c4c68e76941b59c71006c77272966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:49.618175  2263 tablet_bootstrap.cc:492] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff: No bootstrap required, opened a new log
I20260709 13:13:49.618630  2263 ts_tablet_manager.cc:1403] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff: Time spent bootstrapping tablet: real 0.085s	user 0.021s	sys 0.012s
I20260709 13:13:49.623736  2263 raft_consensus.cc:359] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.624454  2263 raft_consensus.cc:385] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.624738  2263 raft_consensus.cc:740] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.625486  2263 consensus_queue.cc:260] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.627743  2263 ts_tablet_manager.cc:1434] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:49.629228  2263 tablet_bootstrap.cc:492] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff: Bootstrap starting.
I20260709 13:13:49.635087  2263 tablet_bootstrap.cc:654] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.636291  2268 raft_consensus.cc:493] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.636750  2268 raft_consensus.cc:515] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.638798  2268 leader_election.cc:290] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:49.640533  2142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47edadac9a9f49fe96b4310b99745134" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a51c4c68e76941b59c71006c77272966" is_pre_election: true
I20260709 13:13:49.640486  2216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47edadac9a9f49fe96b4310b99745134" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096950e469ac459c8e48c2760e0f56ff" is_pre_election: true
I20260709 13:13:49.641520  2142 raft_consensus.cc:2393] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9ba85a12f4440719ca1eb081b9bf874 in current term 1: Already voted for candidate 096950e469ac459c8e48c2760e0f56ff in this term.
I20260709 13:13:49.642937  2035 leader_election.cc:304] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9ba85a12f4440719ca1eb081b9bf874; no voters: 096950e469ac459c8e48c2760e0f56ff, a51c4c68e76941b59c71006c77272966
I20260709 13:13:49.644052  2268 raft_consensus.cc:3060] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.648010  2263 tablet_bootstrap.cc:492] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff: No bootstrap required, opened a new log
I20260709 13:13:49.648543  2263 ts_tablet_manager.cc:1403] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:13:49.651253  2263 raft_consensus.cc:359] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.651926  2263 raft_consensus.cc:385] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.652243  2263 raft_consensus.cc:740] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.652951  2268 raft_consensus.cc:2749] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:49.652995  2263 consensus_queue.cc:260] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.656533  2263 ts_tablet_manager.cc:1434] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:49.657588  2263 tablet_bootstrap.cc:492] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff: Bootstrap starting.
I20260709 13:13:49.664040  2263 tablet_bootstrap.cc:654] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.668884  2263 tablet_bootstrap.cc:492] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff: No bootstrap required, opened a new log
I20260709 13:13:49.669308  2263 ts_tablet_manager.cc:1403] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 13:13:49.672057  2263 raft_consensus.cc:359] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.672765  2263 raft_consensus.cc:385] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.673080  2263 raft_consensus.cc:740] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.673866  2263 consensus_queue.cc:260] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.675797  2263 ts_tablet_manager.cc:1434] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:49.676725  2263 tablet_bootstrap.cc:492] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff: Bootstrap starting.
I20260709 13:13:49.682803  2263 tablet_bootstrap.cc:654] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.687958  2263 tablet_bootstrap.cc:492] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff: No bootstrap required, opened a new log
I20260709 13:13:49.688405  2263 ts_tablet_manager.cc:1403] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:13:49.690907  2263 raft_consensus.cc:359] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.691569  2263 raft_consensus.cc:385] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.691840  2263 raft_consensus.cc:740] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.692508  2263 consensus_queue.cc:260] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.694628  2263 ts_tablet_manager.cc:1434] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:49.738926  2301 raft_consensus.cc:493] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.739411  2301 raft_consensus.cc:515] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.741345  2301 leader_election.cc:290] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403)
I20260709 13:13:49.742187  2063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874" is_pre_election: true
I20260709 13:13:49.742661  2142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a51c4c68e76941b59c71006c77272966" is_pre_election: true
I20260709 13:13:49.743074  2063 raft_consensus.cc:2393] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 096950e469ac459c8e48c2760e0f56ff in current term 1: Already voted for candidate a51c4c68e76941b59c71006c77272966 in this term.
I20260709 13:13:49.745173  2182 leader_election.cc:304] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff; no voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874
I20260709 13:13:49.746047  2271 raft_consensus.cc:3060] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.747684  2301 consensus_queue.cc:1048] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:49.752357  2271 raft_consensus.cc:2749] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:49.764822  2271 consensus_queue.cc:1048] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:49.784377  2301 consensus_queue.cc:1048] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:49.800084  2300 consensus_queue.cc:1048] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:49.850193  2271 raft_consensus.cc:493] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.850685  2271 raft_consensus.cc:515] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.852850  2271 leader_election.cc:290] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403)
I20260709 13:13:49.853847  2063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb927f7bd87438c970a2cb051fea53e" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874" is_pre_election: true
I20260709 13:13:49.854183  2142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb927f7bd87438c970a2cb051fea53e" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a51c4c68e76941b59c71006c77272966" is_pre_election: true
I20260709 13:13:49.854446  2063 raft_consensus.cc:2468] T 2bb927f7bd87438c970a2cb051fea53e P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 096950e469ac459c8e48c2760e0f56ff in term 0.
I20260709 13:13:49.854843  2142 raft_consensus.cc:2468] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 096950e469ac459c8e48c2760e0f56ff in term 0.
I20260709 13:13:49.855604  2182 leader_election.cc:304] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:49.856531  2271 raft_consensus.cc:2804] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.856987  2271 raft_consensus.cc:493] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.857306  2271 raft_consensus.cc:3060] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.861625  2271 raft_consensus.cc:515] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.863782  2271 leader_election.cc:290] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403)
I20260709 13:13:49.864322  2063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb927f7bd87438c970a2cb051fea53e" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:49.864415  2142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb927f7bd87438c970a2cb051fea53e" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a51c4c68e76941b59c71006c77272966"
I20260709 13:13:49.865011  2063 raft_consensus.cc:3060] T 2bb927f7bd87438c970a2cb051fea53e P a9ba85a12f4440719ca1eb081b9bf874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.865065  2142 raft_consensus.cc:3060] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.869715  2142 raft_consensus.cc:2468] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 096950e469ac459c8e48c2760e0f56ff in term 1.
I20260709 13:13:49.870893  2183 leader_election.cc:304] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a51c4c68e76941b59c71006c77272966; no voters: 
I20260709 13:13:49.871667  2271 raft_consensus.cc:2804] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:49.871753  2063 raft_consensus.cc:2468] T 2bb927f7bd87438c970a2cb051fea53e P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 096950e469ac459c8e48c2760e0f56ff in term 1.
I20260709 13:13:49.872853  2271 raft_consensus.cc:697] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [term 1 LEADER]: Becoming Leader. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Running, Role: LEADER
I20260709 13:13:49.873639  2271 consensus_queue.cc:237] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.881065  1966 catalog_manager.cc:5697] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 096950e469ac459c8e48c2760e0f56ff (127.1.227.131). New cstate: current_term: 1 leader_uuid: "096950e469ac459c8e48c2760e0f56ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:49.911598  2294 consensus_queue.cc:1048] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:49.917909  2271 raft_consensus.cc:493] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.918426  2271 raft_consensus.cc:515] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.920496  2271 leader_election.cc:290] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403)
I20260709 13:13:49.922117  2142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaaff3a47de402a94f42a6637afbecc" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a51c4c68e76941b59c71006c77272966" is_pre_election: true
I20260709 13:13:49.924597  2063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaaff3a47de402a94f42a6637afbecc" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874" is_pre_election: true
I20260709 13:13:49.925457  2063 raft_consensus.cc:2393] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 096950e469ac459c8e48c2760e0f56ff in current term 1: Already voted for candidate a51c4c68e76941b59c71006c77272966 in this term.
I20260709 13:13:49.926620  2182 leader_election.cc:304] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff; no voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874
I20260709 13:13:49.928447  2304 consensus_queue.cc:1048] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:49.928705  2299 consensus_queue.cc:1048] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:49.930634  2333 raft_consensus.cc:3060] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.943758  2333 raft_consensus.cc:2749] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:49.943821  2302 consensus_queue.cc:1048] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:49.950284  2333 raft_consensus.cc:493] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.950963  2333 raft_consensus.cc:515] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.953583  2271 raft_consensus.cc:493] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.954419  2333 leader_election.cc:290] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403)
I20260709 13:13:49.954149  2271 raft_consensus.cc:515] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:49.954703  2069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910bee8ef2a8424ab11eb9bc175b3c73" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874" is_pre_election: true
I20260709 13:13:49.955614  2069 raft_consensus.cc:2393] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 096950e469ac459c8e48c2760e0f56ff in current term 1: Already voted for candidate a51c4c68e76941b59c71006c77272966 in this term.
I20260709 13:13:49.956355  2271 leader_election.cc:290] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403)
I20260709 13:13:49.958624  2142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910bee8ef2a8424ab11eb9bc175b3c73" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a51c4c68e76941b59c71006c77272966" is_pre_election: true
I20260709 13:13:49.959129  2140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a55788b5394d93b52dfcd4c04b0ea2" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a51c4c68e76941b59c71006c77272966" is_pre_election: true
I20260709 13:13:49.960669  2182 leader_election.cc:304] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff; no voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874
I20260709 13:13:49.961400  2271 raft_consensus.cc:3060] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.964309  2064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a55788b5394d93b52dfcd4c04b0ea2" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874" is_pre_election: true
I20260709 13:13:49.965092  2064 raft_consensus.cc:2393] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 096950e469ac459c8e48c2760e0f56ff in current term 1: Already voted for candidate a51c4c68e76941b59c71006c77272966 in this term.
I20260709 13:13:49.966176  2182 leader_election.cc:304] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff; no voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874
I20260709 13:13:49.967283  2333 raft_consensus.cc:3060] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.974342  2271 raft_consensus.cc:2749] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:49.977413  2333 raft_consensus.cc:2749] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:50.023535  2294 consensus_queue.cc:1048] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.039834  2299 consensus_queue.cc:1048] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.040002  2294 consensus_queue.cc:1048] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.063087  2299 consensus_queue.cc:1048] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.084209  2299 consensus_queue.cc:1048] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.084839  2303 consensus_queue.cc:1048] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.091030  2302 consensus_queue.cc:1048] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:50.104100  2302 consensus_queue.cc:1048] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:50.169868  2140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167"
dest_uuid: "a51c4c68e76941b59c71006c77272966"
mode: GRACEFUL
new_leader_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
 from {username='slave'} at 127.0.0.1:52066
I20260709 13:13:50.170531  2140 raft_consensus.cc:606] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Received request to transfer leadership to TS a9ba85a12f4440719ca1eb081b9bf874
I20260709 13:13:50.176213  2140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "910bee8ef2a8424ab11eb9bc175b3c73"
dest_uuid: "a51c4c68e76941b59c71006c77272966"
mode: GRACEFUL
new_leader_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
 from {username='slave'} at 127.0.0.1:52066
I20260709 13:13:50.176712  2140 raft_consensus.cc:606] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Received request to transfer leadership to TS a9ba85a12f4440719ca1eb081b9bf874
I20260709 13:13:50.190650  2216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47edadac9a9f49fe96b4310b99745134"
dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
mode: GRACEFUL
new_leader_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
 from {username='slave'} at 127.0.0.1:33638
I20260709 13:13:50.191172  2216 raft_consensus.cc:606] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 1 LEADER]: Received request to transfer leadership to TS a9ba85a12f4440719ca1eb081b9bf874
I20260709 13:13:50.196774  2140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eaaaff3a47de402a94f42a6637afbecc"
dest_uuid: "a51c4c68e76941b59c71006c77272966"
mode: GRACEFUL
new_leader_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
 from {username='slave'} at 127.0.0.1:52066
I20260709 13:13:50.197286  2140 raft_consensus.cc:606] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Received request to transfer leadership to TS a9ba85a12f4440719ca1eb081b9bf874
I20260709 13:13:50.202507  2216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d000d212ec343cea0340f6217aeb246"
dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
mode: GRACEFUL
new_leader_uuid: "a51c4c68e76941b59c71006c77272966"
 from {username='slave'} at 127.0.0.1:33638
I20260709 13:13:50.203054  2216 raft_consensus.cc:606] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 1 LEADER]: Received request to transfer leadership to TS a51c4c68e76941b59c71006c77272966
I20260709 13:13:50.208227  2216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bb927f7bd87438c970a2cb051fea53e"
dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
mode: GRACEFUL
new_leader_uuid: "a51c4c68e76941b59c71006c77272966"
 from {username='slave'} at 127.0.0.1:33638
I20260709 13:13:50.208721  2216 raft_consensus.cc:606] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [term 1 LEADER]: Received request to transfer leadership to TS a51c4c68e76941b59c71006c77272966
I20260709 13:13:50.219446  2140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b242b4def0cd410d9a5bbdf24c5a9645"
dest_uuid: "a51c4c68e76941b59c71006c77272966"
mode: GRACEFUL
new_leader_uuid: "096950e469ac459c8e48c2760e0f56ff"
 from {username='slave'} at 127.0.0.1:52066
I20260709 13:13:50.219960  2140 raft_consensus.cc:606] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Received request to transfer leadership to TS 096950e469ac459c8e48c2760e0f56ff
I20260709 13:13:50.237566  2271 raft_consensus.cc:993] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff: : Instructing follower a51c4c68e76941b59c71006c77272966 to start an election
I20260709 13:13:50.238093  2333 raft_consensus.cc:1081] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 1 LEADER]: Signalling peer a51c4c68e76941b59c71006c77272966 to start an election
I20260709 13:13:50.240103  2140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d000d212ec343cea0340f6217aeb246"
dest_uuid: "a51c4c68e76941b59c71006c77272966"
 from {username='slave'} at 127.0.0.1:52054
I20260709 13:13:50.240713  2140 raft_consensus.cc:493] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:50.241084  2140 raft_consensus.cc:3060] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.247984  2140 raft_consensus.cc:515] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.250370  2140 leader_election.cc:290] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 2 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:50.251160  2063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d000d212ec343cea0340f6217aeb246" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:50.251616  2216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d000d212ec343cea0340f6217aeb246" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:50.251763  2063 raft_consensus.cc:3060] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.252210  2216 raft_consensus.cc:3055] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:50.252558  2216 raft_consensus.cc:740] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Running, Role: LEADER
I20260709 13:13:50.253363  2216 consensus_queue.cc:260] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.254468  2216 raft_consensus.cc:3060] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.258596  2063 raft_consensus.cc:2468] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 2.
I20260709 13:13:50.259218  2216 raft_consensus.cc:2468] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 2.
I20260709 13:13:50.260061  2108 leader_election.cc:304] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:50.261015  2302 raft_consensus.cc:2804] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:50.261673  2302 raft_consensus.cc:697] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 2 LEADER]: Becoming Leader. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:50.262631  2302 consensus_queue.cc:237] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.269701  1966 catalog_manager.cc:5697] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 reported cstate change: term changed from 1 to 2, leader changed from 096950e469ac459c8e48c2760e0f56ff (127.1.227.131) to a51c4c68e76941b59c71006c77272966 (127.1.227.130). New cstate: current_term: 2 leader_uuid: "a51c4c68e76941b59c71006c77272966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.349393  2351 raft_consensus.cc:993] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff: : Instructing follower a9ba85a12f4440719ca1eb081b9bf874 to start an election
I20260709 13:13:50.349967  2271 raft_consensus.cc:1081] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 1 LEADER]: Signalling peer a9ba85a12f4440719ca1eb081b9bf874 to start an election
I20260709 13:13:50.351724  2063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47edadac9a9f49fe96b4310b99745134"
dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
 from {username='slave'} at 127.0.0.1:39798
I20260709 13:13:50.352290  2063 raft_consensus.cc:493] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:50.352684  2063 raft_consensus.cc:3060] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.359500  2063 raft_consensus.cc:515] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.361816  2063 leader_election.cc:290] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 2 election: Requested vote from peers a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:50.363049  2140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47edadac9a9f49fe96b4310b99745134" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a51c4c68e76941b59c71006c77272966"
I20260709 13:13:50.363188  2216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47edadac9a9f49fe96b4310b99745134" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:50.363691  2140 raft_consensus.cc:3060] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.363834  2216 raft_consensus.cc:3055] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:50.364316  2216 raft_consensus.cc:740] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Running, Role: LEADER
I20260709 13:13:50.365195  2216 consensus_queue.cc:260] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.366634  2216 raft_consensus.cc:3060] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.372188  2140 raft_consensus.cc:2468] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9ba85a12f4440719ca1eb081b9bf874 in term 2.
I20260709 13:13:50.373620  2034 leader_election.cc:304] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:50.374012  2216 raft_consensus.cc:2468] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9ba85a12f4440719ca1eb081b9bf874 in term 2.
I20260709 13:13:50.374548  2268 raft_consensus.cc:2804] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:50.375028  2268 raft_consensus.cc:697] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 LEADER]: Becoming Leader. State: Replica: a9ba85a12f4440719ca1eb081b9bf874, State: Running, Role: LEADER
I20260709 13:13:50.375847  2268 consensus_queue.cc:237] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.380101  2271 consensus_queue.cc:1048] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.383731  1966 catalog_manager.cc:5697] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 reported cstate change: term changed from 1 to 2, leader changed from 096950e469ac459c8e48c2760e0f56ff (127.1.227.131) to a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129). New cstate: current_term: 2 leader_uuid: "a9ba85a12f4440719ca1eb081b9bf874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.395015  2333 consensus_queue.cc:1048] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.408990  2351 raft_consensus.cc:993] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff: : Instructing follower a51c4c68e76941b59c71006c77272966 to start an election
I20260709 13:13:50.409482  2333 raft_consensus.cc:1081] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [term 1 LEADER]: Signalling peer a51c4c68e76941b59c71006c77272966 to start an election
I20260709 13:13:50.411295  2140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bb927f7bd87438c970a2cb051fea53e"
dest_uuid: "a51c4c68e76941b59c71006c77272966"
 from {username='slave'} at 127.0.0.1:52054
I20260709 13:13:50.411926  2140 raft_consensus.cc:493] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:50.412313  2140 raft_consensus.cc:3060] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.419098  2140 raft_consensus.cc:515] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.421403  2140 leader_election.cc:290] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 2 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:50.422354  2063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb927f7bd87438c970a2cb051fea53e" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:50.422933  2063 raft_consensus.cc:3060] T 2bb927f7bd87438c970a2cb051fea53e P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.423009  2216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb927f7bd87438c970a2cb051fea53e" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:50.423629  2216 raft_consensus.cc:3055] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:50.423935  2216 raft_consensus.cc:740] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Running, Role: LEADER
I20260709 13:13:50.424787  2216 consensus_queue.cc:260] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.426054  2216 raft_consensus.cc:3060] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.426990  2299 raft_consensus.cc:993] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966: : Instructing follower a9ba85a12f4440719ca1eb081b9bf874 to start an election
I20260709 13:13:50.427407  2299 raft_consensus.cc:1081] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Signalling peer a9ba85a12f4440719ca1eb081b9bf874 to start an election
I20260709 13:13:50.429195  2064 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167"
dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
 from {username='slave'} at 127.0.0.1:39800
I20260709 13:13:50.429780  2064 raft_consensus.cc:493] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:50.430157  2064 raft_consensus.cc:3060] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.433902  2063 raft_consensus.cc:2468] T 2bb927f7bd87438c970a2cb051fea53e P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 2.
I20260709 13:13:50.435411  2108 leader_election.cc:304] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:50.436275  2302 raft_consensus.cc:2804] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:50.436766  2302 raft_consensus.cc:697] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [term 2 LEADER]: Becoming Leader. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:50.437582  2302 consensus_queue.cc:237] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.441777  2299 raft_consensus.cc:993] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966: : Instructing follower 096950e469ac459c8e48c2760e0f56ff to start an election
I20260709 13:13:50.439538  2064 raft_consensus.cc:515] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.442257  2304 raft_consensus.cc:1081] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Signalling peer 096950e469ac459c8e48c2760e0f56ff to start an election
I20260709 13:13:50.444100  2216 raft_consensus.cc:2468] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 2.
I20260709 13:13:50.448362  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:50.444137  2217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b242b4def0cd410d9a5bbdf24c5a9645"
dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
 from {username='slave'} at 127.0.0.1:33628
I20260709 13:13:50.449030  2217 raft_consensus.cc:493] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:50.449146  2218 raft_consensus.cc:3060] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.449469  2217 raft_consensus.cc:3060] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.446184  2140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a51c4c68e76941b59c71006c77272966"
I20260709 13:13:50.450047  2140 raft_consensus.cc:3055] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:50.450467  2140 raft_consensus.cc:740] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:50.451246  2140 consensus_queue.cc:260] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.452330  2140 raft_consensus.cc:3060] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.447456  2064 leader_election.cc:290] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 2 election: Requested vote from peers a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:50.456116  2218 raft_consensus.cc:2468] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9ba85a12f4440719ca1eb081b9bf874 in term 2.
I20260709 13:13:50.456730  2217 raft_consensus.cc:515] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.457568  2035 leader_election.cc:304] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:50.458482  2268 raft_consensus.cc:2804] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:50.458963  2268 raft_consensus.cc:697] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 LEADER]: Becoming Leader. State: Replica: a9ba85a12f4440719ca1eb081b9bf874, State: Running, Role: LEADER
I20260709 13:13:50.459831  2268 consensus_queue.cc:237] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.460523  2140 raft_consensus.cc:2468] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9ba85a12f4440719ca1eb081b9bf874 in term 2.
I20260709 13:13:50.463133  1966 catalog_manager.cc:5697] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 reported cstate change: term changed from 1 to 2, leader changed from 096950e469ac459c8e48c2760e0f56ff (127.1.227.131) to a51c4c68e76941b59c71006c77272966 (127.1.227.130). New cstate: current_term: 2 leader_uuid: "a51c4c68e76941b59c71006c77272966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.464823  2217 leader_election.cc:290] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 2 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403)
I20260709 13:13:50.466089  2064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b242b4def0cd410d9a5bbdf24c5a9645" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:50.466771  2064 raft_consensus.cc:3060] T b242b4def0cd410d9a5bbdf24c5a9645 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.466324  2140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b242b4def0cd410d9a5bbdf24c5a9645" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a51c4c68e76941b59c71006c77272966"
I20260709 13:13:50.468580  2140 raft_consensus.cc:3055] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:50.468959  2140 raft_consensus.cc:740] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:50.471305  2140 consensus_queue.cc:260] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.472694  2140 raft_consensus.cc:3060] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.477600  1964 catalog_manager.cc:5697] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 reported cstate change: term changed from 1 to 2, leader changed from a51c4c68e76941b59c71006c77272966 (127.1.227.130) to a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129). New cstate: current_term: 2 leader_uuid: "a9ba85a12f4440719ca1eb081b9bf874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.477035  2064 raft_consensus.cc:2468] T b242b4def0cd410d9a5bbdf24c5a9645 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 096950e469ac459c8e48c2760e0f56ff in term 2.
I20260709 13:13:50.481542  2140 raft_consensus.cc:2468] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 096950e469ac459c8e48c2760e0f56ff in term 2.
I20260709 13:13:50.482393  2182 leader_election.cc:304] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:50.483349  2333 raft_consensus.cc:2804] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:50.483970  2333 raft_consensus.cc:697] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff [term 2 LEADER]: Becoming Leader. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Running, Role: LEADER
I20260709 13:13:50.484887  2333 consensus_queue.cc:237] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.493937  1964 catalog_manager.cc:5697] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff reported cstate change: term changed from 1 to 2, leader changed from a51c4c68e76941b59c71006c77272966 (127.1.227.130) to 096950e469ac459c8e48c2760e0f56ff (127.1.227.131). New cstate: current_term: 2 leader_uuid: "096950e469ac459c8e48c2760e0f56ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:50.496030  2299 raft_consensus.cc:993] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966: : Instructing follower a9ba85a12f4440719ca1eb081b9bf874 to start an election
I20260709 13:13:50.496528  2302 raft_consensus.cc:1081] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Signalling peer a9ba85a12f4440719ca1eb081b9bf874 to start an election
I20260709 13:13:50.498425  2064 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eaaaff3a47de402a94f42a6637afbecc"
dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
 from {username='slave'} at 127.0.0.1:39800
I20260709 13:13:50.499136  2064 raft_consensus.cc:493] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:50.499526  2064 raft_consensus.cc:3060] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.506315  2064 raft_consensus.cc:515] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.508822  2064 leader_election.cc:290] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 2 election: Requested vote from peers a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:50.509649  2217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaaff3a47de402a94f42a6637afbecc" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:50.509649  2140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaaff3a47de402a94f42a6637afbecc" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a51c4c68e76941b59c71006c77272966"
I20260709 13:13:50.510414  2217 raft_consensus.cc:3060] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.510504  2140 raft_consensus.cc:3055] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:50.510874  2140 raft_consensus.cc:740] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:50.511703  2140 consensus_queue.cc:260] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.512893  2140 raft_consensus.cc:3060] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.517575  2217 raft_consensus.cc:2468] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9ba85a12f4440719ca1eb081b9bf874 in term 2.
I20260709 13:13:50.518754  2035 leader_election.cc:304] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:50.519639  2268 raft_consensus.cc:2804] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:50.520135  2268 raft_consensus.cc:697] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 2 LEADER]: Becoming Leader. State: Replica: a9ba85a12f4440719ca1eb081b9bf874, State: Running, Role: LEADER
I20260709 13:13:50.520228  2140 raft_consensus.cc:2468] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9ba85a12f4440719ca1eb081b9bf874 in term 2.
I20260709 13:13:50.521023  2268 consensus_queue.cc:237] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.528100  1964 catalog_manager.cc:5697] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 reported cstate change: term changed from 1 to 2, leader changed from a51c4c68e76941b59c71006c77272966 (127.1.227.130) to a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129). New cstate: current_term: 2 leader_uuid: "a9ba85a12f4440719ca1eb081b9bf874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.629675  2299 raft_consensus.cc:993] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966: : Instructing follower a9ba85a12f4440719ca1eb081b9bf874 to start an election
I20260709 13:13:50.630214  2302 raft_consensus.cc:1081] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Signalling peer a9ba85a12f4440719ca1eb081b9bf874 to start an election
I20260709 13:13:50.631727  2064 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "910bee8ef2a8424ab11eb9bc175b3c73"
dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
 from {username='slave'} at 127.0.0.1:39800
I20260709 13:13:50.632244  2064 raft_consensus.cc:493] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:50.632565  2064 raft_consensus.cc:3060] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.639274  2064 raft_consensus.cc:515] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.641206  2064 leader_election.cc:290] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 2 election: Requested vote from peers a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:50.641974  2140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910bee8ef2a8424ab11eb9bc175b3c73" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a51c4c68e76941b59c71006c77272966"
I20260709 13:13:50.642272  2217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910bee8ef2a8424ab11eb9bc175b3c73" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:50.642613  2140 raft_consensus.cc:3055] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:50.642791  2217 raft_consensus.cc:3060] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.642995  2140 raft_consensus.cc:740] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:50.643837  2140 consensus_queue.cc:260] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.647348  2218 raft_consensus.cc:1275] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Refusing update from remote peer a51c4c68e76941b59c71006c77272966: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.649551  2304 consensus_queue.cc:1048] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:50.650236  2217 raft_consensus.cc:2468] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9ba85a12f4440719ca1eb081b9bf874 in term 2.
I20260709 13:13:50.651424  2035 leader_election.cc:304] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:50.652321  2268 raft_consensus.cc:2804] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:50.652817  2268 raft_consensus.cc:697] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 LEADER]: Becoming Leader. State: Replica: a9ba85a12f4440719ca1eb081b9bf874, State: Running, Role: LEADER
I20260709 13:13:50.653676  2268 consensus_queue.cc:237] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:50.654497  2140 raft_consensus.cc:3060] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.661286  2064 raft_consensus.cc:1275] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Refusing update from remote peer a51c4c68e76941b59c71006c77272966: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.667840  2302 consensus_queue.cc:1048] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:50.669407  2140 raft_consensus.cc:2468] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9ba85a12f4440719ca1eb081b9bf874 in term 2.
I20260709 13:13:50.685045  1965 catalog_manager.cc:5697] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 reported cstate change: term changed from 1 to 2, leader changed from a51c4c68e76941b59c71006c77272966 (127.1.227.130) to a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129). New cstate: current_term: 2 leader_uuid: "a9ba85a12f4440719ca1eb081b9bf874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.797335  2217 raft_consensus.cc:1275] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Refusing update from remote peer a9ba85a12f4440719ca1eb081b9bf874: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.799842  2268 consensus_queue.cc:1048] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:50.813164  2140 raft_consensus.cc:1275] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Refusing update from remote peer a9ba85a12f4440719ca1eb081b9bf874: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.815145  2295 consensus_queue.cc:1048] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:50.878572  2217 raft_consensus.cc:1275] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Refusing update from remote peer a51c4c68e76941b59c71006c77272966: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.880079  2302 consensus_queue.cc:1048] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:50.888229  2064 raft_consensus.cc:1275] T 2bb927f7bd87438c970a2cb051fea53e P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Refusing update from remote peer a51c4c68e76941b59c71006c77272966: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.890733  2299 consensus_queue.cc:1048] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:50.901407  2217 raft_consensus.cc:1275] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Refusing update from remote peer a9ba85a12f4440719ca1eb081b9bf874: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.902829  2355 consensus_queue.cc:1048] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:50.910759  2140 raft_consensus.cc:1275] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Refusing update from remote peer a9ba85a12f4440719ca1eb081b9bf874: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.912194  2355 consensus_queue.cc:1048] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:50.929170  2140 raft_consensus.cc:1275] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Refusing update from remote peer a9ba85a12f4440719ca1eb081b9bf874: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.930604  2355 consensus_queue.cc:1048] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:50.934163  2064 raft_consensus.cc:1275] T b242b4def0cd410d9a5bbdf24c5a9645 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Refusing update from remote peer 096950e469ac459c8e48c2760e0f56ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.936124  2333 consensus_queue.cc:1048] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:50.942070  2217 raft_consensus.cc:1275] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Refusing update from remote peer a9ba85a12f4440719ca1eb081b9bf874: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.946712  2268 consensus_queue.cc:1048] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:50.954211  2140 raft_consensus.cc:1275] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Refusing update from remote peer 096950e469ac459c8e48c2760e0f56ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.956094  2271 consensus_queue.cc:1048] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:51.066530  2140 raft_consensus.cc:1275] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Refusing update from remote peer a9ba85a12f4440719ca1eb081b9bf874: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:51.067943  2268 consensus_queue.cc:1048] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:51.078631  2218 raft_consensus.cc:1275] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Refusing update from remote peer a9ba85a12f4440719ca1eb081b9bf874: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:51.080322  2295 consensus_queue.cc:1048] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:53.253330  1934 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:13:53.254244  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:53.276324  2140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01a55788b5394d93b52dfcd4c04b0ea2"
dest_uuid: "a51c4c68e76941b59c71006c77272966"
mode: GRACEFUL
new_leader_uuid: "096950e469ac459c8e48c2760e0f56ff"
 from {username='slave'} at 127.0.0.1:52080
I20260709 13:13:53.276865  2140 raft_consensus.cc:606] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Received request to transfer leadership to TS 096950e469ac459c8e48c2760e0f56ff
I20260709 13:13:53.288498  2064 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167"
dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
mode: GRACEFUL
new_leader_uuid: "096950e469ac459c8e48c2760e0f56ff"
 from {username='slave'} at 127.0.0.1:39812
I20260709 13:13:53.288990  2064 raft_consensus.cc:606] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 LEADER]: Received request to transfer leadership to TS 096950e469ac459c8e48c2760e0f56ff
I20260709 13:13:53.290319  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:53.290752  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:53.561947  2367 raft_consensus.cc:993] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874: : Instructing follower 096950e469ac459c8e48c2760e0f56ff to start an election
I20260709 13:13:53.562485  2295 raft_consensus.cc:1081] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 LEADER]: Signalling peer 096950e469ac459c8e48c2760e0f56ff to start an election
I20260709 13:13:53.564002  2217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167"
dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
 from {username='slave'} at 127.0.0.1:33630
I20260709 13:13:53.564478  2217 raft_consensus.cc:493] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:53.564800  2217 raft_consensus.cc:3060] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:53.569171  2217 raft_consensus.cc:515] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:53.570863  2217 leader_election.cc:290] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 3 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403)
I20260709 13:13:53.571923  2140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a51c4c68e76941b59c71006c77272966"
I20260709 13:13:53.571879  2064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:53.572598  2140 raft_consensus.cc:3060] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:53.572647  2064 raft_consensus.cc:3055] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:53.573088  2064 raft_consensus.cc:740] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9ba85a12f4440719ca1eb081b9bf874, State: Running, Role: LEADER
I20260709 13:13:53.573913  2064 consensus_queue.cc:260] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:53.575096  2064 raft_consensus.cc:3060] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:53.579506  2140 raft_consensus.cc:2468] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 096950e469ac459c8e48c2760e0f56ff in term 3.
I20260709 13:13:53.580775  2183 leader_election.cc:304] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a51c4c68e76941b59c71006c77272966; no voters: 
I20260709 13:13:53.581650  2064 raft_consensus.cc:2468] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 096950e469ac459c8e48c2760e0f56ff in term 3.
I20260709 13:13:53.581629  2333 raft_consensus.cc:2804] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:53.583467  2333 raft_consensus.cc:697] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 3 LEADER]: Becoming Leader. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Running, Role: LEADER
I20260709 13:13:53.584185  2333 consensus_queue.cc:237] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:53.590816  1964 catalog_manager.cc:5697] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff reported cstate change: term changed from 2 to 3, leader changed from a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129) to 096950e469ac459c8e48c2760e0f56ff (127.1.227.131). New cstate: current_term: 3 leader_uuid: "096950e469ac459c8e48c2760e0f56ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:53.658651  2363 raft_consensus.cc:993] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966: : Instructing follower 096950e469ac459c8e48c2760e0f56ff to start an election
I20260709 13:13:53.659185  2374 raft_consensus.cc:1081] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Signalling peer 096950e469ac459c8e48c2760e0f56ff to start an election
I20260709 13:13:53.660749  2217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01a55788b5394d93b52dfcd4c04b0ea2"
dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
 from {username='slave'} at 127.0.0.1:33628
I20260709 13:13:53.661295  2217 raft_consensus.cc:493] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:53.661608  2217 raft_consensus.cc:3060] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.665915  2217 raft_consensus.cc:515] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:53.667464  2217 leader_election.cc:290] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 2 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403)
I20260709 13:13:53.668428  2064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a55788b5394d93b52dfcd4c04b0ea2" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:53.668582  2140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a55788b5394d93b52dfcd4c04b0ea2" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a51c4c68e76941b59c71006c77272966"
I20260709 13:13:53.668942  2064 raft_consensus.cc:3060] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.669207  2140 raft_consensus.cc:3055] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:53.669515  2140 raft_consensus.cc:740] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:53.670256  2140 consensus_queue.cc:260] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:53.671288  2140 raft_consensus.cc:3060] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.673725  2064 raft_consensus.cc:2468] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 096950e469ac459c8e48c2760e0f56ff in term 2.
I20260709 13:13:53.674919  2182 leader_election.cc:304] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:53.675602  2333 raft_consensus.cc:2804] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:53.675889  2140 raft_consensus.cc:2468] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 096950e469ac459c8e48c2760e0f56ff in term 2.
I20260709 13:13:53.676098  2333 raft_consensus.cc:697] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 2 LEADER]: Becoming Leader. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Running, Role: LEADER
I20260709 13:13:53.676937  2333 consensus_queue.cc:237] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:53.683588  1964 catalog_manager.cc:5697] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff reported cstate change: term changed from 1 to 2, leader changed from a51c4c68e76941b59c71006c77272966 (127.1.227.130) to 096950e469ac459c8e48c2760e0f56ff (127.1.227.131). New cstate: current_term: 2 leader_uuid: "096950e469ac459c8e48c2760e0f56ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.065909  2064 raft_consensus.cc:1275] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Refusing update from remote peer 096950e469ac459c8e48c2760e0f56ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:54.067472  2333 consensus_queue.cc:1048] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:54.077637  2140 raft_consensus.cc:1275] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 3 FOLLOWER]: Refusing update from remote peer 096950e469ac459c8e48c2760e0f56ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:54.079504  2333 consensus_queue.cc:1048] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:54.119010  2064 raft_consensus.cc:1275] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Refusing update from remote peer 096950e469ac459c8e48c2760e0f56ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:54.120398  2333 consensus_queue.cc:1048] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:54.129374  2140 raft_consensus.cc:1275] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Refusing update from remote peer 096950e469ac459c8e48c2760e0f56ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:54.132146  2368 consensus_queue.cc:1048] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:54.291603  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:54.301817  2217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167"
dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
mode: GRACEFUL
new_leader_uuid: "a51c4c68e76941b59c71006c77272966"
 from {username='slave'} at 127.0.0.1:33638
I20260709 13:13:54.302583  2217 raft_consensus.cc:606] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 3 LEADER]: Received request to transfer leadership to TS a51c4c68e76941b59c71006c77272966
I20260709 13:13:54.317369  2064 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "910bee8ef2a8424ab11eb9bc175b3c73"
dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
mode: GRACEFUL
new_leader_uuid: "a51c4c68e76941b59c71006c77272966"
 from {username='slave'} at 127.0.0.1:39826
I20260709 13:13:54.318014  2064 raft_consensus.cc:606] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 LEADER]: Received request to transfer leadership to TS a51c4c68e76941b59c71006c77272966
I20260709 13:13:54.323640  2064 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47edadac9a9f49fe96b4310b99745134"
dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
mode: GRACEFUL
new_leader_uuid: "a51c4c68e76941b59c71006c77272966"
 from {username='slave'} at 127.0.0.1:39826
I20260709 13:13:54.324128  2064 raft_consensus.cc:606] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 LEADER]: Received request to transfer leadership to TS a51c4c68e76941b59c71006c77272966
I20260709 13:13:54.329092  2064 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eaaaff3a47de402a94f42a6637afbecc"
dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
mode: GRACEFUL
new_leader_uuid: "a51c4c68e76941b59c71006c77272966"
 from {username='slave'} at 127.0.0.1:39826
I20260709 13:13:54.329573  2064 raft_consensus.cc:606] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 2 LEADER]: Received request to transfer leadership to TS a51c4c68e76941b59c71006c77272966
I20260709 13:13:54.342703  2217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01a55788b5394d93b52dfcd4c04b0ea2"
dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
mode: GRACEFUL
new_leader_uuid: "a51c4c68e76941b59c71006c77272966"
 from {username='slave'} at 127.0.0.1:33638
I20260709 13:13:54.343267  2217 raft_consensus.cc:606] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 2 LEADER]: Received request to transfer leadership to TS a51c4c68e76941b59c71006c77272966
I20260709 13:13:54.415445  2367 raft_consensus.cc:993] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874: : Instructing follower a51c4c68e76941b59c71006c77272966 to start an election
I20260709 13:13:54.416570  2367 raft_consensus.cc:1081] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 LEADER]: Signalling peer a51c4c68e76941b59c71006c77272966 to start an election
I20260709 13:13:54.418267  2140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "910bee8ef2a8424ab11eb9bc175b3c73"
dest_uuid: "a51c4c68e76941b59c71006c77272966"
 from {username='slave'} at 127.0.0.1:52058
I20260709 13:13:54.418781  2140 raft_consensus.cc:493] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:54.419127  2140 raft_consensus.cc:3060] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.423272  2140 raft_consensus.cc:515] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:54.424643  2140 leader_election.cc:290] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 3 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:54.425529  2064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910bee8ef2a8424ab11eb9bc175b3c73" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:54.425719  2217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910bee8ef2a8424ab11eb9bc175b3c73" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:54.426100  2064 raft_consensus.cc:3055] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:54.426385  2217 raft_consensus.cc:3060] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.426424  2064 raft_consensus.cc:740] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9ba85a12f4440719ca1eb081b9bf874, State: Running, Role: LEADER
I20260709 13:13:54.427156  2064 consensus_queue.cc:260] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:54.427991  2064 raft_consensus.cc:3060] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.431416  2217 raft_consensus.cc:2468] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 3.
I20260709 13:13:54.431898  2064 raft_consensus.cc:2468] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 3.
I20260709 13:13:54.432598  2110 leader_election.cc:304] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a51c4c68e76941b59c71006c77272966; no voters: 
I20260709 13:13:54.433378  2374 raft_consensus.cc:2804] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:54.434010  2374 raft_consensus.cc:697] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 3 LEADER]: Becoming Leader. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:54.434718  2374 consensus_queue.cc:237] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:54.441773  1964 catalog_manager.cc:5697] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 reported cstate change: term changed from 2 to 3, leader changed from a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129) to a51c4c68e76941b59c71006c77272966 (127.1.227.130). New cstate: current_term: 3 leader_uuid: "a51c4c68e76941b59c71006c77272966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.556720  2333 raft_consensus.cc:993] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff: : Instructing follower a51c4c68e76941b59c71006c77272966 to start an election
I20260709 13:13:54.557202  2333 raft_consensus.cc:1081] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 3 LEADER]: Signalling peer a51c4c68e76941b59c71006c77272966 to start an election
I20260709 13:13:54.558885  2140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167"
dest_uuid: "a51c4c68e76941b59c71006c77272966"
 from {username='slave'} at 127.0.0.1:52054
I20260709 13:13:54.559425  2140 raft_consensus.cc:493] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:54.559778  2140 raft_consensus.cc:3060] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:54.563827  2140 raft_consensus.cc:515] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:54.565183  2140 leader_election.cc:290] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 4 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:54.566030  2064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:54.566322  2217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:54.566519  2064 raft_consensus.cc:3060] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:54.566869  2217 raft_consensus.cc:3055] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:54.567134  2217 raft_consensus.cc:740] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Running, Role: LEADER
I20260709 13:13:54.567847  2217 consensus_queue.cc:260] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:54.568712  2217 raft_consensus.cc:3060] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:54.571097  2064 raft_consensus.cc:2468] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 4.
I20260709 13:13:54.572075  2108 leader_election.cc:304] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:54.573024  2374 raft_consensus.cc:2804] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:54.573552  2374 raft_consensus.cc:697] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 4 LEADER]: Becoming Leader. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:54.573884  2386 raft_consensus.cc:993] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874: : Instructing follower a51c4c68e76941b59c71006c77272966 to start an election
I20260709 13:13:54.574282  2367 raft_consensus.cc:1081] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 LEADER]: Signalling peer a51c4c68e76941b59c71006c77272966 to start an election
I20260709 13:13:54.574381  2374 consensus_queue.cc:237] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:54.575356  2217 raft_consensus.cc:2468] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 4.
I20260709 13:13:54.575953  2140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47edadac9a9f49fe96b4310b99745134"
dest_uuid: "a51c4c68e76941b59c71006c77272966"
 from {username='slave'} at 127.0.0.1:52058
I20260709 13:13:54.576488  2140 raft_consensus.cc:493] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:54.576828  2140 raft_consensus.cc:3060] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.581648  2140 raft_consensus.cc:515] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:54.581595  1964 catalog_manager.cc:5697] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 reported cstate change: term changed from 3 to 4, leader changed from 096950e469ac459c8e48c2760e0f56ff (127.1.227.131) to a51c4c68e76941b59c71006c77272966 (127.1.227.130). New cstate: current_term: 4 leader_uuid: "a51c4c68e76941b59c71006c77272966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.583338  2140 leader_election.cc:290] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 3 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:54.584057  2064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47edadac9a9f49fe96b4310b99745134" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:54.584357  2217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47edadac9a9f49fe96b4310b99745134" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:54.584595  2064 raft_consensus.cc:3055] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:54.584952  2217 raft_consensus.cc:3060] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.584930  2064 raft_consensus.cc:740] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9ba85a12f4440719ca1eb081b9bf874, State: Running, Role: LEADER
I20260709 13:13:54.585878  2064 consensus_queue.cc:260] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:54.586992  2064 raft_consensus.cc:3060] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.591676  2217 raft_consensus.cc:2468] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 3.
I20260709 13:13:54.592814  2110 leader_election.cc:304] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a51c4c68e76941b59c71006c77272966; no voters: 
I20260709 13:13:54.593223  2064 raft_consensus.cc:2468] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 3.
I20260709 13:13:54.593783  2363 raft_consensus.cc:2804] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:54.595155  2363 raft_consensus.cc:697] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 3 LEADER]: Becoming Leader. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:54.595810  2363 consensus_queue.cc:237] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:54.603109  1964 catalog_manager.cc:5697] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 reported cstate change: term changed from 2 to 3, leader changed from a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129) to a51c4c68e76941b59c71006c77272966 (127.1.227.130). New cstate: current_term: 3 leader_uuid: "a51c4c68e76941b59c71006c77272966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.613564  2368 raft_consensus.cc:993] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff: : Instructing follower a51c4c68e76941b59c71006c77272966 to start an election
I20260709 13:13:54.614125  2333 raft_consensus.cc:1081] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 2 LEADER]: Signalling peer a51c4c68e76941b59c71006c77272966 to start an election
I20260709 13:13:54.615661  2140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01a55788b5394d93b52dfcd4c04b0ea2"
dest_uuid: "a51c4c68e76941b59c71006c77272966"
 from {username='slave'} at 127.0.0.1:52054
I20260709 13:13:54.616222  2140 raft_consensus.cc:493] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:54.616640  2140 raft_consensus.cc:3060] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.621112  2140 raft_consensus.cc:515] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:54.622715  2140 leader_election.cc:290] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 3 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:54.623853  2064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a55788b5394d93b52dfcd4c04b0ea2" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:54.623874  2217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a55788b5394d93b52dfcd4c04b0ea2" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:54.624435  2064 raft_consensus.cc:3060] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.624439  2217 raft_consensus.cc:3055] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:54.624959  2217 raft_consensus.cc:740] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Running, Role: LEADER
I20260709 13:13:54.625624  2217 consensus_queue.cc:260] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:54.626550  2217 raft_consensus.cc:3060] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.629654  2064 raft_consensus.cc:2468] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 3.
I20260709 13:13:54.630740  2108 leader_election.cc:304] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a51c4c68e76941b59c71006c77272966, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:54.631114  2217 raft_consensus.cc:2468] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 3.
I20260709 13:13:54.631562  2363 raft_consensus.cc:2804] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:54.632077  2363 raft_consensus.cc:697] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 3 LEADER]: Becoming Leader. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:54.632798  2363 consensus_queue.cc:237] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:54.639185  1964 catalog_manager.cc:5697] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 reported cstate change: term changed from 2 to 3, leader changed from 096950e469ac459c8e48c2760e0f56ff (127.1.227.131) to a51c4c68e76941b59c71006c77272966 (127.1.227.130). New cstate: current_term: 3 leader_uuid: "a51c4c68e76941b59c71006c77272966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.698917  2386 raft_consensus.cc:993] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874: : Instructing follower a51c4c68e76941b59c71006c77272966 to start an election
I20260709 13:13:54.699389  2367 raft_consensus.cc:1081] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 2 LEADER]: Signalling peer a51c4c68e76941b59c71006c77272966 to start an election
I20260709 13:13:54.700971  2140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eaaaff3a47de402a94f42a6637afbecc"
dest_uuid: "a51c4c68e76941b59c71006c77272966"
 from {username='slave'} at 127.0.0.1:52058
I20260709 13:13:54.701454  2140 raft_consensus.cc:493] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:54.701823  2140 raft_consensus.cc:3060] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.706068  2140 raft_consensus.cc:515] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:54.707456  2140 leader_election.cc:290] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 3 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:54.708376  2064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaaff3a47de402a94f42a6637afbecc" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:54.708658  2217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaaff3a47de402a94f42a6637afbecc" candidate_uuid: "a51c4c68e76941b59c71006c77272966" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:54.708915  2064 raft_consensus.cc:3055] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:54.709264  2064 raft_consensus.cc:740] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9ba85a12f4440719ca1eb081b9bf874, State: Running, Role: LEADER
I20260709 13:13:54.709313  2217 raft_consensus.cc:3060] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.710247  2064 consensus_queue.cc:260] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:54.711436  2064 raft_consensus.cc:3060] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.716851  2217 raft_consensus.cc:2468] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 3.
I20260709 13:13:54.718168  2064 raft_consensus.cc:2468] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51c4c68e76941b59c71006c77272966 in term 3.
I20260709 13:13:54.718210  2110 leader_election.cc:304] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a51c4c68e76941b59c71006c77272966; no voters: 
I20260709 13:13:54.719177  2363 raft_consensus.cc:2804] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:54.719740  2363 raft_consensus.cc:697] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 3 LEADER]: Becoming Leader. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:54.720448  2363 consensus_queue.cc:237] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:54.727720  1964 catalog_manager.cc:5697] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 reported cstate change: term changed from 2 to 3, leader changed from a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129) to a51c4c68e76941b59c71006c77272966 (127.1.227.130). New cstate: current_term: 3 leader_uuid: "a51c4c68e76941b59c71006c77272966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.874218  2217 raft_consensus.cc:1275] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Refusing update from remote peer a51c4c68e76941b59c71006c77272966: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:54.875537  2363 consensus_queue.cc:1048] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:54.884822  2064 raft_consensus.cc:1275] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Refusing update from remote peer a51c4c68e76941b59c71006c77272966: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:54.886332  2363 consensus_queue.cc:1048] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:54.959585  2064 raft_consensus.cc:1275] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 4 FOLLOWER]: Refusing update from remote peer a51c4c68e76941b59c71006c77272966: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:54.960731  2374 consensus_queue.cc:1048] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:54.971282  2217 raft_consensus.cc:1275] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 4 FOLLOWER]: Refusing update from remote peer a51c4c68e76941b59c71006c77272966: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:54.973544  2400 consensus_queue.cc:1048] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:54.999807  2063 raft_consensus.cc:1275] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Refusing update from remote peer a51c4c68e76941b59c71006c77272966: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:55.001062  2400 consensus_queue.cc:1048] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:55.010440  2217 raft_consensus.cc:1275] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Refusing update from remote peer a51c4c68e76941b59c71006c77272966: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:55.012588  2400 consensus_queue.cc:1048] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:55.048067  2063 raft_consensus.cc:1275] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Refusing update from remote peer a51c4c68e76941b59c71006c77272966: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:55.049691  2400 consensus_queue.cc:1048] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:55.057325  2217 raft_consensus.cc:1275] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Refusing update from remote peer a51c4c68e76941b59c71006c77272966: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:55.059326  2374 consensus_queue.cc:1048] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:55.265388  2217 raft_consensus.cc:1275] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Refusing update from remote peer a51c4c68e76941b59c71006c77272966: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:55.266763  2374 consensus_queue.cc:1048] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:55.275843  2063 raft_consensus.cc:1275] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Refusing update from remote peer a51c4c68e76941b59c71006c77272966: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:55.277503  2392 consensus_queue.cc:1048] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:57.348301  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:57.356195  2140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d000d212ec343cea0340f6217aeb246"
dest_uuid: "a51c4c68e76941b59c71006c77272966"
mode: GRACEFUL
new_leader_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
 from {username='slave'} at 127.0.0.1:52080
I20260709 13:13:57.356992  2140 raft_consensus.cc:606] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 2 LEADER]: Received request to transfer leadership to TS a9ba85a12f4440719ca1eb081b9bf874
I20260709 13:13:57.359812  2140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47edadac9a9f49fe96b4310b99745134"
dest_uuid: "a51c4c68e76941b59c71006c77272966"
mode: GRACEFUL
new_leader_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
 from {username='slave'} at 127.0.0.1:52080
I20260709 13:13:57.360343  2140 raft_consensus.cc:606] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 3 LEADER]: Received request to transfer leadership to TS a9ba85a12f4440719ca1eb081b9bf874
I20260709 13:13:57.363075  2140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "910bee8ef2a8424ab11eb9bc175b3c73"
dest_uuid: "a51c4c68e76941b59c71006c77272966"
mode: GRACEFUL
new_leader_uuid: "096950e469ac459c8e48c2760e0f56ff"
 from {username='slave'} at 127.0.0.1:52080
I20260709 13:13:57.363585  2140 raft_consensus.cc:606] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 3 LEADER]: Received request to transfer leadership to TS 096950e469ac459c8e48c2760e0f56ff
I20260709 13:13:57.365986  2140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167"
dest_uuid: "a51c4c68e76941b59c71006c77272966"
mode: GRACEFUL
new_leader_uuid: "096950e469ac459c8e48c2760e0f56ff"
 from {username='slave'} at 127.0.0.1:52080
I20260709 13:13:57.366448  2140 raft_consensus.cc:606] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 4 LEADER]: Received request to transfer leadership to TS 096950e469ac459c8e48c2760e0f56ff
I20260709 13:13:57.368687  2140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eaaaff3a47de402a94f42a6637afbecc"
dest_uuid: "a51c4c68e76941b59c71006c77272966"
mode: GRACEFUL
new_leader_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
 from {username='slave'} at 127.0.0.1:52080
I20260709 13:13:57.369115  2140 raft_consensus.cc:606] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 3 LEADER]: Received request to transfer leadership to TS a9ba85a12f4440719ca1eb081b9bf874
I20260709 13:13:57.370255  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:57.370719  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:57.389542  2392 raft_consensus.cc:993] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966: : Instructing follower 096950e469ac459c8e48c2760e0f56ff to start an election
I20260709 13:13:57.390163  2392 raft_consensus.cc:1081] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 3 LEADER]: Signalling peer 096950e469ac459c8e48c2760e0f56ff to start an election
I20260709 13:13:57.391906  2217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "910bee8ef2a8424ab11eb9bc175b3c73"
dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
 from {username='slave'} at 127.0.0.1:33628
I20260709 13:13:57.392434  2217 raft_consensus.cc:493] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:57.392762  2217 raft_consensus.cc:3060] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:57.398478  2217 raft_consensus.cc:515] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:57.400549  2217 leader_election.cc:290] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 4 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403)
I20260709 13:13:57.401645  2140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910bee8ef2a8424ab11eb9bc175b3c73" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a51c4c68e76941b59c71006c77272966"
I20260709 13:13:57.401705  2063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910bee8ef2a8424ab11eb9bc175b3c73" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:57.402596  2140 raft_consensus.cc:3055] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:57.402837  2140 raft_consensus.cc:740] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:57.402676  2063 raft_consensus.cc:3060] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:57.403741  2140 consensus_queue.cc:260] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:57.404657  2140 raft_consensus.cc:3060] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:57.408180  2063 raft_consensus.cc:2468] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 096950e469ac459c8e48c2760e0f56ff in term 4.
I20260709 13:13:57.409085  2140 raft_consensus.cc:2468] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 096950e469ac459c8e48c2760e0f56ff in term 4.
I20260709 13:13:57.409651  2182 leader_election.cc:304] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:57.410830  2333 raft_consensus.cc:2804] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:57.411829  2333 raft_consensus.cc:697] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [term 4 LEADER]: Becoming Leader. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Running, Role: LEADER
I20260709 13:13:57.412650  2333 consensus_queue.cc:237] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:57.420533  1964 catalog_manager.cc:5697] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff reported cstate change: term changed from 3 to 4, leader changed from a51c4c68e76941b59c71006c77272966 (127.1.227.130) to 096950e469ac459c8e48c2760e0f56ff (127.1.227.131). New cstate: current_term: 4 leader_uuid: "096950e469ac459c8e48c2760e0f56ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:57.494513  2392 raft_consensus.cc:993] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966: : Instructing follower a9ba85a12f4440719ca1eb081b9bf874 to start an election
I20260709 13:13:57.495235  2407 raft_consensus.cc:1081] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 2 LEADER]: Signalling peer a9ba85a12f4440719ca1eb081b9bf874 to start an election
I20260709 13:13:57.496757  2063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d000d212ec343cea0340f6217aeb246"
dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
 from {username='slave'} at 127.0.0.1:39800
I20260709 13:13:57.497303  2063 raft_consensus.cc:493] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:57.497656  2063 raft_consensus.cc:3060] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:57.502967  2063 raft_consensus.cc:515] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:57.504778  2063 leader_election.cc:290] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 3 election: Requested vote from peers a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:57.505834  2140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d000d212ec343cea0340f6217aeb246" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a51c4c68e76941b59c71006c77272966"
I20260709 13:13:57.506243  2217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d000d212ec343cea0340f6217aeb246" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:57.506484  2140 raft_consensus.cc:3055] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:57.506804  2217 raft_consensus.cc:3060] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:57.506832  2140 raft_consensus.cc:740] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:57.507938  2140 consensus_queue.cc:260] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:57.509189  2140 raft_consensus.cc:3060] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:57.513811  2217 raft_consensus.cc:2468] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9ba85a12f4440719ca1eb081b9bf874 in term 3.
I20260709 13:13:57.515383  2035 leader_election.cc:304] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:57.516036  2140 raft_consensus.cc:2468] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9ba85a12f4440719ca1eb081b9bf874 in term 3.
I20260709 13:13:57.517637  2414 raft_consensus.cc:2804] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:57.518847  2414 raft_consensus.cc:697] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 3 LEADER]: Becoming Leader. State: Replica: a9ba85a12f4440719ca1eb081b9bf874, State: Running, Role: LEADER
I20260709 13:13:57.519731  2414 consensus_queue.cc:237] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:57.526628  1964 catalog_manager.cc:5697] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 reported cstate change: term changed from 2 to 3, leader changed from a51c4c68e76941b59c71006c77272966 (127.1.227.130) to a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129). New cstate: current_term: 3 leader_uuid: "a9ba85a12f4440719ca1eb081b9bf874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.647131  2392 raft_consensus.cc:993] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966: : Instructing follower 096950e469ac459c8e48c2760e0f56ff to start an election
I20260709 13:13:57.647610  2392 raft_consensus.cc:1081] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 4 LEADER]: Signalling peer 096950e469ac459c8e48c2760e0f56ff to start an election
I20260709 13:13:57.649255  2218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167"
dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
 from {username='slave'} at 127.0.0.1:33628
I20260709 13:13:57.649773  2218 raft_consensus.cc:493] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:57.650092  2218 raft_consensus.cc:3060] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:57.655779  2218 raft_consensus.cc:515] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:57.657868  2218 leader_election.cc:290] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 5 election: Requested vote from peers a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415), a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403)
I20260709 13:13:57.658733  2063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
I20260709 13:13:57.659011  2140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4507a96160e4dbbbaa47ee7adfdf167" candidate_uuid: "096950e469ac459c8e48c2760e0f56ff" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a51c4c68e76941b59c71006c77272966"
I20260709 13:13:57.659430  2063 raft_consensus.cc:3060] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:57.659614  2140 raft_consensus.cc:3055] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:57.660069  2140 raft_consensus.cc:740] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:57.660813  2140 consensus_queue.cc:260] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:57.661901  2140 raft_consensus.cc:3060] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:57.664659  2063 raft_consensus.cc:2468] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 096950e469ac459c8e48c2760e0f56ff in term 5.
I20260709 13:13:57.665710  2182 leader_election.cc:304] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:57.666091  2140 raft_consensus.cc:2468] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 096950e469ac459c8e48c2760e0f56ff in term 5.
I20260709 13:13:57.666647  2333 raft_consensus.cc:2804] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:57.667289  2333 raft_consensus.cc:697] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 5 LEADER]: Becoming Leader. State: Replica: 096950e469ac459c8e48c2760e0f56ff, State: Running, Role: LEADER
I20260709 13:13:57.668237  2333 consensus_queue.cc:237] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:57.676077  1964 catalog_manager.cc:5697] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff reported cstate change: term changed from 4 to 5, leader changed from a51c4c68e76941b59c71006c77272966 (127.1.227.130) to 096950e469ac459c8e48c2760e0f56ff (127.1.227.131). New cstate: current_term: 5 leader_uuid: "096950e469ac459c8e48c2760e0f56ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:57.713272  2407 raft_consensus.cc:993] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966: : Instructing follower a9ba85a12f4440719ca1eb081b9bf874 to start an election
I20260709 13:13:57.713836  2392 raft_consensus.cc:1081] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 3 LEADER]: Signalling peer a9ba85a12f4440719ca1eb081b9bf874 to start an election
I20260709 13:13:57.715555  2063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eaaaff3a47de402a94f42a6637afbecc"
dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
 from {username='slave'} at 127.0.0.1:39800
I20260709 13:13:57.715989  2063 raft_consensus.cc:493] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:57.716387  2063 raft_consensus.cc:3060] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:57.720892  2063 raft_consensus.cc:515] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:57.722312  2063 leader_election.cc:290] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 4 election: Requested vote from peers a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:57.723312  2140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaaff3a47de402a94f42a6637afbecc" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a51c4c68e76941b59c71006c77272966"
I20260709 13:13:57.723430  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaaff3a47de402a94f42a6637afbecc" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:57.723850  2140 raft_consensus.cc:3055] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:57.723963  2218 raft_consensus.cc:3060] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:57.724144  2140 raft_consensus.cc:740] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:57.724854  2140 consensus_queue.cc:260] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:57.725725  2140 raft_consensus.cc:3060] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:57.729050  2218 raft_consensus.cc:2468] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9ba85a12f4440719ca1eb081b9bf874 in term 4.
I20260709 13:13:57.730032  2140 raft_consensus.cc:2468] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9ba85a12f4440719ca1eb081b9bf874 in term 4.
I20260709 13:13:57.730394  2035 leader_election.cc:304] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:57.731261  2414 raft_consensus.cc:2804] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:57.731777  2414 raft_consensus.cc:697] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 4 LEADER]: Becoming Leader. State: Replica: a9ba85a12f4440719ca1eb081b9bf874, State: Running, Role: LEADER
I20260709 13:13:57.732728  2414 consensus_queue.cc:237] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:57.740628  1964 catalog_manager.cc:5697] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 reported cstate change: term changed from 3 to 4, leader changed from a51c4c68e76941b59c71006c77272966 (127.1.227.130) to a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129). New cstate: current_term: 4 leader_uuid: "a9ba85a12f4440719ca1eb081b9bf874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.751591  2407 raft_consensus.cc:993] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966: : Instructing follower a9ba85a12f4440719ca1eb081b9bf874 to start an election
I20260709 13:13:57.752173  2392 raft_consensus.cc:1081] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 3 LEADER]: Signalling peer a9ba85a12f4440719ca1eb081b9bf874 to start an election
I20260709 13:13:57.754177  2064 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47edadac9a9f49fe96b4310b99745134"
dest_uuid: "a9ba85a12f4440719ca1eb081b9bf874"
 from {username='slave'} at 127.0.0.1:39800
I20260709 13:13:57.754722  2064 raft_consensus.cc:493] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:57.755120  2064 raft_consensus.cc:3060] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:57.759872  2064 raft_consensus.cc:515] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:57.761562  2064 leader_election.cc:290] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 4 election: Requested vote from peers a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403), 096950e469ac459c8e48c2760e0f56ff (127.1.227.131:42021)
I20260709 13:13:57.762414  2140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47edadac9a9f49fe96b4310b99745134" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a51c4c68e76941b59c71006c77272966"
I20260709 13:13:57.762609  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47edadac9a9f49fe96b4310b99745134" candidate_uuid: "a9ba85a12f4440719ca1eb081b9bf874" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "096950e469ac459c8e48c2760e0f56ff"
I20260709 13:13:57.763041  2140 raft_consensus.cc:3055] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:57.763306  2218 raft_consensus.cc:3060] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:57.763373  2140 raft_consensus.cc:740] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a51c4c68e76941b59c71006c77272966, State: Running, Role: LEADER
I20260709 13:13:57.764212  2140 consensus_queue.cc:260] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:57.765122  2140 raft_consensus.cc:3060] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:57.768378  2218 raft_consensus.cc:2468] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9ba85a12f4440719ca1eb081b9bf874 in term 4.
I20260709 13:13:57.769404  2140 raft_consensus.cc:2468] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9ba85a12f4440719ca1eb081b9bf874 in term 4.
I20260709 13:13:57.769464  2035 leader_election.cc:304] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096950e469ac459c8e48c2760e0f56ff, a9ba85a12f4440719ca1eb081b9bf874; no voters: 
I20260709 13:13:57.770562  2414 raft_consensus.cc:2804] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:57.771092  2414 raft_consensus.cc:697] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 4 LEADER]: Becoming Leader. State: Replica: a9ba85a12f4440719ca1eb081b9bf874, State: Running, Role: LEADER
I20260709 13:13:57.771878  2414 consensus_queue.cc:237] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } }
I20260709 13:13:57.778172  1964 catalog_manager.cc:5697] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 reported cstate change: term changed from 3 to 4, leader changed from a51c4c68e76941b59c71006c77272966 (127.1.227.130) to a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129). New cstate: current_term: 4 leader_uuid: "a9ba85a12f4440719ca1eb081b9bf874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.849324  2064 raft_consensus.cc:1275] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 4 FOLLOWER]: Refusing update from remote peer 096950e469ac459c8e48c2760e0f56ff: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:57.850690  2333 consensus_queue.cc:1048] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:57.861554  2140 raft_consensus.cc:1275] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 4 FOLLOWER]: Refusing update from remote peer 096950e469ac459c8e48c2760e0f56ff: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:57.863091  2333 consensus_queue.cc:1048] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:58.016584  2218 raft_consensus.cc:1275] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Refusing update from remote peer a9ba85a12f4440719ca1eb081b9bf874: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:58.018220  2414 consensus_queue.cc:1048] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:58.028945  2140 raft_consensus.cc:1275] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 3 FOLLOWER]: Refusing update from remote peer a9ba85a12f4440719ca1eb081b9bf874: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:58.030764  2415 consensus_queue.cc:1048] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:58.154567  2063 raft_consensus.cc:1275] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 5 FOLLOWER]: Refusing update from remote peer 096950e469ac459c8e48c2760e0f56ff: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:58.155941  2333 consensus_queue.cc:1048] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ba85a12f4440719ca1eb081b9bf874" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:58.164909  2140 raft_consensus.cc:1275] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 5 FOLLOWER]: Refusing update from remote peer 096950e469ac459c8e48c2760e0f56ff: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:58.166420  2333 consensus_queue.cc:1048] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:58.186277  2218 raft_consensus.cc:1275] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 4 FOLLOWER]: Refusing update from remote peer a9ba85a12f4440719ca1eb081b9bf874: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:58.187573  2415 consensus_queue.cc:1048] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:58.197119  2140 raft_consensus.cc:1275] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 4 FOLLOWER]: Refusing update from remote peer a9ba85a12f4440719ca1eb081b9bf874: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:58.199069  2426 consensus_queue.cc:1048] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:58.273046  2218 raft_consensus.cc:1275] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [term 4 FOLLOWER]: Refusing update from remote peer a9ba85a12f4440719ca1eb081b9bf874: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:58.274437  2426 consensus_queue.cc:1048] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096950e469ac459c8e48c2760e0f56ff" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:58.283399  2140 raft_consensus.cc:1275] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 4 FOLLOWER]: Refusing update from remote peer a9ba85a12f4440719ca1eb081b9bf874: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:58.284844  2414 consensus_queue.cc:1048] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a51c4c68e76941b59c71006c77272966" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 46403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:58.371675  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:58.377895  1934 tablet_server.cc:179] TabletServer@127.1.227.129:0 shutting down...
I20260709 13:13:58.411898  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:58.412665  1934 tablet_replica.cc:333] T b242b4def0cd410d9a5bbdf24c5a9645 P a9ba85a12f4440719ca1eb081b9bf874: stopping tablet replica
I20260709 13:13:58.413354  1934 raft_consensus.cc:2243] T b242b4def0cd410d9a5bbdf24c5a9645 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:58.413898  1934 raft_consensus.cc:2272] T b242b4def0cd410d9a5bbdf24c5a9645 P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.416160  1934 tablet_replica.cc:333] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874: stopping tablet replica
I20260709 13:13:58.416728  1934 raft_consensus.cc:2243] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:58.417436  1934 raft_consensus.cc:2272] T 2d000d212ec343cea0340f6217aeb246 P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.419493  1934 tablet_replica.cc:333] T df7e54fd225b4faf9ed557ab7f3067e0 P a9ba85a12f4440719ca1eb081b9bf874: stopping tablet replica
I20260709 13:13:58.419960  1934 raft_consensus.cc:2243] T df7e54fd225b4faf9ed557ab7f3067e0 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:58.420318  1934 raft_consensus.cc:2272] T df7e54fd225b4faf9ed557ab7f3067e0 P a9ba85a12f4440719ca1eb081b9bf874 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.422071  1934 tablet_replica.cc:333] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874: stopping tablet replica
I20260709 13:13:58.422577  1934 raft_consensus.cc:2243] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:58.423252  1934 raft_consensus.cc:2272] T 47edadac9a9f49fe96b4310b99745134 P a9ba85a12f4440719ca1eb081b9bf874 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.425324  1934 tablet_replica.cc:333] T 2bb927f7bd87438c970a2cb051fea53e P a9ba85a12f4440719ca1eb081b9bf874: stopping tablet replica
I20260709 13:13:58.425833  1934 raft_consensus.cc:2243] T 2bb927f7bd87438c970a2cb051fea53e P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:58.426199  1934 raft_consensus.cc:2272] T 2bb927f7bd87438c970a2cb051fea53e P a9ba85a12f4440719ca1eb081b9bf874 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.427724  1934 tablet_replica.cc:333] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874: stopping tablet replica
I20260709 13:13:58.428134  1934 raft_consensus.cc:2243] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:58.428484  1934 raft_consensus.cc:2272] T a4507a96160e4dbbbaa47ee7adfdf167 P a9ba85a12f4440719ca1eb081b9bf874 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.430759  1934 tablet_replica.cc:333] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874: stopping tablet replica
I20260709 13:13:58.431300  1934 raft_consensus.cc:2243] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:58.431758  1934 raft_consensus.cc:2272] T 01a55788b5394d93b52dfcd4c04b0ea2 P a9ba85a12f4440719ca1eb081b9bf874 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.433373  1934 tablet_replica.cc:333] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874: stopping tablet replica
I20260709 13:13:58.433912  1934 raft_consensus.cc:2243] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:58.434667  1934 raft_consensus.cc:2272] T eaaaff3a47de402a94f42a6637afbecc P a9ba85a12f4440719ca1eb081b9bf874 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.436656  1934 tablet_replica.cc:333] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874: stopping tablet replica
I20260709 13:13:58.437234  1934 raft_consensus.cc:2243] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:58.437726  1934 raft_consensus.cc:2272] T 910bee8ef2a8424ab11eb9bc175b3c73 P a9ba85a12f4440719ca1eb081b9bf874 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:58.454783  2108 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.227.129:41415: connect: Connection refused (error 111)
W20260709 13:13:58.527590  2108 consensus_peers.cc:597] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 -> Peer a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415): Couldn't send request to peer a9ba85a12f4440719ca1eb081b9bf874. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:41415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:58.541885  1934 tablet_server.cc:196] TabletServer@127.1.227.129:0 shutdown complete.
I20260709 13:13:58.561885  1934 tablet_server.cc:179] TabletServer@127.1.227.130:0 shutting down...
W20260709 13:13:58.568542  2108 consensus_peers.cc:597] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 -> Peer a9ba85a12f4440719ca1eb081b9bf874 (127.1.227.129:41415): Couldn't send request to peer a9ba85a12f4440719ca1eb081b9bf874. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:41415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:58.588267  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:58.589061  1934 tablet_replica.cc:333] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966: stopping tablet replica
I20260709 13:13:58.589717  1934 raft_consensus.cc:2243] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:58.590294  1934 raft_consensus.cc:2272] T eaaaff3a47de402a94f42a6637afbecc P a51c4c68e76941b59c71006c77272966 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.592519  1934 tablet_replica.cc:333] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966: stopping tablet replica
I20260709 13:13:58.593094  1934 raft_consensus.cc:2243] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:58.593528  1934 raft_consensus.cc:2272] T 910bee8ef2a8424ab11eb9bc175b3c73 P a51c4c68e76941b59c71006c77272966 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.595616  1934 tablet_replica.cc:333] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966: stopping tablet replica
I20260709 13:13:58.596143  1934 raft_consensus.cc:2243] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:58.596861  1934 raft_consensus.cc:2272] T df7e54fd225b4faf9ed557ab7f3067e0 P a51c4c68e76941b59c71006c77272966 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.598549  1934 tablet_replica.cc:333] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966: stopping tablet replica
I20260709 13:13:58.599017  1934 raft_consensus.cc:2243] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:58.599431  1934 raft_consensus.cc:2272] T b242b4def0cd410d9a5bbdf24c5a9645 P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.601037  1934 tablet_replica.cc:333] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966: stopping tablet replica
I20260709 13:13:58.601490  1934 raft_consensus.cc:2243] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:58.602231  1934 raft_consensus.cc:2272] T 01a55788b5394d93b52dfcd4c04b0ea2 P a51c4c68e76941b59c71006c77272966 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.604421  1934 tablet_replica.cc:333] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966: stopping tablet replica
I20260709 13:13:58.604904  1934 raft_consensus.cc:2243] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:58.605329  1934 raft_consensus.cc:2272] T a4507a96160e4dbbbaa47ee7adfdf167 P a51c4c68e76941b59c71006c77272966 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.607347  1934 tablet_replica.cc:333] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966: stopping tablet replica
I20260709 13:13:58.607831  1934 raft_consensus.cc:2243] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:58.608228  1934 raft_consensus.cc:2272] T 47edadac9a9f49fe96b4310b99745134 P a51c4c68e76941b59c71006c77272966 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.610196  1934 tablet_replica.cc:333] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966: stopping tablet replica
I20260709 13:13:58.610647  1934 raft_consensus.cc:2243] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:58.611334  1934 raft_consensus.cc:2272] T 2bb927f7bd87438c970a2cb051fea53e P a51c4c68e76941b59c71006c77272966 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.612895  1934 tablet_replica.cc:333] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966: stopping tablet replica
I20260709 13:13:58.613324  1934 raft_consensus.cc:2243] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:58.613703  1934 raft_consensus.cc:2272] T 2d000d212ec343cea0340f6217aeb246 P a51c4c68e76941b59c71006c77272966 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.642320  1934 tablet_server.cc:196] TabletServer@127.1.227.130:0 shutdown complete.
W20260709 13:13:58.663822  2183 consensus_peers.cc:597] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff -> Peer a51c4c68e76941b59c71006c77272966 (127.1.227.130:46403): Couldn't send request to peer a51c4c68e76941b59c71006c77272966. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:46403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:58.665623  1934 tablet_server.cc:179] TabletServer@127.1.227.131:0 shutting down...
I20260709 13:13:58.693466  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:58.694199  1934 tablet_replica.cc:333] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff: stopping tablet replica
I20260709 13:13:58.694856  1934 raft_consensus.cc:2243] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:58.695305  1934 raft_consensus.cc:2272] T 01a55788b5394d93b52dfcd4c04b0ea2 P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.697005  1934 tablet_replica.cc:333] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff: stopping tablet replica
I20260709 13:13:58.697540  1934 raft_consensus.cc:2243] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:58.698040  1934 raft_consensus.cc:2272] T eaaaff3a47de402a94f42a6637afbecc P 096950e469ac459c8e48c2760e0f56ff [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.700596  1934 tablet_replica.cc:333] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff: stopping tablet replica
I20260709 13:13:58.701157  1934 raft_consensus.cc:2243] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:58.701900  1934 raft_consensus.cc:2272] T 910bee8ef2a8424ab11eb9bc175b3c73 P 096950e469ac459c8e48c2760e0f56ff [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.704427  1934 tablet_replica.cc:333] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff: stopping tablet replica
I20260709 13:13:58.704922  1934 raft_consensus.cc:2243] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:58.705710  1934 raft_consensus.cc:2272] T b242b4def0cd410d9a5bbdf24c5a9645 P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.707424  1934 tablet_replica.cc:333] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff: stopping tablet replica
I20260709 13:13:58.707903  1934 raft_consensus.cc:2243] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:58.708319  1934 raft_consensus.cc:2272] T 2bb927f7bd87438c970a2cb051fea53e P 096950e469ac459c8e48c2760e0f56ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.709908  1934 tablet_replica.cc:333] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff: stopping tablet replica
I20260709 13:13:58.710381  1934 raft_consensus.cc:2243] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:13:58.711066  1934 raft_consensus.cc:2272] T a4507a96160e4dbbbaa47ee7adfdf167 P 096950e469ac459c8e48c2760e0f56ff [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.713011  1934 tablet_replica.cc:333] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff: stopping tablet replica
I20260709 13:13:58.713528  1934 raft_consensus.cc:2243] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:58.713969  1934 raft_consensus.cc:2272] T 47edadac9a9f49fe96b4310b99745134 P 096950e469ac459c8e48c2760e0f56ff [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.715829  1934 tablet_replica.cc:333] T df7e54fd225b4faf9ed557ab7f3067e0 P 096950e469ac459c8e48c2760e0f56ff: stopping tablet replica
I20260709 13:13:58.716310  1934 raft_consensus.cc:2243] T df7e54fd225b4faf9ed557ab7f3067e0 P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:58.716785  1934 raft_consensus.cc:2272] T df7e54fd225b4faf9ed557ab7f3067e0 P 096950e469ac459c8e48c2760e0f56ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.718539  1934 tablet_replica.cc:333] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff: stopping tablet replica
I20260709 13:13:58.718966  1934 raft_consensus.cc:2243] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:58.719368  1934 raft_consensus.cc:2272] T 2d000d212ec343cea0340f6217aeb246 P 096950e469ac459c8e48c2760e0f56ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.746685  1934 tablet_server.cc:196] TabletServer@127.1.227.131:0 shutdown complete.
I20260709 13:13:58.763536  1934 master.cc:562] Master@127.1.227.190:37509 shutting down...
I20260709 13:13:58.967228  1934 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:58.967790  1934 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:58.968108  1934 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6cb9c9cc6e6b4e8db81c62b0d8656b41: stopping tablet replica
I20260709 13:13:58.988922  1934 master.cc:584] Master@127.1.227.190:37509 shutdown complete.
096950e469ac459c8e48c2760e0f56ff  1
a51c4c68e76941b59c71006c77272966  4
a9ba85a12f4440719ca1eb081b9bf874  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13201 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:13:59.032757  1934 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.227.190:44443
I20260709 13:13:59.034174  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:59.041780  2439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:59.042078  1934 server_base.cc:1061] running on GCE node
W20260709 13:13:59.041802  2440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:59.042273  2442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:59.043668  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:59.043942  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:59.044077  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783602839044063 us; error 0 us; skew 500 ppm
I20260709 13:13:59.044608  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:59.047667  1934 webserver.cc:533] Webserver started at http://127.1.227.190:46033/ using document root <none> and password file <none>
I20260709 13:13:59.048187  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:59.048372  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:59.048633  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:59.050007  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602825662285-1934-0/minicluster-data/master-0-root/instance:
uuid: "22203bb35f574704b853f1c450a733da"
format_stamp: "Formatted at 2026-07-09 13:13:59 on dist-test-slave-lfdf"
I20260709 13:13:59.055207  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:59.058861  2447 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:59.059715  1934 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:13:59.060104  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602825662285-1934-0/minicluster-data/master-0-root
uuid: "22203bb35f574704b853f1c450a733da"
format_stamp: "Formatted at 2026-07-09 13:13:59 on dist-test-slave-lfdf"
I20260709 13:13:59.060369  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602825662285-1934-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602825662285-1934-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602825662285-1934-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:59.078313  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:59.079504  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:59.122828  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.190:44443
I20260709 13:13:59.122920  2498 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.190:44443 every 8 connection(s)
I20260709 13:13:59.127234  2499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.136672  2499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da: Bootstrap starting.
I20260709 13:13:59.141260  2499 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:59.145567  2499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da: No bootstrap required, opened a new log
I20260709 13:13:59.147810  2499 raft_consensus.cc:359] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22203bb35f574704b853f1c450a733da" member_type: VOTER }
I20260709 13:13:59.148195  2499 raft_consensus.cc:385] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:59.148459  2499 raft_consensus.cc:740] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22203bb35f574704b853f1c450a733da, State: Initialized, Role: FOLLOWER
I20260709 13:13:59.149063  2499 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22203bb35f574704b853f1c450a733da" member_type: VOTER }
I20260709 13:13:59.149474  2499 raft_consensus.cc:399] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:59.149824  2499 raft_consensus.cc:493] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:59.150158  2499 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:59.155225  2499 raft_consensus.cc:515] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22203bb35f574704b853f1c450a733da" member_type: VOTER }
I20260709 13:13:59.155829  2499 leader_election.cc:304] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22203bb35f574704b853f1c450a733da; no voters: 
I20260709 13:13:59.157143  2499 leader_election.cc:290] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:59.157498  2502 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:59.158898  2502 raft_consensus.cc:697] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da [term 1 LEADER]: Becoming Leader. State: Replica: 22203bb35f574704b853f1c450a733da, State: Running, Role: LEADER
I20260709 13:13:59.159639  2502 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22203bb35f574704b853f1c450a733da" member_type: VOTER }
I20260709 13:13:59.160151  2499 sys_catalog.cc:565] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:59.164429  2503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22203bb35f574704b853f1c450a733da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22203bb35f574704b853f1c450a733da" member_type: VOTER } }
I20260709 13:13:59.164372  2504 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22203bb35f574704b853f1c450a733da. Latest consensus state: current_term: 1 leader_uuid: "22203bb35f574704b853f1c450a733da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22203bb35f574704b853f1c450a733da" member_type: VOTER } }
I20260709 13:13:59.165077  2504 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:59.165066  2503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:59.172544  2509 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:59.177531  2509 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:59.180650  1934 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:59.186789  2509 catalog_manager.cc:1383] Generated new cluster ID: 5a63e933ed0e4997aa346e603db398d3
I20260709 13:13:59.187103  2509 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:59.206472  2509 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:59.208020  2509 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:59.238566  2509 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da: Generated new TSK 0
I20260709 13:13:59.239249  2509 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:59.248131  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:59.254323  2520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:59.254629  2521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:59.256364  2523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:59.257375  1934 server_base.cc:1061] running on GCE node
I20260709 13:13:59.258219  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:59.258396  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:59.258513  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783602839258502 us; error 0 us; skew 500 ppm
I20260709 13:13:59.258965  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:59.261449  1934 webserver.cc:533] Webserver started at http://127.1.227.129:34009/ using document root <none> and password file <none>
I20260709 13:13:59.262084  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:59.262246  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:59.262491  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:59.263561  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602825662285-1934-0/minicluster-data/ts-0-root/instance:
uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
format_stamp: "Formatted at 2026-07-09 13:13:59 on dist-test-slave-lfdf"
I20260709 13:13:59.268292  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:59.271965  2528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:59.272790  1934 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:59.273104  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602825662285-1934-0/minicluster-data/ts-0-root
uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
format_stamp: "Formatted at 2026-07-09 13:13:59 on dist-test-slave-lfdf"
I20260709 13:13:59.273351  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602825662285-1934-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602825662285-1934-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602825662285-1934-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:59.285094  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:59.286422  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:59.288059  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:59.290395  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:59.290627  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:59.290879  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:59.291076  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:59.332353  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.129:39121
I20260709 13:13:59.332471  2590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.129:39121 every 8 connection(s)
I20260709 13:13:59.337524  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:59.344818  2595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:59.347724  2596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:59.348407  2598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:59.349155  1934 server_base.cc:1061] running on GCE node
I20260709 13:13:59.350404  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:59.350634  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:59.350850  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783602839350831 us; error 0 us; skew 500 ppm
I20260709 13:13:59.351395  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:59.353906  1934 webserver.cc:533] Webserver started at http://127.1.227.130:40777/ using document root <none> and password file <none>
I20260709 13:13:59.354463  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:59.354710  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:59.355049  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:59.356442  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602825662285-1934-0/minicluster-data/ts-1-root/instance:
uuid: "f96f77e6be1443e89e60a34948b29e42"
format_stamp: "Formatted at 2026-07-09 13:13:59 on dist-test-slave-lfdf"
I20260709 13:13:59.357781  2591 heartbeater.cc:344] Connected to a master server at 127.1.227.190:44443
I20260709 13:13:59.358292  2591 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:59.359112  2591 heartbeater.cc:507] Master 127.1.227.190:44443 requested a full tablet report, sending...
I20260709 13:13:59.361562  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:13:59.361660  2464 ts_manager.cc:194] Registered new tserver with Master: 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121)
I20260709 13:13:59.363735  2464 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42666
I20260709 13:13:59.365836  2603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:59.366870  1934 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:13:59.367189  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602825662285-1934-0/minicluster-data/ts-1-root
uuid: "f96f77e6be1443e89e60a34948b29e42"
format_stamp: "Formatted at 2026-07-09 13:13:59 on dist-test-slave-lfdf"
I20260709 13:13:59.367460  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602825662285-1934-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602825662285-1934-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602825662285-1934-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:59.387600  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:59.388808  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:59.390470  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:59.392939  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:59.393131  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:59.393460  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:59.393617  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:59.436918  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.130:36219
I20260709 13:13:59.437170  2665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.130:36219 every 8 connection(s)
I20260709 13:13:59.442390  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:59.449276  2669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:59.450248  2670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:59.455462  1934 server_base.cc:1061] running on GCE node
W20260709 13:13:59.455534  2672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:59.456769  2666 heartbeater.cc:344] Connected to a master server at 127.1.227.190:44443
I20260709 13:13:59.456964  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:13:59.457170  2666 heartbeater.cc:461] Registering TS with master...
W20260709 13:13:59.457300  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:59.457595  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783602839457559 us; error 0 us; skew 500 ppm
I20260709 13:13:59.458194  2666 heartbeater.cc:507] Master 127.1.227.190:44443 requested a full tablet report, sending...
I20260709 13:13:59.458297  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:59.460919  2464 ts_manager.cc:194] Registered new tserver with Master: f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219)
I20260709 13:13:59.461673  1934 webserver.cc:533] Webserver started at http://127.1.227.131:38831/ using document root <none> and password file <none>
I20260709 13:13:59.462433  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:59.462716  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:59.463085  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:59.465090  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602825662285-1934-0/minicluster-data/ts-2-root/instance:
uuid: "1dbb9c234dec422bb4b1348545e37ce3"
format_stamp: "Formatted at 2026-07-09 13:13:59 on dist-test-slave-lfdf"
I20260709 13:13:59.466455  2464 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42682
I20260709 13:13:59.471451  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:59.476071  2677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:59.476969  1934 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:13:59.477294  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602825662285-1934-0/minicluster-data/ts-2-root
uuid: "1dbb9c234dec422bb4b1348545e37ce3"
format_stamp: "Formatted at 2026-07-09 13:13:59 on dist-test-slave-lfdf"
I20260709 13:13:59.477540  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602825662285-1934-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602825662285-1934-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602825662285-1934-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:59.492026  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:59.493275  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:59.494812  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:59.497110  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:59.497303  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:59.497637  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:59.497874  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:13:59.541121  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.131:33167
I20260709 13:13:59.541249  2739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.131:33167 every 8 connection(s)
I20260709 13:13:59.556236  2740 heartbeater.cc:344] Connected to a master server at 127.1.227.190:44443
I20260709 13:13:59.556733  2740 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:59.557662  2740 heartbeater.cc:507] Master 127.1.227.190:44443 requested a full tablet report, sending...
I20260709 13:13:59.560073  2464 ts_manager.cc:194] Registered new tserver with Master: 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:13:59.560834  1934 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016156946s
I20260709 13:13:59.562039  2464 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42684
I20260709 13:13:59.590378  2464 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42692:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:59.593216  2464 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:59.680609  2705 tablet_service.cc:1511] Processing CreateTablet for tablet 9e867c538ebd4729851d3030a7921ae6 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:59.682206  2705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e867c538ebd4729851d3030a7921ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.686937  2704 tablet_service.cc:1511] Processing CreateTablet for tablet 92ed0a1371ae402bbf3b4182089bf7a4 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:59.687254  2702 tablet_service.cc:1511] Processing CreateTablet for tablet 4651f16c11c04f76b5afcb996b6ab98c (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:59.688546  2704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ed0a1371ae402bbf3b4182089bf7a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.689369  2703 tablet_service.cc:1511] Processing CreateTablet for tablet 5a236e17c7e241569819f8ad849b6f98 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:59.689828  2630 tablet_service.cc:1511] Processing CreateTablet for tablet 92ed0a1371ae402bbf3b4182089bf7a4 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:59.690421  2627 tablet_service.cc:1511] Processing CreateTablet for tablet 8472473e517c4dd29de768894545df0d (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:59.691316  2630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ed0a1371ae402bbf3b4182089bf7a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.692750  2628 tablet_service.cc:1511] Processing CreateTablet for tablet 4651f16c11c04f76b5afcb996b6ab98c (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:59.688584  2631 tablet_service.cc:1511] Processing CreateTablet for tablet 9e867c538ebd4729851d3030a7921ae6 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:59.694988  2629 tablet_service.cc:1511] Processing CreateTablet for tablet 5a236e17c7e241569819f8ad849b6f98 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:59.696357  2628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4651f16c11c04f76b5afcb996b6ab98c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.696267  2556 tablet_service.cc:1511] Processing CreateTablet for tablet 9e867c538ebd4729851d3030a7921ae6 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:59.696507  2701 tablet_service.cc:1511] Processing CreateTablet for tablet 8472473e517c4dd29de768894545df0d (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:59.698081  2703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a236e17c7e241569819f8ad849b6f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.699049  2555 tablet_service.cc:1511] Processing CreateTablet for tablet 92ed0a1371ae402bbf3b4182089bf7a4 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:59.701551  2554 tablet_service.cc:1511] Processing CreateTablet for tablet 5a236e17c7e241569819f8ad849b6f98 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:59.702210  2627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8472473e517c4dd29de768894545df0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.704114  2553 tablet_service.cc:1511] Processing CreateTablet for tablet 4651f16c11c04f76b5afcb996b6ab98c (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:59.706840  2701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8472473e517c4dd29de768894545df0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.706480  2552 tablet_service.cc:1511] Processing CreateTablet for tablet 8472473e517c4dd29de768894545df0d (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:59.708640  2556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e867c538ebd4729851d3030a7921ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.714150  2552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8472473e517c4dd29de768894545df0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.714154  2702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4651f16c11c04f76b5afcb996b6ab98c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.716856  2551 tablet_service.cc:1511] Processing CreateTablet for tablet e55294f6315244018f3c8397aeca04ce (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:59.718135  2555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ed0a1371ae402bbf3b4182089bf7a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.720038  2626 tablet_service.cc:1511] Processing CreateTablet for tablet e55294f6315244018f3c8397aeca04ce (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:59.721500  2551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55294f6315244018f3c8397aeca04ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.723802  2550 tablet_service.cc:1511] Processing CreateTablet for tablet 836d47cab55e478797c8c59d6205c895 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:59.725343  2550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 836d47cab55e478797c8c59d6205c895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.724761  2700 tablet_service.cc:1511] Processing CreateTablet for tablet e55294f6315244018f3c8397aeca04ce (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:59.726080  2553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4651f16c11c04f76b5afcb996b6ab98c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.725963  2625 tablet_service.cc:1511] Processing CreateTablet for tablet 836d47cab55e478797c8c59d6205c895 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:59.726863  2700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55294f6315244018f3c8397aeca04ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.730091  2554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a236e17c7e241569819f8ad849b6f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.731419  2699 tablet_service.cc:1511] Processing CreateTablet for tablet 836d47cab55e478797c8c59d6205c895 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:59.732393  2549 tablet_service.cc:1511] Processing CreateTablet for tablet b3622a951e8e408881ce7caf82d16641 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:59.732976  2699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 836d47cab55e478797c8c59d6205c895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.733798  2549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3622a951e8e408881ce7caf82d16641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.734659  2624 tablet_service.cc:1511] Processing CreateTablet for tablet b3622a951e8e408881ce7caf82d16641 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:59.737848  2629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a236e17c7e241569819f8ad849b6f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.738874  2626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55294f6315244018f3c8397aeca04ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.739230  2698 tablet_service.cc:1511] Processing CreateTablet for tablet b3622a951e8e408881ce7caf82d16641 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:59.740712  2698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3622a951e8e408881ce7caf82d16641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.748690  2548 tablet_service.cc:1511] Processing CreateTablet for tablet 429828aabbb949f58f84ee2ffc1bcc47 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:59.750159  2548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 429828aabbb949f58f84ee2ffc1bcc47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.755223  2628 tablet_service.cc:1511] Processing CreateTablet for tablet 429828aabbb949f58f84ee2ffc1bcc47 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:59.758256  2547 tablet_service.cc:1511] Processing CreateTablet for tablet 122e785e3955406b8953143345c7b8d4 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:59.759801  2547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 122e785e3955406b8953143345c7b8d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.763480  2697 tablet_service.cc:1511] Processing CreateTablet for tablet 429828aabbb949f58f84ee2ffc1bcc47 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:59.765142  2697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 429828aabbb949f58f84ee2ffc1bcc47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.766896  2696 tablet_service.cc:1511] Processing CreateTablet for tablet 122e785e3955406b8953143345c7b8d4 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:59.769661  2696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 122e785e3955406b8953143345c7b8d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.769968  2627 tablet_service.cc:1511] Processing CreateTablet for tablet 122e785e3955406b8953143345c7b8d4 (DEFAULT_TABLE table=test-workload [id=c9989da532fe4812b79b4a02153fbee2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:59.773839  2631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e867c538ebd4729851d3030a7921ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.778127  2625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 836d47cab55e478797c8c59d6205c895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.780537  2628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 429828aabbb949f58f84ee2ffc1bcc47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.782296  2624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3622a951e8e408881ce7caf82d16641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.790112  2627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 122e785e3955406b8953143345c7b8d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.800989  2755 tablet_bootstrap.cc:492] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42: Bootstrap starting.
I20260709 13:13:59.834311  2755 tablet_bootstrap.cc:654] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:59.856055  2757 tablet_bootstrap.cc:492] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Bootstrap starting.
I20260709 13:13:59.858542  2756 tablet_bootstrap.cc:492] T 92ed0a1371ae402bbf3b4182089bf7a4 P 1dbb9c234dec422bb4b1348545e37ce3: Bootstrap starting.
I20260709 13:13:59.863854  2757 tablet_bootstrap.cc:654] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:59.878487  2756 tablet_bootstrap.cc:654] T 92ed0a1371ae402bbf3b4182089bf7a4 P 1dbb9c234dec422bb4b1348545e37ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:59.884716  2755 tablet_bootstrap.cc:492] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42: No bootstrap required, opened a new log
I20260709 13:13:59.885289  2755 ts_tablet_manager.cc:1403] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42: Time spent bootstrapping tablet: real 0.085s	user 0.019s	sys 0.033s
I20260709 13:13:59.888106  2755 raft_consensus.cc:359] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:13:59.888934  2755 raft_consensus.cc:385] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:59.889279  2755 raft_consensus.cc:740] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Initialized, Role: FOLLOWER
I20260709 13:13:59.890285  2755 consensus_queue.cc:260] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:13:59.900007  2755 ts_tablet_manager.cc:1434] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:13:59.900871  2666 heartbeater.cc:499] Master 127.1.227.190:44443 was elected leader, sending a full tablet report...
I20260709 13:13:59.914530  2755 tablet_bootstrap.cc:492] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42: Bootstrap starting.
I20260709 13:13:59.922111  2757 tablet_bootstrap.cc:492] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435: No bootstrap required, opened a new log
I20260709 13:13:59.922873  2757 ts_tablet_manager.cc:1403] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Time spent bootstrapping tablet: real 0.067s	user 0.023s	sys 0.034s
I20260709 13:13:59.923075  2755 tablet_bootstrap.cc:654] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:59.928030  2756 tablet_bootstrap.cc:492] T 92ed0a1371ae402bbf3b4182089bf7a4 P 1dbb9c234dec422bb4b1348545e37ce3: No bootstrap required, opened a new log
I20260709 13:13:59.928555  2756 ts_tablet_manager.cc:1403] T 92ed0a1371ae402bbf3b4182089bf7a4 P 1dbb9c234dec422bb4b1348545e37ce3: Time spent bootstrapping tablet: real 0.070s	user 0.021s	sys 0.031s
I20260709 13:13:59.925210  2761 raft_consensus.cc:493] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.931048  2761 raft_consensus.cc:515] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:13:59.932265  2756 raft_consensus.cc:359] T 92ed0a1371ae402bbf3b4182089bf7a4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:13:59.933329  2756 raft_consensus.cc:385] T 92ed0a1371ae402bbf3b4182089bf7a4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:59.936434  2761 leader_election.cc:290] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:13:59.927464  2757 raft_consensus.cc:359] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:13:59.938102  2757 raft_consensus.cc:385] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:59.938556  2757 raft_consensus.cc:740] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Initialized, Role: FOLLOWER
I20260709 13:13:59.939669  2757 consensus_queue.cc:260] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:13:59.949234  2591 heartbeater.cc:499] Master 127.1.227.190:44443 was elected leader, sending a full tablet report...
I20260709 13:13:59.949805  2757 ts_tablet_manager.cc:1434] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.006s
I20260709 13:13:59.950870  2757 tablet_bootstrap.cc:492] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Bootstrap starting.
I20260709 13:13:59.951225  2566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ed0a1371ae402bbf3b4182089bf7a4" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" is_pre_election: true
W20260709 13:13:59.953671  2606 leader_election.cc:343] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:59.933789  2756 raft_consensus.cc:740] T 92ed0a1371ae402bbf3b4182089bf7a4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dbb9c234dec422bb4b1348545e37ce3, State: Initialized, Role: FOLLOWER
I20260709 13:13:59.959309  2757 tablet_bootstrap.cc:654] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:59.961313  2756 consensus_queue.cc:260] T 92ed0a1371ae402bbf3b4182089bf7a4 P 1dbb9c234dec422bb4b1348545e37ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:13:59.983752  2757 tablet_bootstrap.cc:492] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435: No bootstrap required, opened a new log
I20260709 13:13:59.984673  2757 ts_tablet_manager.cc:1403] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.010s
I20260709 13:13:59.990180  2740 heartbeater.cc:499] Master 127.1.227.190:44443 was elected leader, sending a full tablet report...
I20260709 13:13:59.989890  2715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ed0a1371ae402bbf3b4182089bf7a4" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3" is_pre_election: true
I20260709 13:13:59.990967  2715 raft_consensus.cc:2468] T 92ed0a1371ae402bbf3b4182089bf7a4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 0.
I20260709 13:13:59.991752  2755 tablet_bootstrap.cc:492] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42: No bootstrap required, opened a new log
I20260709 13:13:59.992277  2755 ts_tablet_manager.cc:1403] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42: Time spent bootstrapping tablet: real 0.078s	user 0.020s	sys 0.049s
I20260709 13:13:59.992555  2607 leader_election.cc:304] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42; no voters: 8f9e79a28c0d4f06b5e3cb846bd8b435
I20260709 13:13:59.993620  2762 raft_consensus.cc:2804] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:59.994072  2762 raft_consensus.cc:493] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:59.994454  2762 raft_consensus.cc:3060] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:59.995833  2756 ts_tablet_manager.cc:1434] T 92ed0a1371ae402bbf3b4182089bf7a4 P 1dbb9c234dec422bb4b1348545e37ce3: Time spent starting tablet: real 0.067s	user 0.012s	sys 0.000s
I20260709 13:13:59.995609  2755 raft_consensus.cc:359] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:13:59.996443  2755 raft_consensus.cc:385] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:59.996202  2757 raft_consensus.cc:359] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } }
I20260709 13:13:59.996974  2756 tablet_bootstrap.cc:492] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3: Bootstrap starting.
I20260709 13:13:59.997334  2757 raft_consensus.cc:385] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:59.997783  2757 raft_consensus.cc:740] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Initialized, Role: FOLLOWER
I20260709 13:13:59.998697  2757 consensus_queue.cc:260] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } }
I20260709 13:13:59.996831  2755 raft_consensus.cc:740] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.000356  2755 consensus_queue.cc:260] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.003696  2755 ts_tablet_manager.cc:1434] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:14:00.004612  2756 tablet_bootstrap.cc:654] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.006753  2755 tablet_bootstrap.cc:492] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42: Bootstrap starting.
I20260709 13:14:00.007462  2762 raft_consensus.cc:515] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.005671  2757 ts_tablet_manager.cc:1434] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:14:00.010700  2566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ed0a1371ae402bbf3b4182089bf7a4" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
W20260709 13:14:00.012308  2606 leader_election.cc:343] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.010913  2757 tablet_bootstrap.cc:492] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Bootstrap starting.
I20260709 13:14:00.014400  2755 tablet_bootstrap.cc:654] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.020830  2757 tablet_bootstrap.cc:654] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.023741  2715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ed0a1371ae402bbf3b4182089bf7a4" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:00.024446  2715 raft_consensus.cc:3060] T 92ed0a1371ae402bbf3b4182089bf7a4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.032284  2756 tablet_bootstrap.cc:492] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3: No bootstrap required, opened a new log
I20260709 13:14:00.032923  2756 ts_tablet_manager.cc:1403] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.010s
I20260709 13:14:00.033886  2762 leader_election.cc:290] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 election: Requested vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.035964  2715 raft_consensus.cc:2468] T 92ed0a1371ae402bbf3b4182089bf7a4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 1.
I20260709 13:14:00.036247  2756 raft_consensus.cc:359] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.037138  2756 raft_consensus.cc:385] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.037518  2756 raft_consensus.cc:740] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dbb9c234dec422bb4b1348545e37ce3, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.037886  2607 leader_election.cc:304] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42; no voters: 8f9e79a28c0d4f06b5e3cb846bd8b435
I20260709 13:14:00.038595  2756 consensus_queue.cc:260] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.039675  2762 raft_consensus.cc:2804] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.041082  2756 ts_tablet_manager.cc:1434] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:00.041281  2762 raft_consensus.cc:697] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Becoming Leader. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Running, Role: LEADER
I20260709 13:14:00.042152  2756 tablet_bootstrap.cc:492] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3: Bootstrap starting.
I20260709 13:14:00.042520  2762 consensus_queue.cc:237] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.049973  2756 tablet_bootstrap.cc:654] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.050032  2755 tablet_bootstrap.cc:492] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42: No bootstrap required, opened a new log
I20260709 13:14:00.050860  2755 ts_tablet_manager.cc:1403] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.015s
I20260709 13:14:00.054831  2755 raft_consensus.cc:359] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.058645  2755 raft_consensus.cc:385] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.059070  2755 raft_consensus.cc:740] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.059897  2755 consensus_queue.cc:260] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.061414  2756 tablet_bootstrap.cc:492] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3: No bootstrap required, opened a new log
I20260709 13:14:00.062163  2756 ts_tablet_manager.cc:1403] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.014s
I20260709 13:14:00.062966  2755 ts_tablet_manager.cc:1434] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:14:00.062578  2463 catalog_manager.cc:5697] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 reported cstate change: term changed from 0 to 1, leader changed from <none> to f96f77e6be1443e89e60a34948b29e42 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f96f77e6be1443e89e60a34948b29e42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.064586  2755 tablet_bootstrap.cc:492] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42: Bootstrap starting.
I20260709 13:14:00.065999  2756 raft_consensus.cc:359] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.066854  2756 raft_consensus.cc:385] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.067199  2756 raft_consensus.cc:740] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dbb9c234dec422bb4b1348545e37ce3, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.067512  2757 tablet_bootstrap.cc:492] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435: No bootstrap required, opened a new log
I20260709 13:14:00.068276  2757 ts_tablet_manager.cc:1403] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.002s
I20260709 13:14:00.068068  2756 consensus_queue.cc:260] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.071633  2755 tablet_bootstrap.cc:654] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.071520  2757 raft_consensus.cc:359] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.072446  2757 raft_consensus.cc:385] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.072846  2757 raft_consensus.cc:740] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.073827  2757 consensus_queue.cc:260] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.075253  2756 ts_tablet_manager.cc:1434] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:14:00.076385  2756 tablet_bootstrap.cc:492] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3: Bootstrap starting.
I20260709 13:14:00.084069  2756 tablet_bootstrap.cc:654] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.085430  2757 ts_tablet_manager.cc:1434] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:14:00.092110  2757 tablet_bootstrap.cc:492] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Bootstrap starting.
I20260709 13:14:00.099885  2756 tablet_bootstrap.cc:492] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3: No bootstrap required, opened a new log
I20260709 13:14:00.100449  2756 ts_tablet_manager.cc:1403] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.005s
I20260709 13:14:00.100701  2757 tablet_bootstrap.cc:654] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.101923  2755 tablet_bootstrap.cc:492] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42: No bootstrap required, opened a new log
I20260709 13:14:00.102430  2755 ts_tablet_manager.cc:1403] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.022s
I20260709 13:14:00.103087  2756 raft_consensus.cc:359] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } }
I20260709 13:14:00.103695  2756 raft_consensus.cc:385] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.104039  2756 raft_consensus.cc:740] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dbb9c234dec422bb4b1348545e37ce3, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.104954  2756 consensus_queue.cc:260] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } }
I20260709 13:14:00.105360  2755 raft_consensus.cc:359] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.106084  2755 raft_consensus.cc:385] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.106413  2757 tablet_bootstrap.cc:492] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435: No bootstrap required, opened a new log
I20260709 13:14:00.106362  2755 raft_consensus.cc:740] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.106900  2757 ts_tablet_manager.cc:1403] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.001s
I20260709 13:14:00.107156  2756 ts_tablet_manager.cc:1434] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:14:00.107275  2755 consensus_queue.cc:260] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.108397  2756 tablet_bootstrap.cc:492] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3: Bootstrap starting.
I20260709 13:14:00.109511  2755 ts_tablet_manager.cc:1434] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:00.110486  2755 tablet_bootstrap.cc:492] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42: Bootstrap starting.
I20260709 13:14:00.115962  2756 tablet_bootstrap.cc:654] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.116780  2755 tablet_bootstrap.cc:654] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.120683  2757 raft_consensus.cc:359] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.121606  2757 raft_consensus.cc:385] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.122037  2757 raft_consensus.cc:740] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.122951  2757 consensus_queue.cc:260] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.123986  2756 tablet_bootstrap.cc:492] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3: No bootstrap required, opened a new log
I20260709 13:14:00.124481  2756 ts_tablet_manager.cc:1403] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:14:00.125432  2757 ts_tablet_manager.cc:1434] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 13:14:00.126529  2757 tablet_bootstrap.cc:492] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435: Bootstrap starting.
I20260709 13:14:00.127540  2756 raft_consensus.cc:359] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.128373  2756 raft_consensus.cc:385] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.128705  2756 raft_consensus.cc:740] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dbb9c234dec422bb4b1348545e37ce3, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.129570  2756 consensus_queue.cc:260] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.132666  2755 tablet_bootstrap.cc:492] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42: No bootstrap required, opened a new log
I20260709 13:14:00.133157  2755 ts_tablet_manager.cc:1403] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.014s
I20260709 13:14:00.133507  2756 ts_tablet_manager.cc:1434] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:14:00.134595  2756 tablet_bootstrap.cc:492] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3: Bootstrap starting.
I20260709 13:14:00.135977  2755 raft_consensus.cc:359] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.136704  2755 raft_consensus.cc:385] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.137022  2755 raft_consensus.cc:740] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.137719  2755 consensus_queue.cc:260] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.139915  2755 ts_tablet_manager.cc:1434] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.007s
I20260709 13:14:00.140661  2757 tablet_bootstrap.cc:654] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.140832  2755 tablet_bootstrap.cc:492] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42: Bootstrap starting.
I20260709 13:14:00.142259  2756 tablet_bootstrap.cc:654] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.147588  2755 tablet_bootstrap.cc:654] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.160648  2755 tablet_bootstrap.cc:492] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42: No bootstrap required, opened a new log
I20260709 13:14:00.160641  2756 tablet_bootstrap.cc:492] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3: No bootstrap required, opened a new log
I20260709 13:14:00.161342  2755 ts_tablet_manager.cc:1403] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.010s
I20260709 13:14:00.161602  2756 ts_tablet_manager.cc:1403] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.007s
I20260709 13:14:00.161664  2757 tablet_bootstrap.cc:492] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435: No bootstrap required, opened a new log
I20260709 13:14:00.162436  2757 ts_tablet_manager.cc:1403] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435: Time spent bootstrapping tablet: real 0.036s	user 0.025s	sys 0.001s
I20260709 13:14:00.164244  2756 raft_consensus.cc:359] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.164808  2756 raft_consensus.cc:385] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.165269  2756 raft_consensus.cc:740] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dbb9c234dec422bb4b1348545e37ce3, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.164785  2755 raft_consensus.cc:359] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.165766  2755 raft_consensus.cc:385] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.165501  2757 raft_consensus.cc:359] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.166144  2755 raft_consensus.cc:740] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.166373  2757 raft_consensus.cc:385] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.166177  2756 consensus_queue.cc:260] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.166743  2757 raft_consensus.cc:740] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.167069  2755 consensus_queue.cc:260] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.168051  2757 consensus_queue.cc:260] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.168623  2756 ts_tablet_manager.cc:1434] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 13:14:00.169827  2756 tablet_bootstrap.cc:492] T 4651f16c11c04f76b5afcb996b6ab98c P 1dbb9c234dec422bb4b1348545e37ce3: Bootstrap starting.
I20260709 13:14:00.169844  2755 ts_tablet_manager.cc:1434] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 13:14:00.171278  2755 tablet_bootstrap.cc:492] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42: Bootstrap starting.
I20260709 13:14:00.177443  2756 tablet_bootstrap.cc:654] T 4651f16c11c04f76b5afcb996b6ab98c P 1dbb9c234dec422bb4b1348545e37ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.178717  2755 tablet_bootstrap.cc:654] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.182812  2757 ts_tablet_manager.cc:1434] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:14:00.188071  2757 tablet_bootstrap.cc:492] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Bootstrap starting.
I20260709 13:14:00.191533  2755 tablet_bootstrap.cc:492] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42: No bootstrap required, opened a new log
W20260709 13:14:00.177330  2512 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:00.193498  2755 ts_tablet_manager.cc:1403] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.006s
I20260709 13:14:00.195608  2757 tablet_bootstrap.cc:654] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.196707  2755 raft_consensus.cc:359] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.197589  2755 raft_consensus.cc:385] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.197956  2755 raft_consensus.cc:740] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.199056  2755 consensus_queue.cc:260] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.202332  2764 raft_consensus.cc:493] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.203053  2756 tablet_bootstrap.cc:492] T 4651f16c11c04f76b5afcb996b6ab98c P 1dbb9c234dec422bb4b1348545e37ce3: No bootstrap required, opened a new log
I20260709 13:14:00.202847  2764 raft_consensus.cc:515] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.203567  2756 ts_tablet_manager.cc:1403] T 4651f16c11c04f76b5afcb996b6ab98c P 1dbb9c234dec422bb4b1348545e37ce3: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.016s
I20260709 13:14:00.206564  2756 raft_consensus.cc:359] T 4651f16c11c04f76b5afcb996b6ab98c P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.207193  2756 raft_consensus.cc:385] T 4651f16c11c04f76b5afcb996b6ab98c P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.207509  2756 raft_consensus.cc:740] T 4651f16c11c04f76b5afcb996b6ab98c P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dbb9c234dec422bb4b1348545e37ce3, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.208336  2756 consensus_queue.cc:260] T 4651f16c11c04f76b5afcb996b6ab98c P 1dbb9c234dec422bb4b1348545e37ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.210805  2755 ts_tablet_manager.cc:1434] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:14:00.210827  2756 ts_tablet_manager.cc:1434] T 4651f16c11c04f76b5afcb996b6ab98c P 1dbb9c234dec422bb4b1348545e37ce3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:00.212468  2756 tablet_bootstrap.cc:492] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3: Bootstrap starting.
I20260709 13:14:00.214133  2764 leader_election.cc:290] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.215183  2755 tablet_bootstrap.cc:492] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42: Bootstrap starting.
I20260709 13:14:00.218953  2756 tablet_bootstrap.cc:654] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.223399  2764 raft_consensus.cc:493] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.224215  2755 tablet_bootstrap.cc:654] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.223898  2764 raft_consensus.cc:515] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.226352  2764 leader_election.cc:290] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.233968  2756 tablet_bootstrap.cc:492] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3: No bootstrap required, opened a new log
I20260709 13:14:00.234473  2756 ts_tablet_manager.cc:1403] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.007s
I20260709 13:14:00.235998  2755 tablet_bootstrap.cc:492] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42: No bootstrap required, opened a new log
I20260709 13:14:00.236440  2755 ts_tablet_manager.cc:1403] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.011s
I20260709 13:14:00.236991  2756 raft_consensus.cc:359] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.237830  2756 raft_consensus.cc:385] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.238117  2756 raft_consensus.cc:740] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dbb9c234dec422bb4b1348545e37ce3, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.238193  2641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4651f16c11c04f76b5afcb996b6ab98c" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f96f77e6be1443e89e60a34948b29e42" is_pre_election: true
I20260709 13:14:00.238834  2641 raft_consensus.cc:2468] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 0.
I20260709 13:14:00.238924  2756 consensus_queue.cc:260] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.239467  2757 tablet_bootstrap.cc:492] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435: No bootstrap required, opened a new log
I20260709 13:14:00.239154  2755 raft_consensus.cc:359] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } }
I20260709 13:14:00.239853  2755 raft_consensus.cc:385] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.239955  2757 ts_tablet_manager.cc:1403] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Time spent bootstrapping tablet: real 0.052s	user 0.005s	sys 0.012s
I20260709 13:14:00.240088  2640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3622a951e8e408881ce7caf82d16641" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f96f77e6be1443e89e60a34948b29e42" is_pre_election: true
I20260709 13:14:00.240164  2755 raft_consensus.cc:740] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.240834  2640 raft_consensus.cc:2468] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 0.
I20260709 13:14:00.241222  2755 consensus_queue.cc:260] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } }
I20260709 13:14:00.242451  2529 leader_election.cc:304] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9e79a28c0d4f06b5e3cb846bd8b435, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:00.243273  2764 raft_consensus.cc:2804] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.243685  2764 raft_consensus.cc:493] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.244001  2764 raft_consensus.cc:3060] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.244215  2756 ts_tablet_manager.cc:1434] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:14:00.245153  2756 tablet_bootstrap.cc:492] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3: Bootstrap starting.
I20260709 13:14:00.249956  2757 raft_consensus.cc:359] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.250465  2755 ts_tablet_manager.cc:1434] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:14:00.250741  2757 raft_consensus.cc:385] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.251060  2757 raft_consensus.cc:740] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.251114  2529 leader_election.cc:304] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9e79a28c0d4f06b5e3cb846bd8b435, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:00.251947  2757 consensus_queue.cc:260] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.253217  2764 raft_consensus.cc:515] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.254130  2755 tablet_bootstrap.cc:492] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42: Bootstrap starting.
I20260709 13:14:00.257603  2756 tablet_bootstrap.cc:654] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.259305  2764 leader_election.cc:290] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 election: Requested vote from peers f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.260416  2764 raft_consensus.cc:2804] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.261222  2755 tablet_bootstrap.cc:654] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.265084  2764 raft_consensus.cc:493] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.267940  2764 raft_consensus.cc:3060] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.271382  2714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3622a951e8e408881ce7caf82d16641" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3" is_pre_election: true
I20260709 13:14:00.272336  2713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4651f16c11c04f76b5afcb996b6ab98c" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:00.272838  2714 raft_consensus.cc:2468] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 0.
I20260709 13:14:00.273130  2713 raft_consensus.cc:3060] T 4651f16c11c04f76b5afcb996b6ab98c P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.271617  2715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4651f16c11c04f76b5afcb996b6ab98c" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3" is_pre_election: true
I20260709 13:14:00.277125  2755 tablet_bootstrap.cc:492] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42: No bootstrap required, opened a new log
I20260709 13:14:00.277803  2755 ts_tablet_manager.cc:1403] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.003s
I20260709 13:14:00.281114  2713 raft_consensus.cc:2468] T 4651f16c11c04f76b5afcb996b6ab98c P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 1.
I20260709 13:14:00.281378  2640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4651f16c11c04f76b5afcb996b6ab98c" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
I20260709 13:14:00.282039  2640 raft_consensus.cc:3060] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.281555  2755 raft_consensus.cc:359] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.282538  2755 raft_consensus.cc:385] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.282495  2532 leader_election.cc:304] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, 8f9e79a28c0d4f06b5e3cb846bd8b435; no voters: 
I20260709 13:14:00.283041  2755 raft_consensus.cc:740] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.284246  2755 consensus_queue.cc:260] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.291250  2755 ts_tablet_manager.cc:1434] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:14:00.292268  2755 tablet_bootstrap.cc:492] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42: Bootstrap starting.
I20260709 13:14:00.292141  2640 raft_consensus.cc:2468] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 1.
I20260709 13:14:00.299089  2755 tablet_bootstrap.cc:654] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.309305  2789 raft_consensus.cc:2804] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.310232  2789 raft_consensus.cc:697] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Becoming Leader. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:00.312742  2755 tablet_bootstrap.cc:492] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42: No bootstrap required, opened a new log
I20260709 13:14:00.318228  2755 ts_tablet_manager.cc:1403] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.002s
I20260709 13:14:00.318671  2789 consensus_queue.cc:237] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.321640  2755 raft_consensus.cc:359] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.322546  2755 raft_consensus.cc:385] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.322844  2755 raft_consensus.cc:740] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.323190  2757 ts_tablet_manager.cc:1434] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Time spent starting tablet: real 0.083s	user 0.029s	sys 0.035s
I20260709 13:14:00.323801  2755 consensus_queue.cc:260] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.324254  2757 tablet_bootstrap.cc:492] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435: Bootstrap starting.
I20260709 13:14:00.326184  2755 ts_tablet_manager.cc:1434] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:14:00.316774  2764 raft_consensus.cc:515] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.327553  2762 raft_consensus.cc:493] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.328118  2762 raft_consensus.cc:515] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } }
I20260709 13:14:00.328816  2756 tablet_bootstrap.cc:492] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3: No bootstrap required, opened a new log
I20260709 13:14:00.329301  2756 ts_tablet_manager.cc:1403] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3: Time spent bootstrapping tablet: real 0.084s	user 0.037s	sys 0.018s
I20260709 13:14:00.330295  2762 leader_election.cc:290] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167), 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121)
I20260709 13:14:00.331014  2757 tablet_bootstrap.cc:654] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.332187  2756 raft_consensus.cc:359] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.333670  2756 raft_consensus.cc:385] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.333195  2713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3622a951e8e408881ce7caf82d16641" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:00.334216  2713 raft_consensus.cc:3060] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.334791  2715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e867c538ebd4729851d3030a7921ae6" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3" is_pre_election: true
I20260709 13:14:00.335392  2715 raft_consensus.cc:2468] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 0.
I20260709 13:14:00.336460  2640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3622a951e8e408881ce7caf82d16641" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
I20260709 13:14:00.336997  2640 raft_consensus.cc:3060] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.343494  2713 raft_consensus.cc:2468] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 1.
I20260709 13:14:00.344846  2532 leader_election.cc:304] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, 8f9e79a28c0d4f06b5e3cb846bd8b435; no voters: 
I20260709 13:14:00.332994  2764 leader_election.cc:290] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 election: Requested vote from peers f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.345795  2789 raft_consensus.cc:2804] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.346063  2756 raft_consensus.cc:740] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dbb9c234dec422bb4b1348545e37ce3, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.346355  2789 raft_consensus.cc:697] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Becoming Leader. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:00.347191  2756 consensus_queue.cc:260] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.347530  2789 consensus_queue.cc:237] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.348706  2607 leader_election.cc:304] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:00.349538  2762 raft_consensus.cc:2804] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.349943  2762 raft_consensus.cc:493] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.334082  2566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e867c538ebd4729851d3030a7921ae6" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" is_pre_election: true
I20260709 13:14:00.350257  2756 ts_tablet_manager.cc:1434] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
I20260709 13:14:00.350548  2566 raft_consensus.cc:2468] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 0.
I20260709 13:14:00.351524  2756 tablet_bootstrap.cc:492] T 429828aabbb949f58f84ee2ffc1bcc47 P 1dbb9c234dec422bb4b1348545e37ce3: Bootstrap starting.
I20260709 13:14:00.350275  2762 raft_consensus.cc:3060] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.355543  2462 catalog_manager.cc:5697] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.359208  2756 tablet_bootstrap.cc:654] T 429828aabbb949f58f84ee2ffc1bcc47 P 1dbb9c234dec422bb4b1348545e37ce3: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.360740  2762 raft_consensus.cc:515] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } }
I20260709 13:14:00.363759  2640 raft_consensus.cc:2468] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 1.
I20260709 13:14:00.369025  2713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e867c538ebd4729851d3030a7921ae6" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:00.369691  2713 raft_consensus.cc:3060] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.378527  2713 raft_consensus.cc:2468] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 1.
I20260709 13:14:00.380152  2607 leader_election.cc:304] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:00.381346  2761 raft_consensus.cc:2804] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.381884  2764 raft_consensus.cc:493] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.382400  2764 raft_consensus.cc:515] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.388833  2566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e867c538ebd4729851d3030a7921ae6" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
I20260709 13:14:00.389473  2566 raft_consensus.cc:3060] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.390223  2764 leader_election.cc:290] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.394479  2764 raft_consensus.cc:493] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.394979  2764 raft_consensus.cc:515] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.395767  2761 raft_consensus.cc:697] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Becoming Leader. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Running, Role: LEADER
I20260709 13:14:00.397544  2756 tablet_bootstrap.cc:492] T 429828aabbb949f58f84ee2ffc1bcc47 P 1dbb9c234dec422bb4b1348545e37ce3: No bootstrap required, opened a new log
I20260709 13:14:00.398013  2756 ts_tablet_manager.cc:1403] T 429828aabbb949f58f84ee2ffc1bcc47 P 1dbb9c234dec422bb4b1348545e37ce3: Time spent bootstrapping tablet: real 0.047s	user 0.028s	sys 0.015s
I20260709 13:14:00.398686  2641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429828aabbb949f58f84ee2ffc1bcc47" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f96f77e6be1443e89e60a34948b29e42" is_pre_election: true
I20260709 13:14:00.399509  2641 raft_consensus.cc:2468] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 0.
I20260709 13:14:00.400913  2529 leader_election.cc:304] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9e79a28c0d4f06b5e3cb846bd8b435, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:00.402489  2566 raft_consensus.cc:2468] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 1.
I20260709 13:14:00.402704  2790 raft_consensus.cc:2804] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.404779  2790 raft_consensus.cc:493] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.405172  2790 raft_consensus.cc:3060] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.405681  2762 leader_election.cc:290] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 election: Requested vote from peers 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167), 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121)
I20260709 13:14:00.406811  2762 raft_consensus.cc:493] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.407482  2762 raft_consensus.cc:515] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.397128  2761 consensus_queue.cc:237] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } }
I20260709 13:14:00.405225  2713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a236e17c7e241569819f8ad849b6f98" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3" is_pre_election: true
I20260709 13:14:00.409864  2462 catalog_manager.cc:5697] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.400727  2756 raft_consensus.cc:359] T 429828aabbb949f58f84ee2ffc1bcc47 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.416111  2756 raft_consensus.cc:385] T 429828aabbb949f58f84ee2ffc1bcc47 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.416450  2756 raft_consensus.cc:740] T 429828aabbb949f58f84ee2ffc1bcc47 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dbb9c234dec422bb4b1348545e37ce3, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.417896  2756 consensus_queue.cc:260] T 429828aabbb949f58f84ee2ffc1bcc47 P 1dbb9c234dec422bb4b1348545e37ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.420058  2756 ts_tablet_manager.cc:1434] T 429828aabbb949f58f84ee2ffc1bcc47 P 1dbb9c234dec422bb4b1348545e37ce3: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.003s
I20260709 13:14:00.419965  2566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8472473e517c4dd29de768894545df0d" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" is_pre_election: true
I20260709 13:14:00.422896  2714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8472473e517c4dd29de768894545df0d" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3" is_pre_election: true
I20260709 13:14:00.423552  2714 raft_consensus.cc:2468] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 0.
W20260709 13:14:00.424556  2606 leader_election.cc:343] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.425359  2607 leader_election.cc:304] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42; no voters: 8f9e79a28c0d4f06b5e3cb846bd8b435
I20260709 13:14:00.410913  2798 raft_consensus.cc:493] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.426708  2798 raft_consensus.cc:515] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.427048  2799 raft_consensus.cc:2804] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.427600  2799 raft_consensus.cc:493] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.428054  2799 raft_consensus.cc:3060] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.428973  2798 leader_election.cc:290] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.430811  2714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836d47cab55e478797c8c59d6205c895" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3" is_pre_election: true
I20260709 13:14:00.431455  2714 raft_consensus.cc:2468] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 0.
I20260709 13:14:00.411461  2715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429828aabbb949f58f84ee2ffc1bcc47" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3" is_pre_election: true
I20260709 13:14:00.432417  2715 raft_consensus.cc:2468] T 429828aabbb949f58f84ee2ffc1bcc47 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 0.
I20260709 13:14:00.432796  2607 leader_election.cc:304] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:00.434540  2798 raft_consensus.cc:2804] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.434943  2798 raft_consensus.cc:493] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.435344  2798 raft_consensus.cc:3060] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.411646  2713 raft_consensus.cc:2468] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 0.
I20260709 13:14:00.441545  2532 leader_election.cc:304] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, 8f9e79a28c0d4f06b5e3cb846bd8b435; no voters: 
I20260709 13:14:00.442459  2789 raft_consensus.cc:2804] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.442871  2789 raft_consensus.cc:493] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.441831  2463 catalog_manager.cc:5697] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 reported cstate change: term changed from 0 to 1, leader changed from <none> to f96f77e6be1443e89e60a34948b29e42 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f96f77e6be1443e89e60a34948b29e42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:00.443286  2789 raft_consensus.cc:3060] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.442930  2798 raft_consensus.cc:515] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.446463  2565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836d47cab55e478797c8c59d6205c895" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
I20260709 13:14:00.447077  2798 leader_election.cc:290] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 election: Requested vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.447320  2566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836d47cab55e478797c8c59d6205c895" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" is_pre_election: true
I20260709 13:14:00.425385  2762 leader_election.cc:290] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
W20260709 13:14:00.447836  2606 leader_election.cc:343] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:00.448530  2606 leader_election.cc:343] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.453871  2757 tablet_bootstrap.cc:492] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435: No bootstrap required, opened a new log
I20260709 13:14:00.454365  2757 ts_tablet_manager.cc:1403] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435: Time spent bootstrapping tablet: real 0.130s	user 0.069s	sys 0.054s
I20260709 13:14:00.455307  2762 raft_consensus.cc:493] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.455811  2762 raft_consensus.cc:515] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.456314  2715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836d47cab55e478797c8c59d6205c895" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:00.457145  2715 raft_consensus.cc:3060] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.456063  2799 raft_consensus.cc:515] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.458187  2762 leader_election.cc:290] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.459554  2799 leader_election.cc:290] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 election: Requested vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.459461  2714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a236e17c7e241569819f8ad849b6f98" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3" is_pre_election: true
I20260709 13:14:00.460188  2714 raft_consensus.cc:2468] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 0.
I20260709 13:14:00.409938  2764 leader_election.cc:290] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.460891  2757 raft_consensus.cc:359] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.461606  2757 raft_consensus.cc:385] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.403560  2640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a236e17c7e241569819f8ad849b6f98" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f96f77e6be1443e89e60a34948b29e42" is_pre_election: true
I20260709 13:14:00.461915  2757 raft_consensus.cc:740] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.462229  2607 leader_election.cc:304] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:00.462715  2757 consensus_queue.cc:260] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.464005  2714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8472473e517c4dd29de768894545df0d" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:00.464612  2714 raft_consensus.cc:3060] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.465108  2757 ts_tablet_manager.cc:1434] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:14:00.466117  2757 tablet_bootstrap.cc:492] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Bootstrap starting.
I20260709 13:14:00.466632  2790 raft_consensus.cc:515] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.470407  2566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a236e17c7e241569819f8ad849b6f98" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" is_pre_election: true
I20260709 13:14:00.470904  2641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429828aabbb949f58f84ee2ffc1bcc47" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
I20260709 13:14:00.471448  2641 raft_consensus.cc:3060] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.472262  2565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8472473e517c4dd29de768894545df0d" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
I20260709 13:14:00.472404  2714 raft_consensus.cc:2468] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 1.
I20260709 13:14:00.472842  2565 raft_consensus.cc:3060] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.470407  2713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429828aabbb949f58f84ee2ffc1bcc47" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:00.474392  2713 raft_consensus.cc:3060] T 429828aabbb949f58f84ee2ffc1bcc47 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.474200  2789 raft_consensus.cc:515] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.476115  2757 tablet_bootstrap.cc:654] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.476722  2566 raft_consensus.cc:2393] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f96f77e6be1443e89e60a34948b29e42 in current term 1: Already voted for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in this term.
I20260709 13:14:00.468783  2790 leader_election.cc:290] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 election: Requested vote from peers f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.478720  2789 leader_election.cc:290] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 election: Requested vote from peers f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.478186  2714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a236e17c7e241569819f8ad849b6f98" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:00.479674  2714 raft_consensus.cc:3060] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.482707  2607 leader_election.cc:304] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:00.482831  2639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a236e17c7e241569819f8ad849b6f98" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
I20260709 13:14:00.486720  2565 raft_consensus.cc:2468] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 1.
I20260709 13:14:00.486791  2761 raft_consensus.cc:493] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.487628  2799 raft_consensus.cc:2804] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.487537  2761 raft_consensus.cc:515] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.503995  2641 raft_consensus.cc:2468] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 1.
I20260709 13:14:00.505445  2713 raft_consensus.cc:2468] T 429828aabbb949f58f84ee2ffc1bcc47 P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 1.
I20260709 13:14:00.505656  2529 leader_election.cc:304] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9e79a28c0d4f06b5e3cb846bd8b435, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:00.507592  2789 raft_consensus.cc:2804] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.508415  2789 raft_consensus.cc:697] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Becoming Leader. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:00.510006  2789 consensus_queue.cc:237] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.511270  2715 raft_consensus.cc:2468] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 1.
I20260709 13:14:00.512967  2607 leader_election.cc:304] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42; no voters: 8f9e79a28c0d4f06b5e3cb846bd8b435
I20260709 13:14:00.513163  2790 raft_consensus.cc:493] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.513885  2790 raft_consensus.cc:515] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.516137  2802 raft_consensus.cc:2804] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.489197  2798 raft_consensus.cc:493] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.517611  2802 raft_consensus.cc:697] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Becoming Leader. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Running, Role: LEADER
I20260709 13:14:00.517585  2798 raft_consensus.cc:515] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.518795  2802 consensus_queue.cc:237] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.519673  2715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "122e785e3955406b8953143345c7b8d4" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3" is_pre_election: true
I20260709 13:14:00.520054  2798 leader_election.cc:290] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.520572  2715 raft_consensus.cc:2468] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 0.
I20260709 13:14:00.522085  2565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55294f6315244018f3c8397aeca04ce" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" is_pre_election: true
I20260709 13:14:00.522471  2532 leader_election.cc:304] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, 8f9e79a28c0d4f06b5e3cb846bd8b435; no voters: 
I20260709 13:14:00.523533  2764 raft_consensus.cc:2804] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.516795  2799 raft_consensus.cc:697] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Becoming Leader. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Running, Role: LEADER
I20260709 13:14:00.523929  2764 raft_consensus.cc:493] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.462347  2640 raft_consensus.cc:2468] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 0.
I20260709 13:14:00.523530  2790 leader_election.cc:290] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.524767  2764 raft_consensus.cc:3060] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.525346  2762 raft_consensus.cc:2804] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.527518  2762 raft_consensus.cc:493] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.528034  2762 raft_consensus.cc:3060] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:00.523936  2606 leader_election.cc:343] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.530607  2799 consensus_queue.cc:237] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.532389  2767 raft_consensus.cc:493] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.532900  2767 raft_consensus.cc:515] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.535774  2767 leader_election.cc:290] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219)
I20260709 13:14:00.539819  2761 leader_election.cc:290] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.543252  2757 tablet_bootstrap.cc:492] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435: No bootstrap required, opened a new log
I20260709 13:14:00.543756  2757 ts_tablet_manager.cc:1403] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Time spent bootstrapping tablet: real 0.078s	user 0.031s	sys 0.038s
I20260709 13:14:00.543236  2764 raft_consensus.cc:515] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.546473  2757 raft_consensus.cc:359] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.547178  2757 raft_consensus.cc:385] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.537091  2762 raft_consensus.cc:515] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.547475  2757 raft_consensus.cc:740] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.549161  2757 consensus_queue.cc:260] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.547049  2714 raft_consensus.cc:2468] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 1.
I20260709 13:14:00.551645  2757 ts_tablet_manager.cc:1434] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:00.552732  2757 tablet_bootstrap.cc:492] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435: Bootstrap starting.
I20260709 13:14:00.554448  2762 leader_election.cc:290] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 election: Requested vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.558526  2757 tablet_bootstrap.cc:654] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.558984  2764 leader_election.cc:290] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 election: Requested vote from peers f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.559922  2565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "122e785e3955406b8953143345c7b8d4" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" is_pre_election: true
I20260709 13:14:00.561022  2566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a236e17c7e241569819f8ad849b6f98" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
I20260709 13:14:00.562068  2566 raft_consensus.cc:2393] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f96f77e6be1443e89e60a34948b29e42 in current term 1: Already voted for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in this term.
I20260709 13:14:00.563673  2565 raft_consensus.cc:2393] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f96f77e6be1443e89e60a34948b29e42 in current term 1: Already voted for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in this term.
I20260709 13:14:00.563887  2714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "122e785e3955406b8953143345c7b8d4" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
W20260709 13:14:00.566340  2607 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:33167, user_credentials={real_user=slave}} blocked reactor thread for 53516.7us
I20260709 13:14:00.567481  2714 raft_consensus.cc:3060] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.570195  2640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "122e785e3955406b8953143345c7b8d4" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f96f77e6be1443e89e60a34948b29e42" is_pre_election: true
I20260709 13:14:00.565160  2532 leader_election.cc:304] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, 8f9e79a28c0d4f06b5e3cb846bd8b435; no voters: f96f77e6be1443e89e60a34948b29e42
I20260709 13:14:00.571215  2640 raft_consensus.cc:2468] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 0.
I20260709 13:14:00.576789  2462 catalog_manager.cc:5697] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 reported cstate change: term changed from 0 to 1, leader changed from <none> to f96f77e6be1443e89e60a34948b29e42 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f96f77e6be1443e89e60a34948b29e42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.578128  2764 raft_consensus.cc:2804] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.579631  2764 raft_consensus.cc:697] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Becoming Leader. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:00.580977  2764 consensus_queue.cc:237] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.585381  2757 tablet_bootstrap.cc:492] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435: No bootstrap required, opened a new log
I20260709 13:14:00.586154  2757 ts_tablet_manager.cc:1403] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.015s
I20260709 13:14:00.586752  2640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "122e785e3955406b8953143345c7b8d4" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
I20260709 13:14:00.587630  2640 raft_consensus.cc:3060] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.589470  2757 raft_consensus.cc:359] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.590557  2757 raft_consensus.cc:385] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.590960  2757 raft_consensus.cc:740] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.591737  2757 consensus_queue.cc:260] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.597122  2757 ts_tablet_manager.cc:1434] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:14:00.597076  2789 raft_consensus.cc:493] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.598520  2757 tablet_bootstrap.cc:492] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Bootstrap starting.
I20260709 13:14:00.598377  2789 raft_consensus.cc:515] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.607410  2715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836d47cab55e478797c8c59d6205c895" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3" is_pre_election: true
I20260709 13:14:00.607826  2463 catalog_manager.cc:5697] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.608618  2715 raft_consensus.cc:2393] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in current term 1: Already voted for candidate f96f77e6be1443e89e60a34948b29e42 in this term.
I20260709 13:14:00.605444  2789 leader_election.cc:290] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.611094  2640 raft_consensus.cc:2468] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 1.
I20260709 13:14:00.605284  2714 raft_consensus.cc:2468] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 1.
I20260709 13:14:00.615128  2532 leader_election.cc:304] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, 8f9e79a28c0d4f06b5e3cb846bd8b435; no voters: 
W20260709 13:14:00.617606  2606 consensus_peers.cc:597] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 -> Peer 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121): Couldn't send request to peer 8f9e79a28c0d4f06b5e3cb846bd8b435. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:00.618091  2640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836d47cab55e478797c8c59d6205c895" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f96f77e6be1443e89e60a34948b29e42" is_pre_election: true
I20260709 13:14:00.619979  2757 tablet_bootstrap.cc:654] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.619799  2764 raft_consensus.cc:2804] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.621420  2713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a236e17c7e241569819f8ad849b6f98" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:00.622195  2713 raft_consensus.cc:2393] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f96f77e6be1443e89e60a34948b29e42 in current term 1: Already voted for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in this term.
I20260709 13:14:00.623548  2714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "122e785e3955406b8953143345c7b8d4" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3" is_pre_election: true
I20260709 13:14:00.620599  2715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55294f6315244018f3c8397aeca04ce" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3" is_pre_election: true
I20260709 13:14:00.624734  2715 raft_consensus.cc:2468] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 0.
I20260709 13:14:00.624950  2529 leader_election.cc:304] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f9e79a28c0d4f06b5e3cb846bd8b435; no voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42
I20260709 13:14:00.626902  2607 leader_election.cc:304] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f96f77e6be1443e89e60a34948b29e42; no voters: 1dbb9c234dec422bb4b1348545e37ce3, 8f9e79a28c0d4f06b5e3cb846bd8b435
I20260709 13:14:00.628079  2799 raft_consensus.cc:2749] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.628338  2462 catalog_manager.cc:5697] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 reported cstate change: term changed from 0 to 1, leader changed from <none> to f96f77e6be1443e89e60a34948b29e42 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f96f77e6be1443e89e60a34948b29e42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.629371  2607 leader_election.cc:304] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42; no voters: 8f9e79a28c0d4f06b5e3cb846bd8b435
I20260709 13:14:00.624265  2714 raft_consensus.cc:2393] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f96f77e6be1443e89e60a34948b29e42 in current term 1: Already voted for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in this term.
I20260709 13:14:00.630424  2764 raft_consensus.cc:697] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Becoming Leader. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:00.630482  2799 raft_consensus.cc:2804] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.631101  2799 raft_consensus.cc:493] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.631667  2799 raft_consensus.cc:3060] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.631484  2764 consensus_queue.cc:237] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.635280  2789 raft_consensus.cc:3060] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.642648  2789 raft_consensus.cc:2749] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.643819  2803 consensus_queue.cc:1048] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:00.647735  2607 leader_election.cc:304] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f96f77e6be1443e89e60a34948b29e42; no voters: 1dbb9c234dec422bb4b1348545e37ce3, 8f9e79a28c0d4f06b5e3cb846bd8b435
I20260709 13:14:00.648806  2803 raft_consensus.cc:2749] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.649262  2640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55294f6315244018f3c8397aeca04ce" candidate_uuid: "1dbb9c234dec422bb4b1348545e37ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f96f77e6be1443e89e60a34948b29e42" is_pre_election: true
I20260709 13:14:00.651022  2565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55294f6315244018f3c8397aeca04ce" candidate_uuid: "1dbb9c234dec422bb4b1348545e37ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" is_pre_election: true
I20260709 13:14:00.651841  2565 raft_consensus.cc:2468] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1dbb9c234dec422bb4b1348545e37ce3 in term 0.
I20260709 13:14:00.642678  2799 raft_consensus.cc:515] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.654714  2680 leader_election.cc:304] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, 8f9e79a28c0d4f06b5e3cb846bd8b435; no voters: 
I20260709 13:14:00.656375  2767 raft_consensus.cc:2804] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.656751  2767 raft_consensus.cc:493] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.656881  2799 leader_election.cc:290] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 election: Requested vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.657119  2767 raft_consensus.cc:3060] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.656908  2565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55294f6315244018f3c8397aeca04ce" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
I20260709 13:14:00.657927  2565 raft_consensus.cc:3060] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.660012  2757 tablet_bootstrap.cc:492] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435: No bootstrap required, opened a new log
I20260709 13:14:00.660511  2757 ts_tablet_manager.cc:1403] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Time spent bootstrapping tablet: real 0.062s	user 0.023s	sys 0.017s
I20260709 13:14:00.663218  2757 raft_consensus.cc:359] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.663908  2757 raft_consensus.cc:385] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.664176  2757 raft_consensus.cc:740] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.664812  2757 consensus_queue.cc:260] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.665163  2565 raft_consensus.cc:2468] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 1.
I20260709 13:14:00.666349  2606 leader_election.cc:304] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9e79a28c0d4f06b5e3cb846bd8b435, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:00.666821  2757 ts_tablet_manager.cc:1434] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:14:00.666706  2462 catalog_manager.cc:5697] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.668345  2462 catalog_manager.cc:5697] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.671237  2713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55294f6315244018f3c8397aeca04ce" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:00.671736  2767 raft_consensus.cc:515] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.672818  2713 raft_consensus.cc:2393] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f96f77e6be1443e89e60a34948b29e42 in current term 1: Already voted for candidate 1dbb9c234dec422bb4b1348545e37ce3 in this term.
I20260709 13:14:00.673877  2767 leader_election.cc:290] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [CANDIDATE]: Term 1 election: Requested vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219)
I20260709 13:14:00.656378  2640 raft_consensus.cc:2393] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1dbb9c234dec422bb4b1348545e37ce3 in current term 1: Already voted for candidate f96f77e6be1443e89e60a34948b29e42 in this term.
I20260709 13:14:00.674993  2641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55294f6315244018f3c8397aeca04ce" candidate_uuid: "1dbb9c234dec422bb4b1348545e37ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
I20260709 13:14:00.676044  2799 raft_consensus.cc:2804] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.676538  2799 raft_consensus.cc:697] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Becoming Leader. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Running, Role: LEADER
I20260709 13:14:00.677246  2799 consensus_queue.cc:237] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.679338  2565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55294f6315244018f3c8397aeca04ce" candidate_uuid: "1dbb9c234dec422bb4b1348545e37ce3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
I20260709 13:14:00.680363  2565 raft_consensus.cc:2393] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1dbb9c234dec422bb4b1348545e37ce3 in current term 1: Already voted for candidate f96f77e6be1443e89e60a34948b29e42 in this term.
I20260709 13:14:00.683238  2680 leader_election.cc:304] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3; no voters: 8f9e79a28c0d4f06b5e3cb846bd8b435, f96f77e6be1443e89e60a34948b29e42
I20260709 13:14:00.684768  2767 raft_consensus.cc:2749] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.691280  2463 catalog_manager.cc:5697] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 reported cstate change: term changed from 0 to 1, leader changed from <none> to f96f77e6be1443e89e60a34948b29e42 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f96f77e6be1443e89e60a34948b29e42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.780416  2764 consensus_queue.cc:1048] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.794553  2640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e867c538ebd4729851d3030a7921ae6"
dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
mode: GRACEFUL
new_leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
 from {username='slave'} at 127.0.0.1:38592
I20260709 13:14:00.795181  2640 raft_consensus.cc:606] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Received request to transfer leadership to TS 8f9e79a28c0d4f06b5e3cb846bd8b435
I20260709 13:14:00.799072  2764 consensus_queue.cc:1048] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.800522  2762 consensus_queue.cc:1048] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.801523  2640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92ed0a1371ae402bbf3b4182089bf7a4"
dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
mode: GRACEFUL
new_leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
 from {username='slave'} at 127.0.0.1:38592
I20260709 13:14:00.802138  2640 raft_consensus.cc:606] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Received request to transfer leadership to TS 8f9e79a28c0d4f06b5e3cb846bd8b435
I20260709 13:14:00.813905  2761 consensus_queue.cc:1048] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.817442  2641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8472473e517c4dd29de768894545df0d"
dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
mode: GRACEFUL
new_leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
 from {username='slave'} at 127.0.0.1:38592
I20260709 13:14:00.818492  2641 raft_consensus.cc:606] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Received request to transfer leadership to TS 8f9e79a28c0d4f06b5e3cb846bd8b435
I20260709 13:14:00.824672  2761 raft_consensus.cc:993] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42: : Instructing follower 8f9e79a28c0d4f06b5e3cb846bd8b435 to start an election
I20260709 13:14:00.825156  2761 raft_consensus.cc:1081] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Signalling peer 8f9e79a28c0d4f06b5e3cb846bd8b435 to start an election
I20260709 13:14:00.828940  2764 consensus_queue.cc:1048] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.829934  2565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e867c538ebd4729851d3030a7921ae6"
dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
 from {username='slave'} at 127.0.0.1:38392
I20260709 13:14:00.830505  2565 raft_consensus.cc:493] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:00.830885  2565 raft_consensus.cc:3060] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.841610  2789 consensus_queue.cc:1048] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:00.843878  2789 raft_consensus.cc:493] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.844404  2789 raft_consensus.cc:515] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.846194  2566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3622a951e8e408881ce7caf82d16641"
dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
mode: GRACEFUL
new_leader_uuid: "f96f77e6be1443e89e60a34948b29e42"
 from {username='slave'} at 127.0.0.1:38412
I20260709 13:14:00.846819  2566 raft_consensus.cc:606] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Received request to transfer leadership to TS f96f77e6be1443e89e60a34948b29e42
I20260709 13:14:00.851433  2641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ed0a1371ae402bbf3b4182089bf7a4" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f96f77e6be1443e89e60a34948b29e42" is_pre_election: true
I20260709 13:14:00.853255  2566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "429828aabbb949f58f84ee2ffc1bcc47"
dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
mode: GRACEFUL
new_leader_uuid: "f96f77e6be1443e89e60a34948b29e42"
 from {username='slave'} at 127.0.0.1:38412
I20260709 13:14:00.853894  2566 raft_consensus.cc:606] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Received request to transfer leadership to TS f96f77e6be1443e89e60a34948b29e42
I20260709 13:14:00.855477  2713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ed0a1371ae402bbf3b4182089bf7a4" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3" is_pre_election: true
I20260709 13:14:00.857565  2532 leader_election.cc:304] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f9e79a28c0d4f06b5e3cb846bd8b435; no voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42
I20260709 13:14:00.858392  2789 leader_election.cc:290] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.858390  2790 raft_consensus.cc:2749] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.862788  2566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "122e785e3955406b8953143345c7b8d4"
dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
mode: GRACEFUL
new_leader_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
 from {username='slave'} at 127.0.0.1:38412
I20260709 13:14:00.863468  2566 raft_consensus.cc:606] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Received request to transfer leadership to TS 1dbb9c234dec422bb4b1348545e37ce3
I20260709 13:14:00.863658  2790 raft_consensus.cc:993] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435: : Instructing follower f96f77e6be1443e89e60a34948b29e42 to start an election
I20260709 13:14:00.864377  2790 raft_consensus.cc:1081] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Signalling peer f96f77e6be1443e89e60a34948b29e42 to start an election
I20260709 13:14:00.862792  2565 raft_consensus.cc:515] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } }
I20260709 13:14:00.868511  2640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3622a951e8e408881ce7caf82d16641"
dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
 from {username='slave'} at 127.0.0.1:38566
I20260709 13:14:00.869279  2713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e867c538ebd4729851d3030a7921ae6" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:00.869896  2713 raft_consensus.cc:3060] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.869254  2640 raft_consensus.cc:493] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:00.874228  2640 raft_consensus.cc:3060] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.876389  2713 raft_consensus.cc:2468] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 2.
I20260709 13:14:00.877980  2532 leader_election.cc:304] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, 8f9e79a28c0d4f06b5e3cb846bd8b435; no voters: 
I20260709 13:14:00.878320  2565 leader_election.cc:290] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 2 election: Requested vote from peers 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167), f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219)
I20260709 13:14:00.878898  2789 raft_consensus.cc:2804] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:00.879380  2789 raft_consensus.cc:697] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 LEADER]: Becoming Leader. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:00.880200  2789 consensus_queue.cc:237] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } }
I20260709 13:14:00.880731  2640 raft_consensus.cc:515] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.882529  2640 leader_election.cc:290] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 2 election: Requested vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.883471  2565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3622a951e8e408881ce7caf82d16641" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
I20260709 13:14:00.884032  2565 raft_consensus.cc:3055] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:00.884337  2565 raft_consensus.cc:740] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:00.884661  2713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3622a951e8e408881ce7caf82d16641" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:00.885193  2713 raft_consensus.cc:3060] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.885095  2565 consensus_queue.cc:260] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.886437  2640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e867c538ebd4729851d3030a7921ae6" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
I20260709 13:14:00.886994  2640 raft_consensus.cc:3055] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:00.887313  2640 raft_consensus.cc:740] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Running, Role: LEADER
I20260709 13:14:00.888119  2640 consensus_queue.cc:260] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } }
I20260709 13:14:00.889326  2640 raft_consensus.cc:3060] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.888917  2463 catalog_manager.cc:5697] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 reported cstate change: term changed from 1 to 2, leader changed from f96f77e6be1443e89e60a34948b29e42 (127.1.227.130) to 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129). New cstate: current_term: 2 leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.886443  2565 raft_consensus.cc:3060] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.890829  2713 raft_consensus.cc:2468] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 2.
I20260709 13:14:00.892024  2607 leader_election.cc:304] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:00.892890  2799 raft_consensus.cc:2804] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:00.893352  2799 raft_consensus.cc:697] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [term 2 LEADER]: Becoming Leader. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Running, Role: LEADER
I20260709 13:14:00.894312  2799 consensus_queue.cc:237] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.897038  2640 raft_consensus.cc:2468] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 2.
I20260709 13:14:00.897115  2565 raft_consensus.cc:2468] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 2.
I20260709 13:14:00.903825  2463 catalog_manager.cc:5697] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 reported cstate change: term changed from 1 to 2, leader changed from 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129) to f96f77e6be1443e89e60a34948b29e42 (127.1.227.130). New cstate: current_term: 2 leader_uuid: "f96f77e6be1443e89e60a34948b29e42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.916502  2799 consensus_queue.cc:1048] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.926831  2799 consensus_queue.cc:1048] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.936195  2761 raft_consensus.cc:993] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42: : Instructing follower 8f9e79a28c0d4f06b5e3cb846bd8b435 to start an election
I20260709 13:14:00.936641  2799 raft_consensus.cc:1081] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Signalling peer 8f9e79a28c0d4f06b5e3cb846bd8b435 to start an election
I20260709 13:14:00.938164  2566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8472473e517c4dd29de768894545df0d"
dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
 from {username='slave'} at 127.0.0.1:38392
I20260709 13:14:00.938632  2566 raft_consensus.cc:493] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:00.938930  2566 raft_consensus.cc:3060] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.943596  2566 raft_consensus.cc:515] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.945694  2566 leader_election.cc:290] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 2 election: Requested vote from peers f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:00.946063  2640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8472473e517c4dd29de768894545df0d" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
I20260709 13:14:00.946313  2713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8472473e517c4dd29de768894545df0d" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:00.946676  2640 raft_consensus.cc:3055] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:00.946868  2713 raft_consensus.cc:3060] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.947063  2640 raft_consensus.cc:740] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Running, Role: LEADER
I20260709 13:14:00.947896  2640 consensus_queue.cc:260] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.948974  2640 raft_consensus.cc:3060] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.951726  2713 raft_consensus.cc:2468] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 2.
I20260709 13:14:00.952839  2532 leader_election.cc:304] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, 8f9e79a28c0d4f06b5e3cb846bd8b435; no voters: 
I20260709 13:14:00.953539  2789 raft_consensus.cc:2804] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:00.954084  2789 raft_consensus.cc:697] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 LEADER]: Becoming Leader. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:00.955050  2640 raft_consensus.cc:2468] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 2.
I20260709 13:14:00.954908  2789 consensus_queue.cc:237] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:00.962040  2463 catalog_manager.cc:5697] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 reported cstate change: term changed from 1 to 2, leader changed from f96f77e6be1443e89e60a34948b29e42 (127.1.227.130) to 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129). New cstate: current_term: 2 leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.968794  2799 consensus_queue.cc:1048] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.980856  2762 consensus_queue.cc:1048] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.987615  2789 consensus_queue.cc:1048] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.999243  2764 consensus_queue.cc:1048] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.007470  2764 raft_consensus.cc:993] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435: : Instructing follower f96f77e6be1443e89e60a34948b29e42 to start an election
I20260709 13:14:01.008011  2764 raft_consensus.cc:1081] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Signalling peer f96f77e6be1443e89e60a34948b29e42 to start an election
I20260709 13:14:01.009822  2640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "429828aabbb949f58f84ee2ffc1bcc47"
dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
 from {username='slave'} at 127.0.0.1:38566
I20260709 13:14:01.010447  2640 raft_consensus.cc:493] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:01.010871  2640 raft_consensus.cc:3060] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.016386  2640 raft_consensus.cc:515] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:01.018383  2640 leader_election.cc:290] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 2 election: Requested vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:01.019477  2566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429828aabbb949f58f84ee2ffc1bcc47" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
I20260709 13:14:01.020233  2566 raft_consensus.cc:3055] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:01.020562  2566 raft_consensus.cc:740] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:01.019578  2714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429828aabbb949f58f84ee2ffc1bcc47" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:01.021433  2566 consensus_queue.cc:260] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:01.022045  2714 raft_consensus.cc:3060] T 429828aabbb949f58f84ee2ffc1bcc47 P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.022765  2566 raft_consensus.cc:3060] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.029388  2714 raft_consensus.cc:2468] T 429828aabbb949f58f84ee2ffc1bcc47 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 2.
I20260709 13:14:01.029716  2566 raft_consensus.cc:2468] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 2.
I20260709 13:14:01.030886  2607 leader_election.cc:304] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:01.031574  2762 raft_consensus.cc:2804] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:01.032032  2762 raft_consensus.cc:697] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 [term 2 LEADER]: Becoming Leader. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Running, Role: LEADER
I20260709 13:14:01.032897  2762 consensus_queue.cc:237] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:01.039894  2462 catalog_manager.cc:5697] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 reported cstate change: term changed from 1 to 2, leader changed from 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129) to f96f77e6be1443e89e60a34948b29e42 (127.1.227.130). New cstate: current_term: 2 leader_uuid: "f96f77e6be1443e89e60a34948b29e42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:01.041397  2764 consensus_queue.cc:1048] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.053750  2789 consensus_queue.cc:1048] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.165956  2789 consensus_queue.cc:1048] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.167116  2790 consensus_queue.cc:1048] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.172271  2762 consensus_queue.cc:1048] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.177758  2790 raft_consensus.cc:993] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435: : Instructing follower 1dbb9c234dec422bb4b1348545e37ce3 to start an election
I20260709 13:14:01.178187  2790 raft_consensus.cc:1081] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Signalling peer 1dbb9c234dec422bb4b1348545e37ce3 to start an election
I20260709 13:14:01.181972  2715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "122e785e3955406b8953143345c7b8d4"
dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
 from {username='slave'} at 127.0.0.1:34358
I20260709 13:14:01.182547  2715 raft_consensus.cc:493] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:01.182960  2715 raft_consensus.cc:3060] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.189654  2565 raft_consensus.cc:3060] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.190238  2715 raft_consensus.cc:515] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:01.190761  2762 consensus_queue.cc:1048] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.192209  2715 leader_election.cc:290] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 [CANDIDATE]: Term 2 election: Requested vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219)
I20260709 13:14:01.192940  2566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "122e785e3955406b8953143345c7b8d4" candidate_uuid: "1dbb9c234dec422bb4b1348545e37ce3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
I20260709 13:14:01.193559  2566 raft_consensus.cc:3055] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:01.193976  2566 raft_consensus.cc:740] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:01.194835  2566 consensus_queue.cc:260] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:01.196995  2640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "122e785e3955406b8953143345c7b8d4" candidate_uuid: "1dbb9c234dec422bb4b1348545e37ce3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
I20260709 13:14:01.197640  2640 raft_consensus.cc:3060] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.205291  2640 raft_consensus.cc:2468] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dbb9c234dec422bb4b1348545e37ce3 in term 2.
I20260709 13:14:01.206737  2678 leader_election.cc:304] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:01.207659  2767 raft_consensus.cc:2804] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:01.208206  2767 raft_consensus.cc:697] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 LEADER]: Becoming Leader. State: Replica: 1dbb9c234dec422bb4b1348545e37ce3, State: Running, Role: LEADER
I20260709 13:14:01.209057  2767 consensus_queue.cc:237] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:01.207713  2566 raft_consensus.cc:3060] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.221074  2566 raft_consensus.cc:2468] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dbb9c234dec422bb4b1348545e37ce3 in term 2.
I20260709 13:14:01.224105  2464 catalog_manager.cc:5697] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 reported cstate change: term changed from 1 to 2, leader changed from 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129) to 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131). New cstate: current_term: 2 leader_uuid: "1dbb9c234dec422bb4b1348545e37ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.230743  2762 raft_consensus.cc:993] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42: : Instructing follower 8f9e79a28c0d4f06b5e3cb846bd8b435 to start an election
I20260709 13:14:01.231225  2799 raft_consensus.cc:1081] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Signalling peer 8f9e79a28c0d4f06b5e3cb846bd8b435 to start an election
I20260709 13:14:01.232985  2565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92ed0a1371ae402bbf3b4182089bf7a4"
dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
 from {username='slave'} at 127.0.0.1:38392
I20260709 13:14:01.233457  2565 raft_consensus.cc:493] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:01.233808  2565 raft_consensus.cc:3060] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.238602  2565 raft_consensus.cc:515] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:01.240630  2565 leader_election.cc:290] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 2 election: Requested vote from peers f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:01.241482  2640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ed0a1371ae402bbf3b4182089bf7a4" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
I20260709 13:14:01.241892  2715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ed0a1371ae402bbf3b4182089bf7a4" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:01.242161  2640 raft_consensus.cc:3055] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:01.242419  2715 raft_consensus.cc:3060] T 92ed0a1371ae402bbf3b4182089bf7a4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.242516  2640 raft_consensus.cc:740] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Running, Role: LEADER
I20260709 13:14:01.243392  2640 consensus_queue.cc:260] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:01.244593  2640 raft_consensus.cc:3060] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.249320  2715 raft_consensus.cc:2468] T 92ed0a1371ae402bbf3b4182089bf7a4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 2.
I20260709 13:14:01.250694  2532 leader_election.cc:304] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, 8f9e79a28c0d4f06b5e3cb846bd8b435; no voters: 
I20260709 13:14:01.251078  2640 raft_consensus.cc:2468] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 2.
I20260709 13:14:01.251371  2790 raft_consensus.cc:2804] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:01.251842  2790 raft_consensus.cc:697] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 LEADER]: Becoming Leader. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:01.252535  2790 consensus_queue.cc:237] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:01.258566  2463 catalog_manager.cc:5697] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 reported cstate change: term changed from 1 to 2, leader changed from f96f77e6be1443e89e60a34948b29e42 (127.1.227.130) to 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129). New cstate: current_term: 2 leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:01.352008  2715 raft_consensus.cc:1275] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Refusing update from remote peer 8f9e79a28c0d4f06b5e3cb846bd8b435: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.353338  2790 consensus_queue.cc:1048] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.363484  2714 raft_consensus.cc:1275] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Refusing update from remote peer f96f77e6be1443e89e60a34948b29e42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.363798  2640 raft_consensus.cc:1275] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Refusing update from remote peer 8f9e79a28c0d4f06b5e3cb846bd8b435: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.365186  2799 consensus_queue.cc:1048] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:01.365185  2789 consensus_queue.cc:1048] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:01.375823  2565 raft_consensus.cc:1275] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Refusing update from remote peer f96f77e6be1443e89e60a34948b29e42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.378006  2799 consensus_queue.cc:1048] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.421572  2714 raft_consensus.cc:1275] T 429828aabbb949f58f84ee2ffc1bcc47 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Refusing update from remote peer f96f77e6be1443e89e60a34948b29e42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.422895  2799 consensus_queue.cc:1048] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.431092  2565 raft_consensus.cc:1275] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Refusing update from remote peer f96f77e6be1443e89e60a34948b29e42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.433668  2799 consensus_queue.cc:1048] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:01.437063  2640 raft_consensus.cc:1275] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Refusing update from remote peer 8f9e79a28c0d4f06b5e3cb846bd8b435: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.438643  2789 consensus_queue.cc:1048] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.447245  2714 raft_consensus.cc:1275] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Refusing update from remote peer 8f9e79a28c0d4f06b5e3cb846bd8b435: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.448678  2764 consensus_queue.cc:1048] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.708490  2640 raft_consensus.cc:1275] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Refusing update from remote peer 8f9e79a28c0d4f06b5e3cb846bd8b435: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.709940  2789 consensus_queue.cc:1048] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.719076  2714 raft_consensus.cc:1275] T 92ed0a1371ae402bbf3b4182089bf7a4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Refusing update from remote peer 8f9e79a28c0d4f06b5e3cb846bd8b435: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.720780  2790 consensus_queue.cc:1048] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.823365  2565 raft_consensus.cc:1275] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Refusing update from remote peer 1dbb9c234dec422bb4b1348545e37ce3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.824790  2767 consensus_queue.cc:1048] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.833432  2640 raft_consensus.cc:1275] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Refusing update from remote peer 1dbb9c234dec422bb4b1348545e37ce3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.835702  2842 consensus_queue.cc:1048] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:03.900249  1934 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:14:03.900985  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:03.918015  2565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a236e17c7e241569819f8ad849b6f98"
dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
mode: GRACEFUL
new_leader_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
 from {username='slave'} at 127.0.0.1:38428
I20260709 13:14:03.918546  2565 raft_consensus.cc:606] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Received request to transfer leadership to TS 1dbb9c234dec422bb4b1348545e37ce3
I20260709 13:14:03.920943  2565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e867c538ebd4729851d3030a7921ae6"
dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
mode: GRACEFUL
new_leader_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
 from {username='slave'} at 127.0.0.1:38428
I20260709 13:14:03.921592  2565 raft_consensus.cc:606] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 LEADER]: Received request to transfer leadership to TS 1dbb9c234dec422bb4b1348545e37ce3
I20260709 13:14:03.922936  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:03.923409  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:03.974215  2849 raft_consensus.cc:993] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435: : Instructing follower 1dbb9c234dec422bb4b1348545e37ce3 to start an election
I20260709 13:14:03.974766  2790 raft_consensus.cc:1081] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Signalling peer 1dbb9c234dec422bb4b1348545e37ce3 to start an election
I20260709 13:14:03.976936  2714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a236e17c7e241569819f8ad849b6f98"
dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
 from {username='slave'} at 127.0.0.1:34358
I20260709 13:14:03.977626  2714 raft_consensus.cc:493] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:03.978050  2714 raft_consensus.cc:3060] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.984562  2714 raft_consensus.cc:515] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:03.986447  2714 leader_election.cc:290] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [CANDIDATE]: Term 2 election: Requested vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219)
I20260709 13:14:03.987421  2640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a236e17c7e241569819f8ad849b6f98" candidate_uuid: "1dbb9c234dec422bb4b1348545e37ce3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
I20260709 13:14:03.987215  2565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a236e17c7e241569819f8ad849b6f98" candidate_uuid: "1dbb9c234dec422bb4b1348545e37ce3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
I20260709 13:14:03.988020  2640 raft_consensus.cc:3060] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.988068  2565 raft_consensus.cc:3055] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:03.988513  2565 raft_consensus.cc:740] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:03.989328  2565 consensus_queue.cc:260] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:03.990604  2565 raft_consensus.cc:3060] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.994782  2640 raft_consensus.cc:2468] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dbb9c234dec422bb4b1348545e37ce3 in term 2.
I20260709 13:14:03.996215  2678 leader_election.cc:304] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:03.997212  2845 raft_consensus.cc:2804] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:03.997620  2565 raft_consensus.cc:2468] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dbb9c234dec422bb4b1348545e37ce3 in term 2.
I20260709 13:14:03.998399  2845 raft_consensus.cc:697] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 LEADER]: Becoming Leader. State: Replica: 1dbb9c234dec422bb4b1348545e37ce3, State: Running, Role: LEADER
I20260709 13:14:03.999291  2845 consensus_queue.cc:237] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:04.007305  2464 catalog_manager.cc:5697] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 reported cstate change: term changed from 1 to 2, leader changed from 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129) to 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131). New cstate: current_term: 2 leader_uuid: "1dbb9c234dec422bb4b1348545e37ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:04.079128  2849 raft_consensus.cc:993] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435: : Instructing follower 1dbb9c234dec422bb4b1348545e37ce3 to start an election
I20260709 13:14:04.079651  2790 raft_consensus.cc:1081] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 LEADER]: Signalling peer 1dbb9c234dec422bb4b1348545e37ce3 to start an election
I20260709 13:14:04.081179  2714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e867c538ebd4729851d3030a7921ae6"
dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
 from {username='slave'} at 127.0.0.1:34358
I20260709 13:14:04.081815  2714 raft_consensus.cc:493] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:04.082154  2714 raft_consensus.cc:3060] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:04.087039  2714 raft_consensus.cc:515] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } }
I20260709 13:14:04.089974  2565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e867c538ebd4729851d3030a7921ae6" candidate_uuid: "1dbb9c234dec422bb4b1348545e37ce3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
I20260709 13:14:04.090204  2714 leader_election.cc:290] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [CANDIDATE]: Term 3 election: Requested vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219)
I20260709 13:14:04.090708  2565 raft_consensus.cc:3055] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:04.091004  2640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e867c538ebd4729851d3030a7921ae6" candidate_uuid: "1dbb9c234dec422bb4b1348545e37ce3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
I20260709 13:14:04.091128  2565 raft_consensus.cc:740] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:04.091651  2640 raft_consensus.cc:3060] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:04.092124  2565 consensus_queue.cc:260] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } }
I20260709 13:14:04.093535  2565 raft_consensus.cc:3060] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:04.098364  2640 raft_consensus.cc:2468] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dbb9c234dec422bb4b1348545e37ce3 in term 3.
I20260709 13:14:04.099776  2678 leader_election.cc:304] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:04.100001  2565 raft_consensus.cc:2468] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dbb9c234dec422bb4b1348545e37ce3 in term 3.
I20260709 13:14:04.100730  2845 raft_consensus.cc:2804] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:04.101320  2845 raft_consensus.cc:697] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 LEADER]: Becoming Leader. State: Replica: 1dbb9c234dec422bb4b1348545e37ce3, State: Running, Role: LEADER
I20260709 13:14:04.102176  2845 consensus_queue.cc:237] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } }
I20260709 13:14:04.108894  2464 catalog_manager.cc:5697] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 reported cstate change: term changed from 2 to 3, leader changed from 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129) to 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131). New cstate: current_term: 3 leader_uuid: "1dbb9c234dec422bb4b1348545e37ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:04.488274  2565 raft_consensus.cc:1275] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 FOLLOWER]: Refusing update from remote peer 1dbb9c234dec422bb4b1348545e37ce3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:04.489666  2845 consensus_queue.cc:1048] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:04.500847  2640 raft_consensus.cc:1275] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 3 FOLLOWER]: Refusing update from remote peer 1dbb9c234dec422bb4b1348545e37ce3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:04.503163  2859 consensus_queue.cc:1048] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:04.517977  2565 raft_consensus.cc:1275] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Refusing update from remote peer 1dbb9c234dec422bb4b1348545e37ce3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:04.519296  2859 consensus_queue.cc:1048] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:04.532181  2640 raft_consensus.cc:1275] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Refusing update from remote peer 1dbb9c234dec422bb4b1348545e37ce3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:04.533931  2845 consensus_queue.cc:1048] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:04.924185  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:04.949554  2714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e867c538ebd4729851d3030a7921ae6"
dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
mode: GRACEFUL
new_leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
 from {username='slave'} at 127.0.0.1:34372
I20260709 13:14:04.950138  2714 raft_consensus.cc:606] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 LEADER]: Received request to transfer leadership to TS 8f9e79a28c0d4f06b5e3cb846bd8b435
I20260709 13:14:04.958711  2714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a236e17c7e241569819f8ad849b6f98"
dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
mode: GRACEFUL
new_leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
 from {username='slave'} at 127.0.0.1:34372
I20260709 13:14:04.959200  2714 raft_consensus.cc:606] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 LEADER]: Received request to transfer leadership to TS 8f9e79a28c0d4f06b5e3cb846bd8b435
I20260709 13:14:04.971223  2640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e55294f6315244018f3c8397aeca04ce"
dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
mode: GRACEFUL
new_leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
 from {username='slave'} at 127.0.0.1:38592
I20260709 13:14:04.971853  2640 raft_consensus.cc:606] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Received request to transfer leadership to TS 8f9e79a28c0d4f06b5e3cb846bd8b435
I20260709 13:14:04.977365  2640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "836d47cab55e478797c8c59d6205c895"
dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
mode: GRACEFUL
new_leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
 from {username='slave'} at 127.0.0.1:38592
I20260709 13:14:04.977862  2640 raft_consensus.cc:606] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Received request to transfer leadership to TS 8f9e79a28c0d4f06b5e3cb846bd8b435
I20260709 13:14:04.982905  2640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3622a951e8e408881ce7caf82d16641"
dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
mode: GRACEFUL
new_leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
 from {username='slave'} at 127.0.0.1:38592
I20260709 13:14:04.983409  2640 raft_consensus.cc:606] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [term 2 LEADER]: Received request to transfer leadership to TS 8f9e79a28c0d4f06b5e3cb846bd8b435
I20260709 13:14:04.988269  2868 raft_consensus.cc:993] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42: : Instructing follower 8f9e79a28c0d4f06b5e3cb846bd8b435 to start an election
I20260709 13:14:04.988687  2803 raft_consensus.cc:1081] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Signalling peer 8f9e79a28c0d4f06b5e3cb846bd8b435 to start an election
I20260709 13:14:04.990208  2565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "836d47cab55e478797c8c59d6205c895"
dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
 from {username='slave'} at 127.0.0.1:38392
I20260709 13:14:04.990787  2565 raft_consensus.cc:493] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:04.991163  2565 raft_consensus.cc:3060] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.995666  2565 raft_consensus.cc:515] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:04.997184  2565 leader_election.cc:290] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 2 election: Requested vote from peers f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:04.998216  2640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836d47cab55e478797c8c59d6205c895" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
I20260709 13:14:04.998350  2714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836d47cab55e478797c8c59d6205c895" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:04.998754  2640 raft_consensus.cc:3055] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:04.998828  2714 raft_consensus.cc:3060] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.999070  2640 raft_consensus.cc:740] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Running, Role: LEADER
I20260709 13:14:04.999795  2640 consensus_queue.cc:260] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:05.000649  2640 raft_consensus.cc:3060] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.003262  2714 raft_consensus.cc:2468] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 2.
I20260709 13:14:05.004737  2532 leader_election.cc:304] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, 8f9e79a28c0d4f06b5e3cb846bd8b435; no voters: 
I20260709 13:14:05.005362  2640 raft_consensus.cc:2468] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 2.
I20260709 13:14:05.005842  2790 raft_consensus.cc:2804] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:05.007196  2790 raft_consensus.cc:697] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 LEADER]: Becoming Leader. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:05.008010  2790 consensus_queue.cc:237] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:05.014873  2464 catalog_manager.cc:5697] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 reported cstate change: term changed from 1 to 2, leader changed from f96f77e6be1443e89e60a34948b29e42 (127.1.227.130) to 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129). New cstate: current_term: 2 leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.020869  2868 raft_consensus.cc:993] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42: : Instructing follower 8f9e79a28c0d4f06b5e3cb846bd8b435 to start an election
I20260709 13:14:05.021564  2803 raft_consensus.cc:1081] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [term 2 LEADER]: Signalling peer 8f9e79a28c0d4f06b5e3cb846bd8b435 to start an election
I20260709 13:14:05.023576  2565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3622a951e8e408881ce7caf82d16641"
dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
 from {username='slave'} at 127.0.0.1:38392
I20260709 13:14:05.024277  2565 raft_consensus.cc:493] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:05.024724  2565 raft_consensus.cc:3060] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:05.030726  2565 raft_consensus.cc:515] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:05.032303  2565 leader_election.cc:290] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 3 election: Requested vote from peers f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:05.033360  2640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3622a951e8e408881ce7caf82d16641" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
I20260709 13:14:05.033406  2714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3622a951e8e408881ce7caf82d16641" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:05.034262  2714 raft_consensus.cc:3060] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:05.034209  2640 raft_consensus.cc:3055] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:05.034811  2640 raft_consensus.cc:740] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Running, Role: LEADER
I20260709 13:14:05.035650  2640 consensus_queue.cc:260] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:05.036945  2640 raft_consensus.cc:3060] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:05.041348  2714 raft_consensus.cc:2468] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 3.
I20260709 13:14:05.042902  2874 raft_consensus.cc:993] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3: : Instructing follower 8f9e79a28c0d4f06b5e3cb846bd8b435 to start an election
I20260709 13:14:05.042678  2532 leader_election.cc:304] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, 8f9e79a28c0d4f06b5e3cb846bd8b435; no voters: 
I20260709 13:14:05.043424  2845 raft_consensus.cc:1081] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 LEADER]: Signalling peer 8f9e79a28c0d4f06b5e3cb846bd8b435 to start an election
I20260709 13:14:05.043676  2790 raft_consensus.cc:2804] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:05.043949  2640 raft_consensus.cc:2468] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 3.
I20260709 13:14:05.044198  2790 raft_consensus.cc:697] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 LEADER]: Becoming Leader. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:05.045149  2790 consensus_queue.cc:237] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:05.046221  2565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a236e17c7e241569819f8ad849b6f98"
dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
 from {username='slave'} at 127.0.0.1:38404
I20260709 13:14:05.046742  2565 raft_consensus.cc:493] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:05.047075  2565 raft_consensus.cc:3060] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:05.053217  2565 raft_consensus.cc:515] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:05.053722  2464 catalog_manager.cc:5697] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 reported cstate change: term changed from 2 to 3, leader changed from f96f77e6be1443e89e60a34948b29e42 (127.1.227.130) to 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129). New cstate: current_term: 3 leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.055498  2565 leader_election.cc:290] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 3 election: Requested vote from peers f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:05.056602  2640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a236e17c7e241569819f8ad849b6f98" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
I20260709 13:14:05.057062  2714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a236e17c7e241569819f8ad849b6f98" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:05.057226  2640 raft_consensus.cc:3060] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:05.057776  2714 raft_consensus.cc:3055] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:05.058120  2714 raft_consensus.cc:740] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1dbb9c234dec422bb4b1348545e37ce3, State: Running, Role: LEADER
I20260709 13:14:05.058924  2714 consensus_queue.cc:260] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:05.060061  2714 raft_consensus.cc:3060] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:05.063517  2640 raft_consensus.cc:2468] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 3.
I20260709 13:14:05.065102  2529 leader_election.cc:304] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9e79a28c0d4f06b5e3cb846bd8b435, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:05.065958  2790 raft_consensus.cc:2804] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:05.066491  2790 raft_consensus.cc:697] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 LEADER]: Becoming Leader. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:05.067332  2714 raft_consensus.cc:2468] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 3.
I20260709 13:14:05.067364  2790 consensus_queue.cc:237] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:05.076923  2462 catalog_manager.cc:5697] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 reported cstate change: term changed from 2 to 3, leader changed from 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131) to 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129). New cstate: current_term: 3 leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.099331  2874 raft_consensus.cc:993] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3: : Instructing follower 8f9e79a28c0d4f06b5e3cb846bd8b435 to start an election
I20260709 13:14:05.099807  2874 raft_consensus.cc:1081] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 LEADER]: Signalling peer 8f9e79a28c0d4f06b5e3cb846bd8b435 to start an election
I20260709 13:14:05.101526  2565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e867c538ebd4729851d3030a7921ae6"
dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
 from {username='slave'} at 127.0.0.1:38404
I20260709 13:14:05.102085  2565 raft_consensus.cc:493] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:05.102442  2565 raft_consensus.cc:3060] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:05.104676  2868 raft_consensus.cc:993] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42: : Instructing follower 8f9e79a28c0d4f06b5e3cb846bd8b435 to start an election
I20260709 13:14:05.105109  2803 raft_consensus.cc:1081] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Signalling peer 8f9e79a28c0d4f06b5e3cb846bd8b435 to start an election
I20260709 13:14:05.106845  2564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e55294f6315244018f3c8397aeca04ce"
dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
 from {username='slave'} at 127.0.0.1:38392
I20260709 13:14:05.107344  2564 raft_consensus.cc:493] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:05.107682  2564 raft_consensus.cc:3060] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.108556  2565 raft_consensus.cc:515] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } }
I20260709 13:14:05.110136  2565 leader_election.cc:290] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 4 election: Requested vote from peers 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167), f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219)
I20260709 13:14:05.111086  2714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e867c538ebd4729851d3030a7921ae6" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:05.111117  2640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e867c538ebd4729851d3030a7921ae6" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
I20260709 13:14:05.111708  2714 raft_consensus.cc:3055] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:05.111784  2640 raft_consensus.cc:3060] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:05.112001  2714 raft_consensus.cc:740] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1dbb9c234dec422bb4b1348545e37ce3, State: Running, Role: LEADER
I20260709 13:14:05.112772  2714 consensus_queue.cc:260] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } }
I20260709 13:14:05.113600  2714 raft_consensus.cc:3060] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:05.113785  2564 raft_consensus.cc:515] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:05.116564  2641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55294f6315244018f3c8397aeca04ce" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
I20260709 13:14:05.116689  2564 leader_election.cc:290] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 2 election: Requested vote from peers f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:05.116905  2715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55294f6315244018f3c8397aeca04ce" candidate_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:05.117177  2641 raft_consensus.cc:3055] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.117458  2715 raft_consensus.cc:3060] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.117535  2641 raft_consensus.cc:740] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Running, Role: LEADER
I20260709 13:14:05.118474  2641 consensus_queue.cc:260] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:05.119429  2641 raft_consensus.cc:3060] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.119385  2714 raft_consensus.cc:2468] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 4.
I20260709 13:14:05.120501  2532 leader_election.cc:304] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, 8f9e79a28c0d4f06b5e3cb846bd8b435; no voters: 
I20260709 13:14:05.121308  2790 raft_consensus.cc:2804] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:05.121807  2790 raft_consensus.cc:697] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 4 LEADER]: Becoming Leader. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:05.122601  2790 consensus_queue.cc:237] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } }
I20260709 13:14:05.123829  2640 raft_consensus.cc:2468] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 4.
I20260709 13:14:05.125190  2641 raft_consensus.cc:2468] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 2.
I20260709 13:14:05.126494  2529 leader_election.cc:304] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f9e79a28c0d4f06b5e3cb846bd8b435, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:05.127319  2869 raft_consensus.cc:2804] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:05.127552  2715 raft_consensus.cc:2468] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9e79a28c0d4f06b5e3cb846bd8b435 in term 2.
I20260709 13:14:05.127802  2869 raft_consensus.cc:697] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 LEADER]: Becoming Leader. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:05.128707  2869 consensus_queue.cc:237] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:05.131246  2462 catalog_manager.cc:5697] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 reported cstate change: term changed from 3 to 4, leader changed from 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131) to 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129). New cstate: current_term: 4 leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.143147  2462 catalog_manager.cc:5697] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 reported cstate change: term changed from 1 to 2, leader changed from f96f77e6be1443e89e60a34948b29e42 (127.1.227.130) to 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129). New cstate: current_term: 2 leader_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.463227  2641 raft_consensus.cc:1275] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Refusing update from remote peer 8f9e79a28c0d4f06b5e3cb846bd8b435: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:05.464546  2869 consensus_queue.cc:1048] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:05.469985  2715 raft_consensus.cc:1275] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 FOLLOWER]: Refusing update from remote peer 8f9e79a28c0d4f06b5e3cb846bd8b435: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:05.471415  2790 consensus_queue.cc:1048] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:05.478026  2714 raft_consensus.cc:1275] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Refusing update from remote peer 8f9e79a28c0d4f06b5e3cb846bd8b435: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:05.483381  2641 raft_consensus.cc:1275] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [term 3 FOLLOWER]: Refusing update from remote peer 8f9e79a28c0d4f06b5e3cb846bd8b435: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:05.484355  2790 consensus_queue.cc:1048] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:05.484843  2869 consensus_queue.cc:1048] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:05.509944  2714 raft_consensus.cc:1275] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 FOLLOWER]: Refusing update from remote peer 8f9e79a28c0d4f06b5e3cb846bd8b435: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:05.511564  2790 consensus_queue.cc:1048] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:05.519538  2641 raft_consensus.cc:1275] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 3 FOLLOWER]: Refusing update from remote peer 8f9e79a28c0d4f06b5e3cb846bd8b435: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:05.521428  2879 consensus_queue.cc:1048] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:05.537377  2714 raft_consensus.cc:1275] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 4 FOLLOWER]: Refusing update from remote peer 8f9e79a28c0d4f06b5e3cb846bd8b435: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:05.538739  2879 consensus_queue.cc:1048] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:05.548226  2641 raft_consensus.cc:1275] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 4 FOLLOWER]: Refusing update from remote peer 8f9e79a28c0d4f06b5e3cb846bd8b435: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:05.550936  2640 raft_consensus.cc:1275] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Refusing update from remote peer 8f9e79a28c0d4f06b5e3cb846bd8b435: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:05.551050  2887 consensus_queue.cc:1048] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:05.552274  2879 consensus_queue.cc:1048] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:05.564132  2714 raft_consensus.cc:1275] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Refusing update from remote peer 8f9e79a28c0d4f06b5e3cb846bd8b435: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:05.565614  2879 consensus_queue.cc:1048] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:07.991029  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:07.999576  2564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4651f16c11c04f76b5afcb996b6ab98c"
dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
mode: GRACEFUL
new_leader_uuid: "f96f77e6be1443e89e60a34948b29e42"
 from {username='slave'} at 127.0.0.1:38428
I20260709 13:14:08.000473  2564 raft_consensus.cc:606] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Received request to transfer leadership to TS f96f77e6be1443e89e60a34948b29e42
I20260709 13:14:08.003325  2564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a236e17c7e241569819f8ad849b6f98"
dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
mode: GRACEFUL
new_leader_uuid: "f96f77e6be1443e89e60a34948b29e42"
 from {username='slave'} at 127.0.0.1:38428
I20260709 13:14:08.003841  2564 raft_consensus.cc:606] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 LEADER]: Received request to transfer leadership to TS f96f77e6be1443e89e60a34948b29e42
I20260709 13:14:08.006029  2564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "836d47cab55e478797c8c59d6205c895"
dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
mode: GRACEFUL
new_leader_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
 from {username='slave'} at 127.0.0.1:38428
I20260709 13:14:08.006654  2564 raft_consensus.cc:606] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 LEADER]: Received request to transfer leadership to TS 1dbb9c234dec422bb4b1348545e37ce3
I20260709 13:14:08.009142  2564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8472473e517c4dd29de768894545df0d"
dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
mode: GRACEFUL
new_leader_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
 from {username='slave'} at 127.0.0.1:38428
I20260709 13:14:08.009676  2564 raft_consensus.cc:606] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 LEADER]: Received request to transfer leadership to TS 1dbb9c234dec422bb4b1348545e37ce3
I20260709 13:14:08.010839  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:14:08.011325  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:08.084312  2893 raft_consensus.cc:993] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435: : Instructing follower 1dbb9c234dec422bb4b1348545e37ce3 to start an election
I20260709 13:14:08.085036  2879 raft_consensus.cc:1081] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 LEADER]: Signalling peer 1dbb9c234dec422bb4b1348545e37ce3 to start an election
I20260709 13:14:08.086916  2715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "836d47cab55e478797c8c59d6205c895"
dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
 from {username='slave'} at 127.0.0.1:34358
I20260709 13:14:08.087469  2715 raft_consensus.cc:493] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:08.087926  2715 raft_consensus.cc:3060] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:08.093878  2715 raft_consensus.cc:515] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:08.095659  2715 leader_election.cc:290] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [CANDIDATE]: Term 3 election: Requested vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219)
I20260709 13:14:08.096959  2641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836d47cab55e478797c8c59d6205c895" candidate_uuid: "1dbb9c234dec422bb4b1348545e37ce3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
I20260709 13:14:08.096714  2564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836d47cab55e478797c8c59d6205c895" candidate_uuid: "1dbb9c234dec422bb4b1348545e37ce3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
I20260709 13:14:08.097589  2641 raft_consensus.cc:3060] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:08.097648  2564 raft_consensus.cc:3055] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:08.098166  2564 raft_consensus.cc:740] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:08.099082  2564 consensus_queue.cc:260] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:08.100656  2564 raft_consensus.cc:3060] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:08.105940  2641 raft_consensus.cc:2468] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dbb9c234dec422bb4b1348545e37ce3 in term 3.
I20260709 13:14:08.107600  2678 leader_election.cc:304] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:08.108222  2564 raft_consensus.cc:2468] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dbb9c234dec422bb4b1348545e37ce3 in term 3.
I20260709 13:14:08.108587  2874 raft_consensus.cc:2804] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:08.109648  2874 raft_consensus.cc:697] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 LEADER]: Becoming Leader. State: Replica: 1dbb9c234dec422bb4b1348545e37ce3, State: Running, Role: LEADER
I20260709 13:14:08.110631  2874 consensus_queue.cc:237] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:08.118312  2463 catalog_manager.cc:5697] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 reported cstate change: term changed from 2 to 3, leader changed from 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129) to 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131). New cstate: current_term: 3 leader_uuid: "1dbb9c234dec422bb4b1348545e37ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:08.188336  2879 raft_consensus.cc:993] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435: : Instructing follower 1dbb9c234dec422bb4b1348545e37ce3 to start an election
I20260709 13:14:08.188846  2893 raft_consensus.cc:1081] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 LEADER]: Signalling peer 1dbb9c234dec422bb4b1348545e37ce3 to start an election
I20260709 13:14:08.190673  2715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8472473e517c4dd29de768894545df0d"
dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
 from {username='slave'} at 127.0.0.1:34358
I20260709 13:14:08.191291  2715 raft_consensus.cc:493] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:08.191610  2715 raft_consensus.cc:3060] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:08.197706  2715 raft_consensus.cc:515] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:08.199908  2715 leader_election.cc:290] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [CANDIDATE]: Term 3 election: Requested vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219)
I20260709 13:14:08.200665  2564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8472473e517c4dd29de768894545df0d" candidate_uuid: "1dbb9c234dec422bb4b1348545e37ce3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
I20260709 13:14:08.201040  2641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8472473e517c4dd29de768894545df0d" candidate_uuid: "1dbb9c234dec422bb4b1348545e37ce3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
I20260709 13:14:08.201282  2564 raft_consensus.cc:3055] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:08.201586  2641 raft_consensus.cc:3060] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:08.201617  2564 raft_consensus.cc:740] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:08.202651  2564 consensus_queue.cc:260] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:08.203912  2564 raft_consensus.cc:3060] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:08.209165  2641 raft_consensus.cc:2468] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dbb9c234dec422bb4b1348545e37ce3 in term 3.
I20260709 13:14:08.210656  2678 leader_election.cc:304] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:08.211283  2564 raft_consensus.cc:2468] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dbb9c234dec422bb4b1348545e37ce3 in term 3.
I20260709 13:14:08.211724  2894 raft_consensus.cc:2804] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:08.212251  2894 raft_consensus.cc:697] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 LEADER]: Becoming Leader. State: Replica: 1dbb9c234dec422bb4b1348545e37ce3, State: Running, Role: LEADER
I20260709 13:14:08.213265  2879 raft_consensus.cc:993] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435: : Instructing follower f96f77e6be1443e89e60a34948b29e42 to start an election
I20260709 13:14:08.213174  2894 consensus_queue.cc:237] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:08.213779  2879 raft_consensus.cc:1081] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Signalling peer f96f77e6be1443e89e60a34948b29e42 to start an election
I20260709 13:14:08.215672  2641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4651f16c11c04f76b5afcb996b6ab98c"
dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
 from {username='slave'} at 127.0.0.1:38566
I20260709 13:14:08.216200  2641 raft_consensus.cc:493] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:08.216517  2641 raft_consensus.cc:3060] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:08.221009  2463 catalog_manager.cc:5697] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 reported cstate change: term changed from 2 to 3, leader changed from 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129) to 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131). New cstate: current_term: 3 leader_uuid: "1dbb9c234dec422bb4b1348545e37ce3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:08.222325  2641 raft_consensus.cc:515] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:08.224402  2641 leader_election.cc:290] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 2 election: Requested vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:08.225080  2564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4651f16c11c04f76b5afcb996b6ab98c" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
I20260709 13:14:08.225611  2715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4651f16c11c04f76b5afcb996b6ab98c" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:08.225692  2564 raft_consensus.cc:3055] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:08.226289  2564 raft_consensus.cc:740] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:08.226260  2715 raft_consensus.cc:3060] T 4651f16c11c04f76b5afcb996b6ab98c P 1dbb9c234dec422bb4b1348545e37ce3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:08.227253  2564 consensus_queue.cc:260] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:08.228344  2564 raft_consensus.cc:3060] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:08.232542  2715 raft_consensus.cc:2468] T 4651f16c11c04f76b5afcb996b6ab98c P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 2.
I20260709 13:14:08.233875  2607 leader_election.cc:304] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:08.234193  2564 raft_consensus.cc:2468] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 2.
I20260709 13:14:08.234695  2803 raft_consensus.cc:2804] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:08.235765  2803 raft_consensus.cc:697] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 [term 2 LEADER]: Becoming Leader. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Running, Role: LEADER
I20260709 13:14:08.236512  2803 consensus_queue.cc:237] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:08.243474  2463 catalog_manager.cc:5697] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 reported cstate change: term changed from 1 to 2, leader changed from 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129) to f96f77e6be1443e89e60a34948b29e42 (127.1.227.130). New cstate: current_term: 2 leader_uuid: "f96f77e6be1443e89e60a34948b29e42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:08.460855  2879 raft_consensus.cc:993] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435: : Instructing follower f96f77e6be1443e89e60a34948b29e42 to start an election
I20260709 13:14:08.461376  2879 raft_consensus.cc:1081] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 LEADER]: Signalling peer f96f77e6be1443e89e60a34948b29e42 to start an election
I20260709 13:14:08.463016  2641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a236e17c7e241569819f8ad849b6f98"
dest_uuid: "f96f77e6be1443e89e60a34948b29e42"
 from {username='slave'} at 127.0.0.1:38566
I20260709 13:14:08.463599  2641 raft_consensus.cc:493] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:08.464110  2641 raft_consensus.cc:3060] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:08.469923  2641 raft_consensus.cc:515] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:08.471791  2641 leader_election.cc:290] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 4 election: Requested vote from peers 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121), 1dbb9c234dec422bb4b1348545e37ce3 (127.1.227.131:33167)
I20260709 13:14:08.472605  2564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a236e17c7e241569819f8ad849b6f98" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435"
I20260709 13:14:08.472966  2715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a236e17c7e241569819f8ad849b6f98" candidate_uuid: "f96f77e6be1443e89e60a34948b29e42" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1dbb9c234dec422bb4b1348545e37ce3"
I20260709 13:14:08.473161  2564 raft_consensus.cc:3055] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:08.473649  2564 raft_consensus.cc:740] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8f9e79a28c0d4f06b5e3cb846bd8b435, State: Running, Role: LEADER
I20260709 13:14:08.473680  2715 raft_consensus.cc:3060] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:08.474611  2564 consensus_queue.cc:260] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:08.475853  2564 raft_consensus.cc:3060] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:08.479769  2715 raft_consensus.cc:2468] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 4.
I20260709 13:14:08.481034  2564 raft_consensus.cc:2468] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f96f77e6be1443e89e60a34948b29e42 in term 4.
I20260709 13:14:08.480935  2607 leader_election.cc:304] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbb9c234dec422bb4b1348545e37ce3, f96f77e6be1443e89e60a34948b29e42; no voters: 
I20260709 13:14:08.481966  2803 raft_consensus.cc:2804] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:08.482478  2803 raft_consensus.cc:697] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 4 LEADER]: Becoming Leader. State: Replica: f96f77e6be1443e89e60a34948b29e42, State: Running, Role: LEADER
I20260709 13:14:08.483429  2803 consensus_queue.cc:237] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } }
I20260709 13:14:08.490947  2463 catalog_manager.cc:5697] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 reported cstate change: term changed from 3 to 4, leader changed from 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129) to f96f77e6be1443e89e60a34948b29e42 (127.1.227.130). New cstate: current_term: 4 leader_uuid: "f96f77e6be1443e89e60a34948b29e42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:08.598417  2564 raft_consensus.cc:1275] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 FOLLOWER]: Refusing update from remote peer 1dbb9c234dec422bb4b1348545e37ce3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:08.599829  2894 consensus_queue.cc:1048] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:08.613206  2641 raft_consensus.cc:1275] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 3 FOLLOWER]: Refusing update from remote peer 1dbb9c234dec422bb4b1348545e37ce3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:08.615209  2874 consensus_queue.cc:1048] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:08.623411  2640 raft_consensus.cc:1275] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 3 FOLLOWER]: Refusing update from remote peer 1dbb9c234dec422bb4b1348545e37ce3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:08.624716  2874 consensus_queue.cc:1048] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f96f77e6be1443e89e60a34948b29e42" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:08.635187  2564 raft_consensus.cc:1275] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 FOLLOWER]: Refusing update from remote peer 1dbb9c234dec422bb4b1348545e37ce3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:08.636883  2907 consensus_queue.cc:1048] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:08.687686  2715 raft_consensus.cc:1275] T 4651f16c11c04f76b5afcb996b6ab98c P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Refusing update from remote peer f96f77e6be1443e89e60a34948b29e42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:08.689128  2803 consensus_queue.cc:1048] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:08.700920  2564 raft_consensus.cc:1275] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Refusing update from remote peer f96f77e6be1443e89e60a34948b29e42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:08.703213  2901 consensus_queue.cc:1048] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:08.871752  2715 raft_consensus.cc:1275] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 4 FOLLOWER]: Refusing update from remote peer f96f77e6be1443e89e60a34948b29e42: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:08.873245  2901 consensus_queue.cc:1048] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbb9c234dec422bb4b1348545e37ce3" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:08.880443  2565 raft_consensus.cc:1275] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 4 FOLLOWER]: Refusing update from remote peer f96f77e6be1443e89e60a34948b29e42: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:08.881992  2913 consensus_queue.cc:1048] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9e79a28c0d4f06b5e3cb846bd8b435" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:09.012247  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:09.018411  1934 tablet_server.cc:179] TabletServer@127.1.227.129:0 shutting down...
I20260709 13:14:09.045603  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:09.046350  1934 tablet_replica.cc:333] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435: stopping tablet replica
I20260709 13:14:09.046931  1934 raft_consensus.cc:2243] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:09.047757  1934 raft_consensus.cc:2272] T 92ed0a1371ae402bbf3b4182089bf7a4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.049583  1934 tablet_replica.cc:333] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435: stopping tablet replica
I20260709 13:14:09.050179  1934 raft_consensus.cc:2243] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:09.050812  1934 raft_consensus.cc:2272] T e55294f6315244018f3c8397aeca04ce P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.052389  1934 tablet_replica.cc:333] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435: stopping tablet replica
I20260709 13:14:09.052835  1934 raft_consensus.cc:2243] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.053229  1934 raft_consensus.cc:2272] T 429828aabbb949f58f84ee2ffc1bcc47 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.054936  1934 tablet_replica.cc:333] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435: stopping tablet replica
I20260709 13:14:09.055346  1934 raft_consensus.cc:2243] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.055675  1934 raft_consensus.cc:2272] T 836d47cab55e478797c8c59d6205c895 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.058224  1934 tablet_replica.cc:333] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435: stopping tablet replica
I20260709 13:14:09.058668  1934 raft_consensus.cc:2243] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.059023  1934 raft_consensus.cc:2272] T 8472473e517c4dd29de768894545df0d P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.061021  1934 tablet_replica.cc:333] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435: stopping tablet replica
I20260709 13:14:09.061482  1934 raft_consensus.cc:2243] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.062093  1934 raft_consensus.cc:2272] T 4651f16c11c04f76b5afcb996b6ab98c P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.064442  1934 tablet_replica.cc:333] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435: stopping tablet replica
I20260709 13:14:09.064991  1934 raft_consensus.cc:2243] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:09.065825  1934 raft_consensus.cc:2272] T b3622a951e8e408881ce7caf82d16641 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.067579  1934 tablet_replica.cc:333] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435: stopping tablet replica
I20260709 13:14:09.068260  1934 raft_consensus.cc:2243] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.068725  1934 raft_consensus.cc:2272] T 122e785e3955406b8953143345c7b8d4 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.070787  1934 tablet_replica.cc:333] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435: stopping tablet replica
I20260709 13:14:09.071424  1934 raft_consensus.cc:2243] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:09.072243  1934 raft_consensus.cc:2272] T 9e867c538ebd4729851d3030a7921ae6 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:09.072947  2606 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
I20260709 13:14:09.074771  1934 tablet_replica.cc:333] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435: stopping tablet replica
I20260709 13:14:09.075325  1934 raft_consensus.cc:2243] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.075793  1934 raft_consensus.cc:2272] T 5a236e17c7e241569819f8ad849b6f98 P 8f9e79a28c0d4f06b5e3cb846bd8b435 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:09.076702  2606 consensus_peers.cc:597] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 -> Peer 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121): Couldn't send request to peer 8f9e79a28c0d4f06b5e3cb846bd8b435. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:09.106396  1934 tablet_server.cc:196] TabletServer@127.1.227.129:0 shutdown complete.
I20260709 13:14:09.128786  1934 tablet_server.cc:179] TabletServer@127.1.227.130:0 shutting down...
W20260709 13:14:09.155051  2678 consensus_peers.cc:597] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 -> Peer f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219): Couldn't send request to peer f96f77e6be1443e89e60a34948b29e42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:09.164460  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:09.165328  1934 tablet_replica.cc:333] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42: stopping tablet replica
I20260709 13:14:09.166152  1934 raft_consensus.cc:2243] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.166616  1934 raft_consensus.cc:2272] T 122e785e3955406b8953143345c7b8d4 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.168407  1934 tablet_replica.cc:333] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42: stopping tablet replica
I20260709 13:14:09.169129  1934 raft_consensus.cc:2243] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.169673  1934 raft_consensus.cc:2272] T 9e867c538ebd4729851d3030a7921ae6 P f96f77e6be1443e89e60a34948b29e42 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.171541  1934 tablet_replica.cc:333] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42: stopping tablet replica
I20260709 13:14:09.172122  1934 raft_consensus.cc:2243] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:09.172978  1934 raft_consensus.cc:2272] T 429828aabbb949f58f84ee2ffc1bcc47 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.175077  1934 tablet_replica.cc:333] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42: stopping tablet replica
I20260709 13:14:09.175770  1934 raft_consensus.cc:2243] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.176437  1934 raft_consensus.cc:2272] T b3622a951e8e408881ce7caf82d16641 P f96f77e6be1443e89e60a34948b29e42 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.178957  1934 tablet_replica.cc:333] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42: stopping tablet replica
I20260709 13:14:09.179646  1934 raft_consensus.cc:2243] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.180126  1934 raft_consensus.cc:2272] T 836d47cab55e478797c8c59d6205c895 P f96f77e6be1443e89e60a34948b29e42 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:09.181313  2606 consensus_peers.cc:597] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 -> Peer 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121): Couldn't send request to peer 8f9e79a28c0d4f06b5e3cb846bd8b435. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39121: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:09.183059  1934 tablet_replica.cc:333] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42: stopping tablet replica
I20260709 13:14:09.183665  1934 raft_consensus.cc:2243] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.184165  1934 raft_consensus.cc:2272] T 8472473e517c4dd29de768894545df0d P f96f77e6be1443e89e60a34948b29e42 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.186715  1934 tablet_replica.cc:333] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42: stopping tablet replica
I20260709 13:14:09.187271  1934 raft_consensus.cc:2243] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:09.188102  1934 raft_consensus.cc:2272] T 4651f16c11c04f76b5afcb996b6ab98c P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.190276  1934 tablet_replica.cc:333] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42: stopping tablet replica
I20260709 13:14:09.190938  1934 raft_consensus.cc:2243] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.191516  1934 raft_consensus.cc:2272] T 92ed0a1371ae402bbf3b4182089bf7a4 P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.194208  1934 tablet_replica.cc:333] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42: stopping tablet replica
I20260709 13:14:09.194710  1934 raft_consensus.cc:2243] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.195160  1934 raft_consensus.cc:2272] T e55294f6315244018f3c8397aeca04ce P f96f77e6be1443e89e60a34948b29e42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.196828  1934 tablet_replica.cc:333] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42: stopping tablet replica
I20260709 13:14:09.197268  1934 raft_consensus.cc:2243] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:09.198087  1934 raft_consensus.cc:2272] T 5a236e17c7e241569819f8ad849b6f98 P f96f77e6be1443e89e60a34948b29e42 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:09.222862  2680 consensus_peers.cc:597] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 -> Peer 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121): Couldn't send request to peer 8f9e79a28c0d4f06b5e3cb846bd8b435. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39121: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:09.226132  1934 tablet_server.cc:196] TabletServer@127.1.227.130:0 shutdown complete.
W20260709 13:14:09.234333  2680 consensus_peers.cc:597] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 -> Peer 8f9e79a28c0d4f06b5e3cb846bd8b435 (127.1.227.129:39121): Couldn't send request to peer 8f9e79a28c0d4f06b5e3cb846bd8b435. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39121: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:09.249517  1934 tablet_server.cc:179] TabletServer@127.1.227.131:0 shutting down...
W20260709 13:14:09.253489  2678 consensus_peers.cc:597] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 -> Peer f96f77e6be1443e89e60a34948b29e42 (127.1.227.130:36219): Couldn't send request to peer f96f77e6be1443e89e60a34948b29e42. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:36219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:09.277717  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:09.278806  1934 tablet_replica.cc:333] T 429828aabbb949f58f84ee2ffc1bcc47 P 1dbb9c234dec422bb4b1348545e37ce3: stopping tablet replica
I20260709 13:14:09.279678  1934 raft_consensus.cc:2243] T 429828aabbb949f58f84ee2ffc1bcc47 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.280186  1934 raft_consensus.cc:2272] T 429828aabbb949f58f84ee2ffc1bcc47 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.282228  1934 tablet_replica.cc:333] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3: stopping tablet replica
I20260709 13:14:09.282789  1934 raft_consensus.cc:2243] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.283277  1934 raft_consensus.cc:2272] T 5a236e17c7e241569819f8ad849b6f98 P 1dbb9c234dec422bb4b1348545e37ce3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.285594  1934 tablet_replica.cc:333] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3: stopping tablet replica
I20260709 13:14:09.286212  1934 raft_consensus.cc:2243] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.286664  1934 raft_consensus.cc:2272] T b3622a951e8e408881ce7caf82d16641 P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.288424  1934 tablet_replica.cc:333] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3: stopping tablet replica
I20260709 13:14:09.288985  1934 raft_consensus.cc:2243] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:09.289860  1934 raft_consensus.cc:2272] T 122e785e3955406b8953143345c7b8d4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.291706  1934 tablet_replica.cc:333] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3: stopping tablet replica
I20260709 13:14:09.292229  1934 raft_consensus.cc:2243] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.292641  1934 raft_consensus.cc:2272] T 9e867c538ebd4729851d3030a7921ae6 P 1dbb9c234dec422bb4b1348545e37ce3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.294453  1934 tablet_replica.cc:333] T 4651f16c11c04f76b5afcb996b6ab98c P 1dbb9c234dec422bb4b1348545e37ce3: stopping tablet replica
I20260709 13:14:09.294991  1934 raft_consensus.cc:2243] T 4651f16c11c04f76b5afcb996b6ab98c P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.295421  1934 raft_consensus.cc:2272] T 4651f16c11c04f76b5afcb996b6ab98c P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.298005  1934 tablet_replica.cc:333] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3: stopping tablet replica
I20260709 13:14:09.298585  1934 raft_consensus.cc:2243] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:09.299405  1934 raft_consensus.cc:2272] T 8472473e517c4dd29de768894545df0d P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.301527  1934 tablet_replica.cc:333] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3: stopping tablet replica
I20260709 13:14:09.302110  1934 raft_consensus.cc:2243] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:09.302898  1934 raft_consensus.cc:2272] T 836d47cab55e478797c8c59d6205c895 P 1dbb9c234dec422bb4b1348545e37ce3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.305124  1934 tablet_replica.cc:333] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3: stopping tablet replica
I20260709 13:14:09.305639  1934 raft_consensus.cc:2243] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.306145  1934 raft_consensus.cc:2272] T e55294f6315244018f3c8397aeca04ce P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.307893  1934 tablet_replica.cc:333] T 92ed0a1371ae402bbf3b4182089bf7a4 P 1dbb9c234dec422bb4b1348545e37ce3: stopping tablet replica
I20260709 13:14:09.308377  1934 raft_consensus.cc:2243] T 92ed0a1371ae402bbf3b4182089bf7a4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.308800  1934 raft_consensus.cc:2272] T 92ed0a1371ae402bbf3b4182089bf7a4 P 1dbb9c234dec422bb4b1348545e37ce3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.342190  1934 tablet_server.cc:196] TabletServer@127.1.227.131:0 shutdown complete.
I20260709 13:14:09.359844  1934 master.cc:562] Master@127.1.227.190:44443 shutting down...
I20260709 13:14:09.382118  1934 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:09.382655  1934 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.382989  1934 tablet_replica.cc:333] T 00000000000000000000000000000000 P 22203bb35f574704b853f1c450a733da: stopping tablet replica
I20260709 13:14:09.404431  1934 master.cc:584] Master@127.1.227.190:44443 shutdown complete.
1dbb9c234dec422bb4b1348545e37ce3  1
8f9e79a28c0d4f06b5e3cb846bd8b435  5
f96f77e6be1443e89e60a34948b29e42  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10419 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:14:09.452211  1934 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.227.190:44821
I20260709 13:14:09.453498  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:09.460474  2924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:09.461258  2927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:09.461639  2925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:09.462136  1934 server_base.cc:1061] running on GCE node
I20260709 13:14:09.463192  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:09.463420  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:09.463582  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783602849463568 us; error 0 us; skew 500 ppm
I20260709 13:14:09.464207  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:09.467425  1934 webserver.cc:533] Webserver started at http://127.1.227.190:41173/ using document root <none> and password file <none>
I20260709 13:14:09.468058  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:09.468238  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:09.468534  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:09.469980  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/master-0-root/instance:
uuid: "fc4fb08aba024155968fdc88910f61d7"
format_stamp: "Formatted at 2026-07-09 13:14:09 on dist-test-slave-lfdf"
I20260709 13:14:09.474977  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:14:09.478837  2932 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.479837  1934 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:14:09.480181  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/master-0-root
uuid: "fc4fb08aba024155968fdc88910f61d7"
format_stamp: "Formatted at 2026-07-09 13:14:09 on dist-test-slave-lfdf"
I20260709 13:14:09.480525  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:09.496064  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:09.497313  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:09.539045  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.190:44821
I20260709 13:14:09.539178  2983 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.190:44821 every 8 connection(s)
I20260709 13:14:09.543401  2984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.554165  2984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Bootstrap starting.
I20260709 13:14:09.559500  2984 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.564083  2984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: No bootstrap required, opened a new log
I20260709 13:14:09.566609  2984 raft_consensus.cc:359] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc4fb08aba024155968fdc88910f61d7" member_type: VOTER }
I20260709 13:14:09.567022  2984 raft_consensus.cc:385] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.567327  2984 raft_consensus.cc:740] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc4fb08aba024155968fdc88910f61d7, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.568022  2984 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc4fb08aba024155968fdc88910f61d7" member_type: VOTER }
I20260709 13:14:09.568535  2984 raft_consensus.cc:399] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:09.568794  2984 raft_consensus.cc:493] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:09.569069  2984 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:09.573891  2984 raft_consensus.cc:515] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc4fb08aba024155968fdc88910f61d7" member_type: VOTER }
I20260709 13:14:09.574506  2984 leader_election.cc:304] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc4fb08aba024155968fdc88910f61d7; no voters: 
I20260709 13:14:09.575711  2984 leader_election.cc:290] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:09.576188  2987 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:09.577807  2987 raft_consensus.cc:697] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7 [term 1 LEADER]: Becoming Leader. State: Replica: fc4fb08aba024155968fdc88910f61d7, State: Running, Role: LEADER
I20260709 13:14:09.578562  2987 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc4fb08aba024155968fdc88910f61d7" member_type: VOTER }
I20260709 13:14:09.579062  2984 sys_catalog.cc:565] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:09.584156  2989 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc4fb08aba024155968fdc88910f61d7. Latest consensus state: current_term: 1 leader_uuid: "fc4fb08aba024155968fdc88910f61d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc4fb08aba024155968fdc88910f61d7" member_type: VOTER } }
I20260709 13:14:09.585176  2989 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:09.588047  2988 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc4fb08aba024155968fdc88910f61d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc4fb08aba024155968fdc88910f61d7" member_type: VOTER } }
I20260709 13:14:09.588886  2988 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:09.591681  2993 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:09.596820  2993 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:09.602192  1934 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:09.607136  2993 catalog_manager.cc:1383] Generated new cluster ID: 4401568660e6407ea2cd6efa8177c212
I20260709 13:14:09.607445  2993 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:09.630189  2993 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:09.631765  2993 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:09.644106  2993 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Generated new TSK 0
I20260709 13:14:09.644800  2993 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:09.668751  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:09.675300  3005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:09.676143  3006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:09.678604  3008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:09.679412  1934 server_base.cc:1061] running on GCE node
I20260709 13:14:09.680267  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:09.680505  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:09.680702  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783602849680684 us; error 0 us; skew 500 ppm
I20260709 13:14:09.681305  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:09.684156  1934 webserver.cc:533] Webserver started at http://127.1.227.129:36483/ using document root <none> and password file <none>
I20260709 13:14:09.684669  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:09.684856  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:09.685154  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:09.686290  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-0-root/instance:
uuid: "aaf88538197a49adb8bcf3790309a67e"
format_stamp: "Formatted at 2026-07-09 13:14:09 on dist-test-slave-lfdf"
I20260709 13:14:09.691039  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:14:09.694468  3013 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.695458  1934 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:14:09.695791  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-0-root
uuid: "aaf88538197a49adb8bcf3790309a67e"
format_stamp: "Formatted at 2026-07-09 13:14:09 on dist-test-slave-lfdf"
I20260709 13:14:09.696152  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:09.708385  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:09.709668  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:09.711338  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:09.713871  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:09.714097  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.714345  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:09.714556  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.759986  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.129:44609
I20260709 13:14:09.760272  3075 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.129:44609 every 8 connection(s)
I20260709 13:14:09.764901  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:09.771979  3080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:09.773072  3081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:09.776085  1934 server_base.cc:1061] running on GCE node
W20260709 13:14:09.778010  3083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:09.779047  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:14:09.779312  3076 heartbeater.cc:344] Connected to a master server at 127.1.227.190:44821
W20260709 13:14:09.779353  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:09.779727  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783602849779704 us; error 0 us; skew 500 ppm
I20260709 13:14:09.779806  3076 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:09.780345  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:09.780722  3076 heartbeater.cc:507] Master 127.1.227.190:44821 requested a full tablet report, sending...
I20260709 13:14:09.783390  1934 webserver.cc:533] Webserver started at http://127.1.227.130:36591/ using document root <none> and password file <none>
I20260709 13:14:09.783504  2949 ts_manager.cc:194] Registered new tserver with Master: aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:14:09.783988  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:09.784226  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:09.784490  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:09.785461  2949 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57732
I20260709 13:14:09.785648  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-1-root/instance:
uuid: "f20672b2852447a6bc1e137c4dd40904"
format_stamp: "Formatted at 2026-07-09 13:14:09 on dist-test-slave-lfdf"
I20260709 13:14:09.790674  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:14:09.794510  3088 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.795485  1934 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:14:09.795800  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-1-root
uuid: "f20672b2852447a6bc1e137c4dd40904"
format_stamp: "Formatted at 2026-07-09 13:14:09 on dist-test-slave-lfdf"
I20260709 13:14:09.796057  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:09.816102  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:09.817444  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:09.819181  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:09.821563  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:09.821837  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:14:09.822108  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:09.822285  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.864897  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.130:38619
I20260709 13:14:09.865003  3150 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.130:38619 every 8 connection(s)
I20260709 13:14:09.869797  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:09.877445  3154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:09.879774  3155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:09.883018  1934 server_base.cc:1061] running on GCE node
W20260709 13:14:09.883399  3157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:09.883742  3151 heartbeater.cc:344] Connected to a master server at 127.1.227.190:44821
I20260709 13:14:09.884217  3151 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:09.884574  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:09.884835  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:09.885025  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783602849885007 us; error 0 us; skew 500 ppm
I20260709 13:14:09.885133  3151 heartbeater.cc:507] Master 127.1.227.190:44821 requested a full tablet report, sending...
I20260709 13:14:09.885808  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:09.887547  2949 ts_manager.cc:194] Registered new tserver with Master: f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:09.888711  1934 webserver.cc:533] Webserver started at http://127.1.227.131:40295/ using document root <none> and password file <none>
I20260709 13:14:09.889420  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:09.889416  2949 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57744
I20260709 13:14:09.889859  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:09.890195  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:09.891625  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-2-root/instance:
uuid: "501fdf2af2bc4b0c971ae880e98f466b"
format_stamp: "Formatted at 2026-07-09 13:14:09 on dist-test-slave-lfdf"
I20260709 13:14:09.896399  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:14:09.899997  3162 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.900992  1934 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:14:09.901384  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-2-root
uuid: "501fdf2af2bc4b0c971ae880e98f466b"
format_stamp: "Formatted at 2026-07-09 13:14:09 on dist-test-slave-lfdf"
I20260709 13:14:09.901728  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:09.927006  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:09.928202  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:09.930243  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:09.932574  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:09.932847  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.933130  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:09.933295  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.978404  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.131:38665
I20260709 13:14:09.978466  3224 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.131:38665 every 8 connection(s)
I20260709 13:14:09.999521  3225 heartbeater.cc:344] Connected to a master server at 127.1.227.190:44821
I20260709 13:14:09.999961  3225 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:10.000763  3225 heartbeater.cc:507] Master 127.1.227.190:44821 requested a full tablet report, sending...
I20260709 13:14:10.003233  2949 ts_manager.cc:194] Registered new tserver with Master: 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:10.004293  1934 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.022435392s
I20260709 13:14:10.004896  2949 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57750
I20260709 13:14:10.034302  2949 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57762:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:10.040704  2949 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:10.266793  3116 tablet_service.cc:1511] Processing CreateTablet for tablet 60d362d3e2ef4546ae699b5d8f4db504 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:14:10.268339  3116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d362d3e2ef4546ae699b5d8f4db504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.270834  3115 tablet_service.cc:1511] Processing CreateTablet for tablet fcf5db67d30f487d873766886c2ef408 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:14:10.272212  3115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf5db67d30f487d873766886c2ef408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.273710  3110 tablet_service.cc:1511] Processing CreateTablet for tablet dab74aefe0d74cf5b7b691b15690a40b (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:14:10.275255  3110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dab74aefe0d74cf5b7b691b15690a40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.276645  3113 tablet_service.cc:1511] Processing CreateTablet for tablet be0f43de06b240e69f5f94ca88c7b321 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:14:10.278997  3112 tablet_service.cc:1511] Processing CreateTablet for tablet 1c7972fb78be427daa0baf637a4c17d1 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:14:10.281190  3111 tablet_service.cc:1511] Processing CreateTablet for tablet 717d128a6d6e4ec0b76d3993e4153a8a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:14:10.283546  3108 tablet_service.cc:1511] Processing CreateTablet for tablet a958b84326034dfd93407cbe60f84548 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:14:10.286968  3188 tablet_service.cc:1511] Processing CreateTablet for tablet ae0fe1dc34db4ff5b5d35916b8a84d4a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:14:10.287356  3190 tablet_service.cc:1511] Processing CreateTablet for tablet 60d362d3e2ef4546ae699b5d8f4db504 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:14:10.288497  3188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae0fe1dc34db4ff5b5d35916b8a84d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.289093  3190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d362d3e2ef4546ae699b5d8f4db504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.288794  3183 tablet_service.cc:1511] Processing CreateTablet for tablet 12725e4e41614e1292b974e17635f758 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:14:10.290140  3183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12725e4e41614e1292b974e17635f758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.290987  3187 tablet_service.cc:1511] Processing CreateTablet for tablet be0f43de06b240e69f5f94ca88c7b321 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:14:10.292335  3187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0f43de06b240e69f5f94ca88c7b321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.294849  3186 tablet_service.cc:1511] Processing CreateTablet for tablet 1c7972fb78be427daa0baf637a4c17d1 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:14:10.296181  3186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7972fb78be427daa0baf637a4c17d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.299044  3185 tablet_service.cc:1511] Processing CreateTablet for tablet 717d128a6d6e4ec0b76d3993e4153a8a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:14:10.300500  3185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 717d128a6d6e4ec0b76d3993e4153a8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.294849  3182 tablet_service.cc:1511] Processing CreateTablet for tablet a958b84326034dfd93407cbe60f84548 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:14:10.303262  3182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a958b84326034dfd93407cbe60f84548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.285467  3189 tablet_service.cc:1511] Processing CreateTablet for tablet fcf5db67d30f487d873766886c2ef408 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:14:10.307013  3189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf5db67d30f487d873766886c2ef408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.308964  3107 tablet_service.cc:1511] Processing CreateTablet for tablet 96a33a25f4f3488ea9a2cec075aa10ce (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:14:10.274869  3114 tablet_service.cc:1511] Processing CreateTablet for tablet ae0fe1dc34db4ff5b5d35916b8a84d4a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:14:10.287065  3184 tablet_service.cc:1511] Processing CreateTablet for tablet dab74aefe0d74cf5b7b691b15690a40b (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:14:10.311277  3184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dab74aefe0d74cf5b7b691b15690a40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.283546  3109 tablet_service.cc:1511] Processing CreateTablet for tablet 12725e4e41614e1292b974e17635f758 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:14:10.314743  3113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0f43de06b240e69f5f94ca88c7b321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.315447  3108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a958b84326034dfd93407cbe60f84548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.316255  3040 tablet_service.cc:1511] Processing CreateTablet for tablet fcf5db67d30f487d873766886c2ef408 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:14:10.314729  3041 tablet_service.cc:1511] Processing CreateTablet for tablet 60d362d3e2ef4546ae699b5d8f4db504 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:14:10.319205  3041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d362d3e2ef4546ae699b5d8f4db504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.319278  3039 tablet_service.cc:1511] Processing CreateTablet for tablet ae0fe1dc34db4ff5b5d35916b8a84d4a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:14:10.321239  3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae0fe1dc34db4ff5b5d35916b8a84d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.322104  3107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a33a25f4f3488ea9a2cec075aa10ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.323418  3038 tablet_service.cc:1511] Processing CreateTablet for tablet be0f43de06b240e69f5f94ca88c7b321 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:14:10.325314  3038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0f43de06b240e69f5f94ca88c7b321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.326092  3114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae0fe1dc34db4ff5b5d35916b8a84d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.327512  3037 tablet_service.cc:1511] Processing CreateTablet for tablet 1c7972fb78be427daa0baf637a4c17d1 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:14:10.330209  3111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 717d128a6d6e4ec0b76d3993e4153a8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.330829  3036 tablet_service.cc:1511] Processing CreateTablet for tablet 717d128a6d6e4ec0b76d3993e4153a8a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:14:10.334172  3112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7972fb78be427daa0baf637a4c17d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.335990  3034 tablet_service.cc:1511] Processing CreateTablet for tablet 12725e4e41614e1292b974e17635f758 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:14:10.337014  3109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12725e4e41614e1292b974e17635f758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.339709  3040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf5db67d30f487d873766886c2ef408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.339627  3035 tablet_service.cc:1511] Processing CreateTablet for tablet dab74aefe0d74cf5b7b691b15690a40b (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:14:10.341101  3035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dab74aefe0d74cf5b7b691b15690a40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.342128  3037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7972fb78be427daa0baf637a4c17d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.346148  3036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 717d128a6d6e4ec0b76d3993e4153a8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.347805  3181 tablet_service.cc:1511] Processing CreateTablet for tablet 96a33a25f4f3488ea9a2cec075aa10ce (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:14:10.349292  3181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a33a25f4f3488ea9a2cec075aa10ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.350811  3033 tablet_service.cc:1511] Processing CreateTablet for tablet a958b84326034dfd93407cbe60f84548 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:14:10.362296  3240 tablet_bootstrap.cc:492] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:10.370098  3034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12725e4e41614e1292b974e17635f758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.371331  3032 tablet_service.cc:1511] Processing CreateTablet for tablet 96a33a25f4f3488ea9a2cec075aa10ce (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:14:10.373317  3032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a33a25f4f3488ea9a2cec075aa10ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.382804  3183 tablet_service.cc:1511] Processing CreateTablet for tablet 0d08acccfb704a2cbd3aa420321f06d0 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:14:10.401428  3033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a958b84326034dfd93407cbe60f84548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.399196  3183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d08acccfb704a2cbd3aa420321f06d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.424894  3240 tablet_bootstrap.cc:654] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:10.441905  3189 tablet_service.cc:1511] Processing CreateTablet for tablet de94f7d51a554137acbf3110ce91f2fc (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:14:10.444262  3241 tablet_bootstrap.cc:492] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:10.456269  3112 tablet_service.cc:1511] Processing CreateTablet for tablet c0433e7a23a246a290c4170888e0d7ee (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:14:10.464351  3112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0433e7a23a246a290c4170888e0d7ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.459302  3110 tablet_service.cc:1511] Processing CreateTablet for tablet de94f7d51a554137acbf3110ce91f2fc (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:14:10.471079  3110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de94f7d51a554137acbf3110ce91f2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.461143  3115 tablet_service.cc:1511] Processing CreateTablet for tablet 0d08acccfb704a2cbd3aa420321f06d0 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:14:10.478969  3115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d08acccfb704a2cbd3aa420321f06d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.457532  3189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de94f7d51a554137acbf3110ce91f2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.479385  3186 tablet_service.cc:1511] Processing CreateTablet for tablet c0433e7a23a246a290c4170888e0d7ee (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:14:10.488387  3037 tablet_service.cc:1511] Processing CreateTablet for tablet 0d08acccfb704a2cbd3aa420321f06d0 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:14:10.489780  3037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d08acccfb704a2cbd3aa420321f06d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.507160  3107 tablet_service.cc:1511] Processing CreateTablet for tablet 2fbe6f8795fb454182fceb2dad61e5c6 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:14:10.512468  3107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fbe6f8795fb454182fceb2dad61e5c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.512338  3037 tablet_service.cc:1511] Processing CreateTablet for tablet c0433e7a23a246a290c4170888e0d7ee (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:14:10.513669  3037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0433e7a23a246a290c4170888e0d7ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.503206  3186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0433e7a23a246a290c4170888e0d7ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.530793  3188 tablet_service.cc:1511] Processing CreateTablet for tablet 2fbe6f8795fb454182fceb2dad61e5c6 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:14:10.535794  3039 tablet_service.cc:1511] Processing CreateTablet for tablet d5f05b490add4820b03ca7600e7539ff (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:14:10.539202  3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f05b490add4820b03ca7600e7539ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.546090  3242 tablet_bootstrap.cc:492] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:10.554414  3038 tablet_service.cc:1511] Processing CreateTablet for tablet de94f7d51a554137acbf3110ce91f2fc (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:14:10.555799  3038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de94f7d51a554137acbf3110ce91f2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.560070  3181 tablet_service.cc:1511] Processing CreateTablet for tablet d5f05b490add4820b03ca7600e7539ff (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:14:10.563895  3240 tablet_bootstrap.cc:492] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:10.564414  3240 ts_tablet_manager.cc:1403] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.202s	user 0.033s	sys 0.015s
I20260709 13:14:10.562871  3114 tablet_service.cc:1511] Processing CreateTablet for tablet d5f05b490add4820b03ca7600e7539ff (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:14:10.574102  3188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fbe6f8795fb454182fceb2dad61e5c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.574471  3035 tablet_service.cc:1511] Processing CreateTablet for tablet 2fbe6f8795fb454182fceb2dad61e5c6 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:14:10.575882  3035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fbe6f8795fb454182fceb2dad61e5c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.576773  3032 tablet_service.cc:1511] Processing CreateTablet for tablet cf28784fe3e74ad5b9c56f1d28247222 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:14:10.578245  3032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf28784fe3e74ad5b9c56f1d28247222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.567408  3240 raft_consensus.cc:359] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:10.581807  3240 raft_consensus.cc:385] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:10.582114  3240 raft_consensus.cc:740] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:10.582934  3240 consensus_queue.cc:260] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:10.586125  3181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f05b490add4820b03ca7600e7539ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.589824  3241 tablet_bootstrap.cc:654] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:10.594156  3114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f05b490add4820b03ca7600e7539ff. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:10.596834  2997 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:10.607491  3183 tablet_service.cc:1511] Processing CreateTablet for tablet cf28784fe3e74ad5b9c56f1d28247222 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:14:10.608882  3183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf28784fe3e74ad5b9c56f1d28247222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.597910  3242 tablet_bootstrap.cc:654] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:10.599586  3113 tablet_service.cc:1511] Processing CreateTablet for tablet cf28784fe3e74ad5b9c56f1d28247222 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:14:10.614493  3240 ts_tablet_manager.cc:1434] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.004s
I20260709 13:14:10.614732  3113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf28784fe3e74ad5b9c56f1d28247222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.615132  3151 heartbeater.cc:499] Master 127.1.227.190:44821 was elected leader, sending a full tablet report...
I20260709 13:14:10.615530  3240 tablet_bootstrap.cc:492] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:10.625245  3036 tablet_service.cc:1511] Processing CreateTablet for tablet aef26e81d3be4bc0883542eb71924948 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:14:10.626338  3116 tablet_service.cc:1511] Processing CreateTablet for tablet aef26e81d3be4bc0883542eb71924948 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:14:10.627000  3036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aef26e81d3be4bc0883542eb71924948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.627786  3116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aef26e81d3be4bc0883542eb71924948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.629964  3240 tablet_bootstrap.cc:654] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:10.636561  3242 tablet_bootstrap.cc:492] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:10.637099  3242 ts_tablet_manager.cc:1403] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.091s	user 0.005s	sys 0.008s
I20260709 13:14:10.640034  3242 raft_consensus.cc:359] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:10.641215  3186 tablet_service.cc:1511] Processing CreateTablet for tablet aef26e81d3be4bc0883542eb71924948 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:14:10.642699  3186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aef26e81d3be4bc0883542eb71924948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.645809  3242 raft_consensus.cc:385] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:10.646368  3242 raft_consensus.cc:740] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:10.648283  3241 tablet_bootstrap.cc:492] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:10.648875  3241 ts_tablet_manager.cc:1403] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.243s	user 0.021s	sys 0.003s
I20260709 13:14:10.652293  3241 raft_consensus.cc:359] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:10.648048  3242 consensus_queue.cc:260] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:10.668119  3241 raft_consensus.cc:385] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:10.661478  3035 tablet_service.cc:1511] Processing CreateTablet for tablet 038f072ecdcc4679a46740d78fb0dbd7 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:14:10.668761  3241 raft_consensus.cc:740] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:10.669678  3035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 038f072ecdcc4679a46740d78fb0dbd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.670075  3241 consensus_queue.cc:260] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:10.674996  3110 tablet_service.cc:1511] Processing CreateTablet for tablet 038f072ecdcc4679a46740d78fb0dbd7 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:14:10.676996  3076 heartbeater.cc:499] Master 127.1.227.190:44821 was elected leader, sending a full tablet report...
I20260709 13:14:10.664884  3240 tablet_bootstrap.cc:492] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:10.682211  3240 ts_tablet_manager.cc:1403] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.018s
I20260709 13:14:10.682451  3110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 038f072ecdcc4679a46740d78fb0dbd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.685424  3240 raft_consensus.cc:359] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:10.686287  3240 raft_consensus.cc:385] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:10.686652  3240 raft_consensus.cc:740] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:10.678110  3242 ts_tablet_manager.cc:1434] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.004s
I20260709 13:14:10.687978  3242 tablet_bootstrap.cc:492] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:10.679955  3188 tablet_service.cc:1511] Processing CreateTablet for tablet 038f072ecdcc4679a46740d78fb0dbd7 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:14:10.697515  3240 consensus_queue.cc:260] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:10.698357  3188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 038f072ecdcc4679a46740d78fb0dbd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.700073  3240 ts_tablet_manager.cc:1434] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:14:10.701150  3240 tablet_bootstrap.cc:492] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:10.709002  3240 tablet_bootstrap.cc:654] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:10.711764  3035 tablet_service.cc:1511] Processing CreateTablet for tablet a28cf255dda74b44acbfc2fff2f8f950 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:14:10.713209  3035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a28cf255dda74b44acbfc2fff2f8f950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.714375  3181 tablet_service.cc:1511] Processing CreateTablet for tablet a28cf255dda74b44acbfc2fff2f8f950 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:14:10.715865  3181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a28cf255dda74b44acbfc2fff2f8f950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.715710  3032 tablet_service.cc:1511] Processing CreateTablet for tablet 1a367b51f1ce4b0197b9dadabe52be32 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:14:10.717096  3032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a367b51f1ce4b0197b9dadabe52be32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.723592  3114 tablet_service.cc:1511] Processing CreateTablet for tablet 1a367b51f1ce4b0197b9dadabe52be32 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:14:10.723743  3186 tablet_service.cc:1511] Processing CreateTablet for tablet 1a367b51f1ce4b0197b9dadabe52be32 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:14:10.725060  3114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a367b51f1ce4b0197b9dadabe52be32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.725180  3186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a367b51f1ce4b0197b9dadabe52be32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.731498  3242 tablet_bootstrap.cc:654] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:10.735248  3036 tablet_service.cc:1511] Processing CreateTablet for tablet efef22a7096a40bdb96063353ee98827 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:14:10.738130  3036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efef22a7096a40bdb96063353ee98827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.738241  3110 tablet_service.cc:1511] Processing CreateTablet for tablet a28cf255dda74b44acbfc2fff2f8f950 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:14:10.739594  3110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a28cf255dda74b44acbfc2fff2f8f950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.760828  3225 heartbeater.cc:499] Master 127.1.227.190:44821 was elected leader, sending a full tablet report...
I20260709 13:14:10.764617  3113 tablet_service.cc:1511] Processing CreateTablet for tablet efef22a7096a40bdb96063353ee98827 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:14:10.766124  3113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efef22a7096a40bdb96063353ee98827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.772300  3240 tablet_bootstrap.cc:492] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:10.779808  3240 ts_tablet_manager.cc:1403] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.008s
I20260709 13:14:10.775470  3186 tablet_service.cc:1511] Processing CreateTablet for tablet efef22a7096a40bdb96063353ee98827 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:14:10.774626  3241 ts_tablet_manager.cc:1434] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.125s	user 0.016s	sys 0.006s
I20260709 13:14:10.780920  3244 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.781435  3244 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:10.781816  3107 tablet_service.cc:1511] Processing CreateTablet for tablet d0547788d7204e17800f3e8d5ac0b20a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:14:10.782383  3242 tablet_bootstrap.cc:492] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:10.784847  3107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0547788d7204e17800f3e8d5ac0b20a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.784978  3036 tablet_service.cc:1511] Processing CreateTablet for tablet d0547788d7204e17800f3e8d5ac0b20a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:14:10.786355  3036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0547788d7204e17800f3e8d5ac0b20a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.790550  3242 ts_tablet_manager.cc:1403] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.103s	user 0.014s	sys 0.003s
I20260709 13:14:10.795717  3242 raft_consensus.cc:359] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:10.799415  3242 raft_consensus.cc:385] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:10.799847  3242 raft_consensus.cc:740] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:10.796489  3244 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:10.797261  3241 tablet_bootstrap.cc:492] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:10.798971  3186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efef22a7096a40bdb96063353ee98827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.800846  3242 consensus_queue.cc:260] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:10.810794  3032 tablet_service.cc:1511] Processing CreateTablet for tablet 201b46c47dd4427db5220d8cfaf02883 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:14:10.812183  3032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 201b46c47dd4427db5220d8cfaf02883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.811939  3110 tablet_service.cc:1511] Processing CreateTablet for tablet 201b46c47dd4427db5220d8cfaf02883 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:14:10.813207  3110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 201b46c47dd4427db5220d8cfaf02883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.818326  3244 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.818832  3244 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:10.821010  3244 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:10.817229  3240 raft_consensus.cc:359] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:10.827288  3240 raft_consensus.cc:385] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:10.827840  3240 raft_consensus.cc:740] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:10.828554  3242 ts_tablet_manager.cc:1434] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.000s
I20260709 13:14:10.835595  3116 tablet_service.cc:1511] Processing CreateTablet for tablet 921c451a21e944ff8a8e6ec22207eca3 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:14:10.855198  3116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 921c451a21e944ff8a8e6ec22207eca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.835350  3035 tablet_service.cc:1511] Processing CreateTablet for tablet 921c451a21e944ff8a8e6ec22207eca3 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:14:10.861255  3039 tablet_service.cc:1511] Processing CreateTablet for tablet 85059665c6234a2a8380bebb4790b5cb (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:14:10.849270  3241 tablet_bootstrap.cc:654] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:10.862800  3188 tablet_service.cc:1511] Processing CreateTablet for tablet 201b46c47dd4427db5220d8cfaf02883 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:14:10.864212  3188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 201b46c47dd4427db5220d8cfaf02883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.857884  3240 consensus_queue.cc:260] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:10.860231  3181 tablet_service.cc:1511] Processing CreateTablet for tablet d0547788d7204e17800f3e8d5ac0b20a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:14:10.866303  3181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0547788d7204e17800f3e8d5ac0b20a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.874614  3035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 921c451a21e944ff8a8e6ec22207eca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.879669  3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85059665c6234a2a8380bebb4790b5cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.879446  3186 tablet_service.cc:1511] Processing CreateTablet for tablet 921c451a21e944ff8a8e6ec22207eca3 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:14:10.874660  3242 tablet_bootstrap.cc:492] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:10.888167  3186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 921c451a21e944ff8a8e6ec22207eca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.893417  3242 tablet_bootstrap.cc:654] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:10.895710  3240 ts_tablet_manager.cc:1434] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.113s	user 0.009s	sys 0.001s
I20260709 13:14:10.901399  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:10.903020  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:14:10.904793  3091 leader_election.cc:343] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:10.905923  3091 leader_election.cc:343] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:10.911664  3241 tablet_bootstrap.cc:492] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:10.912249  3241 ts_tablet_manager.cc:1403] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.115s	user 0.012s	sys 0.007s
I20260709 13:14:10.913075  3188 tablet_service.cc:1511] Processing CreateTablet for tablet 85059665c6234a2a8380bebb4790b5cb (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:14:10.914319  3240 tablet_bootstrap.cc:492] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:10.914474  3188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85059665c6234a2a8380bebb4790b5cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.915789  3241 raft_consensus.cc:359] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:10.916635  3241 raft_consensus.cc:385] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:10.916971  3241 raft_consensus.cc:740] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:10.917419  3242 tablet_bootstrap.cc:492] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:10.917953  3242 ts_tablet_manager.cc:1403] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.004s
I20260709 13:14:10.921131  3242 raft_consensus.cc:359] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:10.921957  3242 raft_consensus.cc:385] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:10.922289  3242 raft_consensus.cc:740] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:10.931267  3240 tablet_bootstrap.cc:654] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:10.930861  3242 consensus_queue.cc:260] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:10.936484  3242 ts_tablet_manager.cc:1434] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:14:10.937640  3242 tablet_bootstrap.cc:492] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:10.939096  3116 tablet_service.cc:1511] Processing CreateTablet for tablet 85059665c6234a2a8380bebb4790b5cb (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:14:10.940915  3116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85059665c6234a2a8380bebb4790b5cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.944859  3242 tablet_bootstrap.cc:654] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:10.948364  3039 tablet_service.cc:1511] Processing CreateTablet for tablet 22edd8baac97497aad3f2c9971868c48 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:14:10.949690  3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22edd8baac97497aad3f2c9971868c48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.951529  3110 tablet_service.cc:1511] Processing CreateTablet for tablet 22edd8baac97497aad3f2c9971868c48 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:14:10.953445  3110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22edd8baac97497aad3f2c9971868c48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.955653  3036 tablet_service.cc:1511] Processing CreateTablet for tablet f12375b5613c4d08b52a1a44ccb82294 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:14:10.957152  3036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f12375b5613c4d08b52a1a44ccb82294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.953205  3186 tablet_service.cc:1511] Processing CreateTablet for tablet 22edd8baac97497aad3f2c9971868c48 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:14:10.957674  3107 tablet_service.cc:1511] Processing CreateTablet for tablet f12375b5613c4d08b52a1a44ccb82294 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:14:10.959017  3107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f12375b5613c4d08b52a1a44ccb82294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.960575  3189 tablet_service.cc:1511] Processing CreateTablet for tablet f12375b5613c4d08b52a1a44ccb82294 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:14:10.962612  3032 tablet_service.cc:1511] Processing CreateTablet for tablet e1d12e7c2ef94802ad2c1a3390fe2a8e (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:14:10.963958  3032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d12e7c2ef94802ad2c1a3390fe2a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.931838  3241 consensus_queue.cc:260] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:10.971575  3241 ts_tablet_manager.cc:1434] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.000s
I20260709 13:14:10.972807  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:14:10.974952  3090 leader_election.cc:343] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:10.975517  3090 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:10.976529  3244 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:10.977941  3249 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.978710  3249 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:10.981176  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:14:10.984392  3090 leader_election.cc:343] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:10.984899  3090 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:10.985584  3114 tablet_service.cc:1511] Processing CreateTablet for tablet e1d12e7c2ef94802ad2c1a3390fe2a8e (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:14:10.987105  3114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d12e7c2ef94802ad2c1a3390fe2a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.987638  3244 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:10.993726  3033 tablet_service.cc:1511] Processing CreateTablet for tablet f2254b0c561f4240a9199d1c203568ac (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:14:10.984915  3249 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:14:10.995347  3033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2254b0c561f4240a9199d1c203568ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.996165  3189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f12375b5613c4d08b52a1a44ccb82294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.995373  3113 tablet_service.cc:1511] Processing CreateTablet for tablet f2254b0c561f4240a9199d1c203568ac (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:14:10.999305  3113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2254b0c561f4240a9199d1c203568ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.003813  3186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22edd8baac97497aad3f2c9971868c48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.009855  3241 tablet_bootstrap.cc:492] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:11.037107  3242 tablet_bootstrap.cc:492] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:11.036646  3115 tablet_service.cc:1511] Processing CreateTablet for tablet 172fb190a0d74cd292c08c451255bae2 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:14:11.037701  3242 ts_tablet_manager.cc:1403] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.100s	user 0.005s	sys 0.026s
I20260709 13:14:11.038226  3115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172fb190a0d74cd292c08c451255bae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.039827  3036 tablet_service.cc:1511] Processing CreateTablet for tablet 172fb190a0d74cd292c08c451255bae2 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:14:11.040086  3038 tablet_service.cc:1511] Processing CreateTablet for tablet 1d72320f324f482bb7e1e27290040a3d (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:14:11.041291  3036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172fb190a0d74cd292c08c451255bae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.041932  3038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d72320f324f482bb7e1e27290040a3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.042517  3112 tablet_service.cc:1511] Processing CreateTablet for tablet e234b352c9c44269b88598c9ae245ab5 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:14:11.042845  3041 tablet_service.cc:1511] Processing CreateTablet for tablet e234b352c9c44269b88598c9ae245ab5 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:14:11.044065  3041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e234b352c9c44269b88598c9ae245ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.044065  3112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e234b352c9c44269b88598c9ae245ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.046283  3034 tablet_service.cc:1511] Processing CreateTablet for tablet 0940cf459a7741b58bd85191d095a404 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:14:11.047572  3034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0940cf459a7741b58bd85191d095a404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.058521  3109 tablet_service.cc:1511] Processing CreateTablet for tablet 0940cf459a7741b58bd85191d095a404 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:14:11.059994  3109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0940cf459a7741b58bd85191d095a404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.079375  3249 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.079910  3249 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.081825  3249 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:11.084857  3039 tablet_service.cc:1511] Processing CreateTablet for tablet 348c9fe65bc24c3caf5c132e715a13ba (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:14:11.086364  3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 348c9fe65bc24c3caf5c132e715a13ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.091338  3189 tablet_service.cc:1511] Processing CreateTablet for tablet e1d12e7c2ef94802ad2c1a3390fe2a8e (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:14:11.096321  3181 tablet_service.cc:1511] Processing CreateTablet for tablet f2254b0c561f4240a9199d1c203568ac (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:14:11.098731  3181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2254b0c561f4240a9199d1c203568ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.099771  3188 tablet_service.cc:1511] Processing CreateTablet for tablet 172fb190a0d74cd292c08c451255bae2 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:14:11.101106  3188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172fb190a0d74cd292c08c451255bae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.104637  3189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d12e7c2ef94802ad2c1a3390fe2a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.107372  3183 tablet_service.cc:1511] Processing CreateTablet for tablet 1d72320f324f482bb7e1e27290040a3d (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:14:11.109252  3183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d72320f324f482bb7e1e27290040a3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.109823  3110 tablet_service.cc:1511] Processing CreateTablet for tablet 1d72320f324f482bb7e1e27290040a3d (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:14:11.111270  3110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d72320f324f482bb7e1e27290040a3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.108239  3240 tablet_bootstrap.cc:492] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:11.114182  3240 ts_tablet_manager.cc:1403] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.200s	user 0.021s	sys 0.015s
I20260709 13:14:11.114953  3114 tablet_service.cc:1511] Processing CreateTablet for tablet 348c9fe65bc24c3caf5c132e715a13ba (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:14:11.116458  3114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 348c9fe65bc24c3caf5c132e715a13ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.119757  3241 tablet_bootstrap.cc:654] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:11.122851  3187 tablet_service.cc:1511] Processing CreateTablet for tablet e234b352c9c44269b88598c9ae245ab5 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:14:11.124212  3187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e234b352c9c44269b88598c9ae245ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.115548  3242 raft_consensus.cc:359] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.126542  3242 raft_consensus.cc:385] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:11.126899  3242 raft_consensus.cc:740] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.127751  3242 consensus_queue.cc:260] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.131175  3185 tablet_service.cc:1511] Processing CreateTablet for tablet 0940cf459a7741b58bd85191d095a404 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:14:11.132499  3185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0940cf459a7741b58bd85191d095a404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.132421  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:11.132915  3182 tablet_service.cc:1511] Processing CreateTablet for tablet 348c9fe65bc24c3caf5c132e715a13ba (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:14:11.134351  3182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 348c9fe65bc24c3caf5c132e715a13ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.134654  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:14:11.136334  3165 leader_election.cc:343] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:11.137066  3165 leader_election.cc:343] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.117123  3240 raft_consensus.cc:359] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.138809  3240 raft_consensus.cc:385] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:11.139202  3240 raft_consensus.cc:740] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.139999  3240 consensus_queue.cc:260] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.140805  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:11.142397  3248 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.142306  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:11.143038  3248 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:11.144583  3164 leader_election.cc:343] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.145081  3164 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:14:11.146365  3164 leader_election.cc:343] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.146826  3164 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:11.147837  3249 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:11.148468  3249 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:11.151582  3248 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:11.152199  3248 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.152679  3248 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.123561  3033 tablet_service.cc:1511] Processing CreateTablet for tablet a641b8a516264234af4db10b1a0610f0 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:14:11.129703  3107 tablet_service.cc:1511] Processing CreateTablet for tablet a641b8a516264234af4db10b1a0610f0 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:14:11.170984  3242 ts_tablet_manager.cc:1434] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.133s	user 0.006s	sys 0.003s
I20260709 13:14:11.180833  3186 tablet_service.cc:1511] Processing CreateTablet for tablet a641b8a516264234af4db10b1a0610f0 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:14:11.182608  3186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a641b8a516264234af4db10b1a0610f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.178757  3240 ts_tablet_manager.cc:1434] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.064s	user 0.002s	sys 0.005s
W20260709 13:14:11.193595  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 47263.5us
I20260709 13:14:11.207947  3242 tablet_bootstrap.cc:492] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:11.209092  3248 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:11.209662  3248 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.209924  3113 tablet_service.cc:1511] Processing CreateTablet for tablet 4b91597ece9742ebad558605a654e02a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:14:11.210192  3248 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.210726  3184 tablet_service.cc:1511] Processing CreateTablet for tablet 4b91597ece9742ebad558605a654e02a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:14:11.212100  3184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b91597ece9742ebad558605a654e02a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.212423  3248 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:11.213061  3112 tablet_service.cc:1511] Processing CreateTablet for tablet 7480597af1f341178e465e8723f7320e (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:14:11.213791  3240 tablet_bootstrap.cc:492] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:11.202239  3033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a641b8a516264234af4db10b1a0610f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.209806  3181 tablet_service.cc:1511] Processing CreateTablet for tablet 7480597af1f341178e465e8723f7320e (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:14:11.229950  3107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a641b8a516264234af4db10b1a0610f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.229372  3181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7480597af1f341178e465e8723f7320e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.234218  3112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7480597af1f341178e465e8723f7320e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.242214  3244 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.249191  3113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b91597ece9742ebad558605a654e02a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.248471  3244 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.255573  3244 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:11.255650  3109 tablet_service.cc:1511] Processing CreateTablet for tablet 6e540d8ab4d64f8c8fd8c432fbc5ac3a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:14:11.262037  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:11.262933  3242 tablet_bootstrap.cc:654] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:11.262955  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:14:11.264899  3090 leader_election.cc:343] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.276490  3187 tablet_service.cc:1511] Processing CreateTablet for tablet 1e1474206f8d49e58df15541f5a5725e (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:14:11.278069  3187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e1474206f8d49e58df15541f5a5725e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.282179  3110 tablet_service.cc:1511] Processing CreateTablet for tablet 1e1474206f8d49e58df15541f5a5725e (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:14:11.262825  3050 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:11.284085  3244 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.295230  3244 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.296957  3116 tablet_service.cc:1511] Processing CreateTablet for tablet 1247b6af0f274b8c9d99b6be2d7fbc6b (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:14:11.290732  3109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e540d8ab4d64f8c8fd8c432fbc5ac3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.305474  3116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1247b6af0f274b8c9d99b6be2d7fbc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.301164  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:11.307359  3240 tablet_bootstrap.cc:654] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:11.316408  3115 tablet_service.cc:1511] Processing CreateTablet for tablet 44281a32716140bc805b71db0e071122 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:14:11.300225  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:11.307678  3241 tablet_bootstrap.cc:492] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:11.318739  3241 ts_tablet_manager.cc:1403] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.313s	user 0.021s	sys 0.013s
I20260709 13:14:11.320083  3038 tablet_service.cc:1511] Processing CreateTablet for tablet 1e1474206f8d49e58df15541f5a5725e (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260709 13:14:11.321307  3090 leader_election.cc:343] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.297631  3244 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:11.300637  3091 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:11.303117  3188 tablet_service.cc:1511] Processing CreateTablet for tablet 6e540d8ab4d64f8c8fd8c432fbc5ac3a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:14:11.322878  3188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e540d8ab4d64f8c8fd8c432fbc5ac3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.323102  3244 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:11.323553  3244 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:11.323909  3244 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:11.324486  3041 tablet_service.cc:1511] Processing CreateTablet for tablet 1247b6af0f274b8c9d99b6be2d7fbc6b (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 13:14:11.322898  3091 leader_election.cc:343] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.326058  3108 tablet_service.cc:1511] Processing CreateTablet for tablet 5278ab37d43548b39aed98352e8b9e31 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:14:11.326354  3091 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:11.309707  3110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e1474206f8d49e58df15541f5a5725e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.327862  3108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5278ab37d43548b39aed98352e8b9e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.310142  3039 tablet_service.cc:1511] Processing CreateTablet for tablet 4b91597ece9742ebad558605a654e02a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:14:11.311053  3036 tablet_service.cc:1511] Processing CreateTablet for tablet 6e540d8ab4d64f8c8fd8c432fbc5ac3a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:14:11.330049  3115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44281a32716140bc805b71db0e071122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.312317  3182 tablet_service.cc:1511] Processing CreateTablet for tablet 1247b6af0f274b8c9d99b6be2d7fbc6b (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:14:11.332201  3182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1247b6af0f274b8c9d99b6be2d7fbc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.331998  3034 tablet_service.cc:1511] Processing CreateTablet for tablet 44281a32716140bc805b71db0e071122 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:14:11.321555  3038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e1474206f8d49e58df15541f5a5725e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.334278  3041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1247b6af0f274b8c9d99b6be2d7fbc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.335115  3036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e540d8ab4d64f8c8fd8c432fbc5ac3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.338105  3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b91597ece9742ebad558605a654e02a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.343276  3034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44281a32716140bc805b71db0e071122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.344626  3244 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.354254  3241 raft_consensus.cc:359] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.355187  3241 raft_consensus.cc:385] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:11.355571  3241 raft_consensus.cc:740] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.356436  3241 consensus_queue.cc:260] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.358882  3189 tablet_service.cc:1511] Processing CreateTablet for tablet 44281a32716140bc805b71db0e071122 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:14:11.360339  3189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44281a32716140bc805b71db0e071122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.360205  3184 tablet_service.cc:1511] Processing CreateTablet for tablet 5278ab37d43548b39aed98352e8b9e31 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:14:11.361424  3184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5278ab37d43548b39aed98352e8b9e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.365788  3241 ts_tablet_manager.cc:1434] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.002s
I20260709 13:14:11.380383  3241 tablet_bootstrap.cc:492] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:11.384527  3242 tablet_bootstrap.cc:492] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:11.384884  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:11.385558  3033 tablet_service.cc:1511] Processing CreateTablet for tablet 7480597af1f341178e465e8723f7320e (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 13:14:11.386394  3090 leader_election.cc:343] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.387101  3033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7480597af1f341178e465e8723f7320e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.391115  3032 tablet_service.cc:1511] Processing CreateTablet for tablet 5278ab37d43548b39aed98352e8b9e31 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:14:11.392225  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:11.392803  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:11.385102  3242 ts_tablet_manager.cc:1403] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.179s	user 0.016s	sys 0.004s
I20260709 13:14:11.392474  3032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5278ab37d43548b39aed98352e8b9e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.394090  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:11.393704  3035 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe8825ca0db45529c5a46ef6e9ba53d (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:14:11.394423  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:11.397225  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:11.398316  3244 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:11.394620  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:11.416906  3125 raft_consensus.cc:2393] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 1: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:11.416891  3035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe8825ca0db45529c5a46ef6e9ba53d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.424419  3188 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe8825ca0db45529c5a46ef6e9ba53d (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:14:11.425273  3110 tablet_service.cc:1511] Processing CreateTablet for tablet 5d96dfe3b4fa4acbb1aac261f7ebf5ea (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:14:11.425885  3188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe8825ca0db45529c5a46ef6e9ba53d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.426671  3110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d96dfe3b4fa4acbb1aac261f7ebf5ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.426710  3116 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe8825ca0db45529c5a46ef6e9ba53d (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:14:11.416607  3126 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
W20260709 13:14:11.415169  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 92305us
I20260709 13:14:11.417109  3244 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:11.432894  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:11.433480  3050 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:11.440308  3050 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:11.443506  3185 tablet_service.cc:1511] Processing CreateTablet for tablet 5d96dfe3b4fa4acbb1aac261f7ebf5ea (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:14:11.443784  3091 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:11.444882  3185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d96dfe3b4fa4acbb1aac261f7ebf5ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.448072  3114 tablet_service.cc:1511] Processing CreateTablet for tablet 6707728696274f8cbf107e2a9fd20a2a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:14:11.448659  3242 raft_consensus.cc:359] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.451011  3183 tablet_service.cc:1511] Processing CreateTablet for tablet 6707728696274f8cbf107e2a9fd20a2a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:14:11.452313  3183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6707728696274f8cbf107e2a9fd20a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.454033  3244 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:11.454543  3244 raft_consensus.cc:697] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:11.455359  3244 consensus_queue.cc:237] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:11.428022  3015 leader_election.cc:343] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:11.458300  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 49170.5us
W20260709 13:14:11.459043  3015 leader_election.cc:343] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.459474  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:11.460476  3265 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:11.462139  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:11.463999  3186 tablet_service.cc:1511] Processing CreateTablet for tablet 01dd1f72eb8249a6adadee5f3509bcc2 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:14:11.465180  3186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01dd1f72eb8249a6adadee5f3509bcc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.465981  3265 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:11.466408  3265 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:11.466758  3265 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:11.475322  3248 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.476027  3248 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.449527  3242 raft_consensus.cc:385] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:11.477982  3242 raft_consensus.cc:740] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.429250  3116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe8825ca0db45529c5a46ef6e9ba53d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.480053  3114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6707728696274f8cbf107e2a9fd20a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.488967  3108 tablet_service.cc:1511] Processing CreateTablet for tablet 01dd1f72eb8249a6adadee5f3509bcc2 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:14:11.498358  3248 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:11.501929  3115 tablet_service.cc:1511] Processing CreateTablet for tablet ca4522a8737341bf9c2cb35d3d54f23b (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:14:11.504287  3265 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.505280  3111 tablet_service.cc:1511] Processing CreateTablet for tablet 4b83202a913e45d5830d2ecdfb5354c2 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:14:11.506521  3265 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:11.510066  3242 consensus_queue.cc:260] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.512532  3242 ts_tablet_manager.cc:1434] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.112s	user 0.003s	sys 0.005s
I20260709 13:14:11.514256  3108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01dd1f72eb8249a6adadee5f3509bcc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.518637  3111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b83202a913e45d5830d2ecdfb5354c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.518844  3036 tablet_service.cc:1511] Processing CreateTablet for tablet 5d96dfe3b4fa4acbb1aac261f7ebf5ea (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:14:11.520270  3036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d96dfe3b4fa4acbb1aac261f7ebf5ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.523283  3034 tablet_service.cc:1511] Processing CreateTablet for tablet 6707728696274f8cbf107e2a9fd20a2a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:14:11.524739  3034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6707728696274f8cbf107e2a9fd20a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.526923  3038 tablet_service.cc:1511] Processing CreateTablet for tablet 01dd1f72eb8249a6adadee5f3509bcc2 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:14:11.531762  3183 tablet_service.cc:1511] Processing CreateTablet for tablet ca4522a8737341bf9c2cb35d3d54f23b (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:14:11.532541  3240 tablet_bootstrap.cc:492] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:11.533113  3240 ts_tablet_manager.cc:1403] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.320s	user 0.018s	sys 0.016s
I20260709 13:14:11.533233  3183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca4522a8737341bf9c2cb35d3d54f23b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.536684  3240 raft_consensus.cc:359] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.521555  3184 tablet_service.cc:1511] Processing CreateTablet for tablet 4b83202a913e45d5830d2ecdfb5354c2 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:14:11.541181  3038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01dd1f72eb8249a6adadee5f3509bcc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.543279  3241 tablet_bootstrap.cc:654] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:11.550146  3184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b83202a913e45d5830d2ecdfb5354c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.554955  3181 tablet_service.cc:1511] Processing CreateTablet for tablet cf43b3ddced94b0395a3a79080ce0ed5 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:14:11.556639  3181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf43b3ddced94b0395a3a79080ce0ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.556967  3037 tablet_service.cc:1511] Processing CreateTablet for tablet cf43b3ddced94b0395a3a79080ce0ed5 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:14:11.557423  3040 tablet_service.cc:1511] Processing CreateTablet for tablet 9c2f28b50c354b648096e08cf4f5d54a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:14:11.558318  3037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf43b3ddced94b0395a3a79080ce0ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.558081  3107 tablet_service.cc:1511] Processing CreateTablet for tablet cf43b3ddced94b0395a3a79080ce0ed5 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:14:11.559044  3040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c2f28b50c354b648096e08cf4f5d54a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:11.564256  3015 leader_election.cc:343] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.564822  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:11.565706  3248 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:11.566184  3015 leader_election.cc:343] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.567111  3032 tablet_service.cc:1511] Processing CreateTablet for tablet 4b83202a913e45d5830d2ecdfb5354c2 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:14:11.568296  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:11.569149  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:11.570055  2949 catalog_manager.cc:5697] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:11.572288  3113 tablet_service.cc:1511] Processing CreateTablet for tablet 9c2f28b50c354b648096e08cf4f5d54a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:14:11.573470  3115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca4522a8737341bf9c2cb35d3d54f23b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.581220  3186 tablet_service.cc:1511] Processing CreateTablet for tablet 9c2f28b50c354b648096e08cf4f5d54a (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:14:11.537580  3240 raft_consensus.cc:385] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:11.586022  3186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c2f28b50c354b648096e08cf4f5d54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.577615  3242 tablet_bootstrap.cc:492] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:11.584494  3240 raft_consensus.cc:740] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.600788  3107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf43b3ddced94b0395a3a79080ce0ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.604470  3112 tablet_service.cc:1511] Processing CreateTablet for tablet 006a17784d3e4b139686bca788cab915 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:14:11.616755  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:11.617372  3126 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:11.617305  3186 tablet_service.cc:1511] Processing CreateTablet for tablet 006a17784d3e4b139686bca788cab915 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:14:11.618726  3186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006a17784d3e4b139686bca788cab915. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:11.619205  2997 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:11.618971  3110 tablet_service.cc:1511] Processing CreateTablet for tablet bbb23f9b807d45969a33e8f37691eff6 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:14:11.622754  3240 consensus_queue.cc:260] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.624248  3187 tablet_service.cc:1511] Processing CreateTablet for tablet bbb23f9b807d45969a33e8f37691eff6 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:14:11.624846  3126 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:11.625339  3240 ts_tablet_manager.cc:1434] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.003s
I20260709 13:14:11.625725  3187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb23f9b807d45969a33e8f37691eff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.632714  3111 tablet_service.cc:1511] Processing CreateTablet for tablet 0ee6c4dbcb7b45729d4e2bdcc3a09297 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:14:11.612838  3112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006a17784d3e4b139686bca788cab915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.635607  3113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c2f28b50c354b648096e08cf4f5d54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.637112  3032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b83202a913e45d5830d2ecdfb5354c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.639426  3110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb23f9b807d45969a33e8f37691eff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.643508  3039 tablet_service.cc:1511] Processing CreateTablet for tablet ca4522a8737341bf9c2cb35d3d54f23b (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:14:11.654675  3188 tablet_service.cc:1511] Processing CreateTablet for tablet 0ee6c4dbcb7b45729d4e2bdcc3a09297 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:14:11.656440  3188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ee6c4dbcb7b45729d4e2bdcc3a09297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.645499  3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca4522a8737341bf9c2cb35d3d54f23b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.678213  3240 tablet_bootstrap.cc:492] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:11.678287  3111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ee6c4dbcb7b45729d4e2bdcc3a09297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.681339  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:11.683102  3037 tablet_service.cc:1511] Processing CreateTablet for tablet 006a17784d3e4b139686bca788cab915 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:14:11.685034  3037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006a17784d3e4b139686bca788cab915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.687528  3035 tablet_service.cc:1511] Processing CreateTablet for tablet bbb23f9b807d45969a33e8f37691eff6 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:14:11.687800  3041 tablet_service.cc:1511] Processing CreateTablet for tablet 0ee6c4dbcb7b45729d4e2bdcc3a09297 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:14:11.689138  3035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb23f9b807d45969a33e8f37691eff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.691479  3041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ee6c4dbcb7b45729d4e2bdcc3a09297. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:11.714530  2934 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 80078us
I20260709 13:14:11.735873  3242 tablet_bootstrap.cc:654] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:11.738160  3240 tablet_bootstrap.cc:654] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:11.745870  3015 leader_election.cc:343] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.752931  3241 tablet_bootstrap.cc:492] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:11.753556  3241 ts_tablet_manager.cc:1403] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.373s	user 0.008s	sys 0.012s
I20260709 13:14:11.761152  3241 raft_consensus.cc:359] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.762003  3241 raft_consensus.cc:385] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:11.762318  3241 raft_consensus.cc:740] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.763461  3241 consensus_queue.cc:260] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.769994  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:11.771898  3263 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.771720  3108 tablet_service.cc:1511] Processing CreateTablet for tablet 24410f20507a4acf874cdb6e84c306f6 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:14:11.772418  3263 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.773226  3108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24410f20507a4acf874cdb6e84c306f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.775785  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:11.776479  3126 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:11.777833  3164 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:11.778437  3263 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:11.778719  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:11.779107  3263 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:11.779453  3050 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:11.779623  3263 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:11.780102  3263 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:11.780752  3265 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:11.781981  3265 raft_consensus.cc:697] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:11.782910  3265 consensus_queue.cc:237] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:11.786114  3015 leader_election.cc:343] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.786636  3015 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:11.787478  3248 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:11.787298  3184 tablet_service.cc:1511] Processing CreateTablet for tablet 24410f20507a4acf874cdb6e84c306f6 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 13:14:11.787914  3015 leader_election.cc:343] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:11.788956  3184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24410f20507a4acf874cdb6e84c306f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.798755  3036 tablet_service.cc:1511] Processing CreateTablet for tablet 24410f20507a4acf874cdb6e84c306f6 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:14:11.800472  3036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24410f20507a4acf874cdb6e84c306f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.816797  3241 ts_tablet_manager.cc:1434] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:14:11.818014  3241 tablet_bootstrap.cc:492] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:11.822749  3263 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.828193  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:11.829802  3050 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:11.832037  3263 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:11.839093  3034 tablet_service.cc:1511] Processing CreateTablet for tablet a1ccbbf27f0b436d8c79dfb6db7fc703 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:14:11.840592  3034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ccbbf27f0b436d8c79dfb6db7fc703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.841216  3041 tablet_service.cc:1511] Processing CreateTablet for tablet f9bcd8873c04459f9a1652eaf201375c (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:14:11.842973  3041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9bcd8873c04459f9a1652eaf201375c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.844697  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:11.845322  3126 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:11.846879  3038 tablet_service.cc:1511] Processing CreateTablet for tablet 1b0bf95c7c28416eb4a727eac91af0d0 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:14:11.848322  3038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b0bf95c7c28416eb4a727eac91af0d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.851682  3050 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:11.853201  3165 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:11.854313  3263 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:11.854873  3263 raft_consensus.cc:697] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:11.855885  3263 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.859665  3116 tablet_service.cc:1511] Processing CreateTablet for tablet a1ccbbf27f0b436d8c79dfb6db7fc703 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:14:11.861171  3116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ccbbf27f0b436d8c79dfb6db7fc703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.861213  3181 tablet_service.cc:1511] Processing CreateTablet for tablet a1ccbbf27f0b436d8c79dfb6db7fc703 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:14:11.862762  3181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ccbbf27f0b436d8c79dfb6db7fc703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.863076  3039 tablet_service.cc:1511] Processing CreateTablet for tablet a2dc1155b33b4fbc830d189f5e109f78 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:14:11.863740  3107 tablet_service.cc:1511] Processing CreateTablet for tablet f9bcd8873c04459f9a1652eaf201375c (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:14:11.864420  3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2dc1155b33b4fbc830d189f5e109f78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.865144  3107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9bcd8873c04459f9a1652eaf201375c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.866796  3111 tablet_service.cc:1511] Processing CreateTablet for tablet 1b0bf95c7c28416eb4a727eac91af0d0 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:14:11.867199  3275 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.868327  3111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b0bf95c7c28416eb4a727eac91af0d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.867831  3275 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.871169  3186 tablet_service.cc:1511] Processing CreateTablet for tablet 1b0bf95c7c28416eb4a727eac91af0d0 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:14:11.872469  3186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b0bf95c7c28416eb4a727eac91af0d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.866796  3183 tablet_service.cc:1511] Processing CreateTablet for tablet f9bcd8873c04459f9a1652eaf201375c (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:14:11.896585  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:11.896762  3126 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:11.899185  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:11.900113  3125 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 1: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:11.902354  3165 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:11.893497  3275 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:11.903798  3275 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:11.906447  3113 tablet_service.cc:1511] Processing CreateTablet for tablet a2dc1155b33b4fbc830d189f5e109f78 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:14:11.907327  3036 tablet_service.cc:1511] Processing CreateTablet for tablet e7ddfa6bafce4dcab37f071b34290125 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:14:11.909106  3036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ddfa6bafce4dcab37f071b34290125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.914170  3183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9bcd8873c04459f9a1652eaf201375c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.908034  3113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2dc1155b33b4fbc830d189f5e109f78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.918398  3240 tablet_bootstrap.cc:492] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:11.918921  3240 ts_tablet_manager.cc:1403] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.241s	user 0.025s	sys 0.011s
I20260709 13:14:11.922477  3240 raft_consensus.cc:359] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.923348  3240 raft_consensus.cc:385] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:11.923681  3240 raft_consensus.cc:740] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.927639  3187 tablet_service.cc:1511] Processing CreateTablet for tablet a2dc1155b33b4fbc830d189f5e109f78 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:14:11.929031  3187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2dc1155b33b4fbc830d189f5e109f78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.936777  3241 tablet_bootstrap.cc:654] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:11.947220  3242 tablet_bootstrap.cc:492] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:11.947813  3242 ts_tablet_manager.cc:1403] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.371s	user 0.013s	sys 0.011s
I20260709 13:14:11.950574  3242 raft_consensus.cc:359] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.951117  3242 raft_consensus.cc:385] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:11.951313  3242 raft_consensus.cc:740] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.951944  3242 consensus_queue.cc:260] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:11.955058  3242 ts_tablet_manager.cc:1434] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:14:11.956200  3242 tablet_bootstrap.cc:492] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:11.917520  3275 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:11.964330  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 62083.2us
I20260709 13:14:11.987846  3111 tablet_service.cc:1511] Processing CreateTablet for tablet e7ddfa6bafce4dcab37f071b34290125 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:14:11.988399  2948 catalog_manager.cc:5697] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 0 to 1, leader changed from <none> to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:11.990303  3111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ddfa6bafce4dcab37f071b34290125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.958618  3240 consensus_queue.cc:260] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:12.001199  3090 consensus_peers.cc:597] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:12.001690  3181 tablet_service.cc:1511] Processing CreateTablet for tablet e7ddfa6bafce4dcab37f071b34290125 (DEFAULT_TABLE table=test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:14:12.002182  3244 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.002825  3244 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.006503  3244 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.006682  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:12.008208  3181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ddfa6bafce4dcab37f071b34290125. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:12.008710  3091 leader_election.cc:343] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.010185  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:14:12.011665  3090 leader_election.cc:343] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.012161  3090 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:12.013413  3244 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:11.996161  2946 catalog_manager.cc:5697] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 0 to 1, leader changed from <none> to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:12.017925  3240 ts_tablet_manager.cc:1434] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.001s
I20260709 13:14:12.019109  3240 tablet_bootstrap.cc:492] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:12.030027  3242 tablet_bootstrap.cc:654] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.033783  3240 tablet_bootstrap.cc:654] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.035135  3241 tablet_bootstrap.cc:492] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:12.035678  3241 ts_tablet_manager.cc:1403] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.218s	user 0.021s	sys 0.029s
I20260709 13:14:12.041365  3241 raft_consensus.cc:359] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.042249  3241 raft_consensus.cc:385] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.042603  3241 raft_consensus.cc:740] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.043429  3241 consensus_queue.cc:260] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.046074  3241 ts_tablet_manager.cc:1434] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.004s
I20260709 13:14:12.047168  3241 tablet_bootstrap.cc:492] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:12.066358  3241 tablet_bootstrap.cc:654] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.070335  3242 tablet_bootstrap.cc:492] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:12.072894  3242 ts_tablet_manager.cc:1403] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.117s	user 0.013s	sys 0.002s
I20260709 13:14:12.076743  3242 raft_consensus.cc:359] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.077626  3242 raft_consensus.cc:385] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.077495  3244 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:12.078029  3240 tablet_bootstrap.cc:492] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:12.078117  3242 raft_consensus.cc:740] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.078599  3240 ts_tablet_manager.cc:1403] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.060s	user 0.006s	sys 0.012s
I20260709 13:14:12.079398  3241 tablet_bootstrap.cc:492] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:12.079169  3242 consensus_queue.cc:260] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.079955  3241 ts_tablet_manager.cc:1403] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.003s
I20260709 13:14:12.082042  3240 raft_consensus.cc:359] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.083209  3240 raft_consensus.cc:385] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.083829  3241 raft_consensus.cc:359] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.084735  3241 raft_consensus.cc:385] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.084975  3242 ts_tablet_manager.cc:1434] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:14:12.085150  3241 raft_consensus.cc:740] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.086145  3242 tablet_bootstrap.cc:492] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:12.086148  3241 consensus_queue.cc:260] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.088979  3241 ts_tablet_manager.cc:1434] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:14:12.083590  3240 raft_consensus.cc:740] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.090751  3240 consensus_queue.cc:260] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.094584  3241 tablet_bootstrap.cc:492] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:12.105540  3241 tablet_bootstrap.cc:654] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.105788  3240 ts_tablet_manager.cc:1434] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.003s
I20260709 13:14:12.107421  3240 tablet_bootstrap.cc:492] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:12.108767  3242 tablet_bootstrap.cc:654] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.118108  3241 tablet_bootstrap.cc:492] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:12.118638  3241 ts_tablet_manager.cc:1403] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.006s
I20260709 13:14:12.118964  3242 tablet_bootstrap.cc:492] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:12.119451  3242 ts_tablet_manager.cc:1403] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.004s
I20260709 13:14:12.121685  3241 raft_consensus.cc:359] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.122026  3242 raft_consensus.cc:359] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.122535  3241 raft_consensus.cc:385] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.122684  3242 raft_consensus.cc:385] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.122898  3241 raft_consensus.cc:740] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.122995  3242 raft_consensus.cc:740] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.123886  3242 consensus_queue.cc:260] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.123886  3241 consensus_queue.cc:260] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.126469  3241 ts_tablet_manager.cc:1434] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.006s
I20260709 13:14:12.128463  3240 tablet_bootstrap.cc:654] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.133018  3241 tablet_bootstrap.cc:492] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:12.140347  3241 tablet_bootstrap.cc:654] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.133034  3242 ts_tablet_manager.cc:1434] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:14:12.147980  3242 tablet_bootstrap.cc:492] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:12.152139  3265 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.153007  3265 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.156226  3240 tablet_bootstrap.cc:492] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:12.156888  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:12.158241  3240 ts_tablet_manager.cc:1403] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.009s
I20260709 13:14:12.158212  3125 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:12.159917  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:12.160867  3248 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.161302  3248 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.161682  3248 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.161469  3240 raft_consensus.cc:359] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.162618  3240 raft_consensus.cc:385] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.163116  3240 raft_consensus.cc:740] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.163913  3240 consensus_queue.cc:260] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.165674  3242 tablet_bootstrap.cc:654] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.166518  3240 ts_tablet_manager.cc:1434] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:12.167737  3240 tablet_bootstrap.cc:492] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:12.173652  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:12.174621  3248 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.174968  3198 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:12.176430  3240 tablet_bootstrap.cc:654] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.176569  3265 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.178478  3241 tablet_bootstrap.cc:492] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:12.178990  3241 ts_tablet_manager.cc:1403] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.003s
I20260709 13:14:12.185259  3265 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:12.192236  3248 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.192468  3242 tablet_bootstrap.cc:492] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:12.193248  3240 tablet_bootstrap.cc:492] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:12.193286  3242 ts_tablet_manager.cc:1403] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.021s
I20260709 13:14:12.193804  3240 ts_tablet_manager.cc:1403] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.011s
I20260709 13:14:12.195636  3241 raft_consensus.cc:359] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.196110  3240 raft_consensus.cc:359] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.196400  3241 raft_consensus.cc:385] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.196781  3240 raft_consensus.cc:385] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.196480  3242 raft_consensus.cc:359] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.197263  3240 raft_consensus.cc:740] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.197454  3242 raft_consensus.cc:385] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.197960  3242 raft_consensus.cc:740] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.198518  3240 consensus_queue.cc:260] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.199012  3242 consensus_queue.cc:260] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.200683  3240 ts_tablet_manager.cc:1434] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:14:12.201269  3242 ts_tablet_manager.cc:1434] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:14:12.201371  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:12.201900  3240 tablet_bootstrap.cc:492] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:12.202037  3125 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.205312  3242 tablet_bootstrap.cc:492] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:12.196841  3241 raft_consensus.cc:740] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.208588  3240 tablet_bootstrap.cc:654] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.209165  3241 consensus_queue.cc:260] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.210685  3125 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:12.212875  3280 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.213392  3280 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.214591  3241 ts_tablet_manager.cc:1434] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:14:12.215631  3241 tablet_bootstrap.cc:492] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:12.217008  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:12.219101  3240 tablet_bootstrap.cc:492] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:12.219178  3280 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:12.219416  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:12.219815  3240 ts_tablet_manager.cc:1403] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.006s
I20260709 13:14:12.221815  3241 tablet_bootstrap.cc:654] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.222430  3240 raft_consensus.cc:359] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.223291  3240 raft_consensus.cc:385] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.223675  3240 raft_consensus.cc:740] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.224629  3240 consensus_queue.cc:260] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.226928  3242 tablet_bootstrap.cc:654] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.227247  3240 ts_tablet_manager.cc:1434] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:14:12.228359  3240 tablet_bootstrap.cc:492] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:12.236538  3165 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:12.237362  3275 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.237994  3244 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.237890  3275 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.238497  3244 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.240118  3275 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:12.240657  3275 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:12.242894  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:12.243552  3198 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:12.243815  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:12.244508  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:12.244781  3050 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:12.245128  3200 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.245078  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:12.245855  3051 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:12.248296  3165 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:12.249207  3090 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:12.253263  3292 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.253696  3240 tablet_bootstrap.cc:654] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.251972  3244 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.251209  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:12.253665  3292 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.257332  3292 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.258526  3248 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.259057  3248 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.261029  3242 tablet_bootstrap.cc:492] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:12.261513  3242 ts_tablet_manager.cc:1403] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.025s
I20260709 13:14:12.262686  3240 tablet_bootstrap.cc:492] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:12.261374  3248 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.263168  3240 ts_tablet_manager.cc:1403] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.006s
I20260709 13:14:12.257349  3200 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:12.265473  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:12.252063  3275 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.266023  3240 raft_consensus.cc:359] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.266819  3240 raft_consensus.cc:385] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.266333  3124 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:12.267261  3240 raft_consensus.cc:740] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.266856  3263 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.267041  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:12.267825  3263 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.266436  3275 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.268313  3263 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.269040  3242 raft_consensus.cc:359] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.269833  3242 raft_consensus.cc:385] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.270123  3242 raft_consensus.cc:740] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.271028  3242 consensus_queue.cc:260] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.273222  3242 ts_tablet_manager.cc:1434] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:14:12.274214  3242 tablet_bootstrap.cc:492] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:12.276997  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:12.277099  3292 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.277863  3124 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:12.278657  3126 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 1: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:12.279191  3164 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:12.280972  3242 tablet_bootstrap.cc:654] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.282112  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:14:12.284133  3165 leader_election.cc:343] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.267402  3280 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:12.289129  3275 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:12.285420  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:12.290472  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:12.291219  3248 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:12.292582  3248 raft_consensus.cc:697] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:12.293058  3306 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.293567  3306 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.293984  3306 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.293834  3248 consensus_queue.cc:237] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.296561  3241 tablet_bootstrap.cc:492] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:12.297857  3241 ts_tablet_manager.cc:1403] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.082s	user 0.017s	sys 0.006s
W20260709 13:14:12.299760  3015 leader_election.cc:343] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.300056  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:12.300743  3050 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.288652  3263 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.287645  3304 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.304564  3304 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.304939  3304 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.305188  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:12.306015  3124 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 1: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:12.304376  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:12.309026  3164 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:12.307204  3241 raft_consensus.cc:359] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.310212  3241 raft_consensus.cc:385] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.310570  3263 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:12.310460  3280 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:12.268069  3240 consensus_queue.cc:260] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.309530  3050 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:12.311977  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:12.312661  3240 ts_tablet_manager.cc:1434] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:14:12.312884  3200 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 1: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:14:12.310519  3241 raft_consensus.cc:740] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.313922  3240 tablet_bootstrap.cc:492] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:12.314393  3292 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.314201  3091 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:12.314581  3241 consensus_queue.cc:260] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.319734  3280 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:12.320089  3304 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.323091  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:14:12.324548  3165 leader_election.cc:343] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.324661  3244 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:12.327371  3240 tablet_bootstrap.cc:654] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.324934  3241 ts_tablet_manager.cc:1434] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:14:12.327471  3304 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:12.331928  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:12.332615  3125 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.334017  3242 tablet_bootstrap.cc:492] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:12.334081  3241 tablet_bootstrap.cc:492] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:12.334611  3242 ts_tablet_manager.cc:1403] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.016s
I20260709 13:14:12.338140  3242 raft_consensus.cc:359] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.338899  3242 raft_consensus.cc:385] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.339279  3242 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.342142  3306 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.344770  3242 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.346400  3241 tablet_bootstrap.cc:654] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.346796  2949 catalog_manager.cc:5697] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 0 to 1, leader changed from <none> to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:12.350620  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:12.351343  3123 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.351400  3125 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:12.352633  3164 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:12.354085  3304 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:12.354622  3304 raft_consensus.cc:697] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:12.355561  3304 consensus_queue.cc:237] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.360129  3307 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.360867  3307 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.363036  3244 raft_consensus.cc:697] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:12.364092  3244 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.366178  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:14:12.367792  3015 leader_election.cc:343] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.368471  3307 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.370905  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:12.371596  3200 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.374544  3240 tablet_bootstrap.cc:492] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:12.375026  3240 ts_tablet_manager.cc:1403] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.061s	user 0.023s	sys 0.005s
I20260709 13:14:12.376379  3241 tablet_bootstrap.cc:492] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:12.376866  3241 ts_tablet_manager.cc:1403] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.006s
I20260709 13:14:12.377700  3240 raft_consensus.cc:359] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.378396  3240 raft_consensus.cc:385] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.378691  3240 raft_consensus.cc:740] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.379467  3200 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:12.379297  3240 consensus_queue.cc:260] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.379786  3241 raft_consensus.cc:359] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.380483  3241 raft_consensus.cc:385] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.380805  3241 raft_consensus.cc:740] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.380862  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:12.381899  3307 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:12.381503  3241 consensus_queue.cc:260] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.382421  3307 raft_consensus.cc:697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:12.382751  3198 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.383337  3307 consensus_queue.cc:237] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.384027  3241 ts_tablet_manager.cc:1434] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:12.384990  3241 tablet_bootstrap.cc:492] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:12.347236  3242 ts_tablet_manager.cc:1434] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:14:12.388836  3242 tablet_bootstrap.cc:492] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:12.390820  3241 tablet_bootstrap.cc:654] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.392071  3123 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:12.393241  3306 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.394127  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:14:12.401659  3015 leader_election.cc:343] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.405241  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:12.408159  3265 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:12.413358  3240 ts_tablet_manager.cc:1434] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.004s
I20260709 13:14:12.413133  2948 catalog_manager.cc:5697] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:12.414014  3265 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:12.428483  3240 tablet_bootstrap.cc:492] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:12.418385  3242 tablet_bootstrap.cc:654] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.438203  3240 tablet_bootstrap.cc:654] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.442030  3242 tablet_bootstrap.cc:492] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:12.442782  3242 ts_tablet_manager.cc:1403] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.000s
I20260709 13:14:12.444945  3241 tablet_bootstrap.cc:492] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:12.445317  3242 raft_consensus.cc:359] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.445467  3241 ts_tablet_manager.cc:1403] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.061s	user 0.036s	sys 0.023s
I20260709 13:14:12.448812  3241 raft_consensus.cc:359] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.449535  3242 raft_consensus.cc:385] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.449555  3241 raft_consensus.cc:385] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.450006  3242 raft_consensus.cc:740] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.450142  3241 raft_consensus.cc:740] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.449230  2949 catalog_manager.cc:5697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 0 to 1, leader changed from <none> to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:12.450867  3242 consensus_queue.cc:260] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.451092  3241 consensus_queue.cc:260] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.453166  3241 ts_tablet_manager.cc:1434] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:14:12.454276  3241 tablet_bootstrap.cc:492] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:12.453168  3242 ts_tablet_manager.cc:1434] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:14:12.455519  3242 tablet_bootstrap.cc:492] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:12.459432  3240 tablet_bootstrap.cc:492] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:12.459908  3265 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.460682  3241 tablet_bootstrap.cc:654] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.460395  3265 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.461016  3304 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.461547  3304 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.463414  3265 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.463764  3304 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:12.464562  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:12.464972  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:12.459923  3240 ts_tablet_manager.cc:1403] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.004s
W20260709 13:14:12.466181  3165 leader_election.cc:343] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:12.466300  3015 leader_election.cc:343] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.467537  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:12.468461  3125 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:12.469391  3242 tablet_bootstrap.cc:654] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.469866  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:12.470877  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:12.471261  3265 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.471568  3125 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:12.471704  3265 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.472093  3265 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.472774  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:12.475338  3275 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.475749  3275 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.476114  3275 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.477898  3241 tablet_bootstrap.cc:492] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:12.478039  3304 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.478832  3304 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.480361  3265 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.469429  2946 catalog_manager.cc:5697] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 0 to 1, leader changed from <none> to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:12.483302  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:12.484274  3051 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:12.484817  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:14:12.486327  3015 leader_election.cc:343] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.486289  3165 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:12.487134  3265 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.487840  3280 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.488263  3280 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.483348  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:12.488680  3280 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.488749  3240 raft_consensus.cc:359] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.489172  3125 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.489501  3240 raft_consensus.cc:385] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.490600  3304 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:12.491420  3240 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.492754  3240 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.493794  3241 ts_tablet_manager.cc:1403] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.001s
I20260709 13:14:12.494863  3240 ts_tablet_manager.cc:1434] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:14:12.502998  3240 tablet_bootstrap.cc:492] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:12.496521  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:12.504233  3123 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:12.487819  3275 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.505940  3241 raft_consensus.cc:359] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.506726  3241 raft_consensus.cc:385] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.507031  3241 raft_consensus.cc:740] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.508363  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:12.509716  3280 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:12.510144  3165 leader_election.cc:343] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.511482  3275 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:12.512564  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:12.507773  3241 consensus_queue.cc:260] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.514973  3241 ts_tablet_manager.cc:1434] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:14:12.515872  3241 tablet_bootstrap.cc:492] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:12.515800  3280 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:12.517977  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:12.513347  3051 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.518596  3124 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.523672  3241 tablet_bootstrap.cc:654] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.524514  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:12.525154  3123 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.512670  3125 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:12.527314  3242 tablet_bootstrap.cc:492] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:12.527850  3242 ts_tablet_manager.cc:1403] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.073s	user 0.018s	sys 0.022s
I20260709 13:14:12.529157  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:12.530337  3265 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:12.530843  3265 raft_consensus.cc:697] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:12.531533  3242 raft_consensus.cc:359] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.531672  3265 consensus_queue.cc:237] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.532359  3242 raft_consensus.cc:385] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.532898  3242 raft_consensus.cc:740] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.533043  3051 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:12.533694  3242 consensus_queue.cc:260] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.534304  3244 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.534476  3165 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:12.534821  3244 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.535526  3242 ts_tablet_manager.cc:1434] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:12.535574  3275 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:12.536620  3242 tablet_bootstrap.cc:492] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:12.536512  3275 raft_consensus.cc:697] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:12.536896  3244 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.537653  3275 consensus_queue.cc:237] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.539039  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:14:12.540688  3090 leader_election.cc:343] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.543844  3240 tablet_bootstrap.cc:654] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.544664  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:12.545303  3050 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:12.546469  3242 tablet_bootstrap.cc:654] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.546669  3091 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:12.547485  3124 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:12.547849  3244 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.548219  3244 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.548575  3244 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.532334  3123 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:12.550952  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:12.552054  3280 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:12.552623  3280 raft_consensus.cc:697] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:12.553967  3280 consensus_queue.cc:237] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.556582  3244 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.559815  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:12.560309  3244 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.560411  3050 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.563047  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:12.564154  3242 tablet_bootstrap.cc:492] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:12.564688  3242 ts_tablet_manager.cc:1403] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.001s
W20260709 13:14:12.565908  3090 leader_election.cc:343] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.574234  3242 raft_consensus.cc:359] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.567950  2948 catalog_manager.cc:5697] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 0 to 1, leader changed from <none> to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:12.575054  3050 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:12.575717  3241 tablet_bootstrap.cc:492] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:12.575064  3242 raft_consensus.cc:385] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.576257  3242 raft_consensus.cc:740] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.576510  3091 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:12.577347  3244 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:12.577102  3242 consensus_queue.cc:260] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.576367  3241 ts_tablet_manager.cc:1403] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.061s	user 0.019s	sys 0.004s
I20260709 13:14:12.578845  3244 raft_consensus.cc:697] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:12.579653  3242 ts_tablet_manager.cc:1434] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:14:12.579818  3244 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.580663  3242 tablet_bootstrap.cc:492] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:12.580547  3241 raft_consensus.cc:359] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.581224  3241 raft_consensus.cc:385] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.581501  3241 raft_consensus.cc:740] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.582209  3241 consensus_queue.cc:260] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.584087  3240 tablet_bootstrap.cc:492] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:12.584534  3241 ts_tablet_manager.cc:1434] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:14:12.584698  3240 ts_tablet_manager.cc:1403] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.082s	user 0.008s	sys 0.003s
I20260709 13:14:12.585479  3241 tablet_bootstrap.cc:492] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:12.586467  2946 catalog_manager.cc:5697] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 0 to 1, leader changed from <none> to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:12.588703  3240 raft_consensus.cc:359] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.589713  3240 raft_consensus.cc:385] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.590148  3240 raft_consensus.cc:740] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.592188  3241 tablet_bootstrap.cc:654] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.593094  3240 consensus_queue.cc:260] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.596248  3240 ts_tablet_manager.cc:1434] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.005s
I20260709 13:14:12.600775  3242 tablet_bootstrap.cc:654] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.604056  3240 tablet_bootstrap.cc:492] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:12.600449  2947 catalog_manager.cc:5697] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:12.618116  3242 tablet_bootstrap.cc:492] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:12.618645  3242 ts_tablet_manager.cc:1403] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.007s
I20260709 13:14:12.618727  2948 catalog_manager.cc:5697] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 0 to 1, leader changed from <none> to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:12.621502  3240 tablet_bootstrap.cc:654] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:12.622104  2997 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:12.621851  3242 raft_consensus.cc:359] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.622680  3242 raft_consensus.cc:385] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.622952  3242 raft_consensus.cc:740] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.623656  3242 consensus_queue.cc:260] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.626098  3242 ts_tablet_manager.cc:1434] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:14:12.626988  3242 tablet_bootstrap.cc:492] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:12.631067  3244 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.631557  3244 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.632079  3241 tablet_bootstrap.cc:492] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:12.632491  3241 ts_tablet_manager.cc:1403] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.047s	user 0.004s	sys 0.018s
I20260709 13:14:12.633618  3244 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.633587  3242 tablet_bootstrap.cc:654] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.635730  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:12.635823  3241 raft_consensus.cc:359] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.636490  3241 raft_consensus.cc:385] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.636780  3241 raft_consensus.cc:740] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.636811  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:12.637477  3050 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:12.638782  3091 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:12.639355  3242 tablet_bootstrap.cc:492] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:12.636490  3200 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:12.639577  3244 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.639853  3242 ts_tablet_manager.cc:1403] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.002s
I20260709 13:14:12.640151  3244 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.640547  3244 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.642518  3241 consensus_queue.cc:260] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.642763  3242 raft_consensus.cc:359] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.643533  3242 raft_consensus.cc:385] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.643828  3242 raft_consensus.cc:740] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.644742  3241 ts_tablet_manager.cc:1434] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:14:12.644531  3242 consensus_queue.cc:260] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.645582  3241 tablet_bootstrap.cc:492] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:12.646951  3242 ts_tablet_manager.cc:1434] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:14:12.647949  3242 tablet_bootstrap.cc:492] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:12.648758  3244 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.651774  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:12.652347  3050 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.652354  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:12.653120  3200 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.654174  3242 tablet_bootstrap.cc:654] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.661501  3280 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.662292  3280 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.665820  3241 tablet_bootstrap.cc:654] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.668061  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:12.669092  3051 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:12.670853  3280 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:12.671370  3050 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:12.672922  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:12.675588  3123 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:12.674292  3165 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:12.677187  3280 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.677696  3280 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.678161  3280 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.679975  3240 tablet_bootstrap.cc:492] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:12.680708  3240 ts_tablet_manager.cc:1403] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.000s
I20260709 13:14:12.682683  3091 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:12.684142  3312 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:12.684811  3312 raft_consensus.cc:697] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:12.687482  3312 consensus_queue.cc:237] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.689153  3280 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.694612  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:12.695479  3244 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.695535  3050 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.699508  3240 raft_consensus.cc:359] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.707993  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:12.714695  2948 catalog_manager.cc:5697] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:12.716811  3240 raft_consensus.cc:385] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.710692  3050 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:12.717232  3240 raft_consensus.cc:740] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.718389  3240 consensus_queue.cc:260] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.718783  3165 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:12.720216  3275 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:12.720955  3275 raft_consensus.cc:697] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:12.722021  3240 ts_tablet_manager.cc:1434] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.001s
I20260709 13:14:12.722235  3275 consensus_queue.cc:237] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.723367  3240 tablet_bootstrap.cc:492] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:12.715418  3200 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:12.716353  3123 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.733805  3240 tablet_bootstrap.cc:654] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.734221  3242 tablet_bootstrap.cc:492] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:12.734750  3242 ts_tablet_manager.cc:1403] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.087s	user 0.048s	sys 0.037s
I20260709 13:14:12.708807  3280 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:12.737712  3242 raft_consensus.cc:359] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.738489  3242 raft_consensus.cc:385] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.738801  3242 raft_consensus.cc:740] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.739684  3242 consensus_queue.cc:260] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.742609  3123 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:12.744112  3241 tablet_bootstrap.cc:492] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:12.744570  3241 ts_tablet_manager.cc:1403] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.099s	user 0.020s	sys 0.045s
I20260709 13:14:12.744906  3307 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.745410  3307 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.746080  3240 tablet_bootstrap.cc:492] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:12.746517  3240 ts_tablet_manager.cc:1403] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.007s
I20260709 13:14:12.747351  3241 raft_consensus.cc:359] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.747785  3307 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.748059  3241 raft_consensus.cc:385] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.748397  3241 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.744565  3265 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:14:12.749676  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:12.750324  3198 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:12.749485  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:12.751259  3240 raft_consensus.cc:359] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.752658  3240 raft_consensus.cc:385] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.752733  3242 ts_tablet_manager.cc:1434] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.018s	user 0.000s	sys 0.006s
I20260709 13:14:12.753177  3240 raft_consensus.cc:740] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.754514  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:12.754616  3241 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.755668  3265 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.756095  3265 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.756615  3265 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.755457  3240 consensus_queue.cc:260] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.758878  3240 ts_tablet_manager.cc:1434] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:14:12.763120  3240 tablet_bootstrap.cc:492] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:12.757076  3241 ts_tablet_manager.cc:1434] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:14:12.765924  3307 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.753974  3242 tablet_bootstrap.cc:492] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:12.766323  3312 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:12.766481  3307 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.768049  3241 tablet_bootstrap.cc:492] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:12.768502  3123 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:12.774652  3306 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.775238  3306 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.777384  3306 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.778146  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:12.778999  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:12.785887  3265 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.786473  3124 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:12.785247  3241 tablet_bootstrap.cc:654] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.788075  3265 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.789644  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:12.790663  3124 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:12.791025  3242 tablet_bootstrap.cc:654] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.800920  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:12.768991  3307 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.801594  3199 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:12.806855  3244 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:12.812759  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:12.833508  3306 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.834071  3306 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.834538  3306 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.839788  3240 tablet_bootstrap.cc:654] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.842058  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:12.843791  3307 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.844628  3307 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.845026  3307 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.845068  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:12.845830  3123 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.847834  3306 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.850207  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:12.850805  3199 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:12.845070  3015 leader_election.cc:343] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.855134  3241 tablet_bootstrap.cc:492] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:12.855777  3241 ts_tablet_manager.cc:1403] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.088s	user 0.019s	sys 0.030s
I20260709 13:14:12.863219  2948 catalog_manager.cc:5697] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 0 to 1, leader changed from <none> to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:12.865629  3265 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.866256  3265 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.873126  3306 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.875375  3248 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:12.878413  3265 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.879281  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:12.880185  3125 raft_consensus.cc:2393] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 1: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:14:12.880801  3123 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:12.883174  3307 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.886023  3307 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.888324  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:12.890270  3123 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.891829  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:12.892027  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:12.892606  3125 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.893412  3199 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:12.904126  3242 tablet_bootstrap.cc:492] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:12.904624  3242 ts_tablet_manager.cc:1403] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.151s	user 0.036s	sys 0.037s
I20260709 13:14:12.905421  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:12.906008  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:12.905838  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:14:12.907017  3015 leader_election.cc:343] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.907109  3199 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.908046  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:12.908777  3248 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:12.909128  3306 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:12.909617  3306 raft_consensus.cc:697] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:12.909897  3265 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.910451  3306 consensus_queue.cc:237] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.914374  3241 raft_consensus.cc:359] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.914646  3242 raft_consensus.cc:359] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.915092  3241 raft_consensus.cc:385] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.915405  3241 raft_consensus.cc:740] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.915235  3242 raft_consensus.cc:385] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.915170  3280 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:12.915882  3242 raft_consensus.cc:740] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.916257  3241 consensus_queue.cc:260] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.916577  3242 consensus_queue.cc:260] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.920107  3242 ts_tablet_manager.cc:1434] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 13:14:12.921278  3265 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:12.921854  3241 ts_tablet_manager.cc:1434] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.001s
I20260709 13:14:12.923748  3241 tablet_bootstrap.cc:492] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:12.927984  3242 tablet_bootstrap.cc:492] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:12.945834  3280 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:12.935911  3307 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.951273  3280 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.951613  3307 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.951753  3280 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.956584  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:14:12.962877  3015 leader_election.cc:343] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.967944  3280 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:12.969082  3275 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.968910  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:12.969244  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:12.969720  3275 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:12.970203  3051 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 1: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:12.972023  3275 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:12.971858  3165 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:12.973806  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:12.974679  3122 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 1: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:12.976065  3280 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.978793  3242 tablet_bootstrap.cc:654] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.983044  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:12.984349  3306 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:12.990783  3165 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:12.988070  3123 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:12.986377  3307 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:12.993964  3275 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.995349  3240 tablet_bootstrap.cc:492] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:12.995911  3240 ts_tablet_manager.cc:1403] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.234s	user 0.017s	sys 0.030s
I20260709 13:14:12.987789  3125 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:12.989097  3280 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:12.998698  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:13.001283  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:13.002233  3307 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:14:13.002661  3015 leader_election.cc:343] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.002965  3265 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.003242  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:13.004864  3306 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.003551  3265 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.004390  3307 raft_consensus.cc:697] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:13.006623  3307 consensus_queue.cc:237] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.007103  3265 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:13.012699  3240 raft_consensus.cc:359] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.013284  3240 raft_consensus.cc:385] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.013509  3275 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.013538  3240 raft_consensus.cc:740] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.014722  3240 consensus_queue.cc:260] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.015455  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:13.016965  3126 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 1: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:14:13.017419  3199 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:13.018597  3240 ts_tablet_manager.cc:1434] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:14:13.023908  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:13.025169  3241 tablet_bootstrap.cc:654] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.024964  3299 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.025311  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:13.026778  3306 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.026772  3299 raft_consensus.cc:697] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:13.028438  3240 tablet_bootstrap.cc:492] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:13.028548  3299 consensus_queue.cc:237] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.037147  3240 tablet_bootstrap.cc:654] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.047798  2949 catalog_manager.cc:5697] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 0 to 1, leader changed from <none> to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.048449  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:13.049541  3307 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.050331  3265 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.077349  3307 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.084127  3280 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.095808  3242 tablet_bootstrap.cc:492] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:13.095671  3292 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.096308  3242 ts_tablet_manager.cc:1403] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.169s	user 0.003s	sys 0.012s
I20260709 13:14:13.121279  3280 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.124035  2946 catalog_manager.cc:5697] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 0 to 1, leader changed from <none> to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.136183  3197 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.142971  3304 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.153514  3304 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.155057  3242 raft_consensus.cc:359] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.161363  3242 raft_consensus.cc:385] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.161824  3242 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.147826  2946 catalog_manager.cc:5697] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 0 to 1, leader changed from <none> to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.162837  3240 tablet_bootstrap.cc:492] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:13.163301  3240 ts_tablet_manager.cc:1403] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.135s	user 0.016s	sys 0.008s
I20260709 13:14:13.162716  3242 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.164151  3312 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.166190  3242 ts_tablet_manager.cc:1434] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.070s	user 0.015s	sys 0.000s
I20260709 13:14:13.168787  3242 tablet_bootstrap.cc:492] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:13.184264  3240 raft_consensus.cc:359] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.185032  3240 raft_consensus.cc:385] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.185313  3240 raft_consensus.cc:740] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.192785  3280 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:14:13.205806  3241 tablet_bootstrap.cc:492] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:13.206488  3241 ts_tablet_manager.cc:1403] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.283s	user 0.021s	sys 0.013s
I20260709 13:14:13.231515  3242 tablet_bootstrap.cc:654] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.195005  3275 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 13:14:13.234700  3304 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.234864  3312 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.244287  3304 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.244397  3312 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.261548  3241 raft_consensus.cc:359] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.262086  3312 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:13.262804  3241 raft_consensus.cc:385] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:14:13.245851  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 53332.1us
I20260709 13:14:13.263309  3241 raft_consensus.cc:740] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.262334  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:13.270627  3049 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:13.270246  3241 consensus_queue.cc:260] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.273644  3241 ts_tablet_manager.cc:1434] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.067s	user 0.004s	sys 0.003s
I20260709 13:14:13.273710  3091 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:13.275019  3241 tablet_bootstrap.cc:492] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:13.275152  3370 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.275701  3370 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.276120  3370 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.281180  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:13.283485  3241 tablet_bootstrap.cc:654] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.285627  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:13.286021  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:13.284296  3244 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:14:13.288226  3164 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:13.288372  3240 consensus_queue.cc:260] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.289249  3292 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.289788  3292 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.290376  3280 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:13.291581  3244 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.292677  3292 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:14:13.292806  3090 leader_election.cc:343] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.294437  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:13.295145  3051 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:13.296133  3240 ts_tablet_manager.cc:1434] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.133s	user 0.019s	sys 0.020s
I20260709 13:14:13.297214  3240 tablet_bootstrap.cc:492] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:13.298722  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:13.299434  3200 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:13.300276  3091 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:13.303764  3304 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:13.307072  3240 tablet_bootstrap.cc:654] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.312150  3292 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.312618  3292 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.312986  3292 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.320775  3292 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.323928  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:13.324630  3051 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.330332  3292 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:13.331748  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:13.332617  3200 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.334811  3051 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:13.336262  3091 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:13.340788  3369 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.341522  3369 raft_consensus.cc:697] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:13.342546  3369 consensus_queue.cc:237] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.344579  3240 tablet_bootstrap.cc:492] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:13.345109  3240 ts_tablet_manager.cc:1403] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.003s
I20260709 13:14:13.309391  3370 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.348188  3240 raft_consensus.cc:359] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.349673  3240 raft_consensus.cc:385] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.350040  3240 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.351598  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:13.352368  3051 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.354296  3370 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:13.357995  3240 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.359215  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:13.359953  3240 ts_tablet_manager.cc:1434] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
W20260709 13:14:13.360726  3090 leader_election.cc:343] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.360919  3240 tablet_bootstrap.cc:492] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:13.362699  3051 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:13.364071  3091 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:13.364989  3370 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.365557  3370 raft_consensus.cc:697] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:13.366204  3200 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:13.366545  3370 consensus_queue.cc:237] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.368458  3240 tablet_bootstrap.cc:654] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.368897  3241 tablet_bootstrap.cc:492] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:13.373497  3241 ts_tablet_manager.cc:1403] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.099s	user 0.035s	sys 0.028s
I20260709 13:14:13.376438  3241 raft_consensus.cc:359] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.377298  3241 raft_consensus.cc:385] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.377605  3241 raft_consensus.cc:740] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.378393  3241 consensus_queue.cc:260] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.380595  3241 ts_tablet_manager.cc:1434] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:14:13.381604  3241 tablet_bootstrap.cc:492] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:13.383250  3242 tablet_bootstrap.cc:492] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:13.383793  3242 ts_tablet_manager.cc:1403] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.215s	user 0.011s	sys 0.015s
I20260709 13:14:13.386955  3242 raft_consensus.cc:359] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.387791  3242 raft_consensus.cc:385] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.388147  3241 tablet_bootstrap.cc:654] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.388155  3242 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.389212  3242 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.391863  3242 ts_tablet_manager.cc:1434] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:13.393708  3242 tablet_bootstrap.cc:492] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:13.400501  3240 tablet_bootstrap.cc:492] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:13.401196  3240 ts_tablet_manager.cc:1403] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.004s
I20260709 13:14:13.405408  3242 tablet_bootstrap.cc:654] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.407929  3241 tablet_bootstrap.cc:492] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:13.408412  3241 ts_tablet_manager.cc:1403] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.004s
I20260709 13:14:13.407647  2947 catalog_manager.cc:5697] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.411510  3240 raft_consensus.cc:359] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.411181  2947 catalog_manager.cc:5697] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.412180  3240 raft_consensus.cc:385] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.412496  3240 raft_consensus.cc:740] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.412628  3241 raft_consensus.cc:359] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.413407  3241 raft_consensus.cc:385] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.413208  3240 consensus_queue.cc:260] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.413762  3241 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.414507  3241 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.415683  3240 ts_tablet_manager.cc:1434] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:14:13.416607  3240 tablet_bootstrap.cc:492] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:13.416673  3241 ts_tablet_manager.cc:1434] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:13.418097  3241 tablet_bootstrap.cc:492] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:13.422778  3240 tablet_bootstrap.cc:654] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.423092  3242 tablet_bootstrap.cc:492] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:13.423589  3242 ts_tablet_manager.cc:1403] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.004s
I20260709 13:14:13.424937  3304 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.425609  3304 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.429139  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:13.430330  3051 raft_consensus.cc:2393] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 1: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:13.430560  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:13.431384  3241 tablet_bootstrap.cc:654] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.432366  3164 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:13.433372  3275 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.437731  3304 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:13.453584  3265 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.456597  3275 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.476752  3306 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.449368  3242 raft_consensus.cc:359] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.479935  3242 raft_consensus.cc:385] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.480353  3242 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.486711  3265 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.481160  3242 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.499816  3242 ts_tablet_manager.cc:1434] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.076s	user 0.005s	sys 0.003s
I20260709 13:14:13.500232  3241 tablet_bootstrap.cc:492] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:13.500680  3241 ts_tablet_manager.cc:1403] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.083s	user 0.026s	sys 0.043s
I20260709 13:14:13.503314  3241 raft_consensus.cc:359] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.504673  3242 tablet_bootstrap.cc:492] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:13.512414  3240 tablet_bootstrap.cc:492] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:13.512981  3240 ts_tablet_manager.cc:1403] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.097s	user 0.034s	sys 0.045s
I20260709 13:14:13.513237  3242 tablet_bootstrap.cc:654] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.515965  3240 raft_consensus.cc:359] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.516911  3240 raft_consensus.cc:385] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.517230  3240 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.517861  3240 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.524556  3240 ts_tablet_manager.cc:1434] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:14:13.525758  3240 tablet_bootstrap.cc:492] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:13.504019  3241 raft_consensus.cc:385] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.528878  3241 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.531788  3241 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.535627  3241 ts_tablet_manager.cc:1434] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 13:14:13.536759  3241 tablet_bootstrap.cc:492] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:13.533453  3240 tablet_bootstrap.cc:654] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.542848  3306 consensus_queue.cc:1048] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.553194  3241 tablet_bootstrap.cc:654] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.573726  3389 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.574316  3389 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.577099  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:13.577723  3123 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:13.579008  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:13.579730  3307 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.580190  3307 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.580610  3307 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.595938  3240 tablet_bootstrap.cc:492] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:13.596487  3240 ts_tablet_manager.cc:1403] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.022s
I20260709 13:14:13.601329  3240 raft_consensus.cc:359] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.603255  3240 raft_consensus.cc:385] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.603583  3240 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.604238  3240 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.607682  3241 tablet_bootstrap.cc:492] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:13.608289  3241 ts_tablet_manager.cc:1403] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.072s	user 0.026s	sys 0.003s
I20260709 13:14:13.610194  3306 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.610709  3306 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.611063  3241 raft_consensus.cc:359] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.612298  3240 ts_tablet_manager.cc:1434] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:14:13.612674  3306 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:13.612685  3241 raft_consensus.cc:385] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.613576  3241 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.619463  3241 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.622356  3241 ts_tablet_manager.cc:1434] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:14:13.618724  3240 tablet_bootstrap.cc:492] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:13.626475  3241 tablet_bootstrap.cc:492] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:13.640528  3241 tablet_bootstrap.cc:654] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.634353  3240 tablet_bootstrap.cc:654] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.645539  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:13.646315  3123 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:13.646196  3306 consensus_queue.cc:1048] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.645682  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:13.647555  3200 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:13.648093  3389 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:13.652917  3240 tablet_bootstrap.cc:492] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:13.653483  3240 ts_tablet_manager.cc:1403] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.035s	user 0.004s	sys 0.010s
I20260709 13:14:13.656297  3240 raft_consensus.cc:359] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.657068  3240 raft_consensus.cc:385] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.657398  3240 raft_consensus.cc:740] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.658584  3240 consensus_queue.cc:260] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.660982  3307 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.662107  3241 tablet_bootstrap.cc:492] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:13.662642  3241 ts_tablet_manager.cc:1403] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.004s
I20260709 13:14:13.663635  3307 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:13.665277  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:13.667150  3240 ts_tablet_manager.cc:1434] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:14:13.671584  3240 tablet_bootstrap.cc:492] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:13.676978  3240 tablet_bootstrap.cc:654] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.665591  3241 raft_consensus.cc:359] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.677359  3241 raft_consensus.cc:385] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.677610  3241 raft_consensus.cc:740] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.678418  3241 consensus_queue.cc:260] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:13.670222  2997 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:13.680750  3241 ts_tablet_manager.cc:1434] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.002s
I20260709 13:14:13.681902  3241 tablet_bootstrap.cc:492] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:13.690737  3241 tablet_bootstrap.cc:654] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.695614  3240 tablet_bootstrap.cc:492] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:13.696177  3240 ts_tablet_manager.cc:1403] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.002s
I20260709 13:14:13.699481  3240 raft_consensus.cc:359] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.700407  3240 raft_consensus.cc:385] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.700762  3240 raft_consensus.cc:740] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.701455  3240 consensus_queue.cc:260] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.702152  3241 tablet_bootstrap.cc:492] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:13.702589  3241 ts_tablet_manager.cc:1403] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:14:13.703722  3240 ts_tablet_manager.cc:1434] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:14:13.705158  3241 raft_consensus.cc:359] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.705700  3240 tablet_bootstrap.cc:492] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:13.705892  3241 raft_consensus.cc:385] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.706231  3241 raft_consensus.cc:740] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.706897  3241 consensus_queue.cc:260] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.709156  3241 ts_tablet_manager.cc:1434] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:14:13.710088  3241 tablet_bootstrap.cc:492] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:13.715277  3240 tablet_bootstrap.cc:654] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.718968  3299 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.719488  3241 tablet_bootstrap.cc:654] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.719538  3299 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.720147  3299 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:13.721891  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 56719.2us
I20260709 13:14:13.724188  3389 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.727732  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:13.728719  3196 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:13.731443  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:13.732117  3196 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.746028  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:13.746927  3124 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.753897  3299 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.755970  3299 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:13.751992  3196 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:13.760452  3242 tablet_bootstrap.cc:492] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:13.760946  3242 ts_tablet_manager.cc:1403] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.256s	user 0.080s	sys 0.074s
I20260709 13:14:13.763670  3242 raft_consensus.cc:359] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.763975  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:13.764812  3242 raft_consensus.cc:385] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.765158  3242 raft_consensus.cc:740] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.765972  3242 consensus_queue.cc:260] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.768044  3242 ts_tablet_manager.cc:1434] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:14:13.768986  3299 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.776356  3242 tablet_bootstrap.cc:492] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:13.778337  3240 tablet_bootstrap.cc:492] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:13.778811  3240 ts_tablet_manager.cc:1403] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.073s	user 0.019s	sys 0.012s
I20260709 13:14:13.786580  3369 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.786846  3240 raft_consensus.cc:359] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.787087  3369 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.789112  3307 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.789567  3307 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.790155  3369 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:13.790848  3241 tablet_bootstrap.cc:492] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:13.791332  3241 ts_tablet_manager.cc:1403] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.081s	user 0.008s	sys 0.003s
I20260709 13:14:13.791574  3307 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:13.792197  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:13.792842  3200 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:13.781761  3299 raft_consensus.cc:697] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:13.794075  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:13.789574  3242 tablet_bootstrap.cc:654] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.794603  3299 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.788712  3240 raft_consensus.cc:385] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.797801  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:13.798197  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:13.798421  3051 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:13.798753  3126 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.798858  3124 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:13.796445  3241 raft_consensus.cc:359] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.800976  3241 raft_consensus.cc:385] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.796727  3240 raft_consensus.cc:740] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.801476  3241 raft_consensus.cc:740] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.802582  3241 consensus_queue.cc:260] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.804296  3240 consensus_queue.cc:260] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.796627  3292 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.807021  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:13.810644  3200 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.806038  3292 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.814208  3292 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.815407  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:13.817996  3124 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:13.824222  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:13.825134  3307 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.825556  3307 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.825980  3307 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.827421  3200 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:13.828848  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:13.829479  3196 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:13.817354  3126 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:13.832568  3240 ts_tablet_manager.cc:1434] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.003s
I20260709 13:14:13.833228  3307 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.824098  3292 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.833493  3240 tablet_bootstrap.cc:492] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:13.836403  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:13.837687  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:13.837335  3241 ts_tablet_manager.cc:1434] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 13:14:13.838433  3051 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.838671  3200 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.843618  3241 tablet_bootstrap.cc:492] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:13.845402  3200 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:13.836539  3292 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:13.838104  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:13.846796  3394 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.846760  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:13.847409  3394 raft_consensus.cc:697] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:13.848176  3292 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.848299  3394 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.848987  3292 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:13.849958  3292 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.851372  3240 tablet_bootstrap.cc:654] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.862447  3051 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:13.873855  3369 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.883800  3307 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:13.886286  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:13.887109  3196 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.886281  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:13.883878  2949 catalog_manager.cc:5697] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.888655  3123 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.889448  2946 catalog_manager.cc:5697] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 0 to 1, leader changed from <none> to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.906056  3242 tablet_bootstrap.cc:492] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:13.906708  3242 ts_tablet_manager.cc:1403] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.131s	user 0.006s	sys 0.015s
I20260709 13:14:13.920876  2949 catalog_manager.cc:5697] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 0 to 1, leader changed from <none> to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.922091  3371 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.922833  3371 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.925246  3371 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:13.926465  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:13.927506  3196 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:13.929090  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:13.928689  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:13.934860  3299 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.935405  3299 raft_consensus.cc:697] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:14:13.935703  3090 leader_election.cc:343] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.936483  3292 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.936213  3299 consensus_queue.cc:237] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.946038  3240 tablet_bootstrap.cc:492] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
W20260709 13:14:13.950987  3091 leader_election.cc:343] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.951486  3091 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:13.953171  3369 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.953693  3242 raft_consensus.cc:359] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.954608  3242 raft_consensus.cc:385] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.954027  3369 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.955099  3242 raft_consensus.cc:740] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.932555  3123 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:13.955917  3242 consensus_queue.cc:260] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.962790  3240 ts_tablet_manager.cc:1403] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.129s	user 0.020s	sys 0.003s
I20260709 13:14:13.965010  3242 ts_tablet_manager.cc:1434] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.007s
I20260709 13:14:13.966115  3240 raft_consensus.cc:359] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.966722  3242 tablet_bootstrap.cc:492] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:13.966886  3240 raft_consensus.cc:385] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.967311  3240 raft_consensus.cc:740] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.973922  3241 tablet_bootstrap.cc:654] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.973948  3242 tablet_bootstrap.cc:654] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.976354  3410 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.980049  3410 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.982328  2947 catalog_manager.cc:5697] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 0 to 1, leader changed from <none> to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.987525  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:13.988332  3410 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:13.986790  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:13.990957  3196 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:13.990738  3410 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.991840  3242 tablet_bootstrap.cc:492] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:13.992334  3242 ts_tablet_manager.cc:1403] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.009s
I20260709 13:14:13.992434  3090 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:13.993292  3410 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.993722  3410 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.994150  3410 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.995231  3242 raft_consensus.cc:359] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:13.995937  3242 raft_consensus.cc:385] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.996241  3242 raft_consensus.cc:740] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
W20260709 13:14:13.998675  3091 leader_election.cc:343] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.999881  3240 consensus_queue.cc:260] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.005592  3242 consensus_queue.cc:260] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.007815  3410 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.010814  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:14.011502  3410 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:14.012444  3240 ts_tablet_manager.cc:1434] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 13:14:14.012748  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:14.013351  3197 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.013510  3240 tablet_bootstrap.cc:492] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
W20260709 13:14:14.014299  3091 leader_election.cc:343] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.015563  3241 tablet_bootstrap.cc:492] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:14.016084  3241 ts_tablet_manager.cc:1403] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.173s	user 0.014s	sys 0.005s
I20260709 13:14:14.019467  3241 raft_consensus.cc:359] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.020212  3241 raft_consensus.cc:385] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.020541  3241 raft_consensus.cc:740] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.021605  3242 ts_tablet_manager.cc:1434] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:14:14.021502  3241 consensus_queue.cc:260] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.022666  3242 tablet_bootstrap.cc:492] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:14.023728  3241 ts_tablet_manager.cc:1434] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:14.024749  3241 tablet_bootstrap.cc:492] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:14.025115  3197 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:14.026559  3090 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:14.027891  3410 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.028458  3410 raft_consensus.cc:697] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:14.029366  3410 consensus_queue.cc:237] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.031032  3241 tablet_bootstrap.cc:654] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.034715  3242 tablet_bootstrap.cc:654] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.047298  3240 tablet_bootstrap.cc:654] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.055325  3242 tablet_bootstrap.cc:492] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:14.056066  3242 ts_tablet_manager.cc:1403] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.002s
I20260709 13:14:14.060428  3240 tablet_bootstrap.cc:492] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:14.060943  3240 ts_tablet_manager.cc:1403] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.001s
I20260709 13:14:14.063916  3240 raft_consensus.cc:359] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.064652  3240 raft_consensus.cc:385] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.064972  3240 raft_consensus.cc:740] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.066766  3242 raft_consensus.cc:359] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.067502  3242 raft_consensus.cc:385] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.067804  3242 raft_consensus.cc:740] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.068583  3242 consensus_queue.cc:260] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.065686  3240 consensus_queue.cc:260] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.071456  3240 ts_tablet_manager.cc:1434] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:14:14.072376  3240 tablet_bootstrap.cc:492] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:14.075753  3242 ts_tablet_manager.cc:1434] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
I20260709 13:14:14.081521  3242 tablet_bootstrap.cc:492] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:14.087946  3242 tablet_bootstrap.cc:654] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.090721  3240 tablet_bootstrap.cc:654] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.100034  3242 tablet_bootstrap.cc:492] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:14.100777  3242 ts_tablet_manager.cc:1403] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.005s
I20260709 13:14:14.105952  3242 raft_consensus.cc:359] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.106710  3242 raft_consensus.cc:385] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.106947  3240 tablet_bootstrap.cc:492] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:14.107012  3242 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.107617  3240 ts_tablet_manager.cc:1403] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.004s
I20260709 13:14:14.107805  3403 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.107870  3242 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.108459  3403 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.110463  3242 ts_tablet_manager.cc:1434] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.008s
I20260709 13:14:14.110870  3403 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:14.111464  3242 tablet_bootstrap.cc:492] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:14.111225  3240 raft_consensus.cc:359] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.111853  3240 raft_consensus.cc:385] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.112114  3240 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.112603  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:14.112803  3240 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.113210  3126 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:14.115228  3240 ts_tablet_manager.cc:1434] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:14.116211  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:14.117116  3403 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.117539  3242 tablet_bootstrap.cc:654] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.117446  3403 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.117894  3403 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.121243  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:14.121912  3049 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:14.125588  3240 tablet_bootstrap.cc:492] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:14.125339  3403 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.126965  3403 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:14.128093  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:14.128811  3123 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.132428  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:14.133102  3051 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.134718  3242 tablet_bootstrap.cc:492] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:14.135239  3242 ts_tablet_manager.cc:1403] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.004s
I20260709 13:14:14.137270  3240 tablet_bootstrap.cc:654] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.138921  3123 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:14.139945  3241 tablet_bootstrap.cc:492] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:14.138376  2948 catalog_manager.cc:5697] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.140431  3241 ts_tablet_manager.cc:1403] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.116s	user 0.027s	sys 0.049s
I20260709 13:14:14.141388  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:14.142679  3242 raft_consensus.cc:359] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.143378  3242 raft_consensus.cc:385] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.143687  3242 raft_consensus.cc:740] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.144320  3051 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:14.144484  3242 consensus_queue.cc:260] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.145913  3403 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.146399  3403 raft_consensus.cc:697] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:14.147409  3242 ts_tablet_manager.cc:1434] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:14:14.145591  3241 raft_consensus.cc:359] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.148609  3241 raft_consensus.cc:385] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.148862  3241 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.150228  3410 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.150857  3242 tablet_bootstrap.cc:492] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:14.150696  3410 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.154516  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:14.149662  3241 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.147202  3403 consensus_queue.cc:237] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.155767  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:14.157368  3241 ts_tablet_manager.cc:1434] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:14:14.157498  3280 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.155560  3197 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:14.158001  3280 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.155458  3410 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:14.159319  3090 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:14.159541  3240 tablet_bootstrap.cc:492] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:14.160022  3240 ts_tablet_manager.cc:1403] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.001s
I20260709 13:14:14.160085  3280 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:14.160192  3410 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.157382  3049 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:14.163866  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:14.162411  3410 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.165391  3410 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:14.165812  3164 leader_election.cc:343] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.168946  3241 tablet_bootstrap.cc:492] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:14.171036  3240 raft_consensus.cc:359] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.171692  3240 raft_consensus.cc:385] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.172086  3240 raft_consensus.cc:740] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.171584  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:14.172696  3240 consensus_queue.cc:260] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.181073  3240 ts_tablet_manager.cc:1434] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:14:14.182040  3240 tablet_bootstrap.cc:492] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:14.183096  3051 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:14.184559  3410 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.185632  3165 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:14.186668  3410 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:14.187140  3280 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.187500  3280 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.187978  3280 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.190728  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:14.191324  3051 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.192512  3242 tablet_bootstrap.cc:654] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.194435  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:14.195010  3197 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.199927  2948 catalog_manager.cc:5697] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 0 to 1, leader changed from <none> to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.202188  3241 tablet_bootstrap.cc:654] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.200821  3307 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.203131  3307 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.205155  3307 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:14.207157  3280 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.208827  3197 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:14.213369  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:14.213784  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:14.214294  3196 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 1: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:14.214468  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:14.215022  3049 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.215765  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:14.216427  3410 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.216795  3307 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.216882  3410 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.219899  3410 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:14.220085  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:14.220700  3048 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:14.223891  3091 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:14.224977  3410 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.225404  3410 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.225603  3240 tablet_bootstrap.cc:654] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.225898  3410 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.226881  3051 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:14.226747  3090 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:14.227977  3370 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.228631  3370 raft_consensus.cc:697] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:14.231969  3370 consensus_queue.cc:237] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.234972  3280 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:14.236124  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:14.236732  3126 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.242782  3242 tablet_bootstrap.cc:492] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:14.242751  3307 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.243358  3242 ts_tablet_manager.cc:1403] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.093s	user 0.009s	sys 0.012s
I20260709 13:14:14.233562  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:14.249476  3049 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:14.249603  3410 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.251531  3165 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:14.252714  3280 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.253325  3280 raft_consensus.cc:697] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:14.254428  3280 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.263345  3240 tablet_bootstrap.cc:492] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:14.263237  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:14.263865  3240 ts_tablet_manager.cc:1403] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.004s
I20260709 13:14:14.263921  3049 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.266594  3240 raft_consensus.cc:359] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.267506  3240 raft_consensus.cc:385] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.268173  3240 raft_consensus.cc:740] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.269224  3240 consensus_queue.cc:260] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.269498  3410 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:14.271757  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:14:14.273373  3090 leader_election.cc:343] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.274369  3240 ts_tablet_manager.cc:1434] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:14:14.275319  3240 tablet_bootstrap.cc:492] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:14.276439  3371 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.268252  3126 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:14.289969  3241 tablet_bootstrap.cc:492] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:14.290495  3241 ts_tablet_manager.cc:1403] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.122s	user 0.016s	sys 0.015s
W20260709 13:14:14.288793  3090 leader_election.cc:343] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.293205  3242 raft_consensus.cc:359] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.294340  3242 raft_consensus.cc:385] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.294631  3242 raft_consensus.cc:740] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.295239  3242 consensus_queue.cc:260] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.293951  3049 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:14.297915  2948 catalog_manager.cc:5697] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.303550  2946 catalog_manager.cc:5697] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 0 to 1, leader changed from <none> to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.306581  3242 ts_tablet_manager.cc:1434] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 13:14:14.307440  3091 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:14.308648  3241 raft_consensus.cc:359] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.309367  3241 raft_consensus.cc:385] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.309661  3241 raft_consensus.cc:740] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.310364  3371 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.326696  3241 consensus_queue.cc:260] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.307529  3242 tablet_bootstrap.cc:492] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:14.326359  3371 raft_consensus.cc:697] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:14.333235  3369 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.333813  3369 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.344377  3241 ts_tablet_manager.cc:1434] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.003s
I20260709 13:14:14.345255  3241 tablet_bootstrap.cc:492] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:14.349124  3369 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:14.330070  3371 consensus_queue.cc:237] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.353830  3307 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.357581  3280 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.358168  3280 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.360225  3307 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.363834  3370 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.366460  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:14.366689  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:14.368322  3280 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:14:14.371147  3091 leader_election.cc:343] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.387816  3242 tablet_bootstrap.cc:654] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.392796  3371 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.398181  3371 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.399335  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:14.402689  3241 tablet_bootstrap.cc:654] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.403868  3299 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.406203  3371 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:14.404587  3307 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.405225  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:14.407305  3049 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:14.405505  3240 tablet_bootstrap.cc:654] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.408865  3091 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:14.410490  2946 catalog_manager.cc:5697] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.411742  3307 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.416851  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:14:14.418268  3090 leader_election.cc:343] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.420897  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:14:14.424294  3090 leader_election.cc:343] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.422196  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:14.424592  3370 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.425320  3049 raft_consensus.cc:2393] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 1: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:14.419780  3371 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.437623  3165 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:14.438890  3371 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.440443  3371 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.439337  3280 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.448555  3280 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.448555  3371 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.461781  3371 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:14.481447  3299 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:14.509238  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:14.513121  3049 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.498837  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:14.533818  3370 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.534778  3241 tablet_bootstrap.cc:492] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:14.535436  3241 ts_tablet_manager.cc:1403] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.190s	user 0.014s	sys 0.002s
W20260709 13:14:14.540995  3090 leader_election.cc:343] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.551102  3049 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:14.552680  3091 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:14.553910  3370 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.554538  3370 raft_consensus.cc:697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:14.555447  3370 consensus_queue.cc:237] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.556663  3240 tablet_bootstrap.cc:492] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:14.557098  3240 ts_tablet_manager.cc:1403] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.282s	user 0.012s	sys 0.017s
I20260709 13:14:14.558370  3241 raft_consensus.cc:359] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.558925  3241 raft_consensus.cc:385] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.559144  3241 raft_consensus.cc:740] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.559638  3241 consensus_queue.cc:260] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.564190  3241 ts_tablet_manager.cc:1434] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:14:14.565577  3241 tablet_bootstrap.cc:492] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:14.569046  3244 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.574908  3240 raft_consensus.cc:359] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.575686  3240 raft_consensus.cc:385] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.575937  3240 raft_consensus.cc:740] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.576450  3240 consensus_queue.cc:260] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.583552  3240 ts_tablet_manager.cc:1434] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:14:14.586261  3403 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.586205  3242 tablet_bootstrap.cc:492] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:14.598416  3242 ts_tablet_manager.cc:1403] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.291s	user 0.007s	sys 0.015s
I20260709 13:14:14.598469  3240 tablet_bootstrap.cc:492] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:14.627008  3241 tablet_bootstrap.cc:654] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.632228  2946 catalog_manager.cc:5697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.639947  3242 raft_consensus.cc:359] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.640882  3242 raft_consensus.cc:385] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.641216  3242 raft_consensus.cc:740] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.642247  3242 consensus_queue.cc:260] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.647261  3242 ts_tablet_manager.cc:1434] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:14:14.648533  3242 tablet_bootstrap.cc:492] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:14.658021  3240 tablet_bootstrap.cc:654] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.660597  3242 tablet_bootstrap.cc:654] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.661473  3403 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.666771  3241 tablet_bootstrap.cc:492] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:14.667436  3241 ts_tablet_manager.cc:1403] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.102s	user 0.012s	sys 0.003s
I20260709 13:14:14.671761  3241 raft_consensus.cc:359] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.672854  3241 raft_consensus.cc:385] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.672802  3280 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:14.673434  3241 raft_consensus.cc:740] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.675168  3241 consensus_queue.cc:260] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.678592  3241 ts_tablet_manager.cc:1434] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:14:14.680130  3241 tablet_bootstrap.cc:492] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:14.687759  3242 tablet_bootstrap.cc:492] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:14.688254  3242 ts_tablet_manager.cc:1403] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.019s
I20260709 13:14:14.698447  3242 raft_consensus.cc:359] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.699267  3242 raft_consensus.cc:385] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.699585  3242 raft_consensus.cc:740] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.700299  3242 consensus_queue.cc:260] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.702898  3242 ts_tablet_manager.cc:1434] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.005s
I20260709 13:14:14.707645  3241 tablet_bootstrap.cc:654] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.707458  3371 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.708101  3371 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.709223  3403 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.710836  3371 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:14.712368  3242 tablet_bootstrap.cc:492] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:14.712633  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:14.713295  3370 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:14:14.714051  3090 leader_election.cc:343] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.715198  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:14:14.716619  3091 leader_election.cc:343] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.717124  3091 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:14.718034  3370 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.720136  3242 tablet_bootstrap.cc:654] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.725633  3403 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.726580  3403 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.728724  3299 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.729351  3299 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.732892  3241 tablet_bootstrap.cc:492] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:14.733608  3241 ts_tablet_manager.cc:1403] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.008s
I20260709 13:14:14.732993  3299 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:14.734555  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:14:14.736327  3015 leader_election.cc:343] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.736579  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:14.734544  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:14.737329  3123 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
W20260709 13:14:14.738386  3015 leader_election.cc:343] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.738806  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:14.738742  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:14.740203  3304 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.740479  3307 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.740634  3304 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.741125  3304 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.742168  3370 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.742518  3403 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:14.742676  3370 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.743075  3241 raft_consensus.cc:359] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.743798  3241 raft_consensus.cc:385] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.744099  3241 raft_consensus.cc:740] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.744228  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:14.745108  3370 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:14.744836  3241 consensus_queue.cc:260] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:14.745818  3165 leader_election.cc:343] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.746928  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:14.747195  3241 ts_tablet_manager.cc:1434] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:14:14.748270  3241 tablet_bootstrap.cc:492] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
W20260709 13:14:14.748486  3091 leader_election.cc:343] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.752388  3242 tablet_bootstrap.cc:492] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:14.752928  3242 ts_tablet_manager.cc:1403] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.000s
I20260709 13:14:14.755908  3242 raft_consensus.cc:359] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.756678  3242 raft_consensus.cc:385] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.756995  3242 raft_consensus.cc:740] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.757714  3242 consensus_queue.cc:260] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.762672  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:14.762468  3370 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:14.762990  3304 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:14.764866  3090 leader_election.cc:343] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.765383  3304 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:14.766656  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:14.767745  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:14.768352  3125 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:14.768741  3165 leader_election.cc:343] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.765260  3242 ts_tablet_manager.cc:1434] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 13:14:14.765326  3090 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:14.771777  3292 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.774511  3241 tablet_bootstrap.cc:654] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.776959  3242 tablet_bootstrap.cc:492] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:14.792246  3240 tablet_bootstrap.cc:492] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:14.792785  3240 ts_tablet_manager.cc:1403] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.195s	user 0.015s	sys 0.009s
I20260709 13:14:14.800424  3240 raft_consensus.cc:359] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.801304  3240 raft_consensus.cc:385] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.801713  3240 raft_consensus.cc:740] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.802572  3240 consensus_queue.cc:260] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.807938  3242 tablet_bootstrap.cc:654] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.811092  3240 ts_tablet_manager.cc:1434] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 13:14:14.813357  3240 tablet_bootstrap.cc:492] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
W20260709 13:14:14.812261  2997 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:14.825421  3370 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:14.832191  3299 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.831701  3125 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:14.841663  3299 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.843848  3299 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:14.846156  3241 tablet_bootstrap.cc:492] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:14.846280  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:14.846673  3241 ts_tablet_manager.cc:1403] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.099s	user 0.036s	sys 0.012s
I20260709 13:14:14.847121  3403 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.847690  3403 raft_consensus.cc:697] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:14.848575  3403 consensus_queue.cc:237] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.849438  3241 raft_consensus.cc:359] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.850654  3241 raft_consensus.cc:385] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.850926  3241 raft_consensus.cc:740] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.851586  3241 consensus_queue.cc:260] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.852099  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:14.852718  3125 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:14.853785  3241 ts_tablet_manager.cc:1434] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:14:14.854766  3241 tablet_bootstrap.cc:492] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:14.854674  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:14.855559  3299 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.855927  3299 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.856261  3299 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.858084  3244 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.861593  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:14:14.863235  3015 leader_election.cc:343] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.866065  3304 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.866621  3304 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.870517  3240 tablet_bootstrap.cc:654] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.870937  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:14.871640  3123 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:14.872834  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:14.873502  3051 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:14.874284  3164 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:14.874969  3304 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:14.876097  3280 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.876514  3280 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.876897  3280 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.883906  3241 tablet_bootstrap.cc:654] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.899645  3240 tablet_bootstrap.cc:492] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:14.900079  3240 ts_tablet_manager.cc:1403] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.087s	user 0.016s	sys 0.004s
I20260709 13:14:14.902194  3240 raft_consensus.cc:359] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.902892  3240 raft_consensus.cc:385] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.903151  3240 raft_consensus.cc:740] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.903976  3240 consensus_queue.cc:260] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.905844  3240 ts_tablet_manager.cc:1434] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:14:14.905915  3241 tablet_bootstrap.cc:492] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:14.906425  3241 ts_tablet_manager.cc:1403] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.000s
I20260709 13:14:14.906771  3240 tablet_bootstrap.cc:492] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:14.907663  3242 tablet_bootstrap.cc:492] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:14.908098  3242 ts_tablet_manager.cc:1403] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.138s	user 0.019s	sys 0.003s
I20260709 13:14:14.909245  3241 raft_consensus.cc:359] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.910209  3241 raft_consensus.cc:385] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.910557  3241 raft_consensus.cc:740] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.911357  3241 consensus_queue.cc:260] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.913491  3241 ts_tablet_manager.cc:1434] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:14:14.913000  3280 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.918371  3242 raft_consensus.cc:359] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.919389  3242 raft_consensus.cc:385] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.919723  3242 raft_consensus.cc:740] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.920341  3242 consensus_queue.cc:260] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.921110  3371 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.921605  3371 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.922403  3242 ts_tablet_manager.cc:1434] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:14:14.917868  3241 tablet_bootstrap.cc:492] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:14.923842  3371 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:14.925935  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:14.926503  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:14.927196  3051 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:14.928486  3091 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:14.929296  3370 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.929615  3370 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.929939  3370 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.930683  3241 tablet_bootstrap.cc:654] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.930981  3240 tablet_bootstrap.cc:654] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.926558  3197 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:14.937299  3242 tablet_bootstrap.cc:492] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:14.939543  3370 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.942706  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:14.943327  3051 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.944317  3242 tablet_bootstrap.cc:654] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.950850  3051 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:14.950372  2946 catalog_manager.cc:5697] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 0 to 1, leader changed from <none> to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.952057  3091 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:14.918354  3299 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.952881  3371 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.960004  3371 raft_consensus.cc:697] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:14.961041  3371 consensus_queue.cc:237] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.954707  3403 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.965317  3403 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.966240  3240 tablet_bootstrap.cc:492] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:14.966727  3240 ts_tablet_manager.cc:1403] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.002s
I20260709 13:14:14.968357  3403 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:14.956389  3370 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:14.970063  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:14.970821  3123 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:14.970065  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:14.972851  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:14:14.975808  3165 leader_election.cc:343] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.977051  3465 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.977427  3465 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.977797  3465 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.981904  3240 raft_consensus.cc:359] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.984282  3240 raft_consensus.cc:385] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.984654  3240 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.985541  3240 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.987633  3241 tablet_bootstrap.cc:492] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:14.988153  3241 ts_tablet_manager.cc:1403] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.013s
I20260709 13:14:14.956971  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:14.989691  3199 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.990397  3241 raft_consensus.cc:359] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.990998  3241 raft_consensus.cc:385] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.991250  3241 raft_consensus.cc:740] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.991870  3241 consensus_queue.cc:260] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:14.987639  3240 ts_tablet_manager.cc:1434] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:14:14.993661  3241 ts_tablet_manager.cc:1434] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:14:14.994932  3241 tablet_bootstrap.cc:492] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:14.995790  3240 tablet_bootstrap.cc:492] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:14.999629  2948 catalog_manager.cc:5697] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.002316  3465 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.003453  3240 tablet_bootstrap.cc:654] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.007340  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:15.008046  3123 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.011466  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:14:15.013103  3165 leader_election.cc:343] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.013856  3465 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:15.011761  3241 tablet_bootstrap.cc:654] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.014632  3242 tablet_bootstrap.cc:492] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:15.015131  3242 ts_tablet_manager.cc:1403] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.013s
I20260709 13:14:15.016417  3299 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:14.959185  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:15.019955  3051 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.020601  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:15.027587  3051 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:15.028777  3199 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:15.019012  3123 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:15.030176  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:15.031597  3126 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.032020  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:14:15.022183  3015 leader_election.cc:343] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.034467  3403 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.035233  3403 raft_consensus.cc:697] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:15.036248  3242 raft_consensus.cc:359] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.036823  3307 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.037148  3242 raft_consensus.cc:385] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.037563  3242 raft_consensus.cc:740] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.037535  3307 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.038755  3242 consensus_queue.cc:260] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.039963  3307 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:15.040755  3242 ts_tablet_manager.cc:1434] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:14:15.036168  3403 consensus_queue.cc:237] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.047825  3242 tablet_bootstrap.cc:492] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:15.048445  3165 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:15.049525  3465 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.050693  3465 raft_consensus.cc:697] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:15.055568  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:15.061677  3240 tablet_bootstrap.cc:492] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:15.062194  3240 ts_tablet_manager.cc:1403] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.016s
I20260709 13:14:15.051613  3465 consensus_queue.cc:237] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.062503  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:14:15.064880  3090 consensus_peers.cc:597] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:15.065186  3125 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 1: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:14:15.066782  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:15.058048  3280 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:15.067435  3125 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.069705  3240 raft_consensus.cc:359] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.070379  3240 raft_consensus.cc:385] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.070639  3240 raft_consensus.cc:740] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.071223  3240 consensus_queue.cc:260] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.077493  3280 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.078190  3280 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.079411  3126 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:15.079916  3015 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:15.082110  3307 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.085450  3242 tablet_bootstrap.cc:654] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.087165  3240 ts_tablet_manager.cc:1434] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.002s
I20260709 13:14:15.087812  3280 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:15.088410  3240 tablet_bootstrap.cc:492] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:15.089897  3241 tablet_bootstrap.cc:492] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:15.090502  3241 ts_tablet_manager.cc:1403] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.096s	user 0.017s	sys 0.013s
I20260709 13:14:15.089949  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:15.092674  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:15.094165  3299 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.094633  3299 raft_consensus.cc:697] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:14:15.094813  3164 leader_election.cc:343] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.095453  3299 consensus_queue.cc:237] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.095597  3241 raft_consensus.cc:359] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.097175  3241 raft_consensus.cc:385] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.097612  3241 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.098344  3241 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.100147  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:14:15.104913  3165 leader_election.cc:343] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.107973  3241 ts_tablet_manager.cc:1434] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.002s
I20260709 13:14:15.109526  3241 tablet_bootstrap.cc:492] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
W20260709 13:14:15.112885  3461 log.cc:927] Time spent T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:14:15.122139  3241 tablet_bootstrap.cc:654] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.130390  2948 catalog_manager.cc:5697] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 0 to 1, leader changed from <none> to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.135309  3241 tablet_bootstrap.cc:492] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:15.135988  3241 ts_tablet_manager.cc:1403] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.007s
I20260709 13:14:15.112725  3165 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:15.151787  3240 tablet_bootstrap.cc:654] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.155943  3304 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:15.158120  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 53270.9us
I20260709 13:14:15.160216  3125 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:15.165465  3307 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.170588  3370 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:15.157541  3465 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.174134  3465 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.177503  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:14:15.186817  3165 leader_election.cc:343] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.191061  3242 tablet_bootstrap.cc:492] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:15.191547  3242 ts_tablet_manager.cc:1403] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.144s	user 0.023s	sys 0.014s
I20260709 13:14:15.207698  3299 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.208253  3299 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.209432  3465 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:15.210194  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:15.210919  3125 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:15.211161  3241 raft_consensus.cc:359] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.211858  3241 raft_consensus.cc:385] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.212141  3241 raft_consensus.cc:740] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.212292  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:15.213083  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:15.215161  3465 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.215534  3465 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.215871  3465 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.218220  3242 raft_consensus.cc:359] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.218928  3242 raft_consensus.cc:385] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.219206  3242 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.219920  3240 tablet_bootstrap.cc:492] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:15.220382  3240 ts_tablet_manager.cc:1403] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.132s	user 0.008s	sys 0.014s
I20260709 13:14:15.222029  3241 consensus_queue.cc:260] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.224224  3241 ts_tablet_manager.cc:1434] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.088s	user 0.004s	sys 0.004s
I20260709 13:14:15.224911  3125 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 1: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:14:15.225564  3465 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.226030  3242 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.227509  3299 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:15.228101  3242 ts_tablet_manager.cc:1434] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.002s
I20260709 13:14:15.228962  3242 tablet_bootstrap.cc:492] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:15.229043  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:15.230526  3015 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:15.231297  3299 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.232892  3241 tablet_bootstrap.cc:492] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:15.238070  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:15.238368  3240 raft_consensus.cc:359] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.239055  3240 raft_consensus.cc:385] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.239262  3465 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:15.239349  3240 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.238726  3050 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.240097  3240 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.243425  3240 ts_tablet_manager.cc:1434] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 13:14:15.244354  3240 tablet_bootstrap.cc:492] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:15.246515  3050 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:15.247859  3299 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.247901  3165 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:15.249154  3465 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.249670  3465 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:15.250480  3465 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.255213  3241 tablet_bootstrap.cc:654] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.255743  3242 tablet_bootstrap.cc:654] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.255213  3240 tablet_bootstrap.cc:654] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.259851  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:15.264711  3125 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.274547  3240 tablet_bootstrap.cc:492] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:15.274613  3242 tablet_bootstrap.cc:492] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:15.274178  2946 catalog_manager.cc:5697] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 0 to 1, leader changed from <none> to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:15.275066  3240 ts_tablet_manager.cc:1403] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.004s
I20260709 13:14:15.275193  3242 ts_tablet_manager.cc:1403] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.009s
I20260709 13:14:15.275501  3125 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:15.276732  2946 catalog_manager.cc:5697] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 0 to 1, leader changed from <none> to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:15.278733  3242 raft_consensus.cc:359] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.279610  3242 raft_consensus.cc:385] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.279954  3242 raft_consensus.cc:740] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.277570  3240 raft_consensus.cc:359] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.280633  3240 raft_consensus.cc:385] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.280959  3240 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.280989  3242 consensus_queue.cc:260] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.281883  3240 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.283579  3242 ts_tablet_manager.cc:1434] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:15.284554  3241 tablet_bootstrap.cc:492] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:15.284554  3242 tablet_bootstrap.cc:492] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:15.285337  3241 ts_tablet_manager.cc:1403] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.004s
I20260709 13:14:15.289327  3240 ts_tablet_manager.cc:1434] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:14:15.288815  3241 raft_consensus.cc:359] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.290024  3241 raft_consensus.cc:385] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.290319  3240 tablet_bootstrap.cc:492] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:15.290467  3241 raft_consensus.cc:740] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.291396  3241 consensus_queue.cc:260] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.292428  3476 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.293156  3242 tablet_bootstrap.cc:654] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.292879  3476 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.293403  3370 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.293989  3370 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.295442  3476 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:15.296365  3370 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:15.296981  3240 tablet_bootstrap.cc:654] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.300356  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:15.296644  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:15.301838  3465 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:14:15.303794  3164 leader_election.cc:343] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.305554  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:15.306586  3051 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:15.308564  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:14:15.311005  3091 leader_election.cc:343] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.311483  3241 ts_tablet_manager.cc:1434] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:14:15.322916  3241 tablet_bootstrap.cc:492] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:15.320109  3165 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:15.326406  3476 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:14:15.321197  3090 leader_election.cc:343] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.326818  3476 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.327240  3476 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.327037  3090 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:15.328904  3292 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.335399  3476 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.344403  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:15.344621  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:15.345091  3051 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:15.346184  3164 leader_election.cc:343] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.346901  3476 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:15.340932  3241 tablet_bootstrap.cc:654] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.355536  3051 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:15.357285  3165 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:15.358422  3476 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.358961  3476 raft_consensus.cc:697] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:15.360112  3476 consensus_queue.cc:237] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.368767  3403 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:15.382557  3240 tablet_bootstrap.cc:492] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:15.383069  3240 ts_tablet_manager.cc:1403] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.093s	user 0.028s	sys 0.050s
I20260709 13:14:15.385979  3241 tablet_bootstrap.cc:492] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:15.386646  3241 ts_tablet_manager.cc:1403] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.006s
I20260709 13:14:15.388206  3242 tablet_bootstrap.cc:492] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:15.388708  3242 ts_tablet_manager.cc:1403] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.104s	user 0.038s	sys 0.024s
I20260709 13:14:15.386009  3240 raft_consensus.cc:359] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.391607  3240 raft_consensus.cc:385] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.391887  3240 raft_consensus.cc:740] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.392566  3240 consensus_queue.cc:260] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.393563  3370 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:15.393908  3241 raft_consensus.cc:359] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.394924  3241 raft_consensus.cc:385] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.395004  3240 ts_tablet_manager.cc:1434] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:14:15.395263  3241 raft_consensus.cc:740] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.396256  3241 consensus_queue.cc:260] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.397102  3240 tablet_bootstrap.cc:492] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:15.399403  3241 ts_tablet_manager.cc:1434] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 13:14:15.400869  3241 tablet_bootstrap.cc:492] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:15.402653  3242 raft_consensus.cc:359] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.403370  3242 raft_consensus.cc:385] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.403683  3242 raft_consensus.cc:740] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.404480  3242 consensus_queue.cc:260] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.407220  3242 ts_tablet_manager.cc:1434] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.004s
I20260709 13:14:15.407721  3241 tablet_bootstrap.cc:654] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.408205  3242 tablet_bootstrap.cc:492] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:15.412628  3240 tablet_bootstrap.cc:654] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.421540  3242 tablet_bootstrap.cc:654] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.446022  2948 catalog_manager.cc:5697] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 0 to 1, leader changed from <none> to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:15.453408  3370 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:15.488404  2948 catalog_manager.cc:5697] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 0 to 1, leader changed from <none> to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:15.467698  3244 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.492880  3244 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.495523  3244 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:15.489573  3465 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.496829  3465 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.501114  3465 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:15.502538  3199 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.502838  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:15.503711  3126 raft_consensus.cc:2393] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 1: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:15.482060  3476 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.505518  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:15.506006  3476 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:15.507479  3091 leader_election.cc:343] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.466777  3299 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.509809  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:15.509590  3299 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.513670  3299 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:15.516834  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:15.519168  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:15.525926  3165 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:15.528069  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:15.520112  3476 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:15.529171  3475 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.548164  3476 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:14:15.588141  3490 log.cc:927] Time spent T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:14:15.594432  3499 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.596045  3499 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:15.600059  3470 log.cc:927] Time spent T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.100s	user 0.003s	sys 0.033s
I20260709 13:14:15.601768  3499 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:15.599836  3241 tablet_bootstrap.cc:492] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:15.602290  3240 tablet_bootstrap.cc:492] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:15.602805  3241 ts_tablet_manager.cc:1403] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.202s	user 0.036s	sys 0.024s
I20260709 13:14:15.602849  3240 ts_tablet_manager.cc:1403] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.207s	user 0.024s	sys 0.036s
I20260709 13:14:15.608151  3241 raft_consensus.cc:359] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.608933  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:15.610263  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:15.636338  3126 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:15.611263  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:15.628285  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:14:15.640147  3090 leader_election.cc:343] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.631160  3240 raft_consensus.cc:359] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.633332  3304 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.640632  3242 tablet_bootstrap.cc:492] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:15.641004  3240 raft_consensus.cc:385] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.641287  3242 ts_tablet_manager.cc:1403] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.233s	user 0.034s	sys 0.071s
I20260709 13:14:15.641335  3240 raft_consensus.cc:740] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.642118  3241 raft_consensus.cc:385] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.642426  3241 raft_consensus.cc:740] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.643105  3241 consensus_queue.cc:260] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.643381  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:15.643987  3197 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:15.708316  3196 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.647161  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:15.644291  3050 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
W20260709 13:14:15.710695  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 63601.8us
I20260709 13:14:15.706358  3241 ts_tablet_manager.cc:1434] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.103s	user 0.004s	sys 0.005s
I20260709 13:14:15.711721  3502 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.715453  3502 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.715807  3502 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.715937  3241 tablet_bootstrap.cc:492] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:15.654557  3242 raft_consensus.cc:359] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.721242  3242 raft_consensus.cc:385] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.647459  3240 consensus_queue.cc:260] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.723016  3240 ts_tablet_manager.cc:1434] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.119s	user 0.017s	sys 0.015s
I20260709 13:14:15.723892  3240 tablet_bootstrap.cc:492] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:15.721803  3242 raft_consensus.cc:740] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.726006  3502 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.678467  3280 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
W20260709 13:14:15.729149  3015 leader_election.cc:343] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.728971  3501 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:15.726260  3242 consensus_queue.cc:260] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.731604  3242 ts_tablet_manager.cc:1434] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.090s	user 0.010s	sys 0.014s
I20260709 13:14:15.742072  3090 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:15.731709  3241 tablet_bootstrap.cc:654] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.660501  3304 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
I20260709 13:14:15.739732  3498 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:15.746352  3240 tablet_bootstrap.cc:654] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.746503  3465 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:15.748255  3244 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.748754  3244 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.749248  3244 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.754544  3242 tablet_bootstrap.cc:492] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:15.755827  3443 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.756489  3443 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.761951  3091 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:15.763000  3502 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:15.764461  3506 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.764885  3506 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.765215  3506 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.767125  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:15.767328  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:15.768625  3499 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.769265  3499 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:15.775978  3015 leader_election.cc:343] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.776327  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:15.773090  3443 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:15.780606  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:14:15.782064  3090 leader_election.cc:343] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:15.783327  3015 leader_election.cc:343] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.784170  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:15.786095  3199 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:15.789109  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:15.790645  3505 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.791105  3505 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.791535  3505 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.792058  3499 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:15.801414  3505 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.804455  3242 tablet_bootstrap.cc:654] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.804926  3465 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:15.812012  3241 tablet_bootstrap.cc:492] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:15.812503  3241 ts_tablet_manager.cc:1403] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.097s	user 0.009s	sys 0.005s
I20260709 13:14:15.815202  3241 raft_consensus.cc:359] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.815917  3241 raft_consensus.cc:385] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.816182  3241 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.816820  3241 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.819370  3241 ts_tablet_manager.cc:1434] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:14:15.820026  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:15.820686  3197 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.821014  3505 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:15.807790  3244 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.808626  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:15.827212  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:15.827845  3199 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:15.829226  3015 leader_election.cc:343] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.832681  3197 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:15.836841  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:15.838007  3443 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.837679  3506 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.838551  3443 raft_consensus.cc:697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:15.839372  3125 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 1: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:15.839426  3443 consensus_queue.cc:237] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.842375  3199 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:15.843703  3090 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:15.844264  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:15.844542  3499 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.844972  3501 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.845121  3499 raft_consensus.cc:697] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:15.846119  3499 consensus_queue.cc:237] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.851257  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:15.852550  3244 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:15.855404  3242 tablet_bootstrap.cc:492] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:15.855968  3242 ts_tablet_manager.cc:1403] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.102s	user 0.009s	sys 0.004s
I20260709 13:14:15.859258  3242 raft_consensus.cc:359] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.860242  3242 raft_consensus.cc:385] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.860543  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:15.865485  3475 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:15.881379  3242 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.866056  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:15.866825  3506 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:14:15.882349  3090 leader_election.cc:343] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.882151  3242 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:15.867820  3091 leader_election.cc:343] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.883173  3091 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:15.884682  3292 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.886855  3242 ts_tablet_manager.cc:1434] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:14:15.888561  3242 tablet_bootstrap.cc:492] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:15.890961  3280 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:15.894675  3242 tablet_bootstrap.cc:654] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.896160  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:15.896987  3048 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 1: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:15.900486  3091 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:15.901340  3292 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.869705  3240 tablet_bootstrap.cc:492] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:15.820236  3241 tablet_bootstrap.cc:492] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:15.876529  3499 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.904474  3240 ts_tablet_manager.cc:1403] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.181s	user 0.040s	sys 0.009s
I20260709 13:14:15.918175  3499 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.920728  3241 tablet_bootstrap.cc:654] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:15.923413  3091 leader_election.cc:343] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.927630  3499 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:15.929812  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:15.931759  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:15.933482  3091 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:15.934334  3244 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.933101  2946 catalog_manager.cc:5697] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.940642  3240 raft_consensus.cc:359] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.941331  3240 raft_consensus.cc:385] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.941609  3240 raft_consensus.cc:740] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.944777  2949 catalog_manager.cc:5697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 0 to 1, leader changed from <none> to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.943334  3242 tablet_bootstrap.cc:492] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:15.947189  3242 ts_tablet_manager.cc:1403] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.000s
I20260709 13:14:15.949820  3240 consensus_queue.cc:260] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.952260  3240 ts_tablet_manager.cc:1434] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.000s
I20260709 13:14:15.953164  3240 tablet_bootstrap.cc:492] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:15.955601  3123 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.984205  3242 raft_consensus.cc:359] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.984941  3242 raft_consensus.cc:385] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.985252  3242 raft_consensus.cc:740] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.987135  3280 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:15.988175  3240 tablet_bootstrap.cc:654] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.990254  3242 consensus_queue.cc:260] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:15.993374  3241 tablet_bootstrap.cc:492] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:15.993908  3241 ts_tablet_manager.cc:1403] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.174s	user 0.018s	sys 0.018s
I20260709 13:14:15.995535  3242 ts_tablet_manager.cc:1434] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.001s
I20260709 13:14:15.997062  3242 tablet_bootstrap.cc:492] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:15.999369  3241 raft_consensus.cc:359] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.000131  3241 raft_consensus.cc:385] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.000430  3241 raft_consensus.cc:740] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.003435  3242 tablet_bootstrap.cc:654] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.001135  3241 consensus_queue.cc:260] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.005323  3241 ts_tablet_manager.cc:1434] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:14:16.007073  3241 tablet_bootstrap.cc:492] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:16.015141  3240 tablet_bootstrap.cc:492] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:16.015271  3242 tablet_bootstrap.cc:492] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:16.015699  3240 ts_tablet_manager.cc:1403] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.001s
I20260709 13:14:16.015828  3242 ts_tablet_manager.cc:1403] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:14:16.016243  3241 tablet_bootstrap.cc:654] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.019397  3240 raft_consensus.cc:359] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.020143  3240 raft_consensus.cc:385] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.020408  3240 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.020952  3242 raft_consensus.cc:359] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.021180  3240 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.021826  3242 raft_consensus.cc:385] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.022400  3242 raft_consensus.cc:740] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.023033  3242 consensus_queue.cc:260] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.023917  3240 ts_tablet_manager.cc:1434] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:16.025126  3242 ts_tablet_manager.cc:1434] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:14:16.025328  3240 tablet_bootstrap.cc:492] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:16.026094  3242 tablet_bootstrap.cc:492] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:16.033488  3242 tablet_bootstrap.cc:654] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:16.033480  2997 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:16.035346  3240 tablet_bootstrap.cc:654] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.039655  3241 tablet_bootstrap.cc:492] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:16.039930  3242 tablet_bootstrap.cc:492] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:16.040261  3241 ts_tablet_manager.cc:1403] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.034s	user 0.004s	sys 0.017s
I20260709 13:14:16.040493  3242 ts_tablet_manager.cc:1403] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 13:14:16.042676  3240 tablet_bootstrap.cc:492] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:16.043211  3240 ts_tablet_manager.cc:1403] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.005s
I20260709 13:14:16.043432  3242 raft_consensus.cc:359] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.044256  3242 raft_consensus.cc:385] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.043955  3241 raft_consensus.cc:359] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.044570  3242 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.044898  3241 raft_consensus.cc:385] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.087908  3241 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.090288  3241 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.137635  3280 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.138628  3280 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.163120  3244 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.163731  3244 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.179087  3244 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:16.196591  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:16.197896  3199 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:16.202067  3090 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:16.203433  3292 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:16.203908  3292 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.204361  3292 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.233242  3280 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:16.242499  3242 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.245854  3241 ts_tablet_manager.cc:1434] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.205s	user 0.014s	sys 0.000s
I20260709 13:14:16.248752  3241 tablet_bootstrap.cc:492] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:16.254635  3240 raft_consensus.cc:359] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.255686  3240 raft_consensus.cc:385] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.256083  3240 raft_consensus.cc:740] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.263856  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:16.270810  3240 consensus_queue.cc:260] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.272856  3242 ts_tablet_manager.cc:1434] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.232s	user 0.005s	sys 0.017s
I20260709 13:14:16.273161  3240 ts_tablet_manager.cc:1434] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.230s	user 0.018s	sys 0.006s
I20260709 13:14:16.279971  3240 tablet_bootstrap.cc:492] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:16.299232  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:16.292385  3499 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.312785  3242 tablet_bootstrap.cc:492] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:16.315747  3241 tablet_bootstrap.cc:654] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.319630  3499 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:16.324000  3091 leader_election.cc:343] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.332619  3504 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.333220  3504 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.322283  3499 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:16.340420  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:16.343358  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:16.345679  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:16.351146  3050 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:16.349613  3504 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:16.353221  3091 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:16.352602  3394 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.357885  3504 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:16.357765  3394 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.357313  3244 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:16.362138  3244 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.362506  3244 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.363116  3304 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.363591  3304 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.364329  3394 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:16.365867  3304 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:16.366698  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:16.367456  3124 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:16.337922  3292 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.374794  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:16.375777  3197 raft_consensus.cc:2393] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 1: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:16.378624  3242 tablet_bootstrap.cc:654] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.378888  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:16.380200  3443 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:16.380551  3443 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.380700  3394 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.380926  3443 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.381217  3394 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.383540  3394 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:16.384238  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:16.384963  3124 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:16.385440  3050 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.386571  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:16.387437  3199 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:16.388717  3123 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 1: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:16.391934  3164 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:16.393934  3304 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:16.393868  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:16.394469  3304 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.394680  3124 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:16.395813  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:16.394876  3304 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.396785  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:16.397491  3051 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:16.397941  3504 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:16.398515  3504 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.400935  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:16.401261  3504 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.402433  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:16.403838  3240 tablet_bootstrap.cc:654] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.404844  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:14:16.408248  3165 leader_election.cc:343] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.411128  3292 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:16.421329  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:16.423255  3244 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:16.424728  3091 leader_election.cc:343] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.415342  3164 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:14:16.446309  3015 leader_election.cc:343] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.457996  3280 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:16.464669  3015 consensus_peers.cc:597] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.465370  3280 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:16.466068  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 73036.3us
I20260709 13:14:16.467550  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:16.468420  3048 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.471362  3394 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:16.472080  3244 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:16.478914  3292 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:16.486609  3443 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.489266  3504 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.490993  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:16.492205  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:16.533967  3123 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.536162  3504 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:16.528993  3280 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.537873  3280 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.540330  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:16.541234  3122 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.544718  3280 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:16.502447  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:16.495811  3443 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:16.502336  3506 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.054s
W20260709 13:14:16.563258  3015 leader_election.cc:343] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.582684  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:16.583694  3193 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.588238  3123 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
W20260709 13:14:16.577479  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 47610.6us
I20260709 13:14:16.575628  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:16.589932  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:16.591751  3242 tablet_bootstrap.cc:492] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:16.592156  3241 tablet_bootstrap.cc:492] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:16.599542  3242 ts_tablet_manager.cc:1403] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.287s	user 0.026s	sys 0.050s
I20260709 13:14:16.587313  3304 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.599826  3241 ts_tablet_manager.cc:1403] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.352s	user 0.028s	sys 0.018s
I20260709 13:14:16.605577  3198 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 1: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:14:16.606092  3304 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:16.606948  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:16.599598  3504 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:16.607769  3504 raft_consensus.cc:697] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:16.607514  3242 raft_consensus.cc:359] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.608295  3242 raft_consensus.cc:385] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.608862  3504 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.614899  3242 raft_consensus.cc:740] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.618443  3242 consensus_queue.cc:260] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.622088  3241 raft_consensus.cc:359] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.626423  3241 raft_consensus.cc:385] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.626863  3241 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.628826  3241 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.634325  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:16.635186  3123 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:16.648496  3241 ts_tablet_manager.cc:1434] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 13:14:16.650264  3241 tablet_bootstrap.cc:492] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:16.604836  3048 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
W20260709 13:14:16.656090  3165 leader_election.cc:343] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.663223  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:16.663796  3122 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:16.664052  3051 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 1: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:16.671944  3240 tablet_bootstrap.cc:492] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:16.672624  3240 ts_tablet_manager.cc:1403] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.393s	user 0.016s	sys 0.009s
I20260709 13:14:16.680986  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:16.681181  3240 raft_consensus.cc:359] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.681921  3240 raft_consensus.cc:385] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.682232  3240 raft_consensus.cc:740] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.682992  3240 consensus_queue.cc:260] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.685196  3240 ts_tablet_manager.cc:1434] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 13:14:16.687774  3304 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:16.688195  3304 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.688546  3304 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.688670  3091 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:16.690215  3242 ts_tablet_manager.cc:1434] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.001s
I20260709 13:14:16.691830  3241 tablet_bootstrap.cc:654] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.687192  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:16.672396  3193 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:16.693423  3292 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:16.694257  3292 raft_consensus.cc:697] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:16.695645  3240 tablet_bootstrap.cc:492] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:16.695407  3292 consensus_queue.cc:237] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.691337  3242 tablet_bootstrap.cc:492] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:16.718158  3200 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:16.754501  3090 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:16.756325  3498 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:16.757520  3244 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:16.758029  3244 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:16.758351  3505 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.758786  3244 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.758903  3505 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.759997  3304 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:16.757296  3229 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.1.227.190:44821, user_credentials={real_user=slave}} blocked reactor thread for 45560.3us
I20260709 13:14:16.761340  3505 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:16.763470  3498 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:16.784233  3498 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.797231  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:16.798492  3123 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 1: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:16.802721  3240 tablet_bootstrap.cc:654] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.806146  3304 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:16.814963  3241 tablet_bootstrap.cc:492] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:16.815642  3241 ts_tablet_manager.cc:1403] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.166s	user 0.011s	sys 0.014s
I20260709 13:14:16.821169  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:16.821228  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:16.822229  3120 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.822458  3164 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:16.823318  3304 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:16.825140  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:16.831780  3120 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
W20260709 13:14:16.832840  3015 leader_election.cc:343] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.833001  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:16.835708  3304 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:16.836623  3304 raft_consensus.cc:697] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:16.840071  3242 tablet_bootstrap.cc:654] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.841239  3537 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:16.842582  3015 leader_election.cc:343] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.841728  3537 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.845368  3537 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:16.843050  3015 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:16.845679  3304 consensus_queue.cc:237] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.846268  3443 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:16.951021  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:14:16.954430  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 106215us
I20260709 13:14:16.959628  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:16.960623  3120 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 1: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:16.969796  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:16.972260  3499 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.955689  3241 raft_consensus.cc:359] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.977664  3241 raft_consensus.cc:385] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.977979  3241 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.978662  3241 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.972903  3499 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:16.982494  3165 leader_election.cc:343] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.985469  3241 ts_tablet_manager.cc:1434] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.169s	user 0.009s	sys 0.000s
I20260709 13:14:16.984143  3499 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:16.988655  3241 tablet_bootstrap.cc:492] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:16.990032  3240 tablet_bootstrap.cc:492] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:16.990548  3240 ts_tablet_manager.cc:1403] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.295s	user 0.037s	sys 0.022s
I20260709 13:14:16.990381  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:16.992570  2946 catalog_manager.cc:5697] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 0 to 1, leader changed from <none> to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:16.994464  3242 tablet_bootstrap.cc:492] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:16.998108  3242 ts_tablet_manager.cc:1403] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.307s	user 0.019s	sys 0.033s
I20260709 13:14:16.999182  2946 catalog_manager.cc:5697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 0 to 1, leader changed from <none> to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:17.000161  3091 leader_election.cc:343] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.001127  3242 raft_consensus.cc:359] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.001928  3242 raft_consensus.cc:385] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.002233  3242 raft_consensus.cc:740] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.002949  3242 consensus_queue.cc:260] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.002749  2949 catalog_manager.cc:5697] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 0 to 1, leader changed from <none> to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.005456  3242 ts_tablet_manager.cc:1434] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:16.995935  3241 tablet_bootstrap.cc:654] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.995748  3240 raft_consensus.cc:359] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:16.995630  3165 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:17.006801  3242 tablet_bootstrap.cc:492] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:17.006902  3240 raft_consensus.cc:385] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.007371  3240 raft_consensus.cc:740] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.008222  3537 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.013278  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:17.016188  3505 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.016849  3242 tablet_bootstrap.cc:654] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.016729  3505 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.019937  3505 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.020717  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:14:17.022264  3015 leader_election.cc:343] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.023708  3537 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.024237  3242 tablet_bootstrap.cc:492] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
W20260709 13:14:17.023994  3090 leader_election.cc:343] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.008249  3240 consensus_queue.cc:260] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.024688  3090 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:17.025986  3499 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.026706  3240 ts_tablet_manager.cc:1434] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.003s
I20260709 13:14:17.027098  3241 tablet_bootstrap.cc:492] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:17.027806  3240 tablet_bootstrap.cc:492] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:17.027878  3242 ts_tablet_manager.cc:1403] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.004s
I20260709 13:14:17.027843  3241 ts_tablet_manager.cc:1403] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.009s
I20260709 13:14:17.030633  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:17.030623  3242 raft_consensus.cc:359] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:17.032380  3015 leader_election.cc:343] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.032828  3242 raft_consensus.cc:385] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.033298  3242 raft_consensus.cc:740] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.032971  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:17.034113  3242 consensus_queue.cc:260] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.035193  3443 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.036386  3242 ts_tablet_manager.cc:1434] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.002s
I20260709 13:14:17.037444  3242 tablet_bootstrap.cc:492] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:17.037513  3241 raft_consensus.cc:359] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.038292  3241 raft_consensus.cc:385] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.038585  3241 raft_consensus.cc:740] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.041178  3241 consensus_queue.cc:260] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.044783  3242 tablet_bootstrap.cc:654] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.045956  3241 ts_tablet_manager.cc:1434] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:14:17.047049  3241 tablet_bootstrap.cc:492] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:17.053661  3241 tablet_bootstrap.cc:654] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.053890  3240 tablet_bootstrap.cc:654] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.060277  3502 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.064147  3505 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:17.082177  3242 tablet_bootstrap.cc:492] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:17.082741  3242 ts_tablet_manager.cc:1403] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.015s
I20260709 13:14:17.083096  3240 tablet_bootstrap.cc:492] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:17.083576  3240 ts_tablet_manager.cc:1403] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.002s
I20260709 13:14:17.085786  3242 raft_consensus.cc:359] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.086450  3240 raft_consensus.cc:359] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.087203  3240 raft_consensus.cc:385] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.087482  3240 raft_consensus.cc:740] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.088194  3240 consensus_queue.cc:260] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.089880  3240 ts_tablet_manager.cc:1434] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:14:17.090863  3240 tablet_bootstrap.cc:492] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:17.092459  3242 raft_consensus.cc:385] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.092736  3242 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.093343  3242 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.095755  3242 ts_tablet_manager.cc:1434] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:14:17.096690  3242 tablet_bootstrap.cc:492] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:17.100869  3292 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:17.106107  3241 tablet_bootstrap.cc:492] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:17.106863  3241 ts_tablet_manager.cc:1403] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.004s
I20260709 13:14:17.112017  3242 tablet_bootstrap.cc:654] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.112077  3537 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.115566  3537 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.117843  3240 tablet_bootstrap.cc:654] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.118592  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:17.119479  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:14:17.120117  3165 leader_election.cc:343] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.120209  3120 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:17.118676  3537 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:17.121492  3164 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:17.122334  3304 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.122745  3304 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.123147  3304 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.114822  3241 raft_consensus.cc:359] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.123924  3241 raft_consensus.cc:385] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.124325  3241 raft_consensus.cc:740] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.125347  3241 consensus_queue.cc:260] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.127705  3242 tablet_bootstrap.cc:492] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:17.127440  3537 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.128335  3242 ts_tablet_manager.cc:1403] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.003s
I20260709 13:14:17.128319  3537 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.131417  3242 raft_consensus.cc:359] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.132148  3242 raft_consensus.cc:385] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.133669  3242 raft_consensus.cc:740] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.133750  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:17.134577  3242 consensus_queue.cc:260] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.135350  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:17.136194  3051 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:17.137185  3242 ts_tablet_manager.cc:1434] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:17.138331  3242 tablet_bootstrap.cc:492] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:17.138904  3304 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:17.138218  3164 leader_election.cc:343] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.141227  3304 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:17.142819  3165 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:17.144513  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:17.144979  3537 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:17.145874  3537 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.146245  3242 tablet_bootstrap.cc:654] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.146231  3537 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.146436  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:17.146840  3537 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.147099  3122 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.145074  3051 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.165850  3122 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:17.168758  2947 catalog_manager.cc:5697] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.171133  3241 ts_tablet_manager.cc:1434] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 13:14:17.168390  3051 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:17.171988  3164 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:17.173689  3538 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.174216  3538 raft_consensus.cc:697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:17.175072  3538 consensus_queue.cc:237] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.180857  3240 tablet_bootstrap.cc:492] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:17.181382  3240 ts_tablet_manager.cc:1403] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.091s	user 0.009s	sys 0.015s
W20260709 13:14:17.181833  2997 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:17.170483  2947 catalog_manager.cc:5697] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.184052  3240 raft_consensus.cc:359] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.184755  3240 raft_consensus.cc:385] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.185014  3240 raft_consensus.cc:740] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.185488  3242 tablet_bootstrap.cc:492] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:17.187043  3242 ts_tablet_manager.cc:1403] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.022s
I20260709 13:14:17.187251  3241 tablet_bootstrap.cc:492] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:17.190255  3242 raft_consensus.cc:359] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.191156  3242 raft_consensus.cc:385] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.191514  3242 raft_consensus.cc:740] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.191359  3531 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.192545  3240 consensus_queue.cc:260] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.192938  3242 consensus_queue.cc:260] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.195669  3242 ts_tablet_manager.cc:1434] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:14:17.198015  3241 tablet_bootstrap.cc:654] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.195729  3240 ts_tablet_manager.cc:1434] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:14:17.201624  3240 tablet_bootstrap.cc:492] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:17.203325  3537 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.208027  3531 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.214108  3240 tablet_bootstrap.cc:654] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.196822  3242 tablet_bootstrap.cc:492] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:17.220736  3531 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.221280  3531 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.224490  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:14:17.225881  3091 leader_election.cc:343] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.226797  3531 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.227365  3242 tablet_bootstrap.cc:654] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:17.229880  3091 consensus_peers.cc:597] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:17.231657  3240 tablet_bootstrap.cc:492] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:17.232111  3240 ts_tablet_manager.cc:1403] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:14:17.243249  3240 raft_consensus.cc:359] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.245625  3240 raft_consensus.cc:385] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.245958  3240 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.246613  3240 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.250629  3240 ts_tablet_manager.cc:1434] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:14:17.234685  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:17.251657  3240 tablet_bootstrap.cc:492] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:17.258908  3242 tablet_bootstrap.cc:492] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:17.259545  3242 ts_tablet_manager.cc:1403] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.003s
I20260709 13:14:17.260136  2946 catalog_manager.cc:5697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 0 to 1, leader changed from <none> to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:17.262151  3090 leader_election.cc:343] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.262485  3242 raft_consensus.cc:359] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.263473  3242 raft_consensus.cc:385] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.263736  3240 tablet_bootstrap.cc:654] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.263830  3242 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.264773  3242 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.262636  3090 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:17.270565  3244 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.271723  3242 ts_tablet_manager.cc:1434] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:14:17.272953  3242 tablet_bootstrap.cc:492] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:17.275303  3502 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:17.276073  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:17.276782  3122 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.279521  3242 tablet_bootstrap.cc:654] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.289093  3502 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.289633  3502 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.291503  3242 tablet_bootstrap.cc:492] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:17.291937  3502 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.293785  3242 ts_tablet_manager.cc:1403] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.013s
I20260709 13:14:17.294476  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:17.294833  3502 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.295408  3502 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.297127  3242 raft_consensus.cc:359] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.297520  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:17.297930  3242 raft_consensus.cc:385] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.298331  3242 raft_consensus.cc:740] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.299039  3242 consensus_queue.cc:260] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.301252  3242 ts_tablet_manager.cc:1434] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:14:17.302577  3242 tablet_bootstrap.cc:492] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:17.303272  3502 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:14:17.308840  3015 leader_election.cc:343] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.310720  3242 tablet_bootstrap.cc:654] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.310889  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:17.315891  3240 tablet_bootstrap.cc:492] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:17.316531  3240 ts_tablet_manager.cc:1403] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.000s
I20260709 13:14:17.320168  3240 raft_consensus.cc:359] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.321128  3240 raft_consensus.cc:385] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.321496  3240 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
W20260709 13:14:17.320561  3015 leader_election.cc:343] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.322180  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:17.322580  3240 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.322203  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:17.324770  3443 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:17.325420  3015 leader_election.cc:343] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.326536  3280 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.326728  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:17.326825  3443 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:17.327385  3051 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.327153  3280 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.330336  3280 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:17.325438  3242 tablet_bootstrap.cc:492] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:17.331540  3242 ts_tablet_manager.cc:1403] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.006s
I20260709 13:14:17.332455  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:14:17.334144  3164 leader_election.cc:343] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.336611  3240 ts_tablet_manager.cc:1434] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 13:14:17.335109  3051 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
W20260709 13:14:17.339691  3015 leader_election.cc:343] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.341580  3242 raft_consensus.cc:359] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.342532  3242 raft_consensus.cc:385] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.342769  3242 raft_consensus.cc:740] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.343322  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:17.344141  3502 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.338044  3240 tablet_bootstrap.cc:492] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:17.353003  3242 consensus_queue.cc:260] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.355883  3242 ts_tablet_manager.cc:1434] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:14:17.357216  3242 tablet_bootstrap.cc:492] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:17.358563  3240 tablet_bootstrap.cc:654] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.367436  3122 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:17.368553  3242 tablet_bootstrap.cc:654] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.368829  3537 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:17.371786  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:17.372490  3051 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:17.372506  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:17.373631  3280 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.374114  3280 raft_consensus.cc:697] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:17.374851  3280 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.375789  3506 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.376253  3506 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.378690  3506 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.380043  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:17.381336  3051 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:17.382632  3091 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:17.383607  3531 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.384039  3531 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.384485  3531 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.384701  3165 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:17.386022  3537 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.386428  3537 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.386790  3537 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.399916  3531 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.407546  3242 tablet_bootstrap.cc:492] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:17.408253  3242 ts_tablet_manager.cc:1403] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.008s
I20260709 13:14:17.412169  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:14:17.415899  3090 leader_election.cc:343] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.416846  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:17.417806  3531 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.419934  3242 raft_consensus.cc:359] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.422179  3242 raft_consensus.cc:385] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.422559  3242 raft_consensus.cc:740] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
W20260709 13:14:17.424575  3090 leader_election.cc:343] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.425586  3241 tablet_bootstrap.cc:492] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:17.426277  3241 ts_tablet_manager.cc:1403] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.239s	user 0.049s	sys 0.062s
I20260709 13:14:17.427284  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:17.427758  3051 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.435048  3242 consensus_queue.cc:260] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.439599  3292 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.440150  3292 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.442234  3292 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.442430  3051 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
W20260709 13:14:17.444469  3165 consensus_peers.cc:597] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:17.443879  3091 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:17.445377  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:17.445689  3292 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.446259  3292 raft_consensus.cc:697] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:17.446712  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:17.442891  3241 raft_consensus.cc:359] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.448637  3091 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:17.448882  3241 raft_consensus.cc:385] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.449251  3241 raft_consensus.cc:740] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.449657  3531 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.447386  3292 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.448457  3242 ts_tablet_manager.cc:1434] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:14:17.451320  3242 tablet_bootstrap.cc:492] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:17.449923  3241 consensus_queue.cc:260] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.453382  3241 ts_tablet_manager.cc:1434] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:14:17.455530  3241 tablet_bootstrap.cc:492] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:17.461285  3242 tablet_bootstrap.cc:654] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.463034  3537 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.465608  3537 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:17.466650  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:14:17.467904  3164 leader_election.cc:343] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.468225  3240 tablet_bootstrap.cc:492] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:17.468015  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:17.468708  3240 ts_tablet_manager.cc:1403] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.131s	user 0.031s	sys 0.029s
I20260709 13:14:17.468967  3050 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.469977  3241 tablet_bootstrap.cc:654] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.473836  3240 raft_consensus.cc:359] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.474588  3240 raft_consensus.cc:385] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.474862  3240 raft_consensus.cc:740] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.475517  3240 consensus_queue.cc:260] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.478722  3240 ts_tablet_manager.cc:1434] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:14:17.479696  3240 tablet_bootstrap.cc:492] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:17.482393  3050 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:17.483700  3165 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:17.484772  3304 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.485383  3304 raft_consensus.cc:697] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:17.486581  3304 consensus_queue.cc:237] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.497057  2947 catalog_manager.cc:5697] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.497989  3280 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.499176  3240 tablet_bootstrap.cc:654] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.496277  2946 catalog_manager.cc:5697] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 0 to 1, leader changed from <none> to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.517055  3579 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.517608  3579 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.519708  3579 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.521588  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:17.524396  3579 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.524667  3242 tablet_bootstrap.cc:492] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:17.525133  3242 ts_tablet_manager.cc:1403] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.015s
I20260709 13:14:17.524916  3579 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.526937  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:17.528553  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:17.534952  3443 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.536826  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:17.537665  3242 raft_consensus.cc:359] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:17.538484  3015 leader_election.cc:343] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.538794  3242 raft_consensus.cc:385] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.539819  3242 raft_consensus.cc:740] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.540647  3242 consensus_queue.cc:260] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.540867  3124 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.542075  3242 ts_tablet_manager.cc:1434] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.005s
I20260709 13:14:17.542522  3579 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.542686  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:17.543043  3242 tablet_bootstrap.cc:492] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
W20260709 13:14:17.543915  3015 leader_election.cc:343] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.544351  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:17.546093  3292 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.546375  3443 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.546718  3292 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.547729  3240 tablet_bootstrap.cc:492] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:17.548241  3240 ts_tablet_manager.cc:1403] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.069s	user 0.017s	sys 0.010s
I20260709 13:14:17.548736  3242 tablet_bootstrap.cc:654] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.550963  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:17.551093  3240 raft_consensus.cc:359] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.552894  3240 raft_consensus.cc:385] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.553300  3240 raft_consensus.cc:740] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.552336  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:17.554195  3050 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:17.554332  3240 consensus_queue.cc:260] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.555559  3091 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:17.556452  3506 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:17.556871  3506 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.556949  3240 ts_tablet_manager.cc:1434] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:17.557302  3506 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:17.558565  3240 tablet_bootstrap.cc:492] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:17.560158  3241 tablet_bootstrap.cc:492] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:17.560631  3241 ts_tablet_manager.cc:1403] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.105s	user 0.009s	sys 0.009s
I20260709 13:14:17.549525  3292 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.551734  3193 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:17.565726  3240 tablet_bootstrap.cc:654] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.571211  3241 raft_consensus.cc:359] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.572219  3241 raft_consensus.cc:385] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.572576  3241 raft_consensus.cc:740] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.574074  3241 consensus_queue.cc:260] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.592185  3506 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.595607  3241 ts_tablet_manager.cc:1434] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.002s
I20260709 13:14:17.596567  3506 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.597811  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:17.598582  3050 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:17.603370  3241 tablet_bootstrap.cc:492] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:17.608484  2949 catalog_manager.cc:5697] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 0 to 1, leader changed from <none> to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.609695  3050 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:17.611183  3091 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:17.612758  3531 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:17.613440  3240 tablet_bootstrap.cc:492] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:17.613168  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:17.613907  3240 ts_tablet_manager.cc:1403] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.056s	user 0.020s	sys 0.011s
I20260709 13:14:17.613864  3193 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 2
I20260709 13:14:17.613265  3531 raft_consensus.cc:697] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:17.615615  3531 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.617148  3240 raft_consensus.cc:359] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.617810  3240 raft_consensus.cc:385] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.618081  3240 raft_consensus.cc:740] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.618719  3240 consensus_queue.cc:260] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.622229  3242 tablet_bootstrap.cc:492] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:17.622751  3242 ts_tablet_manager.cc:1403] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.004s
I20260709 13:14:17.624125  3193 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:17.627118  3242 raft_consensus.cc:359] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.627899  3242 raft_consensus.cc:385] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.628199  3242 raft_consensus.cc:740] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.629074  3531 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.629554  3531 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.630525  3240 ts_tablet_manager.cc:1434] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:14:17.631520  3240 tablet_bootstrap.cc:492] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:17.633852  3292 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.634003  3538 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.634060  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:17.634416  3292 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:17.635632  3091 leader_election.cc:343] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.637236  3531 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.637392  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:17.638695  3292 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.634653  3538 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.638034  3050 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:17.640072  3240 tablet_bootstrap.cc:654] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.642653  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:17.643831  3091 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:17.645143  3538 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:17.646286  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:14:17.647687  3164 leader_election.cc:343] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.645848  3242 consensus_queue.cc:260] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.644984  3531 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.651396  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:17.652244  3242 ts_tablet_manager.cc:1434] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:14:17.650342  3531 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.653580  3531 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.659489  3240 tablet_bootstrap.cc:492] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:17.659983  3240 ts_tablet_manager.cc:1403] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.008s
I20260709 13:14:17.660830  3242 tablet_bootstrap.cc:492] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
W20260709 13:14:17.665104  3090 leader_election.cc:343] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.665544  3090 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:17.664633  3240 raft_consensus.cc:359] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.666805  3240 raft_consensus.cc:385] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.667092  3240 raft_consensus.cc:740] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.667871  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:17.667824  3240 consensus_queue.cc:260] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.668627  3051 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:17.668804  3506 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:17.667897  3090 leader_election.cc:343] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.670047  3240 ts_tablet_manager.cc:1434] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:14:17.668108  3531 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.670996  3240 tablet_bootstrap.cc:492] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:17.673728  3242 tablet_bootstrap.cc:654] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.677203  3240 tablet_bootstrap.cc:654] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.675624  3531 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.677066  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:17.678632  3050 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.679561  3531 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.680157  3531 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.682979  3531 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.683252  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:17.683904  3051 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:17.685099  3091 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:17.690173  3531 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.690721  3531 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.691051  3531 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.692085  3240 tablet_bootstrap.cc:492] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:17.692580  3240 ts_tablet_manager.cc:1403] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.012s
I20260709 13:14:17.694334  3242 tablet_bootstrap.cc:492] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:17.694748  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:17.694869  3165 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:17.694901  3242 ts_tablet_manager.cc:1403] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.009s
I20260709 13:14:17.696067  3579 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.694368  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:17.696517  3579 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.699574  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:17.700116  3579 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:14:17.701010  3015 leader_election.cc:343] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.702476  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:17.702736  3594 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.703166  3594 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.703516  3594 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.703558  3242 raft_consensus.cc:359] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.704250  3242 raft_consensus.cc:385] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.704552  3242 raft_consensus.cc:740] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
W20260709 13:14:17.705159  3015 leader_election.cc:343] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.705298  3242 consensus_queue.cc:260] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.705615  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:14:17.705821  3090 leader_election.cc:343] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.707442  3242 ts_tablet_manager.cc:1434] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.001s
I20260709 13:14:17.708281  3050 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:17.708796  3240 raft_consensus.cc:359] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:17.709100  3090 leader_election.cc:343] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.709180  3443 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.709443  3240 raft_consensus.cc:385] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.709805  3240 raft_consensus.cc:740] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.710453  3240 consensus_queue.cc:260] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.712504  3240 ts_tablet_manager.cc:1434] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.000s
I20260709 13:14:17.713441  3240 tablet_bootstrap.cc:492] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:17.714658  2947 catalog_manager.cc:5697] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 2, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 2 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.708493  3241 tablet_bootstrap.cc:654] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.717648  3242 tablet_bootstrap.cc:492] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:17.719760  3091 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:17.721774  3506 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.722832  3506 raft_consensus.cc:697] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:17.723788  3506 consensus_queue.cc:237] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.730257  3594 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.736451  3538 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:14:17.738927  3594 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:17.739960  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:17.740134  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:17.740592  3122 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.740770  3050 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.742466  3240 tablet_bootstrap.cc:654] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.745195  3531 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.747592  3531 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.750216  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:17.750636  3051 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.754463  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:17.755198  3242 tablet_bootstrap.cc:654] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:17.756716  3090 leader_election.cc:343] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.759431  3051 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:17.760507  3091 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:17.763263  3050 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:17.769308  3051 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.771727  3531 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.772850  3531 raft_consensus.cc:697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:17.775061  3531 consensus_queue.cc:237] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.775365  3537 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:17.791254  3165 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:17.791461  3122 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:17.792099  3537 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.792666  3537 raft_consensus.cc:697] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:17.793622  3537 consensus_queue.cc:237] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.796239  3505 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.796849  3505 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.798419  2947 catalog_manager.cc:5697] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.799156  3505 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.800611  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:14:17.802505  3015 leader_election.cc:343] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.804353  3241 tablet_bootstrap.cc:492] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:17.805104  3241 ts_tablet_manager.cc:1403] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.208s	user 0.020s	sys 0.028s
I20260709 13:14:17.809302  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:14:17.811029  3015 leader_election.cc:343] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.811476  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:17.812618  3505 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.814546  3240 tablet_bootstrap.cc:492] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:17.814558  3242 tablet_bootstrap.cc:492] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:17.815033  3240 ts_tablet_manager.cc:1403] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.004s
I20260709 13:14:17.815862  3242 ts_tablet_manager.cc:1403] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.108s	user 0.015s	sys 0.000s
I20260709 13:14:17.808234  3241 raft_consensus.cc:359] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.818228  3241 raft_consensus.cc:385] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.818542  3241 raft_consensus.cc:740] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.819270  3241 consensus_queue.cc:260] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.826108  3537 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.827373  3241 ts_tablet_manager.cc:1434] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:14:17.837148  3240 raft_consensus.cc:359] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.847513  3240 raft_consensus.cc:385] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.848049  3240 raft_consensus.cc:740] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.854467  3241 tablet_bootstrap.cc:492] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:17.847997  2947 catalog_manager.cc:5697] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 0 to 1, leader changed from <none> to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.862071  3443 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:17.864264  3443 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.893796  3242 raft_consensus.cc:359] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.894800  3242 raft_consensus.cc:385] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.895169  3242 raft_consensus.cc:740] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.897879  3244 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.898396  3244 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.903218  3506 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.903766  3506 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.909432  3506 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.897701  3242 consensus_queue.cc:260] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.828552  3537 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.912417  3242 ts_tablet_manager.cc:1434] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.002s
I20260709 13:14:17.912354  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:17.913529  3049 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:17.913795  3242 tablet_bootstrap.cc:492] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:17.916750  3240 consensus_queue.cc:260] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.917774  3531 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.918431  3240 ts_tablet_manager.cc:1434] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.103s	user 0.008s	sys 0.002s
I20260709 13:14:17.918218  3531 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.918905  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:17.920405  3241 tablet_bootstrap.cc:654] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.922114  3051 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 1: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:14:17.916297  3091 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:17.923594  3537 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:17.925282  3240 tablet_bootstrap.cc:492] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:17.951510  3242 tablet_bootstrap.cc:654] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.926685  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:17.934105  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:17.937417  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:17.939415  3244 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.940577  3531 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.958060  3498 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.958617  3498 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.959333  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:17.942644  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:17.960777  3498 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.961612  3050 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:17.961922  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:17.961772  2949 catalog_manager.cc:5697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:17.963239  3015 leader_election.cc:343] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.964694  3240 tablet_bootstrap.cc:654] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.925685  3443 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:17.954427  3611 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.965974  3611 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.966399  3611 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.967104  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:17.968942  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:14:17.970397  3015 leader_election.cc:343] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.970902  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:17.971771  3498 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:17.972062  3443 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.974002  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:17.974843  3048 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 1: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:17.978355  3091 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:17.981878  3499 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.982265  3499 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.982620  3499 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.986677  3244 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:17.985553  3594 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:14:17.996559  3611 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:17.998502  3242 tablet_bootstrap.cc:492] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:17.999048  3242 ts_tablet_manager.cc:1403] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.086s	user 0.016s	sys 0.008s
I20260709 13:14:18.002326  3611 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:18.003074  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:18.003670  3050 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.005124  3242 raft_consensus.cc:359] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.005887  3242 raft_consensus.cc:385] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.006166  3242 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.005478  3048 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.006846  3242 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.008512  3242 ts_tablet_manager.cc:1434] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:14:18.009495  3242 tablet_bootstrap.cc:492] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:18.011050  3050 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:18.012220  3091 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:18.012969  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:18.013010  3611 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:18.013805  3611 raft_consensus.cc:697] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:18.014074  3165 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:18.015275  3304 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.014907  3611 consensus_queue.cc:237] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.001691  3499 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.017470  3499 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:18.018687  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:18.023341  3242 tablet_bootstrap.cc:654] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:18.024916  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 50721.9us
W20260709 13:14:18.032891  3090 leader_election.cc:343] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.025213  3304 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:18.027392  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:18.036768  3050 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.040417  3241 tablet_bootstrap.cc:492] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:18.028138  3240 tablet_bootstrap.cc:492] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:18.041033  3241 ts_tablet_manager.cc:1403] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.187s	user 0.028s	sys 0.015s
I20260709 13:14:18.041663  3240 ts_tablet_manager.cc:1403] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.117s	user 0.005s	sys 0.014s
I20260709 13:14:18.046926  3050 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:18.044751  3240 raft_consensus.cc:359] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.050910  3240 raft_consensus.cc:385] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.051520  3240 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.052894  3091 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:18.052394  3242 tablet_bootstrap.cc:492] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:18.053953  3242 ts_tablet_manager.cc:1403] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.000s
I20260709 13:14:18.054278  3594 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.054819  3090 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:18.056792  3537 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.058516  3242 raft_consensus.cc:359] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.059270  3242 raft_consensus.cc:385] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:14:18.059475  3090 leader_election.cc:343] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.059548  3242 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.058691  3611 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:18.060938  3615 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.053020  3240 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.062052  3242 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.058876  3241 raft_consensus.cc:359] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.063650  3241 raft_consensus.cc:385] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.063943  3241 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.063874  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:18.065536  3241 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.068686  3241 ts_tablet_manager.cc:1434] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:14:18.069622  3241 tablet_bootstrap.cc:492] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:18.063028  3611 raft_consensus.cc:697] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:18.073845  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:18.074383  3611 consensus_queue.cc:237] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:18.079670  3090 leader_election.cc:343] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:18.080714  3090 leader_election.cc:343] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.076903  3615 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:18.084868  3240 ts_tablet_manager.cc:1434] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.002s
I20260709 13:14:18.085703  3240 tablet_bootstrap.cc:492] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
W20260709 13:14:18.094131  3090 consensus_peers.cc:597] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:18.111340  3242 ts_tablet_manager.cc:1434] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:14:18.126317  3242 tablet_bootstrap.cc:492] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:18.110302  3538 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:14:18.142663  3594 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.143168  3594 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.146023  3594 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:18.154148  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:18.154449  3240 tablet_bootstrap.cc:654] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.156061  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:14:18.159672  3165 leader_election.cc:343] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.154842  3125 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 0.
I20260709 13:14:18.165588  3241 tablet_bootstrap.cc:654] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:18.176682  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 69743.2us
I20260709 13:14:18.176159  2946 catalog_manager.cc:5697] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.185855  2946 catalog_manager.cc:5697] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.193809  3164 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:18.156337  3615 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:14:18.207557  3051 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:14:18.210638  3197 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:14:18.202847  3537 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:18.240589  3532 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:18.242420  3537 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:18.261133  3620 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:14:18.254230  3537 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.279923  3280 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.285027  3611 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:14:18.282065  3506 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.280886  3498 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.305215  3498 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.295007  3506 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.317920  3531 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:18.319118  3506 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:18.325358  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:14:18.333007  3090 leader_election.cc:343] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:18.334050  3090 consensus_peers.cc:597] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:18.342087  3627 log.cc:927] Time spent T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.093s	user 0.002s	sys 0.000s
I20260709 13:14:18.317977  3498 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:18.347831  3241 tablet_bootstrap.cc:492] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:18.348344  3241 ts_tablet_manager.cc:1403] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.279s	user 0.024s	sys 0.008s
I20260709 13:14:18.349547  3242 tablet_bootstrap.cc:654] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.358484  3241 raft_consensus.cc:359] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.359247  3241 raft_consensus.cc:385] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.360044  3240 tablet_bootstrap.cc:492] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:18.360621  3240 ts_tablet_manager.cc:1403] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.275s	user 0.011s	sys 0.006s
I20260709 13:14:18.359537  3241 raft_consensus.cc:740] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.362000  3241 consensus_queue.cc:260] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:18.370424  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 73450.1us
W20260709 13:14:18.372318  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 75749.9us
I20260709 13:14:18.382293  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:18.383088  3125 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:18.379935  3505 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.399257  3505 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.393308  3579 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.403687  3579 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.462603  3579 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:18.424211  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:18.470839  3241 ts_tablet_manager.cc:1434] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.122s	user 0.011s	sys 0.015s
I20260709 13:14:18.475873  3280 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.484393  3304 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.484871  3304 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.486984  3240 raft_consensus.cc:359] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.488090  3240 raft_consensus.cc:385] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.488479  3240 raft_consensus.cc:740] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.494421  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:18.489413  3240 consensus_queue.cc:260] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.501497  3304 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:18.500424  3621 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:18.498536  3505 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:18.511574  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:14:18.519671  2997 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:18.523500  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:18.510748  3621 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.524336  3119 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:18.534229  3240 ts_tablet_manager.cc:1434] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.173s	user 0.006s	sys 0.011s
I20260709 13:14:18.594784  3242 tablet_bootstrap.cc:492] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:18.787701  3242 ts_tablet_manager.cc:1403] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.665s	user 0.026s	sys 0.015s
I20260709 13:14:18.789573  3621 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.702281  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:18.797937  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:18.615545  3537 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.833473  3192 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.838125  3242 raft_consensus.cc:359] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.838816  3537 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:18.835903  3642 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.838812  3242 raft_consensus.cc:385] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.840481  3242 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.841188  3242 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.840277  3642 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:18.846480  3642 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:18.854365  3242 ts_tablet_manager.cc:1434] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.003s
I20260709 13:14:18.872989  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:18.876099  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:18.892535  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:14:18.898589  3015 leader_election.cc:343] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.865631  3642 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:14:18.905699  3579 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:14:18.932699  3090 consensus_peers.cc:597] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:18.935057  3090 consensus_peers.cc:597] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:18.929170  3579 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.936154  3579 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:18.939015  3090 leader_election.cc:343] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:18.944823  3015 leader_election.cc:343] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:18.956182  3015 leader_election.cc:343] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:18.972470  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 51165.6us
I20260709 13:14:18.996357  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:18.985571  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:18.986414  3621 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.013077  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:18.997272  3043 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.019608  3050 raft_consensus.cc:2393] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 1: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:19.021319  3164 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:19.017036  3120 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.043023  3621 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:14:19.057533  3077 tablet.cc:2406] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:14:19.077363  3304 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:19.112424  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 153488us
I20260709 13:14:19.117769  3043 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:19.113900  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:19.130911  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:19.143972  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:19.144690  3121 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.151125  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:19.112573  3579 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.156630  3579 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:19.159981  3241 tablet_bootstrap.cc:492] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
W20260709 13:14:19.178191  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 52579.3us
I20260709 13:14:19.180935  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:19.181649  3117 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.182276  3241 tablet_bootstrap.cc:654] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:19.187865  3015 leader_election.cc:343] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.188911  3240 tablet_bootstrap.cc:492] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:19.191340  3117 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:19.194197  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:14:19.222942  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 51338.2us
W20260709 13:14:19.228404  3091 leader_election.cc:343] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.229084  3091 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:14:19.240715  3015 leader_election.cc:343] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.253829  3015 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:19.257972  3648 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:14:19.258426  3120 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:19.250207  3654 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:14:19.315639  3644 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:19.326928  3242 tablet_bootstrap.cc:492] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e: Bootstrap starting.
I20260709 13:14:19.327098  3091 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:19.342767  3121 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:19.343930  3615 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:19.353505  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 112816us
W20260709 13:14:19.354449  3641 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.095s	user 0.005s	sys 0.005s
I20260709 13:14:19.368345  3240 tablet_bootstrap.cc:654] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.370487  3241 tablet_bootstrap.cc:492] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:19.370983  3241 ts_tablet_manager.cc:1403] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.211s	user 0.009s	sys 0.005s
I20260709 13:14:19.376850  3164 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:19.380719  3280 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:19.381219  3280 raft_consensus.cc:697] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:19.382017  3280 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.385203  3242 tablet_bootstrap.cc:654] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.390805  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:19.391700  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:19.424070  3505 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:19.424640  3505 raft_consensus.cc:697] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:19.432169  3665 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:19.435477  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 43831.2us
I20260709 13:14:19.448501  3505 consensus_queue.cc:237] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.449055  3579 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:19.449582  3579 raft_consensus.cc:697] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:19.450395  3579 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.452611  3241 raft_consensus.cc:359] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.453472  3241 raft_consensus.cc:385] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.453928  3241 raft_consensus.cc:740] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
W20260709 13:14:19.460318  3015 leader_election.cc:343] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.460995  3241 consensus_queue.cc:260] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.491915  3498 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:19.493547  3241 ts_tablet_manager.cc:1434] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.122s	user 0.011s	sys 0.000s
W20260709 13:14:19.481750  3669 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:14:19.492553  3498 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.518308  3280 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.519040  3280 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.540357  3240 tablet_bootstrap.cc:492] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:19.541036  3240 ts_tablet_manager.cc:1403] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.352s	user 0.033s	sys 0.021s
I20260709 13:14:19.544799  3498 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:19.548799  3242 tablet_bootstrap.cc:492] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e: No bootstrap required, opened a new log
I20260709 13:14:19.549324  3242 ts_tablet_manager.cc:1403] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e: Time spent bootstrapping tablet: real 0.223s	user 0.013s	sys 0.014s
I20260709 13:14:19.558101  3280 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:19.549959  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:19.586367  3240 raft_consensus.cc:359] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.590008  3242 raft_consensus.cc:359] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.590837  3242 raft_consensus.cc:385] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.587348  3240 raft_consensus.cc:385] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.591886  3240 raft_consensus.cc:740] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.591200  3242 raft_consensus.cc:740] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.631174  3240 consensus_queue.cc:260] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.635411  3240 ts_tablet_manager.cc:1434] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.002s
I20260709 13:14:19.636200  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 187) took 1157 ms. Trace:
I20260709 13:14:19.636308  3242 consensus_queue.cc:260] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.637319  3665 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.638587  3242 ts_tablet_manager.cc:1434] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.003s
I20260709 13:14:19.637823  3665 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.636653  3125 rpcz_store.cc:276] 0709 13:14:18.478454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:18.478613 (+   159us) service_pool.cc:224] Handling call
0709 13:14:18.478956 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:18.479426 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:18.479460 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:18.482917 (+  3457us) log.cc:844] Serialized 26 byte log entry
0709 13:14:19.162855 (+679938us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b1800031fc0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:14:19.269277 (+106422us) raft_consensus.cc:1645] Marking committed up to 0
0709 13:14:19.269334 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:19.269427 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:19.559298 (+289871us) raft_consensus.cc:1685] finished
0709 13:14:19.559314 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:19.636118 (+ 76804us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2702,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":4343,"spinlock_wait_cycles":5320576,"thread_start_us":106217,"threads_started":1,"wal-append.queue_time_us":887110}
I20260709 13:14:19.644078  3665 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:19.633987  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:19.658038  3241 tablet_bootstrap.cc:492] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:19.666262  3241 tablet_bootstrap.cc:654] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.670291  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:19.690331  3241 tablet_bootstrap.cc:492] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:19.690788  3241 ts_tablet_manager.cc:1403] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.000s
I20260709 13:14:19.692492  3240 tablet_bootstrap.cc:492] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:19.693249  3241 raft_consensus.cc:359] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.693794  3241 raft_consensus.cc:385] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.694070  3241 raft_consensus.cc:740] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.694700  3241 consensus_queue.cc:260] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.698801  3240 tablet_bootstrap.cc:654] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.699242  3241 ts_tablet_manager.cc:1434] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
W20260709 13:14:19.701018  2997 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:19.702745  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:19.700249  3241 tablet_bootstrap.cc:492] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:19.714108  3241 tablet_bootstrap.cc:654] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.718438  3240 tablet_bootstrap.cc:492] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:19.718905  3240 ts_tablet_manager.cc:1403] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.001s
I20260709 13:14:19.720065  3200 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:19.721587  3015 leader_election.cc:343] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.723104  3240 raft_consensus.cc:359] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.723819  3240 raft_consensus.cc:385] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.724112  3240 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.724870  3240 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.726702  3240 ts_tablet_manager.cc:1434] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:14:19.727788  3240 tablet_bootstrap.cc:492] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904: Bootstrap starting.
I20260709 13:14:19.736549  3240 tablet_bootstrap.cc:654] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.743448  3164 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:19.747758  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:19.752840  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:19.753532  3120 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:19.755388  3241 tablet_bootstrap.cc:492] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:19.758574  3241 ts_tablet_manager.cc:1403] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.000s
I20260709 13:14:19.823750  3595 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.824872  3623 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.824618  3241 raft_consensus.cc:359] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.846127  3241 raft_consensus.cc:385] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.846499  3241 raft_consensus.cc:740] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.846271  3595 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.847224  3241 consensus_queue.cc:260] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.848599  3595 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:19.849459  3241 ts_tablet_manager.cc:1434] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.091s	user 0.005s	sys 0.001s
I20260709 13:14:19.838894  3644 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.850683  3644 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.852720  3644 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:19.854470  3241 tablet_bootstrap.cc:492] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:19.855345  3665 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.855602  3532 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.855895  3665 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.856096  3532 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.858856  3665 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:14:19.776724  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 45584.9us
I20260709 13:14:19.846120  3623 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.861289  3623 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:19.824054  2946 catalog_manager.cc:5697] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 0 to 1, leader changed from <none> to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:19.859373  3532 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:19.868356  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:19.873155  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:19.876005  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:19.876943  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:19.880762  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:19.882000  3241 tablet_bootstrap.cc:654] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.892202  3240 tablet_bootstrap.cc:492] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904: No bootstrap required, opened a new log
I20260709 13:14:19.892689  3240 ts_tablet_manager.cc:1403] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904: Time spent bootstrapping tablet: real 0.165s	user 0.039s	sys 0.084s
I20260709 13:14:19.885803  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:19.890111  3537 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:19.895323  3240 raft_consensus.cc:359] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.895985  3240 raft_consensus.cc:385] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.896234  3240 raft_consensus.cc:740] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.896885  3240 consensus_queue.cc:260] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.898694  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:19.898941  3240 ts_tablet_manager.cc:1434] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:14:19.899698  3622 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:19.900668  3662 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:19.901086  3662 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.901419  3662 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:19.903697  3015 leader_election.cc:343] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.911810  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:19.924642  3050 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:19.924712  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:19.912110  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:19.926119  3048 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 0.
I20260709 13:14:19.912568  3662 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.929960  3662 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:19.921911  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:19.925457  3120 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
I20260709 13:14:19.927497  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:14:19.931973  3015 leader_election.cc:343] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.932098  3123 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 0.
W20260709 13:14:19.928069  3090 leader_election.cc:343] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:19.933092  3090 leader_election.cc:343] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:19.937000  3015 consensus_peers.cc:597] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:19.942147  3165 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:19.944159  3241 tablet_bootstrap.cc:492] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:19.944664  3241 ts_tablet_manager.cc:1403] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.001s
I20260709 13:14:19.938634  3091 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:19.947275  3091 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:19.947675  3532 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:19.948035  3537 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:19.948092  3532 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.948880  3532 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.955001  3241 raft_consensus.cc:359] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.955793  3241 raft_consensus.cc:385] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.956085  3241 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.956797  3241 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.963569  3644 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:19.964022  3644 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.964377  3644 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.972321  3644 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:19.975592  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:19.986404  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:19.987041  3120 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.991241  3193 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.993768  3120 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:19.963119  3241 ts_tablet_manager.cc:1434] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:14:19.996757  3241 tablet_bootstrap.cc:492] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:19.999217  3537 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:20.003314  3537 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:14:19.993901  3015 leader_election.cc:343] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.007326  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:20.011234  3645 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:20.012315  3645 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.007973  3532 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:20.012887  3645 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.017982  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:20.018790  3665 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:20.019177  3665 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.019260  3644 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:20.019573  3665 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.028777  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:20.029547  3050 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.032232  3665 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:20.037855  3050 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:20.040938  3241 tablet_bootstrap.cc:654] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.057925  3091 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:20.053665  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:20.034451  3665 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:14:20.065969  3090 leader_election.cc:343] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.039211  3532 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:20.039740  3595 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.038977  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:20.073967  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:20.065384  3643 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:20.056079  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:20.081094  3595 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:20.105782  3595 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:20.109056  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:20.087987  3622 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:20.109935  3121 raft_consensus.cc:2393] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 1: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:14:20.115036  3090 leader_election.cc:343] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.087303  3645 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:20.087661  3662 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:14:20.114353  3048 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 1: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:14:20.125425  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 50502.3us
I20260709 13:14:20.112104  3643 raft_consensus.cc:697] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:20.151249  3091 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:20.148193  3645 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:20.189587  3644 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.125190  3622 raft_consensus.cc:697] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:20.203826  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:20.205492  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:20.202350  3643 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:20.223615  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:20.243299  3121 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.232406  3622 consensus_queue.cc:237] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:20.266634  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:20.283885  3165 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:20.288316  3121 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:20.290068  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:20.291072  3124 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 1: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:20.295979  3537 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:20.307155  3015 leader_election.cc:343] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.307296  3579 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:20.303982  3194 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.311522  3241 tablet_bootstrap.cc:492] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:20.310573  2947 catalog_manager.cc:5697] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 0 to 1, leader changed from <none> to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:20.314880  3537 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.356027  3241 ts_tablet_manager.cc:1403] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.360s	user 0.022s	sys 0.037s
I20260709 13:14:20.359189  3241 raft_consensus.cc:359] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:20.359985  3241 raft_consensus.cc:385] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.360280  3241 raft_consensus.cc:740] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
W20260709 13:14:20.362869  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 55738.5us
W20260709 13:14:20.364108  3015 leader_election.cc:343] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.363770  3241 consensus_queue.cc:260] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:20.374316  3241 ts_tablet_manager.cc:1434] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:14:20.376921  3241 tablet_bootstrap.cc:492] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:20.377660  2947 catalog_manager.cc:5697] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 0 to 1, leader changed from <none> to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:20.378652  3594 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.383286  3594 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:20.388298  3241 tablet_bootstrap.cc:654] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.396962  3594 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:20.397226  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:20.407240  3594 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.407938  3594 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:20.410640  3594 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:20.411747  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:20.412644  3118 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 1: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:20.413419  3241 tablet_bootstrap.cc:492] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:20.413949  3241 ts_tablet_manager.cc:1403] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.008s
I20260709 13:14:20.418908  3241 raft_consensus.cc:359] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:20.419763  3241 raft_consensus.cc:385] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.420087  3241 raft_consensus.cc:740] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.420799  3241 consensus_queue.cc:260] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:20.423290  3241 ts_tablet_manager.cc:1434] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:14:20.424350  3241 tablet_bootstrap.cc:492] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:20.431869  3241 tablet_bootstrap.cc:654] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.451076  3241 tablet_bootstrap.cc:492] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:20.451503  3241 ts_tablet_manager.cc:1403] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.001s
I20260709 13:14:20.453522  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:20.457299  3579 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:20.463675  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:20.464485  3623 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.465179  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:20.465641  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:20.466461  3623 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:20.466972  3623 raft_consensus.cc:697] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:20.467921  3623 consensus_queue.cc:237] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:20.475518  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 45391.8us
I20260709 13:14:20.486418  3241 raft_consensus.cc:359] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:20.487221  3241 raft_consensus.cc:385] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.487566  3241 raft_consensus.cc:740] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.488304  3241 consensus_queue.cc:260] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:20.490734  3241 ts_tablet_manager.cc:1434] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 13:14:20.491735  3241 tablet_bootstrap.cc:492] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:20.493005  3165 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:20.494033  3537 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:20.497087  3165 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:20.498397  3651 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.511343  3651 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.512720  3241 tablet_bootstrap.cc:654] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.547511  3194 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.557315  2948 catalog_manager.cc:5697] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 0 to 1, leader changed from <none> to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:20.560118  2948 catalog_manager.cc:5697] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 0 to 1, leader changed from <none> to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:20.572158  3241 tablet_bootstrap.cc:492] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:20.572715  3241 ts_tablet_manager.cc:1403] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.081s	user 0.039s	sys 0.010s
I20260709 13:14:20.575815  3241 raft_consensus.cc:359] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:20.576624  3241 raft_consensus.cc:385] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.576963  3241 raft_consensus.cc:740] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.577908  3241 consensus_queue.cc:260] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:20.581192  3241 ts_tablet_manager.cc:1434] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 13:14:20.582988  3241 tablet_bootstrap.cc:492] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b: Bootstrap starting.
I20260709 13:14:20.590068  3241 tablet_bootstrap.cc:654] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.596602  3241 tablet_bootstrap.cc:492] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b: No bootstrap required, opened a new log
I20260709 13:14:20.597078  3241 ts_tablet_manager.cc:1403] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:14:20.599256  3241 raft_consensus.cc:359] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:20.599802  3241 raft_consensus.cc:385] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.600049  3241 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.600636  3241 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:20.602591  3241 ts_tablet_manager.cc:1434] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.003s
I20260709 13:14:20.606762  2949 catalog_manager.cc:5697] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:20.772243  3537 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.772797  3537 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:20.812855  3651 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.813656  3651 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:20.816633  3651 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:20.834359  3537 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:21.049346  3656 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.050511  3656 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:21.053253  3656 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:21.148383  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:21.149598  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:21.151180  3126 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 1: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:21.163465  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:21.164347  3120 raft_consensus.cc:2393] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 1: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:21.199373  3715 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:21.225304  3191 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.237711  3724 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.275269  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:21.276144  3045 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 1: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:21.278946  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:21.281028  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:21.290370  3194 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.291699  3045 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 1: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:14:21.288795  2997 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:21.308305  3725 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.327193  3720 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:21.343050  3165 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:21.344151  3537 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:21.352293  3165 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:21.353379  3537 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:21.355078  3165 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:21.356171  3537 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.361084  3730 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.367130  3537 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:21.399129  3733 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:21.852553  3717 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.852973  3717 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:21.854879  3717 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:21.855733  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:21.855859  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:21.856416  3045 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:21.856474  3194 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:21.857554  3091 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:21.858260  3717 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:21.858671  3717 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:21.858964  3717 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.863893  3717 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:21.866133  3717 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:21.866645  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:21.866979  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:21.867178  3045 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.867616  3194 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:21.874536  3194 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:21.875487  3090 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:21.875865  3045 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:21.876124  3717 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:21.877228  3717 raft_consensus.cc:697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:21.878149  3717 consensus_queue.cc:237] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:21.888379  2948 catalog_manager.cc:5697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 0 to 2, leader changed from <none> to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 2 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:22.183552  3221 debug-util.cc:398] Leaking SignalData structure 0x7b080005b620 after lost signal to thread 1937
W20260709 13:14:22.184473  3221 debug-util.cc:398] Leaking SignalData structure 0x7b08001c45e0 after lost signal to thread 2983
W20260709 13:14:22.185504  3221 debug-util.cc:398] Leaking SignalData structure 0x7b08002310c0 after lost signal to thread 3075
W20260709 13:14:22.186220  3221 debug-util.cc:398] Leaking SignalData structure 0x7b0800228b00 after lost signal to thread 3150
W20260709 13:14:22.186869  3221 debug-util.cc:398] Leaking SignalData structure 0x7b08002bc1a0 after lost signal to thread 3224
I20260709 13:14:22.385232  3194 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:14:22.387739  3738 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:22.420475  3043 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:14:22.429059  3738 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:22.968703  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:23.005072  3751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:23.007413  3752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:23.020126  3754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:23.020327  1934 server_base.cc:1061] running on GCE node
I20260709 13:14:23.022437  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:23.022797  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:23.023110  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783602863023088 us; error 0 us; skew 500 ppm
I20260709 13:14:23.023803  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:23.028244  1934 webserver.cc:533] Webserver started at http://127.1.227.132:42353/ using document root <none> and password file <none>
I20260709 13:14:23.028999  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:23.029326  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:23.029785  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:23.031352  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-3-root/instance:
uuid: "e9165fe61ab04bfb9a48889156d5c161"
format_stamp: "Formatted at 2026-07-09 13:14:23 on dist-test-slave-lfdf"
I20260709 13:14:23.037395  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.005s
I20260709 13:14:23.042047  3759 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:23.043228  1934 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:14:23.043628  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-3-root
uuid: "e9165fe61ab04bfb9a48889156d5c161"
format_stamp: "Formatted at 2026-07-09 13:14:23 on dist-test-slave-lfdf"
I20260709 13:14:23.044076  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:23.088486  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:23.090605  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:23.102345  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:23.106297  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:23.106623  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:23.106982  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:23.107288  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:14:23.254377  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.132:43109
I20260709 13:14:23.254513  3823 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.132:43109 every 8 connection(s)
I20260709 13:14:23.260778  1934 auto_leader_rebalancer-test.cc:384] add a tserver: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:23.285696  3824 heartbeater.cc:344] Connected to a master server at 127.1.227.190:44821
I20260709 13:14:23.286373  3824 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:23.287323  3824 heartbeater.cc:507] Master 127.1.227.190:44821 requested a full tablet report, sending...
I20260709 13:14:23.289889  2948 ts_manager.cc:194] Registered new tserver with Master: e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:23.291877  2948 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49738
I20260709 13:14:23.491603  3123 consensus_queue.cc:237] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:23.506671  3191 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:23.510016  3717 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:23.517765  3043 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:23.519949  3717 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:23.529718  3717 raft_consensus.cc:2955] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:23.563969  3191 raft_consensus.cc:2955] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
W20260709 13:14:23.586495  3090 consensus_peers.cc:597] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e1d12e7c2ef94802ad2c1a3390fe2a8e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:23.619762  2948 catalog_manager.cc:5697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.622018  3043 raft_consensus.cc:2955] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:23.664320  3043 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:23.684327  3196 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:23.689976  3123 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:23.693856  3725 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:23.695020  3730 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:23.710047  3015 consensus_peers.cc:597] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1b0bf95c7c28416eb4a727eac91af0d0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:23.720779  3121 raft_consensus.cc:2955] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:23.717234  3730 raft_consensus.cc:2955] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:23.724017  3196 raft_consensus.cc:2955] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:23.743692  2949 catalog_manager.cc:5697] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.784273  3196 consensus_queue.cc:237] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:23.798964  3043 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:23.800715  3748 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:23.799063  3121 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:23.810370  3164 consensus_peers.cc:597] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2254b0c561f4240a9199d1c203568ac. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:23.810978  3748 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:23.823325  3043 raft_consensus.cc:2955] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:23.821424  3748 raft_consensus.cc:2955] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:23.829121  3121 raft_consensus.cc:2955] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:23.850929  3191 consensus_queue.cc:237] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:23.853595  2949 catalog_manager.cc:5697] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904 reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
W20260709 13:14:23.879002  3164 consensus_peers.cc:597] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 172fb190a0d74cd292c08c451255bae2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:23.880806  3050 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:23.880982  3121 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:23.883450  3537 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:23.885169  3537 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:23.902640  3782 raft_consensus.cc:2955] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:23.904302  3043 raft_consensus.cc:2955] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:23.913673  3123 raft_consensus.cc:2955] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:23.922832  3855 ts_tablet_manager.cc:933] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:23.925050  2948 catalog_manager.cc:5697] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:23.982268  3855 tablet_copy_client.cc:323] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.130:38619
I20260709 13:14:24.004899  3136 tablet_copy_service.cc:140] P f20672b2852447a6bc1e137c4dd40904: Received BeginTabletCopySession request for tablet e1d12e7c2ef94802ad2c1a3390fe2a8e from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:55318)
I20260709 13:14:24.005527  3136 tablet_copy_service.cc:161] P f20672b2852447a6bc1e137c4dd40904: Beginning new tablet copy session on tablet e1d12e7c2ef94802ad2c1a3390fe2a8e from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:55318: session id = e9165fe61ab04bfb9a48889156d5c161-e1d12e7c2ef94802ad2c1a3390fe2a8e
I20260709 13:14:24.038920  3136 tablet_copy_source_session.cc:215] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:24.047546  3855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d12e7c2ef94802ad2c1a3390fe2a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.071394  3855 tablet_copy_client.cc:806] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:24.077850  3855 tablet_copy_client.cc:670] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:24.082226  3855 tablet_copy_client.cc:538] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:24.090061  3855 tablet_bootstrap.cc:492] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:24.129956  3855 tablet_bootstrap.cc:492] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:24.131047  3855 tablet_bootstrap.cc:492] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:24.131822  3855 ts_tablet_manager.cc:1403] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.013s
I20260709 13:14:24.135003  3855 raft_consensus.cc:359] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:24.135906  3855 raft_consensus.cc:740] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:24.136641  3855 consensus_queue.cc:260] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:24.139704  3824 heartbeater.cc:499] Master 127.1.227.190:44821 was elected leader, sending a full tablet report...
I20260709 13:14:24.140096  3855 ts_tablet_manager.cc:1434] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:14:24.142634  3136 tablet_copy_service.cc:342] P f20672b2852447a6bc1e137c4dd40904: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-e1d12e7c2ef94802ad2c1a3390fe2a8e received from {username='slave'} at 127.0.0.1:55318
I20260709 13:14:24.143093  3136 tablet_copy_service.cc:434] P f20672b2852447a6bc1e137c4dd40904: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-e1d12e7c2ef94802ad2c1a3390fe2a8e on tablet e1d12e7c2ef94802ad2c1a3390fe2a8e with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:24.184950  3855 ts_tablet_manager.cc:933] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:14:24.187004  3855 tablet_copy_client.cc:323] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.129:44609
I20260709 13:14:24.233404  3061 tablet_copy_service.cc:140] P aaf88538197a49adb8bcf3790309a67e: Received BeginTabletCopySession request for tablet 1b0bf95c7c28416eb4a727eac91af0d0 from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:47488)
I20260709 13:14:24.234016  3061 tablet_copy_service.cc:161] P aaf88538197a49adb8bcf3790309a67e: Beginning new tablet copy session on tablet 1b0bf95c7c28416eb4a727eac91af0d0 from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:47488: session id = e9165fe61ab04bfb9a48889156d5c161-1b0bf95c7c28416eb4a727eac91af0d0
I20260709 13:14:24.243707  3061 tablet_copy_source_session.cc:215] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:24.247442  3855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b0bf95c7c28416eb4a727eac91af0d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.264994  3855 tablet_copy_client.cc:806] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:24.265702  3855 tablet_copy_client.cc:670] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:24.269316  3855 tablet_copy_client.cc:538] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:24.289980  3855 tablet_bootstrap.cc:492] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:24.319540  3862 ts_tablet_manager.cc:933] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:24.342180  3855 tablet_bootstrap.cc:492] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:24.343303  3855 tablet_bootstrap.cc:492] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:24.344338  3855 ts_tablet_manager.cc:1403] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.055s	user 0.036s	sys 0.007s
I20260709 13:14:24.349649  3855 raft_consensus.cc:359] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:24.350723  3855 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:24.351531  3855 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:24.362751  3855 ts_tablet_manager.cc:1434] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:14:24.363919  3862 tablet_copy_client.cc:323] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.131:38665
I20260709 13:14:24.377872  3061 tablet_copy_service.cc:342] P aaf88538197a49adb8bcf3790309a67e: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-1b0bf95c7c28416eb4a727eac91af0d0 received from {username='slave'} at 127.0.0.1:47488
I20260709 13:14:24.378350  3061 tablet_copy_service.cc:434] P aaf88538197a49adb8bcf3790309a67e: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-1b0bf95c7c28416eb4a727eac91af0d0 on tablet 1b0bf95c7c28416eb4a727eac91af0d0 with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:24.385519  3855 ts_tablet_manager.cc:933] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:24.413463  3210 tablet_copy_service.cc:140] P 501fdf2af2bc4b0c971ae880e98f466b: Received BeginTabletCopySession request for tablet f2254b0c561f4240a9199d1c203568ac from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:34728)
I20260709 13:14:24.414193  3210 tablet_copy_service.cc:161] P 501fdf2af2bc4b0c971ae880e98f466b: Beginning new tablet copy session on tablet f2254b0c561f4240a9199d1c203568ac from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:34728: session id = e9165fe61ab04bfb9a48889156d5c161-f2254b0c561f4240a9199d1c203568ac
I20260709 13:14:24.451534  3799 raft_consensus.cc:1217] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:24.489286  3210 tablet_copy_source_session.cc:215] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:24.522140  3855 tablet_copy_client.cc:323] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.131:38665
I20260709 13:14:24.535792  3862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2254b0c561f4240a9199d1c203568ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.543100  3210 tablet_copy_service.cc:140] P 501fdf2af2bc4b0c971ae880e98f466b: Received BeginTabletCopySession request for tablet 172fb190a0d74cd292c08c451255bae2 from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:34728)
I20260709 13:14:24.544991  3210 tablet_copy_service.cc:161] P 501fdf2af2bc4b0c971ae880e98f466b: Beginning new tablet copy session on tablet 172fb190a0d74cd292c08c451255bae2 from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:34728: session id = e9165fe61ab04bfb9a48889156d5c161-172fb190a0d74cd292c08c451255bae2
I20260709 13:14:24.559125  3862 tablet_copy_client.cc:806] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:24.560050  3862 tablet_copy_client.cc:670] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:24.602362  3210 tablet_copy_source_session.cc:215] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:24.621649  3855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172fb190a0d74cd292c08c451255bae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:24.625293  3862 tablet_copy_client.cc:538] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:24.636302  3862 tablet_bootstrap.cc:492] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:24.657785  3855 tablet_copy_client.cc:806] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:24.658391  3855 tablet_copy_client.cc:670] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:24.669876  3855 tablet_copy_client.cc:538] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:24.678085  3855 tablet_bootstrap.cc:492] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:24.733026  3862 tablet_bootstrap.cc:492] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:24.735489  3862 tablet_bootstrap.cc:492] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:24.737447  3862 ts_tablet_manager.cc:1403] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.102s	user 0.031s	sys 0.000s
I20260709 13:14:24.744285  3862 raft_consensus.cc:359] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:24.745148  3862 raft_consensus.cc:740] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:24.750751  3799 raft_consensus.cc:1217] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:24.754743  3855 tablet_bootstrap.cc:492] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:24.755699  3855 tablet_bootstrap.cc:492] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:24.756392  3855 ts_tablet_manager.cc:1403] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.079s	user 0.020s	sys 0.018s
I20260709 13:14:24.745886  3862 consensus_queue.cc:260] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:24.759722  3862 ts_tablet_manager.cc:1434] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:14:24.760547  3855 raft_consensus.cc:359] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:24.761441  3210 tablet_copy_service.cc:342] P 501fdf2af2bc4b0c971ae880e98f466b: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-f2254b0c561f4240a9199d1c203568ac received from {username='slave'} at 127.0.0.1:34728
I20260709 13:14:24.761864  3855 raft_consensus.cc:740] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:24.762147  3210 tablet_copy_service.cc:434] P 501fdf2af2bc4b0c971ae880e98f466b: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-f2254b0c561f4240a9199d1c203568ac on tablet f2254b0c561f4240a9199d1c203568ac with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:24.762491  3855 consensus_queue.cc:260] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:24.765453  3855 ts_tablet_manager.cc:1434] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:14:24.768146  3210 tablet_copy_service.cc:342] P 501fdf2af2bc4b0c971ae880e98f466b: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-172fb190a0d74cd292c08c451255bae2 received from {username='slave'} at 127.0.0.1:34728
I20260709 13:14:24.768612  3210 tablet_copy_service.cc:434] P 501fdf2af2bc4b0c971ae880e98f466b: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-172fb190a0d74cd292c08c451255bae2 on tablet 172fb190a0d74cd292c08c451255bae2 with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:24.787098  3799 raft_consensus.cc:1217] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:24.905355  3799 raft_consensus.cc:1217] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:25.036707  3717 raft_consensus.cc:1064] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:25.039412  3717 consensus_queue.cc:237] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:25.063696  3193 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:25.073709  3834 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:14:25.100342  3799 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:25.131531  3834 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:25.140693  3725 raft_consensus.cc:1064] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:25.148921  3725 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:25.179421  3191 raft_consensus.cc:2955] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:14:25.202872  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 140791us
I20260709 13:14:25.212543  3050 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:25.177434  3717 raft_consensus.cc:2955] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:25.256536  3875 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:25.265492  3799 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:25.266428  3196 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:25.267746  3799 raft_consensus.cc:2955] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:25.270666  3123 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:25.277467  2947 catalog_manager.cc:5697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:14:25.279973  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 44751.1us
I20260709 13:14:25.284392  3725 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:14:25.285655  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 44678.1us
I20260709 13:14:25.286892  3783 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:25.288354  3730 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:25.298326  3537 raft_consensus.cc:1064] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:25.285458  3050 raft_consensus.cc:2955] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:14:25.371896  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 59055.3us
I20260709 13:14:25.373319  3537 consensus_queue.cc:237] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:25.418617  3783 raft_consensus.cc:2955] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:25.430552  3798 raft_consensus.cc:2955] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:25.458536  3885 raft_consensus.cc:1064] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:25.467195  3885 consensus_queue.cc:237] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:25.486020  3118 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:25.487470  3799 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:25.499363  3196 raft_consensus.cc:2955] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:25.501919  3124 raft_consensus.cc:2955] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:25.509652  3045 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:25.509881  3537 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:14:25.512797  3748 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:25.521262  3748 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:14:25.559778  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46421.5us
I20260709 13:14:25.582715  3799 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:25.585676  3537 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:25.591431  3049 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:25.599080  3883 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:25.600028  3120 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:25.609342  3873 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:25.664382  3537 raft_consensus.cc:2955] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:25.698693  3045 raft_consensus.cc:2955] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:25.707782  2946 catalog_manager.cc:5697] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:25.756219  3120 consensus_queue.cc:237] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:25.814693  2949 catalog_manager.cc:5697] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:25.815946  3799 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:25.857107  3042 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:25.836995  3896 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:25.898037  3191 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:26.029600  3799 raft_consensus.cc:2955] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:26.039918  3120 raft_consensus.cc:2955] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:26.032401  3904 raft_consensus.cc:2955] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:14:26.163712  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 121123us
W20260709 13:14:26.415833  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 58656.2us
W20260709 13:14:26.434826  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 48798.2us
I20260709 13:14:26.362488  3798 raft_consensus.cc:2955] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:26.469327  3120 raft_consensus.cc:2955] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:14:26.532757  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 122471us
I20260709 13:14:26.538105  3198 consensus_queue.cc:237] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:26.547267  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 377833us
I20260709 13:14:26.552301  3799 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:26.557403  3876 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:14:26.579463  3046 raft_consensus.cc:2955] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:26.564603  3909 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:14:26.589686  3799 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:26.594090  3126 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:26.614754  3043 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:14:26.616212  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 46685.9us
I20260709 13:14:26.618767  3885 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:26.628499  3885 raft_consensus.cc:2955] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:26.640765  3799 raft_consensus.cc:2955] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:26.643879  3043 raft_consensus.cc:2955] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:26.657644  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f2254b0c561f4240a9199d1c203568ac with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:26.677505  2949 catalog_manager.cc:5697] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.726775  3887 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:26.733764  3887 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:26.821099  3834 raft_consensus.cc:2955] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:26.822916  3198 raft_consensus.cc:2955] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:26.871603  2948 catalog_manager.cc:5697] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:26.879586  3834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:54672 (request call id 59) took 1164 ms. Trace:
I20260709 13:14:26.880170  3834 rpcz_store.cc:276] 0709 13:14:25.729378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.735455 (+  6077us) service_pool.cc:224] Handling call
0709 13:14:25.799851 (+ 64396us) log.cc:844] Serialized 501 byte log entry
0709 13:14:25.836653 (+ 36802us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b18001ec040. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c6522 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:14:26.879470 (+1042817us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14699,"raft.queue_time_us":16960,"raft.run_cpu_time_us":1524,"raft.run_wall_time_us":2966,"spinlock_wait_cycles":24118016}
I20260709 13:14:26.891355  3196 consensus_queue.cc:237] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:26.887570  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e1d12e7c2ef94802ad2c1a3390fe2a8e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:14:26.898025  2934 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet f2254b0c561f4240a9199d1c203568ac with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 13:14:26.903678  3797 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:26.905414  3537 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:26.915524  3887 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:26.916357  3887 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:26.919391  3888 raft_consensus.cc:2955] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:26.921208  3798 raft_consensus.cc:2955] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:26.927395  3121 raft_consensus.cc:2955] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:26.931788  3887 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:26.937361  3799 raft_consensus.cc:2955] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:26.952359  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:26.952458  3885 raft_consensus.cc:2955] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:26.952364  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:26.956820  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:26.930570  2947 catalog_manager.cc:5697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 reported cstate change: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:26.961876  3126 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:26.961577  3797 raft_consensus.cc:2955] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:26.966157  3873 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:26.973084  3120 raft_consensus.cc:2955] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:26.982366  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 172fb190a0d74cd292c08c451255bae2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:26.984553  3111 tablet_service.cc:1558] Processing DeleteTablet for tablet f2254b0c561f4240a9199d1c203568ac with delete_type TABLET_DATA_TOMBSTONED (TS f20672b2852447a6bc1e137c4dd40904 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54672
I20260709 13:14:26.987732  3015 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:26.990451  3922 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:27.003422  3915 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:27.004102  3915 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:27.007257  3915 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:27.008519  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:27.012171  3888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:35708 (request call id 59) took 1158 ms. Trace:
I20260709 13:14:27.012425  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:27.013847  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:27.012709  3888 rpcz_store.cc:276] 0709 13:14:25.853415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.854265 (+   850us) service_pool.cc:224] Handling call
0709 13:14:26.296254 (+441989us) log.cc:844] Serialized 501 byte log entry
0709 13:14:27.012076 (+715822us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7708,"raft.queue_time_us":157155,"raft.run_cpu_time_us":2835,"raft.run_wall_time_us":89330,"thread_start_us":108444,"threads_started":1}
I20260709 13:14:27.016662  3165 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:27.021831  3537 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:27.047670  2946 catalog_manager.cc:5697] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:27.053174  3933 tablet_replica.cc:333] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:14:27.054842  3933 raft_consensus.cc:2243] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.055891  3933 raft_consensus.cc:2272] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.063032  3933 ts_tablet_manager.cc:1916] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:27.073403  2935 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1b0bf95c7c28416eb4a727eac91af0d0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:27.088117  2949 catalog_manager.cc:5697] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:27.101292  3933 ts_tablet_manager.cc:1929] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:27.102383  3933 log.cc:1199] T f2254b0c561f4240a9199d1c203568ac P f20672b2852447a6bc1e137c4dd40904: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-1-root/wals/f2254b0c561f4240a9199d1c203568ac
I20260709 13:14:27.105463  3187 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b0bf95c7c28416eb4a727eac91af0d0 with delete_type TABLET_DATA_TOMBSTONED (TS 501fdf2af2bc4b0c971ae880e98f466b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51690
I20260709 13:14:27.122380  3041 tablet_service.cc:1558] Processing DeleteTablet for tablet e1d12e7c2ef94802ad2c1a3390fe2a8e with delete_type TABLET_DATA_TOMBSTONED (TS aaf88538197a49adb8bcf3790309a67e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35708
I20260709 13:14:27.127876  3037 tablet_service.cc:1558] Processing DeleteTablet for tablet 172fb190a0d74cd292c08c451255bae2 with delete_type TABLET_DATA_TOMBSTONED (TS aaf88538197a49adb8bcf3790309a67e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35708
W20260709 13:14:27.149911  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 60203.8us
I20260709 13:14:27.152894  3936 tablet_replica.cc:333] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:14:27.163400  3936 raft_consensus.cc:2243] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.134109  2934 catalog_manager.cc:5028] TS f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): tablet f2254b0c561f4240a9199d1c203568ac (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:27.164283  3936 raft_consensus.cc:2272] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.153446  3935 tablet_replica.cc:333] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:14:27.165840  3935 raft_consensus.cc:2243] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.172304  3935 raft_consensus.cc:2272] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.167570  3936 ts_tablet_manager.cc:1916] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:27.178746  3935 ts_tablet_manager.cc:1916] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:27.189656  3936 ts_tablet_manager.cc:1929] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:27.190333  3936 log.cc:1199] T e1d12e7c2ef94802ad2c1a3390fe2a8e P aaf88538197a49adb8bcf3790309a67e: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-0-root/wals/e1d12e7c2ef94802ad2c1a3390fe2a8e
I20260709 13:14:27.192281  3936 tablet_replica.cc:333] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:14:27.193420  3936 raft_consensus.cc:2243] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.194243  3936 raft_consensus.cc:2272] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.196967  2935 catalog_manager.cc:5028] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): tablet e1d12e7c2ef94802ad2c1a3390fe2a8e (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:27.199385  3936 ts_tablet_manager.cc:1916] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:27.213397  3936 ts_tablet_manager.cc:1929] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:27.213930  3936 log.cc:1199] T 172fb190a0d74cd292c08c451255bae2 P aaf88538197a49adb8bcf3790309a67e: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-0-root/wals/172fb190a0d74cd292c08c451255bae2
I20260709 13:14:27.215528  2935 catalog_manager.cc:5028] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): tablet 172fb190a0d74cd292c08c451255bae2 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:27.222911  3935 ts_tablet_manager.cc:1929] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:27.223337  3935 log.cc:1199] T 1b0bf95c7c28416eb4a727eac91af0d0 P 501fdf2af2bc4b0c971ae880e98f466b: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-2-root/wals/1b0bf95c7c28416eb4a727eac91af0d0
I20260709 13:14:27.225103  2934 catalog_manager.cc:5028] TS 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): tablet 1b0bf95c7c28416eb4a727eac91af0d0 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:28.211369  3048 consensus_queue.cc:237] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:28.218959  3197 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:28.220153  3015 consensus_peers.cc:597] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12725e4e41614e1292b974e17635f758. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:28.220845  3126 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:28.221033  3918 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:28.223805  3939 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:28.233024  3918 raft_consensus.cc:2955] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:28.236641  3197 raft_consensus.cc:2955] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:28.239797  3121 raft_consensus.cc:2955] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:28.250080  3126 consensus_queue.cc:237] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:28.269126  2947 catalog_manager.cc:5697] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:28.291067  3197 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:28.293215  3938 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:28.298173  3090 consensus_peers.cc:597] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 038f072ecdcc4679a46740d78fb0dbd7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:28.308017  3046 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:28.310429  3875 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:28.336690  3875 raft_consensus.cc:2955] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:28.342150  3048 raft_consensus.cc:2955] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:28.348906  3197 raft_consensus.cc:2955] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:28.371637  2946 catalog_manager.cc:5697] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:28.377578  3048 consensus_queue.cc:237] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:28.391163  3197 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:28.392741  3887 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:28.402391  3121 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:28.406705  3015 consensus_peers.cc:597] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dab74aefe0d74cf5b7b691b15690a40b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:28.408288  3939 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:28.435887  3939 raft_consensus.cc:2955] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:28.438719  3197 raft_consensus.cc:2955] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:28.457757  3126 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:28.459297  3121 raft_consensus.cc:2955] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:28.473806  2947 catalog_manager.cc:5697] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:28.529347  3197 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:28.530253  3090 consensus_peers.cc:597] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: de94f7d51a554137acbf3110ce91f2fc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:28.531314  3048 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:28.533876  3956 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:28.534925  3946 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:28.544629  3956 raft_consensus.cc:2955] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:28.547262  3195 raft_consensus.cc:2955] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:28.547802  3048 raft_consensus.cc:2955] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:28.564205  2947 catalog_manager.cc:5697] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:28.801426  3960 ts_tablet_manager.cc:933] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:14:28.810761  3960 tablet_copy_client.cc:323] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.129:44609
I20260709 13:14:28.813581  3061 tablet_copy_service.cc:140] P aaf88538197a49adb8bcf3790309a67e: Received BeginTabletCopySession request for tablet 12725e4e41614e1292b974e17635f758 from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:47488)
I20260709 13:14:28.814219  3061 tablet_copy_service.cc:161] P aaf88538197a49adb8bcf3790309a67e: Beginning new tablet copy session on tablet 12725e4e41614e1292b974e17635f758 from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:47488: session id = e9165fe61ab04bfb9a48889156d5c161-12725e4e41614e1292b974e17635f758
I20260709 13:14:28.822497  3061 tablet_copy_source_session.cc:215] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:28.826508  3960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12725e4e41614e1292b974e17635f758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:28.827611  3959 ts_tablet_manager.cc:933] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:28.843796  3960 tablet_copy_client.cc:806] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:28.844522  3960 tablet_copy_client.cc:670] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:28.848402  3959 tablet_copy_client.cc:323] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.130:38619
I20260709 13:14:28.850692  3136 tablet_copy_service.cc:140] P f20672b2852447a6bc1e137c4dd40904: Received BeginTabletCopySession request for tablet 038f072ecdcc4679a46740d78fb0dbd7 from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:55318)
I20260709 13:14:28.851413  3136 tablet_copy_service.cc:161] P f20672b2852447a6bc1e137c4dd40904: Beginning new tablet copy session on tablet 038f072ecdcc4679a46740d78fb0dbd7 from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:55318: session id = e9165fe61ab04bfb9a48889156d5c161-038f072ecdcc4679a46740d78fb0dbd7
I20260709 13:14:28.861845  3960 tablet_copy_client.cc:538] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:28.872382  3960 tablet_bootstrap.cc:492] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:28.915907  3960 tablet_bootstrap.cc:492] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:28.917148  3960 tablet_bootstrap.cc:492] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:28.917994  3960 ts_tablet_manager.cc:1403] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.046s	user 0.031s	sys 0.004s
I20260709 13:14:28.922540  3960 raft_consensus.cc:359] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:28.923581  3960 raft_consensus.cc:740] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:28.924398  3960 consensus_queue.cc:260] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:28.935547  3960 ts_tablet_manager.cc:1434] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.007s
I20260709 13:14:28.944814  3061 tablet_copy_service.cc:342] P aaf88538197a49adb8bcf3790309a67e: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-12725e4e41614e1292b974e17635f758 received from {username='slave'} at 127.0.0.1:47488
I20260709 13:14:28.945447  3061 tablet_copy_service.cc:434] P aaf88538197a49adb8bcf3790309a67e: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-12725e4e41614e1292b974e17635f758 on tablet 12725e4e41614e1292b974e17635f758 with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:28.954172  3136 tablet_copy_source_session.cc:215] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:28.957752  3959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 038f072ecdcc4679a46740d78fb0dbd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:28.976783  3959 tablet_copy_client.cc:806] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:28.977483  3959 tablet_copy_client.cc:670] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:28.977550  3960 ts_tablet_manager.cc:933] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:28.979624  3960 tablet_copy_client.cc:323] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.130:38619
I20260709 13:14:28.982019  3959 tablet_copy_client.cc:538] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:28.983933  3136 tablet_copy_service.cc:140] P f20672b2852447a6bc1e137c4dd40904: Received BeginTabletCopySession request for tablet de94f7d51a554137acbf3110ce91f2fc from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:55318)
I20260709 13:14:28.984589  3136 tablet_copy_service.cc:161] P f20672b2852447a6bc1e137c4dd40904: Beginning new tablet copy session on tablet de94f7d51a554137acbf3110ce91f2fc from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:55318: session id = e9165fe61ab04bfb9a48889156d5c161-de94f7d51a554137acbf3110ce91f2fc
I20260709 13:14:28.991338  3959 tablet_bootstrap.cc:492] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:29.006706  3136 tablet_copy_source_session.cc:215] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:29.010598  3960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de94f7d51a554137acbf3110ce91f2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:29.047739  3966 ts_tablet_manager.cc:933] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:14:29.052037  3959 tablet_bootstrap.cc:492] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:29.053480  3959 tablet_bootstrap.cc:492] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:29.055320  3959 ts_tablet_manager.cc:1403] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.012s
I20260709 13:14:29.061321  3966 tablet_copy_client.cc:323] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.129:44609
I20260709 13:14:29.062563  3960 tablet_copy_client.cc:806] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:29.063324  3960 tablet_copy_client.cc:670] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:29.063380  3061 tablet_copy_service.cc:140] P aaf88538197a49adb8bcf3790309a67e: Received BeginTabletCopySession request for tablet dab74aefe0d74cf5b7b691b15690a40b from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:47488)
I20260709 13:14:29.064059  3061 tablet_copy_service.cc:161] P aaf88538197a49adb8bcf3790309a67e: Beginning new tablet copy session on tablet dab74aefe0d74cf5b7b691b15690a40b from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:47488: session id = e9165fe61ab04bfb9a48889156d5c161-dab74aefe0d74cf5b7b691b15690a40b
I20260709 13:14:29.067704  3959 raft_consensus.cc:359] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:29.068850  3959 raft_consensus.cc:740] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:29.070474  3960 tablet_copy_client.cc:538] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:29.070043  3959 consensus_queue.cc:260] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:29.073496  3959 ts_tablet_manager.cc:1434] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 13:14:29.078125  3136 tablet_copy_service.cc:342] P f20672b2852447a6bc1e137c4dd40904: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-038f072ecdcc4679a46740d78fb0dbd7 received from {username='slave'} at 127.0.0.1:55318
I20260709 13:14:29.078651  3136 tablet_copy_service.cc:434] P f20672b2852447a6bc1e137c4dd40904: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-038f072ecdcc4679a46740d78fb0dbd7 on tablet 038f072ecdcc4679a46740d78fb0dbd7 with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:29.089493  3061 tablet_copy_source_session.cc:215] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:29.096168  3966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dab74aefe0d74cf5b7b691b15690a40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:29.105517  3960 tablet_bootstrap.cc:492] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:29.129503  3797 raft_consensus.cc:1217] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:29.139833  3966 tablet_copy_client.cc:806] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:29.140518  3966 tablet_copy_client.cc:670] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:29.147348  3966 tablet_copy_client.cc:538] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:29.158948  3966 tablet_bootstrap.cc:492] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:29.191531  3960 tablet_bootstrap.cc:492] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:29.194134  3960 tablet_bootstrap.cc:492] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:29.194816  3960 ts_tablet_manager.cc:1403] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.092s	user 0.023s	sys 0.014s
I20260709 13:14:29.197814  3960 raft_consensus.cc:359] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:29.198747  3960 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:29.199316  3960 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:29.201222  3960 ts_tablet_manager.cc:1434] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:14:29.221235  3136 tablet_copy_service.cc:342] P f20672b2852447a6bc1e137c4dd40904: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-de94f7d51a554137acbf3110ce91f2fc received from {username='slave'} at 127.0.0.1:55318
I20260709 13:14:29.221681  3136 tablet_copy_service.cc:434] P f20672b2852447a6bc1e137c4dd40904: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-de94f7d51a554137acbf3110ce91f2fc on tablet de94f7d51a554137acbf3110ce91f2fc with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:29.224861  3966 tablet_bootstrap.cc:492] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:29.237341  3966 tablet_bootstrap.cc:492] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:29.243640  3966 ts_tablet_manager.cc:1403] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.085s	user 0.021s	sys 0.004s
I20260709 13:14:29.248558  3966 raft_consensus.cc:359] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:29.249648  3966 raft_consensus.cc:740] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:29.250391  3966 consensus_queue.cc:260] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:29.253151  3966 ts_tablet_manager.cc:1434] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:14:29.258013  3061 tablet_copy_service.cc:342] P aaf88538197a49adb8bcf3790309a67e: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-dab74aefe0d74cf5b7b691b15690a40b received from {username='slave'} at 127.0.0.1:47488
I20260709 13:14:29.258471  3061 tablet_copy_service.cc:434] P aaf88538197a49adb8bcf3790309a67e: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-dab74aefe0d74cf5b7b691b15690a40b on tablet dab74aefe0d74cf5b7b691b15690a40b with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:29.344408  3797 raft_consensus.cc:1217] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:29.370265  3797 raft_consensus.cc:1217] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:29.408449  3797 raft_consensus.cc:1217] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:29.549191  3968 raft_consensus.cc:1064] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:29.552055  3968 consensus_queue.cc:237] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:29.572515  3797 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:29.576973  3126 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:29.577229  3968 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:29.583262  3918 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:29.587822  3198 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:29.608037  3939 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:29.630913  3968 raft_consensus.cc:2955] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:29.632880  3123 raft_consensus.cc:2955] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:29.644366  3198 raft_consensus.cc:2955] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:29.652705  3797 raft_consensus.cc:2955] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:29.669302  2948 catalog_manager.cc:5697] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:29.728569  3046 consensus_queue.cc:237] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:29.734390  3797 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:29.735929  3952 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:29.746399  3198 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:29.747900  3952 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:29.749480  3918 raft_consensus.cc:2955] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:29.765228  3797 raft_consensus.cc:2955] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:29.767681  2935 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 12725e4e41614e1292b974e17635f758 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:29.787155  2946 catalog_manager.cc:5697] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:29.794795  3198 raft_consensus.cc:2955] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:29.807816  3111 tablet_service.cc:1558] Processing DeleteTablet for tablet 12725e4e41614e1292b974e17635f758 with delete_type TABLET_DATA_TOMBSTONED (TS f20672b2852447a6bc1e137c4dd40904 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54672
I20260709 13:14:29.809679  3981 tablet_replica.cc:333] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:14:29.810900  3981 raft_consensus.cc:2243] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:29.812000  3981 raft_consensus.cc:2272] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.815662  3981 ts_tablet_manager.cc:1916] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:29.816524  3934 raft_consensus.cc:1064] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:29.819105  3934 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:29.829424  3195 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:29.830178  3797 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:29.831511  3946 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:29.832533  3046 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:29.834396  3946 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:29.835594  3981 ts_tablet_manager.cc:1929] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:29.836097  3981 log.cc:1199] T 12725e4e41614e1292b974e17635f758 P f20672b2852447a6bc1e137c4dd40904: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-1-root/wals/12725e4e41614e1292b974e17635f758
I20260709 13:14:29.836764  3946 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:29.838058  2934 catalog_manager.cc:5028] TS f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): tablet 12725e4e41614e1292b974e17635f758 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:29.857355  3952 raft_consensus.cc:1064] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:29.860069  3952 consensus_queue.cc:237] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:29.870895  3934 raft_consensus.cc:2955] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:29.882685  3797 raft_consensus.cc:2955] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:29.901158  3046 raft_consensus.cc:2955] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:29.908198  2949 catalog_manager.cc:5697] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:29.934355  3123 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:29.946343  3197 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:29.960619  3046 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:29.969074  3799 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:29.978228  3799 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:29.987056  3946 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:14:29.988565  3938 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:29.978228  3123 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:29.999233  3918 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:30.000593  3956 raft_consensus.cc:2955] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.006305  3934 raft_consensus.cc:1064] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:30.009358  3918 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:30.012274  3048 raft_consensus.cc:2955] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.014680  3918 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:30.018683  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet de94f7d51a554137acbf3110ce91f2fc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:30.035346  3934 consensus_queue.cc:237] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:30.041815  3799 raft_consensus.cc:2955] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.062489  2946 catalog_manager.cc:5697] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.072045  3918 raft_consensus.cc:2955] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.073149  3797 raft_consensus.cc:2955] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.079702  3187 tablet_service.cc:1558] Processing DeleteTablet for tablet de94f7d51a554137acbf3110ce91f2fc with delete_type TABLET_DATA_TOMBSTONED (TS 501fdf2af2bc4b0c971ae880e98f466b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51690
I20260709 13:14:30.109887  3123 raft_consensus.cc:2955] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.104432  2946 catalog_manager.cc:5697] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.110740  3195 raft_consensus.cc:2955] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.116297  3198 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:30.118024  3797 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:30.117833  3946 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:30.119552  3934 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:30.120841  3048 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:30.132002  3938 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:30.141160  3990 tablet_replica.cc:333] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:14:30.154867  3990 raft_consensus.cc:2243] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:30.155893  3990 pending_rounds.cc:70] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b: Trying to abort 1 pending ops.
I20260709 13:14:30.156446  3990 pending_rounds.cc:77] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305637354772865024 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "de94f7d51a554137acbf3110ce91f2fc" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } } }
I20260709 13:14:30.158865  3990 raft_consensus.cc:2917] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:14:30.159329  3990 raft_consensus.cc:2889] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:14:30.159708  3990 raft_consensus.cc:2272] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:30.165160  3938 raft_consensus.cc:2955] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.167922  3990 ts_tablet_manager.cc:1916] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:30.172189  3045 raft_consensus.cc:2955] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.177006  3797 raft_consensus.cc:2955] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.181120  3048 consensus_queue.cc:237] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:30.188934  3799 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:30.187695  3198 raft_consensus.cc:2955] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.191636  3195 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:30.192381  3918 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:30.193912  3939 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:30.201339  3952 raft_consensus.cc:2955] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.208882  3799 raft_consensus.cc:2955] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.222796  3990 ts_tablet_manager.cc:1929] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:30.223358  3990 log.cc:1199] T de94f7d51a554137acbf3110ce91f2fc P 501fdf2af2bc4b0c971ae880e98f466b: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-2-root/wals/de94f7d51a554137acbf3110ce91f2fc
I20260709 13:14:30.200662  2946 catalog_manager.cc:5697] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.219851  3195 raft_consensus.cc:2955] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.225303  2934 catalog_manager.cc:5028] TS 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): tablet de94f7d51a554137acbf3110ce91f2fc (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:30.230495  2935 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dab74aefe0d74cf5b7b691b15690a40b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:30.279713  3123 consensus_queue.cc:237] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:30.280572  2949 catalog_manager.cc:5697] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.295416  3048 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:30.296204  3799 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:30.296406  3111 tablet_service.cc:1558] Processing DeleteTablet for tablet dab74aefe0d74cf5b7b691b15690a40b with delete_type TABLET_DATA_TOMBSTONED (TS f20672b2852447a6bc1e137c4dd40904 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54672
I20260709 13:14:30.297366  3981 tablet_replica.cc:333] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:14:30.298375  3998 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:30.298702  3981 raft_consensus.cc:2243] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:30.300264  3981 raft_consensus.cc:2272] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:30.304786  3981 ts_tablet_manager.cc:1916] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:30.305469  3998 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:30.313634  3997 raft_consensus.cc:2955] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.320668  3981 ts_tablet_manager.cc:1929] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:30.321123  3981 log.cc:1199] T dab74aefe0d74cf5b7b691b15690a40b P f20672b2852447a6bc1e137c4dd40904: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-1-root/wals/dab74aefe0d74cf5b7b691b15690a40b
I20260709 13:14:30.319970  3048 raft_consensus.cc:2955] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.322547  2934 catalog_manager.cc:5028] TS f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): tablet dab74aefe0d74cf5b7b691b15690a40b (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:30.320149  3799 raft_consensus.cc:2955] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.337981  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 038f072ecdcc4679a46740d78fb0dbd7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:30.345834  2948 catalog_manager.cc:5697] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:30.356179  3187 tablet_service.cc:1558] Processing DeleteTablet for tablet 038f072ecdcc4679a46740d78fb0dbd7 with delete_type TABLET_DATA_TOMBSTONED (TS 501fdf2af2bc4b0c971ae880e98f466b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51690
I20260709 13:14:30.357146  3990 tablet_replica.cc:333] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:14:30.358172  3990 raft_consensus.cc:2243] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:30.358855  3990 raft_consensus.cc:2272] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:30.368854  3990 ts_tablet_manager.cc:1916] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:30.390229  3990 ts_tablet_manager.cc:1929] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:30.390671  3990 log.cc:1199] T 038f072ecdcc4679a46740d78fb0dbd7 P 501fdf2af2bc4b0c971ae880e98f466b: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-2-root/wals/038f072ecdcc4679a46740d78fb0dbd7
I20260709 13:14:30.392571  2934 catalog_manager.cc:5028] TS 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): tablet 038f072ecdcc4679a46740d78fb0dbd7 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:31.449649  3123 consensus_queue.cc:237] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:31.458207  3196 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:31.460094  3048 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:31.459939  3997 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:31.461371  3090 consensus_peers.cc:597] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf43b3ddced94b0395a3a79080ce0ed5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:31.461623  3934 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:31.473080  3997 raft_consensus.cc:2955] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:31.474211  3048 raft_consensus.cc:2955] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:31.480890  3196 raft_consensus.cc:2955] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:31.494130  3195 consensus_queue.cc:237] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:31.492758  2946 catalog_manager.cc:5697] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:31.506740  3123 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:31.507403  3164 consensus_peers.cc:597] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9c2f28b50c354b648096e08cf4f5d54a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:31.509370  3999 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:31.509866  3048 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:31.511657  3999 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:31.522534  4010 raft_consensus.cc:2955] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:31.524374  3123 raft_consensus.cc:2955] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:31.539007  3046 consensus_queue.cc:237] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:31.541977  3048 raft_consensus.cc:2955] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:31.549666  2947 catalog_manager.cc:5697] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.563517  3195 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:31.567503  4016 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:31.565448  3123 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:31.571174  3015 consensus_peers.cc:597] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2fbe6f8795fb454182fceb2dad61e5c6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:31.573161  4016 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:31.582620  3196 raft_consensus.cc:2955] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:31.584276  3123 raft_consensus.cc:2955] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:31.580967  3918 raft_consensus.cc:2955] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:31.598512  2948 catalog_manager.cc:5697] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:31.623836  3196 consensus_queue.cc:237] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
W20260709 13:14:31.635798  3164 consensus_peers.cc:597] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e234b352c9c44269b88598c9ae245ab5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:31.636783  3046 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:31.638031  3126 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:31.638876  4010 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:31.639757  3915 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:31.647699  3915 raft_consensus.cc:2955] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:31.649246  3046 raft_consensus.cc:2955] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:31.652882  3126 raft_consensus.cc:2955] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:31.666193  2946 catalog_manager.cc:5697] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:32.003799  4024 ts_tablet_manager.cc:933] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:32.006816  4024 tablet_copy_client.cc:323] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.130:38619
I20260709 13:14:32.008500  4026 ts_tablet_manager.cc:933] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:32.008507  3136 tablet_copy_service.cc:140] P f20672b2852447a6bc1e137c4dd40904: Received BeginTabletCopySession request for tablet cf43b3ddced94b0395a3a79080ce0ed5 from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:55318)
I20260709 13:14:32.009248  3136 tablet_copy_service.cc:161] P f20672b2852447a6bc1e137c4dd40904: Beginning new tablet copy session on tablet cf43b3ddced94b0395a3a79080ce0ed5 from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:55318: session id = e9165fe61ab04bfb9a48889156d5c161-cf43b3ddced94b0395a3a79080ce0ed5
I20260709 13:14:32.021399  3136 tablet_copy_source_session.cc:215] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:32.023877  4026 tablet_copy_client.cc:323] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.131:38665
I20260709 13:14:32.026768  4024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf43b3ddced94b0395a3a79080ce0ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.030916  3210 tablet_copy_service.cc:140] P 501fdf2af2bc4b0c971ae880e98f466b: Received BeginTabletCopySession request for tablet 9c2f28b50c354b648096e08cf4f5d54a from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:34728)
I20260709 13:14:32.031533  3210 tablet_copy_service.cc:161] P 501fdf2af2bc4b0c971ae880e98f466b: Beginning new tablet copy session on tablet 9c2f28b50c354b648096e08cf4f5d54a from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:34728: session id = e9165fe61ab04bfb9a48889156d5c161-9c2f28b50c354b648096e08cf4f5d54a
I20260709 13:14:32.040549  3210 tablet_copy_source_session.cc:215] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:32.044770  4026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c2f28b50c354b648096e08cf4f5d54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.062538  4024 tablet_copy_client.cc:806] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:32.063241  4024 tablet_copy_client.cc:670] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:32.067219  4024 tablet_copy_client.cc:538] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:32.067241  4026 tablet_copy_client.cc:806] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:32.074303  4026 tablet_copy_client.cc:670] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:32.077306  4024 tablet_bootstrap.cc:492] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:32.079126  4026 tablet_copy_client.cc:538] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:32.089391  4026 tablet_bootstrap.cc:492] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:32.105137  4024 tablet_bootstrap.cc:492] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:32.106300  4024 tablet_bootstrap.cc:492] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:32.107206  4024 ts_tablet_manager.cc:1403] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.030s	user 0.027s	sys 0.000s
I20260709 13:14:32.110743  4024 raft_consensus.cc:359] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:32.111672  4024 raft_consensus.cc:740] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:32.112335  4024 consensus_queue.cc:260] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:32.119314  4026 tablet_bootstrap.cc:492] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:32.120115  4026 tablet_bootstrap.cc:492] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:32.120231  4024 ts_tablet_manager.cc:1434] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.007s
I20260709 13:14:32.120844  4026 ts_tablet_manager.cc:1403] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.032s	user 0.022s	sys 0.007s
I20260709 13:14:32.122203  3136 tablet_copy_service.cc:342] P f20672b2852447a6bc1e137c4dd40904: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-cf43b3ddced94b0395a3a79080ce0ed5 received from {username='slave'} at 127.0.0.1:55318
I20260709 13:14:32.122659  3136 tablet_copy_service.cc:434] P f20672b2852447a6bc1e137c4dd40904: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-cf43b3ddced94b0395a3a79080ce0ed5 on tablet cf43b3ddced94b0395a3a79080ce0ed5 with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:32.126042  4026 raft_consensus.cc:359] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:32.126917  4026 raft_consensus.cc:740] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:32.127736  4026 consensus_queue.cc:260] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:32.130187  4026 ts_tablet_manager.cc:1434] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 13:14:32.131852  4024 ts_tablet_manager.cc:933] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:14:32.132102  3210 tablet_copy_service.cc:342] P 501fdf2af2bc4b0c971ae880e98f466b: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-9c2f28b50c354b648096e08cf4f5d54a received from {username='slave'} at 127.0.0.1:34728
I20260709 13:14:32.132480  3210 tablet_copy_service.cc:434] P 501fdf2af2bc4b0c971ae880e98f466b: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-9c2f28b50c354b648096e08cf4f5d54a on tablet 9c2f28b50c354b648096e08cf4f5d54a with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:32.133673  4024 tablet_copy_client.cc:323] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.129:44609
I20260709 13:14:32.135591  3061 tablet_copy_service.cc:140] P aaf88538197a49adb8bcf3790309a67e: Received BeginTabletCopySession request for tablet 2fbe6f8795fb454182fceb2dad61e5c6 from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:47488)
I20260709 13:14:32.136121  3061 tablet_copy_service.cc:161] P aaf88538197a49adb8bcf3790309a67e: Beginning new tablet copy session on tablet 2fbe6f8795fb454182fceb2dad61e5c6 from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:47488: session id = e9165fe61ab04bfb9a48889156d5c161-2fbe6f8795fb454182fceb2dad61e5c6
I20260709 13:14:32.145859  3061 tablet_copy_source_session.cc:215] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:32.151332  4024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fbe6f8795fb454182fceb2dad61e5c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.168725  4026 ts_tablet_manager.cc:933] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:32.170743  4026 tablet_copy_client.cc:323] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.131:38665
I20260709 13:14:32.172854  4024 tablet_copy_client.cc:806] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:32.173377  3210 tablet_copy_service.cc:140] P 501fdf2af2bc4b0c971ae880e98f466b: Received BeginTabletCopySession request for tablet e234b352c9c44269b88598c9ae245ab5 from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:34728)
I20260709 13:14:32.173480  4024 tablet_copy_client.cc:670] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:32.174057  3210 tablet_copy_service.cc:161] P 501fdf2af2bc4b0c971ae880e98f466b: Beginning new tablet copy session on tablet e234b352c9c44269b88598c9ae245ab5 from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:34728: session id = e9165fe61ab04bfb9a48889156d5c161-e234b352c9c44269b88598c9ae245ab5
I20260709 13:14:32.179688  4024 tablet_copy_client.cc:538] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:32.182101  3210 tablet_copy_source_session.cc:215] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:32.184628  4026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e234b352c9c44269b88598c9ae245ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.189009  4024 tablet_bootstrap.cc:492] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:32.202162  4026 tablet_copy_client.cc:806] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:32.202751  4026 tablet_copy_client.cc:670] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:32.208626  4026 tablet_copy_client.cc:538] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:32.219223  4026 tablet_bootstrap.cc:492] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:32.248224  4026 tablet_bootstrap.cc:492] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:32.249161  4026 tablet_bootstrap.cc:492] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:32.249850  4026 ts_tablet_manager.cc:1403] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.012s
I20260709 13:14:32.252676  4026 raft_consensus.cc:359] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:32.253604  4026 raft_consensus.cc:740] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:32.254442  4026 consensus_queue.cc:260] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:32.262586  4026 ts_tablet_manager.cc:1434] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:14:32.264726  3210 tablet_copy_service.cc:342] P 501fdf2af2bc4b0c971ae880e98f466b: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-e234b352c9c44269b88598c9ae245ab5 received from {username='slave'} at 127.0.0.1:34728
I20260709 13:14:32.265142  3210 tablet_copy_service.cc:434] P 501fdf2af2bc4b0c971ae880e98f466b: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-e234b352c9c44269b88598c9ae245ab5 on tablet e234b352c9c44269b88598c9ae245ab5 with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:32.271450  4024 tablet_bootstrap.cc:492] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:32.272490  4024 tablet_bootstrap.cc:492] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:32.273609  4024 ts_tablet_manager.cc:1403] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.085s	user 0.041s	sys 0.033s
I20260709 13:14:32.277225  4024 raft_consensus.cc:359] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:32.278076  4024 raft_consensus.cc:740] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:32.278698  4024 consensus_queue.cc:260] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:32.282513  4024 ts_tablet_manager.cc:1434] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:14:32.285650  3061 tablet_copy_service.cc:342] P aaf88538197a49adb8bcf3790309a67e: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-2fbe6f8795fb454182fceb2dad61e5c6 received from {username='slave'} at 127.0.0.1:47488
I20260709 13:14:32.286123  3061 tablet_copy_service.cc:434] P aaf88538197a49adb8bcf3790309a67e: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-2fbe6f8795fb454182fceb2dad61e5c6 on tablet 2fbe6f8795fb454182fceb2dad61e5c6 with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:32.531060  3799 raft_consensus.cc:1217] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:32.559703  3799 raft_consensus.cc:1217] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:32.615809  3799 raft_consensus.cc:1217] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:32.790659  3799 raft_consensus.cc:1217] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:33.053963  3999 raft_consensus.cc:1064] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:33.055743  3999 consensus_queue.cc:237] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:33.061662  3799 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:33.062608  3123 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:33.063397  3999 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:33.062770  3046 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:33.065304  3915 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:33.066358  4034 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:33.105929  4039 raft_consensus.cc:2955] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.110849  3123 raft_consensus.cc:2955] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.122252  3797 raft_consensus.cc:2955] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.125963  4019 raft_consensus.cc:1064] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:33.129174  4019 consensus_queue.cc:237] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:33.122509  3048 raft_consensus.cc:2955] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.136109  2948 catalog_manager.cc:5697] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:33.155251  3198 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:33.158164  3126 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:33.161370  4036 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:33.163399  4036 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:33.166237  3797 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:33.168473  4047 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:33.193889  4047 raft_consensus.cc:2955] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.206135  3195 consensus_queue.cc:237] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:33.214082  3046 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:33.214754  3799 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:33.215334  3123 raft_consensus.cc:2955] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.217378  3999 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:33.231796  4034 raft_consensus.cc:2955] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.239727  3799 raft_consensus.cc:2955] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.246480  3195 raft_consensus.cc:2955] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.248363  2946 catalog_manager.cc:5697] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:33.252832  4039 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:33.221763  3797 raft_consensus.cc:2955] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.257999  4005 raft_consensus.cc:1064] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:33.260778  4005 consensus_queue.cc:237] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:33.262387  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9c2f28b50c354b648096e08cf4f5d54a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:33.267305  3048 raft_consensus.cc:2955] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.272995  3046 consensus_queue.cc:237] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:33.287920  3797 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:33.289191  4037 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:33.289850  3915 raft_consensus.cc:1064] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:33.292106  3915 consensus_queue.cc:237] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:33.307063  4036 raft_consensus.cc:2955] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.315117  3126 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:33.315119  3796 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:33.316498  4019 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:33.317313  2947 catalog_manager.cc:5697] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:33.321188  3123 raft_consensus.cc:2955] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.321069  3999 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:14:33.309494  3798 raft_consensus.cc:2955] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:14:33.334992  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 82409.5us
I20260709 13:14:33.369382  2949 catalog_manager.cc:5697] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:14:33.374293  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 79490.3us
I20260709 13:14:33.379136  3111 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c2f28b50c354b648096e08cf4f5d54a with delete_type TABLET_DATA_TOMBSTONED (TS f20672b2852447a6bc1e137c4dd40904 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54672
W20260709 13:14:33.396112  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 53710.7us
I20260709 13:14:33.399814  3046 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:33.401310  3123 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:14:33.431209  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 78625.3us
I20260709 13:14:33.435165  2935 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2fbe6f8795fb454182fceb2dad61e5c6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:33.460806  3045 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:33.462682  4034 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:33.468341  3915 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:33.471238  3796 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:33.471927  4061 tablet_replica.cc:333] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:14:33.477042  4054 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:33.481098  3187 tablet_service.cc:1558] Processing DeleteTablet for tablet 2fbe6f8795fb454182fceb2dad61e5c6 with delete_type TABLET_DATA_TOMBSTONED (TS 501fdf2af2bc4b0c971ae880e98f466b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51690
I20260709 13:14:33.479970  3196 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:33.473548  4061 raft_consensus.cc:2243] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:33.489022  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 50555.3us
I20260709 13:14:33.492018  4061 raft_consensus.cc:2272] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:33.503443  4052 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:33.506619  4061 ts_tablet_manager.cc:1916] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:14:33.514309  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 50563.4us
I20260709 13:14:33.545043  4067 tablet_replica.cc:333] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:14:33.553243  4004 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:33.557646  4067 raft_consensus.cc:2243] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:33.563781  4034 raft_consensus.cc:2955] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.566329  4067 raft_consensus.cc:2272] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:33.574007  4067 ts_tablet_manager.cc:1916] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:33.577142  4005 raft_consensus.cc:2955] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.583496  3046 raft_consensus.cc:2955] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.590885  3197 raft_consensus.cc:2955] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.595479  4061 ts_tablet_manager.cc:1929] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:33.595994  4061 log.cc:1199] T 9c2f28b50c354b648096e08cf4f5d54a P f20672b2852447a6bc1e137c4dd40904: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-1-root/wals/9c2f28b50c354b648096e08cf4f5d54a
I20260709 13:14:33.597826  2934 catalog_manager.cc:5028] TS f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): tablet 9c2f28b50c354b648096e08cf4f5d54a (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:33.601490  3798 raft_consensus.cc:2955] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.607208  2947 catalog_manager.cc:5697] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:33.612589  4067 ts_tablet_manager.cc:1929] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:33.613178  4067 log.cc:1199] T 2fbe6f8795fb454182fceb2dad61e5c6 P 501fdf2af2bc4b0c971ae880e98f466b: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-2-root/wals/2fbe6f8795fb454182fceb2dad61e5c6
I20260709 13:14:33.628484  2947 catalog_manager.cc:5697] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.633867  2934 catalog_manager.cc:5028] TS 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): tablet 2fbe6f8795fb454182fceb2dad61e5c6 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:33.639532  3798 raft_consensus.cc:2955] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.649792  3121 raft_consensus.cc:2955] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.652275  3123 consensus_queue.cc:237] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:33.663147  3198 consensus_queue.cc:237] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:33.664767  3197 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:33.666971  4004 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:33.676793  3796 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:33.684242  3798 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:33.692669  3123 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:33.693724  4039 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:33.695204  4054 raft_consensus.cc:2955] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.704169  4063 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:33.708050  4034 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:33.708747  3797 raft_consensus.cc:2955] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.712257  3198 raft_consensus.cc:2955] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.713979  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cf43b3ddced94b0395a3a79080ce0ed5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:33.721381  3915 raft_consensus.cc:2955] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.731112  2949 catalog_manager.cc:5697] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.736720  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e234b352c9c44269b88598c9ae245ab5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:33.739071  3123 raft_consensus.cc:2955] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.746948  3041 tablet_service.cc:1558] Processing DeleteTablet for tablet cf43b3ddced94b0395a3a79080ce0ed5 with delete_type TABLET_DATA_TOMBSTONED (TS aaf88538197a49adb8bcf3790309a67e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35708
I20260709 13:14:33.755009  4073 tablet_replica.cc:333] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:14:33.767879  3798 raft_consensus.cc:2955] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:33.769546  2947 catalog_manager.cc:5697] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:33.788775  4073 raft_consensus.cc:2243] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:33.789304  4073 pending_rounds.cc:70] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e: Trying to abort 1 pending ops.
I20260709 13:14:33.789552  4073 pending_rounds.cc:77] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305637368869539840 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } } }
I20260709 13:14:33.790807  4073 raft_consensus.cc:2917] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:14:33.791178  4073 raft_consensus.cc:2889] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:14:33.791484  4073 raft_consensus.cc:2272] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:33.795243  4073 ts_tablet_manager.cc:1916] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:33.796319  3041 tablet_service.cc:1558] Processing DeleteTablet for tablet e234b352c9c44269b88598c9ae245ab5 with delete_type TABLET_DATA_TOMBSTONED (TS aaf88538197a49adb8bcf3790309a67e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35708
I20260709 13:14:33.811671  4073 ts_tablet_manager.cc:1929] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:33.812130  4073 log.cc:1199] T cf43b3ddced94b0395a3a79080ce0ed5 P aaf88538197a49adb8bcf3790309a67e: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-0-root/wals/cf43b3ddced94b0395a3a79080ce0ed5
I20260709 13:14:33.813503  4073 tablet_replica.cc:333] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:14:33.813500  2935 catalog_manager.cc:5028] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): tablet cf43b3ddced94b0395a3a79080ce0ed5 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:33.814771  4073 raft_consensus.cc:2243] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:33.815321  4073 raft_consensus.cc:2272] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:33.817984  4073 ts_tablet_manager.cc:1916] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:33.828110  4073 ts_tablet_manager.cc:1929] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:33.828431  4073 log.cc:1199] T e234b352c9c44269b88598c9ae245ab5 P aaf88538197a49adb8bcf3790309a67e: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-0-root/wals/e234b352c9c44269b88598c9ae245ab5
I20260709 13:14:33.829658  2935 catalog_manager.cc:5028] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): tablet e234b352c9c44269b88598c9ae245ab5 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:34.879331  3045 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:34.885826  3198 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:34.887511  3015 consensus_peers.cc:597] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44281a32716140bc805b71db0e071122. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:34.887552  3123 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:34.888441  4037 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:34.889855  4047 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:34.897548  4047 raft_consensus.cc:2955] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:34.902839  3123 raft_consensus.cc:2955] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:34.905171  3198 raft_consensus.cc:2955] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:34.913544  3196 consensus_queue.cc:237] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:34.920682  2946 catalog_manager.cc:5697] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
W20260709 13:14:34.934692  3164 consensus_peers.cc:597] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d08acccfb704a2cbd3aa420321f06d0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:34.937722  3120 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:34.939631  4057 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:34.944051  3045 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:34.947821  4057 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:34.951512  3915 raft_consensus.cc:2955] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:34.956918  3120 raft_consensus.cc:2955] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:34.967020  3045 raft_consensus.cc:2955] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:34.968541  3196 consensus_queue.cc:237] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:34.976107  2947 catalog_manager.cc:5697] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:34.987553  3045 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:34.988677  3164 consensus_peers.cc:597] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d96dfe3b4fa4acbb1aac261f7ebf5ea. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:34.989646  3123 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:34.989632  4057 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:34.991444  4075 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:35.007318  3915 raft_consensus.cc:2955] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:35.014638  3045 raft_consensus.cc:2955] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:35.020313  3120 raft_consensus.cc:2955] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:35.024278  3046 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:35.033448  3196 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:35.035137  2947 catalog_manager.cc:5697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:35.036132  3015 consensus_peers.cc:597] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a367b51f1ce4b0197b9dadabe52be32. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:35.038268  4037 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:35.041512  3120 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:35.043177  4037 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:35.049278  4079 raft_consensus.cc:2955] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:35.052723  3196 raft_consensus.cc:2955] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:35.055733  3120 raft_consensus.cc:2955] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:35.067147  2949 catalog_manager.cc:5697] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:35.292790  4096 ts_tablet_manager.cc:933] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:14:35.294802  4096 tablet_copy_client.cc:323] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.129:44609
I20260709 13:14:35.296483  3061 tablet_copy_service.cc:140] P aaf88538197a49adb8bcf3790309a67e: Received BeginTabletCopySession request for tablet 44281a32716140bc805b71db0e071122 from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:47488)
I20260709 13:14:35.297065  3061 tablet_copy_service.cc:161] P aaf88538197a49adb8bcf3790309a67e: Beginning new tablet copy session on tablet 44281a32716140bc805b71db0e071122 from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:47488: session id = e9165fe61ab04bfb9a48889156d5c161-44281a32716140bc805b71db0e071122
I20260709 13:14:35.305513  3061 tablet_copy_source_session.cc:215] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:35.310170  4096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44281a32716140bc805b71db0e071122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.323769  4096 tablet_copy_client.cc:806] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:35.324338  4096 tablet_copy_client.cc:670] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:35.328379  4096 tablet_copy_client.cc:538] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:35.335295  4096 tablet_bootstrap.cc:492] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:35.356053  4096 tablet_bootstrap.cc:492] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:35.357065  4096 tablet_bootstrap.cc:492] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:35.357832  4096 ts_tablet_manager.cc:1403] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.023s	user 0.023s	sys 0.000s
I20260709 13:14:35.360849  4096 raft_consensus.cc:359] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:35.361786  4096 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:35.362403  4096 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:35.365460  4096 ts_tablet_manager.cc:1434] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:35.367480  3061 tablet_copy_service.cc:342] P aaf88538197a49adb8bcf3790309a67e: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-44281a32716140bc805b71db0e071122 received from {username='slave'} at 127.0.0.1:47488
I20260709 13:14:35.367946  3061 tablet_copy_service.cc:434] P aaf88538197a49adb8bcf3790309a67e: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-44281a32716140bc805b71db0e071122 on tablet 44281a32716140bc805b71db0e071122 with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:35.456358  4096 ts_tablet_manager.cc:933] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:35.458127  4096 tablet_copy_client.cc:323] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.131:38665
I20260709 13:14:35.459900  3210 tablet_copy_service.cc:140] P 501fdf2af2bc4b0c971ae880e98f466b: Received BeginTabletCopySession request for tablet 0d08acccfb704a2cbd3aa420321f06d0 from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:34728)
I20260709 13:14:35.460462  3210 tablet_copy_service.cc:161] P 501fdf2af2bc4b0c971ae880e98f466b: Beginning new tablet copy session on tablet 0d08acccfb704a2cbd3aa420321f06d0 from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:34728: session id = e9165fe61ab04bfb9a48889156d5c161-0d08acccfb704a2cbd3aa420321f06d0
I20260709 13:14:35.471067  4101 ts_tablet_manager.cc:933] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:35.472811  3210 tablet_copy_source_session.cc:215] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:35.476363  4096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d08acccfb704a2cbd3aa420321f06d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.492509  4101 tablet_copy_client.cc:323] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.131:38665
I20260709 13:14:35.494460  4096 tablet_copy_client.cc:806] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:35.495191  4096 tablet_copy_client.cc:670] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:35.497181  3210 tablet_copy_service.cc:140] P 501fdf2af2bc4b0c971ae880e98f466b: Received BeginTabletCopySession request for tablet 5d96dfe3b4fa4acbb1aac261f7ebf5ea from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:34728)
I20260709 13:14:35.497794  3210 tablet_copy_service.cc:161] P 501fdf2af2bc4b0c971ae880e98f466b: Beginning new tablet copy session on tablet 5d96dfe3b4fa4acbb1aac261f7ebf5ea from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:34728: session id = e9165fe61ab04bfb9a48889156d5c161-5d96dfe3b4fa4acbb1aac261f7ebf5ea
I20260709 13:14:35.500146  4096 tablet_copy_client.cc:538] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:35.506819  3210 tablet_copy_source_session.cc:215] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:35.510461  4101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d96dfe3b4fa4acbb1aac261f7ebf5ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.513243  4096 tablet_bootstrap.cc:492] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:35.541363  4101 tablet_copy_client.cc:806] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:35.542447  4101 tablet_copy_client.cc:670] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:35.556082  4101 tablet_copy_client.cc:538] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:35.567284  4101 tablet_bootstrap.cc:492] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:35.570967  4096 tablet_bootstrap.cc:492] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:35.572209  4096 tablet_bootstrap.cc:492] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:35.573068  4096 ts_tablet_manager.cc:1403] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.060s	user 0.022s	sys 0.023s
I20260709 13:14:35.577006  4096 raft_consensus.cc:359] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:35.577993  4096 raft_consensus.cc:740] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:35.579339  4096 consensus_queue.cc:260] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:35.582983  4096 ts_tablet_manager.cc:1434] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:14:35.586247  3210 tablet_copy_service.cc:342] P 501fdf2af2bc4b0c971ae880e98f466b: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-0d08acccfb704a2cbd3aa420321f06d0 received from {username='slave'} at 127.0.0.1:34728
I20260709 13:14:35.586746  3210 tablet_copy_service.cc:434] P 501fdf2af2bc4b0c971ae880e98f466b: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-0d08acccfb704a2cbd3aa420321f06d0 on tablet 0d08acccfb704a2cbd3aa420321f06d0 with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:35.603628  4101 tablet_bootstrap.cc:492] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:35.604717  4101 tablet_bootstrap.cc:492] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:35.605489  4101 ts_tablet_manager.cc:1403] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.008s
I20260709 13:14:35.608865  4101 raft_consensus.cc:359] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:35.610345  4101 raft_consensus.cc:740] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:35.611133  4101 consensus_queue.cc:260] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:35.617075  4101 ts_tablet_manager.cc:1434] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:14:35.630379  3210 tablet_copy_service.cc:342] P 501fdf2af2bc4b0c971ae880e98f466b: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-5d96dfe3b4fa4acbb1aac261f7ebf5ea received from {username='slave'} at 127.0.0.1:34728
I20260709 13:14:35.630903  3210 tablet_copy_service.cc:434] P 501fdf2af2bc4b0c971ae880e98f466b: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-5d96dfe3b4fa4acbb1aac261f7ebf5ea on tablet 5d96dfe3b4fa4acbb1aac261f7ebf5ea with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:35.635423  4101 ts_tablet_manager.cc:933] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:14:35.637506  4101 tablet_copy_client.cc:323] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.129:44609
I20260709 13:14:35.639323  3061 tablet_copy_service.cc:140] P aaf88538197a49adb8bcf3790309a67e: Received BeginTabletCopySession request for tablet 1a367b51f1ce4b0197b9dadabe52be32 from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:47488)
I20260709 13:14:35.639914  3061 tablet_copy_service.cc:161] P aaf88538197a49adb8bcf3790309a67e: Beginning new tablet copy session on tablet 1a367b51f1ce4b0197b9dadabe52be32 from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:47488: session id = e9165fe61ab04bfb9a48889156d5c161-1a367b51f1ce4b0197b9dadabe52be32
I20260709 13:14:35.649106  3061 tablet_copy_source_session.cc:215] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:35.656594  4101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a367b51f1ce4b0197b9dadabe52be32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.678603  4101 tablet_copy_client.cc:806] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:35.679245  4101 tablet_copy_client.cc:670] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:35.683061  4101 tablet_copy_client.cc:538] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:35.694392  4101 tablet_bootstrap.cc:492] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:35.712976  3797 raft_consensus.cc:1217] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:35.720480  4101 tablet_bootstrap.cc:492] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:35.721429  4101 tablet_bootstrap.cc:492] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:35.722060  4101 ts_tablet_manager.cc:1403] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.006s
I20260709 13:14:35.724270  4101 raft_consensus.cc:359] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:35.724833  4101 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:35.725427  4101 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:35.727285  4101 ts_tablet_manager.cc:1434] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:14:35.729664  3061 tablet_copy_service.cc:342] P aaf88538197a49adb8bcf3790309a67e: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-1a367b51f1ce4b0197b9dadabe52be32 received from {username='slave'} at 127.0.0.1:47488
I20260709 13:14:35.730114  3061 tablet_copy_service.cc:434] P aaf88538197a49adb8bcf3790309a67e: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-1a367b51f1ce4b0197b9dadabe52be32 on tablet 1a367b51f1ce4b0197b9dadabe52be32 with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:35.893112  3797 raft_consensus.cc:1217] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:14:35.949275  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 53589.6us
I20260709 13:14:35.985502  3797 raft_consensus.cc:1217] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:36.146581  3797 raft_consensus.cc:1217] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:36.291507  4037 raft_consensus.cc:1064] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:36.293812  4037 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:36.301631  3797 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:36.301857  3123 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:36.301628  3195 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:36.303191  4037 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:36.304353  4079 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:36.305470  4047 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:36.325662  4047 raft_consensus.cc:2955] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:36.334259  3123 raft_consensus.cc:2955] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:36.336556  3798 raft_consensus.cc:2955] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:36.356845  2949 catalog_manager.cc:5697] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:36.368479  4089 raft_consensus.cc:1064] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:36.371511  4089 consensus_queue.cc:237] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:36.379984  3195 raft_consensus.cc:2955] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:36.405359  3798 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:36.411084  3121 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:36.422753  4108 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:36.428158  4109 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:36.446537  3045 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:36.448624  4089 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:36.460247  3915 raft_consensus.cc:2955] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:36.471127  3046 raft_consensus.cc:2955] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:36.471820  3121 raft_consensus.cc:2955] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:36.478194  4109 raft_consensus.cc:1064] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:36.489853  4109 consensus_queue.cc:237] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:36.553552  4037 raft_consensus.cc:1064] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:36.556121  3798 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:36.556227  4037 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:36.556147  3797 raft_consensus.cc:2955] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:36.559844  3046 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:36.561589  3123 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:36.564045  4124 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:36.566064  4124 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:36.568770  4124 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:36.620569  3797 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:36.624053  3195 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:36.627264  3123 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:36.647758  4037 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:36.648679  4047 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:36.650771  4106 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:36.672645  4124 raft_consensus.cc:2955] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:36.676760  3121 raft_consensus.cc:2955] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:36.742245  4037 raft_consensus.cc:2955] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:36.732147  3798 raft_consensus.cc:2955] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:36.758970  3797 raft_consensus.cc:2955] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:36.777261  3048 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:36.776911  3198 raft_consensus.cc:2955] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:36.791033  3045 raft_consensus.cc:2955] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:36.871222  3118 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:36.851326  2949 catalog_manager.cc:5697] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:36.887100  2949 catalog_manager.cc:5697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:36.901527  3797 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:36.932336  4135 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:36.959584  3118 raft_consensus.cc:2955] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:36.971722  3195 consensus_queue.cc:237] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:36.971705  3198 consensus_queue.cc:237] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:36.982017  3048 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:36.983840  4109 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:36.991575  3797 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:37.000949  4123 raft_consensus.cc:2955] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:37.030395  2947 catalog_manager.cc:5697] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:37.037710  3799 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:37.038727  3121 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:37.047770  4124 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:37.050076  4135 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:37.050980  4108 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:37.086608  4124 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:37.094308  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5d96dfe3b4fa4acbb1aac261f7ebf5ea with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:37.057857  3799 raft_consensus.cc:2955] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:37.104588  3043 raft_consensus.cc:2955] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:37.117120  4109 raft_consensus.cc:2955] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:37.119132  4106 raft_consensus.cc:2955] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:37.121048  3799 raft_consensus.cc:2955] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:37.128428  3119 raft_consensus.cc:2955] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:37.154644  3797 raft_consensus.cc:2955] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:37.174031  2945 catalog_manager.cc:5697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:37.175635  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0d08acccfb704a2cbd3aa420321f06d0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:37.177461  2935 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 44281a32716140bc805b71db0e071122 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:37.185179  3050 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:37.182229  3119 raft_consensus.cc:2955] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:37.191192  3799 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:37.191794  3121 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:37.193044  4106 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:37.193966  4135 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:37.195878  3111 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d96dfe3b4fa4acbb1aac261f7ebf5ea with delete_type TABLET_DATA_TOMBSTONED (TS f20672b2852447a6bc1e137c4dd40904 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54672
I20260709 13:14:37.205325  2949 catalog_manager.cc:5697] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:37.218490  2949 catalog_manager.cc:5697] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:37.227396  4106 raft_consensus.cc:2955] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:37.231305  4143 tablet_replica.cc:333] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:14:37.232257  4143 raft_consensus.cc:2243] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:37.233053  4143 raft_consensus.cc:2272] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:37.237617  3799 raft_consensus.cc:2955] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:37.240207  4143 ts_tablet_manager.cc:1916] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:37.242832  2935 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1a367b51f1ce4b0197b9dadabe52be32 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:37.244714  3119 raft_consensus.cc:2955] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:37.257541  3187 tablet_service.cc:1558] Processing DeleteTablet for tablet 44281a32716140bc805b71db0e071122 with delete_type TABLET_DATA_TOMBSTONED (TS 501fdf2af2bc4b0c971ae880e98f466b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51690
I20260709 13:14:37.260710  4143 ts_tablet_manager.cc:1929] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:37.261463  4143 log.cc:1199] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P f20672b2852447a6bc1e137c4dd40904: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-1-root/wals/5d96dfe3b4fa4acbb1aac261f7ebf5ea
I20260709 13:14:37.271288  2934 catalog_manager.cc:5028] TS f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): tablet 5d96dfe3b4fa4acbb1aac261f7ebf5ea (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:37.271612  3041 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d08acccfb704a2cbd3aa420321f06d0 with delete_type TABLET_DATA_TOMBSTONED (TS aaf88538197a49adb8bcf3790309a67e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35708
I20260709 13:14:37.269451  2946 catalog_manager.cc:5697] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:37.268491  4144 tablet_replica.cc:333] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:14:37.275614  4144 raft_consensus.cc:2243] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:37.276094  4145 tablet_replica.cc:333] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:14:37.277437  4145 raft_consensus.cc:2243] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:37.278509  4145 raft_consensus.cc:2272] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:37.282752  4144 raft_consensus.cc:2272] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:37.285120  4145 ts_tablet_manager.cc:1916] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:37.287146  4144 ts_tablet_manager.cc:1916] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:37.287241  3187 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a367b51f1ce4b0197b9dadabe52be32 with delete_type TABLET_DATA_TOMBSTONED (TS 501fdf2af2bc4b0c971ae880e98f466b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51690
I20260709 13:14:37.305121  4145 ts_tablet_manager.cc:1929] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:37.305760  4145 log.cc:1199] T 0d08acccfb704a2cbd3aa420321f06d0 P aaf88538197a49adb8bcf3790309a67e: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-0-root/wals/0d08acccfb704a2cbd3aa420321f06d0
I20260709 13:14:37.307716  2935 catalog_manager.cc:5028] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): tablet 0d08acccfb704a2cbd3aa420321f06d0 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:37.308702  4144 ts_tablet_manager.cc:1929] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:37.309216  4144 log.cc:1199] T 44281a32716140bc805b71db0e071122 P 501fdf2af2bc4b0c971ae880e98f466b: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-2-root/wals/44281a32716140bc805b71db0e071122
I20260709 13:14:37.311290  2934 catalog_manager.cc:5028] TS 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): tablet 44281a32716140bc805b71db0e071122 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:37.332297  4144 tablet_replica.cc:333] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:14:37.334399  4144 raft_consensus.cc:2243] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:37.335482  4144 raft_consensus.cc:2272] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:37.339397  4144 ts_tablet_manager.cc:1916] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:37.352398  4144 ts_tablet_manager.cc:1929] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:37.352726  4144 log.cc:1199] T 1a367b51f1ce4b0197b9dadabe52be32 P 501fdf2af2bc4b0c971ae880e98f466b: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-2-root/wals/1a367b51f1ce4b0197b9dadabe52be32
I20260709 13:14:37.354121  2934 catalog_manager.cc:5028] TS 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): tablet 1a367b51f1ce4b0197b9dadabe52be32 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:38.365409  3195 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:38.372259  3043 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:38.372449  3121 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:38.372884  3164 consensus_peers.cc:597] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 348c9fe65bc24c3caf5c132e715a13ba. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:38.373996  4109 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.375298  4123 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.384601  4123 raft_consensus.cc:2955] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:38.386106  3043 raft_consensus.cc:2955] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:38.389842  3121 raft_consensus.cc:2955] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:38.401880  3195 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:38.417222  2949 catalog_manager.cc:5697] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:38.427582  3164 consensus_peers.cc:597] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01dd1f72eb8249a6adadee5f3509bcc2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:38.428934  3121 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:38.428977  3043 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:38.430895  4123 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.431869  4147 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:38.456841  4147 raft_consensus.cc:2955] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:38.466491  3121 raft_consensus.cc:2955] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:38.467144  3043 raft_consensus.cc:2955] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:38.485024  2949 catalog_manager.cc:5697] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:38.487972  3195 consensus_queue.cc:237] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:38.505638  3043 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:38.506731  3164 consensus_peers.cc:597] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96a33a25f4f3488ea9a2cec075aa10ce. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:38.507269  3121 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:38.508368  4158 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:38.509411  4147 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:38.520633  4123 raft_consensus.cc:2955] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:38.523023  3121 raft_consensus.cc:2955] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:38.531514  3043 raft_consensus.cc:2955] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:38.536827  3045 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:38.543841  2945 catalog_manager.cc:5697] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
W20260709 13:14:38.560842  3015 consensus_peers.cc:597] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a28cf255dda74b44acbfc2fff2f8f950. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:38.561458  3121 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:38.562330  3195 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:38.562811  4142 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.564723  4142 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:38.578173  4079 raft_consensus.cc:2955] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:38.579681  3195 raft_consensus.cc:2955] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:38.581398  3121 raft_consensus.cc:2955] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:38.595942  2946 catalog_manager.cc:5697] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:38.828003  4166 ts_tablet_manager.cc:933] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:38.830436  4166 tablet_copy_client.cc:323] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.131:38665
I20260709 13:14:38.832675  3210 tablet_copy_service.cc:140] P 501fdf2af2bc4b0c971ae880e98f466b: Received BeginTabletCopySession request for tablet 01dd1f72eb8249a6adadee5f3509bcc2 from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:34728)
I20260709 13:14:38.833273  3210 tablet_copy_service.cc:161] P 501fdf2af2bc4b0c971ae880e98f466b: Beginning new tablet copy session on tablet 01dd1f72eb8249a6adadee5f3509bcc2 from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:34728: session id = e9165fe61ab04bfb9a48889156d5c161-01dd1f72eb8249a6adadee5f3509bcc2
I20260709 13:14:38.841188  3210 tablet_copy_source_session.cc:215] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:38.844434  4166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01dd1f72eb8249a6adadee5f3509bcc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:38.859103  4166 tablet_copy_client.cc:806] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:38.859743  4166 tablet_copy_client.cc:670] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:38.863631  4166 tablet_copy_client.cc:538] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:38.872072  4166 tablet_bootstrap.cc:492] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:38.890729  4166 tablet_bootstrap.cc:492] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:38.891502  4166 tablet_bootstrap.cc:492] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:38.892077  4166 ts_tablet_manager.cc:1403] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 13:14:38.894809  4166 raft_consensus.cc:359] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:38.895706  4166 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:38.896458  4166 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:38.899577  4166 ts_tablet_manager.cc:1434] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.003s
I20260709 13:14:38.901727  3210 tablet_copy_service.cc:342] P 501fdf2af2bc4b0c971ae880e98f466b: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-01dd1f72eb8249a6adadee5f3509bcc2 received from {username='slave'} at 127.0.0.1:34728
I20260709 13:14:38.902257  3210 tablet_copy_service.cc:434] P 501fdf2af2bc4b0c971ae880e98f466b: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-01dd1f72eb8249a6adadee5f3509bcc2 on tablet 01dd1f72eb8249a6adadee5f3509bcc2 with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:38.966887  4166 ts_tablet_manager.cc:933] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:38.969503  4166 tablet_copy_client.cc:323] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.131:38665
I20260709 13:14:38.971107  3210 tablet_copy_service.cc:140] P 501fdf2af2bc4b0c971ae880e98f466b: Received BeginTabletCopySession request for tablet 348c9fe65bc24c3caf5c132e715a13ba from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:34728)
I20260709 13:14:38.971663  3210 tablet_copy_service.cc:161] P 501fdf2af2bc4b0c971ae880e98f466b: Beginning new tablet copy session on tablet 348c9fe65bc24c3caf5c132e715a13ba from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:34728: session id = e9165fe61ab04bfb9a48889156d5c161-348c9fe65bc24c3caf5c132e715a13ba
I20260709 13:14:38.977129  3210 tablet_copy_source_session.cc:215] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:38.979817  4166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 348c9fe65bc24c3caf5c132e715a13ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:38.992447  4166 tablet_copy_client.cc:806] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:38.993112  4166 tablet_copy_client.cc:670] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:38.996732  4166 tablet_copy_client.cc:538] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:39.005489  4166 tablet_bootstrap.cc:492] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:39.022086  4166 tablet_bootstrap.cc:492] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:39.023077  4166 tablet_bootstrap.cc:492] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:39.023819  4166 ts_tablet_manager.cc:1403] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.018s	user 0.021s	sys 0.000s
I20260709 13:14:39.026822  4166 raft_consensus.cc:359] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:39.028051  4166 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:39.028755  4166 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:39.037619  4173 ts_tablet_manager.cc:933] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:39.039755  4166 ts_tablet_manager.cc:1434] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 13:14:39.045006  3210 tablet_copy_service.cc:342] P 501fdf2af2bc4b0c971ae880e98f466b: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-348c9fe65bc24c3caf5c132e715a13ba received from {username='slave'} at 127.0.0.1:34728
I20260709 13:14:39.045238  4173 tablet_copy_client.cc:323] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.131:38665
I20260709 13:14:39.045492  3210 tablet_copy_service.cc:434] P 501fdf2af2bc4b0c971ae880e98f466b: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-348c9fe65bc24c3caf5c132e715a13ba on tablet 348c9fe65bc24c3caf5c132e715a13ba with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:39.046919  3210 tablet_copy_service.cc:140] P 501fdf2af2bc4b0c971ae880e98f466b: Received BeginTabletCopySession request for tablet 96a33a25f4f3488ea9a2cec075aa10ce from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:34728)
I20260709 13:14:39.047453  3210 tablet_copy_service.cc:161] P 501fdf2af2bc4b0c971ae880e98f466b: Beginning new tablet copy session on tablet 96a33a25f4f3488ea9a2cec075aa10ce from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:34728: session id = e9165fe61ab04bfb9a48889156d5c161-96a33a25f4f3488ea9a2cec075aa10ce
I20260709 13:14:39.049196  4166 ts_tablet_manager.cc:933] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:14:39.057020  3210 tablet_copy_source_session.cc:215] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:39.061425  4173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a33a25f4f3488ea9a2cec075aa10ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:39.090910  4166 tablet_copy_client.cc:323] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.129:44609
I20260709 13:14:39.093514  3061 tablet_copy_service.cc:140] P aaf88538197a49adb8bcf3790309a67e: Received BeginTabletCopySession request for tablet a28cf255dda74b44acbfc2fff2f8f950 from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:47488)
I20260709 13:14:39.094096  3061 tablet_copy_service.cc:161] P aaf88538197a49adb8bcf3790309a67e: Beginning new tablet copy session on tablet a28cf255dda74b44acbfc2fff2f8f950 from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:47488: session id = e9165fe61ab04bfb9a48889156d5c161-a28cf255dda74b44acbfc2fff2f8f950
I20260709 13:14:39.097831  4173 tablet_copy_client.cc:806] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:39.098788  4173 tablet_copy_client.cc:670] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:39.102797  3061 tablet_copy_source_session.cc:215] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:39.103416  4173 tablet_copy_client.cc:538] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:39.106710  4166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a28cf255dda74b44acbfc2fff2f8f950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:39.114538  4173 tablet_bootstrap.cc:492] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:39.121634  4166 tablet_copy_client.cc:806] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:39.122263  4166 tablet_copy_client.cc:670] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:39.128477  4166 tablet_copy_client.cc:538] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:39.135774  4166 tablet_bootstrap.cc:492] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:39.157262  4173 tablet_bootstrap.cc:492] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:39.158286  4173 tablet_bootstrap.cc:492] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:39.158879  4166 tablet_bootstrap.cc:492] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:39.159807  4166 tablet_bootstrap.cc:492] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:39.160458  4166 ts_tablet_manager.cc:1403] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.003s
I20260709 13:14:39.163146  4166 raft_consensus.cc:359] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:39.163928  4166 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:39.159055  4173 ts_tablet_manager.cc:1403] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.015s
I20260709 13:14:39.164527  4166 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:39.166774  4166 ts_tablet_manager.cc:1434] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:14:39.168111  4173 raft_consensus.cc:359] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:39.170523  4173 raft_consensus.cc:740] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:39.171202  4173 consensus_queue.cc:260] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:39.174664  4173 ts_tablet_manager.cc:1434] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:14:39.176460  3061 tablet_copy_service.cc:342] P aaf88538197a49adb8bcf3790309a67e: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-a28cf255dda74b44acbfc2fff2f8f950 received from {username='slave'} at 127.0.0.1:47488
I20260709 13:14:39.176600  3210 tablet_copy_service.cc:342] P 501fdf2af2bc4b0c971ae880e98f466b: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-96a33a25f4f3488ea9a2cec075aa10ce received from {username='slave'} at 127.0.0.1:34728
I20260709 13:14:39.176959  3061 tablet_copy_service.cc:434] P aaf88538197a49adb8bcf3790309a67e: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-a28cf255dda74b44acbfc2fff2f8f950 on tablet a28cf255dda74b44acbfc2fff2f8f950 with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:39.177053  3210 tablet_copy_service.cc:434] P 501fdf2af2bc4b0c971ae880e98f466b: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-96a33a25f4f3488ea9a2cec075aa10ce on tablet 96a33a25f4f3488ea9a2cec075aa10ce with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:39.289412  3799 raft_consensus.cc:1217] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:39.466647  3799 raft_consensus.cc:1217] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:39.469528  3799 raft_consensus.cc:1217] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:39.484138  3799 raft_consensus.cc:1217] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:39.766506  4123 raft_consensus.cc:1064] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:39.768894  4123 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:39.781716  3043 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:39.783597  3799 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:39.783815  3118 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:39.785557  4109 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:39.786777  4179 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:39.787528  4158 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:39.810091  4109 raft_consensus.cc:2955] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:39.811692  3118 raft_consensus.cc:2955] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:39.828814  3799 raft_consensus.cc:2955] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:39.830315  3045 raft_consensus.cc:2955] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:39.837545  2945 catalog_manager.cc:5697] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:39.874884  3193 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:39.881876  3118 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:39.883296  4158 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:39.884985  3799 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:39.887485  4109 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:39.892607  4179 raft_consensus.cc:2955] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:39.901036  3118 raft_consensus.cc:2955] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:39.903719  3797 raft_consensus.cc:2955] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:39.911945  4123 raft_consensus.cc:1064] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:39.914719  4123 consensus_queue.cc:237] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:39.919142  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 01dd1f72eb8249a6adadee5f3509bcc2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:39.929186  2946 catalog_manager.cc:5697] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:39.941884  3797 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:39.943661  3045 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:39.945384  3121 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:39.946563  4109 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:39.951901  4158 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:39.957967  3041 tablet_service.cc:1558] Processing DeleteTablet for tablet 01dd1f72eb8249a6adadee5f3509bcc2 with delete_type TABLET_DATA_TOMBSTONED (TS aaf88538197a49adb8bcf3790309a67e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35708
I20260709 13:14:39.956750  4109 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:14:39.960117  4192 tablet_replica.cc:333] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:14:39.961310  4192 raft_consensus.cc:2243] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:39.962201  4192 raft_consensus.cc:2272] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:39.968392  4192 ts_tablet_manager.cc:1916] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:39.981401  4158 raft_consensus.cc:2955] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:39.988408  4192 ts_tablet_manager.cc:1929] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:39.988953  4192 log.cc:1199] T 01dd1f72eb8249a6adadee5f3509bcc2 P aaf88538197a49adb8bcf3790309a67e: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-0-root/wals/01dd1f72eb8249a6adadee5f3509bcc2
I20260709 13:14:39.991730  2935 catalog_manager.cc:5028] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): tablet 01dd1f72eb8249a6adadee5f3509bcc2 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:39.992949  3799 raft_consensus.cc:2955] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:39.997218  3043 raft_consensus.cc:2955] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:40.008980  3118 raft_consensus.cc:2955] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:40.020574  2944 catalog_manager.cc:5697] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:40.055963  4179 raft_consensus.cc:1064] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:40.057722  3198 consensus_queue.cc:237] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:40.058877  4179 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:40.065382  3045 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:40.069356  3799 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:40.069824  4109 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:40.071664  4109 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:40.083727  4158 raft_consensus.cc:2955] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:40.088425  3118 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:40.089354  3797 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:40.090163  4178 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:40.090682  3799 raft_consensus.cc:2955] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:40.094365  3045 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:40.100689  4142 raft_consensus.cc:1064] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:40.094933  4109 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:40.103367  4142 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:40.096781  3043 raft_consensus.cc:2955] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:40.108086  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 96a33a25f4f3488ea9a2cec075aa10ce with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:40.109755  4179 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:40.114910  2946 catalog_manager.cc:5697] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:40.128754  3111 tablet_service.cc:1558] Processing DeleteTablet for tablet 96a33a25f4f3488ea9a2cec075aa10ce with delete_type TABLET_DATA_TOMBSTONED (TS f20672b2852447a6bc1e137c4dd40904 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54672
I20260709 13:14:40.131006  4199 tablet_replica.cc:333] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:14:40.132794  4199 raft_consensus.cc:2243] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:40.134078  4199 raft_consensus.cc:2272] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:40.142942  3047 raft_consensus.cc:2955] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:40.139914  4158 raft_consensus.cc:2955] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:40.157166  3797 raft_consensus.cc:2955] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:14:40.215950  4197 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:14:40.188179  2944 catalog_manager.cc:5697] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:40.232970  3198 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:40.233654  3797 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:40.236464  3118 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:40.236644  4201 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:40.237881  4189 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:40.241945  4189 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:40.165926  3119 raft_consensus.cc:2955] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:40.213191  4199 ts_tablet_manager.cc:1916] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:40.281144  3195 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:40.286947  3799 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:40.288439  4158 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:40.297298  3050 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:40.302976  4158 raft_consensus.cc:2955] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:40.306687  3798 raft_consensus.cc:2955] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:40.309109  4179 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:40.316154  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 348c9fe65bc24c3caf5c132e715a13ba with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:40.320569  3050 raft_consensus.cc:2955] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:40.330536  4199 ts_tablet_manager.cc:1929] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:40.331208  4199 log.cc:1199] T 96a33a25f4f3488ea9a2cec075aa10ce P f20672b2852447a6bc1e137c4dd40904: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-1-root/wals/96a33a25f4f3488ea9a2cec075aa10ce
I20260709 13:14:40.333033  2934 catalog_manager.cc:5028] TS f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): tablet 96a33a25f4f3488ea9a2cec075aa10ce (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:40.353009  4079 raft_consensus.cc:2955] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:40.355101  2946 catalog_manager.cc:5697] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:40.370062  3118 raft_consensus.cc:2955] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:40.378207  3111 tablet_service.cc:1558] Processing DeleteTablet for tablet 348c9fe65bc24c3caf5c132e715a13ba with delete_type TABLET_DATA_TOMBSTONED (TS f20672b2852447a6bc1e137c4dd40904 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54672
I20260709 13:14:40.383747  4199 tablet_replica.cc:333] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:14:40.384855  4199 raft_consensus.cc:2243] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:40.385691  4199 raft_consensus.cc:2272] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:40.388478  2949 catalog_manager.cc:5697] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:40.390094  4199 ts_tablet_manager.cc:1916] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:40.392040  3195 raft_consensus.cc:2955] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:40.399130  3798 raft_consensus.cc:2955] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:40.422061  4199 ts_tablet_manager.cc:1929] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:40.422678  4199 log.cc:1199] T 348c9fe65bc24c3caf5c132e715a13ba P f20672b2852447a6bc1e137c4dd40904: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-1-root/wals/348c9fe65bc24c3caf5c132e715a13ba
I20260709 13:14:40.424710  2934 catalog_manager.cc:5028] TS f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): tablet 348c9fe65bc24c3caf5c132e715a13ba (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:40.441577  3050 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:40.448362  3798 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:40.448659  3118 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:40.449755  4079 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:40.451581  4189 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:40.457183  4201 raft_consensus.cc:2955] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:40.460350  3118 raft_consensus.cc:2955] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:40.475468  2945 catalog_manager.cc:5697] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New cstate: current_term: 1 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:40.477038  2935 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a28cf255dda74b44acbfc2fff2f8f950 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:40.478422  3798 raft_consensus.cc:2955] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:40.488019  3187 tablet_service.cc:1558] Processing DeleteTablet for tablet a28cf255dda74b44acbfc2fff2f8f950 with delete_type TABLET_DATA_TOMBSTONED (TS 501fdf2af2bc4b0c971ae880e98f466b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51690
I20260709 13:14:40.494992  4205 tablet_replica.cc:333] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:14:40.496138  4205 raft_consensus.cc:2243] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:40.496819  4205 raft_consensus.cc:2272] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:40.500774  4205 ts_tablet_manager.cc:1916] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:40.514680  4205 ts_tablet_manager.cc:1929] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:40.515000  4205 log.cc:1199] T a28cf255dda74b44acbfc2fff2f8f950 P 501fdf2af2bc4b0c971ae880e98f466b: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-2-root/wals/a28cf255dda74b44acbfc2fff2f8f950
I20260709 13:14:40.516446  2934 catalog_manager.cc:5028] TS 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): tablet a28cf255dda74b44acbfc2fff2f8f950 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:41.561213  3196 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:41.571411  3050 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:41.571645  3119 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:41.573087  3164 consensus_peers.cc:597] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 85059665c6234a2a8380bebb4790b5cb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:41.573081  4123 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:41.573966  4158 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:41.588321  4123 raft_consensus.cc:2955] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:41.602386  3119 raft_consensus.cc:2955] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:41.611716  3050 raft_consensus.cc:2955] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:41.613238  3118 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:41.625388  2944 catalog_manager.cc:5697] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
W20260709 13:14:41.658725  3090 consensus_peers.cc:597] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a2dc1155b33b4fbc830d189f5e109f78. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:41.661427  3050 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:41.663240  4206 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:41.684168  4180 raft_consensus.cc:2955] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:41.686062  3047 raft_consensus.cc:2955] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:41.700034  3195 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:41.702773  4137 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:41.705056  3119 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:41.715592  2946 catalog_manager.cc:5697] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:41.732411  3191 raft_consensus.cc:2955] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
W20260709 13:14:41.755224  3090 consensus_peers.cc:597] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: be0f43de06b240e69f5f94ca88c7b321. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:41.755939  3050 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:41.759141  3196 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:41.759143  4180 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:41.763087  4180 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:41.782917  4180 raft_consensus.cc:2955] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:41.786968  3047 raft_consensus.cc:2955] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:41.789335  3191 raft_consensus.cc:2955] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:41.800920  3191 consensus_queue.cc:237] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:41.805562  2945 catalog_manager.cc:5697] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:41.810880  3164 consensus_peers.cc:597] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3fe8825ca0db45529c5a46ef6e9ba53d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:41.813156  3119 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:41.813931  3047 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:41.815124  4123 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:41.816021  4158 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:41.836805  4211 raft_consensus.cc:2955] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:41.838270  3119 raft_consensus.cc:2955] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:41.846978  3045 raft_consensus.cc:2955] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:41.867238  2946 catalog_manager.cc:5697] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:41.970278  4228 ts_tablet_manager.cc:933] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:41.972427  4228 tablet_copy_client.cc:323] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.131:38665
I20260709 13:14:41.974334  3210 tablet_copy_service.cc:140] P 501fdf2af2bc4b0c971ae880e98f466b: Received BeginTabletCopySession request for tablet 85059665c6234a2a8380bebb4790b5cb from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:34728)
I20260709 13:14:41.974962  3210 tablet_copy_service.cc:161] P 501fdf2af2bc4b0c971ae880e98f466b: Beginning new tablet copy session on tablet 85059665c6234a2a8380bebb4790b5cb from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:34728: session id = e9165fe61ab04bfb9a48889156d5c161-85059665c6234a2a8380bebb4790b5cb
I20260709 13:14:41.983206  3210 tablet_copy_source_session.cc:215] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:41.986729  4228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85059665c6234a2a8380bebb4790b5cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:42.004194  4228 tablet_copy_client.cc:806] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:42.004844  4228 tablet_copy_client.cc:670] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:42.008623  4228 tablet_copy_client.cc:538] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:42.018801  4228 tablet_bootstrap.cc:492] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:42.040423  4228 tablet_bootstrap.cc:492] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:42.041487  4228 tablet_bootstrap.cc:492] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:42.042265  4228 ts_tablet_manager.cc:1403] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.006s
I20260709 13:14:42.045354  4228 raft_consensus.cc:359] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:42.046283  4228 raft_consensus.cc:740] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:42.046943  4228 consensus_queue.cc:260] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:42.056946  4228 ts_tablet_manager.cc:1434] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.007s
I20260709 13:14:42.058655  3210 tablet_copy_service.cc:342] P 501fdf2af2bc4b0c971ae880e98f466b: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-85059665c6234a2a8380bebb4790b5cb received from {username='slave'} at 127.0.0.1:34728
I20260709 13:14:42.059053  3210 tablet_copy_service.cc:434] P 501fdf2af2bc4b0c971ae880e98f466b: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-85059665c6234a2a8380bebb4790b5cb on tablet 85059665c6234a2a8380bebb4790b5cb with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:42.123260  4228 ts_tablet_manager.cc:933] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:42.127831  4228 tablet_copy_client.cc:323] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.130:38619
I20260709 13:14:42.129578  3136 tablet_copy_service.cc:140] P f20672b2852447a6bc1e137c4dd40904: Received BeginTabletCopySession request for tablet a2dc1155b33b4fbc830d189f5e109f78 from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:55318)
I20260709 13:14:42.130153  3136 tablet_copy_service.cc:161] P f20672b2852447a6bc1e137c4dd40904: Beginning new tablet copy session on tablet a2dc1155b33b4fbc830d189f5e109f78 from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:55318: session id = e9165fe61ab04bfb9a48889156d5c161-a2dc1155b33b4fbc830d189f5e109f78
I20260709 13:14:42.136637  3136 tablet_copy_source_session.cc:215] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:42.139624  4228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2dc1155b33b4fbc830d189f5e109f78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:42.157143  4228 tablet_copy_client.cc:806] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:42.159621  4228 tablet_copy_client.cc:670] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:42.163470  4228 tablet_copy_client.cc:538] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:42.172650  4228 tablet_bootstrap.cc:492] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:42.278085  4234 ts_tablet_manager.cc:933] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:42.280673  4234 tablet_copy_client.cc:323] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.131:38665
I20260709 13:14:42.282500  3210 tablet_copy_service.cc:140] P 501fdf2af2bc4b0c971ae880e98f466b: Received BeginTabletCopySession request for tablet 3fe8825ca0db45529c5a46ef6e9ba53d from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:34728)
I20260709 13:14:42.283108  3210 tablet_copy_service.cc:161] P 501fdf2af2bc4b0c971ae880e98f466b: Beginning new tablet copy session on tablet 3fe8825ca0db45529c5a46ef6e9ba53d from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:34728: session id = e9165fe61ab04bfb9a48889156d5c161-3fe8825ca0db45529c5a46ef6e9ba53d
I20260709 13:14:42.287508  4228 tablet_bootstrap.cc:492] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:42.288516  4228 tablet_bootstrap.cc:492] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:42.289327  4228 ts_tablet_manager.cc:1403] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.117s	user 0.031s	sys 0.069s
I20260709 13:14:42.292682  4228 raft_consensus.cc:359] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:42.293345  3210 tablet_copy_source_session.cc:215] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:42.293689  4228 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:42.294456  4228 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:42.300678  4228 ts_tablet_manager.cc:1434] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:14:42.303292  4234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe8825ca0db45529c5a46ef6e9ba53d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:42.305861  3136 tablet_copy_service.cc:342] P f20672b2852447a6bc1e137c4dd40904: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-a2dc1155b33b4fbc830d189f5e109f78 received from {username='slave'} at 127.0.0.1:55318
I20260709 13:14:42.306618  3136 tablet_copy_service.cc:434] P f20672b2852447a6bc1e137c4dd40904: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-a2dc1155b33b4fbc830d189f5e109f78 on tablet a2dc1155b33b4fbc830d189f5e109f78 with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:42.331427  4234 tablet_copy_client.cc:806] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:42.332082  4234 tablet_copy_client.cc:670] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:42.336511  4234 tablet_copy_client.cc:538] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:42.344801  4234 tablet_bootstrap.cc:492] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:42.362498  4228 ts_tablet_manager.cc:933] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:42.364192  4234 tablet_bootstrap.cc:492] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:42.366408  4234 tablet_bootstrap.cc:492] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:42.367587  4234 ts_tablet_manager.cc:1403] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 13:14:42.371162  4234 raft_consensus.cc:359] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:42.372103  4234 raft_consensus.cc:740] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:42.372792  4234 consensus_queue.cc:260] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:42.378592  4234 ts_tablet_manager.cc:1434] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:14:42.380407  3210 tablet_copy_service.cc:342] P 501fdf2af2bc4b0c971ae880e98f466b: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-3fe8825ca0db45529c5a46ef6e9ba53d received from {username='slave'} at 127.0.0.1:34728
I20260709 13:14:42.380817  3210 tablet_copy_service.cc:434] P 501fdf2af2bc4b0c971ae880e98f466b: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-3fe8825ca0db45529c5a46ef6e9ba53d on tablet 3fe8825ca0db45529c5a46ef6e9ba53d with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:42.389333  4228 tablet_copy_client.cc:323] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.130:38619
I20260709 13:14:42.391057  3136 tablet_copy_service.cc:140] P f20672b2852447a6bc1e137c4dd40904: Received BeginTabletCopySession request for tablet be0f43de06b240e69f5f94ca88c7b321 from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:55318)
I20260709 13:14:42.391599  3136 tablet_copy_service.cc:161] P f20672b2852447a6bc1e137c4dd40904: Beginning new tablet copy session on tablet be0f43de06b240e69f5f94ca88c7b321 from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:55318: session id = e9165fe61ab04bfb9a48889156d5c161-be0f43de06b240e69f5f94ca88c7b321
I20260709 13:14:42.399323  3136 tablet_copy_source_session.cc:215] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:42.402359  4228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0f43de06b240e69f5f94ca88c7b321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:42.419387  4228 tablet_copy_client.cc:806] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:42.419935  4228 tablet_copy_client.cc:670] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:42.423324  4228 tablet_copy_client.cc:538] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:42.432914  4228 tablet_bootstrap.cc:492] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:42.440658  3797 raft_consensus.cc:1217] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:42.455276  4228 tablet_bootstrap.cc:492] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:42.456082  4228 tablet_bootstrap.cc:492] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:42.456693  4228 ts_tablet_manager.cc:1403] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.005s
I20260709 13:14:42.458864  4228 raft_consensus.cc:359] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:42.459486  4228 raft_consensus.cc:740] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:42.460500  4228 consensus_queue.cc:260] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:42.462818  4228 ts_tablet_manager.cc:1434] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:14:42.464778  3136 tablet_copy_service.cc:342] P f20672b2852447a6bc1e137c4dd40904: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-be0f43de06b240e69f5f94ca88c7b321 received from {username='slave'} at 127.0.0.1:55318
I20260709 13:14:42.465179  3136 tablet_copy_service.cc:434] P f20672b2852447a6bc1e137c4dd40904: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-be0f43de06b240e69f5f94ca88c7b321 on tablet be0f43de06b240e69f5f94ca88c7b321 with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:42.691818  3797 raft_consensus.cc:1217] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:42.748574  3797 raft_consensus.cc:1217] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:42.932777  4211 raft_consensus.cc:1064] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:42.935536  4211 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:42.943921  3797 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:42.946003  3050 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:42.946008  3119 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:42.946141  4211 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:14:42.949626  4123 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:42.950582  4178 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:42.969815  4123 raft_consensus.cc:2955] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:42.973551  3118 raft_consensus.cc:2955] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:42.974751  3797 raft_consensus.cc:2955] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:42.981341  3799 raft_consensus.cc:1217] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:42.992893  3045 raft_consensus.cc:2955] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:43.004844  2946 catalog_manager.cc:5697] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:43.033468  3191 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:43.038992  3797 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:43.040292  4123 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:43.040567  3118 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:43.042829  4123 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:43.050669  4211 raft_consensus.cc:2955] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:43.055222  3797 raft_consensus.cc:2955] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:43.060045  3118 raft_consensus.cc:2955] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:43.080138  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 85059665c6234a2a8380bebb4790b5cb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:43.094446  2944 catalog_manager.cc:5697] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 3 to 4, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:43.109422  3041 tablet_service.cc:1558] Processing DeleteTablet for tablet 85059665c6234a2a8380bebb4790b5cb with delete_type TABLET_DATA_TOMBSTONED (TS aaf88538197a49adb8bcf3790309a67e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35708
I20260709 13:14:43.111460  4248 tablet_replica.cc:333] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:14:43.112514  4248 raft_consensus.cc:2243] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.113096  4248 raft_consensus.cc:2272] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.115949  4248 ts_tablet_manager.cc:1916] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:43.130419  4248 ts_tablet_manager.cc:1929] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:43.130781  4248 log.cc:1199] T 85059665c6234a2a8380bebb4790b5cb P aaf88538197a49adb8bcf3790309a67e: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-0-root/wals/85059665c6234a2a8380bebb4790b5cb
I20260709 13:14:43.132345  2935 catalog_manager.cc:5028] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): tablet 85059665c6234a2a8380bebb4790b5cb (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:43.215546  4123 raft_consensus.cc:1064] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:43.218080  4123 consensus_queue.cc:237] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:43.224911  3797 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:43.224923  3050 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:43.225240  3118 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:43.226754  4178 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:43.227620  4211 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:43.228533  4240 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:43.240854  4240 raft_consensus.cc:2955] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:43.243126  3118 raft_consensus.cc:2955] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:43.262976  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:43.267601  3045 raft_consensus.cc:2955] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:43.292730  4221 raft_consensus.cc:1064] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:43.297973  4221 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:43.390040  4252 log.cc:927] Time spent T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:14:43.403940  3798 raft_consensus.cc:2955] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:43.467801  3196 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:43.475982  4258 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:43.481024  3798 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:43.483134  4221 raft_consensus.cc:1064] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:43.486163  4221 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:43.497479  4220 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:14:44.215571  3118 consensus_meta.cc:287] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.971s	user 0.020s	sys 0.005s
I20260709 13:14:44.222503  4260 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:44.223120  4260 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.226070  4260 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:44.246095  3045 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:44.253288  4258 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.254205  4258 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.257097  4258 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:44.265322  4260 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:44.266346  4260 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.269426  4260 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:44.270372  4260 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:44.271103  4260 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.274168  4260 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:44.282068  4259 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.282680  4259 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.284901  4259 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:44.288335  4260 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:44.289028  4260 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:44.291256  4260 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:14:44.295636  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.297384  4257 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.298137  4257 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:44.300498  4257 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:44.305779  4259 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:44.313566  4261 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.314203  4261 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:44.318742  4261 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:44.319577  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.323294  4261 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.324252  4261 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.326900  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.327473  4261 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:44.331669  4261 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.334769  3121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "e9165fe61ab04bfb9a48889156d5c161"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:14:44.335450  3121 raft_consensus.cc:606] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Received request to transfer leadership to TS e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:44.332419  4261 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.337680  4261 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:44.341002  4266 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.341729  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.342128  4266 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:44.346001  4266 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:44.346616  4266 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:43.265650  2944 catalog_manager.cc:5697] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:44.347188  4266 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:44.350117  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.350224  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.349395  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.351743  4261 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.352353  4261 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:44.353108  4266 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:44.353547  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.354799  4261 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:44.355103  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.356693  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:14:44.362779  4221 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.030s	sys 0.017s
W20260709 13:14:44.363253  4221 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.030s	sys 0.017s
I20260709 13:14:44.383760  4273 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:44.384397  4273 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.386687  4273 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:44.388154  4273 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.388751  4273 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.390762  4273 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:44.393934  4266 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.394749  4266 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:44.398283  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.399520  4275 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.399964  4266 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:44.400435  4275 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.403410  4274 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.404036  4274 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.404659  4275 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:44.406149  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:44.406639  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:44.419313  3121 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 1.
I20260709 13:14:44.421017  3761 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:44.421867  4266 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.422377  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:44.423454  4266 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.406802  4274 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:44.409878  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:44.426044  4211 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.388181  2944 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57750 (request call id 186) took 1125 ms. Trace:
I20260709 13:14:44.412204  4178 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.426806  4211 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.427109  4178 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.414320  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:44.414436  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:44.432715  3798 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:44.415189  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:44.416330  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:44.416695  4220 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.423869  4266 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.458279  3090 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:44.455756  4259 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.459376  4259 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:44.464313  4178 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:44.468371  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:44.468947  4180 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.457108  4261 raft_consensus.cc:993] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904: : Instructing follower e9165fe61ab04bfb9a48889156d5c161 to start an election
I20260709 13:14:44.469434  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:44.608662  4240 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.502493  4273 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.615624  4240 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.616387  4273 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.458529  4220 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:44.619186  4240 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:44.474999  4221 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.620148  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:44.619973  4221 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.617455  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.521347  2945 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49738 (request call id 111) took 1103 ms. Trace:
I20260709 13:14:44.469359  4180 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.624644  4180 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.501696  3090 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:44.469321  3121 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:44.627038  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.451735  4266 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.514072  4231 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.632119  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:44.624121  2945 rpcz_store.cc:276] 0709 13:14:43.418161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.419284 (+  1123us) service_pool.cc:224] Handling call
0709 13:14:44.521264 (+1101980us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:14:44.632881  3193 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:44.636485  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:44.502584  4259 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:44.638636  4264 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.638868  4273 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:44.647678  4282 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:44.647809  4257 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.648048  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:44.647697  4274 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:44.649724  4274 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.650126  4253 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:44.504199  4211 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:44.641858  4281 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:44.642473  4180 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:44.643167  4178 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:44.508095  4279 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:14:44.625428  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 168682us
I20260709 13:14:44.644995  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:14:44.636653  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 135042us
I20260709 13:14:44.648419  4257 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.500070  4277 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:44.632207  4220 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:44.654698  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:44.655756  4221 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:44.655998  4274 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:44.657981  4178 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.634995  4261 raft_consensus.cc:1081] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Signalling peer e9165fe61ab04bfb9a48889156d5c161 to start an election
I20260709 13:14:44.666851  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:44.650694  4253 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.669848  4180 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:44.672624  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:44.677068  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:44.679471  4178 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:44.681371  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:14:44.682396  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 59355.3us
I20260709 13:14:44.426834  2944 rpcz_store.cc:276] 0709 13:14:43.262492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.262651 (+   159us) service_pool.cc:224] Handling call
0709 13:14:44.388088 (+1125437us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:44.365041 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:44.365693 (+   652us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:44.365728 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:14:44.365769 (+    41us) tablet.cc:662] Decoding operations
0709 13:14:44.366111 (+   342us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:44.366190 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:44.366219 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:44.366442 (+   223us) tablet.cc:701] Row locks acquired
0709 13:14:44.366461 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:14:44.366596 (+   135us) write_op.cc:270] Start()
0709 13:14:44.366711 (+   115us) write_op.cc:276] Timestamp: P: 1783602884366551 usec, L: 0
0709 13:14:44.366736 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:14:44.367471 (+   735us) log.cc:844] Serialized 598 byte log entry
0709 13:14:44.372557 (+  5086us) op_driver.cc:464] REPLICATION: finished
0709 13:14:44.382739 (+ 10182us) write_op.cc:301] APPLY: starting
0709 13:14:44.382819 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:44.382922 (+   103us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:44.383056 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:44.383241 (+   185us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:44.383388 (+   147us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:44.383433 (+    45us) write_op.cc:312] APPLY: finished
0709 13:14:44.383655 (+   222us) log.cc:844] Serialized 22 byte log entry
0709 13:14:44.384781 (+  1126us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:44.384883 (+   102us) write_op.cc:454] Released schema lock
0709 13:14:44.384923 (+    40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":9952,"apply.run_cpu_time_us":1642,"apply.run_wall_time_us":56984,"num_ops":1,"prepare.queue_time_us":5294,"prepare.run_cpu_time_us":3987,"prepare.run_wall_time_us":5181,"raft.queue_time_us":1169,"raft.run_cpu_time_us":7406,"raft.run_wall_time_us":12246,"replication_time_us":5703,"spinlock_wait_cycles":97536,"thread_start_us":20956,"threads_started":4,"wal-append.queue_time_us":1473}]]}
I20260709 13:14:44.656512  4281 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:44.648299  4282 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.686466  4276 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:44.703797  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:44.631367  4231 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:44.673240  4275 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:44.704095  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:44.707231  3197 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
W20260709 13:14:44.709954  4280 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:14:44.712515  4257 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:44.712659  4274 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:44.713543  4274 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.722393  3195 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:44.682436  4277 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.714354  4276 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.726990  4260 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:44.713606  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.729133  4260 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:44.730320  4274 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:44.732800  4282 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:44.732897  4260 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:44.734294  4281 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:44.725898  4240 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:44.717316  4275 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.737643  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.739509  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.742666  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.744565  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.748148  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.749253  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.750125  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.673579  4279 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:44.752557  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 75317.7us
I20260709 13:14:44.757216  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.757580  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:44.749338  4282 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:44.761633  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:44.762204  4257 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:44.746758  4240 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.740582  4266 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:44.762744  4257 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:44.770269  4276 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:44.755131  4253 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:44.764804  4282 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:44.753072  3147 debug-util.cc:398] Leaking SignalData structure 0x7b08000dcec0 after lost signal to thread 1937
I20260709 13:14:44.759780  3164 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:44.758836  4285 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.835587  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:44.835505  4260 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:44.866370  4178 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:14:44.866238  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 106497us
I20260709 13:14:44.866811  4178 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:44.867113  4178 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:44.862681  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 137357us
I20260709 13:14:44.836133  4259 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:44.900844  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:44.903416  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:44.904695  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:44.869426  4276 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:44.897445  4260 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:45.025592  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 70131.6us
W20260709 13:14:44.953235  1939 debug-util.cc:398] Leaking SignalData structure 0x7b080000fae0 after lost signal to thread 4221
I20260709 13:14:44.952209  3090 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:44.953722  4178 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:45.110569  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:14:45.111469  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 159367us
I20260709 13:14:45.035280  3794 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 2: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:14:44.938162  4279 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:14:45.031359  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 134200us
I20260709 13:14:45.117107  4178 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:45.115367  3090 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:45.120550  4301 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:45.122992  4302 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:45.135852  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.087603  4266 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:45.087100  4231 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:45.113336  4220 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.053025  4211 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:45.139349  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.070781  4273 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:45.045007  4283 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:45.129374  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.131966  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.057322  4277 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:45.101886  4282 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:45.146040  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:44.899422  4285 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:45.135136  3147 debug-util.cc:398] Leaking SignalData structure 0x7b08000a7820 after lost signal to thread 2983
I20260709 13:14:45.070364  3793 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
 from {username='slave'} at 127.0.0.1:43908
I20260709 13:14:45.178165  3793 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:45.178072  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.178689  3793 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.168677  4273 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:44.944311  4259 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:45.010957  4276 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:45.034349  4286 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:45.141006  4279 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:45.162432  4231 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:45.140276  4261 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.164402  4240 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:45.174261  4260 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:45.181550  4266 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:45.185981  4276 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:45.186069  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.189850  4291 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:45.191936  3792 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:45.168236  4211 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:45.199684  4287 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:45.202512  4295 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:45.211905  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.171243  4302 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:45.216104  4293 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:45.217885  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.220443  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:45.222373  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.196951  4286 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:45.227597  3120 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.223300  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.190395  4283 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:45.228863  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.229053  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.192633  4231 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:45.230417  4283 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:45.196719  4266 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:45.217592  3147 debug-util.cc:398] Leaking SignalData structure 0x7b080029c0e0 after lost signal to thread 3075
I20260709 13:14:45.225359  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:45.224031  3195 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.237223  4231 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:45.200929  4257 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:45.160127  4301 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:45.247925  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:14:45.239501  3147 debug-util.cc:398] Leaking SignalData structure 0x7b080031f4e0 after lost signal to thread 3150
I20260709 13:14:45.198650  4279 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:45.200379  4287 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:45.214453  4291 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:45.203320  4295 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:45.258273  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:45.261646  3799 raft_consensus.cc:2955] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:45.256481  4283 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:45.267477  4283 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:45.269717  4301 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:45.271488  4287 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:45.272250  4287 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:45.272897  4287 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:45.216897  4293 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:45.260623  4273 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:45.288201  4274 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:45.289505  4285 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:45.290800  4275 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:14:45.291574  4211 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:45.307374  3795 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.311517  4286 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:45.310257  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.284114  4294 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:45.318943  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.318897  4294 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:45.324232  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.317553  3798 raft_consensus.cc:2955] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:45.327920  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.328639  3090 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:45.294241  4180 raft_consensus.cc:2955] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:45.329761  3090 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:45.332309  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:45.336280  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.338945  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.293340  4274 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:45.343158  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.343703  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.346511  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:14:45.338861  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 199999us
I20260709 13:14:45.349642  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.352190  4294 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:45.350647  3165 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:14:45.335304  3147 debug-util.cc:398] Leaking SignalData structure 0x7b08001e2aa0 after lost signal to thread 3823
I20260709 13:14:45.354250  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.354517  4293 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:45.355152  4292 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.357386  3165 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.358919  3165 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.335137  4257 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:45.335426  4259 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:45.374269  4211 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:45.374447  4273 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:45.374611  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.374900  4211 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:45.375846  4266 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:45.375012  4273 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:45.376796  4282 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.377024  4211 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:45.377763  4273 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:45.378041  4303 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.375757  3164 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.363051  4276 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.400671  4283 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:45.370442  4295 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:45.363662  4257 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:45.404139  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.411891  3164 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.374272  4304 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.407087  4257 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.415148  4306 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.416848  4302 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:45.419198  4279 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:45.419803  4274 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:45.420312  4291 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:45.315042  4298 raft_consensus.cc:2955] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:45.422654  3793 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:45.409016  4287 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:45.413775  4283 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.432353  4257 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:45.414750  3164 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.436962  4274 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:45.440076  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 182446us
I20260709 13:14:45.440951  3164 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.441314  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.450099  3798 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.448894  2944 catalog_manager.cc:5697] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:45.452875  4307 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:45.451634  2944 catalog_manager.cc:5697] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:45.454164  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.445191  4274 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.455250  4180 consensus_queue.cc:1059] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:14:45.457062  3015 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.457552  4293 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.453416  4307 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:45.464506  3793 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:45.466262  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:45.467731  4307 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.473178  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.474102  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.475260  4293 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:45.475694  4293 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:45.476073  4293 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.481804  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.482594  3198 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 2: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:14:45.484026  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.484119  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.484894  4291 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:45.485291  4291 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:45.485908  4291 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.486515  3198 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:45.488565  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.490859  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.492859  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.494941  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.496135  4310 consensus_queue.cc:1059] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:45.497592  4287 raft_consensus.cc:3055] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:45.498157  4287 raft_consensus.cc:740] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:45.499325  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.499662  3761 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:45.500365  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.500566  4266 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.501996  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.503330  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.504969  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.499157  4287 consensus_queue.cc:260] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:45.507054  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.507915  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.508664  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.510263  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.514874  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.524310  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.512629  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.520222  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.515888  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.510424  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:45.532542  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.532827  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.546957  3090 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:45.548619  4264 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.551234  3090 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:45.552173  4258 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.555601  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.558687  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.534747  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.569638  3198 consensus_queue.cc:237] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:45.578187  4309 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:45.579332  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.573491  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.581614  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.513156  4287 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.583654  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.583704  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.578884  4309 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:45.588881  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.592767  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:14:45.598137  4311 log.cc:927] Time spent T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:14:45.598939  4257 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:45.602211  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.590660  3117 raft_consensus.cc:3055] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:45.603380  3117 raft_consensus.cc:740] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:45.604295  3117 consensus_queue.cc:260] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:45.606493  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.606848  3117 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.611316  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.614080  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.602144  4292 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.602492  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:45.619035  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:45.620184  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:45.620674  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.621227  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.621377  4309 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:45.622861  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.623703  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:45.623988  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.624508  3042 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.624828  3117 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:45.625540  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:45.630252  3762 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.622447  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:14:45.631642  4259 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:14:45.636512  3762 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.637413  4286 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.637785  4266 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.638595  4291 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:45.639047  3762 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.639932  4266 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.642660  3761 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:45.643734  4266 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:45.644356  4266 raft_consensus.cc:697] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:14:45.644726  3090 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:45.645648  4292 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.645341  4266 consensus_queue.cc:237] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:45.653223  3090 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:45.654621  4292 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.654726  4293 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:45.656313  3047 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.629086  4307 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:45.658852  3043 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.659617  4307 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:45.661355  3091 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:45.663376  4180 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:45.665756  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.666100  3117 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.667465  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.668480  4298 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.669304  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:45.662784  4292 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.672093  3043 raft_consensus.cc:2955] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:45.663517  3090 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:45.675828  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:45.742508  4291 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:14:45.743639  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 80191.2us
I20260709 13:14:45.744087  4261 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.744513  3090 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:45.728466  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.696203  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.690493  4293 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:45.734432  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.723390  3045 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.738903  4298 consensus_queue.cc:1059] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:14:45.739579  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 69012.5us
I20260709 13:14:45.747675  4283 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.749218  3046 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:45.748509  4283 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.749990  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:45.755391  4291 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.752864  4261 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.756393  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:45.755142  4221 consensus_queue.cc:1059] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:45.729575  3042 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:45.757944  4287 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.758100  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:45.758123  4298 raft_consensus.cc:3055] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:45.760336  4298 raft_consensus.cc:740] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:45.760730  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:45.761500  4298 consensus_queue.cc:260] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:45.763350  4298 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.696151  3195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "e9165fe61ab04bfb9a48889156d5c161"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:14:45.765996  3195 raft_consensus.cc:606] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Received request to transfer leadership to TS e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:45.757961  4257 raft_consensus.cc:3055] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:45.766592  4257 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:45.753177  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:45.767619  4257 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:45.763391  4221 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:14:45.769109  4257 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.769546  4221 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:45.765929  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.770923  4221 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:45.772217  4221 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:45.775063  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.777361  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.767856  3796 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:45.782723  4307 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:45.787580  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:45.750627  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 54528.3us
I20260709 13:14:45.795399  4287 consensus_queue.cc:1059] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:45.797184  4287 raft_consensus.cc:3055] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:45.797601  4287 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:45.798941  4287 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:45.800598  4287 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.776722  4221 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:45.795429  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 51007.6us
I20260709 13:14:45.807801  3090 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:45.791887  3165 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.810182  4257 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.812144  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.812312  3165 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.819161  4274 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.813265  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.820600  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:45.821099  4307 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:45.823745  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.824388  4291 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:45.825044  4297 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.825423  4291 raft_consensus.cc:3055] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:45.823572  4283 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.825832  4291 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:45.825953  3165 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.826740  4291 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:45.828223  4291 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.829592  3165 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.830448  4283 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.831832  3165 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.832522  4283 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.834646  4297 raft_consensus.cc:993] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b: : Instructing follower e9165fe61ab04bfb9a48889156d5c161 to start an election
I20260709 13:14:45.835111  4297 raft_consensus.cc:1081] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Signalling peer e9165fe61ab04bfb9a48889156d5c161 to start an election
I20260709 13:14:45.830295  4274 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.836458  4306 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:45.839207  3799 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
 from {username='slave'} at 127.0.0.1:43926
I20260709 13:14:45.839803  3799 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:45.840260  3799 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.849759  3799 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:45.866815  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:45.867486  3117 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.874384  3117 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:45.879110  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:45.879956  4266 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:45.880525  4266 raft_consensus.cc:697] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:14:45.881383  4266 consensus_queue.cc:237] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:45.833642  3165 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.888228  4274 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:45.888365  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 54801.4us
I20260709 13:14:45.889189  3165 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.890767  4274 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.891012  3165 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.891868  3799 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:45.856109  3090 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:45.893949  4261 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.894358  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:45.893941  3123 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.895321  3118 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.895821  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:45.896376  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:45.898144  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:45.898540  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:45.902093  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:45.903730  3118 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:45.904693  3125 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:45.906463  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:45.908877  3121 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:45.912930  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:45.923036  4283 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.925160  3165 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.925971  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:45.931932  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.932865  4293 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.934187  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:45.929312  2945 catalog_manager.cc:5697] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 1 to 2, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 2 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:45.937151  4287 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.937635  2945 catalog_manager.cc:5697] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 1 to 2, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 2 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:45.943324  3117 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:45.938594  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.955994  4240 raft_consensus.cc:2955] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:45.957930  4279 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.968370  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.969946  4287 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.970671  4287 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.958990  3165 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.972116  3165 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.973213  3165 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.974148  4279 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.974747  4279 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.975268  4279 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:45.969470  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:45.976925  4291 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.978863  3165 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.980077  3165 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.981478  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:45.983740  4302 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.984438  4302 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.985189  4287 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.990733  3165 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:45.991621  4302 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:46.007792  2945 catalog_manager.cc:5697] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:46.014539  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 62742.4us
I20260709 13:14:46.019573  4266 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:46.020170  4266 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:46.021327  3165 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:46.034389  4279 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.023603  4266 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:46.025991  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:46.027052  3796 raft_consensus.cc:2955] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:14:46.040050  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.040776  3015 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:46.042196  3111 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fe8825ca0db45529c5a46ef6e9ba53d with delete_type TABLET_DATA_TOMBSTONED (TS f20672b2852447a6bc1e137c4dd40904 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54672
I20260709 13:14:46.044955  4287 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.051093  3045 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:46.052719  4266 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:46.059508  3798 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:46.063427  4324 tablet_replica.cc:333] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:14:46.066329  4292 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:46.070957  4287 consensus_queue.cc:1059] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:46.071616  3042 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:46.078624  4287 raft_consensus.cc:3055] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:46.079100  4287 raft_consensus.cc:740] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:46.073386  3165 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:46.080139  4287 consensus_queue.cc:260] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:46.082099  4279 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:46.082739  4279 raft_consensus.cc:697] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:46.084128  4292 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:46.083750  4279 consensus_queue.cc:237] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:46.080629  3761 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:46.089962  4266 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.091859  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:46.092859  4266 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.094463  3761 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:46.097172  4266 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.098623  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:46.097851  4298 raft_consensus.cc:2955] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:46.099565  4266 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.100409  4287 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.074865  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:46.106730  4310 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:46.107371  4310 raft_consensus.cc:697] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:46.106957  3043 raft_consensus.cc:2955] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:46.108444  4310 consensus_queue.cc:237] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:46.111348  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:46.124347  4309 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:46.114722  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet be0f43de06b240e69f5f94ca88c7b321 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:46.124944  4309 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:46.125536  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3fe8825ca0db45529c5a46ef6e9ba53d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:46.125018  2946 catalog_manager.cc:5697] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:46.122313  3042 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:46.126051  4309 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:46.131289  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:46.135078  3117 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:46.146906  3796 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:46.154052  3126 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:46.155364  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:46.161178  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:46.189250  3197 raft_consensus.cc:3055] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:46.189616  3197 raft_consensus.cc:740] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:46.190470  3197 consensus_queue.cc:260] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:46.191267  4323 consensus_queue.cc:1059] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:46.191555  4291 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.192237  4323 consensus_queue.cc:1059] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:46.192952  4323 consensus_queue.cc:1243] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Peer e9165fe61ab04bfb9a48889156d5c161 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:14:46.194479  4240 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:14:46.192955  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 61756.5us
I20260709 13:14:46.199723  3197 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.220470  3187 tablet_service.cc:1558] Processing DeleteTablet for tablet be0f43de06b240e69f5f94ca88c7b321 with delete_type TABLET_DATA_TOMBSTONED (TS 501fdf2af2bc4b0c971ae880e98f466b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51690
I20260709 13:14:46.221612  3761 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:46.222693  4266 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.172650  3198 raft_consensus.cc:2955] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:46.224615  4266 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:46.178205  3798 raft_consensus.cc:2955] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:46.256325  2944 catalog_manager.cc:5697] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 1 to 2, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 2 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:46.259814  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 60412.8us
W20260709 13:14:46.273028  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 48634.5us
W20260709 13:14:46.277088  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.296129  3197 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:46.302026  4333 tablet_replica.cc:333] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:14:46.303110  4333 raft_consensus.cc:2243] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:46.303812  4333 raft_consensus.cc:2272] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:46.306633  2945 catalog_manager.cc:5697] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 1 to 2, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 2 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:46.308387  2945 catalog_manager.cc:5697] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 1 to 2, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 2 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:46.309974  4333 ts_tablet_manager.cc:1916] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:46.322329  3043 raft_consensus.cc:2955] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:46.345844  3117 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:46.347908  3043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "e9165fe61ab04bfb9a48889156d5c161"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:14:46.348487  3043 raft_consensus.cc:606] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Received request to transfer leadership to TS e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:46.348811  3043 raft_consensus.cc:614] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:46.350021  4324 raft_consensus.cc:2243] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:46.350934  4324 raft_consensus.cc:2272] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:46.351603  3045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "e9165fe61ab04bfb9a48889156d5c161"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:14:46.352191  3045 raft_consensus.cc:606] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Received request to transfer leadership to TS e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:46.352509  3045 raft_consensus.cc:614] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:46.354308  4324 ts_tablet_manager.cc:1916] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:46.364300  4333 ts_tablet_manager.cc:1929] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:46.364889  4333 log.cc:1199] T be0f43de06b240e69f5f94ca88c7b321 P 501fdf2af2bc4b0c971ae880e98f466b: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-2-root/wals/be0f43de06b240e69f5f94ca88c7b321
I20260709 13:14:46.367110  2934 catalog_manager.cc:5028] TS 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): tablet be0f43de06b240e69f5f94ca88c7b321 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:46.367937  3197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "e9165fe61ab04bfb9a48889156d5c161"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:14:46.368562  3197 raft_consensus.cc:606] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Received request to transfer leadership to TS e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:46.373908  4286 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:46.374395  3197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "e9165fe61ab04bfb9a48889156d5c161"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:14:46.375136  3197 raft_consensus.cc:606] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Received request to transfer leadership to TS e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:46.378710  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:46.380483  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:46.433693  3187 tablet_service.cc:1558] Processing DeleteTablet for tablet be0f43de06b240e69f5f94ca88c7b321 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:51690
I20260709 13:14:46.436549  2934 catalog_manager.cc:5028] TS 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): tablet be0f43de06b240e69f5f94ca88c7b321 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:46.440722  3197 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:46.442209  4266 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:46.489522  4240 raft_consensus.cc:993] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: : Instructing follower e9165fe61ab04bfb9a48889156d5c161 to start an election
I20260709 13:14:46.490190  4240 raft_consensus.cc:1081] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Signalling peer e9165fe61ab04bfb9a48889156d5c161 to start an election
I20260709 13:14:46.493088  3796 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
 from {username='slave'} at 127.0.0.1:43926
I20260709 13:14:46.493723  3796 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:46.494155  3796 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.537386  3796 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:46.551280  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:46.551939  3043 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.562579  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:46.563330  3198 raft_consensus.cc:3055] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:46.563735  3198 raft_consensus.cc:740] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:46.564509  3198 consensus_queue.cc:260] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:46.565500  3198 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.569321  3042 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:46.570160  4324 ts_tablet_manager.cc:1929] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:46.570693  4324 log.cc:1199] T 3fe8825ca0db45529c5a46ef6e9ba53d P f20672b2852447a6bc1e137c4dd40904: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-1-root/wals/3fe8825ca0db45529c5a46ef6e9ba53d
I20260709 13:14:46.572592  2934 catalog_manager.cc:5028] TS f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): tablet 3fe8825ca0db45529c5a46ef6e9ba53d (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:46.577167  3198 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:46.563309  3796 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:46.581025  4279 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:14:46.593477  3043 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:46.600486  3045 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:46.600819  3761 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:14:46.605111  4266 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:46.605762  4266 raft_consensus.cc:697] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:14:46.606709  4266 consensus_queue.cc:237] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:46.601620  3197 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.623461  3119 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:46.625455  4240 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:46.628544  3119 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:46.640884  3197 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:46.667773  2945 catalog_manager.cc:5697] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 1 to 2, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 2 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:46.675829  4287 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:46.684615  4323 raft_consensus.cc:993] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b: : Instructing follower e9165fe61ab04bfb9a48889156d5c161 to start an election
I20260709 13:14:46.685287  4323 raft_consensus.cc:1081] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Signalling peer e9165fe61ab04bfb9a48889156d5c161 to start an election
I20260709 13:14:46.687425  3796 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
 from {username='slave'} at 127.0.0.1:43926
I20260709 13:14:46.688091  3796 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:46.688555  3796 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.696983  3796 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:46.708155  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:46.708948  3045 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.709893  3796 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:46.716328  4307 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:46.718343  3045 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:46.719920  3762 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:14:46.721004  4266 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:46.721565  4266 raft_consensus.cc:697] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:14:46.722522  4266 consensus_queue.cc:237] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:46.731902  3126 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:46.744958  4334 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:46.745579  4334 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:46.750216  4334 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:46.751024  4307 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:46.743155  2946 catalog_manager.cc:5697] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 1 to 2, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 2 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:46.752226  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:46.753003  3042 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:46.755276  3762 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:14:46.765321  4334 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:46.765986  4334 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:46.766476  4334 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.777981  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:46.779052  3126 raft_consensus.cc:2393] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 2: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:46.785964  3195 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.807750  4334 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:46.811249  3195 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:46.818861  4334 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:46.819661  4334 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:46.820144  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:46.821831  3126 raft_consensus.cc:2393] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 2: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:46.823719  4334 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:46.829286  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:46.830005  3195 raft_consensus.cc:3055] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:46.830322  3195 raft_consensus.cc:740] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:46.831082  3195 consensus_queue.cc:260] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:46.832526  3195 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.833626  4334 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:46.834767  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:46.838930  3195 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:46.890671  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:46.898187  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:46.903338  3042 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 2: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:46.909307  4352 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:46.922037  3043 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:46.936803  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:46.946660  3126 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 2: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:46.960085  3762 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:46.978554  4334 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:46.979485  4334 raft_consensus.cc:697] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:14:46.981611  3762 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:46.990861  4286 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.981163  4334 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:47.057866  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 57529.9us
W20260709 13:14:47.106969  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 81973us
I20260709 13:14:47.109558  4361 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:47.120936  4286 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:47.117251  4361 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:47.163631  4361 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:47.167909  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:47.168992  3117 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 2: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:47.172132  3043 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:47.180648  3042 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:47.206542  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:47.207475  3042 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 2: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:47.215693  3165 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:47.217890  4266 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:47.219774  4266 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:47.231283  4298 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.232030  4298 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:47.236748  4298 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:47.245200  4361 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.246523  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:47.247299  3796 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:47.255108  2945 catalog_manager.cc:5697] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 1 to 2, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 2 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:47.295073  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:47.312350  4357 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.313222  4357 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:47.324637  3194 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:47.335819  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:47.334182  4365 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:14:47.336555  3044 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:47.335659  3197 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:47.352433  4357 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:47.356715  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:47.357641  3798 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:47.357669  4361 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:47.359450  3090 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:47.363355  4266 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:47.364024  4257 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:47.364500  4257 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.364864  4257 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.394183  4307 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.395013  4307 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:47.404171  4307 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:14:47.410271  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 60623.6us
I20260709 13:14:47.405238  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:47.391979  3091 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:47.423089  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:47.425321  3796 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:47.425829  4363 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:47.426322  4363 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.426723  4363 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.426693  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:47.440852  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:47.441576  3043 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:47.445273  4363 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:47.449004  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:47.469151  4363 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:47.473557  4257 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:47.475229  3119 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:47.477828  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:47.478530  3043 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.497537  3043 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:14:47.513236  3091 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:47.514444  4363 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:47.515184  4363 raft_consensus.cc:697] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:47.516112  4363 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:47.519274  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:47.519971  3798 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.528620  3798 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:14:47.530607  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:47.531245  3043 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.531279  3090 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:47.533931  4298 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:47.534516  4298 raft_consensus.cc:697] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:47.535523  4298 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:47.536767  4365 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:47.537364  4365 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:47.539039  3043 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:14:47.539620  4365 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:47.541119  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:47.542011  3119 raft_consensus.cc:2393] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 2: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:47.550984  3119 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:47.554781  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:47.555640  3042 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:47.556696  3762 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:47.557838  4365 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:47.558212  4365 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:47.558586  4365 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.563736  4334 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:47.564571  4334 consensus_queue.cc:1243] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:14:47.565354  4366 raft_consensus.cc:3055] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:47.565702  4366 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:14:47.566550  4366 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:47.566124  2948 catalog_manager.cc:5697] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 2 to 3, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 3 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.572144  4366 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.574553  4365 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:47.600976  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:47.627125  4363 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.627621  4365 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:47.627740  4363 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:47.632807  4363 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:47.632632  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:47.633924  3043 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:47.634814  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:47.634984  3762 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:14:47.635668  3119 raft_consensus.cc:2393] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 2: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:47.635903  4334 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:47.637924  4334 raft_consensus.cc:697] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:14:47.648348  4357 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.649838  4357 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:47.643362  4257 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:47.650573  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:47.642057  4334 consensus_queue.cc:237] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:47.660113  3090 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:47.661784  4363 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:47.663189  4357 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:47.653939  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:14:47.677457  4310 raft_consensus.cc:2764] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:14:47.664269  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:47.678552  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:47.679251  3192 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:47.678593  3051 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:47.681497  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:47.682191  3796 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:47.684311  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:47.685631  4298 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:47.686149  4298 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.686764  4298 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.693977  2948 catalog_manager.cc:5697] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 1 to 3, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 3 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.703017  2946 catalog_manager.cc:5697] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 1 to 2, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 2 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:47.731417  4298 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:47.735212  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:47.735637  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:47.736065  3192 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.736371  3042 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.746028  3042 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:14:47.748824  4298 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:47.748952  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:47.749758  3796 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.770121  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:47.781113  3192 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:14:47.782583  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:47.783504  4298 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:47.784217  4298 raft_consensus.cc:697] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:47.785164  4298 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:47.785166  3796 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:14:47.800977  2946 catalog_manager.cc:5697] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.841696  3042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:14:47.842554  3042 raft_consensus.cc:606] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:47.847697  3117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:14:47.848335  3117 raft_consensus.cc:606] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:47.856696  3117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "e9165fe61ab04bfb9a48889156d5c161"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:14:47.857353  3117 raft_consensus.cc:606] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Received request to transfer leadership to TS e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:47.862452  3198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:14:47.863072  3198 raft_consensus.cc:606] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:47.866449  3117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:14:47.867030  3117 raft_consensus.cc:606] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:47.868170  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:47.869944  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:47.886713  4334 raft_consensus.cc:476] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 13:14:47.946156  4354 raft_consensus.cc:993] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: : Instructing follower 501fdf2af2bc4b0c971ae880e98f466b to start an election
I20260709 13:14:47.946828  4287 raft_consensus.cc:1081] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Signalling peer 501fdf2af2bc4b0c971ae880e98f466b to start an election
I20260709 13:14:47.948632  3192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:51716
I20260709 13:14:47.949352  3192 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:47.949802  3192 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.957782  3192 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:47.960856  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:47.961499  3042 raft_consensus.cc:3055] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:47.961861  3042 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:47.962690  3042 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:47.963903  3042 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.966500  3192 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:47.967284  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:47.968040  3117 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.997081  3796 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:47.999640  4257 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:48.009183  3117 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:48.010809  3164 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:48.011858  4351 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:48.012619  4351 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:48.014828  4351 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:48.057641  2946 catalog_manager.cc:5697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 1 to 2, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 2 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.076661  3042 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:48.083315  4363 raft_consensus.cc:993] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: : Instructing follower aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:14:48.083844  4363 raft_consensus.cc:1081] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Signalling peer aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:14:48.084496  3043 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:48.085526  3042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:35712
I20260709 13:14:48.086218  3042 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:48.086606  3042 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.092944  4363 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:48.095021  3051 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:48.097642  3042 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:48.102877  3042 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:48.104055  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:48.104727  3198 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.111125  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:48.111816  3124 raft_consensus.cc:3055] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:48.112124  3124 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:48.114722  3796 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:14:48.115160  3796 pending_rounds.cc:85] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Aborting all ops after (but not including) 4
I20260709 13:14:48.115437  3796 pending_rounds.cc:107] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:14:48.115726  3796 raft_consensus.cc:2889] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:48.112982  3124 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:48.118121  3124 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.122432  4363 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:48.123270  4298 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:48.132037  3198 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:48.133360  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:48.134742  4354 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:48.135322  4354 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:48.138000  4354 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:48.156674  3124 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:48.161964  3051 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:48.180933  4334 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:14:48.219376  4363 raft_consensus.cc:993] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904: : Instructing follower 501fdf2af2bc4b0c971ae880e98f466b to start an election
I20260709 13:14:48.219914  4363 raft_consensus.cc:1081] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Signalling peer 501fdf2af2bc4b0c971ae880e98f466b to start an election
W20260709 13:14:48.339421  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 105779us
I20260709 13:14:48.396782  3193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:51706
I20260709 13:14:48.397505  3193 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:48.398063  3193 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.452172  3117 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:48.455870  4264 raft_consensus.cc:993] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: : Instructing follower e9165fe61ab04bfb9a48889156d5c161 to start an election
I20260709 13:14:48.456400  4264 raft_consensus.cc:1081] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Signalling peer e9165fe61ab04bfb9a48889156d5c161 to start an election
I20260709 13:14:48.460855  3193 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:48.478446  3796 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
 from {username='slave'} at 127.0.0.1:43908
I20260709 13:14:48.479228  3796 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:48.479660  3796 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.469581  4366 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:14:48.502017  3193 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:48.504020  3796 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:48.513499  3191 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:14:48.515975  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 48576.2us
W20260709 13:14:48.532737  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 298487us
I20260709 13:14:48.545874  3796 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:48.547799  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:48.560357  3124 raft_consensus.cc:3055] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:48.560700  3124 raft_consensus.cc:740] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:48.561461  3124 consensus_queue.cc:260] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:48.562561  3124 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.551075  4391 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:48.552681  3799 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:48.558696  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:48.567149  4404 raft_consensus.cc:993] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: : Instructing follower aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:14:48.567267  3043 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.567795  4404 raft_consensus.cc:1081] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Signalling peer aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:14:48.574978  3050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:35726
I20260709 13:14:48.575534  3050 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:48.575670  3045 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:48.575917  3050 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.577512  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:48.578145  3045 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.577656  3043 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:48.584311  3050 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:48.589759  3050 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:48.586689  3045 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:48.587090  3165 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:48.592516  4359 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:48.593020  4359 raft_consensus.cc:697] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:48.593374  2948 catalog_manager.cc:5697] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 1 to 2, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 2 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:48.593973  4359 consensus_queue.cc:237] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:48.594595  4391 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:48.598747  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:48.599228  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:48.599974  3117 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.600116  3124 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:48.602699  3762 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:14:48.604848  4392 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:48.605306  4392 raft_consensus.cc:697] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:14:48.611080  4392 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:48.618481  3200 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:48.620788  4407 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:48.626228  4391 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:48.627974  3117 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:48.636062  3191 raft_consensus.cc:2955] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:48.599387  3193 raft_consensus.cc:3055] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:48.647898  3193 raft_consensus.cc:740] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:48.649020  3193 consensus_queue.cc:260] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:48.650091  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:48.653518  3120 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:48.676640  3193 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.653568  3126 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:48.653574  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:48.677726  4407 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:48.678122  3118 raft_consensus.cc:3055] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:48.678344  4407 raft_consensus.cc:697] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:48.657246  3044 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:48.678467  3118 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:48.661542  3050 raft_consensus.cc:2955] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:48.682823  3118 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:48.683930  3118 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.686404  3193 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:48.687958  3120 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:48.688794  4407 consensus_queue.cc:237] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:48.695885  3118 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:48.698933  2946 catalog_manager.cc:5697] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 1 to 2, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 2 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.704833  4407 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:48.716842  4359 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:48.773221  2945 catalog_manager.cc:5697] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 1 to 2, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 2 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.779897  3050 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:48.807365  4404 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:48.838330  2948 catalog_manager.cc:5697] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 1 to 2, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 2 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:48.871161  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:48.892940  3118 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:48.898422  3796 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:48.900074  4298 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:48.913893  4357 raft_consensus.cc:2955] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:48.919010  3796 raft_consensus.cc:2955] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:48.922736  3200 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:48.926759  4298 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:48.930842  3200 raft_consensus.cc:2955] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:48.956826  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a2dc1155b33b4fbc830d189f5e109f78 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:48.957074  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:48.960305  2946 catalog_manager.cc:5697] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index 3 to 5, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New cstate: current_term: 3 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:48.995002  3041 tablet_service.cc:1558] Processing DeleteTablet for tablet a2dc1155b33b4fbc830d189f5e109f78 with delete_type TABLET_DATA_TOMBSTONED (TS aaf88538197a49adb8bcf3790309a67e not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:35708
I20260709 13:14:49.018561  4425 tablet_replica.cc:333] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:14:49.020355  4425 raft_consensus.cc:2243] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:49.021231  4425 raft_consensus.cc:2272] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:49.022627  3120 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:49.025899  4425 ts_tablet_manager.cc:1916] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:49.027012  4359 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:49.028771  3044 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:49.032567  4392 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:49.079715  3120 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:49.085518  4334 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:49.090785  3050 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:49.093154  4404 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:49.104327  3192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "e9165fe61ab04bfb9a48889156d5c161"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:14:49.105054  3192 raft_consensus.cc:606] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Received request to transfer leadership to TS e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:49.118291  3192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:14:49.119650  3192 raft_consensus.cc:606] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:49.131729  3044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:14:49.133530  3044 raft_consensus.cc:606] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:49.150784  3044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:14:49.152747  3044 raft_consensus.cc:606] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:49.160912  3120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "e9165fe61ab04bfb9a48889156d5c161"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:14:49.161569  3120 raft_consensus.cc:606] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Received request to transfer leadership to TS e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:49.163661  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:49.165341  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:49.170708  4425 ts_tablet_manager.cc:1929] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:14:49.171538  4425 log.cc:1199] T a2dc1155b33b4fbc830d189f5e109f78 P aaf88538197a49adb8bcf3790309a67e: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-0-root/wals/a2dc1155b33b4fbc830d189f5e109f78
I20260709 13:14:49.173463  4408 raft_consensus.cc:993] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904: : Instructing follower e9165fe61ab04bfb9a48889156d5c161 to start an election
I20260709 13:14:49.173777  2935 catalog_manager.cc:5028] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): tablet a2dc1155b33b4fbc830d189f5e109f78 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:14:49.174057  4357 raft_consensus.cc:1081] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Signalling peer e9165fe61ab04bfb9a48889156d5c161 to start an election
I20260709 13:14:49.176570  3796 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
 from {username='slave'} at 127.0.0.1:43908
I20260709 13:14:49.177088  3796 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:49.177433  3796 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:49.184845  3796 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:49.196530  3796 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:49.196837  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:49.197512  3120 raft_consensus.cc:3055] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:49.198908  3120 raft_consensus.cc:740] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:49.199760  3120 consensus_queue.cc:260] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:49.203990  3120 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:49.211530  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:49.212483  3192 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:49.230461  3120 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:49.231891  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:49.233693  4365 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:49.233628  3192 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:49.234277  4365 raft_consensus.cc:697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:14:49.235189  4365 consensus_queue.cc:237] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:49.236933  3120 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:49.238298  4407 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:49.255127  2946 catalog_manager.cc:5697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 1 to 2, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 2 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:49.261246  3192 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:49.272353  4405 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:49.395340  4406 raft_consensus.cc:993] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: : Instructing follower 501fdf2af2bc4b0c971ae880e98f466b to start an election
I20260709 13:14:49.395980  4407 raft_consensus.cc:1081] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Signalling peer 501fdf2af2bc4b0c971ae880e98f466b to start an election
I20260709 13:14:49.398209  3193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:51716
I20260709 13:14:49.398689  3193 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:49.398963  3193 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.403185  3193 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:49.404608  3193 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:49.405586  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:49.405830  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:49.406280  3050 raft_consensus.cc:3055] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:49.406566  3117 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.406675  3050 raft_consensus.cc:740] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:49.407717  3050 consensus_queue.cc:260] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:49.409080  3050 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.413962  3117 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:14:49.416349  4393 raft_consensus.cc:993] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b: : Instructing follower aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:14:49.416312  3164 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:49.417074  4393 raft_consensus.cc:1081] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Signalling peer aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:14:49.417881  4351 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:49.418489  4351 raft_consensus.cc:697] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:49.419343  4351 consensus_queue.cc:237] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:49.424796  3044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:35726
I20260709 13:14:49.425377  3044 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:49.425773  3044 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.440739  3044 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:49.444664  3050 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:14:49.445680  3044 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:49.446725  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:49.446949  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:49.447381  3193 raft_consensus.cc:3055] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:49.447491  3117 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.447916  3193 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:49.448758  3193 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:49.449946  3193 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.454547  4351 raft_consensus.cc:993] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: : Instructing follower e9165fe61ab04bfb9a48889156d5c161 to start an election
I20260709 13:14:49.455173  4393 raft_consensus.cc:1081] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Signalling peer e9165fe61ab04bfb9a48889156d5c161 to start an election
I20260709 13:14:49.455847  2945 catalog_manager.cc:5697] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 2 to 3, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 3 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:49.458369  3798 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
 from {username='slave'} at 127.0.0.1:43926
I20260709 13:14:49.459259  3798 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:49.459645  3798 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:49.460817  3193 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:14:49.462218  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:49.463524  4407 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:49.464049  4407 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:49.464959  4407 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:49.478821  3117 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:14:49.500978  3798 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:49.505692  3798 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:49.505903  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:49.506580  3192 raft_consensus.cc:3055] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:49.506913  3192 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:49.507827  3192 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:49.508208  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:49.509289  3118 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:49.510829  3192 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:49.519001  3118 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:49.520411  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:49.521554  4365 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:49.522500  4365 raft_consensus.cc:697] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:14:49.521497  2945 catalog_manager.cc:5697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 2 to 3, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 3 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:49.523499  4365 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:49.531670  3192 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:49.549278  2945 catalog_manager.cc:5697] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 1 to 2, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 2 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:49.698982  4405 raft_consensus.cc:993] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e: : Instructing follower 501fdf2af2bc4b0c971ae880e98f466b to start an election
I20260709 13:14:49.699513  4406 raft_consensus.cc:1081] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Signalling peer 501fdf2af2bc4b0c971ae880e98f466b to start an election
I20260709 13:14:49.700910  3193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:51716
I20260709 13:14:49.701380  3193 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:49.701696  3193 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:49.706271  3193 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:49.708189  3193 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:49.710659  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:49.711414  3117 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:49.713111  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:49.713701  3044 raft_consensus.cc:3055] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:49.714064  3044 raft_consensus.cc:740] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:49.714809  3044 consensus_queue.cc:260] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:49.716141  3044 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:49.724812  3044 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:49.725934  3165 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:49.726670  4351 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:49.727228  4351 raft_consensus.cc:697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:49.728142  4351 consensus_queue.cc:237] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:49.740587  3117 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:49.748502  2945 catalog_manager.cc:5697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 1 to 2, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 2 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:49.749922  3117 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:49.751353  4365 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:49.805953  3193 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:49.808279  4365 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:49.896185  3044 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:49.897677  4351 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:49.916379  3117 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:49.926239  4351 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:49.928412  3117 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:49.930181  4405 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:49.952299  3193 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:49.953871  4406 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:50.031353  3192 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:50.035267  4365 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:50.122058  3120 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:50.137356  4334 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:50.142865  3192 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:50.165086  3117 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:50.166731  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:50.167665  4404 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:50.185473  3164 consensus_peers.cc:597] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fcf5db67d30f487d873766886c2ef408. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:50.187747  3050 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:50.189839  4359 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:50.228014  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:50.233043  3050 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:50.234627  4404 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:50.239861  4359 raft_consensus.cc:2955] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:50.245249  3044 raft_consensus.cc:2955] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:50.248907  3117 raft_consensus.cc:2955] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:50.291725  2947 catalog_manager.cc:5697] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:50.298715  3117 consensus_queue.cc:237] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:50.308987  3120 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:50.313314  4359 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:50.342053  3044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0940cf459a7741b58bd85191d095a404"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:14:50.342904  3044 raft_consensus.cc:606] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:50.353324  3193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:14:50.354257  3193 raft_consensus.cc:606] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:50.358544  3118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "e9165fe61ab04bfb9a48889156d5c161"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:14:50.359298  3118 raft_consensus.cc:606] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Received request to transfer leadership to TS e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:50.363339  3118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:14:50.363947  3118 raft_consensus.cc:606] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:50.366405  3192 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:50.366796  3090 consensus_peers.cc:597] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0ee6c4dbcb7b45729d4e2bdcc3a09297. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:50.368031  3044 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:50.368086  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:14:50.369953  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:50.370906  4391 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:50.374882  4357 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:50.414930  4391 raft_consensus.cc:2955] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:50.423568  3044 raft_consensus.cc:2955] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:50.427495  3193 raft_consensus.cc:2955] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:50.456456  3193 consensus_queue.cc:237] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:50.460546  2946 catalog_manager.cc:5697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
W20260709 13:14:50.487085  3164 consensus_peers.cc:597] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a641b8a516264234af4db10b1a0610f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:50.490032  3118 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:50.491560  4404 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:50.491894  3044 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:50.493906  4404 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:50.504678  4404 raft_consensus.cc:2955] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:50.511499  3050 raft_consensus.cc:2955] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:50.519321  3118 raft_consensus.cc:2955] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:50.527045  3120 consensus_queue.cc:237] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:50.531762  2945 catalog_manager.cc:5697] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 1 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:50.557337  3090 consensus_peers.cc:597] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a1ccbbf27f0b436d8c79dfb6db7fc703. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:50.547537  3193 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:50.566388  3045 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:50.570374  4357 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:50.572362  4357 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:50.601061  4465 ts_tablet_manager.cc:933] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:50.603036  3045 raft_consensus.cc:2955] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:50.606498  4465 tablet_copy_client.cc:323] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.131:38665
I20260709 13:14:50.611377  3210 tablet_copy_service.cc:140] P 501fdf2af2bc4b0c971ae880e98f466b: Received BeginTabletCopySession request for tablet fcf5db67d30f487d873766886c2ef408 from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:34728)
I20260709 13:14:50.611992  3210 tablet_copy_service.cc:161] P 501fdf2af2bc4b0c971ae880e98f466b: Beginning new tablet copy session on tablet fcf5db67d30f487d873766886c2ef408 from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:34728: session id = e9165fe61ab04bfb9a48889156d5c161-fcf5db67d30f487d873766886c2ef408
I20260709 13:14:50.614813  3193 raft_consensus.cc:2955] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:50.620622  3210 tablet_copy_source_session.cc:215] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:50.600850  4357 raft_consensus.cc:2955] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:50.627243  4465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf5db67d30f487d873766886c2ef408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:50.647619  4465 tablet_copy_client.cc:806] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:50.648253  4465 tablet_copy_client.cc:670] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:50.658131  4405 raft_consensus.cc:993] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e: : Instructing follower 501fdf2af2bc4b0c971ae880e98f466b to start an election
I20260709 13:14:50.658737  4405 raft_consensus.cc:1081] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Signalling peer 501fdf2af2bc4b0c971ae880e98f466b to start an election
I20260709 13:14:50.661847  3192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0940cf459a7741b58bd85191d095a404"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:51716
I20260709 13:14:50.662449  3192 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:50.669834  3192 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:50.669869  4465 tablet_copy_client.cc:538] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:50.680997  4391 raft_consensus.cc:993] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: : Instructing follower aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:14:50.681602  4391 raft_consensus.cc:1081] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Signalling peer aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:14:50.693118  3192 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:50.696460  2945 catalog_manager.cc:5697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index -1 to 2, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 2 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:50.700558  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:50.701169  3120 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:50.698025  4465 tablet_bootstrap.cc:492] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:50.707937  3120 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:50.709272  3164 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:50.711987  3192 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:50.721648  3045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:35712
I20260709 13:14:50.722275  3045 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:50.726377  4393 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:50.726940  4393 raft_consensus.cc:697] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:50.727852  4393 consensus_queue.cc:237] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:50.733613  3045 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:50.746733  3045 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:50.749195  3045 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:50.750471  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:50.751130  3120 raft_consensus.cc:3055] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:50.751402  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:50.752031  3193 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:50.754057  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 86147us
I20260709 13:14:50.751451  3120 raft_consensus.cc:740] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:50.756171  3120 consensus_queue.cc:260] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:50.757395  3120 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:50.761669  4357 raft_consensus.cc:993] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904: : Instructing follower e9165fe61ab04bfb9a48889156d5c161 to start an election
I20260709 13:14:50.762241  4357 raft_consensus.cc:1081] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Signalling peer e9165fe61ab04bfb9a48889156d5c161 to start an election
I20260709 13:14:50.764411  3798 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
 from {username='slave'} at 127.0.0.1:43908
I20260709 13:14:50.765269  3798 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:50.765759  3798 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.774407  4472 ts_tablet_manager.cc:933] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:50.774930  4359 raft_consensus.cc:993] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b: : Instructing follower aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:14:50.774832  3120 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:50.775578  4359 raft_consensus.cc:1081] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Signalling peer aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:14:50.776387  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:50.777303  3193 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:50.777371  4446 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:50.778115  4446 raft_consensus.cc:697] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:50.779100  4446 consensus_queue.cc:237] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:50.773664  3798 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:50.789129  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:50.789777  3045 raft_consensus.cc:3055] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:50.790110  3045 raft_consensus.cc:740] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:50.793088  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:50.791852  3045 consensus_queue.cc:260] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:50.793780  3118 raft_consensus.cc:3055] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:50.794114  3118 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:50.797355  3043 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:35726
I20260709 13:14:50.797956  3043 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:50.798298  3043 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:50.797510  3118 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:50.799229  3118 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.801600  3798 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:50.813447  3045 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:50.812990  3118 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:14:50.818233  3043 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:50.816812  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:50.821080  3043 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:50.822499  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:50.823333  3193 raft_consensus.cc:3055] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:50.823663  3193 raft_consensus.cc:740] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:50.827266  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:50.827850  3798 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:50.834403  3045 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:50.846797  3193 consensus_queue.cc:260] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:50.848155  3193 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:50.868211  3193 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:50.871260  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:50.822352  4448 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:50.887465  4465 tablet_bootstrap.cc:492] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:50.888640  4465 tablet_bootstrap.cc:492] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:50.889387  4465 ts_tablet_manager.cc:1403] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.192s	user 0.011s	sys 0.034s
I20260709 13:14:50.891228  4448 raft_consensus.cc:697] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:14:50.893100  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 96056us
I20260709 13:14:50.896875  3798 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:50.892580  4448 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:50.913441  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 123747us
W20260709 13:14:50.915437  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 44283.6us
I20260709 13:14:50.889410  4407 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:50.943826  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:50.944541  3193 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.977173  3193 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:14:50.988498  4465 raft_consensus.cc:359] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:50.993309  2947 catalog_manager.cc:5697] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 1 to 2, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 2 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:50.989506  4465 raft_consensus.cc:740] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:51.007360  4465 consensus_queue.cc:260] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:51.036453  4465 ts_tablet_manager.cc:1434] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.147s	user 0.010s	sys 0.000s
I20260709 13:14:51.020370  4407 raft_consensus.cc:697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:51.048698  4472 tablet_copy_client.cc:323] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.130:38619
I20260709 13:14:51.052363  3796 raft_consensus.cc:1217] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:51.053193  3210 tablet_copy_service.cc:342] P 501fdf2af2bc4b0c971ae880e98f466b: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-fcf5db67d30f487d873766886c2ef408 received from {username='slave'} at 127.0.0.1:34728
I20260709 13:14:51.053855  3210 tablet_copy_service.cc:434] P 501fdf2af2bc4b0c971ae880e98f466b: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-fcf5db67d30f487d873766886c2ef408 on tablet fcf5db67d30f487d873766886c2ef408 with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:51.086652  3136 tablet_copy_service.cc:140] P f20672b2852447a6bc1e137c4dd40904: Received BeginTabletCopySession request for tablet 0ee6c4dbcb7b45729d4e2bdcc3a09297 from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:55318)
I20260709 13:14:51.087270  3136 tablet_copy_service.cc:161] P f20672b2852447a6bc1e137c4dd40904: Beginning new tablet copy session on tablet 0ee6c4dbcb7b45729d4e2bdcc3a09297 from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:55318: session id = e9165fe61ab04bfb9a48889156d5c161-0ee6c4dbcb7b45729d4e2bdcc3a09297
I20260709 13:14:51.092980  4465 ts_tablet_manager.cc:933] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:51.044401  4407 consensus_queue.cc:237] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:51.109064  3136 tablet_copy_source_session.cc:215] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:51.112025  4488 ts_tablet_manager.cc:933] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:51.115907  4465 tablet_copy_client.cc:323] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.130:38619
I20260709 13:14:51.120043  3135 tablet_copy_service.cc:140] P f20672b2852447a6bc1e137c4dd40904: Received BeginTabletCopySession request for tablet a1ccbbf27f0b436d8c79dfb6db7fc703 from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:55318)
I20260709 13:14:51.120659  3135 tablet_copy_service.cc:161] P f20672b2852447a6bc1e137c4dd40904: Beginning new tablet copy session on tablet a1ccbbf27f0b436d8c79dfb6db7fc703 from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:55318: session id = e9165fe61ab04bfb9a48889156d5c161-a1ccbbf27f0b436d8c79dfb6db7fc703
I20260709 13:14:51.333913  3117 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:14:51.344739  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 210093us
I20260709 13:14:51.367664  3135 tablet_copy_source_session.cc:215] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:51.547855  4488 tablet_copy_client.cc:323] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.131:38665
I20260709 13:14:52.036221  4493 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:52.037356  4493 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.040139  4493 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:52.040943  4496 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:52.046387  4496 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.049346  4496 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:52.352041  4493 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:52.352856  4493 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.356673  4496 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:52.386509  4493 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:52.387208  4493 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:52.387866  4493 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.388417  4505 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:52.389098  4505 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.389603  4493 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.390164  4493 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:52.386129  4496 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.390698  4493 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.392321  4505 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.392848  4493 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.392848  4496 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:14:52.395617  3017 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.000s	sys 0.006s
I20260709 13:14:52.382396  4506 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:14:52.395962  3017 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.000s	sys 0.007s
I20260709 13:14:52.396572  4496 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:52.396337  4506 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.397185  4496 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:52.399747  4493 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:52.400123  4496 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.400337  4493 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.400893  4496 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:52.401441  4496 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.402577  4493 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:52.403973  4493 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:52.404510  4493 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.407652  4505 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:52.408303  4505 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.408357  4496 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.411382  4505 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.411602  4496 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:52.412326  4496 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.413504  4505 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:52.413869  4506 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:52.416146  4505 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.418069  4493 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.420210  4493 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:52.420852  4493 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.423895  4493 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:52.462008  4493 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.462745  4493 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.465642  4493 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.487423  4502 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:52.488176  4502 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.490465  4502 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.492472  4493 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:52.493229  4493 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.493935  4486 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:52.494627  4486 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.496038  4493 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.496347  4486 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.506516  4493 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:52.507184  4493 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:52.509760  4493 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.515805  4493 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:52.516345  4493 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.518471  4493 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:52.522624  4493 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:52.523319  4487 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:52.523284  4493 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.524044  4487 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:52.524670  3166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.008s	sys 0.022s
W20260709 13:14:52.525103  3166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.009s	sys 0.023s
I20260709 13:14:52.525820  4493 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:52.526345  4487 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:52.527545  4497 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:52.528192  4497 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.530825  4497 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:52.533028  4497 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:52.533639  4497 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.534444  4504 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:52.535020  4504 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.536454  4497 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:52.537943  4504 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:52.539722  4493 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:52.540347  4493 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.542721  4499 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:52.543416  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.543320  4499 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.545053  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.545867  4499 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.546310  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.546458  4499 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:52.547012  4499 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.547387  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.547904  3122 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:52.548583  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.549012  3122 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:52.549167  4499 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.550820  4499 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:52.551419  4499 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.554024  4499 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.559278  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:52.560876  4493 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.560781  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:52.561635  4493 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:52.562173  4493 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:52.562569  4493 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:52.565894  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.567893  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.573647  4407 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:52.574225  4407 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:52.574657  4407 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.577965  4493 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:52.580513  4493 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.569631  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.582252  4407 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.583109  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.583560  4499 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:52.584328  4407 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.584147  4499 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.584556  2947 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57750 (request call id 223) took 1603 ms. Trace:
I20260709 13:14:52.585498  4507 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:52.586127  4507 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.587450  4499 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:52.588475  4507 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.589639  4487 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:52.569535  4505 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:52.590242  4487 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.591668  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.592319  4487 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:52.592813  4487 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:52.593297  4487 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:52.596058  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:14:52.598973  3763 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.140s	user 0.004s	sys 0.024s
W20260709 13:14:52.599368  3763 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.140s	user 0.004s	sys 0.025s
I20260709 13:14:52.599215  3122 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:52.584987  2947 rpcz_store.cc:276] 0709 13:14:50.980873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.981027 (+   154us) service_pool.cc:224] Handling call
0709 13:14:52.584469 (+1603442us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:50.998489 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:50.999065 (+   576us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:50.999101 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:14:50.999119 (+    18us) tablet.cc:662] Decoding operations
0709 13:14:50.999481 (+   362us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:50.999534 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:50.999561 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:50.999749 (+   188us) tablet.cc:701] Row locks acquired
0709 13:14:50.999771 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:14:50.999921 (+   150us) write_op.cc:270] Start()
0709 13:14:51.000039 (+   118us) write_op.cc:276] Timestamp: P: 1783602890999875 usec, L: 0
0709 13:14:51.000063 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:14:51.000711 (+   648us) log.cc:844] Serialized 541 byte log entry
0709 13:14:51.007971 (+  7260us) op_driver.cc:464] REPLICATION: finished
0709 13:14:51.008445 (+   474us) write_op.cc:301] APPLY: starting
0709 13:14:51.008526 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:51.008627 (+   101us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:51.008742 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:51.008988 (+   246us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:51.009135 (+   147us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:51.009180 (+    45us) write_op.cc:312] APPLY: finished
0709 13:14:51.009381 (+   201us) log.cc:844] Serialized 23 byte log entry
0709 13:14:51.009542 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:51.009626 (+    84us) write_op.cc:454] Released schema lock
0709 13:14:51.009673 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:51.010027 (+   354us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:51.010068 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":433536,"child_traces":[["op",{"apply.queue_time_us":238,"apply.run_cpu_time_us":1585,"apply.run_wall_time_us":1585,"num_ops":1,"prepare.queue_time_us":106,"prepare.run_cpu_time_us":2501,"prepare.run_wall_time_us":2500,"replication_time_us":7751}]]}
I20260709 13:14:52.597265  4487 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.602799  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.602857  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.603277  4504 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:52.604334  4505 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:52.605139  4504 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.605530  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.605290  4505 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.606570  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.607196  4504 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:52.607497  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.607652  4505 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.608918  4487 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:52.609438  4487 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.609935  3043 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:52.610062  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:52.611621  4487 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.611680  4504 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:52.611794  3122 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:52.612340  4504 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.611708  4505 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:52.613142  4505 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:52.613494  4505 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.619277  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.623854  4504 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.624229  4469 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:52.625051  4469 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.627327  4469 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.628966  4505 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.623070  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:52.631337  4484 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:52.631793  4484 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:52.632261  4484 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.634366  4497 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:14:52.637410  3091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.227s	user 0.002s	sys 0.007s
I20260709 13:14:52.637110  4497 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.640472  4404 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:52.641096  4404 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.643605  4404 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:52.741932  4404 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:52.742839  4404 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.745957  4404 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:52.838634  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:52.838985  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.839170  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:52.839650  3122 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:52.839946  3125 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.848201  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:52.848793  3125 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:14:52.848951  3122 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.839337  3123 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:52.644939  4484 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.667979  4500 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:52.854146  4500 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
W20260709 13:14:52.855850  3761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.383s	user 0.007s	sys 0.008s
I20260709 13:14:52.857959  3122 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:14:52.738188  4487 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:52.860646  4487 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:52.763463  3072 debug-util.cc:398] Leaking SignalData structure 0x7b08000a6fc0 after lost signal to thread 1937
I20260709 13:14:52.766021  4497 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:14:52.636516  4469 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:52.862273  4469 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.863312  4487 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:14:52.858006  3761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.385s	user 0.009s	sys 0.009s
I20260709 13:14:52.864744  4469 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:52.866137  4496 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.856864  4500 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:52.668735  4486 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.867633  4486 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.868433  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:14:52.729995  3091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.319s	user 0.003s	sys 0.007s
I20260709 13:14:52.859786  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:52.870541  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:52.871452  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:52.872710  4506 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:52.873088  4506 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:52.873488  4506 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.873978  4486 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.874305  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.876089  4484 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:52.876652  4484 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:52.878072  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:52.878893  3125 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.879317  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.880003  3118 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 1.
I20260709 13:14:52.880838  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.881251  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.882076  4477 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:52.882586  4477 raft_consensus.cc:697] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:52.631628  4505 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.861294  3123 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:52.881379  3118 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 1.
I20260709 13:14:52.885427  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:52.883399  4477 consensus_queue.cc:237] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.892590  4502 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:52.893141  4502 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.895035  4502 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:52.883641  4504 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:52.897713  4504 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.899963  4504 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.883817  4484 raft_consensus.cc:697] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:52.902523  4484 consensus_queue.cc:237] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.904066  4493 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:52.904541  4493 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.907183  4493 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:52.890411  4496 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:52.913592  4448 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:52.914304  4496 raft_consensus.cc:697] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:52.915683  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:52.917088  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:52.915043  4499 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:52.914206  4448 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.917198  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:52.921659  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:52.928031  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.917898  4504 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:52.912349  3135 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:55318 (request call id 83) took 1792 ms. Trace:
I20260709 13:14:52.916900  4496 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:52.946910  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:52.947623  3792 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:52.963584  3125 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:14:52.973919  3761 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:52.943585  4499 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:52.983541  4510 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:52.983969  4510 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:52.984408  4510 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:52.985999  4499 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:52.986153  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:52.984763  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:52.946662  3135 rpcz_store.cc:276] 0709 13:14:51.119502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.119899 (+   397us) service_pool.cc:224] Handling call
0709 13:14:52.912220 (+1792321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:52.979969  4505 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:52.988736  3120 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:52.993011  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:52.993783  3125 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 1.
I20260709 13:14:52.995126  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:52.981345  4446 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:52.990483  4493 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:52.990442  4499 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:53.006655  3123 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:52.965646  4504 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:53.007783  4484 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:53.016906  4478 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:53.018030  4448 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:53.011426  4499 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:53.012873  4493 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:53.023939  4506 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:52.996506  4505 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:53.007270  4446 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:53.026290  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:53.036314  3798 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:14:53.037019  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:53.040127  4505 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:53.040503  4504 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:53.027805  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:14:53.030931  4407 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:53.031020  4514 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:53.031729  4509 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:53.034492  4484 raft_consensus.cc:697] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:53.034972  4499 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:53.051123  3163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.543s	user 0.015s	sys 0.020s
W20260709 13:14:53.052095  3163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.545s	user 0.016s	sys 0.020s
I20260709 13:14:53.051895  4446 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:53.053293  4509 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:53.055697  4509 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:53.048386  4407 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:53.058314  4484 consensus_queue.cc:237] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:53.062587  4407 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:53.048174  4514 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:53.074514  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.074787  4497 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:53.075372  4497 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:53.076826  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:53.081274  4393 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:53.081964  4393 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:53.082273  4351 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.083067  4351 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:53.084251  4393 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:53.084810  4393 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:53.085237  4393 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:53.085947  4359 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.086762  4359 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:53.087417  4393 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:53.088157  4393 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:53.088622  4393 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:53.093070  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 50491.6us
I20260709 13:14:53.077482  4497 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:53.077991  3790 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:53.071574  4514 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.098672  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:53.100451  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:53.101229  4493 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:53.077881  4500 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:53.091409  4506 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:53.034956  4478 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
W20260709 13:14:53.117779  3090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.791s	user 0.011s	sys 0.040s
W20260709 13:14:53.118269  3090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.791s	user 0.011s	sys 0.040s
I20260709 13:14:53.118818  4478 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:53.106478  4510 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:53.114075  4359 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:53.127454  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:53.070600  4505 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:53.129199  4505 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:53.129657  4505 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.131877  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:14:53.133984  3164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.740s	user 0.016s	sys 0.020s
I20260709 13:14:53.120476  4500 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:53.106734  3126 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:53.126644  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:53.110769  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:53.105679  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:53.136387  3799 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
W20260709 13:14:53.123549  3072 debug-util.cc:398] Leaking SignalData structure 0x7b0800136160 after lost signal to thread 2983
I20260709 13:14:53.147807  4478 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:53.148830  4487 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:53.153446  4503 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.149279  4486 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:53.149703  4391 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:53.149926  4510 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:53.150372  4298 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:53.121364  4393 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:53.119849  4484 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:53.153707  4478 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:53.155668  4484 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:53.156261  4478 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.155470  4298 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:53.154121  4487 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:53.154762  4391 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:53.154462  4486 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:53.167737  4351 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:53.169991  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:53.154204  4503 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:53.174739  3092 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.730s	user 0.014s	sys 0.019s
W20260709 13:14:53.211585  3164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.818s	user 0.017s	sys 0.020s
I20260709 13:14:53.215188  4351 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:53.215425  3165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.791s	user 0.018s	sys 0.018s
W20260709 13:14:53.216933  3165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.793s	user 0.018s	sys 0.018s
I20260709 13:14:53.222659  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.239710  3051 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:53.240033  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.240617  3119 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:14:53.240895  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.240617  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.242080  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:14:53.242983  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 132304us
I20260709 13:14:53.243363  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.249007  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.248960  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.251449  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.253043  3794 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:53.254709  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.255368  3043 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:53.255699  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.255985  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.261303  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.263779  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.265976  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:53.266430  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.265529  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.266537  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.271025  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:53.271453  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.272070  3051 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:53.272703  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.273341  3043 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:53.274004  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.274585  3044 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:53.275350  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.275831  3050 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:53.278383  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.278868  3050 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:53.277562  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:53.281188  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.281955  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:14:53.284578  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.286101  4298 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:53.156291  4484 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:53.290036  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.291972  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.292541  3200 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:53.293715  3126 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 1.
I20260709 13:14:53.295742  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.263105  4507 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:53.312709  3092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.868s	user 0.015s	sys 0.020s
I20260709 13:14:53.304738  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.313235  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.314234  3050 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:53.296387  3126 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 1.
I20260709 13:14:53.288370  4404 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:53.314677  3123 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
W20260709 13:14:53.297081  3072 debug-util.cc:398] Leaking SignalData structure 0x7b08002fb840 after lost signal to thread 3075
I20260709 13:14:53.285921  4493 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:53.290161  4448 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:14:53.295604  4509 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:53.347661  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.290581  4496 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:14:53.358707  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:53.295758  4510 consensus_queue.cc:1059] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 13:14:53.345808  3072 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef9a0 after lost signal to thread 3076
I20260709 13:14:53.371973  4465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ccbbf27f0b436d8c79dfb6db7fc703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:53.371922  4366 raft_consensus.cc:3055] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:53.372490  4366 raft_consensus.cc:740] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:14:53.372829  3072 debug-util.cc:398] Leaking SignalData structure 0x7b08000ef4a0 after lost signal to thread 3150
I20260709 13:14:53.328768  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.328890  4391 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:53.301261  4446 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:14:53.312984  4507 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:53.373425  4366 consensus_queue.cc:260] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:53.386513  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:53.352130  4509 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:53.393795  4520 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:53.394372  4520 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:53.351845  4404 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:53.406710  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.391386  4509 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:53.410697  3072 debug-util.cc:398] Leaking SignalData structure 0x7b080005d2c0 after lost signal to thread 3224
I20260709 13:14:53.411839  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:53.412963  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:53.404286  4366 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:53.403141  4486 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:53.401782  4500 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:53.415372  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:53.420689  4351 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:53.421304  4351 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:53.421984  4507 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:53.420573  3193 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:53.405701  3793 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
W20260709 13:14:53.470643  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 55326.4us
I20260709 13:14:53.470643  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.478601  4518 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:53.471253  2945 catalog_manager.cc:5697] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 3 to 4, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 4 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:53.411078  4404 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:53.414197  4503 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:53.483739  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.416006  4448 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:53.479779  4446 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:53.387282  4514 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:53.484622  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 71737.1us
I20260709 13:14:53.423556  4351 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:53.492781  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:53.425315  4504 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:53.487787  4472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ee6c4dbcb7b45729d4e2bdcc3a09297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:53.479200  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:53.498414  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.500135  3200 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:53.486776  4448 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:53.503422  4448 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.505429  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.506260  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.506846  3192 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:53.507620  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.504832  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.511025  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.519019  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.594383  3042 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:53.519443  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.595547  3198 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:53.602662  4523 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:53.511799  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.471357  4499 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:53.604130  3197 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:53.593990  3196 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:53.606878  4404 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:53.511103  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.612869  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.614879  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.512359  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:14:53.518636  3072 debug-util.cc:398] Leaking SignalData structure 0x7b08000326a0 after lost signal to thread 3823
I20260709 13:14:53.496891  4504 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:53.603778  4500 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.668762  4474 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:53.675128  3123 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:14:53.517365  3791 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:14:53.637050  4351 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:14:53.704077  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:53.704523  4521 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:53.704623  4359 raft_consensus.cc:1064] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
W20260709 13:14:53.705031  4517 log.cc:927] Time spent T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:14:53.705825  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.677829  4504 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.700580  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.516146  4505 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:53.603384  4523 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:53.730734  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.734953  3124 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:53.602735  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.720316  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.722136  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:53.727478  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:53.699364  4500 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:53.745977  3045 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
W20260709 13:14:53.744506  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 251505us
I20260709 13:14:53.493553  4518 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:53.747136  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.748129  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:53.664829  4404 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:53.753348  3799 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:53.746783  3795 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:53.752314  3798 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Advancing to term 2
I20260709 13:14:53.732030  3047 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:53.715062  4351 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:53.759011  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.759752  3194 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:53.761229  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.762542  4499 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:53.764868  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.759450  4496 consensus_queue.cc:1059] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:14:53.766937  3792 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:53.767381  4496 raft_consensus.cc:3055] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:53.767552  4500 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:53.767871  4496 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:53.768918  4496 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:53.775708  4407 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:14:53.776938  4478 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.620s	user 0.012s	sys 0.014s
I20260709 13:14:53.777526  4519 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:53.777403  4478 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:53.778153  4519 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:53.778687  4519 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:53.778870  4487 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:53.781805  3051 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:53.770810  3199 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:53.782959  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.783555  3194 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:53.769516  4404 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:53.784366  2946 catalog_manager.cc:5697] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 1 to 2, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 2 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:53.714232  4474 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:53.765350  4520 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:53.771885  4351 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:53.770658  4523 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:53.728327  4521 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:53.786027  4514 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:53.811331  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.812601  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.808382  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.793777  4448 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:53.817643  3117 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:53.810628  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.814646  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.814757  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.820438  3051 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 2: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:53.823674  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:53.828044  3200 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:53.802104  4496 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.831338  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.837051  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:53.840886  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.840795  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:14:53.842325  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 200631us
I20260709 13:14:53.810052  4505 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:53.844208  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:53.847159  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.848596  3798 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEARNER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:53.849136  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.855207  3048 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:53.818107  4478 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:53.856998  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:53.900090  3164 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:14:53.901415  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.902047  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.901391  4513 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
W20260709 13:14:53.907428  4484 consensus_meta.cc:287] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.606s	user 0.005s	sys 0.006s
I20260709 13:14:53.907912  4484 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:53.908857  4513 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:53.909420  4513 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:53.910148  4484 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:53.910830  3044 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:53.912016  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:53.912477  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.913062  3196 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:53.855037  4512 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:14:53.940452  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:53.959956  3164 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:53.937381  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:53.938037  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:53.931691  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.932035  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.920446  4523 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:53.942564  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:53.964352  4513 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:53.965623  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.966403  3121 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:53.911301  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:53.968315  3796 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:53.970904  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:53.971122  3126 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:53.904861  4351 consensus_queue.cc:1059] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:14:53.971976  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:53.971956  3164 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:14:53.967177  3015 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 1.533s (SENT) [suppressed 5 similar messages]
I20260709 13:14:53.983834  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:53.984840  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:53.985613  3798 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.965256  4523 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:53.971406  4497 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:54.005681  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:54.007033  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:54.015951  3762 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:54.016942  4526 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:54.018419  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:54.019392  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:14:54.022290  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 55141.3us
I20260709 13:14:54.005496  4523 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:54.017455  3762 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:54.010429  4527 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:54.033676  4527 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.034132  4527 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:54.033833  4351 consensus_queue.cc:1059] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:54.005195  4497 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:54.042292  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:54.048799  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:54.047504  4497 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:54.042352  4499 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:54.064257  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:54.042163  4474 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:54.065477  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:54.050357  4518 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:54.067581  4448 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:54.067726  3123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:14:54.104575  3123 raft_consensus.cc:606] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:54.066984  3196 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:54.093411  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:54.065181  4407 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:14:54.051744  4500 consensus_queue.cc:1059] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:14:54.048311  4446 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:14:54.071038  4473 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:54.097530  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:54.132261  3199 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:54.097895  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:54.102018  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:54.135076  3200 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:54.142055  4520 raft_consensus.cc:3055] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:54.142642  4520 raft_consensus.cc:740] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:54.143534  4520 consensus_queue.cc:260] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:54.145041  4520 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:54.102325  4521 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:14:54.170928  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 162851us
W20260709 13:14:54.176004  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:54.163396  4404 raft_consensus.cc:3055] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:54.185106  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:14:54.186157  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 137425us
I20260709 13:14:54.186211  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:54.188243  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:54.188745  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:54.178555  4404 raft_consensus.cc:740] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:54.193262  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:54.193915  3198 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:54.191754  4404 consensus_queue.cc:260] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:54.198800  4404 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:54.215315  4509 consensus_meta.cc:287] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.799s	user 0.012s	sys 0.008s
I20260709 13:14:54.217478  4519 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:54.219894  4519 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:54.220471  4509 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:54.217478  3050 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:54.222855  3798 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:54.228358  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:54.213531  4526 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:54.230841  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:54.234422  3798 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:54.237412  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:54.240783  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:54.246034  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:54.246682  3195 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:54.246201  4359 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:54.230077  3047 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:54.255447  3762 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:54.256237  4448 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:54.257556  4537 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:54.249127  4527 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:54.261824  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:54.222808  4509 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:54.272622  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:54.274750  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:54.239743  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:54.281888  3191 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:14:54.282145  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:54.291944  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 88998.5us
I20260709 13:14:54.292836  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:14:54.294706  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:54.268273  4478 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:14:54.299767  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 119794us
I20260709 13:14:54.301810  3091 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:54.302186  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:54.302911  4487 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:54.303319  4487 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:54.303777  4487 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:54.304965  3091 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:54.315934  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:54.319483  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:54.321947  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:54.282959  4536 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:54.298532  4505 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:54.333901  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:54.326802  4543 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:54.327996  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:54.336408  3194 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:14:54.328388  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:54.328681  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:54.329349  3195 raft_consensus.cc:3055] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:54.373543  3195 raft_consensus.cc:740] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:54.313503  4487 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:54.329869  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:54.297668  4519 consensus_queue.cc:1059] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:14:54.372653  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:54.337955  3120 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:54.333065  4407 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:54.298990  4478 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:54.298254  4521 consensus_queue.cc:1059] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:14:54.454234  4505 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:54.454680  3195 consensus_queue.cc:260] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:54.337620  4543 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:14:54.459995  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 86306.8us
I20260709 13:14:54.472164  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:54.455862  3196 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:14:54.475159  3196 pending_rounds.cc:85] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 1
I20260709 13:14:54.475996  3196 pending_rounds.cc:107] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:14:54.476419  3196 raft_consensus.cc:2889] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:54.477820  3198 raft_consensus.cc:3055] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:54.478210  3198 raft_consensus.cc:740] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:54.468149  4407 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
W20260709 13:14:54.471009  4504 consensus_meta.cc:287] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.729s	user 0.012s	sys 0.020s
W20260709 13:14:54.482283  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 106554us
I20260709 13:14:54.479174  4523 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:54.472652  4543 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:54.478930  3198 consensus_queue.cc:260] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:54.416661  3762 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:54.483623  4393 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:54.473095  4520 consensus_queue.cc:1059] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:14:54.491406  4405 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:54.534600  4407 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:14:54.538959  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 170222us
I20260709 13:14:54.487864  4504 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:54.537094  4405 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:54.550050  4523 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:54.532657  4524 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:54.537881  4527 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:54.599673  4405 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:14:54.549309  4465 consensus_meta.cc:287] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.721s	user 0.006s	sys 0.010s
I20260709 13:14:54.601945  4465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:43908 (request call id 255) took 3607 ms. Trace:
I20260709 13:14:54.548079  4484 raft_consensus.cc:1064] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:54.605085  4543 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:54.616279  4484 raft_consensus.cc:1068] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Unable to promote non-voter e9165fe61ab04bfb9a48889156d5c161: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:14:54.548638  4505 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:54.603922  4504 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:54.617298  3795 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:54.602584  4465 rpcz_store.cc:276] 0709 13:14:50.994736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.995141 (+   405us) service_pool.cc:224] Handling call
0709 13:14:51.093454 (+ 98313us) ts_tablet_manager.cc:934] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
0709 13:14:53.370291 (+2276837us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:53.807699 (+437408us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:53.807833 (+   134us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:54.600740 (+792907us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:54.601171 (+   431us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:54.601709 (+   538us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:54.601827 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":243,"tablet-copy.queue_time_us":97317,"thread_start_us":111968,"threads_started":2}
I20260709 13:14:54.647969  4478 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:14:54.680832  4497 consensus_meta.cc:287] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.614s	user 0.005s	sys 0.009s
I20260709 13:14:54.685825  4474 raft_consensus.cc:3055] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:54.686444  4474 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:54.687666  4474 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:54.700278  3198 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:54.714766  2945 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49738 (request call id 143) took 2126 ms. Trace:
I20260709 13:14:54.689455  4474 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:54.633718  4543 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:54.708887  4465 tablet_copy_client.cc:806] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:54.681531  4497 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:54.725792  2946 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57732 (request call id 227) took 1410 ms. Trace:
W20260709 13:14:54.619277  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 117839us
I20260709 13:14:54.734616  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:54.726405  2946 rpcz_store.cc:276] 0709 13:14:53.315558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.315717 (+   159us) service_pool.cc:224] Handling call
0709 13:14:53.514568 (+198851us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b54000d98d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031d090 00007ff8303bbf3a 00007ff8361721cc 00007ff83627037e 00007ff8347312a4 00007ff834731232 00007ff834731161 00007ff8347310dc 00007ff834730392 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:14:54.725688 (+1211120us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:53.990920 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:54.073039 (+ 82119us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:54.092500 (+ 19461us) write_op.cc:435] Acquired schema lock
0709 13:14:54.102741 (+ 10241us) tablet.cc:662] Decoding operations
0709 13:14:54.150428 (+ 47687us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:54.150499 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:54.150548 (+    49us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:54.150803 (+   255us) tablet.cc:701] Row locks acquired
0709 13:14:54.150830 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:14:54.151020 (+   190us) write_op.cc:270] Start()
0709 13:14:54.151177 (+   157us) write_op.cc:276] Timestamp: P: 1783602894150959 usec, L: 0
0709 13:14:54.151211 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:14:54.152227 (+  1016us) log.cc:844] Serialized 541 byte log entry
0709 13:14:54.331420 (+179193us) op_driver.cc:464] REPLICATION: finished
0709 13:14:54.543697 (+212277us) write_op.cc:301] APPLY: starting
0709 13:14:54.543778 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:54.543886 (+   108us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:54.543994 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:54.544202 (+   208us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:54.544370 (+   168us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:54.544417 (+    47us) write_op.cc:312] APPLY: finished
0709 13:14:54.544602 (+   185us) log.cc:844] Serialized 23 byte log entry
0709 13:14:54.544762 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:54.544847 (+    85us) write_op.cc:454] Released schema lock
0709 13:14:54.544885 (+    38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":150719,"reported_tablets":1,"spinlock_wait_cycles":6716800,"child_traces":[["op",{"apply.queue_time_us":209604,"apply.run_cpu_time_us":1566,"apply.run_wall_time_us":52910,"num_ops":1,"prepare.queue_time_us":171155,"prepare.run_cpu_time_us":3883,"prepare.run_wall_time_us":174596,"replication_time_us":148005,"threads_started":1}]]}
I20260709 13:14:54.743114  3198 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:14:54.747258  3198 pending_rounds.cc:85] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 2
I20260709 13:14:54.750029  3198 pending_rounds.cc:107] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:14:54.752734  3198 raft_consensus.cc:2917] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:14:54.752779  4497 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:54.733292  4465 tablet_copy_client.cc:670] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:54.771633  3198 raft_consensus.cc:2889] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:54.792830  3798 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:54.800623  4487 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:14:54.791077  4518 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:14:54.715605  2945 rpcz_store.cc:276] 0709 13:14:52.582640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.582780 (+   140us) service_pool.cc:224] Handling call
0709 13:14:53.156794 (+574014us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b5400002490. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28f0b2 00007ff836208a89 00007ff8361a0da6 00007ff836172088 00007ff83627037e 00007ff8347312a4 00007ff834731232 00007ff834731161 00007ff8347310dc
0709 13:14:54.708493 (+1551699us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:53.713593 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:53.794291 (+ 80698us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:53.794323 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:14:53.794340 (+    17us) tablet.cc:662] Decoding operations
0709 13:14:53.806715 (+ 12375us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:53.806796 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:53.806833 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:53.807046 (+   213us) tablet.cc:701] Row locks acquired
0709 13:14:53.807065 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:14:53.807210 (+   145us) write_op.cc:270] Start()
0709 13:14:53.807324 (+   114us) write_op.cc:276] Timestamp: P: 1783602893807167 usec, L: 0
0709 13:14:53.807349 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:14:53.810635 (+  3286us) log.cc:844] Serialized 536 byte log entry
0709 13:14:54.246856 (+436221us) op_driver.cc:464] REPLICATION: finished
0709 13:14:54.491702 (+244846us) write_op.cc:301] APPLY: starting
0709 13:14:54.500099 (+  8397us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:54.531258 (+ 31159us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:54.538686 (+  7428us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:54.540346 (+  1660us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:54.540592 (+   246us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:54.540671 (+    79us) write_op.cc:312] APPLY: finished
0709 13:14:54.542508 (+  1837us) log.cc:844] Serialized 23 byte log entry
0709 13:14:54.542728 (+   220us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:54.542817 (+    89us) write_op.cc:454] Released schema lock
0709 13:14:54.542855 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:54.543255 (+   400us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:54.543299 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":23906560,"child_traces":[["op",{"apply.queue_time_us":234257,"apply.run_cpu_time_us":2842,"apply.run_wall_time_us":54703,"num_ops":1,"prepare.queue_time_us":227665,"prepare.run_cpu_time_us":56352,"prepare.run_wall_time_us":223875,"raft.queue_time_us":273007,"raft.run_cpu_time_us":7969,"raft.run_wall_time_us":44996,"replication_time_us":439342,"thread_start_us":479154,"threads_started":4,"wal-append.queue_time_us":180667}]]}
I20260709 13:14:54.799312  4359 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:54.799685  4497 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:54.830821  4497 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:54.830441  4359 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:54.834120  4497 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:54.835178  4359 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:14:54.848150  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 49839.9us
W20260709 13:14:54.851588  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:54.852586  4404 consensus_queue.cc:1059] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:54.856647  3795 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
W20260709 13:14:54.878556  3092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.009s	sys 0.037s
W20260709 13:14:54.891194  3165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.000s	sys 0.012s
W20260709 13:14:54.891588  3165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.000s	sys 0.012s
W20260709 13:14:54.890314  3121 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.028s	sys 0.036s
I20260709 13:14:54.895272  3195 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:54.895256  3123 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.005s	sys 0.058s
W20260709 13:14:54.897881  3123 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.006s	sys 0.058s
W20260709 13:14:54.897925  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 436848us
W20260709 13:14:54.896644  3091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.035s	sys 0.026s
W20260709 13:14:54.898538  3091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.035s	sys 0.026s
W20260709 13:14:54.898818  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 592373us
I20260709 13:14:54.901240  3120 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:54.895594  3121 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.028s	sys 0.036s
I20260709 13:14:54.893018  4534 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:54.893224  4544 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:54.903807  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:14:54.907979  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 518710us
I20260709 13:14:54.907173  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:54.891242  4472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:43908 (request call id 251) took 4132 ms. Trace:
I20260709 13:14:54.909142  3050 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:54.907301  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 415289us
I20260709 13:14:54.912535  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:54.903167  4487 consensus_queue.cc:1059] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
W20260709 13:14:54.922148  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 215997us
I20260709 13:14:54.922554  3123 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:54.928962  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:54.923202  4550 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:14:54.924057  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:54.924743  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:54.931262  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:54.931325  4547 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:54.924805  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:54.925007  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:14:54.933398  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 81028.3us
I20260709 13:14:54.925443  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:54.926146  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:54.936908  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:54.943563  3120 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:54.945149  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:54.939462  3165 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:54.908077  4544 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:54.952406  2945 catalog_manager.cc:5697] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 1 to 2, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 2 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:14:54.954252  2945 catalog_manager.cc:5697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 1 to 2, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 2 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:54.955498  2945 catalog_manager.cc:5697] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 2 to 3, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 3 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:14:54.960081  4351 raft_consensus.cc:3055] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:54.960613  4351 raft_consensus.cc:740] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:54.901279  4486 consensus_queue.cc:1059] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:14:54.919097  4478 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:14:54.978453  3165 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:54.938737  4446 raft_consensus.cc:3055] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:54.921335  4448 consensus_queue.cc:1059] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:14:54.931957  4547 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:54.964677  3050 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:54.908248  4534 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:54.988706  3165 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:54.990319  3165 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:54.968060  4465 tablet_copy_client.cc:538] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:54.991358  3165 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:54.965193  4553 raft_consensus.cc:3055] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:54.995085  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:54.997280  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:54.966236  4359 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:54.998895  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.001060  4500 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:55.003242  4561 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:55.003754  4561 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:55.004112  4561 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:54.981765  4446 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:54.984622  4497 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:55.004689  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.008127  3165 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.014933  4557 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:55.015276  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:54.983652  4405 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:14:55.016878  4407 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:55.017264  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.005271  4553 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:55.015370  4557 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:55.020798  4557 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.021039  4523 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:54.961673  4351 consensus_queue.cc:260] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:55.026144  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.019026  3195 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:55.023521  3165 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.024034  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.013398  4393 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:55.024734  4523 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:55.041473  3165 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.042501  4528 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:55.043211  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.050177  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:14:55.054605  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.055568  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.017278  4407 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:55.027295  4405 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:54.910408  4472 rpcz_store.cc:276] 0709 13:14:50.759027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.759394 (+   367us) service_pool.cc:224] Handling call
0709 13:14:50.774841 (+ 15447us) ts_tablet_manager.cc:934] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
0709 13:14:53.163069 (+2388228us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:54.598498 (+1435429us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:54.598644 (+   146us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:54.811447 (+212803us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:54.857260 (+ 45813us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:54.881293 (+ 24033us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:54.890385 (+  9092us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":306,"tablet-copy.queue_time_us":14406,"thread_start_us":286987,"threads_started":2}
I20260709 13:14:55.021584  4537 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:55.065697  4537 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:55.066423  4537 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.066233  4446 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:55.044186  4518 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:55.026746  4520 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:55.047549  4528 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:55.062955  4556 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:55.046651  4393 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:55.061476  4407 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.008026  4359 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.020800  4553 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:55.063665  4405 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:55.065685  4538 consensus_queue.cc:1059] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:14:55.050655  4523 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.051752  4351 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.060849  4544 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:55.048591  4497 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:55.069864  4472 tablet_copy_client.cc:806] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
W20260709 13:14:55.045570  4404 consensus_queue.cc:1175] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f20672b2852447a6bc1e137c4dd40904" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 13:14:55.070225  4446 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.070412  4500 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:55.059011  4478 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:55.051429  4509 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:55.059465  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.077371  4393 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.087530  4556 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:55.088975  4405 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.090672  4538 raft_consensus.cc:3055] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:55.057603  4521 consensus_queue.cc:1059] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:14:55.076711  4528 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.093636  4497 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:55.077603  4518 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:14:55.105474  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46747.1us
I20260709 13:14:55.108731  4559 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:55.113386  4559 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:55.092631  4552 raft_consensus.cc:3055] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:55.103906  4553 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.105118  4472 tablet_copy_client.cc:670] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:55.114488  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.107244  4556 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.112835  4497 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.116736  4509 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:55.107672  4538 raft_consensus.cc:740] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:55.117511  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.114593  4552 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:55.114264  4518 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:55.114737  4520 raft_consensus.cc:3055] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:55.113819  4559 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.122651  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.135761  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:55.135492  3091 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:55.142457  4558 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:55.142949  4526 raft_consensus.cc:3055] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:55.129361  4520 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:55.143319  4526 raft_consensus.cc:740] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:14:55.146195  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.143348  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:55.150822  3042 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:55.123106  4509 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:55.129876  4518 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.164193  4555 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:55.164315  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.144127  4520 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.180449  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.165529  4509 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:55.168298  4558 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:55.185407  4484 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:55.151819  4534 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:55.181078  4519 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:55.187922  4484 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:55.144169  4526 consensus_queue.cc:260] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:55.184644  4359 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:55.197069  3050 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:55.188700  4555 raft_consensus.cc:697] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:55.187075  4509 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.195746  4520 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.198437  4484 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:55.227069  4474 consensus_meta.cc:287] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.001s
I20260709 13:14:55.237967  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.178246  4538 consensus_queue.cc:260] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:55.248703  4538 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.226613  4555 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:55.251951  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 49879.9us
I20260709 13:14:55.243209  4526 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.260031  4487 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:14:55.278120  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.256582  4478 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:55.286633  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.191742  4552 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:55.320291  3091 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:55.326073  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:55.328114  4569 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:55.328402  4567 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:55.328591  4569 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:55.329003  4569 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.328898  4567 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.331100  4567 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:55.267714  4556 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.336120  4556 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:55.338858  4537 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:55.341456  4523 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.283113  4505 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:14:55.269621  4513 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:14:55.280810  4487 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:55.351903  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:55.361819  4465 tablet_bootstrap.cc:492] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:55.367587  4487 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:55.368410  4570 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:55.353924  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 310744us
I20260709 13:14:55.374920  4407 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.373441  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:55.376974  4407 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:14:55.384115  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.383410  4552 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.315488  4497 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:55.320237  4393 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.368981  4570 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:55.360299  4547 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:55.410557  3090 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:14:55.406437  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 365234us
I20260709 13:14:55.413313  3165 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.359560  4478 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:14:55.389360  4509 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.349474  4569 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.433053  3050 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:55.416772  4527 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:55.420324  4547 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:55.437438  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:55.433126  4523 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:55.439054  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:55.410470  4405 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.441625  3797 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 2: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:14:55.377720  4561 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.449009  4527 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.442770  4486 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:55.481249  4393 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:14:55.480953  4486 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.475893  3042 raft_consensus.cc:1240] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:55.441262  4359 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:55.476404  4405 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:55.436101  4484 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:55.452765  4537 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:55.484189  3195 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:55.490793  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.494314  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.494661  3198 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 1.
I20260709 13:14:55.495018  3196 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 1.
I20260709 13:14:55.483312  4486 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:55.504616  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.497897  4569 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:55.499750  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.501065  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.482710  4559 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.505618  3195 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 1.
I20260709 13:14:55.489845  4359 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:55.493713  3210 tablet_copy_service.cc:140] P 501fdf2af2bc4b0c971ae880e98f466b: Received BeginTabletCopySession request for tablet a641b8a516264234af4db10b1a0610f0 from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:34728)
I20260709 13:14:55.508842  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.510201  3199 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
W20260709 13:14:55.512266  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 238161us
I20260709 13:14:55.513285  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.496882  4570 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:55.517333  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.523295  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:55.524662  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:55.526952  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:55.546331  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.524228  3117 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:55.547123  3199 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:55.508191  4497 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:55.552850  4366 consensus_queue.cc:1059] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:55.493268  4557 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.554261  3042 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:55.554358  3048 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:55.546635  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:55.511540  4359 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.550943  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:55.551805  3049 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:55.552273  4484 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:55.490697  4528 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:55.555302  3797 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:55.549572  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:55.568601  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.517179  4405 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:55.557157  4499 raft_consensus.cc:3055] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:55.557487  4557 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:55.558799  4527 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:55.560559  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:55.570937  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.561244  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.562039  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:55.562594  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.562850  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:55.563552  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.563691  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:55.565953  3051 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:55.569222  3193 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:55.519127  3210 tablet_copy_service.cc:161] P 501fdf2af2bc4b0c971ae880e98f466b: Beginning new tablet copy session on tablet a641b8a516264234af4db10b1a0610f0 from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:34728: session id = e9165fe61ab04bfb9a48889156d5c161-a641b8a516264234af4db10b1a0610f0
I20260709 13:14:55.579422  4499 raft_consensus.cc:740] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:14:55.579679  4509 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:55.580356  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.597344  3192 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 1.
I20260709 13:14:55.571884  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:55.607319  3195 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
W20260709 13:14:55.572295  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 63839.4us
I20260709 13:14:55.588930  3191 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 1.
I20260709 13:14:55.592113  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.592607  3200 raft_consensus.cc:2393] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:14:55.595417  3047 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.596022  4499 consensus_queue.cc:260] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:55.611805  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.612665  3200 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 1.
I20260709 13:14:55.603385  4497 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:55.617353  4499 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.618368  4472 tablet_copy_client.cc:538] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:55.618981  4497 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:55.619940  4497 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.611836  4569 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:14:55.622675  4569 raft_consensus.cc:3055] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:55.623023  4569 raft_consensus.cc:740] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:55.623891  4569 consensus_queue.cc:260] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.625047  4569 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.616422  4524 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:55.616225  4487 consensus_queue.cc:1059] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:14:55.631531  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:55.632840  3051 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:55.633947  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:55.639376  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.633589  3044 raft_consensus.cc:1240] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:55.640650  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:55.642506  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:55.646202  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.629702  4524 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:55.648726  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.649312  3192 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:55.651595  4487 raft_consensus.cc:3055] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:55.652033  4487 raft_consensus.cc:740] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:55.653039  3047 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:14:55.655156  4561 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:55.638417  4509 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:14:55.657945  3210 tablet_copy_source_session.cc:215] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:55.658242  4559 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:55.658388  4518 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.661060  3198 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:55.642498  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:55.661966  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.662761  3194 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 2: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:14:55.663861  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.652926  4487 consensus_queue.cc:260] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.629781  4486 consensus_queue.cc:1059] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:14:55.671245  4526 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:55.672643  4486 raft_consensus.cc:3055] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:55.672988  4486 raft_consensus.cc:740] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:55.671279  4487 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.674091  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:55.676177  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.664968  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:14:55.670102  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.670243  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:55.678071  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.678166  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.649629  4524 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:55.679913  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:55.690840  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:55.680091  3091 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:55.681967  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:55.693158  3194 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:14:55.693418  3193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:14:55.693990  3193 raft_consensus.cc:606] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:55.694315  3193 raft_consensus.cc:614] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:55.682853  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:55.684298  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.688050  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:55.689010  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:55.689005  3196 raft_consensus.cc:1240] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:14:55.614935  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 102557us
I20260709 13:14:55.690351  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:55.710016  3123 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:14:55.698170  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:55.701064  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:55.703890  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:55.704015  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.704609  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.705049  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:55.706107  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:55.706476  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:55.706741  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:55.707005  4524 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:55.707325  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:55.719676  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:55.708616  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:55.714334  3044 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:55.721837  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:55.722901  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:55.723203  4550 consensus_queue.cc:1059] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:55.724282  4550 raft_consensus.cc:3055] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:55.724669  4550 raft_consensus.cc:740] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:14:55.719013  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.720772  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.696902  4526 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:55.726837  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:55.727780  4559 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:55.725507  4550 consensus_queue.cc:260] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.726331  4505 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:55.728978  4538 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:55.723994  4359 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.729866  4543 raft_consensus.cc:3055] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:55.729828  4538 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.730329  4543 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:55.731173  4543 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:55.731792  4538 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:55.732486  4543 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.698556  4552 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:55.732412  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:55.712212  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.740212  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:55.740649  3043 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:55.741655  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:55.741986  3761 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:55.741508  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:55.743682  3761 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:55.746358  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.750609  3050 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:55.751539  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:55.755932  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:55.734920  4550 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.734586  4524 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:55.778559  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:55.778635  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:55.779459  3193 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.781507  3796 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:55.752532  4526 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:55.719349  4544 consensus_queue.cc:1059] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:14:55.752393  4499 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:55.786832  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:55.752638  4552 raft_consensus.cc:697] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:55.695763  4486 consensus_queue.cc:260] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.794132  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.757496  4448 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:55.753113  4580 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:55.795747  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.803128  3193 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:55.758199  4359 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:55.782389  4524 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.778103  4528 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:55.816803  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.819298  3046 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:55.789727  4526 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:55.790612  4527 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:55.836845  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.830332  3194 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:55.808594  4405 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:55.806253  4448 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:55.809958  4558 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:55.794754  4534 consensus_queue.cc:1059] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:14:55.840051  4537 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:55.843389  4578 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.843885  4578 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:55.844233  4448 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.847973  3193 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:55.820529  4559 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.817963  4580 raft_consensus.cc:697] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:14:55.827327  4486 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.850419  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:14:55.852192  4579 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:14:55.826576  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:55.839063  4526 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.840286  4557 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:55.841004  4405 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:55.874358  4487 raft_consensus.cc:3055] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:55.874831  4487 raft_consensus.cc:740] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:55.875741  4487 consensus_queue.cc:260] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.876896  4487 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.877513  4544 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:55.859601  4558 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:55.878075  4544 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.880252  4544 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:55.880383  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:55.880731  4544 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:55.880971  3196 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.881249  4544 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.882156  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.867399  4552 consensus_queue.cc:237] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.883453  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:55.885207  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.870076  4505 consensus_queue.cc:1059] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:14:55.886581  4505 raft_consensus.cc:3055] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:55.886936  4505 raft_consensus.cc:740] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:55.886993  4547 raft_consensus.cc:3055] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:55.887399  4547 raft_consensus.cc:740] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:55.883487  4544 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:55.887790  4505 consensus_queue.cc:260] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:55.888186  4547 consensus_queue.cc:260] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.892977  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.890179  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.826907  4497 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:55.903295  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.904127  3126 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:55.904443  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:14:55.904942  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:55.905400  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.905584  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.841198  4527 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:55.907928  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.905951  3196 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:55.908988  3165 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.909104  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.909664  3199 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:14:55.910616  3193 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:55.910759  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:55.911688  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.910611  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.914947  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.911711  3199 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:14:55.912806  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.906931  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:55.889338  4547 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.916155  3196 raft_consensus.cc:2393] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:14:55.889053  4505 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.920058  4526 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:55.854846  4519 consensus_queue.cc:1059] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:14:55.890486  4405 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.922852  3197 raft_consensus.cc:2368] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3.
I20260709 13:14:55.914455  3165 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.859943  4569 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:14:55.916405  3193 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:14:55.923439  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.924333  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.927124  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:55.926517  4393 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:55.924863  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.927785  3196 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:55.914742  4359 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:55.943708  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.945632  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.915999  4528 consensus_queue.cc:1059] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:14:55.954623  4557 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:55.958699  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:55.950723  4519 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:55.949949  4556 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:55.957448  4472 tablet_bootstrap.cc:492] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:14:55.961447  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.972309  3165 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:55.974829  3165 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.984836  4526 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:55.986217  3165 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.986588  4518 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:55.972703  4528 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:55.982930  4537 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:14:55.983035  4393 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:55.990000  4561 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:55.992244  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:55.992959  3165 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:55.994110  3794 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:14:55.966279  4446 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:55.996596  4528 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:55.997818  4538 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:55.999068  4359 raft_consensus.cc:3055] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:55.999215  3165 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:55.999619  4359 raft_consensus.cc:740] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:56.000564  4359 consensus_queue.cc:260] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:56.005897  4538 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:56.006825  4359 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.008598  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:56.007328  3165 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:56.022168  4556 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:56.022904  4556 raft_consensus.cc:697] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:56.024096  4556 consensus_queue.cc:237] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:56.026572  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.031973  3195 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:56.027999  4527 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:56.018597  4537 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:14:56.057391  4537 raft_consensus.cc:3055] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:56.057880  4537 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:56.058877  4537 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:56.061515  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:56.062129  3200 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:56.053107  3165 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:56.027076  4518 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:56.012972  4578 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:55.942386  4580 consensus_queue.cc:237] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:56.026763  4497 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:56.069584  3121 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:56.090131  3200 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:56.109642  3165 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:14:56.116360  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.014277  4446 raft_consensus.cc:697] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:56.120049  4359 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:56.128221  3117 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
W20260709 13:14:56.131053  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.099587  4527 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:56.133150  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.082777  4524 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:56.148263  3165 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:56.162200  4448 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:56.163681  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:56.164479  4448 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:56.165360  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:56.164484  3050 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:56.191196  4524 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:56.191524  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:56.184221  4499 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.198359  3794 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.198661  4446 consensus_queue.cc:237] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:56.150000  4497 consensus_queue.cc:1059] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:14:56.206449  3120 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
W20260709 13:14:56.213620  4591 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:14:56.215124  4405 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:56.216797  4537 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:56.217265  4405 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:56.198555  4499 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:56.218580  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 70399.5us
W20260709 13:14:56.229673  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 386235us
W20260709 13:14:56.232223  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.248169  4544 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:56.248860  4544 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:56.251442  4567 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:56.251989  4567 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:56.251413  4544 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:56.254931  4567 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:56.263180  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:56.255324  4558 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.276782  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:56.278734  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:56.280898  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:56.229683  4538 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:56.281787  3121 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 3: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:56.281608  4366 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.285140  4366 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:56.255353  4509 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:56.286540  4509 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:56.287256  4366 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:56.288792  4509 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:56.291165  4499 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:56.229483  3794 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:14:56.212824  3762 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:56.280470  4558 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:56.271121  4497 consensus_queue.cc:1059] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:14:56.303036  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:56.304530  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:14:56.241315  3165 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:56.308050  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:14:56.310063  4582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.014s	sys 0.019s
W20260709 13:14:56.310786  4582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.014s	sys 0.020s
I20260709 13:14:56.313519  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:56.317298  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:56.321602  3126 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.321314  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:56.325228  3121 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:56.335022  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:56.337286  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:56.338253  3121 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 1.
W20260709 13:14:56.339954  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 98768.6us
I20260709 13:14:56.340787  3165 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:56.342111  3165 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:14:56.343041  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 436877us
I20260709 13:14:56.343446  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:56.345786  3121 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:56.346916  3126 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:14:56.349924  4359 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:56.302842  4559 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:56.355508  3117 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:56.354063  3165 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:56.360126  3761 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:56.348870  4393 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:56.371958  3761 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:56.353884  4561 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:56.353327  4527 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:56.354746  4576 raft_consensus.cc:3055] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:14:56.391124  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:56.391467  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 45322.3us
W20260709 13:14:56.353212  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 159541us
I20260709 13:14:56.381449  4448 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:56.455102  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:56.456331  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:14:56.402679  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 49910.8us
I20260709 13:14:56.390908  4497 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:14:56.370814  3798 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.000s	sys 0.019s
W20260709 13:14:56.485875  3798 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.001s	sys 0.019s
W20260709 13:14:56.424853  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 68447.1us
I20260709 13:14:56.437633  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:14:56.437958  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 66085.6us
W20260709 13:14:56.405882  4465 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.017s	sys 0.033s
I20260709 13:14:56.440207  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:56.442456  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:14:56.442750  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.454945  4524 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:56.440629  4594 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:56.470808  4561 raft_consensus.cc:697] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:56.439286  4558 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:56.441493  4576 raft_consensus.cc:740] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:56.471278  4448 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:56.571772  4448 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.482918  3165 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:14:56.471747  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 451070us
W20260709 13:14:56.574882  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 102134us
I20260709 13:14:56.522161  3761 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:14:56.560631  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 73485.9us
W20260709 13:14:56.520144  4465 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.017s	sys 0.034s
I20260709 13:14:56.482739  4528 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:56.581003  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 58966.6us
I20260709 13:14:56.580927  4528 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:56.582451  3761 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:56.584170  3798 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:56.471011  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:56.592132  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:56.593592  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:56.563395  4594 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:56.594060  3197 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:14:56.595539  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:56.602480  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:56.562155  4499 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:56.629993  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:56.630734  3797 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
W20260709 13:14:56.632316  4614 log.cc:927] Time spent T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:14:56.633126  4609 log.cc:927] Time spent T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:14:56.633541  3122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:14:56.633883  4488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a641b8a516264234af4db10b1a0610f0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:56.634342  4600 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 13:14:56.602478  4594 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.602540  4559 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 13:14:56.635185  4611 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:14:56.634253  4536 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:14:56.637367  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 54813us
I20260709 13:14:56.590353  4366 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:56.589871  4393 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:14:56.659292  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 45671.7us
W20260709 13:14:56.573698  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 87342.2us
I20260709 13:14:56.574111  4597 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:56.636281  4505 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:56.566406  4524 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:56.596871  4557 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.701102  4512 raft_consensus.cc:1064] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:14:56.701960  4405 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.702567  4573 raft_consensus.cc:3055] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:56.605822  3047 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
W20260709 13:14:56.728036  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 166056us
I20260709 13:14:56.600399  4596 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.688588  3793 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:14:56.734885  3164 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:56.755131  3050 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:56.726227  3122 raft_consensus.cc:606] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:56.765638  3045 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:56.763079  3046 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:56.758630  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:56.790602  3090 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:56.793870  3042 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 2: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:56.794869  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:56.796427  3090 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:56.799150  3090 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:56.693993  4576 consensus_queue.cc:260] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:56.802063  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 67259.7us
I20260709 13:14:56.759276  4536 raft_consensus.cc:697] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:56.710644  4561 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:56.803794  4617 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:14:56.792696  4573 raft_consensus.cc:740] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:56.801896  4595 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:56.802672  4547 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.816231  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:56.821709  3165 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:56.820216  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:56.821498  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:56.770021  4557 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:56.822952  3165 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:56.823158  3198 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:56.760483  4597 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:56.807705  4393 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:56.802577  4605 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:56.791348  4405 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:56.825027  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 83731.8us
I20260709 13:14:56.832023  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:56.811261  4576 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.811650  4487 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:56.828469  3165 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:56.835219  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:14:56.826365  4607 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:14:56.841418  3198 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:56.824350  4527 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:56.832365  4618 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:56.830063  4393 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:56.852473  3165 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:56.837536  4528 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:14:56.854213  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 55180.2us
I20260709 13:14:56.857287  3090 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:56.843888  4519 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:56.858819  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:56.862607  4623 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:56.854044  4393 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:56.869956  4619 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:14:56.869712  4536 consensus_queue.cc:237] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:56.861104  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:14:56.931206  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 70175.7us
I20260709 13:14:56.851550  4573 consensus_queue.cc:260] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:56.920783  4465 tablet_bootstrap.cc:492] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:56.920887  4557 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:56.921242  4624 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:56.922894  4519 raft_consensus.cc:697] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:56.943048  4519 consensus_queue.cc:237] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:56.851279  4595 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.944043  4597 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:56.944214  4595 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:56.865005  4534 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:56.946127  4366 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:56.946674  4366 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:56.947527  4595 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:56.948750  4366 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:56.936282  4559 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:56.949707  4559 raft_consensus.cc:697] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:56.950781  3046 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:56.940580  3794 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:56.941778  4405 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:56.941993  4487 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.956423  4487 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:56.952590  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:56.958107  3121 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:56.958973  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:56.953239  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:56.959906  3046 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
W20260709 13:14:56.954844  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 96118.3us
W20260709 13:14:56.931825  4537 consensus_meta.cc:287] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.715s	user 0.033s	sys 0.012s
I20260709 13:14:56.955454  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:56.955912  4505 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:56.953452  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:56.963455  3091 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:56.964075  3045 raft_consensus.cc:2393] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:56.925964  4528 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:56.959532  3048 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
W20260709 13:14:56.961889  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 95165us
I20260709 13:14:56.968819  3121 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:14:56.922233  4527 consensus_queue.cc:1059] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:14:56.962105  3090 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:14:56.971575  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.973688  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:56.974512  3121 raft_consensus.cc:2393] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:56.975845  4626 consensus_queue.cc:1059] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:56.978005  4527 consensus_queue.cc:1243] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:14:56.978884  4527 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:56.979758  3046 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:56.979527  4527 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:56.984824  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 44835.4us
I20260709 13:14:56.984849  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:56.985523  3194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:14:56.986121  3194 raft_consensus.cc:606] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:56.986441  3194 raft_consensus.cc:614] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:56.988576  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:56.994935  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:56.950572  4559 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:56.987798  4555 consensus_queue.cc:1059] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:14:56.986853  4465 tablet_bootstrap.cc:492] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:56.970790  4605 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:14:57.006816  4623 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:56.964658  4448 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:57.007306  4623 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:57.007773  4623 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.970186  4505 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:56.982707  4597 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:57.001605  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:14:56.971303  4524 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:56.972740  4534 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:14:57.000362  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:56.997730  4569 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:57.005434  4527 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:57.011881  4448 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:57.019749  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:57.022261  4538 raft_consensus.cc:3055] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:57.020819  4393 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:57.013727  4465 ts_tablet_manager.cc:1403] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 1.652s	user 0.050s	sys 0.047s
I20260709 13:14:57.026685  4538 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:57.030912  4594 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:57.011276  4597 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:57.042402  3090 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:57.017616  4569 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:57.012253  4624 consensus_queue.cc:1059] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:14:57.054100  4543 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:57.054646  4594 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:57.054904  4543 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:57.055346  4543 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:57.055712  4543 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.056947  4393 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:57.064818  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:57.065523  3117 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:57.066191  3798 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 3: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:14:57.066895  4624 raft_consensus.cc:3055] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:57.067328  4624 raft_consensus.cc:740] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:57.067615  4487 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:57.067080  4538 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:57.068320  4624 consensus_queue.cc:260] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:57.070236  4465 raft_consensus.cc:359] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:57.071348  4465 raft_consensus.cc:740] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:14:57.071557  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:57.072245  3122 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:14:57.072407  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:57.073037  3118 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:14:57.043437  4597 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.073263  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:57.073959  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:57.074546  3119 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.037179  4627 raft_consensus.cc:3055] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:14:57.086045  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 92831.3us
I20260709 13:14:57.087934  3194 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:57.088214  3121 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:57.089423  4505 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:57.051738  4569 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.091485  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:57.091884  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:57.092275  3042 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 2: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:57.092463  3121 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:14:57.092630  4573 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.095577  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:57.096374  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:14:57.102681  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.102519  3117 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:14:57.102969  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:14:57.072153  4465 consensus_queue.cc:260] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:57.104698  3761 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:57.065243  4596 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:57.108413  3200 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:57.084409  4627 raft_consensus.cc:740] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:14:57.112358  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 70063.7us
I20260709 13:14:57.112075  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:14:57.099884  4558 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.106137  4556 consensus_queue.cc:1059] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:14:57.105942  4446 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:57.107061  4499 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:57.114984  4627 consensus_queue.cc:260] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:57.106983  4547 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:57.113150  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:14:57.159171  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46090.4us
I20260709 13:14:57.160024  3090 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:57.113865  4448 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:57.165021  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:57.160800  4567 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:57.172922  3196 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:57.168530  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:57.169180  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:57.169895  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:57.170167  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:57.170653  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:57.171391  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:57.173252  3761 leader_election.cc:400] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3.
I20260709 13:14:57.173951  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:57.175598  3761 leader_election.cc:403] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:14:57.171761  3119 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:14:57.171924  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:57.156291  4446 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:57.186586  3194 raft_consensus.cc:1240] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:57.177878  3197 raft_consensus.cc:2376] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2. Re-sending same reply.
I20260709 13:14:57.174739  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:57.177083  3191 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:57.158923  4499 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:57.188498  3195 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 2: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:14:57.206347  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:57.213205  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:57.225493  3198 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
W20260709 13:14:57.249143  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.270259  4602 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3.
I20260709 13:14:57.164913  4448 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:57.288093  4448 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:57.172988  4487 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:57.276816  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 100410us
I20260709 13:14:57.288168  4631 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:57.174429  4603 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.119326  4558 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:57.290266  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:57.299677  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:57.300702  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:57.206460  4446 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.208076  4499 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:57.217114  4627 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.216015  4528 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.339865  4575 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:57.345279  3199 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:57.216266  4552 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:57.366070  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:57.366803  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:57.345130  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:14:57.373062  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.174757  4534 consensus_queue.cc:1059] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.147s
I20260709 13:14:57.380486  3797 raft_consensus.cc:2393] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 3: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:14:57.384450  4592 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:14:57.321705  4547 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:57.389714  3164 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:57.384855  4636 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.389775  4536 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:57.335659  4505 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:14:57.390610  4635 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:57.288084  4612 consensus_queue.cc:1059] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.276s
I20260709 13:14:57.391569  3794 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:57.397694  4630 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:57.400578  4359 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.401170  4618 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:57.387604  4575 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.399225  4536 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.380337  4528 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:57.387322  4552 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:57.416574  4575 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.421705  4359 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:57.428637  3090 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:57.432101  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:57.399525  4547 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:57.432848  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 254709us
I20260709 13:14:57.414162  4635 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.441342  3761 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:57.418362  4536 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:57.346982  4603 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:57.432446  4465 ts_tablet_manager.cc:1434] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.400s	user 0.008s	sys 0.002s
I20260709 13:14:57.438961  4630 raft_consensus.cc:697] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:57.441864  4527 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:57.448645  4561 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:57.444962  4635 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.470057  4366 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:57.425184  4618 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:57.475989  4558 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:57.463212  4561 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:57.464403  4527 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:57.485687  4646 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.488729  4561 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.467243  4631 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:14:57.510463  4543 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:57.512912  4543 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:57.516546  4597 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:57.519335  4575 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:57.520592  4605 raft_consensus.cc:3055] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:57.521248  4569 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:57.522400  4547 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:57.526924  4597 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:14:57.527369  4623 consensus_meta.cc:287] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.005s
I20260709 13:14:57.528345  4638 raft_consensus.cc:3055] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:57.529808  4538 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.540812  4618 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:57.539064  4603 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:57.608583  2945 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49738 (request call id 144) took 2754 ms. Trace:
I20260709 13:14:57.563547  4623 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:57.554842  4552 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:57.750615  4623 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:57.642948  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:57.752133  3049 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:14:57.646552  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:57.557195  4569 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:14:57.668406  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 239712us
I20260709 13:14:57.754057  3051 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 3: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:57.650110  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:57.755352  3046 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:57.756770  4573 consensus_meta.cc:287] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.664s	user 0.012s	sys 0.001s
I20260709 13:14:57.669828  3120 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:57.683723  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.758389  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.759661  4575 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:14:57.686631  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.542822  4605 raft_consensus.cc:740] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:57.747651  2945 rpcz_store.cc:276] 0709 13:14:54.854416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.854574 (+   158us) service_pool.cc:224] Handling call
0709 13:14:54.940667 (+ 86093us) spinlock_profiling.cc:243] Waited 67.7 ms on lock 0x7b54000d98d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031d090 00007ff8303bbf3a 00007ff8361721cc 00007ff83627037e 00007ff8347312a4 00007ff834731232 00007ff834731161 00007ff8347310dc 00007ff834730392 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:14:57.608253 (+2667586us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:55.445004 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:55.555232 (+110228us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:55.564087 (+  8855us) write_op.cc:435] Acquired schema lock
0709 13:14:55.566512 (+  2425us) tablet.cc:662] Decoding operations
0709 13:14:55.582978 (+ 16466us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:55.583054 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:55.583088 (+    34us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:14:55.583413 (+   325us) tablet.cc:701] Row locks acquired
0709 13:14:55.583435 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:14:55.583592 (+   157us) write_op.cc:270] Start()
0709 13:14:55.583716 (+   124us) write_op.cc:276] Timestamp: P: 1783602895583542 usec, L: 0
0709 13:14:55.583740 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:14:55.627158 (+ 43418us) log.cc:844] Serialized 1365 byte log entry
0709 13:14:56.310751 (+683593us) op_driver.cc:464] REPLICATION: finished
0709 13:14:56.630471 (+319720us) write_op.cc:301] APPLY: starting
0709 13:14:56.630563 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:56.630689 (+   126us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:56.630835 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:56.631235 (+   400us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:56.631394 (+   159us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:14:56.631435 (+    41us) write_op.cc:312] APPLY: finished
0709 13:14:56.631649 (+   214us) log.cc:844] Serialized 35 byte log entry
0709 13:14:56.631859 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:56.632006 (+   147us) write_op.cc:454] Released schema lock
0709 13:14:56.632041 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:56.632381 (+   340us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:56.632408 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2432,"reported_tablets":4,"spinlock_wait_cycles":155665664,"child_traces":[["op",{"apply.queue_time_us":272008,"apply.run_cpu_time_us":1948,"apply.run_wall_time_us":34633,"num_ops":3,"prepare.queue_time_us":458852,"prepare.run_cpu_time_us":17876,"prepare.run_wall_time_us":310429,"raft.queue_time_us":536209,"raft.run_cpu_time_us":23997,"raft.run_wall_time_us":129125,"replication_time_us":726832,"spinlock_wait_cycles":2304,"thread_start_us":1121239,"threads_started":4,"wal-append.queue_time_us":141779,"wal-append.run_cpu_time_us":37821,"wal-append.run_wall_time_us":1971978}]]}
W20260709 13:14:57.628262  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 327430us
I20260709 13:14:57.675076  3091 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:57.698237  3798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 298) took 1105 ms. Trace:
I20260709 13:14:57.691823  3194 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
W20260709 13:14:57.735280  4488 consensus_meta.cc:287] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.673s	user 0.005s	sys 0.012s
I20260709 13:14:57.503916  4512 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:57.740952  4528 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:57.741040  4509 raft_consensus.cc:3055] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:57.512878  4519 raft_consensus.cc:3055] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:57.779130  4519 raft_consensus.cc:740] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:57.780738  4519 consensus_queue.cc:260] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:57.745035  4594 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.798913  4594 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:57.746157  4595 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.037s	sys 0.051s
I20260709 13:14:57.611467  2947 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57750 (request call id 224) took 2120 ms. Trace:
I20260709 13:14:57.803054  2947 rpcz_store.cc:276] 0709 13:14:55.491438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.491580 (+   142us) service_pool.cc:224] Handling call
0709 13:14:57.611280 (+2119700us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":266230,"reported_tablets":4}
I20260709 13:14:57.616962  2946 catalog_manager.cc:5697] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 2 to 3, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 3 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:14:57.806541  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:57.641404  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:14:57.689308  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 247917us
I20260709 13:14:57.693656  3195 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:57.764317  3798 rpcz_store.cc:276] 0709 13:14:56.592660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.593368 (+   708us) service_pool.cc:224] Handling call
0709 13:14:57.697488 (+1104120us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b54005f0fd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:14:57.697880 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084701952}
I20260709 13:14:57.792167  4446 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:57.504702  4630 consensus_queue.cc:237] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:57.827953  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:57.557853  4638 raft_consensus.cc:740] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:57.508169  4646 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:57.544495  4650 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:57.769521  4573 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.889379  4556 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:57.889472  4573 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:57.890264  4556 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:57.892642  4573 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:57.777554  4509 raft_consensus.cc:740] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:57.743813  4524 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.783538  4527 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:57.788341  4624 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:57.790940  4636 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:57.796128  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 121748us
I20260709 13:14:57.796629  3090 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:57.797655  4569 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:57.724033  4472 tablet_bootstrap.cc:492] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:57.763185  4605 consensus_queue.cc:260] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:57.824396  3120 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:14:57.833658  3046 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
W20260709 13:14:57.834689  4448 consensus_meta.cc:287] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.525s	user 0.016s	sys 0.005s
I20260709 13:14:57.832650  4638 consensus_queue.cc:260] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:57.836568  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.826457  4594 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:14:57.859961  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.906842  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:57.894512  4509 consensus_queue.cc:260] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:57.908589  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:57.908856  4509 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.909472  3044 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:14:57.910542  3195 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:57.911069  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:57.912701  4594 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:57.913327  4594 raft_consensus.cc:697] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:14:57.913532  4605 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.871418  4635 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:57.874495  3200 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:57.881841  3797 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:57.845623  4446 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:57.866024  4488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:43926 (request call id 366) took 6759 ms. Trace:
I20260709 13:14:57.867254  4519 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:57.887358  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 113679us
W20260709 13:14:57.887864  4653 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 13:14:57.893635  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:57.900179  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:57.900274  4557 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:57.900718  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 104223us
I20260709 13:14:57.901142  4650 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:57.906002  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:57.910534  4638 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.848809  4575 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.902910  4569 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:57.923805  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.927781  3042 raft_consensus.cc:2368] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3.
I20260709 13:14:57.919751  4448 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:57.932256  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:57.933135  3049 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:14:57.897362  4524 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:57.932788  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:57.934806  4569 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:57.943154  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:57.958252  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:57.958860  4655 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.959748  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:57.961565  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:57.936499  4575 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:57.967072  4448 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:57.968472  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:57.969094  3762 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:57.972122  3762 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:57.972133  4366 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:57.923009  4594 consensus_queue.cc:237] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:57.974785  4651 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:57.975855  4472 tablet_bootstrap.cc:492] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:14:57.977866  4524 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:57.980971  4538 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:57.959438  4655 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:57.983827  3762 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:14:57.985491  4635 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:57.999023  3198 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:14:57.998869  4650 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:57.999855  4505 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:58.000012  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:58.000385  4505 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.001222  4537 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.004748  4655 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:58.004995  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:58.005318  3120 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.013954  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:58.020051  3797 raft_consensus.cc:1217] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:14:58.020241  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:58.021019  3125 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 1.
I20260709 13:14:58.022056  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:58.022446  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:58.022684  4575 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:58.023638  3125 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:58.024503  4472 ts_tablet_manager.cc:1403] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 2.082s	user 0.047s	sys 0.021s
I20260709 13:14:58.024667  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:57.950433  4557 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.024959  4556 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:57.986800  4646 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:58.027405  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:58.028697  3135 tablet_copy_service.cc:342] P f20672b2852447a6bc1e137c4dd40904: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-a1ccbbf27f0b436d8c79dfb6db7fc703 received from {username='slave'} at 127.0.0.1:55318
I20260709 13:14:58.043210  3121 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:58.026013  4650 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.047843  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:58.044459  4487 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.051826  3119 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:58.051883  3120 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:58.054477  3050 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:14:58.041720  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:58.086057  3118 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:14:58.087522  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 145155us
W20260709 13:14:58.047487  4499 consensus_meta.cc:287] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.556s	user 0.005s	sys 0.012s
W20260709 13:14:58.053514  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 69814.8us
I20260709 13:14:58.101827  3797 raft_consensus.cc:2368] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3.
I20260709 13:14:58.096946  3135 tablet_copy_service.cc:434] P f20672b2852447a6bc1e137c4dd40904: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-a1ccbbf27f0b436d8c79dfb6db7fc703 on tablet a1ccbbf27f0b436d8c79dfb6db7fc703 with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:58.105515  4652 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:14:58.106081  4561 consensus_meta.cc:287] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.600s	user 0.011s	sys 0.002s
I20260709 13:14:57.920859  4488 rpcz_store.cc:276] 0709 13:14:51.075824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.076014 (+   190us) service_pool.cc:224] Handling call
0709 13:14:51.112425 (+ 36411us) ts_tablet_manager.cc:934] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
0709 13:14:56.589498 (+5477073us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:57.061954 (+472456us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:57.062104 (+   150us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:57.831939 (+769835us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:57.832684 (+   745us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:57.833074 (+   390us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:57.835150 (+  2076us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":30271,"tablet-copy.queue_time_us":35460,"thread_start_us":409470,"threads_started":2}
I20260709 13:14:58.098434  4538 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.095732  4537 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.121997  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:58.106248  4652 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.123947  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:58.120338  3122 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:14:58.122812  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:58.126107  4487 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.128333  4487 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:58.127689  4472 raft_consensus.cc:359] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:58.120496  3090 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:58.118526  4524 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:14:58.139329  4659 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:14:58.139344  4488 tablet_copy_client.cc:806] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:58.178781  4488 tablet_copy_client.cc:670] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:58.174926  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:58.113314  4536 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:58.175661  3091 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:58.097374  4499 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:58.106835  4561 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:58.058259  4650 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.179800  3798 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:14:58.128931  4472 raft_consensus.cc:740] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
W20260709 13:14:58.185067  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.185534  3194 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:58.187155  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:58.116034  4569 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:58.187388  4561 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:58.189105  4538 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.198287  4650 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:58.199482  4538 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:58.199911  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:14:58.190660  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 77744us
I20260709 13:14:58.195382  4537 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:58.201231  4638 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:58.210804  4638 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.210985  3794 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:14:58.211285  4638 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:58.212015  3118 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
W20260709 13:14:58.212177  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.213477  3120 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:58.213768  4499 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:14:58.196182  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 88369.7us
I20260709 13:14:58.214668  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:58.215080  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:58.215451  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:58.215953  3120 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 3: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:14:58.188359  4646 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:58.194746  3795 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:14:58.208494  3117 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:58.185570  4524 raft_consensus.cc:697] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:14:58.226975  4499 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.231258  4499 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:58.233779  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.233851  4538 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:58.342172  4561 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:58.343220  4499 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:58.343079  4561 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:58.299820  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:58.352681  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.235381  3091 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:58.247247  4569 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:58.356061  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:58.353770  4527 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:58.356720  4359 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:14:58.247903  4662 log.cc:927] Time spent T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:14:58.356552  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:58.397269  3049 raft_consensus.cc:2393] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 3: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:14:58.379077  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.282095  3047 raft_consensus.cc:2368] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5.
I20260709 13:14:58.285475  4624 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:58.398094  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:58.247643  4661 log.cc:927] Time spent T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:14:58.226528  4487 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:58.384625  3118 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:58.386634  3761 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:58.389081  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:58.389806  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:14:58.402195  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 166949us
I20260709 13:14:58.390584  3042 raft_consensus.cc:2393] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:58.235667  4472 consensus_queue.cc:260] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:58.390734  4650 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.246435  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:14:58.395251  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.389081  4359 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.395390  4561 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:14:58.400682  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 185370us
I20260709 13:14:58.297226  4505 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:14:58.403390  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.235322  4557 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:58.409469  4650 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.415916  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:58.416574  3796 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:58.417608  4650 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:58.418097  3796 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:58.412308  3126 raft_consensus.cc:2393] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:58.297451  4638 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:58.420610  4636 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:58.421270  4636 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:58.411717  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:58.421468  4638 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:58.421869  4636 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:58.403905  4487 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:58.425549  4487 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.434532  4527 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:58.450165  3790 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:58.451678  4527 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:58.454200  4505 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.454710  4505 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:58.456254  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:58.456732  4505 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:58.457016  3194 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:14:58.458282  4505 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:58.413514  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:58.460273  3042 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:58.436124  3091 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:58.438794  4472 ts_tablet_manager.cc:1434] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.414s	user 0.014s	sys 0.012s
I20260709 13:14:58.440447  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:58.442132  4499 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:14:58.442298  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 55817.5us
I20260709 13:14:58.443145  4519 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.443274  3090 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:58.443465  4561 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.444361  4538 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.445200  4518 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.445878  4573 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.234290  4524 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:58.446978  3193 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:58.468801  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:14:58.463891  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 48730us
I20260709 13:14:58.466354  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:58.470321  3091 leader_election.cc:400] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3.
W20260709 13:14:58.470731  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.478147  3091 leader_election.cc:403] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:14:58.457442  4487 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:58.482242  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.468540  4499 raft_consensus.cc:697] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:14:58.470906  4638 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:58.471760  4650 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:58.470182  4518 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.493281  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:58.493819  4518 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:58.494889  3200 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:58.491695  4658 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:58.494267  3792 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:58.497510  3050 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:14:58.481232  4651 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:14:58.497670  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 54574.8us
I20260709 13:14:58.474881  4624 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.478688  4636 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.497397  4638 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.491091  4536 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:58.501600  4605 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3.
I20260709 13:14:58.484448  4519 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.483136  4538 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.504637  4527 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:58.502184  4651 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.512491  3091 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:58.485117  4561 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.516800  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:58.498257  4573 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:58.509209  4638 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:58.518486  4651 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:58.521399  4636 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:58.521591  4561 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:58.521848  4527 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:58.526304  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:14:58.569653  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.611913  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:58.613124  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:58.620075  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:58.621763  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:58.521286  4633 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:14:58.527648  4538 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:58.631562  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:58.603538  4487 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:58.632364  4636 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:58.625692  4650 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:58.632637  4561 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:58.657699  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 141008us
I20260709 13:14:58.637811  4538 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:58.638229  4569 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:58.640976  4650 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:58.667946  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 181220us
I20260709 13:14:58.626672  4499 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:14:58.672277  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 208487us
I20260709 13:14:58.669880  4650 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:58.691812  3090 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:14:58.673281  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 155814us
I20260709 13:14:58.709966  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:58.710727  3045 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:58.665729  4509 consensus_queue.cc:1059] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:14:58.712598  4603 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.712813  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:58.714359  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47488 (request call id 119) took 1088 ms. Trace:
I20260709 13:14:58.714799  3047 rpcz_store.cc:276] 0709 13:14:57.625874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.630436 (+  4562us) service_pool.cc:224] Handling call
0709 13:14:57.641051 (+ 10615us) spinlock_profiling.cc:243] Waited 6.7 ms on lock 0x7b5800000f98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff8353790a0 00007ff835378984 00007ff82e8f36d4 00007ff82e8f3662
0709 13:14:58.714094 (+1073043us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54001ae5d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:14:58.714253 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":943424768}
I20260709 13:14:58.681321  4538 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.669486  4561 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.738312  4646 consensus_queue.cc:1059] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:58.741292  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:58.713165  4603 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.754021  3118 raft_consensus.cc:2368] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5.
I20260709 13:14:58.689718  4624 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:14:58.754205  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 61254.7us
W20260709 13:14:58.755014  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 76264.9us
I20260709 13:14:58.757382  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:58.759215  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:58.759994  3047 raft_consensus.cc:2368] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5.
I20260709 13:14:58.761621  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:58.762310  3120 raft_consensus.cc:2368] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5.
I20260709 13:14:58.679875  4569 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:58.764649  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 93210.8us
I20260709 13:14:58.765208  3044 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:14:58.775010  4677 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:58.757718  4673 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:58.776330  3126 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 1.
I20260709 13:14:58.776089  4673 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.756000  4527 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:58.756525  4519 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:58.782384  4673 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:58.782740  4561 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:14:58.777312  3762 leader_election.cc:400] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5.
I20260709 13:14:58.785553  4569 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:58.770401  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:58.790110  4646 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:58.761494  4624 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:58.786741  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:58.795351  3121 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:58.790493  3200 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:14:58.790359  4569 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:14:58.815539  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.795563  4573 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:58.817559  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:58.817639  4682 raft_consensus.cc:3055] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:58.817816  4569 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:58.818359  4682 raft_consensus.cc:740] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:58.812606  4519 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:58.835448  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.835584  3090 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:14:58.825901  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 47461.8us
I20260709 13:14:58.837352  3091 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:14:58.823577  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 85418.7us
W20260709 13:14:58.831135  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:58.861533  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 44066.4us
I20260709 13:14:58.790680  4646 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.890019  4652 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:58.889835  4605 consensus_queue.cc:1059] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:58.827600  4624 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.891448  3194 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:14:58.903548  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:58.925222  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 87981.9us
I20260709 13:14:58.941298  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:58.958470  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:58.959195  3797 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:14:58.937034  4487 raft_consensus.cc:3055] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:58.965040  3193 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:58.868997  4509 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:58.929929  4636 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:58.937809  4678 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:58.961100  4569 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:58.968613  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:58.968844  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:58.970659  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:58.970825  4672 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.972489  4673 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.934530  4651 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:58.974740  4573 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:58.975968  4679 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.977090  4561 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:58.961057  4652 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.014997  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:58.977847  4527 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.978118  4683 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:14:58.978556  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.971836  3164 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:14:58.979087  4669 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:14:58.979449  4359 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:58.969056  4691 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:14:58.983696  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:14:58.930295  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:58.930449  4675 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.995602  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:58.926538  4519 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.004122  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:58.974328  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:58.892853  4499 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:59.007925  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:58.946913  4505 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:14:58.966681  4487 raft_consensus.cc:740] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:59.012087  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:58.987687  4538 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:58.977885  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:59.020889  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:59.016685  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:59.033418  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:14:59.033823  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 62115.7us
I20260709 13:14:59.035636  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:59.035792  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:59.052148  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:59.052865  3194 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:14:59.036314  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:59.020012  4527 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:59.038019  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:59.019881  4679 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:59.038919  4633 raft_consensus.cc:3055] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:59.059507  4359 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:59.009862  4672 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:59.040316  4636 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.026953  4673 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:59.040771  4569 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.017882  4561 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.025156  4683 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:59.086652  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:59.025588  4603 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:59.042665  4692 raft_consensus.cc:3055] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:59.041165  4675 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.018539  4678 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:59.042812  4573 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:58.931783  4682 consensus_queue.cc:260] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:14:59.050504  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 62939.6us
I20260709 13:14:59.050745  3121 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:14:59.036366  3051 raft_consensus.cc:2410] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:59.053718  3124 raft_consensus.cc:2410] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:59.047057  3120 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:59.058573  3046 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:14:59.020538  4693 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.039697  4651 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:59.072202  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:59.073233  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:59.065132  3200 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:59.019884  4652 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.077704  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:59.110144  3194 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:14:59.076145  3193 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:59.076138  3123 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
W20260709 13:14:59.090411  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 254951us
I20260709 13:14:59.090584  3164 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:59.090543  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:59.111864  3044 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:59.061870  4633 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:59.051448  4499 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.086283  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:59.100685  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:59.101918  3793 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:14:59.103175  4650 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:59.091005  4692 raft_consensus.cc:740] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:59.105472  4573 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:59.105508  4679 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:59.106519  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:59.191087  4686 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:59.194039  4636 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.094116  4519 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:59.242318  4624 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:59.087235  4569 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.184435  4693 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:59.119833  4505 consensus_queue.cc:1059] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
W20260709 13:14:59.351013  3045 consensus_meta.cc:287] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.614s	user 0.015s	sys 0.006s
W20260709 13:14:59.483242  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 406938us
I20260709 13:14:59.484741  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:14:59.351686  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:59.490610  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.352420  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:59.350847  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:59.192642  4678 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:59.502269  3049 raft_consensus.cc:2410] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:14:59.354525  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:59.351315  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:59.386719  3195 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:59.503798  3198 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:59.416463  4557 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:59.417212  4652 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:14:59.374975  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 321550us
I20260709 13:14:59.483399  3045 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:14:59.350847  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:59.195935  3794 raft_consensus.cc:2410] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:14:59.499625  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1344) took 1362 ms. Trace:
I20260709 13:14:59.502266  3120 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:59.352121  3200 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
W20260709 13:14:59.503415  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 151057us
I20260709 13:14:59.436182  3090 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:59.503683  3191 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:14:59.428614  4646 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:59.518321  3119 rpcz_store.cc:276] 0709 13:14:58.110639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.114121 (+  3482us) service_pool.cc:224] Handling call
0709 13:14:58.114499 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:58.198353 (+ 83854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:58.198397 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:58.198947 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:14:58.229815 (+ 30868us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:58.229871 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.195458 (+965587us) spinlock_profiling.cc:243] Waited 83.3 ms on lock 0x7b54003e7e54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:14:59.350930 (+155472us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:59.350997 (+    67us) raft_consensus.cc:1685] finished
0709 13:14:59.351012 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:59.472891 (+121879us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":594,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":191691136,"thread_start_us":30329,"threads_started":1,"wal-append.queue_time_us":198532,"wal-append.run_cpu_time_us":2189,"wal-append.run_wall_time_us":1035644}
I20260709 13:14:59.518713  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:59.369820  4686 raft_consensus.cc:697] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:14:59.550624  4636 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:59.551273  4686 consensus_queue.cc:237] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:59.516136  4685 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:59.554253  4646 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:59.555071  4646 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:59.532977  3793 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEARNER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:59.537906  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:59.516700  4624 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:14:59.558378  3196 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:14:59.538852  4505 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.535344  4675 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:59.541919  4693 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:59.542593  4692 consensus_queue.cc:260] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:59.547258  4499 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:59.549283  4561 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:59.553380  4650 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:59.530666  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:14:59.593546  3194 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:59.540654  4683 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:59.595060  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:14:59.595938  3193 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:59.557371  4673 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:59.545454  4569 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:59.559684  4505 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.551450  4636 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.565724  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:59.520735  4366 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
W20260709 13:14:59.642673  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 530834us
I20260709 13:14:59.643916  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:59.592154  4697 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.599782  4693 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:14:59.651647  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 167022us
I20260709 13:14:59.651712  3165 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:59.607605  4561 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.613618  4683 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:59.653503  3165 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:59.621210  4499 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:59.662690  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:59.637511  4650 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:59.657430  4561 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:59.657560  4683 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.599026  4702 consensus_queue.cc:1059] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 13:14:59.677091  4693 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:59.660929  4692 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.665397  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:59.666220  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:59.646097  3791 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:59.670049  3165 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:59.670576  4701 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:59.659969  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 103213us
I20260709 13:14:59.692668  3121 raft_consensus.cc:2393] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 2: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:59.695397  3194 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:14:59.695669  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:59.671093  4658 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.666137  4697 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.672152  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:59.714247  3798 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:14:59.657606  4573 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.647219  4636 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:59.675081  4646 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:59.675361  4650 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.658393  4677 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:59.670079  4703 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:59.727460  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:59.727727  4703 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:59.728355  3793 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:59.668138  4499 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.730333  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:59.731833  4499 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:59.679980  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:59.732154  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:14:59.732913  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 53108.2us
I20260709 13:14:59.734170  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:59.735070  3120 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:59.700139  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:59.735682  3799 raft_consensus.cc:2368] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3.
W20260709 13:14:59.720851  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 50871.9us
I20260709 13:14:59.721941  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:14:59.736831  3165 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:59.737007  4636 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:59.737239  3797 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:59.737927  3792 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:59.738193  3165 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:59.740254  4703 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:59.741021  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:59.741879  3126 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:59.741928  4624 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:59.742420  4624 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.742743  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:59.646301  4538 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:59.743402  3126 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:14:59.743932  4538 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:59.744352  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:59.688962  4701 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:59.726648  4687 log.cc:927] Time spent T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.756s	user 0.013s	sys 0.008s
I20260709 13:14:59.745947  4701 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:59.718225  4658 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.749306  3119 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:59.734105  4652 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:59.750782  4658 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:59.751145  3122 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:14:59.751664  4638 consensus_meta.cc:287] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.148s	user 0.010s	sys 0.009s
I20260709 13:14:59.689462  4685 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:59.721796  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:59.726604  4650 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:59.727470  4704 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:59.734933  3164 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:59.743238  4673 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:59.724545  4573 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:59.726125  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:59.752077  4638 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.824700  4499 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:59.752480  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:14:59.832047  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 97183.7us
W20260709 13:14:59.823513  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 72084.9us
I20260709 13:14:59.832672  3797 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
W20260709 13:14:59.834007  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:59.811492  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 52673.9us
I20260709 13:14:59.795717  3118 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:14:59.734069  4694 log.cc:927] Time spent T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.305s	user 0.002s	sys 0.001s
I20260709 13:14:59.833333  2947 catalog_manager.cc:5697] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 2 to 3, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 3 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:14:59.742776  4624 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:59.851552  4537 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:14:59.853186  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:59.859573  3121 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:59.743114  4697 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:59.853366  2947 catalog_manager.cc:5697] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.862254  3164 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:14:59.862519  2946 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57744 (request call id 239) took 4880 ms. Trace:
W20260709 13:14:59.785785  3090 connection.cc:256] RPC call timeout handler was delayed by -1.1180727420000949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
I20260709 13:14:59.796285  4658 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.860529  3091 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:59.839224  4680 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:59.853914  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:59.843662  4703 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.746006  4538 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:59.810314  4702 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:14:59.743299  4519 raft_consensus.cc:3055] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:59.857612  3123 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:59.868670  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:59.869009  4505 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:59.810212  4646 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:59.870669  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 152) took 1121 ms. Trace:
I20260709 13:14:59.860631  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:59.839406  4557 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:14:59.876827  3761 leader_election.cc:400] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5.
I20260709 13:14:59.873227  4686 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:14:59.879199  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.859097  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:59.882337  3090 leader_election.cc:400] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3.
I20260709 13:14:59.883579  3121 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:59.890772  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:59.886593  3119 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 5: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:59.885402  3117 rpcz_store.cc:276] 0709 13:14:58.749672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.749816 (+   144us) service_pool.cc:224] Handling call
0709 13:14:58.764609 (+ 14793us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:58.817038 (+ 52429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:58.817081 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:58.836647 (+ 19566us) log.cc:844] Serialized 26 byte log entry
0709 13:14:59.010238 (+173591us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:59.010297 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.010400 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:59.733244 (+722844us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:14:59.870376 (+137132us) raft_consensus.cc:1685] finished
0709 13:14:59.870397 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:59.870593 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":192,"raft.queue_time_us":46479,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":136,"spinlock_wait_cycles":34521472,"thread_start_us":143500,"threads_started":2,"wal-append.queue_time_us":220336}
I20260709 13:14:59.862901  2946 rpcz_store.cc:276] 0709 13:14:54.963356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.963673 (+   317us) service_pool.cc:224] Handling call
0709 13:14:54.991778 (+ 28105us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5400002490. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28f0b2 00007ff836208a89 00007ff8361a0da6 00007ff836172088 00007ff83627037e 00007ff8347312a4 00007ff834731232 00007ff834731161 00007ff8347310dc
0709 13:14:55.034786 (+ 43008us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b5400002490. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28f640 00007ff836166b76 00007ff836270c3e 00007ff8347312a4 00007ff834731232 00007ff834731161 00007ff8347310dc 00007ff834730392 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:14:59.843418 (+4808632us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:58.015636 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:58.133121 (+117485us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:58.177829 (+ 44708us) write_op.cc:435] Acquired schema lock
0709 13:14:58.179935 (+  2106us) tablet.cc:662] Decoding operations
0709 13:14:58.236303 (+ 56368us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:58.236414 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:58.236456 (+    42us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:58.237074 (+   618us) tablet.cc:701] Row locks acquired
0709 13:14:58.237139 (+    65us) write_op.cc:260] PREPARE: finished
0709 13:14:58.237395 (+   256us) write_op.cc:270] Start()
0709 13:14:58.237569 (+   174us) write_op.cc:276] Timestamp: P: 1783602898237321 usec, L: 0
0709 13:14:58.237617 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 13:14:58.238616 (+   999us) log.cc:844] Serialized 541 byte log entry
0709 13:14:58.714139 (+475523us) op_driver.cc:464] REPLICATION: finished
0709 13:14:59.026826 (+312687us) write_op.cc:301] APPLY: starting
0709 13:14:59.050864 (+ 24038us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:59.076790 (+ 25926us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:59.098254 (+ 21464us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:59.102580 (+  4326us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:59.102840 (+   260us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:59.102883 (+    43us) write_op.cc:312] APPLY: finished
0709 13:14:59.103147 (+   264us) log.cc:844] Serialized 23 byte log entry
0709 13:14:59.103329 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:59.103408 (+    79us) write_op.cc:454] Released schema lock
0709 13:14:59.103469 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:59.103837 (+   368us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:59.103866 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"spinlock_wait_cycles":32722560,"child_traces":[["op",{"apply.queue_time_us":279334,"apply.run_cpu_time_us":2276,"apply.run_wall_time_us":85394,"num_ops":1,"prepare.queue_time_us":207367,"prepare.run_cpu_time_us":15946,"prepare.run_wall_time_us":303948,"raft.queue_time_us":221286,"raft.run_cpu_time_us":8100,"raft.run_wall_time_us":79226,"replication_time_us":476360,"thread_start_us":345282,"threads_started":4,"wal-append.queue_time_us":154712}]]}
I20260709 13:14:59.891542  3126 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:59.887332  4646 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:59.889380  3761 leader_election.cc:403] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:14:59.874063  4693 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:59.858800  4536 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:14:59.874431  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:14:59.892678  3122 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:14:59.893436  4683 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:59.893630  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:14:59.865607  4537 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:59.934885  4537 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:59.890738  4686 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.935501  4686 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:59.901968  3761 leader_election.cc:400] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5.
I20260709 13:14:59.854441  4499 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.938037  3761 leader_election.cc:403] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:14:59.938706  4366 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5.
I20260709 13:14:59.939070  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:59.904497  4693 raft_consensus.cc:697] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:14:59.940390  4693 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.949965  4706 raft_consensus.cc:3055] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:59.950423  4706 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:14:59.951309  4706 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:59.907261  4646 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:59.908705  4524 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:59.952611  4524 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.954815  4524 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:59.909389  4705 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:59.908766  3090 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:14:59.909885  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.910969  3793 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:14:59.912542  4638 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:14:59.913806  4633 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.918500  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:14:59.919485  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:14:59.912564  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:59.913848  4701 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:59.890139  4557 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.923465  4624 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:59.876464  4658 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.931444  4573 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:59.932494  4561 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:59.882807  4703 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:59.883111  4519 raft_consensus.cc:740] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:14:59.877122  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 138989us
I20260709 13:14:59.960268  3164 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:14:59.962883  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 54207.1us
I20260709 13:14:59.964512  4713 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5.
W20260709 13:14:59.964702  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 52214.1us
I20260709 13:14:59.951979  4499 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:59.965039  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:59.965677  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:14:59.972935  4487 consensus_queue.cc:260] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:14:59.974066  4633 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:59.971135  4646 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:59.974627  4537 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:14:59.976151  4701 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:59.976861  3122 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:14:59.981408  4658 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:59.985167  3165 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:14:59.985811  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:14:59.989699  3046 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
W20260709 13:14:59.990502  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.990994  4536 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:14:59.991315  4690 log.cc:927] Time spent T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.951s	user 0.007s	sys 0.006s
I20260709 13:14:59.992206  4519 consensus_queue.cc:260] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:14:59.992184  4686 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:14:59.994601  3090 leader_election.cc:400] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3.
I20260709 13:15:00.033272  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.033686  3090 leader_election.cc:403] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:00.034091  3045 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
W20260709 13:15:00.034298  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 48628.9us
I20260709 13:14:59.996563  3120 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:14:59.997812  4703 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:14:59.988236  4702 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:00.035601  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:00.037631  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 52593.3us
I20260709 13:15:00.038257  3090 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:14:59.970434  4518 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:59.999136  4527 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:14:59.999958  3050 raft_consensus.cc:2393] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 2: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:14:59.999816  4636 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.000361  4705 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:14:59.999868  4557 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:00.001477  3135 tablet_copy_service.cc:342] P f20672b2852447a6bc1e137c4dd40904: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-0ee6c4dbcb7b45729d4e2bdcc3a09297 received from {username='slave'} at 127.0.0.1:55318
I20260709 13:15:00.054204  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:00.001401  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:00.054901  3135 tablet_copy_service.cc:434] P f20672b2852447a6bc1e137c4dd40904: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-0ee6c4dbcb7b45729d4e2bdcc3a09297 on tablet 0ee6c4dbcb7b45729d4e2bdcc3a09297 with peer e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:00.055469  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 54150.8us
I20260709 13:15:00.002068  4561 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:59.988111  4624 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:00.004352  4706 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.062944  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:00.005623  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:14:59.995932  4678 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:00.066205  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.067296  3200 raft_consensus.cc:2393] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:00.067776  4686 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:00.039811  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.047181  4573 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:00.068593  3049 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:00.068779  3195 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:00.068859  4573 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:15:00.069406  4698 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.622s	user 0.003s	sys 0.001s
I20260709 13:15:00.066231  4678 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.040374  4536 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.071640  4672 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:00.051047  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.072048  4678 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.072352  3199 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:15:00.072352  4536 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.057994  4707 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.073511  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 1334) took 1071 ms. Trace:
I20260709 13:15:00.040836  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.052079  4692 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.074105  3125 rpcz_store.cc:276] 0709 13:14:59.006316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:59.009494 (+  3178us) service_pool.cc:224] Handling call
0709 13:15:00.073312 (+1063818us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b540011c6d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:00.073432 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1959152384}
I20260709 13:15:00.074971  4692 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.075682  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:00.077252  4692 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.054108  4519 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:00.058723  4705 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.078954  4696 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:00.051565  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:00.079373  4696 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:00.080065  4705 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.047545  4701 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:00.080579  3121 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:00.080245  4696 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.080796  4701 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.035427  4679 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:00.081254  4696 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.081980  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.082589  3050 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:15:00.082959  3194 raft_consensus.cc:2368] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3.
I20260709 13:15:00.081271  4701 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.056252  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.083899  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.061508  4557 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:00.008719  4646 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:00.084937  4646 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.085067  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.044480  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:00.086915  3793 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.091271  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:00.092103  3795 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 5: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:00.013355  4537 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.070171  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:00.051067  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:00.039481  4518 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:00.065399  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:00.094698  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 45893.7us
I20260709 13:15:00.094700  3195 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:00.096251  3121 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:15:00.096705  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.045984  3193 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:00.097081  3125 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:00.060763  4708 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:00.099061  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.112799  4557 raft_consensus.cc:697] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:00.112864  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:00.056903  4636 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.119787  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:00.120864  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.122108  4636 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.084658  3198 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 2: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:00.102017  4518 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.119828  4557 consensus_queue.cc:237] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:00.112243  3200 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:15:00.124231  4701 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.113566  3796 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:15:00.047041  3791 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:00.130229  4701 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:15:00.130430  4518 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.132774  3121 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:00.133410  4518 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:00.133975  3121 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:00.138522  4509 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:00.138797  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:00.130810  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.049537  4703 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:00.057552  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:00.159759  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 102280us
I20260709 13:15:00.160523  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:00.069449  4573 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.136294  4707 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3.
I20260709 13:15:00.165776  4678 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:00.047389  4702 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:00.168119  4678 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.168850  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.169952  4702 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:00.170148  4678 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.164454  3164 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:00.073817  4716 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:00.174350  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.178982  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.140043  4675 raft_consensus.cc:2764] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:15:00.181982  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.130486  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:00.162676  4518 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:00.183180  3042 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:15:00.172551  4701 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:00.194248  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.200174  3200 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 1.
I20260709 13:15:00.195899  3193 raft_consensus.cc:2393] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:00.196696  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:00.201277  3045 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.186054  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:00.178881  4702 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:00.199623  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.172986  4703 raft_consensus.cc:697] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:00.199090  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.178942  4679 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:00.166206  4594 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:15:00.296164  3126 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:15:00.480883  3195 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:00.232137  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:00.279356  4725 log.cc:927] Time spent T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:15:00.482046  3200 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:00.482359  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:00.440973  3091 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:00.201193  3795 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:15:00.352761  3045 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:00.483332  3126 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:00.483536  4683 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:00.484018  4683 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.484409  4683 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:00.484504  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 43669.1us
W20260709 13:15:00.332130  4671 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 1.574s	user 0.016s	sys 0.009s
I20260709 13:15:00.368021  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.279381  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:00.327281  4670 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 1.513s	user 0.004s	sys 0.032s
W20260709 13:15:00.240630  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.308053  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:00.490912  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.491432  3123 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:00.492213  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.492827  3046 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:15:00.336081  4682 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:00.297120  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.495261  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.355592  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.496150  3043 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:15:00.496713  3049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:15:00.497397  3049 raft_consensus.cc:606] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:00.198058  4518 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.272064  4537 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.202637  4509 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.297s
I20260709 13:15:00.208477  4702 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.500401  4702 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.325157  4646 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:00.304508  3761 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:00.501552  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 197159us
I20260709 13:15:00.497669  2947 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57750 (request call id 225) took 2012 ms. Trace:
I20260709 13:15:00.502408  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:00.502712  4488 tablet_copy_client.cc:538] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:00.503082  4646 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:00.503904  4675 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:00.329541  3794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43926 (request call id 411) took 1388 ms. Trace:
I20260709 13:15:00.504598  4675 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:00.505152  4675 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.506743  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.507398  3191 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:00.508276  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.508836  3191 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:00.229622  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:00.295708  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:00.326206  3762 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:00.347640  4487 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.486159  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.210228  3050 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:00.509681  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.518653  4703 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:00.520874  3050 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:00.294289  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:00.318398  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:00.306386  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:00.522473  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.443301  4673 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:00.303004  4658 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.223s
I20260709 13:15:00.295588  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.209837  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.306917  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:00.489250  3042 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:00.528821  3120 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.229612  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:00.530038  3090 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:00.530561  3192 raft_consensus.cc:2368] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3.
I20260709 13:15:00.502954  2947 rpcz_store.cc:276] 0709 13:14:58.490222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.492474 (+  2252us) service_pool.cc:224] Handling call
0709 13:15:00.497594 (+2005120us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:59.977570 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:59.978244 (+   674us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:59.978279 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:14:59.978300 (+    21us) tablet.cc:662] Decoding operations
0709 13:14:59.978740 (+   440us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:59.978827 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:59.978865 (+    38us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:14:59.979224 (+   359us) tablet.cc:701] Row locks acquired
0709 13:14:59.979249 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:14:59.979411 (+   162us) write_op.cc:270] Start()
0709 13:14:59.979530 (+   119us) write_op.cc:276] Timestamp: P: 1783602899979363 usec, L: 0
0709 13:14:59.979552 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:15:00.003968 (+ 24416us) log.cc:844] Serialized 924 byte log entry
0709 13:15:00.256876 (+252908us) op_driver.cc:464] REPLICATION: finished
0709 13:15:00.322374 (+ 65498us) spinlock_profiling.cc:243] Waited 7.54 ms on lock 0x7b54000d98d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303aee28 00007ff833de9581 00007ff833de8d58 00007ff833ded9f1 00007ff833ded9a9 00007ff833ded939 00007ff833ded901 00007ff833decb2d 000000000038f354 000000000038f199
0709 13:15:00.486351 (+163977us) write_op.cc:301] APPLY: starting
0709 13:15:00.486470 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:00.486746 (+   276us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:00.486781 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:00.487409 (+   628us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:00.487611 (+   202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:15:00.487684 (+    73us) write_op.cc:312] APPLY: finished
0709 13:15:00.487951 (+   267us) log.cc:844] Serialized 29 byte log entry
0709 13:15:00.488898 (+   947us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:00.488995 (+    97us) write_op.cc:454] Released schema lock
0709 13:15:00.489036 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:00.490248 (+  1212us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:00.490279 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":22624,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":229185,"apply.run_cpu_time_us":2092,"apply.run_wall_time_us":3874,"num_ops":2,"prepare.queue_time_us":76418,"prepare.run_cpu_time_us":6346,"prepare.run_wall_time_us":358854,"replication_time_us":277164,"spinlock_wait_cycles":17352576,"thread_start_us":97863,"threads_started":2}]]}
I20260709 13:15:00.531399  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.532330  3192 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:00.525720  4673 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:00.528098  3196 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:00.333808  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.499585  4518 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.533209  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.534677  3192 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:15:00.535480  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.535997  3192 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:15:00.536759  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.525316  3197 raft_consensus.cc:2368] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5.
I20260709 13:15:00.287204  3793 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:00.232885  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.319583  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:00.537032  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.540979  3194 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:00.541280  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.498677  4679 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.514210  4488 tablet_bootstrap.cc:492] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:15:00.541908  4679 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:00.544157  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 218065us
I20260709 13:15:00.545347  3762 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:00.310165  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:00.546241  4524 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:00.546375  3796 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.546685  4524 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.547164  4524 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.493664  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:00.434278  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 250088us
I20260709 13:15:00.554008  4594 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:00.554487  4594 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.554934  4594 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.554054  4524 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:00.303105  4573 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.515482  4683 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.556689  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.557523  3117 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:00.513960  4675 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:00.537958  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.558622  4509 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:00.539067  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.561107  3193 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:00.562151  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.504946  3794 rpcz_store.cc:276] 0709 13:14:58.940842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.947052 (+  6210us) service_pool.cc:224] Handling call
0709 13:15:00.329243 (+1382191us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b5400236754. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:00.329454 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261002624}
I20260709 13:15:00.497766  3049 raft_consensus.cc:614] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:00.563390  3193 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:00.484393  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.296125  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.564505  3051 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:00.542565  4713 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:00.565184  3762 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:00.566411  4366 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:00.566771  4366 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:00.567167  4366 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.566854  3762 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:00.537952  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:00.551520  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.568027  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.288090  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.522182  3050 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:00.542797  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:00.570581  3194 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:00.570642  3165 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:00.485255  3126 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:00.571484  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.572072  4519 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.572141  3050 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:15:00.572588  4672 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:00.572752  4519 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:00.565336  4713 raft_consensus.cc:697] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:00.271940  4692 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:00.574087  4692 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.574245  4713 consensus_queue.cc:237] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:00.575285  4519 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:00.568889  4658 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:00.576287  4692 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.551651  4679 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.557869  4573 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:00.567947  4499 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:00.573158  3051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:55618
W20260709 13:15:00.555523  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 51609.9us
I20260709 13:15:00.577623  4499 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.577805  3051 raft_consensus.cc:606] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:00.578207  4499 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.578425  4679 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:00.578562  3761 leader_election.cc:400] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3.
I20260709 13:15:00.579131  3761 leader_election.cc:403] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:00.199918  4701 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:00.579943  4701 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.580076  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:00.577411  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.583250  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.583453  3051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "e9165fe61ab04bfb9a48889156d5c161"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:15:00.583874  3050 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:15:00.583959  3051 raft_consensus.cc:606] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Received request to transfer leadership to TS e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:00.584724  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.585719  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.586722  3050 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:15:00.586896  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.485349  3091 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:00.587617  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:00.587666  3051 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:00.588752  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.589015  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:00.589558  3050 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.362195  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.518252  2945 catalog_manager.cc:5697] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 2 to 3, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 3 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:00.592497  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.591398  2945 catalog_manager.cc:5697] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 1 to 2, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 2 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
W20260709 13:15:00.592845  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 62905.2us
I20260709 13:15:00.593225  3044 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:15:00.571488  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.594288  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.594362  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.518659  3198 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:00.596027  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:00.542064  3200 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:00.595134  3047 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:00.539790  4673 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:00.598052  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 112834us
I20260709 13:15:00.599373  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:00.601341  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:00.602389  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:00.604035  3120 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:00.606033  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.593928  4693 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:00.606313  3091 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:00.609031  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:00.608433  3090 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:00.609714  3199 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.610941  4699 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:00.611354  4699 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:00.607472  4509 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:00.611395  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:00.611999  4699 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:00.612504  3043 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:00.613169  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:00.613453  3090 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:00.589274  4499 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:00.607407  4732 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:00.616933  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:00.614693  3047 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.609069  4692 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:00.616601  4569 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:00.617020  3048 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:00.608151  2945 catalog_manager.cc:5697] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 1 to 2, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 2 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:00.615103  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:00.617754  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:00.618826  3051 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.619246  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:00.618966  2945 catalog_manager.cc:5697] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 1 to 2, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 2 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:00.619953  3090 leader_election.cc:400] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3.
I20260709 13:15:00.620731  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:00.620962  3090 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:00.563431  4683 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.624325  4716 raft_consensus.cc:2764] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:15:00.624436  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 44446.6us
I20260709 13:15:00.624542  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:00.624325  4735 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:00.625973  2945 catalog_manager.cc:5697] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 1 to 2, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 2 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:00.626958  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:00.557410  3195 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:15:00.629470  3090 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:00.612273  4509 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.633208  4711 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:00.633772  4509 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.633905  4524 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.635324  4658 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:00.667133  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.635982  4603 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:00.657322  3124 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:15:00.668296  4603 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.668745  4603 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.669157  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 1336) took 1660 ms. Trace:
I20260709 13:15:00.669909  4693 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.670219  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:00.670399  4693 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.671537  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:00.671367  4701 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:00.672137  3043 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.672601  3197 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:00.631284  3118 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:00.674111  3165 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:00.674639  4693 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.637097  4499 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.637048  3796 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:00.607877  4646 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.638724  4675 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.652757  3090 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:00.640282  4594 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:00.642611  4702 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.608876  4519 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.617167  4732 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.622026  4569 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:00.645028  4650 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:00.645401  4673 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:00.646042  4679 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:00.646989  4518 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:00.622344  4692 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:00.631603  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:00.652252  3120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:42960
W20260709 13:15:00.690013  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 58942.3us
I20260709 13:15:00.690102  3120 raft_consensus.cc:606] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:00.690598  3120 raft_consensus.cc:614] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:00.657102  3047 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:00.659297  2945 catalog_manager.cc:5697] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 2 to 3, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 3 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:00.627799  4708 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:00.661057  4636 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:00.625938  4638 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:00.628114  4557 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:15:00.645469  4573 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:00.632099  4716 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:00.627471  4696 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:00.702589  4696 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.702963  4696 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.704089  3199 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:00.674266  4366 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:00.705447  4518 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:00.700222  4716 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:00.706187  4716 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.707886  4699 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.709817  4573 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.710856  4594 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.687028  4732 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.711264  4603 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.712208  3192 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:00.675921  3165 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:00.676772  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 79873.4us
W20260709 13:15:00.677021  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.713944  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.714247  3051 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:00.636613  3091 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:00.715240  4573 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:00.698370  4638 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:15:00.715606  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 79074.3us
I20260709 13:15:00.715934  4638 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.716640  4603 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.717315  4603 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:00.719277  4701 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:00.719559  3762 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:00.720724  3762 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:00.677534  3164 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:00.678835  3050 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:00.669584  3124 rpcz_store.cc:276] 0709 13:14:59.008671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:59.118274 (+109603us) service_pool.cc:224] Handling call
0709 13:15:00.668993 (+1550719us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400319f54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:00.669099 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2645709568}
I20260709 13:15:00.693418  4706 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:00.722085  4706 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.722426  4706 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.722720  4736 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:00.691524  4692 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:00.723150  4702 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.706197  4366 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.679494  4651 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3.
I20260709 13:15:00.689610  4673 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.725633  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:00.677057  3090 leader_election.cc:400] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5.
I20260709 13:15:00.681941  4693 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:00.726969  4693 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:00.727391  4693 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:00.727454  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:00.727768  4624 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:00.691744  2945 catalog_manager.cc:5697] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 1 to 2, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 2 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:00.680910  4672 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:00.693676  3046 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:00.688859  4569 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.681402  4646 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:00.693382  4708 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:00.700920  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 75526.1us
I20260709 13:15:00.730309  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:00.714533  3165 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:00.734942  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:00.741333  3048 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.741963  4573 raft_consensus.cc:2764] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:15:00.741631  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:00.743458  4573 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:00.717440  3091 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:00.743882  4573 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:00.744349  4573 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:00.734862  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 57923.1us
I20260709 13:15:00.744664  3091 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:00.745182  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:00.745923  4688 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:00.746179  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:00.746694  4688 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:00.746919  4487 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:00.747151  4688 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.747308  3090 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:00.692667  4505 raft_consensus.cc:2764] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:15:00.747689  4688 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.747699  4487 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:00.748334  4487 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:00.748611  4605 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:00.748709  4487 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.749047  4605 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:00.749455  4605 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:00.736120  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 58665.3us
I20260709 13:15:00.754573  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:00.755888  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:00.736416  2945 catalog_manager.cc:5697] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 3 to 4, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 4 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:00.687152  4650 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.761160  4650 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.764920  4366 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:00.764333  3165 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:00.698238  4636 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:00.760229  2945 catalog_manager.cc:5697] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 2 to 3, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 3 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:15:00.771067  3091 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:00.773159  3051 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.778331  3048 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:15:00.722105  4603 raft_consensus.cc:697] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:00.723380  4736 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:00.780560  3045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "f20672b2852447a6bc1e137c4dd40904"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:15:00.783999  3045 raft_consensus.cc:606] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Received request to transfer leadership to TS f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:00.780858  3165 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:00.691419  4679 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:00.789788  3091 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:00.796777  3047 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:15:00.799639  3762 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:00.769203  4708 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.791224  4699 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.790791  4603 consensus_queue.cc:237] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.792888  4519 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:00.792510  4638 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.735157  4672 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:00.741034  4701 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:00.794246  4673 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:00.840932  4638 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.842473  4646 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:00.844961  4488 tablet_bootstrap.cc:492] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:00.835314  3762 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:15:00.804916  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 114282us
W20260709 13:15:00.811481  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 59865.1us
I20260709 13:15:00.847862  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:00.786106  3165 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:00.776643  4636 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:00.807550  3051 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:15:00.782382  4703 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:00.785238  4561 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:00.815828  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:00.787045  4518 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:00.866490  3043 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:00.869405  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:00.871357  3090 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:00.863336  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:15:00.872607  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 86707.8us
I20260709 13:15:00.817905  4736 raft_consensus.cc:697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:00.871414  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:00.823334  4682 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:00.879067  3796 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:00.832638  4672 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:00.891346  3090 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:00.892433  4487 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:00.895049  4679 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:00.878628  4518 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:00.897233  4736 consensus_queue.cc:237] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:00.899230  4650 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.901402  4716 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:00.903666  4716 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:00.915908  3762 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:00.869077  4701 raft_consensus.cc:697] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:00.917845  3795 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.835412  4735 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:00.918581  4735 raft_consensus.cc:697] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:00.919660  4735 consensus_queue.cc:237] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:00.866204  4561 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:00.921782  4561 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.922444  4638 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:00.923007  4638 raft_consensus.cc:697] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:00.923923  4638 consensus_queue.cc:237] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:00.875356  4488 tablet_bootstrap.cc:492] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:15:00.881608  4673 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:15:00.926021  4488 ts_tablet_manager.cc:1403] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.412s	user 0.016s	sys 0.016s
I20260709 13:15:00.884546  4713 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:00.927310  4713 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:00.928288  4713 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:00.866362  4703 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.929950  4703 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.885128  4646 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:15:00.885774  4699 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:00.886962  4683 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:00.890095  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:00.890241  4739 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:00.917351  4701 consensus_queue.cc:237] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:00.878006  3165 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:00.901580  4650 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:00.943512  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 153800us
I20260709 13:15:00.880518  4705 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:01.015205  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 137298us
I20260709 13:15:01.029183  3165 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:01.015717  4573 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.014775  4624 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:01.024467  3043 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:01.043004  3051 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:01.043462  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:01.044080  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.882093  4682 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.030997  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:01.032666  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:00.926040  4594 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:01.035983  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:01.038076  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:01.046653  3126 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:01.034559  3164 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:01.044750  3051 raft_consensus.cc:2368] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3.
I20260709 13:15:01.047976  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:01.045650  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:01.049343  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:01.052567  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:01.052855  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:01.054404  3118 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:00.929471  4488 raft_consensus.cc:359] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
W20260709 13:15:01.054230  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 180719us
I20260709 13:15:01.057258  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:01.058593  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:01.061313  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:01.057826  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:01.062737  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:01.063607  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:01.063894  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:01.064123  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:01.066309  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:01.047052  4693 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.042898  4518 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:00.941974  4696 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.052140  4682 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:01.109609  3126 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:01.126127  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:01.126127  3091 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:01.067235  4519 raft_consensus.cc:2764] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:15:01.043857  4699 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 13:15:01.133329  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 240760us
I20260709 13:15:01.133430  3091 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:01.103855  4633 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:01.086090  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:01.066670  4488 raft_consensus.cc:740] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:15:01.138392  4650 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:01.067901  4594 raft_consensus.cc:697] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:01.111666  4518 raft_consensus.cc:697] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:01.052670  4732 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:01.156038  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:01.155882  4692 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:01.162384  4743 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:15:01.152022  4702 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:15:01.065496  4658 consensus_queue.cc:1059] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:15:01.152448  4679 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:01.155230  4633 raft_consensus.cc:697] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:15:01.198374  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 163906us
I20260709 13:15:01.200698  3164 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:01.147305  4688 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:01.165114  4705 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:15:01.188393  4487 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:01.149165  4747 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
W20260709 13:15:01.217782  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 80032.8us
I20260709 13:15:01.210392  4366 raft_consensus.cc:3055] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:01.184876  4569 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.197860  4749 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:01.214383  4624 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:01.227171  3121 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:15:01.241140  3795 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:01.242486  4732 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:01.242312  4518 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.216468  4603 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:15:01.224663  4366 raft_consensus.cc:740] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:01.229240  4573 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:01.224620  4505 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:15:01.197054  4488 consensus_queue.cc:260] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:01.266505  4366 consensus_queue.cc:260] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:01.234591  4633 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:01.273474  4706 consensus_meta.cc:287] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.001s
I20260709 13:15:01.274107  4624 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.274638  4696 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:01.268935  4703 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:01.276160  4682 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.276723  3090 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:01.250600  4749 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:01.234375  4693 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:01.251971  4487 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:01.269543  4561 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.277618  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:01.302300  3090 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:01.303841  4749 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.358412  4692 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:01.439633  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:01.440315  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:01.305590  4487 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.443953  4487 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:01.295531  4706 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.277010  4636 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.445796  4603 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.446343  4603 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.447259  4636 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:01.419240  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 172613us
I20260709 13:15:01.450151  3045 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:01.447315  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:01.452682  4706 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:01.454126  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:01.455829  3796 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:01.455964  4744 raft_consensus.cc:3055] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:01.456413  4744 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:01.458914  4735 consensus_queue.cc:1059] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:01.460872  4735 raft_consensus.cc:3055] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:01.463040  3120 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:01.465101  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:01.430081  4696 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:01.465950  3126 raft_consensus.cc:2368] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3.
I20260709 13:15:01.430258  4761 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:01.430903  4672 consensus_meta.cc:287] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.540s	user 0.013s	sys 0.004s
I20260709 13:15:01.470057  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:01.472328  3118 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:01.431996  4561 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:01.280575  4699 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.434616  4488 ts_tablet_manager.cc:1434] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.508s	user 0.010s	sys 0.014s
W20260709 13:15:01.435859  4605 consensus_meta.cc:287] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.686s	user 0.009s	sys 0.004s
I20260709 13:15:01.226102  4594 consensus_queue.cc:237] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:01.442250  4758 log.cc:927] Time spent T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.098s	user 0.001s	sys 0.001s
I20260709 13:15:01.466552  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:01.461218  4735 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:01.475879  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:01.474741  3124 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:01.474434  4761 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:01.479321  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:01.457298  4744 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.474295  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:01.479900  3798 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:01.480067  4708 consensus_meta.cc:287] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.654s	user 0.006s	sys 0.010s
I20260709 13:15:01.480329  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:01.541625  3125 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:01.543519  3118 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:01.543375  4708 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.480685  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:01.543995  4735 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:01.544729  3793 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:01.542289  4670 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:15:01.468149  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:01.545425  4735 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:01.484658  3015 connection.cc:256] RPC call timeout handler was delayed by -1.2755453960000978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
I20260709 13:15:01.492162  3119 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:01.485718  4699 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:01.479254  4672 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.551553  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:01.481101  4688 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:01.480754  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:01.556124  3120 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:01.546868  3043 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:01.467979  4760 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:15:01.547996  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 244527us
I20260709 13:15:01.481961  3126 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:15:01.545620  4708 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:01.559433  3090 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:01.562340  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:01.565333  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:15:01.484659  4488 ts_tablet_manager.cc:1467] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: Tablet startup took 558ms
I20260709 13:15:01.555543  4692 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:01.558027  4693 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.489931  4603 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:01.578840  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:01.493687  4761 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:01.577781  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:01.586393  4633 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:01.590632  3015 leader_election.cc:400] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3.
I20260709 13:15:01.486387  4605 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.592530  3126 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:01.591007  3015 leader_election.cc:403] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:01.574251  4760 raft_consensus.cc:697] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:01.571955  4638 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:01.572144  4505 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:01.600170  4749 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:01.573614  4739 raft_consensus.cc:2764] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:15:01.587792  4693 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.602694  4693 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:01.572738  4747 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:01.581351  3121 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:01.578290  4705 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.598073  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:01.600275  4672 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:01.588907  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:01.583326  3120 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
W20260709 13:15:01.653268  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.697312  4605 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:01.586845  4757 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:15:01.721956  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:01.722719  3195 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:01.698988  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 68658.6us
I20260709 13:15:01.721098  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:01.724187  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:01.724990  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:01.725618  3194 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:01.724893  3199 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:01.725448  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:01.732726  3197 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:01.733654  4696 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:01.736241  4751 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.522s	user 0.001s	sys 0.004s
I20260709 13:15:01.724493  4708 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3.
I20260709 13:15:01.741811  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:01.744232  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:01.744304  3200 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:01.749874  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:01.750427  3192 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:01.752964  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:01.753715  4767 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 13:15:01.754118  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 553492us
I20260709 13:15:01.756006  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:01.753626  3199 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:01.734973  4646 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:01.627027  4705 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.765581  3196 raft_consensus.cc:1275] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:01.766856  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:01.767601  3193 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:01.768537  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:01.769490  3193 raft_consensus.cc:2393] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:01.771498  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:01.773722  3194 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:01.775159  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:01.775951  3194 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:01.778067  3195 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:01.778980  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:01.780014  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:01.780519  3195 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:01.782168  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:01.794510  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:01.795866  3198 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:01.795302  3196 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:15:01.799072  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:01.799708  3196 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:01.801937  4573 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:01.802433  3119 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:15:01.768959  4519 consensus_queue.cc:1059] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:15:01.803385  4757 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:01.803939  4757 raft_consensus.cc:697] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:01.804245  3795 raft_consensus.cc:1240] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:01.805184  3120 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:01.807670  3199 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:01.808202  3195 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:01.808571  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:01.810918  3196 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:15:01.811127  3193 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:01.817072  3194 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:15:01.804898  4757 consensus_queue.cc:237] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.795430  4633 consensus_queue.cc:1059] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:15:01.823185  3196 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:15:01.739024  4557 consensus_queue.cc:1059] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:15:01.835131  4747 raft_consensus.cc:3055] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:01.835646  4747 raft_consensus.cc:740] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:01.836248  4366 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:01.836598  4747 consensus_queue.cc:260] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.805871  4699 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:01.766121  4732 consensus_queue.cc:1059] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:15:01.824026  4594 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.873773  4594 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:01.837610  3197 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:01.870939  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:01.769520  4646 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.876816  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:01.877702  4646 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:01.828001  4769 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:15:01.826169  4760 consensus_queue.cc:237] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.878513  3197 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:15:01.922520  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:02.048378  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:02.034312  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:02.042594  3761 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:02.029663  3200 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:01.932327  3090 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:02.064152  3195 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:02.033238  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:01.964561  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.060624  3196 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:02.067698  3126 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:02.068431  3165 leader_election.cc:400] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3.
I20260709 13:15:02.068790  3165 leader_election.cc:403] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:01.971714  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:01.957618  3192 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:02.069799  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:02.070725  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 138534us
I20260709 13:15:02.126292  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:02.070749  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:02.128440  3200 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.130306  3192 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:02.131217  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:02.138298  3195 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:02.132563  3197 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.117590  3194 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:01.837100  4692 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:01.963967  4777 log.cc:927] Time spent T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:15:01.837507  4536 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:02.139593  3192 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:02.147104  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 105995us
I20260709 13:15:01.951352  4715 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:01.921257  4716 raft_consensus.cc:3055] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:01.964447  4747 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.031139  4487 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:15:02.129896  4762 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.520s	user 0.000s	sys 0.002s
I20260709 13:15:02.189020  3123 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:02.127096  4675 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:15:02.070778  4735 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.514s	user 0.003s	sys 0.006s
I20260709 13:15:02.164709  3198 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:01.963217  4537 raft_consensus.cc:3055] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:15:02.167378  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.202001  4487 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:02.204450  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.205556  4594 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:02.172993  4703 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:01.575261  4488 ts_tablet_manager.cc:1469] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: Trace:
0709 13:14:51.075824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.076014 (+   190us) service_pool.cc:224] Handling call
0709 13:14:51.112425 (+ 36411us) ts_tablet_manager.cc:934] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
0709 13:14:56.589498 (+5477073us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:57.061954 (+472456us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:57.062104 (+   150us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:57.831939 (+769835us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:57.832684 (+   745us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:57.833074 (+   390us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:57.835150 (+  2076us) inbound_call.cc:177] Queueing success response
0709 13:15:00.513769 (+2678619us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:15:00.926398 (+412629us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:15:00.926998 (+   600us) tablet_replica.cc:261] Starting instrumentation
0709 13:15:00.927695 (+   697us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":30271,"raft.queue_time_us":12895,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":8613,"tablet-copy.queue_time_us":35460,"tablet-download-pool.queue_time_us":4061,"tablet-download-pool.run_cpu_time_us":1254,"tablet-download-pool.run_wall_time_us":2318140,"thread_start_us":409470,"threads_started":2}
I20260709 13:15:02.173485  4536 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.223691  4536 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:01.920944  4706 consensus_queue.cc:1059] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.252s
I20260709 13:15:02.224781  4706 raft_consensus.cc:3055] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:02.225277  4706 raft_consensus.cc:740] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:02.175800  4705 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:02.176678  3046 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:02.132097  4646 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:02.198737  4650 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:02.232234  3048 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:01.962646  4557 consensus_queue.cc:1243] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:02.187549  4716 raft_consensus.cc:740] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:02.232810  4569 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:02.160300  4624 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3.
I20260709 13:15:02.146839  4701 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:02.239151  4646 raft_consensus.cc:697] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:02.128986  4761 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.209960  4755 raft_consensus.cc:2764] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:15:02.187381  4672 consensus_queue.cc:1059] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:15:02.214037  3793 raft_consensus.cc:2410] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:02.202502  4537 raft_consensus.cc:740] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:02.215260  3198 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:02.196070  4673 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:02.215741  4744 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:02.218611  4682 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:02.205799  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.219762  4487 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:02.220566  3196 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:02.230422  3197 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:02.187049  4715 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.177242  3044 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:15:02.226395  4706 consensus_queue.cc:260] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:01.962369  4759 consensus_queue.cc:1059] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.302s
I20260709 13:15:02.235304  3194 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:02.160799  3090 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:02.284380  4682 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:02.284396  4537 consensus_queue.cc:260] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.287683  4537 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.273701  4673 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:02.282828  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 122101us
I20260709 13:15:02.294860  3090 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:02.267457  3200 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:02.236531  4650 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:02.238829  4705 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.297705  3090 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:02.299038  3194 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:15:02.301998  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:02.256208  4701 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.240327  4646 consensus_queue.cc:237] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:02.236719  4716 consensus_queue.cc:260] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:02.270725  4509 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.004s	sys 0.036s
I20260709 13:15:02.301935  4682 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:02.304296  4693 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:02.325019  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:02.308921  4706 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.308372  4759 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.302290  4487 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:15:02.322983  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:02.322664  4703 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:02.304651  4705 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
W20260709 13:15:02.337906  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 141663us
W20260709 13:15:02.332677  4509 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.007s	sys 0.036s
I20260709 13:15:02.339790  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:02.338989  4569 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:02.338464  4682 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.349229  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:02.335970  4693 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.341934  3090 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:02.336527  4716 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.344014  4519 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:02.346477  4658 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:02.354208  4658 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:02.356173  4658 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:02.361836  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:02.340721  4557 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:02.363062  3165 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:02.352648  3090 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:02.350953  4682 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.344626  4703 raft_consensus.cc:697] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:02.362618  4672 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:02.353200  4693 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.368432  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:02.369840  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:02.375557  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:02.377583  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 305798us
I20260709 13:15:02.340389  4759 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:02.370061  3164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.015s	sys 0.045s
W20260709 13:15:02.386451  3164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.015s	sys 0.045s
I20260709 13:15:02.363236  4749 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:02.387010  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 631021us
I20260709 13:15:02.382500  3046 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:02.387945  3164 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:02.366493  4569 raft_consensus.cc:697] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:02.373247  4786 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:02.368531  4605 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:02.392968  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:02.375149  4708 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:02.393036  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:02.398536  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:02.396632  3164 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:02.383227  4761 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:02.423048  3090 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:02.416500  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:02.386974  4672 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:02.431514  4672 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.389264  4749 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:02.434247  4749 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.425084  4701 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:02.391543  4696 raft_consensus.cc:3055] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:02.425462  4703 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:02.430285  4487 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:02.424541  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:02.404768  4715 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:02.442368  4569 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.391932  4699 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:02.396238  4792 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:02.394347  4658 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:15:02.487802  3048 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:02.404350  4557 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:02.396037  4754 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:15:02.402596  4705 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:02.490674  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 67542.5us
W20260709 13:15:02.490906  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 74459.3us
I20260709 13:15:02.393390  4765 consensus_queue.cc:1059] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:15:02.505246  4696 raft_consensus.cc:740] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:02.422708  4650 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:02.452154  4753 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:02.422154  4605 raft_consensus.cc:697] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:02.506089  3042 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:02.487221  4756 raft_consensus.cc:3055] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:02.506143  3046 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:02.507289  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:02.507402  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 84449.4us
I20260709 13:15:02.508108  3049 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:02.545213  4753 raft_consensus.cc:697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:15:02.494864  4787 log.cc:927] Time spent T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.060s	user 0.006s	sys 0.000s
I20260709 13:15:02.513808  3045 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:02.514024  4487 raft_consensus.cc:697] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:02.513484  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:02.511727  4699 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.516201  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:02.495852  4708 consensus_queue.cc:1059] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:15:02.490187  4786 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:02.531639  3164 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:02.546540  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:02.552716  3164 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:02.396700  4518 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:02.506276  4573 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:02.565104  4366 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:02.566793  4682 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.567318  4557 consensus_queue.cc:1059] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:02.532721  4759 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:02.551676  4786 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.544374  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:02.551126  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:02.550809  3050 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:02.553295  3046 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:02.560861  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:02.547515  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:02.550688  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:02.546623  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:02.548879  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:02.567058  4537 consensus_queue.cc:1059] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:02.537521  4785 raft_consensus.cc:3055] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:02.572122  3042 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:02.572479  3045 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:02.573010  3051 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:02.573087  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:02.573525  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:02.565052  4573 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.575454  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:02.584515  3044 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.584379  3164 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:02.554517  3090 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:02.529963  4711 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:15:02.571902  4561 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:02.586589  4796 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:15:02.576211  4679 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:02.586772  4561 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.587307  4561 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.566784  4536 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:15:02.547446  4753 consensus_queue.cc:237] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.577342  4509 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:15:02.588487  4794 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:15:02.577556  4785 raft_consensus.cc:740] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:02.586347  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:02.548915  4594 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:15:02.550709  4756 raft_consensus.cc:740] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:02.586006  4715 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:02.550526  4699 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.582077  3762 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:02.547668  4735 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:02.595824  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:02.595659  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:02.596359  3090 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:02.595664  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:02.577824  4518 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:02.578223  4682 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:02.603569  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:02.633899  3043 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:02.591470  4573 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.549835  4524 consensus_queue.cc:1059] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:15:02.545588  4797 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:15:02.548030  4605 consensus_queue.cc:237] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.549602  4487 consensus_queue.cc:237] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.632175  3044 raft_consensus.cc:2410] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:02.592887  4679 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:02.647840  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:02.662216  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 70343.1us
I20260709 13:15:02.682973  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:02.683300  3043 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:02.683862  3126 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:02.684180  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:02.684453  3793 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:02.684863  3049 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:02.685102  3123 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:02.685684  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:02.685935  3049 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:02.680641  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:02.686021  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:02.686698  3798 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:02.687680  4732 raft_consensus.cc:3055] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:02.674185  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:02.686735  3795 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:02.600517  4802 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:02.656860  3050 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:02.610503  4794 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:02.682777  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:02.688993  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:02.690420  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:02.691165  3119 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:02.648660  4509 consensus_queue.cc:1059] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:15:02.691278  4759 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.755893  3794 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:02.756165  4624 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.756366  4759 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.756717  4624 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:02.709870  4732 raft_consensus.cc:740] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:02.637051  4703 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:02.758876  4624 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:02.759107  4703 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:02.762104  4790 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:02.639153  4775 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.002s	sys 0.026s
I20260709 13:15:02.600100  4557 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:02.674552  4708 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.755247  3118 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:02.762203  4703 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:02.631347  4749 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.755980  4753 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.661489  4569 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:02.691875  4366 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
W20260709 13:15:02.765407  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 55225.5us
I20260709 13:15:02.688337  4715 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:02.628499  4793 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.674341  4518 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:02.648828  4519 consensus_queue.cc:1059] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 13:15:02.636075  4735 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:02.802047  4519 raft_consensus.cc:3055] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:02.802471  4519 raft_consensus.cc:740] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:02.802562  4702 raft_consensus.cc:993] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: : Instructing follower 501fdf2af2bc4b0c971ae880e98f466b to start an election
I20260709 13:15:02.803473  4735 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:02.771235  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:02.660866  4705 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:15:02.807714  4509 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.808262  4509 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:02.810735  4792 raft_consensus.cc:3055] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:02.811136  4792 raft_consensus.cc:740] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:15:02.766618  4775 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.002s	sys 0.032s
I20260709 13:15:02.753132  4794 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:02.764559  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 74175.4us
I20260709 13:15:02.594082  4785 consensus_queue.cc:260] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.663190  4537 consensus_queue.cc:1059] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 13:15:02.767896  4682 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:02.782969  4693 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.768139  4802 raft_consensus.cc:697] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:02.751688  4716 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 13:15:02.786612  4744 consensus_meta.cc:287] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.000s
I20260709 13:15:02.797187  4706 raft_consensus.cc:3055] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:02.800897  4699 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.803396  4702 raft_consensus.cc:1081] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Signalling peer 501fdf2af2bc4b0c971ae880e98f466b to start an election
I20260709 13:15:02.803270  4519 consensus_queue.cc:260] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:02.709789  3126 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:15:02.816388  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:02.905552  3117 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:02.809506  3091 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:02.906852  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 97406.5us
I20260709 13:15:02.909140  3091 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:02.817116  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:02.836705  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:02.833580  4794 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:02.831718  4673 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:02.834185  4808 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.840235  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:02.776086  4561 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.826875  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:02.811597  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:02.826040  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:02.934075  3192 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:02.825227  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:02.826104  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:02.934794  3195 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:02.839573  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:02.935914  3194 raft_consensus.cc:2393] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:02.774055  4708 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.849067  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:02.849648  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:02.792527  4569 raft_consensus.cc:697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:02.857211  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:02.857355  4650 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:02.857910  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:02.851467  3090 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:02.967325  3123 raft_consensus.cc:2368] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4.
I20260709 13:15:02.861225  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:02.865135  3165 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:02.968011  3119 raft_consensus.cc:2368] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4.
I20260709 13:15:02.869287  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:02.850317  4682 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:02.869556  3793 raft_consensus.cc:1217] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:02.870091  4749 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:02.867290  4706 raft_consensus.cc:740] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:02.871071  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:02.865860  4785 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:02.872367  4802 consensus_queue.cc:237] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.867074  3210 tablet_copy_service.cc:342] P 501fdf2af2bc4b0c971ae880e98f466b: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-a641b8a516264234af4db10b1a0610f0 received from {username='slave'} at 127.0.0.1:34728
W20260709 13:15:02.873816  4798 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:15:02.779575  4753 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:02.824038  4792 consensus_queue.cc:260] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.875728  4693 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:02.883211  4747 raft_consensus.cc:3055] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:02.903802  3124 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:15:03.002660  3124 pending_rounds.cc:85] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 3
I20260709 13:15:02.912977  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:02.914656  3091 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:03.003916  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 89292.6us
I20260709 13:15:02.930339  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:02.930392  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:02.949839  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.955504  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:02.963678  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:02.707804  4756 consensus_queue.cc:260] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.979092  3194 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:03.027760  3198 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:15:02.979276  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 127916us
I20260709 13:15:02.915282  4519 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.913108  4703 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:15:02.980075  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 115013us
I20260709 13:15:02.984591  4755 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:02.985239  3197 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:02.822166  4793 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:02.976939  4537 raft_consensus.cc:3055] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:03.031469  3047 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.986914  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:02.987694  3050 raft_consensus.cc:1275] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:02.933404  4605 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:03.002965  3124 pending_rounds.cc:107] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:15:03.035291  3124 raft_consensus.cc:2889] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:02.983062  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:02.989286  4790 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:02.995136  4706 consensus_queue.cc:260] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:02.978391  4682 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.985975  4487 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:02.999094  4812 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:15:03.000336  4759 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:02.996309  3791 raft_consensus.cc:2393] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:03.004333  4747 raft_consensus.cc:740] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:03.027581  3200 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:03.030804  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:03.059052  3046 raft_consensus.cc:2393] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:15:02.993618  4805 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.214s	user 0.000s	sys 0.000s
I20260709 13:15:03.033351  3091 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:03.083698  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:03.035198  4605 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.113916  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:03.114639  3046 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:03.115877  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:03.050958  4487 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.037851  4537 raft_consensus.cc:740] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:02.978349  4808 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:03.134231  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:03.135699  4809 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:15:03.045151  4518 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:15:03.041934  4672 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:02.987859  4749 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:03.044400  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:03.045773  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:03.026489  3210 tablet_copy_service.cc:434] P 501fdf2af2bc4b0c971ae880e98f466b: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-a641b8a516264234af4db10b1a0610f0 on tablet a641b8a516264234af4db10b1a0610f0 with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:03.054030  3123 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:03.026315  4624 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.055948  3119 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:03.030105  4692 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:03.048689  4573 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:03.062722  4706 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:03.141578  3047 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:03.134248  4487 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.038810  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:03.115319  4605 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:03.087258  4790 raft_consensus.cc:697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:15:03.153790  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 120461us
I20260709 13:15:03.187973  3091 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:03.182106  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.030053  4561 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:03.201321  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:03.201995  3046 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:03.184525  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 368191us
I20260709 13:15:03.058066  4696 consensus_queue.cc:260] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:03.201009  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:03.209501  3196 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:03.210999  3047 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:03.214195  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:03.186857  4699 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:03.207881  4760 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:03.179170  4749 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:03.184772  4624 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:03.140846  4569 consensus_queue.cc:237] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:03.185165  4747 consensus_queue.cc:260] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:03.270713  4646 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:03.292573  3198 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:03.294627  4821 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.300247  3046 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:03.273056  4594 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:15:03.286773  4824 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:15:03.300503  4821 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:03.216291  4808 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:03.209091  4537 consensus_queue.cc:260] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:03.278039  4760 raft_consensus.cc:697] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:03.325181  4747 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:03.325518  4753 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:03.352149  4755 raft_consensus.cc:697] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:03.376726  4765 raft_consensus.cc:3055] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:03.377233  4765 raft_consensus.cc:740] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:15:03.385730  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:03.388042  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:03.388520  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.356690  4537 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.376943  4755 consensus_queue.cc:237] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:03.395859  4692 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:03.324272  4594 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:03.349311  4790 consensus_queue.cc:237] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
W20260709 13:15:03.409835  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.416165  4821 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:03.416966  4594 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:03.417917  4819 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:15:03.423483  3049 raft_consensus.cc:3055] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:03.424060  3049 raft_consensus.cc:740] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:03.379220  4793 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:03.402311  4765 consensus_queue.cc:260] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:03.440712  4682 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:03.461555  3090 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:03.429339  3049 consensus_queue.cc:260] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:03.506523  3049 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:03.506758  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 45323.8us
I20260709 13:15:03.510106  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:03.511934  3090 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:03.504421  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.515908  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:03.517714  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:03.518515  3123 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:03.519227  3117 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:03.519387  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 331470us
I20260709 13:15:03.523875  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:03.508719  4699 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:15:03.525959  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 339668us
I20260709 13:15:03.425062  4760 consensus_queue.cc:237] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:03.508163  4749 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:03.509155  4765 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:03.530694  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.515257  4646 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:03.529109  3091 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:03.597493  3164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.013s	sys 0.009s
W20260709 13:15:03.598112  3164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.013s	sys 0.009s
W20260709 13:15:03.598474  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 591170us
W20260709 13:15:03.607409  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.610961  3048 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:03.617937  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:03.627959  3046 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.635950  3120 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:03.531903  4703 consensus_queue.cc:1059] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
W20260709 13:15:03.614290  4815 log.cc:927] Time spent T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.351s	user 0.000s	sys 0.002s
I20260709 13:15:03.609068  4822 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:03.664639  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.538082  4749 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:15:03.608559  4830 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:03.675215  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 146172us
I20260709 13:15:03.676143  3091 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:03.677227  3091 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:03.679044  4828 log.cc:927] Time spent T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:15:03.680128  4820 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.680837  4820 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:03.642755  3122 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:03.716491  3164 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:03.683972  4519 consensus_meta.cc:287] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.003s
I20260709 13:15:03.736711  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1415) took 1027 ms. Trace:
I20260709 13:15:03.737835  3046 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:03.737171  3126 rpcz_store.cc:276] 0709 13:15:02.709093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.709210 (+   117us) service_pool.cc:224] Handling call
0709 13:15:02.709525 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:02.905522 (+195997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:03.732522 (+827000us) spinlock_profiling.cc:243] Waited 71.9 ms on lock 0x7b54001011a0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83032adc0 00007ff8303b6a02 00007ff8303b2dd6 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:15:03.736648 (+  4126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165399808}
I20260709 13:15:03.718047  4518 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:03.746592  4834 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:03.683136  4831 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:03.725932  4569 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:03.758716  3164 leader_election.cc:400] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4.
I20260709 13:15:03.759927  3164 leader_election.cc:400] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4.
W20260709 13:15:03.744232  4706 consensus_meta.cc:287] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.002s
I20260709 13:15:03.747706  4682 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:03.740527  4699 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:03.750347  4830 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:03.782130  4838 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:15:03.794309  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.795994  4679 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:03.799850  4573 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:03.800688  4573 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:03.766548  4834 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:03.806918  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:03.772966  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.672587  4822 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:03.803221  4755 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:03.832680  4755 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:03.752650  4518 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:03.847991  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 170777us
W20260709 13:15:03.848450  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.797614  4679 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.801288  4573 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:03.808677  4834 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.764979  4831 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:03.854590  3091 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:03.860814  4646 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.862414  4682 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.793167  4732 consensus_queue.cc:260] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:03.868129  4822 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:03.869513  4518 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:03.791762  4699 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:03.871673  4605 consensus_meta.cc:287] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.669s	user 0.008s	sys 0.003s
I20260709 13:15:03.871305  4820 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:03.852905  4835 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:03.852170  4838 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:03.873865  3091 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:03.803318  4830 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:03.867017  4834 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:03.879590  4794 consensus_meta.cc:287] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.963s	user 0.019s	sys 0.002s
I20260709 13:15:03.887259  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:03.877085  4749 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:03.884429  3091 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:03.890023  3195 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:03.891641  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1404) took 1252 ms. Trace:
I20260709 13:15:03.892022  3120 rpcz_store.cc:276] 0709 13:15:02.639715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.639841 (+   126us) service_pool.cc:224] Handling call
0709 13:15:02.674220 (+ 34379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:03.636449 (+962229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:03.891442 (+254993us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b5400148cd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:03.891588 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2211301632}
I20260709 13:15:03.897083  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:03.897944  3048 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.901458  3051 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:15:03.901844  3051 pending_rounds.cc:85] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 3
I20260709 13:15:03.902891  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:03.864063  4679 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:03.875522  4682 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:03.882266  4732 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.872751  4646 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:03.921890  3164 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:03.889675  3194 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:51716
I20260709 13:15:03.923847  3194 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:03.924257  3194 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:03.924362  3045 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:15:03.924719  3045 pending_rounds.cc:85] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 1
I20260709 13:15:03.924939  3045 pending_rounds.cc:107] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:15:03.925174  3045 raft_consensus.cc:2889] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:03.883620  4850 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:15:03.885294  4835 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:03.902073  3051 pending_rounds.cc:107] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 13:15:03.923606  4518 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:03.929147  3051 raft_consensus.cc:2917] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 13:15:03.929702  3051 raft_consensus.cc:2889] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:03.929339  4518 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:03.931331  4842 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:15:03.931706  4518 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:03.906123  4537 consensus_meta.cc:287] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.516s	user 0.012s	sys 0.000s
I20260709 13:15:03.933024  3049 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:15:03.935701  3049 pending_rounds.cc:85] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 5
I20260709 13:15:03.936167  3049 pending_rounds.cc:107] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:15:03.936607  3049 raft_consensus.cc:2889] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:03.939616  3048 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:03.882489  4605 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:03.910960  4744 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:03.942070  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1677) took 1418 ms. Trace:
I20260709 13:15:03.950948  3194 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:03.945066  3049 rpcz_store.cc:276] 0709 13:15:02.519210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.686709 (+167499us) service_pool.cc:224] Handling call
0709 13:15:02.688495 (+  1786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:03.423348 (+734853us) spinlock_profiling.cc:243] Waited 79.6 ms on lock 0x7b54002a10a0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83032adc0 00007ff8303b51c0 00007ff8303b6231 00007ff8303b2d8f 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c
0709 13:15:03.937290 (+513942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:03.937480 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183131392}
I20260709 13:15:03.954393  3194 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:03.941362  4755 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:03.946148  4701 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.892978  4794 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:03.957913  4849 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:03.958040  4853 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:03.942994  4633 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:15:03.961295  3125 raft_consensus.cc:2368] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3.
W20260709 13:15:03.982100  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.947688  4537 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:03.959210  4744 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:03.995918  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:04.001231  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:03.996835  3117 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:03.960989  4699 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:03.911334  4760 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:04.008165  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:04.008930  3120 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:15:04.009287  3117 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:04.009353  3123 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:15:04.001919  4785 consensus_meta.cc:287] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.008s	user 0.010s	sys 0.005s
I20260709 13:15:03.995245  4573 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:04.010937  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:04.013301  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.013171  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:04.013576  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:04.019364  3117 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 2: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:04.008275  3794 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:15:03.983776  4847 consensus_queue.cc:1059] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:15:04.000157  4749 raft_consensus.cc:697] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:04.020687  4852 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:04.025310  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.010828  4820 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:04.026952  4838 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:04.027070  4794 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:04.028178  4679 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:04.028666  4817 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.843s	user 0.003s	sys 0.005s
I20260709 13:15:04.065801  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 158) took 1461 ms. Trace:
I20260709 13:15:04.003824  4537 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:03.998503  4853 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:04.018817  4693 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.019053  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:04.024521  4699 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
W20260709 13:15:04.041953  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:04.044601  4845 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:15:04.045878  4646 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:04.019810  4831 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:04.068897  4487 consensus_meta.cc:287] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.863s	user 0.012s	sys 0.001s
I20260709 13:15:04.049853  4855 raft_consensus.cc:3055] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:04.074139  4855 raft_consensus.cc:740] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:04.073958  4487 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:04.052030  4747 consensus_meta.cc:287] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.676s	user 0.012s	sys 0.000s
I20260709 13:15:04.045771  4744 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:04.072510  4693 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:04.078181  4829 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.723s	user 0.000s	sys 0.004s
I20260709 13:15:04.077821  4749 consensus_queue.cc:237] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:04.079110  4693 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:04.056638  4852 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:04.087085  4856 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:15:04.070619  4682 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:04.011006  4760 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:04.066179  3044 rpcz_store.cc:276] 0709 13:15:02.604418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.777381 (+172963us) service_pool.cc:224] Handling call
0709 13:15:02.777679 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:02.777989 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:02.778005 (+    16us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:02.778298 (+   293us) log.cc:844] Serialized 26 byte log entry
0709 13:15:02.875116 (+ 96818us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b1800284f80. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d240c0a 00007ff836980219 00007ff83428758f 00007ff82d2c6571 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd
0709 13:15:02.977151 (+102035us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:02.977686 (+   535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.977854 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:03.933592 (+955738us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:04.065577 (+131985us) raft_consensus.cc:1685] finished
0709 13:15:04.065600 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.065724 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13590,"raft.queue_time_us":2307,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":10922,"spinlock_wait_cycles":38777600,"thread_start_us":161252,"threads_started":1,"wal-append.queue_time_us":248961}
I20260709 13:15:04.053153  4835 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:04.059051  4820 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:04.117375  4853 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:04.118891  4537 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:04.086081  4605 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:04.120528  4852 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:04.155932  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.190728  4747 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.276504  4747 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:04.278476  4862 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:15:04.280411  3120 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:15:04.121153  4855 consensus_queue.cc:260] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:04.285497  4855 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:04.289940  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.291463  4732 consensus_queue.cc:1059] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:04.292629  4732 raft_consensus.cc:3055] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:04.293076  4732 raft_consensus.cc:740] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:04.294360  4487 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:04.295197  4509 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:04.296280  4650 raft_consensus.cc:3055] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:04.296439  3043 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:04.296698  4732 consensus_queue.cc:260] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:04.305902  3051 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:15:04.302235  4840 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.623s	user 0.003s	sys 0.000s
I20260709 13:15:04.311056  3045 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:04.312956  3125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 1376) took 1505 ms (client timeout 1634 ms). Trace:
I20260709 13:15:04.284422  4701 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:04.308459  3165 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:04.316406  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:04.313434  3125 rpcz_store.cc:269] 0709 13:15:02.807328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.807561 (+   233us) service_pool.cc:224] Handling call
0709 13:15:04.312739 (+1505178us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b540031ae54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:04.312893 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2125579136}
I20260709 13:15:04.296698  4650 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:04.317906  4833 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:15:04.321607  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:04.324196  4650 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:04.325165  4650 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:04.326681  4822 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:04.327280  4822 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.327816  4822 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:04.338828  4825 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.943s	user 0.007s	sys 0.003s
I20260709 13:15:04.342458  4679 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:04.343024  4679 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:04.344285  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1615) took 1504 ms. Trace:
I20260709 13:15:04.344852  3196 rpcz_store.cc:276] 0709 13:15:02.839793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.840674 (+   881us) service_pool.cc:224] Handling call
0709 13:15:04.343972 (+1503298us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54003bb354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:04.344169 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557358848}
I20260709 13:15:04.346565  4701 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.346874  4708 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:04.347257  4701 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:04.356766  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:04.306191  4509 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:15:04.363314  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 159) took 1595 ms. Trace:
I20260709 13:15:04.363827  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:04.314792  4732 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:04.369459  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:04.377234  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.371186  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:04.378070  3194 raft_consensus.cc:2393] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:04.366117  3192 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:15:04.345008  4679 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:15:04.368211  4786 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:15:04.321286  4795 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:04.383313  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:04.388084  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:04.388672  3192 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:04.385119  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:04.389358  4841 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.601s	user 0.001s	sys 0.001s
I20260709 13:15:04.389605  3195 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:04.390820  4633 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:04.362246  4624 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:04.385959  3196 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:04.390105  3192 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:04.383926  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:04.395358  3049 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:04.396137  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:04.393592  3196 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:04.320262  4790 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:15:04.398705  3196 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:04.399988  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1619) took 1361 ms. Trace:
I20260709 13:15:04.400262  4820 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:04.400692  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:04.400401  3198 rpcz_store.cc:276] 0709 13:15:03.038618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.051705 (+ 13087us) service_pool.cc:224] Handling call
0709 13:15:03.052076 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:03.293287 (+241211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.399699 (+1106412us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54003b9554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:04.399879 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551988992}
I20260709 13:15:04.400957  4834 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:04.402508  3121 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:04.404628  4633 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:04.404879  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:04.405380  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.404089  4834 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:04.405160  4633 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:04.369920  3042 rpcz_store.cc:276] 0709 13:15:02.767767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.795235 (+ 27468us) service_pool.cc:224] Handling call
0709 13:15:02.795663 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:02.882478 (+ 86815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:02.882524 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:02.883157 (+   633us) log.cc:844] Serialized 26 byte log entry
0709 13:15:03.179018 (+295861us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:03.179074 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:03.179165 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:04.338054 (+1158889us) spinlock_profiling.cc:243] Waited 7.4 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:04.351541 (+ 13487us) raft_consensus.cc:1685] finished
0709 13:15:04.351575 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.363252 (+ 11677us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86343,"raft.queue_time_us":108486,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":10767,"spinlock_wait_cycles":17019264,"thread_start_us":295369,"threads_started":1,"wal-append.queue_time_us":487111}
I20260709 13:15:04.407433  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:04.409191  4701 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:04.390872  3195 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:04.409897  4760 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:04.409960  4633 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:04.411041  3042 raft_consensus.cc:2410] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:04.411536  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 172) took 1548 ms. Trace:
I20260709 13:15:04.412261  4749 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:04.412848  4749 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:04.413731  4756 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:04.414127  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:04.414716  3198 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:04.417896  4650 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.418412  4650 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:04.419281  4487 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.419986  4487 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:04.420389  4650 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:04.422034  4795 raft_consensus.cc:697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:04.419365  4830 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:04.411882  3197 rpcz_store.cc:276] 0709 13:15:02.863472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.037482 (+174010us) service_pool.cc:224] Handling call
0709 13:15:03.037779 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:03.515313 (+477534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:03.515346 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:03.515843 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:15:03.684728 (+168885us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:03.684776 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.411163 (+726387us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b54002bbbd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:04.411215 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:04.411261 (+    46us) raft_consensus.cc:1685] finished
0709 13:15:04.411285 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.411480 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95355,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":35655,"spinlock_wait_cycles":17992576,"thread_start_us":540814,"threads_started":2,"wal-append.queue_time_us":231395}
I20260709 13:15:04.412842  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:04.423195  4795 consensus_queue.cc:237] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:04.382323  4747 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:04.362632  4708 consensus_queue.cc:1059] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:15:04.401644  3196 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:04.678244  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:04.443614  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:04.523751  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.517666  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:04.687606  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.537155  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:04.689291  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1381) took 1659 ms. Trace:
W20260709 13:15:04.479074  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.740150  3119 rpcz_store.cc:276] 0709 13:15:03.029899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.032340 (+  2441us) service_pool.cc:224] Handling call
0709 13:15:03.050806 (+ 18466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:03.178165 (+127359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.538484 (+1360319us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b54003e7954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:04.689207 (+150723us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11293568}
I20260709 13:15:04.683537  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:04.690092  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 333428us
I20260709 13:15:04.742830  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:04.743295  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:04.398488  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:04.521469  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 80826.2us
I20260709 13:15:04.744539  3091 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:04.701857  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.747080  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:04.523988  4650 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:04.729561  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:04.702337  4715 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.398499  4790 consensus_queue.cc:1243] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:15:04.736585  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:04.536886  3199 raft_consensus.cc:2410] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:04.663945  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1377) took 1856 ms. Trace:
I20260709 13:15:04.775427  3124 rpcz_store.cc:276] 0709 13:15:02.807614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.809848 (+  2234us) service_pool.cc:224] Handling call
0709 13:15:02.810193 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:03.035870 (+225677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.663599 (+1627729us) spinlock_profiling.cc:243] Waited 73.8 ms on lock 0x7b540011c6d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:04.663854 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169675648}
I20260709 13:15:04.633663  4509 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.496546  4759 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.633812  4711 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.443326  4785 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.748072  3047 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:15:04.534075  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.751741  4792 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:04.752682  4823 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:04.533718  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1680) took 2013 ms. Trace:
I20260709 13:15:04.860319  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:04.860507  3050 rpcz_store.cc:276] 0709 13:15:02.519948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.712287 (+192339us) service_pool.cc:224] Handling call
0709 13:15:02.712742 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:03.034156 (+321414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.533395 (+1499239us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b540027c9d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:04.533647 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":631566720}
I20260709 13:15:04.532279  4633 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:04.751099  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.749634  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:04.862051  3043 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:04.749302  3051 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:15:04.534888  4487 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:04.528551  3794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 306) took 1680 ms. Trace:
I20260709 13:15:04.736716  4702 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.865833  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:04.868745  3047 raft_consensus.cc:3055] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:04.869104  3047 raft_consensus.cc:740] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:04.761089  4847 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:04.523388  4744 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.226s
I20260709 13:15:04.846112  4790 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:04.444911  4760 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.308s
I20260709 13:15:04.851135  3798 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:04.749464  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:04.752559  4569 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:15:04.857100  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:04.534081  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.852856  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:04.847484  3795 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.991s	user 0.012s	sys 0.048s
I20260709 13:15:04.864480  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:04.761958  4701 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.737368  4833 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:04.788458  4853 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.804414  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:04.939079  3198 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:04.884694  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:04.897470  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:04.761435  4650 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:04.850277  4509 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:04.801476  4715 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:04.882409  4749 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:04.946198  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:04.947245  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:04.853435  4759 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:04.896173  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:04.856714  4711 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:04.973006  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:04.974474  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:04.938131  3795 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.082s	user 0.012s	sys 0.048s
I20260709 13:15:04.877696  4633 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:04.985777  3042 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:04.878183  4702 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:04.863102  4785 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:04.883002  4847 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:04.942327  4756 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.938277  4786 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.897802  4790 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:04.944416  4569 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:05.008348  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:04.974433  4868 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:04.946496  4833 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:04.946321  4701 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:04.946610  4853 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:04.865693  3794 rpcz_store.cc:276] 0709 13:15:02.848536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.850281 (+  1745us) service_pool.cc:224] Handling call
0709 13:15:03.679681 (+829400us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b58000c4b98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28eeee 0000000000375939 00007ff8353021e0 00007ff8353cb0c4 00007ff8353cb131 00007ff83538cfc0 00007ff835377929 00007ff8353773d2 00007ff82e8eebd4
0709 13:15:03.679891 (+   210us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:04.025247 (+345356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.528115 (+502868us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b5400494154. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:04.528428 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":779409536}
I20260709 13:15:04.978528  4749 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:15:05.036973  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:05.043830  3050 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
W20260709 13:15:05.051720  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 299390us
I20260709 13:15:05.052521  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:05.054596  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:05.057425  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:05.058285  3044 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
W20260709 13:15:05.062341  4869 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:15:05.063068  4715 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:05.059397  3191 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:05.075177  4650 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:05.082859  4759 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:05.083585  4759 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.084156  4759 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:05.092724  4855 consensus_meta.cc:287] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.807s	user 0.008s	sys 0.001s
I20260709 13:15:05.094882  4716 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:05.035038  4830 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.096189  4830 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:05.098392  4830 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:05.111833  3048 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:05.112525  3044 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:05.115919  3198 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:05.109683  4524 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.121245  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1356) took 1234 ms. Trace:
I20260709 13:15:05.121047  4524 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:05.121845  3200 rpcz_store.cc:276] 0709 13:15:03.887263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.887386 (+   123us) service_pool.cc:224] Handling call
0709 13:15:03.888253 (+   867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:03.905569 (+ 17316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:03.905603 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:03.905649 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:03.905681 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.120906 (+1215225us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b540013b0d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:05.120977 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:05.121163 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39358848}
I20260709 13:15:05.029474  4868 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:05.144125  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:05.144948  3050 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:05.101686  4832 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 1.427s	user 0.000s	sys 0.006s
W20260709 13:15:05.109077  4822 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.781s	user 0.011s	sys 0.001s
W20260709 13:15:05.161525  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.012310  4786 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:05.007721  4756 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:05.077564  4509 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:05.124573  4716 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:05.190595  4732 consensus_meta.cc:287] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.809s	user 0.011s	sys 0.001s
I20260709 13:15:05.186595  4703 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.182469  4855 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.174834  4715 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:05.194947  4866 log.cc:927] Time spent T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:15:05.210500  3049 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:15:05.197619  4509 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.204770  4557 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:05.208920  4519 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:05.216931  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.190236  4822 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:05.235090  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 185) took 2279 ms. Trace:
I20260709 13:15:05.235689  3118 rpcz_store.cc:276] 0709 13:15:02.955315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.956503 (+  1188us) service_pool.cc:224] Handling call
0709 13:15:02.966120 (+  9617us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:02.981576 (+ 15456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:02.981629 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:03.032902 (+ 51273us) log.cc:844] Serialized 26 byte log entry
0709 13:15:03.350563 (+317661us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:03.350608 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:03.350680 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:05.100977 (+1750297us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:05.234689 (+133712us) raft_consensus.cc:1685] finished
0709 13:15:05.234714 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:05.234983 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12698,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":12052,"spinlock_wait_cycles":64799616,"thread_start_us":307058,"threads_started":1,"wal-append.queue_time_us":494771}
W20260709 13:15:05.238998  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:05.239604  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:05.240188  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:05.240583  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.241041  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:05.243221  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:05.244879  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:05.198038  4716 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:05.248869  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:05.250984  3051 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:05.252012  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:05.217190  4838 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.012s	sys 0.037s
I20260709 13:15:05.252625  3051 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:05.266674  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:05.267385  3124 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:15:05.213606  4732 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.270021  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:05.215441  4855 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:05.266433  4838 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.013s	sys 0.037s
I20260709 13:15:05.276906  4633 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:05.269721  4711 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:05.275625  3119 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:05.277933  4822 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:05.278083  4759 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:05.225206  4509 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:05.278949  4701 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:05.280119  4509 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:05.277933  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:05.281361  3051 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:05.204303  4569 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:05.282302  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:05.286649  4855 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:05.287091  4716 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:05.266160  4847 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:05.248500  4830 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.218485  4561 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:05.289579  3051 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:05.294183  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:05.303776  3049 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:05.304749  3049 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:05.294548  4868 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:05.295960  4833 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:05.216974  4715 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:05.214334  4703 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:05.268329  4557 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:05.298698  4739 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.240535  4519 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:05.299084  4696 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:05.299460  4830 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:05.364615  4830 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:05.272258  4702 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:05.300309  4889 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.366417  4889 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:05.366825  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:05.309073  3192 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:05.310077  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:05.368880  3197 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:05.310837  3195 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:05.310913  3196 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:05.338884  4797 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:05.308032  4792 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.370239  4797 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:05.370448  4792 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:05.372789  4792 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:05.311902  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:05.315274  3124 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:05.315941  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:05.373518  3193 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:05.374765  3118 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 2: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:05.317806  3126 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:05.312222  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:05.316697  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:05.337409  4739 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:05.380875  4524 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:05.370147  3047 consensus_queue.cc:260] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:05.388008  4785 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:05.389876  3120 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:15:05.390166  4519 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:05.322594  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.331985  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:05.404906  3200 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:15:05.335981  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:05.336326  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:05.336818  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:05.337431  4786 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:05.289456  4732 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:05.290145  4853 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:05.399392  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.402791  4884 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.425976  3796 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:15:05.403841  4790 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:05.428728  3793 raft_consensus.cc:2410] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:05.429230  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:05.429461  4557 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:05.404790  4524 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.429611  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:05.328334  3050 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:05.323076  4561 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:05.886603  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:05.887742  3164 connection.cc:256] RPC call timeout handler was delayed by -1.1494748459997481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
W20260709 13:15:05.709837  3044 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.022s	sys 0.025s
I20260709 13:15:05.429966  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:05.893828  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:05.714931  3045 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.018s	sys 0.009s
I20260709 13:15:05.886765  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:05.687336  3165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.017s	sys 0.027s
W20260709 13:15:05.897286  3165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.020s	sys 0.033s
I20260709 13:15:05.886648  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:05.895395  3799 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
W20260709 13:15:05.898643  3044 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.027s	sys 0.036s
I20260709 13:15:05.886876  3047 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:05.481547  3043 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:05.899889  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1717) took 1041 ms. Trace:
I20260709 13:15:05.896376  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1715) took 1213 ms. Trace:
W20260709 13:15:05.896884  3045 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.024s	sys 0.011s
I20260709 13:15:05.904772  3049 rpcz_store.cc:276] 0709 13:15:04.682904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.306464 (+623560us) service_pool.cc:224] Handling call
0709 13:15:05.895871 (+589407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.896049 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:05.896079 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:05.896123 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:05.896154 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.896213 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:05.896320 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:05.475688  3199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1610) took 2627 ms (client timeout 2127 ms). Trace:
W20260709 13:15:05.727643  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.895426  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 1707) took 1452 ms. Trace:
I20260709 13:15:05.906692  3050 rpcz_store.cc:276] 0709 13:15:04.443244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.052517 (+609273us) service_pool.cc:224] Handling call
0709 13:15:05.895367 (+842850us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:05.895860  3798 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:15:05.908223  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:05.391652  4703 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:05.901952  3043 rpcz_store.cc:276] 0709 13:15:04.858655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.476539 (+617884us) service_pool.cc:224] Handling call
0709 13:15:05.476890 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.899589 (+422699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.899816 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:05.638480  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:05.905834  3199 rpcz_store.cc:269] 0709 13:15:02.835922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.836050 (+   128us) service_pool.cc:224] Handling call
0709 13:15:05.439623 (+2603573us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b540013bfd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:05.462901 (+ 23278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3608809728}
I20260709 13:15:05.914880  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:05.916366  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:05.922720  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:05.923619  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.908533  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:05.928117  3195 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
W20260709 13:15:05.709903  4802 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.421s	user 0.014s	sys 0.031s
W20260709 13:15:05.512347  3090 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.132:43109 timed out after 1.705s (SENT) [suppressed 32 similar messages]
I20260709 13:15:05.931859  3192 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:05.938799  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:05.938820  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:05.939814  3192 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:05.941596  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:05.942322  3192 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:05.674396  4537 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.415156  4519 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:05.939370  4853 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.480353  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:05.922768  4672 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:05.962255  4672 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:05.964453  4672 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:05.964969  4672 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:05.965452  4672 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:05.973678  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:05.937685  4802 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.649s	user 0.016s	sys 0.037s
I20260709 13:15:05.643218  4739 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:05.894614  4794 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:05.927004  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 288643us
W20260709 13:15:05.947386  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 60704.4us
I20260709 13:15:05.948230  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:05.955628  3043 raft_consensus.cc:1275] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:05.988993  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:05.940958  4785 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:05.479485  4732 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:05.701500  4756 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:05.479877  3795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 305) took 2582 ms. Trace:
I20260709 13:15:05.900410  4715 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:05.898198  4786 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:05.913635  4884 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:05.956024  4893 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:05.956385  4790 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:05.958350  4561 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:05.995965  4487 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.013s	sys 0.025s
I20260709 13:15:06.065515  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:06.066370  3192 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:06.067605  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:06.069044  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:05.463256  3794 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:05.930637  4880 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:05.929840  4702 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:06.087025  4702 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:05.990301  3047 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:15:05.991065  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:05.992445  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:06.088116  3047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 1384) took 1783 ms (client timeout 2298 ms). Trace:
I20260709 13:15:05.978128  4519 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:05.995257  3198 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:06.000622  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:05.909387  4524 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:05.980588  4557 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:05.959618  3049 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:06.096508  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1718) took 1217 ms. Trace:
I20260709 13:15:06.096938  3049 rpcz_store.cc:276] 0709 13:15:04.879317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.947000 (+1067683us) service_pool.cc:224] Handling call
0709 13:15:05.959280 (+ 12280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.096238 (+136958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.096456 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.025547  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:06.099198  3118 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:15:05.979955  4853 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:06.064235  4889 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:06.021220  4756 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:06.010610  4872 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:15:06.064289  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:05.954818  4537 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:05.996035  4739 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.992609  4797 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:06.085527  3797 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:06.064385  4893 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:06.088258  3199 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:05.994885  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:06.088320  3197 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:06.116945  3195 raft_consensus.cc:2410] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:15:06.090392  3048 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.024s	sys 0.049s
W20260709 13:15:06.069924  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:06.083660  4487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.014s	sys 0.025s
I20260709 13:15:06.117913  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:06.128108  3046 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:06.130406  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:06.131399  3199 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:15:05.995061  3795 rpcz_store.cc:276] 0709 13:15:02.848240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.849510 (+  1270us) service_pool.cc:224] Handling call
0709 13:15:02.849835 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:02.850051 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:04.464281 (+1614230us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82d2a90ac 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c3455 00007ff833dab3c7
0709 13:15:05.000109 (+535828us) log.cc:844] Serialized 14 byte log entry
0709 13:15:05.309259 (+309150us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:05.321836 (+ 12577us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:05.334402 (+ 12566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.359892 (+ 25490us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:05.430477 (+ 70585us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1463358,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":2999,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":14281,"spinlock_wait_cycles":4147456,"thread_start_us":2388427,"threads_started":2,"wal-append.queue_time_us":386847}
I20260709 13:15:06.112784  3790 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:06.114341  4739 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:06.112484  4557 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:06.092201  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:05.984300  4794 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:06.024094  4790 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:05.994395  4785 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:06.093598  4747 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:15:06.110996  3196 raft_consensus.cc:2410] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:06.019456  4786 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:06.111624  4569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.033s	sys 0.062s
W20260709 13:15:06.088523  3047 rpcz_store.cc:269] 0709 13:15:04.304922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.865542 (+560620us) service_pool.cc:224] Handling call
0709 13:15:05.369769 (+504227us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b4c00247d80. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82e67fa20 00007ff82e690a29 00007ff82e656644 00007ff82e67df2d 00007ff82e67db93 00007ff8303ae18b 00007ff8303aecb5 00007ff8303a9f30 00007ff8303ab7de 00007ff8303b727c 00007ff835378b17
0709 13:15:06.088055 (+718286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64870144}
W20260709 13:15:06.117554  3048 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.024s	sys 0.049s
I20260709 13:15:06.160528  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:06.135336  4672 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:06.161211  3199 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:06.092128  3126 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:06.151345  3197 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:15:06.069729  3192 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:06.149426  3198 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:06.156787  4790 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:06.160547  4569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.034s	sys 0.062s
I20260709 13:15:06.171957  4702 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:06.208819  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:06.218890  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:06.219533  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.279078  3124 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:06.178306  4884 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:06.301419  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:06.302495  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:06.267055  4702 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:06.268800  4696 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:06.301831  3791 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.007s	sys 0.006s
W20260709 13:15:06.308833  3791 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.007s	sys 0.006s
I20260709 13:15:06.308877  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 168) took 1882 ms. Trace:
I20260709 13:15:06.309574  3044 rpcz_store.cc:276] 0709 13:15:04.426233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.143191 (+716958us) service_pool.cc:224] Handling call
0709 13:15:05.143488 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.143722 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:05.899061 (+755339us) log.cc:844] Serialized 14 byte log entry
0709 13:15:06.308510 (+409449us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:06.308570 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:06.308624 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.308700 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.308820 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":942988,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"thread_start_us":1123291,"threads_started":2}
I20260709 13:15:06.289480  4524 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:06.295193  4853 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:06.322124  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 340928us
W20260709 13:15:06.323479  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 378655us
W20260709 13:15:06.324373  3191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1644) took 1428 ms (client timeout 1894 ms). Trace:
I20260709 13:15:06.327106  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:06.327813  3198 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
W20260709 13:15:06.324762  3191 rpcz_store.cc:269] 0709 13:15:04.896655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.897208 (+   553us) service_pool.cc:224] Handling call
0709 13:15:06.324212 (+1427004us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54003bae54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:06.324319 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269003648}
I20260709 13:15:06.328709  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:06.329389  3121 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
W20260709 13:15:06.338486  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 430012us
I20260709 13:15:06.341146  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:06.351147  3124 raft_consensus.cc:2393] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:06.346764  3091 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:06.312249  4893 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:06.321033  4705 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.000s	sys 0.013s
W20260709 13:15:06.326977  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 814601us
I20260709 13:15:06.365419  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:06.365710  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:06.369522  3117 raft_consensus.cc:2410] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:06.369985  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 1407) took 1044 ms. Trace:
I20260709 13:15:06.370386  3117 rpcz_store.cc:276] 0709 13:15:05.325683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.365117 (+1039434us) service_pool.cc:224] Handling call
0709 13:15:06.369920 (+  4803us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.373265  3091 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:06.374697  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1364) took 1061 ms. Trace:
I20260709 13:15:06.311918  4702 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:06.359567  3761 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:06.370221  3165 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:06.387714  3091 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:06.368826  4705 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.000s	sys 0.015s
I20260709 13:15:06.349979  4569 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:06.402027  3091 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:06.317528  4696 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:06.402990  4487 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:06.403486  3165 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:06.401405  4858 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:06.409631  4487 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.410276  4487 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:06.411428  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.375083  3193 rpcz_store.cc:276] 0709 13:15:05.312997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.365469 (+1052472us) service_pool.cc:224] Handling call
0709 13:15:06.374638 (+  9169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.348012  4672 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:15:06.383944  3164 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:06.386731  4699 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.384867  4830 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.385362  4802 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:06.389006  4884 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:06.480350  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 96498.8us
I20260709 13:15:06.488166  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 169) took 1239 ms. Trace:
W20260709 13:15:06.415467  4901 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:15:06.373018  4524 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:15:06.385195  4561 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
W20260709 13:15:06.453222  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.412117  4858 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.385496  4557 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:06.414219  4903 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:15:06.419673  4797 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.120s
I20260709 13:15:06.419792  4569 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
W20260709 13:15:06.492019  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 90053.5us
I20260709 13:15:06.414867  4705 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:06.424456  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1391) took 1173 ms. Trace:
I20260709 13:15:06.387195  4834 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:06.376411  4895 consensus_queue.cc:1059] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.116s
I20260709 13:15:06.478879  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:06.488948  3043 rpcz_store.cc:276] 0709 13:15:05.248652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.986153 (+737501us) service_pool.cc:224] Handling call
0709 13:15:05.996835 (+ 10682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.997103 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:06.294924 (+297821us) log.cc:844] Serialized 14 byte log entry
0709 13:15:06.487433 (+192509us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:06.487552 (+   119us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:06.487659 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.487790 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.488043 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":90112,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"thread_start_us":438529,"threads_started":3}
I20260709 13:15:06.740444  3200 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:15:06.743873  4925 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:06.745592  4925 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:06.742276  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:06.745941  4834 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:06.724023  3797 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 328) took 1318 ms (client timeout 1559 ms). Trace:
I20260709 13:15:06.748210  4834 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:06.748270  4925 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:06.747695  3797 rpcz_store.cc:269] 0709 13:15:05.406047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.408180 (+  2133us) service_pool.cc:224] Handling call
0709 13:15:06.723770 (+1315590us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54005f0fd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:06.723941 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434336128}
W20260709 13:15:06.681797  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.651091  4921 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:15:06.618901  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 205356us
I20260709 13:15:06.749914  4921 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:06.562285  4853 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.751961  3792 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:06.753965  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:06.491432  4910 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:06.736065  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:06.623911  4487 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:06.570237  4906 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.242s	user 0.000s	sys 0.000s
W20260709 13:15:06.569648  4902 log.cc:927] Time spent T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:15:06.758080  4930 raft_consensus.cc:3055] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:06.758561  4858 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.580302  4852 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:06.813211  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:06.739879  4790 consensus_meta.cc:287] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.002s
I20260709 13:15:06.763414  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1395) took 1511 ms. Trace:
I20260709 13:15:06.745642  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:06.641692  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 151073us
W20260709 13:15:06.631891  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.635565  3762 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:15:06.822145  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 186681us
W20260709 13:15:06.687253  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 284108us
I20260709 13:15:06.716161  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1396) took 1463 ms. Trace:
W20260709 13:15:06.655579  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.824975  4487 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:06.826143  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:06.826499  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:06.827072  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:06.827836  3121 raft_consensus.cc:2393] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:06.570570  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1700) took 2143 ms. Trace:
I20260709 13:15:06.636574  4926 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.770011  4910 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:06.837019  4910 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.837013  4926 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:06.387207  4785 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:06.794710  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.492901  4756 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:06.810796  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:06.814684  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:06.755779  3049 rpcz_store.cc:276] 0709 13:15:05.251059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.098006 (+846947us) service_pool.cc:224] Handling call
0709 13:15:06.111185 (+ 13179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.111415 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:06.119131 (+  7716us) log.cc:844] Serialized 14 byte log entry
0709 13:15:06.423990 (+304859us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:06.424074 (+    84us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:06.424132 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.424220 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.424383 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13089,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":60227,"spinlock_wait_cycles":3802368,"thread_start_us":304322,"threads_started":2,"wal-append.queue_time_us":189542}
I20260709 13:15:06.572202  4702 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:06.815770  3090 connection.cc:256] RPC call timeout handler was delayed by -1.1146373980000135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
W20260709 13:15:06.843719  3090 connection.cc:256] RPC call timeout handler was delayed by -1.0454806530001406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
W20260709 13:15:06.844146  3090 connection.cc:256] RPC call timeout handler was delayed by -1.0454806530001406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
I20260709 13:15:06.663264  4909 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.813390  3091 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:06.810303  4929 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.850571  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:06.851181  3119 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:06.817543  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:06.478309  4802 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:15:06.654825  4908 log.cc:927] Time spent T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 13:15:06.568619  4899 log.cc:927] Time spent T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:15:06.818717  3047 rpcz_store.cc:276] 0709 13:15:05.252142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.160878 (+908736us) service_pool.cc:224] Handling call
0709 13:15:06.161145 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.166251 (+  5106us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:06.174332 (+  8081us) log.cc:844] Serialized 14 byte log entry
0709 13:15:06.378909 (+204577us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:06.378981 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:06.379039 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.763170 (+384131us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b540028c154. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:06.763214 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.763354 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24174,"prepare.queue_time_us":6520,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":214884,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":7220,"spinlock_wait_cycles":11124608,"thread_start_us":192047,"threads_started":1,"wal-append.queue_time_us":245575}
I20260709 13:15:06.828485  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:06.829154  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:06.824695  3165 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:06.408704  4835 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.832619  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:06.828227  3042 rpcz_store.cc:276] 0709 13:15:04.426908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.248873 (+821965us) service_pool.cc:224] Handling call
0709 13:15:05.249189 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:05.264577 (+ 15388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:05.264606 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:05.276474 (+ 11868us) log.cc:844] Serialized 26 byte log entry
0709 13:15:05.716815 (+440341us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:05.716875 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.716994 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:06.570131 (+853137us) raft_consensus.cc:1685] finished
0709 13:15:06.570158 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.570492 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21012,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":17586,"thread_start_us":415580,"threads_started":1,"wal-append.queue_time_us":829491}
I20260709 13:15:06.809962  4925 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:15:06.824290  3044 rpcz_store.cc:276] 0709 13:15:05.252396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.311603 (+1059207us) service_pool.cc:224] Handling call
0709 13:15:06.311939 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:06.371442 (+ 59503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.371467 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:06.371937 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:15:06.486130 (+114193us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:06.486189 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.486299 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:06.715843 (+229544us) raft_consensus.cc:1685] finished
0709 13:15:06.715874 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.716082 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":61610,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":9999,"thread_start_us":130881,"threads_started":2,"wal-append.queue_time_us":267694}
W20260709 13:15:06.810590  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 413533us
I20260709 13:15:06.838773  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:06.846323  4756 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.573676  4924 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.839476  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:06.831990  4834 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:15:06.877673  4939 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:06.878177  4939 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:15:06.878340  3790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 331) took 1412 ms (client timeout 1708 ms). Trace:
I20260709 13:15:06.878594  3796 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:06.577031  3791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 325) took 1184 ms. Trace:
I20260709 13:15:06.715891  4519 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:06.420022  4786 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:06.844938  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:06.845949  4487 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:06.881364  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 56717.8us
I20260709 13:15:06.895691  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1695) took 2977 ms. Trace:
I20260709 13:15:06.809437  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1699) took 2382 ms. Trace:
I20260709 13:15:06.847198  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:06.847364  3090 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:06.848382  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:06.479979  4699 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:06.411092  4889 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:06.852336  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:06.853879  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:06.570007  4696 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:06.486967  4830 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:06.816643  4930 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:06.816887  4852 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:06.838145  4872 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:06.862834  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:06.830561  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:06.862860  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:06.903841  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 73340.5us
I20260709 13:15:06.903879  3044 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:06.572324  4911 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.279s
I20260709 13:15:06.865779  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:06.866665  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:06.809930  4705 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:06.867287  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:06.907222  3119 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:06.867324  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1709) took 2401 ms. Trace:
I20260709 13:15:06.868486  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:06.871762  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:06.871881  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:06.908248  3047 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:06.872689  3043 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 5: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:06.838794  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:06.878566  4939 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:06.538440  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.853399  4692 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:06.858418  4802 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.839567  4790 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:06.894896  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 81575.4us
I20260709 13:15:06.899231  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 167) took 2473 ms. Trace:
I20260709 13:15:06.899840  3165 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:06.896241  3046 rpcz_store.cc:276] 0709 13:15:03.901680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.906735 (+  5055us) service_pool.cc:224] Handling call
0709 13:15:03.907083 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.128642 (+2221559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.879031 (+750389us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b540004a1d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:06.879204 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5106751360}
I20260709 13:15:06.901968  4487 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:06.872974  4835 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:06.901654  3798 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
W20260709 13:15:06.960075  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 63794.3us
I20260709 13:15:06.897042  3045 rpcz_store.cc:276] 0709 13:15:04.426576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.151645 (+725069us) service_pool.cc:224] Handling call
0709 13:15:05.152030 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.152279 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:05.905139 (+752860us) log.cc:844] Serialized 14 byte log entry
0709 13:15:06.808922 (+903783us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:06.809017 (+    95us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:06.809080 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.809174 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.809352 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32833,"prepare.queue_time_us":934643,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":146430,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":53620,"thread_start_us":1622876,"threads_started":3,"wal-append.queue_time_us":665402}
I20260709 13:15:06.904656  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:06.871481  4921 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:06.873266  4756 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.908420  3042 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:15:06.873445  3126 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 5: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:06.905282  3049 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:06.955411  2947 catalog_manager.cc:5697] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 1 to 3, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 3 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:06.906162  3762 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:15:06.963397  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 57322.8us
W20260709 13:15:06.963469  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 58899.4us
W20260709 13:15:06.913950  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 51228.7us
I20260709 13:15:06.964318  2947 catalog_manager.cc:5697] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 1 to 3, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 3 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:06.907892  3051 rpcz_store.cc:276] 0709 13:15:04.466082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.302990 (+836908us) service_pool.cc:224] Handling call
0709 13:15:05.303277 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:05.306699 (+  3422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:05.306740 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:05.307170 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:15:05.886287 (+579117us) spinlock_profiling.cc:243] Waited 873 us on lock 0x7b1800023b60. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:15:06.173163 (+286876us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:06.173224 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.173327 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:06.860775 (+687448us) raft_consensus.cc:1685] finished
0709 13:15:06.860795 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.867261 (+  6466us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3093,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":2008320,"thread_start_us":286624,"threads_started":1,"wal-append.queue_time_us":993570}
I20260709 13:15:06.880021  4924 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:06.918968  3118 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:06.920090  4830 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:06.902920  4889 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:06.920921  4692 raft_consensus.cc:697] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:06.982426  4692 consensus_queue.cc:237] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:06.983356  4835 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:06.901695  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 54399.2us
I20260709 13:15:06.984445  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:06.908787  4852 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:06.954973  3050 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:06.908908  4872 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.986383  3125 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:06.958132  4487 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:06.954602  4939 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:06.927182  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 171) took 1656 ms. Trace:
I20260709 13:15:06.910406  4786 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:06.949201  2945 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57732 (request call id 228) took 8466 ms. Trace:
I20260709 13:15:06.954039  4739 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:06.958905  4926 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:06.926527  4696 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:06.952929  3121 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:15:06.987144  4932 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:15:07.022042  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 172) took 1748 ms. Trace:
I20260709 13:15:06.966174  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:06.854190  4909 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:06.967953  2947 catalog_manager.cc:5697] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 1 to 2, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 2 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:06.978149  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:07.026803  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 60687.1us
I20260709 13:15:06.856712  4929 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:06.942942  4705 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:06.925592  4702 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.949180  4802 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:06.989010  4487 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:06.924129  3048 rpcz_store.cc:276] 0709 13:15:04.425908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.142589 (+716681us) service_pool.cc:224] Handling call
0709 13:15:05.142983 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.191070 (+ 48087us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:05.563300 (+372230us) log.cc:844] Serialized 14 byte log entry
0709 13:15:06.745325 (+1182025us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b18000f1240. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82ff5b4bc 00007ff82d2a948b 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff5323a
0709 13:15:06.745537 (+   212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:06.745587 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:06.745630 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.898929 (+153299us) spinlock_profiling.cc:243] Waited 47.8 ms on lock 0x7b540029de54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:06.899009 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.899173 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":896040,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":4384,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":113634304,"thread_start_us":960961,"threads_started":2,"wal-append.queue_time_us":596285}
I20260709 13:15:06.992837  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:06.950770  4790 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:07.004472  3046 rpcz_store.cc:276] 0709 13:15:05.270801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.926472 (+1655671us) service_pool.cc:224] Handling call
0709 13:15:06.926755 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.926904 (+   149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.926927 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:06.926962 (+    35us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:06.926989 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.927034 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.927133 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:07.011898  4786 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.022471  3045 rpcz_store.cc:276] 0709 13:15:05.273352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.994389 (+1721037us) service_pool.cc:224] Handling call
0709 13:15:07.021491 (+ 27102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:07.021683 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:07.021712 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:07.021787 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:07.021816 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.021879 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.021983 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.977252  4797 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:06.979323  4923 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:15:06.987521  4940 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:07.026847  2947 catalog_manager.cc:5697] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 1 to 2, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 2 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:07.027571  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:07.006726  2945 rpcz_store.cc:276] 0709 13:14:58.485018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.491827 (+  6809us) service_pool.cc:224] Handling call
0709 13:14:58.662683 (+170856us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b5400002490. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28f0b2 00007ff836208a89 00007ff8361a0da6 00007ff836172088 00007ff83627037e 00007ff8347312a4 00007ff834731232 00007ff834731161 00007ff8347310dc
0709 13:15:06.949059 (+8286376us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:01.264540 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:01.288577 (+ 24037us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:01.288615 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:15:01.288631 (+    16us) tablet.cc:662] Decoding operations
0709 13:15:01.289673 (+  1042us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:01.289730 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:01.289789 (+    59us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:15:01.290590 (+   801us) tablet.cc:701] Row locks acquired
0709 13:15:01.290607 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:15:01.290755 (+   148us) write_op.cc:270] Start()
0709 13:15:01.290872 (+   117us) write_op.cc:276] Timestamp: P: 1783602901290712 usec, L: 0
0709 13:15:01.290895 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:15:01.291582 (+   687us) log.cc:844] Serialized 3636 byte log entry
0709 13:15:01.838429 (+546847us) op_driver.cc:464] REPLICATION: finished
0709 13:15:02.547140 (+708711us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82d2a90ac 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff833de9ef0
0709 13:15:02.795055 (+247915us) write_op.cc:301] APPLY: starting
0709 13:15:02.801686 (+  6631us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:02.860102 (+ 58416us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:02.861352 (+  1250us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:02.877763 (+ 16411us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:02.877957 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:15:02.878000 (+    43us) write_op.cc:312] APPLY: finished
0709 13:15:02.878382 (+   382us) log.cc:844] Serialized 71 byte log entry
0709 13:15:03.046076 (+167694us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:03.056632 (+ 10556us) write_op.cc:454] Released schema lock
0709 13:15:03.061411 (+  4779us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:03.140173 (+ 78762us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:03.140214 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4049,"reported_tablets":16,"spinlock_wait_cycles":4785536,"child_traces":[["op",{"apply.queue_time_us":937199,"apply.run_cpu_time_us":32369,"apply.run_wall_time_us":348167,"num_ops":9,"prepare.queue_time_us":352729,"prepare.run_cpu_time_us":4249,"prepare.run_wall_time_us":58099,"replication_time_us":534978,"spinlock_wait_cycles":42694912,"thread_start_us":1428713,"threads_started":3,"wal-append.queue_time_us":392321,"wal-append.run_cpu_time_us":2326,"wal-append.run_wall_time_us":1149425}]]}
I20260709 13:15:06.994059  4895 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:06.988308  4872 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.033669  4946 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:07.034125  4939 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:07.034435  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 130441us
I20260709 13:15:06.961447  3044 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:15:07.043776  4487 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:07.009759  4696 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.070938  4946 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:06.987193  4925 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:15:07.048133  4797 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.073674  4797 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.074704  4853 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:07.075480  3794 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:07.076613  4909 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:07.077175  4699 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:07.080746  4537 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:07.029556  4835 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:15:07.084911  4858 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:07.046130  4702 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:07.086848  4924 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:07.087656  4702 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:07.048802  4786 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.976722  4934 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:15:07.024946  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 174) took 1091 ms. Trace:
W20260709 13:15:06.894805  3790 rpcz_store.cc:269] 0709 13:15:05.466385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.479969 (+ 13584us) service_pool.cc:224] Handling call
0709 13:15:06.878133 (+1398164us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54005415d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:06.878281 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345220992}
W20260709 13:15:07.051486  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 74142.6us
I20260709 13:15:07.049072  3124 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:07.030270  4926 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:07.056419  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:07.114717  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 58366.6us
I20260709 13:15:07.063748  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1398) took 1810 ms. Trace:
I20260709 13:15:07.116010  3047 rpcz_store.cc:276] 0709 13:15:05.252929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.913131 (+1660202us) service_pool.cc:224] Handling call
0709 13:15:06.913468 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:07.011817 (+ 98349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:07.011847 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:07.011908 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:07.011941 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.063494 (+ 51553us) spinlock_profiling.cc:243] Waited 98.1 ms on lock 0x7b540028c654. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:07.063543 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.063682 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225710848}
I20260709 13:15:07.064428  3043 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:07.009863  4561 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:15:07.031313  4569 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:07.021597  4834 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:15:07.068506  3761 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:07.103917  3194 rpcz_store.cc:276] 0709 13:15:05.933338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.723245 (+789907us) service_pool.cc:224] Handling call
0709 13:15:06.723647 (+   402us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:06.724024 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.724051 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:06.724629 (+   578us) log.cc:844] Serialized 52 byte log entry
0709 13:15:06.856354 (+131725us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:07.023341 (+166987us) log.cc:844] Serialized 14 byte log entry
0709 13:15:07.023597 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.023664 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:07.023712 (+    48us) raft_consensus.cc:1685] finished
0709 13:15:07.023725 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.024869 (+  1144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":193771,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":31557,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":6704,"thread_start_us":274844,"threads_started":2,"wal-append.queue_time_us":150741}
I20260709 13:15:07.129171  3122 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 4: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:07.009526  4830 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:07.037719  4910 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:07.129479  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 61057.4us
I20260709 13:15:07.120205  4487 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:07.047151  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 84365.1us
I20260709 13:15:07.065583  4790 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:07.123843  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:06.894798  3791 rpcz_store.cc:276] 0709 13:15:05.392614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.411827 (+ 19213us) service_pool.cc:224] Handling call
0709 13:15:05.665251 (+253424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:05.707751 (+ 42500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:05.710142 (+  2391us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:05.788989 (+ 78847us) log.cc:844] Serialized 26 byte log entry
0709 13:15:06.309427 (+520438us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:06.309721 (+   294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.327373 (+ 17652us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:06.576806 (+249433us) raft_consensus.cc:1685] finished
0709 13:15:06.576825 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.576968 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6773,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":9922,"thread_start_us":519875,"threads_started":1,"wal-append.queue_time_us":749495}
I20260709 13:15:07.071404  4696 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.088802  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1397) took 1836 ms. Trace:
I20260709 13:15:06.942968  4930 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:07.132011  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:07.069033  4940 raft_consensus.cc:697] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:07.130825  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:07.133385  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 160678us
I20260709 13:15:07.114252  4794 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:07.135815  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:15:07.192901  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 57185.5us
I20260709 13:15:07.141943  3044 rpcz_store.cc:276] 0709 13:15:05.252647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.911694 (+1659047us) service_pool.cc:224] Handling call
0709 13:15:06.961233 (+ 49539us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:07.088537 (+127304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.088741 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:07.178917  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:07.179235  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:07.162449  4936 log.cc:927] Time spent T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 13:15:07.187572  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 55163.4us
I20260709 13:15:07.199286  3091 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:07.199456  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:07.131265  4830 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:07.088650  4692 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:15:07.113886  4926 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.207404  4926 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:07.133982  4941 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:07.205235  4705 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:07.180058  4537 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:07.214849  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:07.215034  4705 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.215253  4537 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:07.215528  3117 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:15:07.215773  4537 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.218763  4858 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:07.223732  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:07.076644  4756 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:07.196713  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:07.128891  4702 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:07.165951  4715 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:07.134496  4790 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.198194  4802 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:07.204716  4930 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:07.205852  4924 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:07.251191  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.224601  3047 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:07.252517  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:07.253243  3047 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:15:07.192059  4569 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:15:07.205873  3118 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:07.230523  3125 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:15:07.197769  4893 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:07.189078  4877 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:07.239419  3049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "f20672b2852447a6bc1e137c4dd40904"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:15:07.264233  3049 raft_consensus.cc:606] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Received request to transfer leadership to TS f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:07.264732  3049 raft_consensus.cc:614] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:07.265475  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:07.237399  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 170) took 1973 ms. Trace:
W20260709 13:15:07.204478  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 73726.7us
I20260709 13:15:07.267017  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:07.267935  3194 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:07.268036  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:07.205238  4853 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:07.237813  3761 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:07.269377  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:07.269724  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 174) took 1969 ms. Trace:
I20260709 13:15:07.246369  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:07.272233  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:07.203449  4830 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:07.215610  4705 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:07.250497  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:07.219817  4923 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 13:15:07.257544  3122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 1426) took 2014 ms (client timeout 1731 ms). Trace:
W20260709 13:15:07.274745  3122 rpcz_store.cc:269] 0709 13:15:05.242867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.248247 (+  5380us) service_pool.cc:224] Handling call
0709 13:15:06.415700 (+1167453us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b5800003398. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff8353790a0 00007ff835378984 00007ff82e8f36d4 00007ff82e8f3662
0709 13:15:07.257325 (+841625us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b54000a8a54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:07.257477 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":845511936}
I20260709 13:15:07.275527  3194 raft_consensus.cc:1275] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:07.275614  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:07.276180  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 223923us
I20260709 13:15:07.201022  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:07.268196  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:07.277896  3761 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:07.278079  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 77174.9us
I20260709 13:15:07.278697  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:07.246909  4852 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:07.270188  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:07.192163  4911 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:15:07.244590  4790 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.235512  4715 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:07.271526  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:07.266827  3043 rpcz_store.cc:276] 0709 13:15:05.264359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.913417 (+1649058us) service_pool.cc:224] Handling call
0709 13:15:07.064225 (+150808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:07.118659 (+ 54434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.237150 (+118491us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54000c5650. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:07.237331 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346153856}
I20260709 13:15:07.306263  3761 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:07.270174  3048 rpcz_store.cc:276] 0709 13:15:05.299912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.035519 (+1735607us) service_pool.cc:224] Handling call
0709 13:15:07.035857 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:07.036087 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:07.131967 (+ 95880us) log.cc:844] Serialized 14 byte log entry
0709 13:15:07.269389 (+137422us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:07.269442 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:07.269496 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.269561 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.269672 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":143277,"prepare.run_cpu_time_us":185,"prepare.run_wall_time_us":866,"raft.queue_time_us":9036,"thread_start_us":208002,"threads_started":2}
I20260709 13:15:07.273399  3193 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:07.307766  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:07.278755  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:07.268839  3198 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
W20260709 13:15:07.308636  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.276217  3192 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:07.258796  3792 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:15:07.289873  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:07.299543  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:07.263844  4893 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.259285  4939 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:07.301802  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:07.306453  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:07.310842  4893 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.311201  4939 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:07.312105  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:07.313905  4939 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:07.270592  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:07.317435  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:07.321913  3200 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:15:07.239161  4696 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:07.309881  3792 pending_rounds.cc:85] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Aborting all ops after (but not including) 3
I20260709 13:15:07.284022  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:07.322369  3123 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:07.324524  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:07.324559  3090 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:07.272616  4853 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:15:07.327271  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 59820.7us
I20260709 13:15:07.339362  3164 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:07.327622  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:07.263051  4889 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:07.350904  4487 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:07.350905  3090 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:07.325949  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:07.290469  4739 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:07.352001  4487 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:07.352653  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:07.352829  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:07.353785  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:07.354329  3090 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:07.354998  4921 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:07.355440  4921 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:07.355851  4921 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:07.357192  4519 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:07.357911  4519 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:07.358285  4519 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.358637  4519 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:07.353803  4487 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:07.363207  4487 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:07.363557  4487 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:07.367331  4702 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:07.367868  4702 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:07.372355  4519 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:07.397831  3045 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:15:07.342497  3164 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:07.347652  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:07.376403  4487 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:07.399672  3049 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:07.376569  4702 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:07.384819  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:07.334208  3792 pending_rounds.cc:107] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 13:15:07.325850  4692 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:07.289706  4877 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:07.398517  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:07.418042  3043 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:07.419049  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:07.332831  3091 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:07.388818  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:07.328464  4931 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:07.413489  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:07.331408  4929 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:07.416229  4487 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:07.346704  4853 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:07.405052  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 62660.6us
W20260709 13:15:07.431695  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 104152us
I20260709 13:15:07.432052  3164 leader_election.cc:400] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3.
I20260709 13:15:07.432863  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:07.330984  4938 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.422233  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:07.438625  3043 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:07.439627  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:07.440182  3043 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:07.441004  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:07.441649  3043 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 5: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:15:07.422140  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 118553us
I20260709 13:15:07.378998  4739 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.428179  3044 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:07.429774  3049 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:07.443292  3118 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:07.443811  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:07.444617  3165 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:07.398077  4889 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:07.450100  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:07.463373  3043 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:07.410085  4835 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:07.417966  4692 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:07.457615  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.464684  3049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:55618
W20260709 13:15:07.466866  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 134094us
I20260709 13:15:07.469563  4835 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.329116  4561 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.114s
I20260709 13:15:07.418298  4914 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:07.473445  3049 raft_consensus.cc:606] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:07.479701  3049 raft_consensus.cc:614] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:07.409927  3792 raft_consensus.cc:2917] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 13:15:07.470013  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:07.428664  4931 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:07.470023  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 81329.2us
I20260709 13:15:07.482154  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:07.483729  4487 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:07.484087  4487 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:07.484486  4487 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:07.449708  4739 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.484110  3090 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:07.481696  3050 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:15:07.491811  4487 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:07.456591  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:07.493867  4487 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:07.453238  4910 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:15:07.478171  4835 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:07.552547  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1721) took 1220 ms. Trace:
I20260709 13:15:07.553198  3049 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:07.554291  3048 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:07.554649  3049 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:15:07.556033  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 71983.8us
I20260709 13:15:07.553143  3045 rpcz_store.cc:276] 0709 13:15:06.332078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.046241 (+714163us) service_pool.cc:224] Handling call
0709 13:15:07.063096 (+ 16855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:07.398319 (+335223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.552167 (+153848us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54000c6554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:07.552462 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769159424}
W20260709 13:15:07.560588  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 206871us
I20260709 13:15:07.469890  4956 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:07.478734  4911 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:07.567446  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:07.483544  4931 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:07.480041  4834 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:07.568321  3762 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:07.571838  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:07.338986  4940 consensus_queue.cc:237] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:07.418504  4715 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:07.554030  3792 raft_consensus.cc:2889] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:07.555152  4732 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:07.566797  4947 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:07.567945  4756 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:07.569559  4959 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:07.569154  4956 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.576382  4834 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.556157  4925 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:15:07.556823  4797 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:07.593147  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:07.496034  4948 log.cc:927] Time spent T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 13:15:07.577877  4923 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:07.470342  4889 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:07.566794  4960 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:07.477545  4692 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.580746  4703 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:07.594026  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 47690.1us
W20260709 13:15:07.666272  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 94612.7us
I20260709 13:15:07.809540  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:07.610100  4956 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:07.591717  4877 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:07.645956  4963 consensus_queue.cc:1059] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:15:07.479640  4914 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:07.647892  4953 log.cc:927] Time spent T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:15:07.615322  4834 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:07.600530  4959 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:07.614820  4852 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:07.615439  4519 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:07.598623  4672 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.102s
I20260709 13:15:07.647878  4941 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEARNER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:07.591229  4947 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.587420  4934 consensus_queue.cc:1059] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
W20260709 13:15:07.697633  4957 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 13:15:07.695500  4794 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:07.740850  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:07.742594  3044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b91597ece9742ebad558605a654e02a"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:55618
W20260709 13:15:07.748826  4954 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 13:15:07.751456  4797 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:07.694015  4696 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:07.835147  4959 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:07.762004  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.596561  4732 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:07.801551  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.665902  4928 consensus_queue.cc:1059] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.149s
I20260709 13:15:07.815754  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:07.820117  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:15:07.881429  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 61402.1us
I20260709 13:15:07.882124  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:07.801530  4964 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:07.808245  4923 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:07.837054  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.811996  4703 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.839404  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1720) took 1507 ms. Trace:
W20260709 13:15:07.841168  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 384666us
I20260709 13:15:07.828058  4958 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
W20260709 13:15:07.844175  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 367323us
I20260709 13:15:07.892813  3091 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:07.828299  4914 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:07.824795  4702 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:07.850198  4947 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:07.878966  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:07.879480  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 321650us
I20260709 13:15:07.857350  4794 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:07.884266  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 68625.1us
I20260709 13:15:07.817548  4877 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:07.867877  4519 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:07.888936  3046 rpcz_store.cc:276] 0709 13:15:06.331739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.038096 (+706357us) service_pool.cc:224] Handling call
0709 13:15:07.038449 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:07.038769 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:07.038793 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:07.039224 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:15:07.067282 (+ 28058us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:07.067320 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.067384 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:07.839202 (+771818us) raft_consensus.cc:1685] finished
0709 13:15:07.839222 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.839334 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":882,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":6762,"thread_start_us":27747,"threads_started":1,"wal-append.queue_time_us":88341}
I20260709 13:15:07.906344  3091 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:07.874251  4976 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:07.917261  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:07.918031  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:07.918234  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.949661  3091 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:07.919620  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:07.975591  3117 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:07.920323  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:07.877219  3794 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:15:07.920954  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:07.891662  4923 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:07.891547  4703 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:07.922063  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:07.921975  4524 consensus_queue.cc:1059] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:07.922868  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:07.923990  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:07.924578  4965 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:07.924683  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:07.925848  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:07.988858  3200 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:15:07.926113  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:07.989916  3798 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Advancing to term 3
I20260709 13:15:07.926215  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:07.889142  4972 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:07.927681  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:07.993552  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:07.921571  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:07.925371  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:07.880743  4756 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.930889  3164 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:07.929147  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:07.995368  3192 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
W20260709 13:15:07.937284  3015 connection.cc:256] RPC call timeout handler was delayed by -1.4441046280001046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
W20260709 13:15:07.995961  3015 connection.cc:256] RPC call timeout handler was delayed by -1.3730046279999897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
W20260709 13:15:07.996399  3015 connection.cc:256] RPC call timeout handler was delayed by -1.2893046280000817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
I20260709 13:15:07.886711  4964 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:07.986812  3122 raft_consensus.cc:2393] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 4: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:07.908176  4699 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:07.940026  4794 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:07.996762  3015 connection.cc:256] RPC call timeout handler was delayed by -1.2533046280000235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
I20260709 13:15:07.928515  4978 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:07.933956  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:07.989289  4797 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:07.997849  3791 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:07.990823  3091 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:08.003211  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 72399.4us
W20260709 13:15:08.002547  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 53548.9us
I20260709 13:15:07.974812  4877 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:07.995359  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:07.958010  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:08.008461  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 64835.8us
I20260709 13:15:07.974534  4519 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:07.994442  4852 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:08.015676  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:07.998044  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:08.002321  4699 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:08.042099  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:08.003005  4964 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:08.068408  3194 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:15:08.069227  4569 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:08.069597  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:08.070291  3194 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:07.947882  4984 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:08.043375  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:08.045712  3125 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:08.002683  4963 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:08.042869  3200 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:15:08.015554  4978 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:08.066962  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:08.077689  3126 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:15:08.043712  4909 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:08.002019  4982 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:08.002918  4756 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:08.018222  3164 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:07.991340  4976 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:08.079084  4893 consensus_meta.cc:287] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.768s	user 0.029s	sys 0.010s
I20260709 13:15:08.037461  4797 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:08.114552  4884 raft_consensus.cc:3055] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:08.115002  4884 raft_consensus.cc:740] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:08.115623  4797 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:08.115885  4884 consensus_queue.cc:260] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:08.117074  4872 consensus_meta.cc:287] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.004s	user 0.008s	sys 0.002s
I20260709 13:15:07.993430  4965 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:08.083719  4926 consensus_meta.cc:287] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.876s	user 0.020s	sys 0.015s
I20260709 13:15:08.072093  4699 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:08.059101  4852 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.059402  4519 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:08.073283  4935 log.cc:927] Time spent T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:15:08.113329  4893 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:08.084942  4889 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:08.122187  4732 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:08.051981  4946 consensus_queue.cc:1059] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:15:08.123625  4976 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:08.126014  4705 consensus_meta.cc:287] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.823s	user 0.010s	sys 0.009s
W20260709 13:15:08.141240  4739 consensus_meta.cc:287] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.008s
I20260709 13:15:08.079787  4978 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:08.146358  4926 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:08.152345  4971 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:15:08.146636  4852 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:08.153378  4830 consensus_meta.cc:287] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.864s	user 0.013s	sys 0.003s
I20260709 13:15:08.084656  4982 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.153795  4830 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:08.139250  4786 consensus_meta.cc:287] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.016s	user 0.008s	sys 0.003s
I20260709 13:15:08.154633  4786 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:08.156652  4786 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:08.125672  4938 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.676s	user 0.013s	sys 0.017s
I20260709 13:15:08.158106  4938 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:08.160261  4893 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:08.141358  4931 consensus_meta.cc:287] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.008s
I20260709 13:15:08.160950  4931 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:08.161484  4794 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:08.162487  4974 raft_consensus.cc:3055] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:08.162884  4974 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:08.163170  4931 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:08.140861  4872 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:08.163723  4974 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:08.164815  4974 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:08.165675  4872 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:08.166031  4852 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:08.167758  4830 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:08.154135  4982 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:08.117218  4884 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:08.161332  4930 consensus_meta.cc:287] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.905s	user 0.007s	sys 0.001s
W20260709 13:15:08.150847  4985 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:15:08.172343  4926 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:08.175325  4965 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:08.179925  4955 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.713s	user 0.006s	sys 0.000s
W20260709 13:15:08.005401  3015 connection.cc:256] RPC call timeout handler was delayed by -1.1373580259999017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 13:15:08.215426  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0626580260000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 13:15:08.216271  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0626580260000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
I20260709 13:15:08.215960  3043 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:15:08.216741  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0248580259999471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
I20260709 13:15:08.220580  3042 raft_consensus.cc:2393] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 5: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:08.233353  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:08.235045  3050 raft_consensus.cc:2368] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4.
I20260709 13:15:08.242806  3118 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:08.243046  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1735) took 1008 ms. Trace:
W20260709 13:15:08.243353  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 227551us
I20260709 13:15:08.243813  3043 rpcz_store.cc:276] 0709 13:15:07.234589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.547917 (+313328us) service_pool.cc:224] Handling call
0709 13:15:07.548405 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:08.217046 (+668641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:08.242606 (+ 25560us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b540029ca54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:08.242971 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1532398336}
I20260709 13:15:08.079231  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:08.073345  3122 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:15:08.131881  3194 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:08.080508  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:08.129702  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 70084.1us
I20260709 13:15:08.022321  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:08.307233  3790 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:08.157219  4739 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:08.341133  4715 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:08.246660  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:08.259588  3191 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
W20260709 13:15:08.143288  4537 consensus_meta.cc:287] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.927s	user 0.008s	sys 0.004s
W20260709 13:15:08.266491  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.268442  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:08.345191  3049 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:08.346079  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 78060.6us
I20260709 13:15:08.245487  3090 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:08.278959  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:08.286170  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1723) took 1943 ms. Trace:
W20260709 13:15:08.161401  4790 consensus_meta.cc:287] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.839s	user 0.012s	sys 0.006s
I20260709 13:15:08.163594  4794 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:08.311103  4909 raft_consensus.cc:697] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:08.316445  3200 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:08.325650  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:08.330386  4946 raft_consensus.cc:3055] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:08.373194  4852 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:08.351683  3798 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEARNER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:08.355682  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:15:08.357519  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 339232us
I20260709 13:15:08.311437  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:08.342949  3191 pending_rounds.cc:85] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 2
I20260709 13:15:08.373299  4946 raft_consensus.cc:740] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:08.354084  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 186) took 1076 ms. Trace:
W20260709 13:15:08.380189  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 84732.5us
I20260709 13:15:08.379417  4537 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:08.391310  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:08.382509  3091 leader_election.cc:400] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4.
I20260709 13:15:08.384032  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:08.399501  3091 leader_election.cc:403] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:15:08.375507  3191 pending_rounds.cc:107] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:15:08.400503  3191 raft_consensus.cc:2889] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:08.405349  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 49910.3us
I20260709 13:15:08.383216  4760 raft_consensus.cc:3055] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:08.415628  4786 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:08.416442  4537 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:08.418111  3043 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:15:08.417883  4705 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:08.419467  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 174408us
I20260709 13:15:08.420855  4705 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:08.421284  3048 raft_consensus.cc:1240] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:08.422417  4739 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:08.348294  3051 rpcz_store.cc:276] 0709 13:15:06.342921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.053873 (+710952us) service_pool.cc:224] Handling call
0709 13:15:07.054202 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:07.065794 (+ 11592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:07.065834 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:07.112816 (+ 46982us) log.cc:844] Serialized 26 byte log entry
0709 13:15:07.258813 (+145997us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:07.286619 (+ 27806us) log.cc:844] Serialized 14 byte log entry
0709 13:15:07.286913 (+   294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.287019 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:08.177822 (+890803us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:08.285418 (+107596us) raft_consensus.cc:1685] finished
0709 13:15:08.285581 (+   163us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:08.285906 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7540,"prepare.queue_time_us":31587,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":2875,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":3393,"spinlock_wait_cycles":3579008,"thread_start_us":78975,"threads_started":1,"wal-append.queue_time_us":210671}
I20260709 13:15:08.422271  4946 consensus_queue.cc:260] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:08.414315  4760 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:08.423910  3126 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 4: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:08.423751  3090 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:08.424114  4946 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:08.424760  3197 raft_consensus.cc:2393] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:08.425751  3200 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:08.419632  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:08.431871  4487 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:08.404166  4703 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:08.381660  4964 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:08.433658  4976 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:08.439015  4976 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:08.439643  4976 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:08.447963  3164 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:08.448365  4961 consensus_queue.cc:1059] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:08.453608  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:08.460052  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 77892.3us
I20260709 13:15:08.452411  4732 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:08.465698  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.466037  4943 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:08.465960  4909 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:08.377405  3193 rpcz_store.cc:276] 0709 13:15:07.277401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.307911 (+ 30510us) service_pool.cc:224] Handling call
0709 13:15:07.318133 (+ 10222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:07.321310 (+  3177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:07.321341 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:07.328590 (+  7249us) log.cc:844] Serialized 26 byte log entry
0709 13:15:07.654093 (+325503us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:07.696909 (+ 42816us) log.cc:844] Serialized 14 byte log entry
0709 13:15:07.797335 (+100426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.797589 (+   254us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:08.292210 (+494621us) raft_consensus.cc:1685] finished
0709 13:15:08.296198 (+  3988us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:08.353846 (+ 57648us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":208491,"prepare.queue_time_us":42586,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":249335,"raft.run_cpu_time_us":403,"raft.run_wall_time_us":99675,"thread_start_us":240967,"threads_started":1,"wal-append.queue_time_us":448572}
I20260709 13:15:08.433105  4705 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:08.473408  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:08.472028  4672 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:08.476554  4910 raft_consensus.cc:3055] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:08.478619  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:08.486120  3043 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:08.427821  4760 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:08.499503  4998 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.156s	user 0.001s	sys 0.001s
I20260709 13:15:08.480647  4910 raft_consensus.cc:740] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:08.505386  3045 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:08.506438  4703 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:08.506313  4519 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:08.509858  4921 consensus_meta.cc:287] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.147s	user 0.009s	sys 0.030s
W20260709 13:15:08.514966  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 55184.7us
I20260709 13:15:08.517412  4910 consensus_queue.cc:260] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:08.519101  5008 consensus_queue.cc:1059] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:08.488148  4991 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:15:08.525061  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:08.519686  4910 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:08.510592  4921 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:08.506438  4790 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:08.558373  4893 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:08.567421  4830 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:15:08.569083  5006 log.cc:927] Time spent T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:15:08.558637  4956 consensus_meta.cc:287] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.689s	user 0.009s	sys 0.008s
W20260709 13:15:08.577062  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 99683.3us
I20260709 13:15:08.517478  4978 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:08.576177  3120 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
W20260709 13:15:08.589879  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 124280us
I20260709 13:15:08.588260  3050 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:08.595350  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:08.603062  4834 consensus_meta.cc:287] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.763s	user 0.013s	sys 0.005s
I20260709 13:15:08.603564  4834 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:08.610334  3046 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:08.614856  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:08.596953  4964 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:08.586354  4830 raft_consensus.cc:697] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:08.622378  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:08.628085  3050 raft_consensus.cc:2393] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 5: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:08.628993  3125 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:08.620265  4519 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:08.625707  4834 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:08.640175  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:08.600801  4956 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:08.638077  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:15:08.648391  5005 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:15:08.649577  4830 consensus_queue.cc:237] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:08.660061  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:08.613013  4893 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:08.660784  4877 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:08.677906  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.678579  4921 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:08.680240  4703 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:08.694403  3124 raft_consensus.cc:2368] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3.
I20260709 13:15:08.695564  4790 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:08.697484  4947 consensus_meta.cc:287] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.723s	user 0.012s	sys 0.000s
W20260709 13:15:08.706591  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 109441us
I20260709 13:15:08.713830  3120 raft_consensus.cc:2393] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 4: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:08.718405  4519 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:08.718567  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 52656.4us
I20260709 13:15:08.718978  4519 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:08.719398  4519 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:08.719535  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:08.720525  4941 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:08.721223  4941 consensus_queue.cc:1059] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:08.721670  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:08.722194  4561 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:08.722076  4944 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:08.725075  4944 raft_consensus.cc:3055] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:08.725421  4944 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:08.726384  4944 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:08.727265  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1739) took 1458 ms. Trace:
I20260709 13:15:08.727648  3049 rpcz_store.cc:276] 0709 13:15:07.268862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.555306 (+286444us) service_pool.cc:224] Handling call
0709 13:15:07.555539 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:08.345884 (+790345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:08.726985 (+381101us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b5400474fd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:08.727205 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1810210048}
W20260709 13:15:08.729501  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:08.723269  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 109670us
I20260709 13:15:08.733916  3049 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:08.727630  4944 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:08.733306  4982 consensus_meta.cc:287] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.559s	user 0.012s	sys 0.002s
I20260709 13:15:08.701090  4978 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:08.729154  4976 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:08.745615  4487 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:08.763507  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:08.763487  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:08.723325  4941 raft_consensus.cc:3055] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:08.735674  4947 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:08.770133  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:08.770864  4947 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:08.772665  4884 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:08.773128  4884 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:08.773557  4884 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:08.770916  3042 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:08.781587  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:08.783540  3050 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:15:08.781855  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 46713us
I20260709 13:15:08.766680  4956 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:08.743503  4982 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:08.779045  4941 raft_consensus.cc:740] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:15:08.806258  4974 consensus_meta.cc:287] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.006s
I20260709 13:15:08.810554  4982 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:08.788061  4947 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:08.811571  4947 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:08.801797  4943 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4.
I20260709 13:15:08.815671  4976 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:08.817960  4914 consensus_meta.cc:287] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.860s	user 0.004s	sys 0.008s
I20260709 13:15:08.818429  4914 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:08.820601  4914 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:08.826612  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:08.827662  3200 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:15:08.828866  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:08.834290  3049 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:08.842783  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:08.843014  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:08.777691  4561 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.844537  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:08.844458  4561 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:08.846201  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:08.846894  4561 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:08.847472  4561 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:08.848196  3791 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEARNER]: Advancing to term 4
I20260709 13:15:08.847851  4941 consensus_queue.cc:260] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:08.849367  4941 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:08.850853  4786 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:08.852097  3195 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:08.854171  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:15:08.855038  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 59215.6us
I20260709 13:15:08.857337  4877 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:08.859534  3199 raft_consensus.cc:2410] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:15:08.860824  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:08.861248  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.862201  3193 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
W20260709 13:15:08.862547  4923 consensus_meta.cc:287] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.860s	user 0.005s	sys 0.006s
I20260709 13:15:08.863058  4923 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:08.864326  3047 raft_consensus.cc:2393] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:08.865058  4705 raft_consensus.cc:3055] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:08.863404  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:08.862555  3193 pending_rounds.cc:85] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 2
I20260709 13:15:08.866228  3193 pending_rounds.cc:107] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:15:08.866484  3193 raft_consensus.cc:2889] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:08.861340  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:08.872613  3045 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:08.872833  3194 raft_consensus.cc:2368] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4.
I20260709 13:15:08.872810  3042 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:08.873989  4940 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.874511  4940 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:08.876175  4692 consensus_meta.cc:287] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.050s	user 0.010s	sys 0.012s
I20260709 13:15:08.876838  4940 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:08.876724  4692 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:08.877466  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:08.877586  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:08.878827  3044 raft_consensus.cc:606] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:08.879244  3044 raft_consensus.cc:614] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:08.865417  4705 raft_consensus.cc:740] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:08.880492  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 178) took 1618 ms. Trace:
I20260709 13:15:08.881330  4705 consensus_queue.cc:260] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:08.880836  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:08.882684  4705 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:08.882720  3045 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:08.880896  3048 rpcz_store.cc:276] 0709 13:15:07.262141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.555046 (+292905us) service_pool.cc:224] Handling call
0709 13:15:07.555282 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:08.421861 (+866579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:08.880205 (+458344us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b54003c4bd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:08.880431 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1965675392}
I20260709 13:15:08.885651  3791 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEARNER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:08.901255  3045 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:08.848030  4561 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:08.868467  4947 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:08.903609  3199 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:08.916671  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:08.887306  4976 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:08.932339  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:08.930541  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:08.933218  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:08.930122  4923 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:08.920306  4835 consensus_meta.cc:287] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.194s	user 0.006s	sys 0.017s
I20260709 13:15:08.935915  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:08.934393  3045 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:15:08.931404  4946 consensus_meta.cc:287] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.002s
I20260709 13:15:08.947119  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:08.920917  4976 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:08.951247  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:08.922786  4692 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:08.956903  4959 consensus_meta.cc:287] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.999s	user 0.006s	sys 0.011s
I20260709 13:15:08.957085  3126 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:15:08.957412  4959 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:08.958158  3124 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:08.959697  4959 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:08.960391  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55618 (request call id 12) took 1361 ms. Trace:
I20260709 13:15:08.960968  3192 raft_consensus.cc:1240] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:08.962481  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:08.963052  4732 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:08.963325  3796 raft_consensus.cc:2393] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:08.963510  4732 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:08.964679  3197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34728 (request call id 180) took 1689 ms (client timeout 2129 ms). Trace:
I20260709 13:15:08.965327  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:08.966316  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:08.966516  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:08.968552  2947 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49738 (request call id 145) took 8307 ms. Trace:
I20260709 13:15:08.956960  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:08.973518  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:08.974459  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:08.975253  3200 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:08.976390  3122 raft_consensus.cc:1240] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:08.979249  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:08.979775  4760 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.980054  3120 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:08.982470  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1394) took 1031 ms. Trace:
I20260709 13:15:08.982602  4519 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:08.983763  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:08.984863  4519 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:08.985945  4978 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:08.986950  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:08.987432  4756 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:08.987771  3124 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 4: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:08.988222  4739 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:08.989427  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 181) took 1014 ms. Trace:
W20260709 13:15:08.965118  3197 rpcz_store.cc:269] 0709 13:15:07.275331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.289574 (+ 14243us) service_pool.cc:224] Handling call
0709 13:15:08.964457 (+1674883us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b5400177854. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:08.964608 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2170189184}
I20260709 13:15:08.989794  3046 rpcz_store.cc:276] 0709 13:15:07.975084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.223701 (+248617us) service_pool.cc:224] Handling call
0709 13:15:08.224202 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:08.610811 (+386609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:08.989211 (+378400us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b5400074754. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:08.989375 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843134720}
I20260709 13:15:08.990988  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:08.991426  3046 raft_consensus.cc:1240] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:08.995294  5015 log.cc:927] Time spent T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.338s	user 0.000s	sys 0.003s
I20260709 13:15:08.996151  4893 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:08.986143  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:08.999357  3047 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 3. Ops: []
I20260709 13:15:09.000356  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:08.998154  4699 consensus_meta.cc:287] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.663s	user 0.008s	sys 0.004s
I20260709 13:15:08.999644  3197 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
W20260709 13:15:08.958218  4853 consensus_meta.cc:287] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.313s	user 0.023s	sys 0.007s
I20260709 13:15:09.019590  3121 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:15:09.019381  4853 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:09.021910  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:09.022419  3196 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:09.022282  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:09.023356  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:08.960783  3044 rpcz_store.cc:276] 0709 13:15:07.599125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.742399 (+143274us) service_pool.cc:224] Handling call
0709 13:15:08.960107 (+1217708us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540028df54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303ad853 00007ff83537b60a 00007ff82e9017d4 00007ff82e901762 00007ff82e901691 00007ff82e90160c 00007ff82e9008c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:08.960266 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2302315392}
I20260709 13:15:08.950109  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:08.989908  3790 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:08.993211  4884 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:09.016041  3164 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:08.954581  4976 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.017491  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:09.018220  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:09.018523  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:08.982887  3198 rpcz_store.cc:276] 0709 13:15:07.951503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.000115 (+ 48612us) service_pool.cc:224] Handling call
0709 13:15:08.000471 (+   356us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:08.428493 (+428022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:08.432330 (+  3837us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:08.470283 (+ 37953us) log.cc:844] Serialized 52 byte log entry
0709 13:15:08.623086 (+152803us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:08.688027 (+ 64941us) log.cc:844] Serialized 14 byte log entry
0709 13:15:08.688528 (+   501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:08.981896 (+293368us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b5400178c54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:08.981958 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:08.982030 (+    72us) raft_consensus.cc:1685] finished
0709 13:15:08.982146 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:08.982296 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110565,"prepare.queue_time_us":47041,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":60,"raft.queue_time_us":83813,"raft.run_cpu_time_us":427,"raft.run_wall_time_us":27796,"spinlock_wait_cycles":579139328,"thread_start_us":112166,"threads_started":1,"wal-append.queue_time_us":285088}
I20260709 13:15:08.972880  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:09.030571  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:09.039026  3117 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.039906  3120 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:08.985512  4519 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:15:09.002894  4561 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:09.038442  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:08.987432  4978 consensus_queue.cc:1059] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:15:09.033612  4853 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:09.046170  3796 raft_consensus.cc:2410] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:09.047286  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:09.048485  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:08.972891  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:09.052639  4910 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:09.053418  4910 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:09.055907  3791 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 4: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:09.056506  3121 raft_consensus.cc:1240] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:09.046082  4884 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:09.059274  3796 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:15:09.045312  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:09.059873  3200 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:09.059963  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:09.072506  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:09.087800  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:09.089643  3126 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:09.092136  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:09.058329  4893 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:08.955710  4835 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:09.023483  4699 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:09.098505  3794 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 4: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:09.098573  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 191) took 1168 ms. Trace:
I20260709 13:15:09.099098  3192 rpcz_store.cc:276] 0709 13:15:07.930222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.996097 (+ 65875us) service_pool.cc:224] Handling call
0709 13:15:07.996461 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:08.961386 (+964925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:09.098282 (+136896us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b54001b85d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:09.098487 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2217331584}
I20260709 13:15:09.099841  4699 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:09.100244  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:09.099875  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:09.102077  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:09.102347  3120 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:09.103453  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:09.105448  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:09.106063  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.108250  4914 consensus_queue.cc:1059] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:09.108609  4944 consensus_queue.cc:1059] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:09.109273  4914 consensus_queue.cc:1059] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:09.109555  4944 consensus_queue.cc:1059] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:09.110497  4914 raft_consensus.cc:3055] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:09.110703  4944 raft_consensus.cc:3055] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:09.110947  4914 raft_consensus.cc:740] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:09.111330  4794 raft_consensus.cc:3055] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:09.111574  4877 raft_consensus.cc:3055] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:09.111786  4794 raft_consensus.cc:740] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:09.112012  4877 raft_consensus.cc:740] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:09.112841  4794 consensus_queue.cc:260] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:09.096839  3122 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 2: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:09.112571  4914 consensus_queue.cc:260] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:09.112861  4877 consensus_queue.cc:260] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:09.101552  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:09.111207  4944 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:09.117028  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:09.118289  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1652) took 1843 ms. Trace:
I20260709 13:15:09.119647  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 192) took 1189 ms. Trace:
I20260709 13:15:09.127043  4519 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:09.126883  3049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:15:09.126951  3795 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:09.128409  3120 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:09.235112  3196 rpcz_store.cc:276] 0709 13:15:07.930530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.999988 (+ 69458us) service_pool.cc:224] Handling call
0709 13:15:08.000233 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:09.022894 (+1022661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:09.119362 (+ 96468us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540013ced4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:09.119592 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2349934848}
I20260709 13:15:09.133628  4835 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:09.134106  4958 raft_consensus.cc:3055] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:09.096132  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:09.137624  3117 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:09.146463  3799 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:09.097405  4893 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.968946  2947 rpcz_store.cc:276] 0709 13:15:00.661108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.666264 (+  5156us) service_pool.cc:224] Handling call
0709 13:15:08.968306 (+8302042us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:07.274363 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:07.546414 (+272051us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:07.553306 (+  6892us) write_op.cc:435] Acquired schema lock
0709 13:15:07.560307 (+  7001us) tablet.cc:662] Decoding operations
0709 13:15:07.738749 (+178442us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:07.796286 (+ 57537us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:07.802177 (+  5891us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:15:07.866296 (+ 64119us) tablet.cc:701] Row locks acquired
0709 13:15:07.869364 (+  3068us) write_op.cc:260] PREPARE: finished
0709 13:15:07.881258 (+ 11894us) write_op.cc:270] Start()
0709 13:15:07.890901 (+  9643us) write_op.cc:276] Timestamp: P: 1783602907881195 usec, L: 0
0709 13:15:07.905876 (+ 14975us) op_driver.cc:348] REPLICATION: starting
0709 13:15:08.044328 (+138452us) log.cc:844] Serialized 1686 byte log entry
0709 13:15:08.183108 (+138780us) op_driver.cc:464] REPLICATION: finished
0709 13:15:08.184461 (+  1353us) write_op.cc:301] APPLY: starting
0709 13:15:08.184545 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:08.184713 (+   168us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:08.184849 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:08.269426 (+ 84577us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:08.270095 (+   669us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:15:08.270244 (+   149us) write_op.cc:312] APPLY: finished
0709 13:15:08.271731 (+  1487us) log.cc:844] Serialized 41 byte log entry
0709 13:15:08.299111 (+ 27380us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:08.377520 (+ 78409us) write_op.cc:454] Released schema lock
0709 13:15:08.399002 (+ 21482us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:08.477577 (+ 78575us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:08.479168 (+  1591us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":33394,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":1097,"apply.run_cpu_time_us":4657,"apply.run_wall_time_us":250710,"num_ops":4,"prepare.queue_time_us":188856,"prepare.run_cpu_time_us":15422,"prepare.run_wall_time_us":886266,"raft.queue_time_us":31260,"raft.run_cpu_time_us":1310,"raft.run_wall_time_us":1310,"replication_time_us":277070,"spinlock_wait_cycles":184576,"thread_start_us":205624,"threads_started":4,"wal-append.queue_time_us":93427}]]}
I20260709 13:15:09.174057  3119 raft_consensus.cc:2368] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3.
I20260709 13:15:09.173017  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:09.242573  3122 raft_consensus.cc:2410] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:09.140193  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:09.185940  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.141112  3123 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:09.192404  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:09.174861  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:09.197698  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:09.202909  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:09.245805  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.199280  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:09.207826  3090 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:09.208853  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:09.246935  3124 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 5: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:09.209677  3797 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:09.222540  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:09.209347  4914 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.257423  3200 raft_consensus.cc:2368] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4.
I20260709 13:15:09.227026  3043 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:09.228206  3044 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:09.230304  3164 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:09.228866  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:09.169173  4732 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:09.236637  3049 raft_consensus.cc:606] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:09.260411  3049 raft_consensus.cc:614] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:09.261474  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:09.262423  3126 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:09.236691  3192 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:09.234282  3191 rpcz_store.cc:276] 0709 13:15:07.274725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.274844 (+   119us) service_pool.cc:224] Handling call
0709 13:15:07.275115 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:08.422072 (+1146957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:09.118025 (+695953us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b5400178754. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:09.118232 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2250523520}
I20260709 13:15:09.130695  3793 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:09.197827  4794 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:09.257658  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:09.227708  5018 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:15:09.266410  3198 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:09.261381  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:09.269979  3048 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:09.268275  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:09.274899  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 53069.1us
I20260709 13:15:09.277837  3121 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:15:09.277165  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 172438us
I20260709 13:15:09.279237  3051 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:15:09.275909  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:09.244278  4893 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.284245  3046 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:09.284868  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.287957  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:09.288332  3197 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.288812  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:09.241051  4958 raft_consensus.cc:740] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:09.244001  4923 raft_consensus.cc:3055] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:09.290961  3196 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:09.291108  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.287801  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:09.287655  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:09.297048  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 156947us
I20260709 13:15:09.299824  3761 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:09.307032  4979 consensus_queue.cc:1059] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:09.310177  3191 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:09.310702  4519 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:09.311266  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:09.312032  3191 raft_consensus.cc:2393] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:09.312225  4858 consensus_queue.cc:1059] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:15:09.312860  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:09.313176  4858 raft_consensus.cc:3055] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:09.309841  4941 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:09.316603  3119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 1450) took 1402 ms (client timeout 1829 ms). Trace:
I20260709 13:15:09.314288  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:09.318905  3119 rpcz_store.cc:269] 0709 13:15:07.914572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.917009 (+  2437us) service_pool.cc:224] Handling call
0709 13:15:09.316382 (+1399373us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540010de54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:09.316534 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2677137280}
I20260709 13:15:09.319279  3192 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:09.314003  4569 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:09.313534  3191 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.336578  3042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:15:09.337205  3042 raft_consensus.cc:606] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:09.337536  3042 raft_consensus.cc:614] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:15:09.327646  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 46524.8us
W20260709 13:15:09.314392  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 119993us
W20260709 13:15:09.358417  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 58661.1us
I20260709 13:15:09.364856  3196 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:09.286494  4877 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:09.333441  4739 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:09.371645  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:09.291909  4561 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:09.397464  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:09.313587  4858 raft_consensus.cc:740] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:15:09.403101  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 127270us
W20260709 13:15:09.405164  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.425452  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:09.295050  4923 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:15:09.429320  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 54757us
I20260709 13:15:09.401801  4739 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:09.431120  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:09.432351  4739 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:09.397148  5022 log.cc:927] Time spent T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:15:09.370177  4974 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:09.436837  3165 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:09.396658  4921 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:09.448654  3091 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:09.404294  4561 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:09.455878  3091 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:09.462028  3048 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:09.438623  4830 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.330505  4944 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:09.451867  4739 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:09.373286  4937 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:15:09.457854  4561 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:09.481850  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.373699  4569 consensus_queue.cc:1059] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:15:09.462078  4703 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:09.482981  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:09.463624  4756 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:09.487165  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:09.485322  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 78982.4us
I20260709 13:15:09.492592  4853 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:09.453642  4978 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:15:09.460332  4958 consensus_queue.cc:260] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:09.494803  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:09.496187  3199 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:09.473018  4943 consensus_queue.cc:1059] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:15:09.478034  4692 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:09.473996  4519 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:09.501629  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:09.452455  4982 consensus_queue.cc:1059] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:15:09.524858  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:09.530329  3165 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:09.536119  3192 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:09.491963  4944 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.538767  4982 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:09.574505  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:09.548986  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 54321.5us
I20260709 13:15:09.490934  4732 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:09.549922  4692 raft_consensus.cc:697] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:09.554195  4705 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:09.554739  4569 raft_consensus.cc:3055] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:09.528786  4853 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:09.523820  4943 consensus_queue.cc:1243] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:09.557860  4978 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:09.533648  4959 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:09.560046  4976 consensus_meta.cc:287] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.001s
I20260709 13:15:09.561522  4756 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:09.562004  4947 consensus_queue.cc:1059] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:09.566475  4941 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:09.502760  4835 consensus_queue.cc:1059] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
W20260709 13:15:09.573647  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 71717.5us
I20260709 13:15:09.568893  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:09.544181  4802 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:15:09.578058  3191 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:09.579900  3197 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:09.569235  4958 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:09.593771  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.485927  4923 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:09.582180  4569 raft_consensus.cc:740] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:09.623948  3165 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:09.628695  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 59896.2us
I20260709 13:15:09.585904  4561 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:09.585209  3791 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.025s	sys 0.069s
I20260709 13:15:09.597479  4756 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:09.639750  3090 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:09.639905  3791 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.025s	sys 0.070s
W20260709 13:15:09.665027  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 81179.9us
I20260709 13:15:09.635365  4760 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:09.665119  3165 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:09.595760  4853 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:09.665983  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:09.612215  4976 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:09.641939  4756 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:09.682714  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 53088.2us
I20260709 13:15:09.683621  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:09.594146  4858 consensus_queue.cc:260] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:09.687712  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:09.686544  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 125593us
I20260709 13:15:09.698174  3198 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
W20260709 13:15:09.703775  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.685986  4760 raft_consensus.cc:697] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:09.716800  4739 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:09.698393  4802 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:09.697718  4569 consensus_queue.cc:260] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:09.720031  4569 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:09.722856  4760 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:09.716941  4893 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:09.731397  4941 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.732120  4941 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:09.738729  5030 log.cc:927] Time spent T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:15:09.728196  4893 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:09.761303  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 237068us
I20260709 13:15:09.700505  4978 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:09.700220  4786 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:09.767567  3091 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:09.782210  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.762398  4943 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:15:09.768846  4914 consensus_meta.cc:287] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.505s	user 0.003s	sys 0.010s
I20260709 13:15:09.798028  3199 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3. Ops: []
W20260709 13:15:09.803591  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.811214  3044 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:15:09.761076  4802 raft_consensus.cc:697] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:09.767195  4853 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:09.823939  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.697091  4692 consensus_queue.cc:237] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:09.830489  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:09.831498  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:09.840721  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.791857  4703 raft_consensus.cc:697] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:09.794467  4978 raft_consensus.cc:697] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:15:09.846412  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 181370us
I20260709 13:15:09.846554  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1664) took 1018 ms. Trace:
I20260709 13:15:09.849192  3193 rpcz_store.cc:276] 0709 13:15:08.828096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.004262 (+176166us) service_pool.cc:224] Handling call
0709 13:15:09.037699 (+ 33437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:09.108694 (+ 70995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:09.108734 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:09.109263 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:15:09.459845 (+350582us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:09.459893 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:09.459963 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:09.846309 (+386346us) raft_consensus.cc:1685] finished
0709 13:15:09.846337 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:09.846480 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3714,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":140,"thread_start_us":350174,"threads_started":1,"wal-append.queue_time_us":465168}
I20260709 13:15:09.772322  4835 consensus_queue.cc:1059] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:15:09.817672  5041 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:09.854485  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:09.822906  4561 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:09.854873  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 152040us
W20260709 13:15:09.866139  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.853469  4739 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:09.871824  4739 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.872394  4739 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:09.872561  4561 consensus_queue.cc:1059] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:09.872809  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:09.873131  4703 consensus_queue.cc:237] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:09.873806  4561 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:09.874449  4561 consensus_queue.cc:1243] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:15:09.874940  4561 raft_consensus.cc:3055] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:09.875237  4561 raft_consensus.cc:740] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:09.875624  4732 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:09.877046  4976 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:09.878090  5041 raft_consensus.cc:697] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:09.878422  4947 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:09.879204  4947 raft_consensus.cc:3055] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:09.879645  4947 raft_consensus.cc:740] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:09.880519  4947 consensus_queue.cc:260] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:09.853282  5044 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:09.879107  5041 consensus_queue.cc:237] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:09.878494  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.869167  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:09.885635  3164 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:09.856173  5047 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:09.898988  3044 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:15:09.909987  3165 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:09.847553  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 162592us
W20260709 13:15:09.882326  5036 log.cc:927] Time spent T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:15:09.919688  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:09.881712  4947 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.891791  5042 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.921686  5043 raft_consensus.cc:3055] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:09.934245  5043 raft_consensus.cc:740] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:09.935379  5043 consensus_queue.cc:260] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:09.936987  5043 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.938227  4802 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:09.944394  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:09.946064  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:09.946161  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:09.946877  3118 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:15:09.933264  5042 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:09.926169  3119 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:09.927589  5044 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:09.928829  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:09.929536  5049 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:09.913880  4941 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:09.930653  4978 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:09.962571  4937 raft_consensus.cc:3055] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:09.962999  4937 raft_consensus.cc:740] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:09.963788  4937 consensus_queue.cc:260] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:09.964838  4937 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:09.931393  5035 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:15:09.932709  4853 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:09.954020  3761 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:09.876166  4561 consensus_queue.cc:260] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:09.930510  5034 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:15:09.957334  3790 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:09.956163  5044 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:09.987408  5044 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:09.988538  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:09.992103  4830 consensus_meta.cc:287] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.002s
I20260709 13:15:09.958106  5039 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.959179  3791 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:09.955814  4893 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:09.955471  4976 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.961998  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:09.962579  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:09.967309  4853 raft_consensus.cc:697] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:09.985666  4941 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:09.991930  5051 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:09.958418  5042 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:10.009059  3121 raft_consensus.cc:1240] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:09.993500  3165 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:09.996724  5039 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:09.999019  4561 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:10.007195  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 45353.2us
W20260709 13:15:10.007226  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 44711.4us
I20260709 13:15:09.994514  4830 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:09.992264  4756 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:09.995051  5049 raft_consensus.cc:697] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:09.996968  4893 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:10.011524  5047 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:10.023451  4910 raft_consensus.cc:2764] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:15:10.003261  4941 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.031863  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:10.042419  3126 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:10.042500  3795 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:10.043483  5051 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:10.044226  4923 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:10.045245  3044 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:10.045892  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.046625  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:10.047400  3042 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:10.047827  5055 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:10.048923  5055 consensus_queue.cc:1059] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:10.049852  4692 raft_consensus.cc:3055] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:10.050309  4692 raft_consensus.cc:740] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:10.049990  4853 consensus_queue.cc:237] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:10.051172  4692 consensus_queue.cc:260] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:10.038515  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1427) took 1009 ms. Trace:
I20260709 13:15:10.040145  4946 raft_consensus.cc:3055] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:10.044023  5051 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:10.038300  3121 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:10.020725  4964 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:10.035560  3165 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:10.056524  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:10.063621  3118 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.054569  3125 rpcz_store.cc:276] 0709 13:15:09.020734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.087943 (+ 67209us) service_pool.cc:224] Handling call
0709 13:15:09.100270 (+ 12327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:09.172441 (+ 72171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:09.172471 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:09.207839 (+ 35368us) log.cc:844] Serialized 26 byte log entry
0709 13:15:09.672109 (+464270us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:09.848081 (+175972us) log.cc:844] Serialized 14 byte log entry
0709 13:15:09.908365 (+ 60284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:09.909090 (+   725us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:10.030420 (+121330us) raft_consensus.cc:1685] finished
0709 13:15:10.030441 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:10.030585 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81879,"prepare.queue_time_us":268024,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":155889,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":6692,"thread_start_us":603456,"threads_started":2,"wal-append.queue_time_us":546939}
I20260709 13:15:10.036446  4893 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.005635  4739 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:10.053406  4941 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:10.025130  4794 consensus_queue.cc:1059] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:15:10.057363  4946 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:10.063166  4964 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.088970  4964 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:10.092384  3118 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:15:10.072795  5008 raft_consensus.cc:3055] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:10.094372  5008 raft_consensus.cc:740] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:10.095451  5008 consensus_queue.cc:260] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:10.096876  5008 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:10.098074  5049 consensus_queue.cc:237] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:10.068970  4692 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:10.105967  5042 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.106571  5042 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:10.079205  5047 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:10.109472  5047 raft_consensus.cc:697] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:10.110625  5047 consensus_queue.cc:237] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:10.114280  4756 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:10.117868  4959 raft_consensus.cc:3055] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:10.118435  4959 raft_consensus.cc:740] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:10.119426  4959 consensus_queue.cc:260] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:10.121889  5034 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:15:10.125330  4858 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:10.125607  5042 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:10.125877  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:10.126839  3795 raft_consensus.cc:2410] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:10.129288  4976 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:10.131127  3791 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:10.081650  3015 leader_election.cc:400] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3.
I20260709 13:15:10.146572  3015 leader_election.cc:403] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:10.083101  5039 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:10.085513  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 50051.7us
I20260709 13:15:10.087507  4884 raft_consensus.cc:3055] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:10.088415  4877 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.139806  3091 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:10.153067  3042 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 13:15:10.156137  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 78107.8us
I20260709 13:15:10.162279  3015 leader_election.cc:400] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3.
I20260709 13:15:10.162726  3015 leader_election.cc:403] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:10.172578  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:10.155102  4884 raft_consensus.cc:740] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:10.150636  5044 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:10.171783  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:10.182894  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 152721us
I20260709 13:15:10.183656  4943 raft_consensus.cc:697] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:10.170773  4976 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3.
W20260709 13:15:10.215396  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:10.216064  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 53992.6us
W20260709 13:15:10.217391  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.220983  3164 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:10.174641  5057 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:10.230623  5061 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:15:10.230808  3048 raft_consensus.cc:2410] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:10.235860  3118 raft_consensus.cc:1240] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:15:10.241542  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.120811  4959 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:10.171053  4877 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:10.222501  5058 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.109s	user 0.002s	sys 0.000s
I20260709 13:15:10.271255  4884 consensus_queue.cc:260] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:10.272660  4884 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:10.246121  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 84475.8us
I20260709 13:15:10.247169  4739 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:10.246779  4943 consensus_queue.cc:237] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:10.274720  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:10.275336  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:10.276173  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.247792  5063 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:10.257340  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:10.254531  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:10.277752  3192 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:10.250183  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:10.251546  4941 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:10.222719  4756 consensus_queue.cc:1059] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:15:10.253548  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:10.253813  3165 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:10.254503  3199 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.254732  3794 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:10.255577  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:10.256625  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:10.257006  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:10.258033  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:10.258222  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:10.258689  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:10.292366  3196 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:10.257411  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:10.259347  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:10.263023  5044 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:10.264043  4947 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:10.228974  5057 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.225370  4760 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.267320  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:10.268015  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:10.276369  4964 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:10.279701  5063 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:10.282328  5048 raft_consensus.cc:1064] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:15:10.283136  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:10.335019  3119 raft_consensus.cc:2410] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:10.283914  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:10.223258  4921 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3.
I20260709 13:15:10.339066  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:10.286545  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:10.286087  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:10.339978  3191 raft_consensus.cc:2393] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 4: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:10.293299  3197 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:10.340708  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:10.292390  3194 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:10.341781  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:10.341966  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:10.342676  3198 raft_consensus.cc:2393] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 5: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:10.343022  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:10.343425  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:10.343611  3119 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:10.344179  3198 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:10.344915  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:10.295574  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.340775  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:10.306212  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:10.348414  3797 raft_consensus.cc:2393] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 5: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:10.306366  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:10.350088  3123 raft_consensus.cc:2410] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:10.350004  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:10.351030  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:10.351204  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:10.351718  3123 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:10.352727  3123 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:10.353214  4893 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:10.340778  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:10.354494  3118 raft_consensus.cc:2393] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 4: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:10.355640  3118 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:15:10.356758  3118 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.357584  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:10.315404  5057 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:10.361337  3126 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:10.308259  3192 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:10.312891  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:10.313299  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:10.363517  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:10.224161  4946 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:10.318529  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:10.316782  4947 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:10.366178  3124 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:15:10.320465  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 66753.1us
I20260709 13:15:10.367218  3165 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:10.367502  4947 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:10.368088  4947 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:10.368456  4947 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.368561  3165 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:10.368824  4947 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:10.374261  5047 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:10.374831  4964 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:10.375180  3165 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:10.376042  4786 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:10.378036  4786 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:10.379201  3123 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:10.382068  3194 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:10.312922  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:10.321030  3799 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:10.323169  4561 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:10.323108  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:10.322466  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:10.324188  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:10.398495  3792 raft_consensus.cc:2393] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 5: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:10.322471  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:10.327590  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:10.330704  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:10.402002  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.334067  5063 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:10.337246  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:10.337982  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:10.338742  3122 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:10.330245  4760 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:10.382308  3165 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:10.337014  5048 raft_consensus.cc:1068] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: Unable to promote non-voter e9165fe61ab04bfb9a48889156d5c161: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:15:10.405136  5048 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:10.405601  4760 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:10.406774  5057 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:10.407673  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:10.408418  3046 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:10.408928  5057 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:10.388255  3197 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:10.283183  5051 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:10.409970  4561 consensus_queue.cc:1059] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:10.410712  4941 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:10.411060  4561 raft_consensus.cc:3055] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:10.411329  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:10.412204  3046 raft_consensus.cc:2393] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 3: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:10.390707  3798 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:10.411468  4561 raft_consensus.cc:740] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:10.355576  4893 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:10.413859  4561 consensus_queue.cc:260] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:10.415344  4561 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.417265  3790 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:10.419484  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:10.420377  4877 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:10.420433  4893 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:10.421090  4893 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:10.421497  4893 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:10.422955  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:10.423192  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.425313  4760 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.425531  3046 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:10.425946  4760 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:10.428134  4760 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:10.429246  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:10.429067  4893 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:10.438377  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:10.429513  5044 raft_consensus.cc:3055] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:10.431308  3090 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:10.433097  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:10.456105  3798 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:10.433034  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:10.440495  3046 raft_consensus.cc:2393] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:10.434957  3117 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:10.446385  3122 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:10.427927  4946 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:10.448132  3121 raft_consensus.cc:2410] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:10.461055  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:10.449991  3120 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:10.451692  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:10.452322  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:10.461922  3046 raft_consensus.cc:2393] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 5: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:10.452428  4947 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:10.390141  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:10.462558  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.462230  3124 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:10.388412  3119 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:10.470645  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:10.471311  3051 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:10.472200  3043 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:10.462751  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:10.477936  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:10.478116  3046 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:10.482820  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:10.484649  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:10.483327  3125 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:10.483745  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:10.514076  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:10.487470  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 56286us
I20260709 13:15:10.455447  5044 raft_consensus.cc:740] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:10.522271  3090 leader_election.cc:400] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4.
I20260709 13:15:10.522655  3090 leader_election.cc:403] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:15:10.519096  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:10.523186  3049 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:10.526651  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:10.527365  3195 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:10.528258  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:10.528949  3200 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:10.477468  5043 raft_consensus.cc:2764] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:15:10.531682  3091 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:10.480404  4944 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:10.536270  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:10.536306  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:10.537155  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:10.537959  3197 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:15:10.547689  3048 raft_consensus.cc:2393] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 5: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:10.539251  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:10.548504  3046 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:10.550254  3046 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:15:10.553805  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.554284  3199 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:10.555275  3050 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:10.546133  3165 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:10.556831  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:10.559085  3193 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:15:10.559573  3193 pending_rounds.cc:85] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 1
I20260709 13:15:10.559852  3193 pending_rounds.cc:107] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:15:10.560156  3193 raft_consensus.cc:2889] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:10.543764  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:10.556088  3191 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:10.562850  3195 raft_consensus.cc:2393] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 5: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:10.555205  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:10.547778  3197 pending_rounds.cc:85] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 1
I20260709 13:15:10.482549  4978 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:10.565296  3197 pending_rounds.cc:107] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:15:10.566082  3197 raft_consensus.cc:2889] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:10.572669  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:10.573577  3194 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:10.574216  3164 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:10.522739  4914 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:10.519881  4941 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:15:10.577915  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 60190.7us
I20260709 13:15:10.576546  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:10.583052  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:10.583248  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:10.578444  5057 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4.
I20260709 13:15:10.586668  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:10.587318  3198 raft_consensus.cc:2376] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5. Re-sending same reply.
I20260709 13:15:10.588125  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:10.595223  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:10.595871  3198 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:10.596112  3091 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:10.553864  4835 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:15:10.596758  4786 consensus_queue.cc:1059] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.597437  4786 consensus_queue.cc:1243] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:15:10.596014  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:10.598002  4786 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:10.582791  4692 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:10.600268  5042 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:10.600483  4692 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.600770  5042 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.601452  5042 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:10.544255  4561 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.557875  4964 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:10.600970  4692 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:10.606426  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:10.587257  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:10.564971  3793 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:10.615538  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:10.633864  3051 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:10.634196  3049 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:10.617561  3050 raft_consensus.cc:1240] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:10.618551  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:10.618928  4760 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.590396  4944 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:10.619730  4561 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:10.601683  2947 catalog_manager.cc:5697] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:10.622771  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:10.624106  5048 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:10.573228  4978 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:10.626282  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:10.655092  3199 raft_consensus.cc:2393] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:10.626700  5067 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:10.627700  4519 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:10.627974  4853 raft_consensus.cc:3055] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:10.606231  4941 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:10.631559  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:10.637949  3125 raft_consensus.cc:2393] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:10.638427  3121 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:10.646639  3192 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:10.565269  4959 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:15:10.670018  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:10.670508  3045 raft_consensus.cc:1275] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:10.671273  3123 raft_consensus.cc:2393] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 5: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:10.661780  3091 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:10.636068  3191 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:10.578158  5047 consensus_queue.cc:1059] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
W20260709 13:15:10.683640  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:10.687088  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 64391.6us
I20260709 13:15:10.688416  3196 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
W20260709 13:15:10.663380  5049 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.010s	sys 0.013s
W20260709 13:15:10.702623  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.688544  2947 catalog_manager.cc:5697] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 1 to 2, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 2 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:10.659138  4978 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:10.655841  4964 raft_consensus.cc:697] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:10.663682  4944 raft_consensus.cc:697] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:15:10.715914  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 169840us
W20260709 13:15:10.755254  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 170572us
W20260709 13:15:10.709048  5049 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.011s	sys 0.013s
I20260709 13:15:10.759611  2947 catalog_manager.cc:5697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 2 to 4, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 4 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:15:10.664290  4853 raft_consensus.cc:740] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:10.801630  3165 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:10.756271  3762 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:15:10.803630  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:10.803673  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 48698.3us
I20260709 13:15:10.626314  5063 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:10.664836  4943 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:10.686364  4921 raft_consensus.cc:2764] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
W20260709 13:15:10.807919  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.812904  3165 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:10.715552  4914 raft_consensus.cc:670] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:10.708634  5048 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:10.823031  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:10.888540  4964 consensus_queue.cc:237] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:10.756217  4992 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.826701  5038 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:10.890796  5038 raft_consensus.cc:697] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:10.891873  5038 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:10.892976  5069 log.cc:927] Time spent T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:15:10.873970  4976 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.894068  4976 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:10.879915  5044 consensus_queue.cc:260] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:10.883092  3124 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
W20260709 13:15:10.809244  5053 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:15:10.897195  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 73588.2us
I20260709 13:15:10.898257  3090 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:10.898592  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.903283  2947 catalog_manager.cc:5697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 3 to 5, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 5 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:10.905805  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.705880  5043 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:10.901715  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:10.916224  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 379148us
I20260709 13:15:10.716876  5057 consensus_queue.cc:1059] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.154s
I20260709 13:15:10.917507  2947 catalog_manager.cc:5697] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 1 to 3, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 3 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:10.965927  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.908332  4884 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:10.991117  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 92968.7us
I20260709 13:15:10.989055  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:10.898913  4786 raft_consensus.cc:697] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:10.995566  2947 catalog_manager.cc:5697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:10.896755  4893 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:10.905375  4947 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:10.997766  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.005800  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:11.016798  4794 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.017382  4794 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.019583  4794 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:10.982009  5048 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.888605  4692 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:10.897094  5042 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.015820  2947 catalog_manager.cc:5697] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 1 to 2, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 2 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:11.020105  4699 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:11.036814  3090 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:11.047883  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:11.048174  3761 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:11.051451  3045 raft_consensus.cc:2410] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:10.998742  5043 raft_consensus.cc:697] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:11.008662  5044 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:11.037622  5056 raft_consensus.cc:3055] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:11.056196  5039 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:11.056818  4794 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:11.073483  5039 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.074095  5039 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.089365  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:11.059733  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:10.916033  4992 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.133490  3050 raft_consensus.cc:2393] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:11.091979  5039 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.054695  2947 catalog_manager.cc:5697] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 2 to 3, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 3 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:15:11.096103  5041 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:15:11.096779  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 75769us
W20260709 13:15:11.141554  3043 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.021s	sys 0.015s
W20260709 13:15:11.141960  3043 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.021s	sys 0.015s
I20260709 13:15:11.096903  5042 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:11.106002  5063 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:11.107605  4561 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:10.999718  4835 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:15:11.058990  5057 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 13:15:11.111006  4877 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.074479  5078 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:11.132606  3124 raft_consensus.cc:2410] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:11.007812  4884 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.117812  4976 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:10.991158  4853 consensus_queue.cc:260] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:11.143474  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 330653us
I20260709 13:15:11.138679  2947 catalog_manager.cc:5697] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 4 to 5, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 5 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:15:11.044826  5048 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:11.137180  5075 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 13:15:11.065775  5073 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:11.066183  5056 raft_consensus.cc:740] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:11.178467  3090 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:11.155586  4947 raft_consensus.cc:1064] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:15:11.113363  4692 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:11.095021  4893 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:11.160224  5074 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:15:11.188184  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:11.190606  2947 catalog_manager.cc:5697] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 1 to 3, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 3 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:15:11.163636  4921 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:11.064473  4944 consensus_queue.cc:237] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.191076  5079 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:11.205803  4946 consensus_meta.cc:287] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.736s	user 0.009s	sys 0.001s
I20260709 13:15:11.224277  4893 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:11.226807  5063 consensus_queue.cc:1059] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:11.237926  3164 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:11.114039  4786 consensus_queue.cc:237] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.223917  2947 catalog_manager.cc:5697] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 1 to 3, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 3 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:15:11.235792  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:11.236567  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:11.186671  5072 log.cc:927] Time spent T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.285s	user 0.001s	sys 0.001s
I20260709 13:15:11.231436  3761 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:11.191035  4941 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:11.250733  4941 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:11.251343  4941 raft_consensus.cc:697] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:11.252389  4941 consensus_queue.cc:237] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.254102  5085 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:11.254760  5085 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:11.258410  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 94388.3us
I20260709 13:15:11.258612  4914 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.259334  4914 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.259765  3090 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:11.246928  5039 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:11.263350  3045 raft_consensus.cc:2393] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 5: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:11.247136  3051 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:11.230659  5077 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:11.247915  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:11.266875  3049 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:11.187744  4877 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.264940  2947 catalog_manager.cc:5697] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 1 to 3, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 3 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:15:11.193910  4756 consensus_queue.cc:1059] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:15:11.281399  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:11.272891  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:11.273093  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:11.273670  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:11.288931  3124 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.274492  3164 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:11.273530  4884 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:11.275302  5083 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:11.275409  5081 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:11.192859  5043 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.276118  4692 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:15:11.277150  4910 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.278179  3196 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:11.278908  5047 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:11.279392  5049 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:11.271898  2947 catalog_manager.cc:5697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 2 to 4, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 4 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:11.267309  5048 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:11.238353  4893 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:11.295646  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.243391  5088 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.305392  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:11.306128  3761 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:11.295980  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:11.267156  5057 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:11.298290  3164 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:11.321383  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:11.292608  4958 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:15:11.298748  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 345866us
I20260709 13:15:11.268234  5042 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:11.279832  4561 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:15:11.296833  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 307869us
I20260709 13:15:11.303056  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:11.330602  3090 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:11.330983  3199 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:15:11.242242  5079 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.337579  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:11.340840  3196 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:15:11.315646  5063 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:11.311239  5057 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.353133  3050 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:11.347993  3090 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:11.348946  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:11.349983  3046 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:11.345829  3124 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:11.322983  5048 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:11.326704  4914 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:11.327289  4946 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:11.362495  3050 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:11.362701  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:11.362943  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:11.363481  3046 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:11.363533  3048 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:11.357080  5055 consensus_queue.cc:1059] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:15:11.333797  4835 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:11.303671  4910 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.305001  5049 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.305207  5047 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.351051  4884 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:11.295045  5056 consensus_queue.cc:260] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.382441  3050 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:11.297317  5081 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.378357  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:11.322714  5039 consensus_queue.cc:1059] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:15:11.346774  5041 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:11.385281  4992 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:11.386039  5056 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:11.387883  5079 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:11.317557  5088 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.393500  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:11.394140  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:11.395042  3761 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:11.359354  5057 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:11.396080  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:11.347697  4561 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.399721  5081 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:11.404552  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 56615.1us
I20260709 13:15:11.335345  4958 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.416769  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:11.426690  5039 raft_consensus.cc:3055] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:11.374583  5092 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:15:11.431294  5091 consensus_queue.cc:1059] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:11.410763  5078 consensus_queue.cc:1059] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:15:11.398646  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:11.444151  3043 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:11.444236  3048 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
W20260709 13:15:11.444634  5067 consensus_meta.cc:287] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.761s	user 0.007s	sys 0.004s
W20260709 13:15:11.449965  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:11.444996  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 65977.7us
W20260709 13:15:11.446607  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 51650.2us
I20260709 13:15:11.469213  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:11.408255  5038 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:11.460417  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.408002  4959 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.472779  3123 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:11.393675  4946 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:15:11.467577  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 50904.2us
I20260709 13:15:11.472828  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:11.392987  5048 consensus_queue.cc:1059] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:15:11.474058  5067 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:11.474255  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:11.405617  5086 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:15:11.476945  5089 raft_consensus.cc:3055] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:11.477497  5049 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:11.477995  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:11.461655  5039 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:11.478958  5088 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:11.479750  5081 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.480115  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:11.530812  3793 raft_consensus.cc:2393] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 5: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:11.480907  4946 raft_consensus.cc:697] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:11.470978  5038 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.532320  3049 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:11.532526  5038 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:11.482366  4877 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:11.483767  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:11.483983  5095 raft_consensus.cc:3055] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:11.484082  4756 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.532344  4946 consensus_queue.cc:237] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.471307  4943 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.536839  4943 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.484263  5051 consensus_queue.cc:1059] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:11.538090  3164 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:11.534646  5095 raft_consensus.cc:740] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:11.485375  4561 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:11.539127  4943 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:11.539342  4561 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:11.540537  5039 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.541806  5039 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:11.526386  5067 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:11.545176  5038 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.545760  5067 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.488647  3117 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:11.473662  4914 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:11.497713  5083 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:11.547298  5085 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:11.486222  5047 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:11.490128  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:11.548583  3126 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:11.483911  4910 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:11.502807  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:11.549850  3798 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:11.460953  4992 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.478492  4959 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.550820  4992 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.552310  4959 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:11.523542  3050 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
W20260709 13:15:11.522212  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 47986.1us
I20260709 13:15:11.552929  4992 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:11.505565  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:11.553484  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:11.554306  4964 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:11.554807  4964 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:11.555075  4958 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:11.555714  5081 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.464805  5079 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:11.557195  5079 raft_consensus.cc:697] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:11.557384  3195 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:11.558000  5081 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:11.558357  5079 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.539140  5095 consensus_queue.cc:260] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.559680  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:11.560979  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:11.501660  4978 consensus_meta.cc:287] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.685s	user 0.007s	sys 0.000s
I20260709 13:15:11.526467  3091 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:11.564716  3197 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:11.485656  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:11.546118  3119 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:11.566624  3046 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
W20260709 13:15:11.529542  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 57128.7us
I20260709 13:15:11.569531  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:11.474565  4976 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:11.570407  3199 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:15:11.572585  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.572692  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:11.574790  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:11.574954  3200 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:11.574965  3197 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:11.577083  3798 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:11.547590  5038 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:11.583570  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:11.584534  3192 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:11.584581  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:11.523228  5089 raft_consensus.cc:740] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:11.528769  4921 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:11.538137  5051 raft_consensus.cc:3055] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:11.534898  4756 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.547313  4914 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.572345  4877 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.592886  5051 raft_consensus.cc:740] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:11.606837  5051 consensus_queue.cc:260] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.608088  5051 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:11.611191  4756 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:11.586782  5077 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:11.612222  5077 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.614319  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:11.614676  5077 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:11.615437  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:11.616338  3045 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 2: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:11.616246  5063 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:11.573542  5044 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:11.617627  5044 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:11.620255  4893 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.621368  3042 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:11.591444  4976 raft_consensus.cc:697] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:11.622711  4976 consensus_queue.cc:237] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:11.623817  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.594261  5056 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:11.624785  4921 raft_consensus.cc:697] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:11.595352  4884 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:11.626262  4921 consensus_queue.cc:237] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.598956  3197 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:11.629055  3194 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:11.631670  3090 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:11.632027  5041 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:11.632928  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:11.634097  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 46368.8us
I20260709 13:15:11.604584  3192 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:11.593334  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:11.636093  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:11.636495  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:11.591938  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 65432.8us
I20260709 13:15:11.638181  3042 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:11.638350  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:11.639096  3050 raft_consensus.cc:2393] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:11.573246  4978 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.588863  5088 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:11.555714  4964 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.647042  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:11.641340  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:11.641587  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:11.641901  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:11.651521  3117 raft_consensus.cc:2410] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:11.643245  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:11.643533  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:11.644414  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:11.645030  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:11.636771  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:11.645958  3046 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:11.651105  3164 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:11.658293  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:11.653379  3118 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:11.654850  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:11.653918  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:11.602115  4992 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:11.664060  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:11.664685  3125 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:11.662657  3164 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:11.601087  4853 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:11.603706  4914 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:11.620747  5044 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:11.670828  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:11.665052  3051 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:11.665163  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:11.673997  3090 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:11.645342  4760 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:11.646359  5063 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:11.649145  5091 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:11.674448  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:11.649847  5056 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:11.634147  4699 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:15:11.690303  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:11.716674  3194 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 2.
I20260709 13:15:11.716585  3090 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:11.691913  3044 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:11.663980  3793 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:11.692866  5039 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.694145  4519 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.728328  4519 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.694588  5073 raft_consensus.cc:3055] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:11.729966  5073 raft_consensus.cc:740] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:11.694867  5083 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:11.696786  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:11.730875  5083 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:11.693624  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:11.698845  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:11.731981  3042 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:11.731752  4760 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:11.732405  3164 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:11.710215  5063 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.733783  5063 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:11.734342  5093 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:11.693172  5079 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:11.734946  3164 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:11.735183  5079 raft_consensus.cc:697] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:15:11.736559  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.653568  5049 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.736937  5092 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:11.737191  5078 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:11.737644  5092 raft_consensus.cc:2764] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:15:11.738158  4884 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:11.742120  5067 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:11.747951  4519 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:11.713878  3091 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:11.719163  3762 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:15:11.723819  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 49434.9us
I20260709 13:15:11.749471  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:11.750761  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:11.664501  4992 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.598352  4877 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.650681  5043 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:15:11.601423  5057 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.727317  4692 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:11.727059  5039 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.772212  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:11.731321  5083 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.736106  5079 consensus_queue.cc:237] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.702916  4893 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:11.665354  5047 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:11.710938  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:11.689900  5102 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.791543  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:11.760527  4992 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.759987  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:15:11.760059  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 46320us
I20260709 13:15:11.763785  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34728 (request call id 206) took 1219 ms. Trace:
I20260709 13:15:11.770797  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:11.775568  3761 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:11.759353  5077 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:11.778028  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:11.800119  3125 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.778496  4914 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.778923  3121 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:11.805297  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:11.602589  5089 consensus_queue.cc:260] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.674775  5085 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:15:11.748984  5041 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:11.784502  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:11.779935  5093 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:11.785809  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:11.788421  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:11.664701  5088 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.652333  5081 consensus_queue.cc:1059] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:15:11.792219  3796 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:11.798586  3120 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:11.800891  3117 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:11.768069  4739 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:11.799013  3195 rpcz_store.cc:276] 0709 13:15:10.544479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.631354 (+ 86875us) service_pool.cc:224] Handling call
0709 13:15:11.763631 (+1132277us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b5400036454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:11.763730 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2051690368}
W20260709 13:15:11.823171  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 63298us
I20260709 13:15:11.776441  4760 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:11.814769  3091 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:11.818807  3119 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:11.823866  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:11.826534  3124 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:11.830456  4978 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:11.808614  5038 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:11.786983  4794 consensus_queue.cc:1059] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:15:11.805049  3790 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:11.805433  5077 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.822832  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:11.867100  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:11.867841  3125 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:15:11.867992  3042 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:11.870394  3762 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:11.882170  4914 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:11.884109  5088 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:11.860436  3796 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:11.864742  5039 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:11.860527  3795 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:11.860980  4692 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:11.861150  4877 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:11.861491  5097 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:15:11.861864  5105 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:15:11.887063  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 46280.4us
I20260709 13:15:11.884196  5049 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:11.891564  3042 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:11.888245  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:11.840123  5057 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:11.856093  3122 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:11.804848  5102 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.912328  4992 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:11.852211  5093 raft_consensus.cc:697] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:11.864097  5077 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:11.851869  5112 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:11.891036  3794 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:11.872072  4760 raft_consensus.cc:697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:11.902917  4699 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.873104  4884 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:11.906430  4877 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:11.908479  4692 raft_consensus.cc:697] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:11.904322  5097 raft_consensus.cc:697] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:11.923290  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:11.917948  4978 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:11.886878  5063 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.933017  4884 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.936995  5041 raft_consensus.cc:697] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:11.909611  5039 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:15:11.908720  5084 consensus_queue.cc:1059] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:15:11.946609  3798 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:12.047465  5085 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:12.060168  4786 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:12.059168  5063 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:12.062613  5095 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:12.066829  5073 consensus_queue.cc:260] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:12.014998  5093 consensus_queue.cc:237] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.040961  4964 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:12.098392  4964 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:12.100515  4964 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:12.018165  5102 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:12.019177  5041 consensus_queue.cc:237] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:12.102563  5089 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.016762  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:12.051460  5097 consensus_queue.cc:237] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:11.926157  5112 raft_consensus.cc:697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:12.106375  5112 consensus_queue.cc:237] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.050614  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:12.110108  3796 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:12.110948  4739 raft_consensus.cc:1064] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:15:12.111635  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:12.112708  5102 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:12.113142  5102 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.113520  5102 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:11.930024  4877 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.166755  3198 raft_consensus.cc:2410] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:15:12.017360  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 79687.1us
I20260709 13:15:12.054452  4946 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:11.962832  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.948992  3792 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:12.039674  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:12.074666  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:12.176812  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:12.181059  3799 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:11.948639  5088 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:11.930802  4699 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:12.114460  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:12.152776  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:12.156543  3047 raft_consensus.cc:3055] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:12.159157  5102 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.117249  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:12.178663  3194 raft_consensus.cc:1275] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:12.179431  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:12.193764  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:12.182715  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:12.194485  3191 raft_consensus.cc:2393] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 5: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:12.194511  3045 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:12.185428  3794 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:12.189355  3197 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:12.188653  3047 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:12.195266  3195 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:12.165426  5051 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.181242  4877 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.246868  3050 raft_consensus.cc:1275] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:15:12.248274  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 208815us
I20260709 13:15:12.248963  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:12.232726  3047 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.250115  3047 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:12.244308  3799 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:12.257339  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:12.258813  3193 raft_consensus.cc:2410] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:12.192790  4705 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.259150  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:12.082158  5085 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:12.263226  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:12.256547  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:12.078780  4760 consensus_queue.cc:237] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:12.238371  4964 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:12.239123  5047 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.304469  5044 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:12.097323  4786 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.191928  4946 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.229674  5081 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:15:12.269248  5091 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:12.096572  4692 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.298800  4992 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:12.253786  5051 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:12.308605  4519 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:12.360523  3165 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:12.368444  3192 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:12.291949  4893 consensus_queue.cc:1059] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:15:12.372696  4884 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:12.377229  3047 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:15:12.290697  4705 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:12.379411  3047 pending_rounds.cc:85] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 5
I20260709 13:15:12.379813  3047 pending_rounds.cc:107] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:15:12.380192  3047 raft_consensus.cc:2889] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:12.377298  3165 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:12.331534  5044 raft_consensus.cc:697] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:15:12.382728  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 81675.9us
I20260709 13:15:12.317843  5047 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:12.394786  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:15:12.396370  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 139924us
W20260709 13:15:12.400182  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.411887  4705 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:12.413661  5138 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:12.414609  5138 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.386662  5084 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.413383  5081 consensus_queue.cc:1059] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:15:12.392519  4853 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:12.454128  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1815) took 1101 ms. Trace:
I20260709 13:15:12.468820  3200 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:12.436417  3191 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:12.479504  3051 rpcz_store.cc:276] 0709 13:15:11.352210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.356966 (+  4756us) service_pool.cc:224] Handling call
0709 13:15:11.357290 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:11.691403 (+334113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:12.453895 (+762492us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b540004a1d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:12.454069 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707312512}
I20260709 13:15:12.455560  5044 consensus_queue.cc:237] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.399744  4921 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:12.534242  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:12.535179  3126 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:12.538517  3119 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:12.539790  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:12.501896  3195 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
W20260709 13:15:12.504901  5083 consensus_meta.cc:287] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.713s	user 0.009s	sys 0.001s
I20260709 13:15:12.512097  4877 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.514870  4946 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:12.518714  5077 consensus_meta.cc:287] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.000s
I20260709 13:15:12.481901  4699 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:12.507812  5085 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:12.521960  5114 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:15:12.523152  4884 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.480005  5102 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:12.527184  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:12.556350  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.437230  5051 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:12.452654  5047 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:12.480873  5084 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:12.544502  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:12.546061  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:12.415097  5138 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.550841  3126 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:12.452680  4786 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:12.549276  5091 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:12.562705  3117 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:15:12.565393  4946 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.560097  5079 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:15:12.550060  5083 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:12.549784  5077 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.559271  4884 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.607414  4884 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:12.608254  5084 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:12.609608  4877 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:12.612382  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 235128us
I20260709 13:15:12.613583  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:12.618008  3165 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:12.620033  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 66960.8us
W20260709 13:15:12.624619  5095 consensus_meta.cc:287] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.000s
I20260709 13:15:12.598163  4946 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.601190  5039 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:15:12.628123  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:12.620642  5084 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:12.610632  5138 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:12.630707  3051 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:12.631968  3042 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:12.632962  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:12.633299  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:12.633639  3046 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:12.635324  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:12.635634  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:12.636111  3117 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:12.636458  3193 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:12.638396  3195 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:12.638880  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:12.639386  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:12.640642  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:12.641518  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:12.639416  3117 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.642179  3051 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 1.
I20260709 13:15:12.642416  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:12.641113  3193 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:12.643443  4884 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.644093  4884 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.645884  3199 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:12.647224  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:12.634498  4877 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:12.648532  5125 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:15:12.648646  4877 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:12.649045  5128 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:15:12.649183  4877 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:12.649356  3117 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:12.649806  5152 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:15:12.652604  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:12.653273  3042 raft_consensus.cc:2393] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:12.648103  5148 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:12.656416  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:12.656898  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.658315  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:12.659801  5083 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:12.640007  5044 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.668310  4877 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.668414  4947 consensus_queue.cc:237] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.681020  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:12.676085  4853 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:12.694216  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:12.671806  5077 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:12.694998  3045 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:15:12.695302  5077 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:12.686579  3051 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:12.693090  5044 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:12.698110  3165 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:12.698313  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:12.699592  3165 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:12.685901  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:12.700786  3165 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:12.701217  3042 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.690999  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1453) took 1208 ms. Trace:
I20260709 13:15:12.702569  3120 rpcz_store.cc:276] 0709 13:15:11.482270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.482413 (+   143us) service_pool.cc:224] Handling call
0709 13:15:11.482707 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:11.822015 (+339308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:12.690570 (+868555us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b540011b7d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:12.690862 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":725996288}
I20260709 13:15:12.709647  3165 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:12.711258  3165 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:12.716497  3762 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:12.732043  5084 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:15:12.734584  3045 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:12.672381  3790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 356) took 1103 ms. Trace:
I20260709 13:15:12.686568  4884 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:12.673589  4944 raft_consensus.cc:3055] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:12.753403  4944 raft_consensus.cc:740] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:12.710260  5063 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:12.755278  5044 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:12.756449  3042 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:12.710741  4756 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:12.679489  4946 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:12.710947  4958 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:12.736456  4853 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:12.732398  5039 consensus_queue.cc:1059] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:15:12.736608  5155 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:12.738358  5077 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:12.752866  5086 raft_consensus.cc:3055] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:12.678105  4739 consensus_queue.cc:237] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.764222  5039 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:12.765211  5120 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.504s	user 0.000s	sys 0.005s
I20260709 13:15:12.765014  5039 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.763424  5086 raft_consensus.cc:740] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:15:12.767637  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.759214  4853 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.771533  4853 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:12.771611  5086 consensus_queue.cc:260] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.758775  4884 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.778302  4884 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.759433  5079 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.749229  3790 rpcz_store.cc:276] 0709 13:15:11.568529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.575462 (+  6933us) service_pool.cc:224] Handling call
0709 13:15:12.672063 (+1096601us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b5400627fd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:12.672257 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405500800}
I20260709 13:15:12.782065  5079 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.783270  5086 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:12.787266  4884 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:12.785339  5079 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:12.790583  4877 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:12.760288  5155 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.806381  4893 raft_consensus.cc:3055] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:12.806896  4893 raft_consensus.cc:740] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:12.807793  4893 consensus_queue.cc:260] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:12.809087  4893 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.810324  5095 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.810932  5095 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:12.813366  5095 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:12.814575  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:12.823884  3198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1433) took 1258 ms (client timeout 1677 ms). Trace:
I20260709 13:15:12.824481  3192 raft_consensus.cc:1275] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:15:12.825032  3192 pending_rounds.cc:85] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 1
I20260709 13:15:12.825317  3192 pending_rounds.cc:107] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:15:12.825647  3192 raft_consensus.cc:2889] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:12.827440  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 432708us
I20260709 13:15:12.828311  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:12.828805  3762 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:15:12.824497  3198 rpcz_store.cc:269] 0709 13:15:11.565291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.565417 (+   126us) service_pool.cc:224] Handling call
0709 13:15:12.823660 (+1258243us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b5400035f54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:12.823820 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1336391424}
I20260709 13:15:12.830092  3762 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:12.814394  5039 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:12.837605  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:12.848781  3117 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:12.838696  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:12.843839  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 80884.5us
I20260709 13:15:12.850265  3118 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.850492  3761 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:12.803622  5155 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:12.860177  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:12.861688  3200 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
W20260709 13:15:12.856449  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.858085  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:12.862980  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:12.863152  3198 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:12.859787  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:12.864069  3195 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:12.862469  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:12.866266  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.868115  3197 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:12.868474  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:12.870519  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:12.871255  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:12.871958  3043 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:12.873499  3090 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:12.876185  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:12.870529  5156 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:12.866043  4959 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.903939  3118 raft_consensus.cc:2410] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:12.903880  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:12.897185  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:12.860477  5112 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:12.902379  3043 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:15:12.852756  5048 raft_consensus.cc:3055] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:12.863677  5095 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.865937  5079 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.863294  4884 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:15:12.903460  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 62635.1us
I20260709 13:15:12.911909  5079 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.914202  5079 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:12.867038  4958 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:12.914269  3198 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:12.908623  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:12.861686  4756 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.872629  5049 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.870791  5093 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:12.915017  5097 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:12.921469  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 48051.8us
I20260709 13:15:12.899575  5118 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.924211  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:12.909518  4519 consensus_queue.cc:1059] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:15:12.922397  4756 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:12.927709  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:12.918777  5095 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:12.929987  5095 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:12.930037  4964 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:12.932039  4964 raft_consensus.cc:697] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:15:12.934710  5158 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:15:12.936431  4943 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.936975  4943 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.939034  4943 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:12.941200  5124 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:12.943182  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:12.943288  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:12.944195  3790 raft_consensus.cc:2393] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 3: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:12.915480  5039 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:15:12.945273  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:12.946089  3795 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:12.946205  5039 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:12.904661  5088 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:12.947198  5063 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.947784  5063 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.950471  3164 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:12.951119  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.951779  5084 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:12.933000  4964 consensus_queue.cc:237] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:12.955436  3164 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:12.956120  3194 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:12.929467  4756 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:12.906675  5139 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.967082  3118 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:12.967794  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:12.968499  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:12.970340  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:12.911213  5048 raft_consensus.cc:740] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:12.910298  5159 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:12.974794  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 50626.4us
I20260709 13:15:12.976038  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:12.980002  3117 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:12.992674  3121 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:12.995424  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:12.992872  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 66480us
I20260709 13:15:12.917516  4853 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:13.008388  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:12.919139  5112 raft_consensus.cc:697] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:13.009311  3122 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:13.010520  3090 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:13.021366  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:13.031248  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 55863.6us
I20260709 13:15:12.923525  5044 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.039114  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:13.041893  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:12.958204  5042 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:13.042690  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:13.050192  3123 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
W20260709 13:15:13.049398  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 144256us
I20260709 13:15:13.051020  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:13.051132  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:13.055624  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:13.056705  3044 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.910104  4959 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:12.922801  5049 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:12.970636  5097 raft_consensus.cc:697] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:13.071628  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:13.072453  3198 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:13.060444  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:12.979352  5084 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.066387  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:13.077661  3042 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:13.078317  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:13.080931  3198 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:13.010931  5063 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:13.009305  5089 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:13.011158  5159 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:13.082333  3164 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:13.083176  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:13.092326  3123 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:13.083410  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:13.086239  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:13.088502  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:12.977788  5055 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 13:15:13.089514  3122 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:13.036520  5156 raft_consensus.cc:697] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:13.049510  4756 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:13.093612  3195 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:13.094803  3198 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:13.095811  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:13.089423  3124 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:13.099900  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:12.992314  5139 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:12.978821  5118 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:13.067577  5041 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:15:13.054978  5044 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:13.102253  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:13.334334  3123 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:13.094381  5159 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.064990  5124 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:13.336410  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:13.127506  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:13.316284  5044 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:13.236459  5063 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:13.362814  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 324011us
I20260709 13:15:13.171339  4959 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:13.315840  5156 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:13.335664  5097 consensus_queue.cc:237] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:13.173671  5048 consensus_queue.cc:260] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:13.386999  5163 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.286s	user 0.000s	sys 0.000s
I20260709 13:15:13.308286  4835 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:13.387778  4835 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:13.172685  5166 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:13.389074  5166 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.389467  5166 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:13.390048  4835 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:13.390525  5049 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
W20260709 13:15:13.171221  5162 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:15:13.321393  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 225646us
I20260709 13:15:13.405454  3044 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:13.323033  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:13.323169  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.323881  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:13.071369  5079 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:15:13.147073  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:13.407150  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 413723us
I20260709 13:15:13.096130  5047 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.210s
I20260709 13:15:13.338685  3196 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:13.310984  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1721) took 1056 ms. Trace:
I20260709 13:15:13.405663  3164 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:13.409029  3192 rpcz_store.cc:276] 0709 13:15:12.254464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.369257 (+114793us) service_pool.cc:224] Handling call
0709 13:15:12.823949 (+454692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:12.826276 (+  2327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.310696 (+484420us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b5400035f50. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:13.310903 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044882304}
I20260709 13:15:13.100277  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:13.378608  3122 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:13.378058  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:13.420629  3123 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:13.159129  4910 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:13.320773  5081 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:13.334082  5161 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:15:13.090921  4884 raft_consensus.cc:697] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:15:13.290074  5086 consensus_meta.cc:287] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 13:15:13.409587  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:13.410694  3124 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:13.442857  5044 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:13.443607  5044 raft_consensus.cc:697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:13.412622  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:13.403523  5063 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:13.425043  5123 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.425782  5049 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:13.424855  5081 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.463806  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:13.464598  3790 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:13.465078  5063 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:13.421459  4943 consensus_queue.cc:1059] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:15:13.466197  4884 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:13.461805  5123 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:13.470283  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:13.471048  3794 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:13.456930  5086 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.430265  4877 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.468163  5081 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:13.459247  5049 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.301899  5112 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:13.471896  3123 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:13.427264  3793 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
W20260709 13:15:13.474277  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.481369  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 206) took 1083 ms. Trace:
I20260709 13:15:13.444888  5044 consensus_queue.cc:237] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:13.501216  3047 rpcz_store.cc:276] 0709 13:15:12.398929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.399358 (+   429us) service_pool.cc:224] Handling call
0709 13:15:12.399748 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:12.810644 (+410896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:12.810684 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:12.811181 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:15:12.905490 (+ 94309us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:12.905550 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:12.905648 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:13.481074 (+575426us) raft_consensus.cc:1685] finished
0709 13:15:13.481105 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:13.481294 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":410459,"raft.queue_time_us":411835,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":93829,"threads_started":1,"wal-append.queue_time_us":160428}
I20260709 13:15:13.461716  4853 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:13.516980  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 94402.9us
I20260709 13:15:13.483182  5049 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:13.511691  5089 raft_consensus.cc:697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:13.565289  3126 raft_consensus.cc:3055] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:13.566633  5118 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:13.568818  5174 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.478955  5086 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:13.591845  5174 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:13.594167  5174 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:13.479483  5171 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.098s
W20260709 13:15:13.501255  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.587258  3126 raft_consensus.cc:740] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:13.594036  5086 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:13.597069  3799 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:13.458527  5055 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:15:13.481251  4877 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:13.598227  3126 consensus_queue.cc:260] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:13.610929  3126 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:13.581315  4519 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.613119  4519 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:13.616079  4519 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:13.630139  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 217577us
W20260709 13:15:13.637882  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.637687  5086 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.639036  5086 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:13.638130  4853 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.639178  4947 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:13.640213  3042 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.019s	sys 0.036s
I20260709 13:15:13.640476  4947 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:13.642059  3042 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.019s	sys 0.036s
I20260709 13:15:13.643090  4519 raft_consensus.cc:2764] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:15:13.643847  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:13.644966  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:13.600061  5123 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:13.654954  3126 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:15:13.657675  3126 pending_rounds.cc:85] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 5
I20260709 13:15:13.658890  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:13.659328  3126 pending_rounds.cc:107] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:15:13.662042  3126 raft_consensus.cc:2889] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:13.640213  4853 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:13.652173  5047 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:13.676214  4947 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:13.677225  4943 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:15:13.661813  4756 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:13.693960  3049 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:13.686965  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 277061us
I20260709 13:15:13.680444  5047 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:13.730366  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 71546.2us
I20260709 13:15:13.700903  5182 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:13.729346  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:13.754101  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:13.711510  5047 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:13.770522  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:13.793613  3195 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:13.771489  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:13.701143  5139 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:13.728716  5156 consensus_queue.cc:1059] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:15:13.780676  5185 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:15:13.782760  5179 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 13:15:13.746661  5155 consensus_meta.cc:287] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.876s	user 0.007s	sys 0.004s
W20260709 13:15:13.756201  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 171697us
I20260709 13:15:13.695323  5089 consensus_queue.cc:237] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:13.741266  5063 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:13.741473  4947 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.859395  4947 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:13.859741  5192 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:13.702401  4756 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:13.863540  5195 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.863729  5063 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:13.864199  5195 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:13.841061  5189 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:13.841218  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:13.875881  3050 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:13.842087  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:13.877239  3193 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.772679  5055 raft_consensus.cc:2764] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:15:13.895510  3762 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:13.827999  5188 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:13.853107  4760 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
W20260709 13:15:13.870628  5193 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:15:13.889672  5084 consensus_meta.cc:287] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.795s	user 0.005s	sys 0.003s
I20260709 13:15:13.830060  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:13.884433  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1727) took 1025 ms. Trace:
I20260709 13:15:13.927459  3090 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:13.898311  3761 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:13.926635  3194 rpcz_store.cc:276] 0709 13:15:12.859089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.860001 (+   912us) service_pool.cc:224] Handling call
0709 13:15:13.884197 (+1024196us) spinlock_profiling.cc:243] Waited 79.2 ms on lock 0x7b54001b76d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:13.884361 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182195072}
I20260709 13:15:13.938794  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:13.738758  4964 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.008s	sys 0.017s
I20260709 13:15:13.812450  5079 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:15:13.908977  3200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51690
I20260709 13:15:13.846784  5185 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:13.872694  5073 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:13.711215  5086 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:13.851788  5155 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:13.925554  5118 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.930794  5084 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:13.958673  4519 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:13.930929  5182 raft_consensus.cc:697] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:15:13.948417  4964 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.009s	sys 0.022s
I20260709 13:15:13.931488  4877 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:13.961642  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:13.968941  3796 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:13.928333  5189 raft_consensus.cc:697] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:13.975484  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:13.974189  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 118864us
W20260709 13:15:13.982486  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.983117  3799 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:13.986074  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:13.989380  3197 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:15:13.923158  5197 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:15:14.018352  3047 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:13.991178  4519 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:13.982220  4692 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:13.976423  3790 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:15:14.031312  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 122449us
I20260709 13:15:14.033370  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:13.919054  5188 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:14.027684  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:14.050601  3119 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:14.035198  3191 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:14.034006  3199 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:14.035954  3165 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:14.083191  3126 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:15:14.083777  3126 pending_rounds.cc:85] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 5
I20260709 13:15:14.084059  3126 pending_rounds.cc:107] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:15:14.084352  3126 raft_consensus.cc:2889] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:14.109429  4964 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:14.110702  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:14.111613  3125 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:14.115556  3047 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:14.116142  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:14.107406  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:14.120839  3118 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
W20260709 13:15:14.122557  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.114090  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:14.145421  4519 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:14.116962  3199 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:14.146628  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:14.150522  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:14.150758  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:14.151214  3194 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:14.151263  3047 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:13.969638  5041 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:15:14.028656  4692 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.156837  3195 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:15:14.158165  3799 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:14.159773  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:13.981603  5118 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
W20260709 13:15:14.145066  4893 consensus_meta.cc:287] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.306s	user 0.014s	sys 0.000s
I20260709 13:15:14.164408  3047 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:15:14.166707  3119 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:14.179159  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:14.105926  5084 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:14.164510  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:14.201751  3049 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:14.204380  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:14.202746  3191 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 1.
I20260709 13:15:14.206863  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:14.163283  4692 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:14.284279  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:14.842118  3165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.033s	sys 0.027s
W20260709 13:15:14.199452  5081 consensus_meta.cc:287] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.704s	user 0.005s	sys 0.005s
I20260709 13:15:14.978302  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:14.979204  3126 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:14.298609  3193 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
W20260709 13:15:14.394079  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:14.291214  5201 log.cc:927] Time spent T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
W20260709 13:15:14.674311  3046 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.000s	sys 0.019s
W20260709 13:15:14.269055  5200 log.cc:927] Time spent T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
W20260709 13:15:14.845407  3762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.000s	sys 0.026s
W20260709 13:15:14.987129  3762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.003s	sys 0.028s
I20260709 13:15:14.383037  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:14.971678  5044 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.089s	sys 0.168s
I20260709 13:15:14.961325  5118 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:14.354689  4519 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.997294  4519 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:14.207194  3125 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
W20260709 13:15:14.972256  3165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.034s	sys 0.031s
I20260709 13:15:14.972982  3047 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:14.999032  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 1483) took 1002 ms. Trace:
I20260709 13:15:14.229835  5208 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:14.983026  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1436) took 1238 ms. Trace:
W20260709 13:15:14.667608  3792 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.006s	sys 0.014s
W20260709 13:15:14.292646  5210 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:15:14.283265  5182 consensus_queue.cc:237] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
W20260709 13:15:14.983954  3046 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.009s	sys 0.021s
W20260709 13:15:14.846621  3121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.027s	sys 0.030s
W20260709 13:15:14.994912  5044 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.090s	sys 0.169s
W20260709 13:15:14.963872  5049 consensus_meta.cc:287] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.363s	user 0.030s	sys 0.045s
W20260709 13:15:14.881614  5159 consensus_meta.cc:287] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.503s	user 0.010s	sys 0.003s
I20260709 13:15:15.020545  5049 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:15.023234  5049 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:14.435873  5166 consensus_meta.cc:287] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.046s	user 0.002s	sys 0.008s
I20260709 13:15:15.024223  5166 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:15.027070  5166 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:15.028069  5203 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:15:15.029422  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 248) took 1961 ms. Trace:
I20260709 13:15:15.014917  3193 rpcz_store.cc:276] 0709 13:15:13.744552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.744697 (+   145us) service_pool.cc:224] Handling call
0709 13:15:14.982967 (+1238270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:14.962503  5188 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:14.994195  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1472) took 1241 ms. Trace:
I20260709 13:15:15.034101  5044 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:15.025290  4692 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:14.961158  5195 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:14.969933  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 855877us
I20260709 13:15:15.034854  5044 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:15.034278  3044 rpcz_store.cc:276] 0709 13:15:13.752511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.754281 (+  1770us) service_pool.cc:224] Handling call
0709 13:15:13.754627 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:13.901645 (+147018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:13.901676 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:13.920129 (+ 18453us) log.cc:844] Serialized 26 byte log entry
0709 13:15:14.116801 (+196672us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:14.116858 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.116943 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:14.993939 (+876996us) raft_consensus.cc:1685] finished
0709 13:15:14.993965 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:14.994128 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":173430,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":6072,"thread_start_us":159265,"threads_started":1,"wal-append.queue_time_us":455614}
I20260709 13:15:14.229601  5176 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:14.217031  5170 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:14.861471  3015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.006s	sys 0.021s
I20260709 13:15:15.036321  5176 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:15.036645  3015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.006s	sys 0.025s
I20260709 13:15:15.036615  5170 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:15.037485  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 1.07581e+06us
W20260709 13:15:15.029845  5073 consensus_meta.cc:287] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.060s	user 0.009s	sys 0.003s
W20260709 13:15:15.039880  5047 consensus_meta.cc:287] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.208s	user 0.009s	sys 0.004s
I20260709 13:15:15.040664  3199 raft_consensus.cc:2410] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:15.040318  5047 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:15.041134  3200 raft_consensus.cc:606] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 13:15:15.041513  3200 raft_consensus.cc:614] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:15.003708  5185 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:15.042007  5084 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.269784  5189 consensus_queue.cc:237] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:15.004787  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 232) took 1356 ms. Trace:
I20260709 13:15:14.987051  5081 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:14.984133  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:15.015939  3121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.027s	sys 0.041s
I20260709 13:15:15.016005  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 250) took 1945 ms. Trace:
I20260709 13:15:14.984267  5181 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:15.020659  5159 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:14.268278  5202 log.cc:927] Time spent T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
I20260709 13:15:15.029887  3124 rpcz_store.cc:276] 0709 13:15:13.068517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.444124 (+375607us) service_pool.cc:224] Handling call
0709 13:15:13.444455 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:13.695106 (+250651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:13.695146 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:13.705019 (+  9873us) log.cc:844] Serialized 26 byte log entry
0709 13:15:13.933975 (+228956us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:13.934027 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.934121 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:15.029197 (+1095076us) raft_consensus.cc:1685] finished
0709 13:15:15.029219 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.029357 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50067,"raft.run_cpu_time_us":6335,"raft.run_wall_time_us":70695,"thread_start_us":398751,"threads_started":2,"wal-append.queue_time_us":652144}
I20260709 13:15:15.031980  5220 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:14.388861  5138 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:15.035616  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:15:15.108151  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 72631.3us
I20260709 13:15:15.001786  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:14.999382  3047 rpcz_store.cc:276] 0709 13:15:13.997141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.221025 (+223884us) service_pool.cc:224] Handling call
0709 13:15:14.998980 (+777955us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:15.038265  3795 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 5: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:15.038448  5176 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:14.644657  5186 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:15.117991  5186 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:15.118019  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:15.120129  5186 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:15.039549  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:15.120759  5195 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:15.121119  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 1482) took 1136 ms. Trace:
I20260709 13:15:15.121222  5195 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.121884  5195 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:15.121683  3044 rpcz_store.cc:276] 0709 13:15:13.984880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.039278 (+1054398us) service_pool.cc:224] Handling call
0709 13:15:15.121047 (+ 81769us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:15.122992  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:15.003469  5212 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 13:15:14.267176  5194 log.cc:927] Time spent T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.293s	user 0.001s	sys 0.001s
I20260709 13:15:15.127068  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 246) took 2061 ms. Trace:
I20260709 13:15:15.127643  3164 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:15.127519  3122 rpcz_store.cc:276] 0709 13:15:13.065856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.445655 (+379799us) service_pool.cc:224] Handling call
0709 13:15:13.459647 (+ 13992us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:13.475010 (+ 15363us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:13.868778 (+393768us) log.cc:844] Serialized 14 byte log entry
0709 13:15:13.988724 (+119946us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:13.989212 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:15:13.989338 (+   126us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:13.989371 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.989435 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:14.415793 (+426358us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b18002f2240. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:15:15.126770 (+710977us) raft_consensus.cc:1685] finished
0709 13:15:15.126859 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.127009 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24923,"prepare.queue_time_us":485617,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":158292,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":76251,"spinlock_wait_cycles":9277824,"thread_start_us":296407,"threads_started":2,"wal-append.queue_time_us":774728}
W20260709 13:15:15.130251  3198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34728 (request call id 225) took 2047 ms (client timeout 2176 ms). Trace:
I20260709 13:15:15.037482  5044 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:15.132591  5222 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.133144  5222 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:15.130709  3198 rpcz_store.cc:269] 0709 13:15:13.082955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.083125 (+   170us) service_pool.cc:224] Handling call
0709 13:15:15.130074 (+2046949us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b5400040bd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:15.130191 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2985856}
I20260709 13:15:15.135540  5222 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:15.093513  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1487) took 1058 ms. Trace:
I20260709 13:15:15.001000  5204 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:15.161455  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:15.162925  3044 raft_consensus.cc:2410] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:15.094261  3050 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:15.093868  3192 rpcz_store.cc:276] 0709 13:15:13.648463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.648665 (+   202us) service_pool.cc:224] Handling call
0709 13:15:13.649977 (+  1312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:13.650321 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:13.650350 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:13.650751 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 13:15:13.834714 (+183963us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:13.834773 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.834850 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:15.004580 (+1169730us) raft_consensus.cc:1685] finished
0709 13:15:15.004601 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.004733 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":638,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4763,"thread_start_us":156851,"threads_started":1,"wal-append.queue_time_us":327071}
W20260709 13:15:15.015491  3792 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.008s	sys 0.019s
I20260709 13:15:15.014494  5208 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.167819  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:15.110167  3045 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
W20260709 13:15:15.106372  4884 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.050s	sys 0.096s
I20260709 13:15:15.166684  5176 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:15:15.184583  4884 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.051s	sys 0.096s
I20260709 13:15:15.037482  5170 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:15.102224  4978 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:15:15.039523  4692 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:15.120255  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:15.125020  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 1475) took 1186 ms. Trace:
I20260709 13:15:15.267715  3049 rpcz_store.cc:276] 0709 13:15:13.938332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.938521 (+   189us) service_pool.cc:224] Handling call
0709 13:15:15.124639 (+1186118us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b540028e454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:15.124764 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":602574080}
I20260709 13:15:15.268910  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:15.140079  5073 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.147257  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1845) took 2056 ms. Trace:
I20260709 13:15:15.042618  5084 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:15.147188  5044 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:15.137980  3121 rpcz_store.cc:276] 0709 13:15:14.035298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.035443 (+   145us) service_pool.cc:224] Handling call
0709 13:15:14.038275 (+  2832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:14.106305 (+ 68030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:14.106335 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:14.157548 (+ 51213us) log.cc:844] Serialized 26 byte log entry
0709 13:15:15.092993 (+935445us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:15.093058 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.093162 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:15.093224 (+    62us) raft_consensus.cc:1685] finished
0709 13:15:15.093242 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.093421 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95100,"raft.queue_time_us":119967,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":38206,"thread_start_us":914227,"threads_started":1,"wal-append.queue_time_us":854174}
W20260709 13:15:15.148238  3197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34728 (request call id 227) took 2062 ms (client timeout 2007 ms). Trace:
W20260709 13:15:15.274685  3197 rpcz_store.cc:269] 0709 13:15:13.085697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.085903 (+   206us) service_pool.cc:224] Handling call
0709 13:15:15.147986 (+2062083us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b54003b9054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:15.148136 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2061038336}
I20260709 13:15:15.151558  4853 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:15.152463  5047 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:15.116779  5220 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:15.153986  5159 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:15.130473  5138 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:15.166160  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 1479) took 1224 ms. Trace:
I20260709 13:15:15.281342  3050 rpcz_store.cc:276] 0709 13:15:13.941872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.976368 (+1034496us) service_pool.cc:224] Handling call
0709 13:15:15.166081 (+189713us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:15.094791  3123 rpcz_store.cc:276] 0709 13:15:13.070407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.510662 (+440255us) service_pool.cc:224] Handling call
0709 13:15:13.511220 (+   558us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:13.578928 (+ 67708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:13.578959 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:13.588596 (+  9637us) log.cc:844] Serialized 52 byte log entry
0709 13:15:13.832564 (+243968us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:13.832627 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.832717 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:15.015760 (+1183043us) raft_consensus.cc:1685] finished
0709 13:15:15.015783 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.015947 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79024,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"spinlock_wait_cycles":23808,"thread_start_us":188847,"threads_started":1,"wal-append.queue_time_us":319962}
I20260709 13:15:15.281718  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:15.169423  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:15.185894  3165 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:15.185329  3044 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:15.118992  5081 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:15.185851  3091 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.129:44609 timed out after 1.724s (SENT) [suppressed 10 similar messages]
I20260709 13:15:15.161506  5204 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.270896  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 1477) took 1329 ms. Trace:
I20260709 13:15:15.290174  3047 rpcz_store.cc:276] 0709 13:15:13.941273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.120020 (+1178747us) service_pool.cc:224] Handling call
0709 13:15:15.270819 (+150799us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:15.270665  3042 rpcz_store.cc:276] 0709 13:15:13.090745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.091520 (+   775us) service_pool.cc:224] Handling call
0709 13:15:13.091890 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:13.648226 (+556336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:13.648286 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:13.648823 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:15:13.909289 (+260466us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:13.909327 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.909425 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:15.147049 (+1237624us) raft_consensus.cc:1685] finished
0709 13:15:15.147067 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.147198 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":476025,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":174,"thread_start_us":780778,"threads_started":2,"wal-append.queue_time_us":294264}
I20260709 13:15:15.185076  5188 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.292152  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:15.184957  5208 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:15.288496  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 158897us
I20260709 13:15:15.262979  4959 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:15:15.290970  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 252757us
I20260709 13:15:15.292387  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:15.103255  5181 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:15.293665  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 107857us
I20260709 13:15:15.276408  5089 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:15.184883  5176 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:15.301608  3165 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:15.298141  3051 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:15.309876  3164 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:15.312642  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:15.298280  5182 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:15.291780  4853 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:15.293435  5204 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:15.307045  5081 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:15.294636  5229 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.292289  5047 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:15.297243  5159 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.294811  5044 raft_consensus.cc:697] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:15.277086  5073 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:15.307235  4959 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:15.306418  5228 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:15.308943  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:15.357498  3790 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:15:15.327886  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1473) took 2360 ms. Trace:
I20260709 13:15:15.359405  5138 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:15.347653  3048 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 1839) took 2340 ms (client timeout 1724 ms). Trace:
I20260709 13:15:15.359536  5073 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:15.359591  5081 raft_consensus.cc:697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:15:15.360059  3048 rpcz_store.cc:269] 0709 13:15:12.994219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.995151 (+   932us) service_pool.cc:224] Handling call
0709 13:15:15.334698 (+2339547us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b54001f5754. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:15.334908 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1582785280}
I20260709 13:15:15.296972  5188 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:15.349828  3164 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:15.321142  5237 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:15.320420  5182 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:15.354112  5233 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:15:15.322002  5227 consensus_queue.cc:1059] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:15:15.323366  5232 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:15.320797  4853 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:15.341074  4692 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.356233  4959 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:15.334085  5186 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.358719  3120 rpcz_store.cc:276] 0709 13:15:12.967010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.967117 (+   107us) service_pool.cc:224] Handling call
0709 13:15:13.041977 (+ 74860us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:13.161703 (+119726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:13.161764 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:13.166237 (+  4473us) log.cc:844] Serialized 26 byte log entry
0709 13:15:13.478059 (+311822us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:13.478117 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.327389 (+1849272us) spinlock_profiling.cc:243] Waited 86.1 ms on lock 0x7b54003e8854. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:15.327442 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:15.327543 (+   101us) raft_consensus.cc:1685] finished
0709 13:15:15.327556 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.327800 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5948,"raft.queue_time_us":102,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":4219,"spinlock_wait_cycles":198072832,"thread_start_us":170846,"threads_started":1,"wal-append.queue_time_us":405312,"wal-append.run_cpu_time_us":2169,"wal-append.run_wall_time_us":1067765}
I20260709 13:15:15.363726  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:15.363443  3090 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:15.363297  5237 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.374015  5073 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:15.360038  5138 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:15.378931  5220 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:15.379359  5188 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:15.384653  4947 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:15.387301  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1734) took 1352 ms. Trace:
I20260709 13:15:15.394744  4760 raft_consensus.cc:3055] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:15:15.506346  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 143172us
I20260709 13:15:15.367854  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1473) took 1615 ms. Trace:
I20260709 13:15:15.510874  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51690 (request call id 80) took 1494 ms. Trace:
I20260709 13:15:15.311174  5089 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:15.515208  5244 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:15.516450  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 330590us
I20260709 13:15:15.341797  5229 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:15.341540  5047 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:15.357316  5228 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:15.347994  5159 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:15.877338  4519 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:15.548084  3042 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:15.950911  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:15.909070  5063 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:15.908560  3795 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 341) took 2819 ms (client timeout 2999 ms). Trace:
I20260709 13:15:15.843847  4705 raft_consensus.cc:3055] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:15.855110  5136 raft_consensus.cc:3055] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:16.004256  4964 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:16.004873  4964 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:16.005312  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1476) took 2065 ms. Trace:
I20260709 13:15:16.005755  3051 rpcz_store.cc:276] 0709 13:15:13.940164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.940318 (+   154us) service_pool.cc:224] Handling call
0709 13:15:13.940657 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:15.310290 (+1369633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.005079 (+694789us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540028c654. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:16.005257 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3121412864}
I20260709 13:15:15.840358  5155 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:16.003854  5136 raft_consensus.cc:740] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:16.007002  4964 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:15.859217  4944 consensus_queue.cc:260] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:15.661314  5230 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:15:15.950279  3046 rpcz_store.cc:276] 0709 13:15:13.752860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.755022 (+  2162us) service_pool.cc:224] Handling call
0709 13:15:13.924927 (+169905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:13.925093 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:15.015576 (+1090483us) log.cc:844] Serialized 14 byte log entry
0709 13:15:15.366558 (+350982us) log.cc:844] Serialized 14 byte log entry
0709 13:15:15.366760 (+   202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:15.366801 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:15.366851 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.366962 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.367125 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29647,"prepare.queue_time_us":188262,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":84,"raft.queue_time_us":209486,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"thread_start_us":1381561,"threads_started":3,"wal-append.queue_time_us":299784}
I20260709 13:15:15.807112  4853 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:15.961076  5174 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:16.020696  5174 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:16.024255  5174 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:15.829594  5170 consensus_meta.cc:287] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.000s
I20260709 13:15:16.025490  5170 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:15.545609  5173 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 1.978s	user 0.009s	sys 0.002s
W20260709 13:15:15.962563  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.522135  5138 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.950433  3199 rpcz_store.cc:276] 0709 13:15:14.035205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.146441 (+111236us) service_pool.cc:224] Handling call
0709 13:15:15.386980 (+1240539us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b54003bb354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:15.387166 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2054092672}
W20260709 13:15:15.998379  3795 rpcz_store.cc:269] 0709 13:15:13.089107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.090652 (+  1545us) service_pool.cc:224] Handling call
0709 13:15:15.908235 (+2817583us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b5400691254. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:15.908433 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3945691392}
W20260709 13:15:16.000900  5208 consensus_meta.cc:287] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.003s
I20260709 13:15:15.541952  4756 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:15.864240  5195 consensus_meta.cc:287] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.742s	user 0.007s	sys 0.005s
I20260709 13:15:16.048681  5195 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:16.050868  4944 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:16.052215  5195 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:16.002200  4705 raft_consensus.cc:740] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:16.056977  5086 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:16.057519  5086 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.815554  5084 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:15.960363  5088 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:15:15.926821  5204 consensus_meta.cc:287] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.600s	user 0.004s	sys 0.007s
W20260709 13:15:15.526850  5231 log.cc:927] Time spent T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:15:15.519471  5073 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.519532  5237 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:15.883774  5048 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.057621  5159 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:16.032207  5170 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:15.801036  5176 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:16.143466  3047 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.053s	sys 0.178s
I20260709 13:15:15.953315  5244 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.883917  4835 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.747408  5169 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.951763  4760 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:15.505517  5081 consensus_queue.cc:237] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:15.514217  4692 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:15.774609  5181 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:15.803256  5182 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:16.055506  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 692304us
I20260709 13:15:16.153800  2947 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57750 (request call id 226) took 6699 ms. Trace:
W20260709 13:15:16.058368  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 107559us
I20260709 13:15:16.059902  3049 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:16.061362  3091 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:16.154206  2947 rpcz_store.cc:276] 0709 13:15:09.532944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.538261 (+  5317us) service_pool.cc:224] Handling call
0709 13:15:16.153707 (+6615446us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:11.943111 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:12.094528 (+151417us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:12.094587 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:15:12.094609 (+    22us) tablet.cc:662] Decoding operations
0709 13:15:12.095872 (+  1263us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:12.095975 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:12.096010 (+    35us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:15:12.159936 (+ 63926us) tablet.cc:701] Row locks acquired
0709 13:15:12.159982 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:15:12.160579 (+   597us) write_op.cc:270] Start()
0709 13:15:12.160741 (+   162us) write_op.cc:276] Timestamp: P: 1783602912160105 usec, L: 0
0709 13:15:12.160771 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:15:12.161474 (+   703us) log.cc:844] Serialized 5226 byte log entry
0709 13:15:12.666730 (+505256us) op_driver.cc:464] REPLICATION: finished
0709 13:15:12.765530 (+ 98800us) write_op.cc:301] APPLY: starting
0709 13:15:12.765633 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:12.765978 (+   345us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:12.766137 (+   159us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:13.309353 (+543216us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b5c00226d0c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff8365a5331 00007ff8365a5221 00007ff83659ff6c 00007ff833d0030b 00007ff833cfffd3 00007ff833dfee34 00007ff833dea97c 00007ff833deed61 00007ff833deed19 00007ff833deeca9 00007ff833deec71
0709 13:15:13.310813 (+  1460us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:13.311055 (+   242us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:15:13.311099 (+    44us) write_op.cc:312] APPLY: finished
0709 13:15:13.311419 (+   320us) log.cc:844] Serialized 95 byte log entry
0709 13:15:13.312274 (+   855us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:13.312417 (+   143us) write_op.cc:454] Released schema lock
0709 13:15:13.312463 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:13.314682 (+  2219us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:13.314714 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":867,"reported_tablets":26,"spinlock_wait_cycles":6912,"child_traces":[["op",{"apply.queue_time_us":98520,"apply.run_cpu_time_us":7777,"apply.run_wall_time_us":549132,"num_ops":13,"prepare.queue_time_us":195803,"prepare.run_cpu_time_us":101655,"prepare.run_wall_time_us":371422,"raft.queue_time_us":202269,"raft.run_cpu_time_us":40470,"raft.run_wall_time_us":97705,"replication_time_us":505685,"spinlock_wait_cycles":4700416,"thread_start_us":493583,"threads_started":4,"wal-append.queue_time_us":291386,"wal-append.run_cpu_time_us":20592,"wal-append.run_wall_time_us":1902425}]]}
I20260709 13:15:16.163159  3090 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:16.163570  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 102265us
I20260709 13:15:16.164722  3090 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:16.062139  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:16.167048  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:16.167905  3046 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:16.170006  5123 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:16.170574  5123 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.171015  5123 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:16.174005  5124 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:16.063568  3017 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.048s	sys 0.069s
I20260709 13:15:16.057972  5086 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:16.176949  3017 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.048s	sys 0.069s
I20260709 13:15:16.090440  3051 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:16.179340  3051 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:15.518157  5186 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:16.043995  5138 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.110603  5168 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.112979  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:16.114812  5073 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:16.013691  5136 consensus_queue.cc:260] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:15.952091  3200 rpcz_store.cc:276] 0709 13:15:13.908550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.908695 (+   145us) service_pool.cc:224] Handling call
0709 13:15:15.397629 (+1488934us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003bb354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303ad853 00007ff83537b60a 00007ff82e9017d4 00007ff82e901762 00007ff82e901691 00007ff82e90160c 00007ff82e9008c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:15.402334 (+  4705us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2511012224}
I20260709 13:15:16.042294  5208 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:16.196189  3044 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.001s	sys 0.016s
W20260709 13:15:16.196678  3044 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.001s	sys 0.016s
I20260709 13:15:16.057981  4705 consensus_queue.cc:260] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:16.055433  5047 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:15.776479  3792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 358) took 1728 ms. Trace:
I20260709 13:15:16.087574  5188 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:16.214192  3796 raft_consensus.cc:1240] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:16.189258  5118 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:15.755019  5044 consensus_queue.cc:237] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:16.149663  4835 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:16.146389  3047 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.054s	sys 0.179s
I20260709 13:15:16.227367  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1852) took 1066 ms. Trace:
I20260709 13:15:16.227852  3047 rpcz_store.cc:276] 0709 13:15:15.165833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.301230 (+135397us) service_pool.cc:224] Handling call
0709 13:15:15.308088 (+  6858us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:15.310012 (+  1924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.310057 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:15.312102 (+  2045us) log.cc:844] Serialized 26 byte log entry
0709 13:15:16.226997 (+914895us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:16.227042 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.227120 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.227160 (+    40us) raft_consensus.cc:1685] finished
0709 13:15:16.227172 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.227299 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1521,"raft.queue_time_us":14467,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"thread_start_us":878296,"threads_started":1,"wal-append.queue_time_us":889843}
W20260709 13:15:16.147128  3761 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.045s	sys 0.085s
W20260709 13:15:16.147025  3165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.050s	sys 0.080s
W20260709 13:15:16.234799  3165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.051s	sys 0.080s
W20260709 13:15:16.235481  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 933864us
I20260709 13:15:16.113876  5137 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.154215  3164 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:16.115963  5133 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:16.184247  3042 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 2: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:16.108721  5088 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:16.145546  5244 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:16.112190  5204 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:16.288695  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:16.193038  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:16.203115  5166 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:15:16.198405  5192 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:15:16.216224  3049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "f20672b2852447a6bc1e137c4dd40904"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:15:16.087652  5042 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:16.181233  5211 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
W20260709 13:15:16.229503  3761 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.046s	sys 0.085s
W20260709 13:15:16.324855  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 1.0086e+06us
I20260709 13:15:16.226449  3046 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
W20260709 13:15:16.237609  3015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.011s	sys 0.008s
I20260709 13:15:16.236253  3165 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:15:16.327068  3015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.011s	sys 0.008s
W20260709 13:15:16.327322  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 91157.7us
W20260709 13:15:16.327690  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 1.01505e+06us
W20260709 13:15:16.237998  3050 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.003s	sys 0.016s
W20260709 13:15:16.328331  3050 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.006s	sys 0.016s
I20260709 13:15:16.185349  5169 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:16.288853  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:16.290772  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 97935.1us
I20260709 13:15:16.332779  3090 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:16.333895  3165 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:16.326967  3049 raft_consensus.cc:606] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Received request to transfer leadership to TS f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:16.334934  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:16.335052  3049 raft_consensus.cc:614] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:16.269789  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:16.321213  5042 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.336732  5197 consensus_queue.cc:1059] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:16.337205  5042 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:16.236122  5118 raft_consensus.cc:697] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:15:16.191233  3048 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.005s	sys 0.012s
W20260709 13:15:16.343822  3048 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.005s	sys 0.012s
I20260709 13:15:16.203585  5170 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:15:16.296339  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:16.234942  4705 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:16.329116  3762 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:16.201820  5168 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:16.337872  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:16.291559  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 137426us
I20260709 13:15:16.226966  5188 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:16.348728  3121 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:16.320911  5047 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:16.393193  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:16.460906  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:16.461223  3122 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:16.393872  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:16.394255  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.324486  5112 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.462625  5112 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:16.462970  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:16.464210  3118 raft_consensus.cc:2410] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:16.465840  3121 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:16.356339  5171 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:16.396781  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:16.391963  5207 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:16.337946  4910 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:16.442482  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.479341  3117 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:16.394716  5159 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:15:16.449986  5189 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.056s	sys 0.096s
I20260709 13:15:16.287328  5182 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:16.492055  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:16.207290  4760 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:16.496488  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:16.443006  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:16.446724  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 117667us
I20260709 13:15:16.446831  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:16.448349  3043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 1837) took 3472 ms (client timeout 1732 ms). Trace:
W20260709 13:15:16.499579  3043 rpcz_store.cc:269] 0709 13:15:12.975628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.975790 (+   162us) service_pool.cc:224] Handling call
0709 13:15:16.448065 (+3472275us) spinlock_profiling.cc:243] Waited 3.28 s on lock 0x7b54003a8ed4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:16.448252 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7549533440}
I20260709 13:15:16.342764  5216 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:16.454607  3796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 361) took 2447 ms. Trace:
I20260709 13:15:16.453876  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:16.456331  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:16.520835  3047 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.342324  5084 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.471618  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:16.471109  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.472235  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:16.473382  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:16.397248  5197 raft_consensus.cc:3055] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:15:16.486603  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 279248us
I20260709 13:15:16.349730  4946 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.115s
I20260709 13:15:16.492851  3200 raft_consensus.cc:2368] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3.
I20260709 13:15:16.492535  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:16.595523  3196 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:16.493381  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:16.493650  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:16.596728  3198 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:16.339370  5137 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:16.465552  5047 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.618587  5047 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.620543  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:16.621469  3198 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:16.495051  3193 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:16.625084  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:16.626361  3015 connection.cc:256] RPC call timeout handler was delayed by -1.2508107490000384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 13:15:16.626940  3015 connection.cc:256] RPC call timeout handler was delayed by -1.2508107490000384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 13:15:16.627322  3015 connection.cc:256] RPC call timeout handler was delayed by -1.1311107489998449s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 13:15:16.627730  3015 connection.cc:256] RPC call timeout handler was delayed by -1.1311107489998449s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 13:15:16.628115  3015 connection.cc:256] RPC call timeout handler was delayed by -1.1095107490000373s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
W20260709 13:15:16.628476  3015 connection.cc:256] RPC call timeout handler was delayed by -1.1095107490000373s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
I20260709 13:15:16.495268  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:16.465121  5156 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:16.489414  5189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.057s	sys 0.097s
I20260709 13:15:16.475210  4910 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.395697  5176 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:15:16.518698  3197 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:16.474898  5171 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:16.342525  5089 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:16.475796  5229 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:16.535422  3051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:15:16.519529  3796 rpcz_store.cc:276] 0709 13:15:13.995882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.023416 (+ 27534us) service_pool.cc:224] Handling call
0709 13:15:14.105371 (+ 81955us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:16.214692 (+2109321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.443388 (+228696us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b5400236754. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:16.443626 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4849345920}
I20260709 13:15:16.598076  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:16.484088  5228 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:16.599498  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 147834us
I20260709 13:15:16.600910  5112 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:16.605506  5241 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:16.205920  3792 rpcz_store.cc:276] 0709 13:15:13.936353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.944733 (+  8380us) service_pool.cc:224] Handling call
0709 13:15:13.975647 (+ 30914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:13.975919 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:15.184583 (+1208664us) log.cc:844] Serialized 14 byte log entry
0709 13:15:15.484881 (+300298us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:15.513420 (+ 28539us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:15.518073 (+  4653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.529130 (+ 11057us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.664432 (+135302us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25156,"prepare.queue_time_us":1128478,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":28404,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":35615,"thread_start_us":1373535,"threads_started":2,"wal-append.queue_time_us":600408}
I20260709 13:15:16.607304  4946 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:16.608001  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:16.609189  5148 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.290887  5133 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:16.443008  5250 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.178s
I20260709 13:15:16.609797  5155 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.610671  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:16.610823  4835 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:16.614130  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1856) took 1427 ms. Trace:
W20260709 13:15:16.615269  5254 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:15:16.617955  5137 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:16.643743  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:15:16.581671  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.646055  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:16.497943  5049 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.622877  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:16.489255  5207 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:16.448730  5248 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.198s
I20260709 13:15:16.530076  5118 consensus_queue.cc:237] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:16.708402  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:16.715241  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:16.845466  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 215725us
I20260709 13:15:16.716277  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:16.847067  3015 leader_election.cc:400] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3.
I20260709 13:15:16.847391  3015 leader_election.cc:403] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:16.532511  5216 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.490868  5159 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:16.510299  5182 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:16.848683  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:16.850119  3200 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 1.
I20260709 13:15:16.749358  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:16.913261  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:16.851171  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 388151us
I20260709 13:15:16.920372  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:16.851895  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:16.851964  3164 connection.cc:256] RPC call timeout handler was delayed by -1.6491605080000227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
I20260709 13:15:16.921815  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:16.922391  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:16.922413  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:16.591974  4760 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:16.923257  3796 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:16.648623  5251 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.746546  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:16.742316  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:16.926045  3043 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:16.926574  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:16.926903  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:16.700817  3051 raft_consensus.cc:606] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:16.927902  3051 raft_consensus.cc:614] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:16.647032  5197 raft_consensus.cc:740] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:16.843400  3050 rpcz_store.cc:276] 0709 13:15:15.261600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.401957 (+140357us) service_pool.cc:224] Handling call
0709 13:15:15.406454 (+  4497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:15.406866 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.406911 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:15.407464 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:15:16.328708 (+921244us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:16.328748 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.328815 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.613850 (+285035us) raft_consensus.cc:1685] finished
0709 13:15:16.613879 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.614055 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":553318,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":86,"thread_start_us":801207,"threads_started":1,"wal-append.queue_time_us":988920}
I20260709 13:15:16.652892  4756 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.917794  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:16.866912  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:16.863693  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:16.854465  3122 raft_consensus.cc:2410] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:15:16.929785  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:16.933274  3200 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:15:16.783370  5260 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.496s	user 0.000s	sys 0.001s
W20260709 13:15:16.786687  5073 consensus_meta.cc:287] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.586s	user 0.012s	sys 0.000s
W20260709 13:15:16.772095  5252 log.cc:927] Time spent T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 13:15:16.707054  4910 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:16.969199  5185 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:15:16.984678  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1853) took 1810 ms. Trace:
W20260709 13:15:16.985489  5256 log.cc:927] Time spent T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:15:16.985121  3048 rpcz_store.cc:276] 0709 13:15:15.174088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.367345 (+193257us) service_pool.cc:224] Handling call
0709 13:15:15.367737 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:15.368149 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.368194 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:15.405130 (+ 36936us) log.cc:844] Serialized 26 byte log entry
0709 13:15:16.344320 (+939190us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:16.344377 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.344478 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.984466 (+639988us) raft_consensus.cc:1685] finished
0709 13:15:16.984484 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.984617 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41909,"raft.queue_time_us":585036,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":43252,"thread_start_us":828157,"threads_started":1,"wal-append.queue_time_us":808760}
I20260709 13:15:16.987218  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:16.987596  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:16.987927  3123 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:16.988873  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:16.989060  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:16.989949  3048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "f20672b2852447a6bc1e137c4dd40904"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:15:16.990063  5188 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:16.990481  3048 raft_consensus.cc:606] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Received request to transfer leadership to TS f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:16.991655  5182 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:16.976485  4835 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:16.929687  5170 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:15:16.994987  4835 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:16.932941  5189 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:16.940634  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:16.970398  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:16.720739  5156 raft_consensus.cc:697] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:16.998518  3050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:15:16.999086  3050 raft_consensus.cc:606] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:16.998631  5156 consensus_queue.cc:237] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:16.997664  5189 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.002806  5189 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:16.970765  3090 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:16.971277  5257 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.376s	user 0.001s	sys 0.000s
I20260709 13:15:16.753950  5191 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:17.006584  5191 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.007085  5191 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:16.764930  5208 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:16.784940  5249 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:16.972615  3196 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:16.968708  3192 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:16.974126  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:16.622352  5084 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:16.716564  5186 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:16.775573  5204 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:16.851044  5171 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.976917  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.032552  3119 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:17.033456  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:16.743130  4692 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:16.679685  5253 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.980643  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:16.860755  5176 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:16.860694  5216 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.969880  2946 catalog_manager.cc:5697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 4 to 5, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 5 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:16.997167  4835 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:16.969672  3047 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:17.009263  3048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "f20672b2852447a6bc1e137c4dd40904"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:15:16.605536  5086 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:16.747761  5168 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:16.794669  5088 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:16.857527  5207 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:16.923094  5089 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:16.979067  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:16.971939  3121 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:17.020125  5136 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:17.020819  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1851) took 1860 ms. Trace:
W20260709 13:15:17.022141  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 51466.8us
I20260709 13:15:16.942025  5137 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:17.030138  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.031123  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:17.028322  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.034119  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:16.861111  5155 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:16.954270  5251 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:16.861287  5148 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:17.020881  5169 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:16.871268  4946 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:17.169292  5265 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.171s	user 0.001s	sys 0.001s
I20260709 13:15:17.009021  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:17.023406  5095 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.868436  5049 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.041406  4978 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:16.871040  5241 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:17.063105  4692 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:17.165490  5048 consensus_meta.cc:287] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.048s	user 0.005s	sys 0.005s
W20260709 13:15:17.109506  4705 consensus_meta.cc:287] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.711s	user 0.008s	sys 0.001s
I20260709 13:15:17.182312  5133 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:16.981277  5073 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.075728  3195 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:17.177508  3048 raft_consensus.cc:606] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Received request to transfer leadership to TS f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:16.980705  5192 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.981381  4756 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:17.114205  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 192605us
I20260709 13:15:17.221773  3123 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:17.184341  3796 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:17.173674  2946 catalog_manager.cc:5697] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 3 to 4, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 4 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:15:17.046450  5244 consensus_meta.cc:287] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.715s	user 0.008s	sys 0.003s
I20260709 13:15:17.177340  3044 rpcz_store.cc:276] 0709 13:15:15.160541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.299223 (+138682us) service_pool.cc:224] Handling call
0709 13:15:15.312313 (+ 13090us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:15.502973 (+190660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.503020 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:15.503855 (+   835us) log.cc:844] Serialized 52 byte log entry
0709 13:15:16.197164 (+693309us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:16.197227 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.197325 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:17.020566 (+823241us) raft_consensus.cc:1685] finished
0709 13:15:17.020592 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.020761 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10461,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":71,"thread_start_us":883027,"threads_started":2,"wal-append.queue_time_us":789669}
I20260709 13:15:17.192948  3045 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
W20260709 13:15:17.194942  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.199612  4835 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:15:17.211594  5228 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.203137  3164 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:17.076001  4944 consensus_meta.cc:287] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.002s	user 0.010s	sys 0.001s
I20260709 13:15:17.208703  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.211804  3042 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:17.172778  5137 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.212456  3193 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
W20260709 13:15:17.064297  5268 log.cc:927] Time spent T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:15:17.216461  3119 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
W20260709 13:15:17.211656  5042 consensus_meta.cc:287] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.816s	user 0.011s	sys 0.000s
I20260709 13:15:17.220310  3198 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:17.213161  3091 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:17.230471  3761 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:17.048127  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:17.045262  5249 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.215986  4699 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:17.239858  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.240087  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:17.256196  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.265990  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:17.267051  5079 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.276588  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:17.220510  5124 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:17.231578  2946 catalog_manager.cc:5697] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:15:17.270864  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 57825us
I20260709 13:15:17.271121  3200 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:15:17.234865  3790 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
W20260709 13:15:17.273267  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 50890.7us
I20260709 13:15:17.232493  5090 raft_consensus.cc:1027] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: attempt to promote peer e9165fe61ab04bfb9a48889156d5c161: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:15:17.277032  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:17.291425  3117 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:15:17.278291  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 62990.8us
I20260709 13:15:17.279847  2946 catalog_manager.cc:5697] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 3 to 4, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 4 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.280740  3164 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:17.213492  5095 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:17.216986  4978 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:17.054364  5197 consensus_queue.cc:260] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.266230  5137 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.266222  5081 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:17.288941  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:17.075037  5253 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:17.322762  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:17.298012  3164 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:17.298415  3126 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:17.299365  2946 catalog_manager.cc:5697] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 2 to 4, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 4 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:15:17.266777  5228 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.325464  3200 raft_consensus.cc:2410] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:17.326342  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:17.326879  3200 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.326004  2946 catalog_manager.cc:5697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 1 to 3, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 3 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.327026  5228 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:17.327991  2946 catalog_manager.cc:5697] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 2 to 4, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 4 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:15:17.290192  5124 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.330286  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:17.330543  5148 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:17.331395  5124 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:17.332320  5273 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:15:17.333580  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.335260  5084 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:17.335347  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.303377  5259 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:17.291251  5237 consensus_meta.cc:287] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.147s	user 0.008s	sys 0.004s
I20260709 13:15:17.279170  5169 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:17.233316  5244 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.279558  5270 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:17.288633  4853 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:17.337929  3047 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:17.361716  5270 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.362063  5049 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:17.362291  5251 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:17.362897  5270 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:17.311383  5279 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:17.311812  5073 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:15:17.293931  5063 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.229964  5192 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:17.271116  5229 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:17.333716  5155 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:17.278553  5042 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:17.336969  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.303668  5249 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:17.305467  5159 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:17.309134  4959 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:17.276351  5079 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:17.340400  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.371912  5267 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:17.388584  5229 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.396777  5253 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:17.398366  3120 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 5: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:17.343750  3200 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
W20260709 13:15:16.220855  5226 consensus_queue.cc:1175] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aaf88538197a49adb8bcf3790309a67e" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:17.348042  3117 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:17.348579  2946 catalog_manager.cc:5697] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.283890  4699 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:17.296868  5171 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.339198  5044 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:17.365886  5138 consensus_meta.cc:287] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.185s	user 0.008s	sys 0.004s
I20260709 13:15:17.339578  5197 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:17.386036  3118 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 4. Ops: []
I20260709 13:15:17.339038  4944 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:17.363477  5208 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
W20260709 13:15:17.373438  5123 consensus_meta.cc:287] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.202s	user 0.009s	sys 0.005s
I20260709 13:15:17.337821  5237 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.371551  5124 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:17.398981  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 57660.9us
I20260709 13:15:17.403185  5267 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:17.399773  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.402869  2946 catalog_manager.cc:5697] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:15:17.440603  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.410949  5095 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:17.411820  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.448335  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.448036  5124 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:17.449070  3117 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:17.450026  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:17.450114  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:17.450730  3797 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.452875  3125 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:17.412796  5047 consensus_meta.cc:287] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.794s	user 0.005s	sys 0.004s
I20260709 13:15:17.414891  3195 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:17.415772  4910 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:17.416478  3795 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:15:17.418102  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 551256us
I20260709 13:15:17.383303  5063 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:17.455122  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:17.370930  5279 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.457047  3798 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEARNER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:17.427006  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.428177  5192 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:17.392470  5086 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:17.430074  4756 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:17.391950  4959 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.424886  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:17.476778  3200 raft_consensus.cc:2410] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:15:17.441370  2946 catalog_manager.cc:5697] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 2 to 4, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 4 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:15:17.478713  2946 catalog_manager.cc:5697] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 3 to 5, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 5 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.474514  4946 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:17.482272  4959 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.484073  5251 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.484663  5251 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.487008  5251 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:17.442345  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:17.489069  3197 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.438300  5138 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.445168  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:17.426693  5123 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.453168  5248 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:17.496948  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:17.435189  5181 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:17.498118  3194 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:17.494666  3796 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:17.472092  3797 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:17.441274  3119 raft_consensus.cc:2376] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6. Re-sending same reply.
I20260709 13:15:17.490469  3192 raft_consensus.cc:2368] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 2. Current term is 3.
I20260709 13:15:17.454694  5176 raft_consensus.cc:697] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:15:17.455721  5272 log.cc:927] Time spent T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:15:17.492574  3200 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:17.499550  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.480862  2946 catalog_manager.cc:5697] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 3 to 4, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 4 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:15:17.500264  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.500625  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:17.502988  3195 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:17.503450  2946 catalog_manager.cc:5697] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:15:17.504439  3200 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:15:17.503975  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:17.493497  5189 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:17.504877  2946 catalog_manager.cc:5697] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 2 to 3, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 3 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
W20260709 13:15:17.506747  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:17.508652  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.452806  5241 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:17.363976  5259 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.507388  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:17.506835  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:17.458873  5047 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.498724  5181 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:17.497359  5248 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.506830  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:17.514207  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.515053  3119 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:17.518610  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:17.504812  3200 pending_rounds.cc:85] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 2
I20260709 13:15:17.519490  3200 pending_rounds.cc:107] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:15:17.519737  3200 raft_consensus.cc:2889] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:17.511780  3797 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:17.500015  5279 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:17.509462  5093 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:17.523144  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:17.436342  5207 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.507649  5189 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:17.456113  5191 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:17.506052  5182 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:15:17.525357  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:17.556515  3191 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:17.568518  3197 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:17.562321  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:17.579777  3797 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:15:17.580896  3798 raft_consensus.cc:2368] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6.
I20260709 13:15:17.537001  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:17.586277  3119 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:17.589982  4699 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:17.590502  5089 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3.
I20260709 13:15:17.582212  5047 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:17.591925  3793 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:17.520573  5241 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:17.592249  5137 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:17.526656  5229 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:17.592638  5241 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:17.593307  5241 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:17.575359  5175 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:17.593885  5281 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:15:17.594156  5175 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:17.594631  5175 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:17.577580  4760 consensus_meta.cc:287] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.625s	user 0.008s	sys 0.003s
I20260709 13:15:17.590147  4910 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:17.518205  5181 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:17.577069  5189 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:17.603235  3123 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:17.550995  4756 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.577702  5093 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:17.606899  3199 raft_consensus.cc:2393] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:17.578632  5171 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:17.607546  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 85505.5us
I20260709 13:15:17.563275  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:17.578652  5237 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:17.571424  5176 consensus_queue.cc:237] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.520568  5253 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:15:17.612130  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.616035  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:17.615275  3119 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:17.616791  3799 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 5: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:17.601814  4699 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.603675  4946 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.619540  4699 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.620369  3051 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:17.563733  5216 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.610530  5093 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.624498  5267 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:17.625944  5207 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:17.613305  5248 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:17.562675  5246 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:15:17.631546  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.633893  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:17.633958  3119 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:17.634791  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1461) took 1031 ms. Trace:
I20260709 13:15:17.633226  5089 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:15:17.636783  5136 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:15:17.637923  4959 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.627224  5112 consensus_queue.cc:1059] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:15:17.612589  4756 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:17.659981  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.646674  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.635530  3195 rpcz_store.cc:276] 0709 13:15:16.603788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.507481 (+903693us) service_pool.cc:224] Handling call
0709 13:15:17.518976 (+ 11495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.522663 (+  3687us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:17.526370 (+  3707us) log.cc:844] Serialized 14 byte log entry
0709 13:15:17.634503 (+108133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:17.634540 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:17.634572 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.634655 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.634743 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29205,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":9201,"raft.run_wall_time_us":29729,"spinlock_wait_cycles":16572032,"thread_start_us":104291,"threads_started":1}
I20260709 13:15:17.639253  5248 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:17.661324  4959 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:17.673251  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1740) took 1024 ms. Trace:
W20260709 13:15:17.672147  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.672703  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.671976  5079 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:17.673722  3195 rpcz_store.cc:276] 0709 13:15:16.649175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.664210 (+1015035us) service_pool.cc:224] Handling call
0709 13:15:17.672734 (+  8524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.672921 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:17.672947 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:17.672986 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:17.673015 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.673066 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.673193 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:17.665175  5248 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:17.635015  4699 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:17.627951  4946 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.633311  5182 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:15:17.688066  3195 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:17.688341  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.666129  5137 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:17.688768  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1741) took 1039 ms. Trace:
I20260709 13:15:17.679417  5248 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.691005  3195 rpcz_store.cc:276] 0709 13:15:16.649439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.676237 (+1026798us) service_pool.cc:224] Handling call
0709 13:15:17.687736 (+ 11499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.688541 (+   805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.688719 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:17.682242  5259 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:17.698370  4946 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:17.700299  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:17.692294  5296 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:15:17.711483  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.711959  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1743) took 1061 ms. Trace:
I20260709 13:15:17.712105  3121 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:17.712322  3195 rpcz_store.cc:276] 0709 13:15:16.651156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.695677 (+1044521us) service_pool.cc:224] Handling call
0709 13:15:17.711422 (+ 15745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.711622 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:17.711650 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:17.711689 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:17.711722 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.711773 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.711902 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:17.715754  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:17.716836  3121 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 5: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:17.719722  4978 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:17.725941  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.726778  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1499) took 1227 ms. Trace:
I20260709 13:15:17.726974  3119 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:17.727137  3125 rpcz_store.cc:276] 0709 13:15:16.499025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.531246 (+ 32221us) service_pool.cc:224] Handling call
0709 13:15:16.681158 (+149912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.453422 (+772264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.726558 (+273136us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b540018a1d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:17.726721 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1774151936}
I20260709 13:15:17.728786  5216 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:17.730522  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55318 (request call id 256) took 1436 ms. Trace:
I20260709 13:15:17.730877  3120 rpcz_store.cc:276] 0709 13:15:16.294475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.295549 (+  1074us) service_pool.cc:224] Handling call
0709 13:15:17.730335 (+1434786us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540011c1d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:17.730466 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2300798848}
I20260709 13:15:17.731973  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:17.710460  5191 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:17.732650  3120 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:17.734684  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:17.735376  3799 raft_consensus.cc:2393] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:17.733224  3165 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:17.737037  3165 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:17.735458  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1744) took 1084 ms. Trace:
I20260709 13:15:17.738854  3195 rpcz_store.cc:276] 0709 13:15:16.651460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.722274 (+1070814us) service_pool.cc:224] Handling call
0709 13:15:17.734985 (+ 12711us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.735155 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:17.735177 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:17.735218 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:17.735247 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.735295 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.735394 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:17.741148  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:17.741703  3050 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.742030  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:17.742600  3043 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:17.743587  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:17.738744  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:17.744786  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:17.745920  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:17.746287  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:17.746482  3042 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:17.747035  3046 raft_consensus.cc:2410] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:17.746992  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:17.747980  3045 raft_consensus.cc:2410] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:17.748137  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:17.748679  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:17.749182  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:17.749454  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:17.749723  3046 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:17.749786  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:17.749207  3045 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:17.750564  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:17.752734  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1745) took 1101 ms. Trace:
I20260709 13:15:17.715760  5270 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.753062  3195 rpcz_store.cc:276] 0709 13:15:16.659665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.740043 (+1080378us) service_pool.cc:224] Handling call
0709 13:15:17.740321 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.740525 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:17.740831 (+   306us) log.cc:844] Serialized 14 byte log entry
0709 13:15:17.752489 (+ 11658us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:17.752535 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:17.752577 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.752620 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.752694 (+    74us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6939,"prepare.queue_time_us":150,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":7059,"thread_start_us":4320,"threads_started":1}
I20260709 13:15:17.754995  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.735942  5048 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:15:17.758109  5155 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.766067  5155 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:17.758664  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:17.761495  3119 raft_consensus.cc:2410] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:17.762758  3050 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:17.765319  4756 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:17.767284  3120 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.767253  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.770025  5155 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:17.771018  5181 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.763870  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:17.754146  4978 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.773290  3125 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:17.773214  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:17.779781  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1746) took 1119 ms. Trace:
I20260709 13:15:17.754371  4959 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:17.719956  5189 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.763619  5073 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:17.777853  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.754695  5047 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:17.780182  3195 rpcz_store.cc:276] 0709 13:15:16.660112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.761220 (+1101108us) service_pool.cc:224] Handling call
0709 13:15:17.777150 (+ 15930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.777346 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:17.777371 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:17.777410 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:17.777443 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.779625 (+  2182us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.779722 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:17.735924  5137 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:15:17.782477  3120 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:17.783157  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:17.784243  3042 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:17.786396  4959 raft_consensus.cc:697] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:17.785144  4978 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:17.791108  3045 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:17.794070  5241 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.799998  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:17.802889  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:17.801539  3046 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:17.785552  3119 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:17.807906  3121 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.806538  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.808597  3125 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:17.809177  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:17.806615  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.811124  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:17.811765  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:17.812903  3164 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:17.801121  5047 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.817049  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.814090  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:17.814790  3091 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:17.819175  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.820071  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.820571  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:17.822098  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.822501  3164 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:17.823803  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:17.826220  3117 raft_consensus.cc:2410] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:17.826516  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:17.814620  5155 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:17.813614  5048 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:17.817315  5086 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:17.831466  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:17.801605  5073 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:17.837417  3045 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:17.819576  5047 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.832772  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.789178  5093 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.833284  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.842039  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:17.834517  3195 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 5: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:17.834084  5086 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.835914  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:17.825347  5237 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:17.836268  5258 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:17.832360  5233 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:17.830928  5155 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:17.826995  5044 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:17.831063  5269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.004s	sys 0.018s
I20260709 13:15:17.827315  5249 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:17.828552  4756 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:17.837630  4978 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:17.832085  4959 consensus_queue.cc:237] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.862808  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:17.845218  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:17.863581  3119 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:17.863683  3195 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.846195  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:17.848045  3120 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:17.852118  3165 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:17.855198  3198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1456) took 1252 ms (client timeout 1531 ms). Trace:
I20260709 13:15:17.870205  3119 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
W20260709 13:15:17.870177  3198 rpcz_store.cc:269] 0709 13:15:16.602453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.622571 (+ 20118us) service_pool.cc:224] Handling call
0709 13:15:17.855033 (+1232462us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b5400043dd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:17.855143 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":866879232}
I20260709 13:15:17.854571  5137 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:17.841315  5124 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:17.848481  5086 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.844978  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:17.856621  5155 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:17.859297  5269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.004s	sys 0.019s
I20260709 13:15:17.872824  5175 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.860016  5258 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.858358  5044 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:15:17.874083  5300 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:15:17.859700  5233 raft_consensus.cc:697] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:17.861035  4756 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.877003  3195 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:17.870343  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1510) took 1019 ms. Trace:
I20260709 13:15:17.854895  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:17.858690  5073 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:17.878300  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.879853  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:17.882157  5090 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:17.898413  3120 rpcz_store.cc:276] 0709 13:15:16.851100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.826643 (+975543us) service_pool.cc:224] Handling call
0709 13:15:17.840086 (+ 13443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.870037 (+ 29951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.870239 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:17.882589  3165 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:17.878775  5137 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:15:17.883566  3193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1453) took 1282 ms (client timeout 1558 ms). Trace:
I20260709 13:15:17.884284  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1500) took 1364 ms. Trace:
I20260709 13:15:17.886600  5189 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:17.887645  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:17.889487  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.893263  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:17.905282  3198 raft_consensus.cc:2410] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:17.894764  5044 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:17.893620  5258 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:17.905992  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:17.967967  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 80402us
I20260709 13:15:17.972620  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:17.929085  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:17.905198  3193 rpcz_store.cc:269] 0709 13:15:16.601609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.624784 (+ 23175us) service_pool.cc:224] Handling call
0709 13:15:17.883381 (+1258597us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b540013d3d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:17.883490 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1348990208}
I20260709 13:15:17.934875  3121 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:17.974061  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 1499) took 1049 ms. Trace:
I20260709 13:15:17.974201  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:17.974504  3121 rpcz_store.cc:276] 0709 13:15:16.924657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.799706 (+875049us) service_pool.cc:224] Handling call
0709 13:15:17.973998 (+174292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:17.975837  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:17.975960  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:17.976691  3121 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 2: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:15:17.957509  5280 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.558s	user 0.000s	sys 0.003s
I20260709 13:15:17.953883  5248 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.952729  5175 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:17.969698  5137 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.898998  4756 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.954135  5093 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:17.942791  5233 consensus_queue.cc:237] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:17.971179  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:17.995141  3119 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:17.995842  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1511) took 1053 ms. Trace:
I20260709 13:15:17.996145  3119 rpcz_store.cc:276] 0709 13:15:16.942605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.994637 (+1052032us) service_pool.cc:224] Handling call
0709 13:15:17.994962 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.995611 (+   649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.995792 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:17.996546  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1496) took 1141 ms. Trace:
I20260709 13:15:17.978787  3124 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:17.967198  3118 rpcz_store.cc:276] 0709 13:15:16.519527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.521089 (+  1562us) service_pool.cc:224] Handling call
0709 13:15:16.605656 (+ 84567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.425566 (+819910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.884022 (+458456us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b54003e7e54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:17.884218 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1794203520}
I20260709 13:15:17.997293  3119 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:17.897383  5181 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:17.970168  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 116649us
I20260709 13:15:17.985039  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:17.998735  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:17.981102  3048 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:18.003152  3799 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 1 LEARNER]: Advancing to term 2
I20260709 13:15:17.970597  5229 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:17.971544  5088 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:17.976734  3193 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:15:17.971400  5090 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:18.006490  3118 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:18.009464  3796 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:17.980428  5270 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:18.010548  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:18.012776  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:18.012975  3193 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.997974  4692 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.996928  3121 rpcz_store.cc:276] 0709 13:15:16.854960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.992417 (+1137457us) service_pool.cc:224] Handling call
0709 13:15:17.995947 (+  3530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.996240 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:17.996266 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:17.996305 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:17.996340 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.996395 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.996499 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":5899}
I20260709 13:15:18.004350  4959 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:18.027709  5248 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:18.028437  4959 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:18.028784  4692 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:18.004639  5204 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:18.027604  3794 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEARNER]: Advancing to term 5
I20260709 13:15:18.030135  3125 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:18.030910  4959 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:18.008953  5088 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:18.031134  3122 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:18.031739  3792 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:18.031450  5086 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:18.007519  5155 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:18.032301  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:18.071684  3796 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:15:18.022226  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:18.073518  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 51410.9us
I20260709 13:15:18.074652  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:18.028136  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:18.033159  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:18.077838  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 44768.7us
I20260709 13:15:18.037147  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1450) took 1436 ms. Trace:
I20260709 13:15:18.078624  3196 rpcz_store.cc:276] 0709 13:15:16.600746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.610418 (+  9672us) service_pool.cc:224] Handling call
0709 13:15:18.036918 (+1426500us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540013bad4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:18.037065 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298934016}
W20260709 13:15:18.038218  5303 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:15:17.980759  5047 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:18.040122  5137 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:18.040539  3199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1439) took 1550 ms (client timeout 1836 ms). Trace:
I20260709 13:15:18.041448  3797 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEARNER]: Advancing to term 4
I20260709 13:15:18.046259  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:15:17.970279  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 87757us
I20260709 13:15:18.095846  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:18.095609  3199 rpcz_store.cc:269] 0709 13:15:16.489898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.493114 (+  3216us) service_pool.cc:224] Handling call
0709 13:15:18.040257 (+1547143us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002bc5d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:18.040456 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2323067648}
I20260709 13:15:18.096664  3165 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:18.047117  3050 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:18.097241  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:18.096735  3049 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:18.048316  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:18.098719  3118 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:15:18.099004  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 50803.6us
I20260709 13:15:18.100559  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:18.101477  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:18.046229  3799 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEARNER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:18.051386  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1494) took 1619 ms. Trace:
W20260709 13:15:18.052210  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.056805  3042 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:18.103883  3193 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:18.105121  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:18.106704  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:18.108116  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:18.061599  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:18.109555  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.110893  3090 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:18.112784  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:18.049221  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:18.113860  3046 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:18.118026  5073 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:18.082947  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:18.121291  3196 raft_consensus.cc:2368] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6.
I20260709 13:15:18.122332  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:18.123839  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:18.125842  5270 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:18.126566  5270 raft_consensus.cc:697] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:18.127794  5270 consensus_queue.cc:237] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:18.131253  3195 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 5: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:18.131356  3199 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:18.095580  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:18.134130  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:18.102550  3126 rpcz_store.cc:276] 0709 13:15:16.432565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.444931 (+ 12366us) service_pool.cc:224] Handling call
0709 13:15:16.445326 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.324454 (+879128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.051056 (+726602us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b540010d454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:18.051300 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1961377536}
I20260709 13:15:18.125174  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:18.139139  3046 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:18.141563  3090 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:18.143622  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:18.145462  3046 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:18.146477  3042 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:18.148623  3090 leader_election.cc:400] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6.
I20260709 13:15:18.148981  3090 leader_election.cc:403] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:18.111811  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:18.081523  5088 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:18.150059  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 48630.8us
I20260709 13:15:18.150624  3193 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 5: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:18.150835  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:18.152050  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:18.158538  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:18.152366  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:18.162761  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 66167.9us
I20260709 13:15:18.164196  3165 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:18.165205  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.168265  3042 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:18.082538  5185 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:18.173578  3165 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:18.178812  5093 consensus_queue.cc:1059] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:18.077427  5204 raft_consensus.cc:697] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:18.131487  5250 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:18.176019  3197 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:18.094034  4853 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:18.171857  5186 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:18.173947  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:18.180475  3165 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:18.180786  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:18.170516  5248 raft_consensus.cc:2764] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:15:18.181278  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:18.186475  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:18.204548  3049 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 5: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:18.179710  5301 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:18.155522  5166 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:18.152161  4835 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:18.180365  5249 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:18.181607  5237 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.156406  5269 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:18.152282  5276 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:18.200201  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:18.181037  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:18.201437  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:18.202356  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:18.151993  5181 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:18.177203  5185 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:18.224995  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:18.149497  5229 consensus_queue.cc:1059] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:15:18.222347  3797 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEARNER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:18.204399  5189 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:18.181344  5208 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:15:18.202310  4853 raft_consensus.cc:697] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:15:18.215217  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 66748.4us
I20260709 13:15:18.189159  5250 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:18.224937  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:18.207080  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:18.208477  5301 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.237215  3799 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:18.219972  5090 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:18.243830  3090 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:18.217329  3046 raft_consensus.cc:3055] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:18.364949  3046 raft_consensus.cc:740] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:18.250157  4978 raft_consensus.cc:2764] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:15:18.222031  5186 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6.
I20260709 13:15:18.251485  5250 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.233609  5093 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:18.262342  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:18.266623  4853 consensus_queue.cc:237] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:18.218377  4835 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:18.234172  5185 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:18.224903  5181 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:15:18.418506  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:18.350163  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 99259us
W20260709 13:15:18.323087  5273 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:15:18.277388  5301 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.371170  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:18.366082  3046 consensus_queue.cc:260] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:18.397557  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:18.277885  4893 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:15:18.439822  3044 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:18.447477  4893 consensus_queue.cc:1059] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:18.448501  4893 consensus_queue.cc:1243] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:18.451933  4959 raft_consensus.cc:3055] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:18.452412  4959 raft_consensus.cc:740] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:18.452590  5063 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:18.404410  5090 raft_consensus.cc:697] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:15:18.459020  3124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 1491) took 2121 ms (client timeout 1660 ms). Trace:
I20260709 13:15:18.459699  5090 consensus_queue.cc:237] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:18.460671  5088 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:18.462626  3042 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:18.463694  5047 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:18.341420  5204 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:18.459446  3124 rpcz_store.cc:269] 0709 13:15:16.337424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.337698 (+   274us) service_pool.cc:224] Handling call
0709 13:15:17.961291 (+1623593us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54002dbf20. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83032adc0 00007ff8303b6e18 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:18.458803 (+497512us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54000a9954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:18.458912 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142959232}
I20260709 13:15:18.413705  4835 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.474390  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1502) took 1496 ms. Trace:
I20260709 13:15:18.366536  4705 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.476007  4705 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:18.425863  5042 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:18.401163  5306 log.cc:927] Time spent T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.160s	user 0.002s	sys 0.016s
I20260709 13:15:18.475268  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:18.486984  3048 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:18.478330  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 297939us
I20260709 13:15:18.423380  5181 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.467237  5123 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:18.489774  3165 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:15:18.538705  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 49047.7us
I20260709 13:15:18.539803  3165 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:18.557828  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:18.561834  3761 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:18.457489  4756 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:18.429538  4978 consensus_queue.cc:1059] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:15:18.600205  3761 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:18.467810  5189 consensus_queue.cc:1059] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 13:15:18.453370  4959 consensus_queue.cc:260] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:18.614615  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:18.618500  3045 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:18.618574  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:18.621006  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1511) took 1572 ms. Trace:
I20260709 13:15:18.628135  3050 raft_consensus.cc:2393] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:18.602205  5063 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:18.586248  5207 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:18.627533  3119 rpcz_store.cc:276] 0709 13:15:17.048437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.001272 (+952835us) service_pool.cc:224] Handling call
0709 13:15:18.001714 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.003359 (+  1645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.003404 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:18.004068 (+   664us) log.cc:844] Serialized 26 byte log entry
0709 13:15:18.128645 (+124577us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:18.128690 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.128775 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:18.620705 (+491930us) raft_consensus.cc:1685] finished
0709 13:15:18.620735 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.620930 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1240,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":2804,"thread_start_us":123424,"threads_started":1,"wal-append.queue_time_us":203181}
I20260709 13:15:18.643589  3119 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:18.605881  5266 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:18.619455  5269 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:18.641377  5123 consensus_queue.cc:1059] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:18.617550  5042 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:15:18.669240  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 267) took 1216 ms. Trace:
I20260709 13:15:18.602371  5208 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:18.669948  3126 rpcz_store.cc:276] 0709 13:15:17.452677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.135764 (+683087us) service_pool.cc:224] Handling call
0709 13:15:18.136207 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.136490 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:18.354537 (+218047us) log.cc:844] Serialized 14 byte log entry
0709 13:15:18.668807 (+314270us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:18.668875 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:18.668937 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.669022 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.669173 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18422,"prepare.queue_time_us":235550,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"thread_start_us":523332,"threads_started":2}
I20260709 13:15:18.625396  5229 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:15:18.667548  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:18.604244  5047 consensus_queue.cc:1059] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
W20260709 13:15:18.648535  3794 consensus_meta.cc:287] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.002s
I20260709 13:15:18.666323  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1517) took 1143 ms. Trace:
I20260709 13:15:18.685302  3119 rpcz_store.cc:276] 0709 13:15:17.523407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.643073 (+1119666us) service_pool.cc:224] Handling call
0709 13:15:18.643401 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.649239 (+  5838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.666244 (+ 17005us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:18.656848  5266 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.686360  3045 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:18.687165  3119 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:18.688019  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:18.688560  3119 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:18.684013  3126 raft_consensus.cc:1275] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:18.701002  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1518) took 1173 ms. Trace:
I20260709 13:15:18.701613  3126 rpcz_store.cc:276] 0709 13:15:17.527259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.676149 (+1148890us) service_pool.cc:224] Handling call
0709 13:15:18.676544 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.700622 (+ 24078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.700923 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:18.478231  3120 rpcz_store.cc:276] 0709 13:15:16.977518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.994652 (+1017134us) service_pool.cc:224] Handling call
0709 13:15:18.007989 (+ 13337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.008268 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:18.171179 (+162911us) log.cc:844] Serialized 14 byte log entry
0709 13:15:18.471382 (+300203us) log.cc:844] Serialized 14 byte log entry
0709 13:15:18.474007 (+  2625us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:18.474063 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:18.474111 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.474195 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.474329 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26402,"prepare.queue_time_us":216033,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":2438,"thread_start_us":455501,"threads_started":2}
I20260709 13:15:18.640496  3048 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
W20260709 13:15:18.734357  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 490589us
I20260709 13:15:18.735664  3090 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:18.666749  4705 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:18.659955  5207 raft_consensus.cc:697] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:18.753445  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1526) took 1056 ms. Trace:
I20260709 13:15:18.771550  3119 rpcz_store.cc:276] 0709 13:15:17.696786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.687980 (+991194us) service_pool.cc:224] Handling call
0709 13:15:18.688282 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.709451 (+ 21169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.753377 (+ 43926us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:18.755017  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1517) took 1562 ms. Trace:
I20260709 13:15:18.773852  3121 rpcz_store.cc:276] 0709 13:15:17.192358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.015806 (+823448us) service_pool.cc:224] Handling call
0709 13:15:18.016924 (+  1118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.018706 (+  1782us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:18.273920 (+255214us) log.cc:844] Serialized 14 byte log entry
0709 13:15:18.754645 (+480725us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:18.754700 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:18.754751 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.754827 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.754953 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49898,"prepare.queue_time_us":255223,"prepare.run_cpu_time_us":3846,"prepare.run_wall_time_us":27298,"thread_start_us":562077,"threads_started":2,"wal-append.queue_time_us":295638}
I20260709 13:15:18.760023  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:18.669605  5063 raft_consensus.cc:697] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:18.780553  3048 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:18.784366  3048 raft_consensus.cc:1240] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:18.703648  5258 consensus_meta.cc:287] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.710s	user 0.004s	sys 0.011s
I20260709 13:15:18.684809  5229 consensus_queue.cc:1243] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:18.790714  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:18.755276  5166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.015s	sys 0.031s
I20260709 13:15:18.805814  5192 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:18.808933  3192 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34728 (request call id 236) took 2147 ms (client timeout 2139 ms). Trace:
W20260709 13:15:18.809072  3793 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 357) took 5066 ms (client timeout 1503 ms). Trace:
W20260709 13:15:18.810014  3117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 1498) took 1889 ms (client timeout 2154 ms). Trace:
I20260709 13:15:18.687566  5208 raft_consensus.cc:697] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:15:18.945935  3117 rpcz_store.cc:269] 0709 13:15:16.920611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.449776 (+529165us) service_pool.cc:224] Handling call
0709 13:15:18.809807 (+1360031us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54000a8554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:18.809954 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":862970752}
I20260709 13:15:18.753515  5266 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:18.757987  5197 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:18.703171  5204 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 13:15:18.789480  5138 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:18.809949  3794 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEARNER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
W20260709 13:15:18.839306  5044 consensus_meta.cc:287] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.857s	user 0.005s	sys 0.006s
I20260709 13:15:18.855746  5088 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:18.869856  5304 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.500s	user 0.003s	sys 0.000s
W20260709 13:15:18.898866  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 258236us
I20260709 13:15:18.861779  5301 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:18.890165  4978 raft_consensus.cc:3055] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:18.912855  3124 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:18.950511  5269 raft_consensus.cc:697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:18.959041  3794 pending_rounds.cc:85] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: Aborting all ops after (but not including) 2
I20260709 13:15:18.864339  5063 consensus_queue.cc:237] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:18.928320  5312 log.cc:927] Time spent T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:15:18.862800  5207 consensus_queue.cc:237] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:18.898640  4756 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:18.944221  3192 rpcz_store.cc:269] 0709 13:15:16.661045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.029052 (+368007us) service_pool.cc:224] Handling call
0709 13:15:18.808669 (+1779617us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b5400037354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:18.808846 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":728464128}
W20260709 13:15:18.949093  5185 consensus_meta.cc:287] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.001s
I20260709 13:15:18.942175  5166 raft_consensus.cc:697] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:15:18.968587  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 148800us
I20260709 13:15:18.989691  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:18.920457  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 304516us
I20260709 13:15:18.969353  4978 raft_consensus.cc:740] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:15:18.974301  5327 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:15:18.961486  5189 raft_consensus.cc:3055] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:18.944506  5258 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:19.001973  3762 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:19.016521  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.972347  3794 pending_rounds.cc:107] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:15:19.029444  5330 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:19.029518  4978 consensus_queue.cc:260] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:19.030582  5314 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:19.033393  4835 consensus_meta.cc:287] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.523s	user 0.005s	sys 0.001s
W20260709 13:15:19.034423  5326 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:15:19.035260  5331 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:15:19.036191  5342 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:15:18.945691  3793 rpcz_store.cc:269] 0709 13:15:13.742804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.746403 (+  3599us) service_pool.cc:224] Handling call
0709 13:15:18.808826 (+5062423us) spinlock_profiling.cc:243] Waited 3.49 s on lock 0x7b54005f0354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:18.808964 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8036201856}
W20260709 13:15:19.038391  5250 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.624s	user 0.006s	sys 0.005s
I20260709 13:15:19.040211  5208 consensus_queue.cc:237] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:19.071043  3794 raft_consensus.cc:2889] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:18.987368  5317 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.161s	user 0.001s	sys 0.001s
W20260709 13:15:19.090296  5181 consensus_meta.cc:287] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.541s	user 0.012s	sys 0.001s
I20260709 13:15:19.050173  5301 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:19.052048  5320 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:15:19.093078  5258 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:18.964951  5044 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:19.094444  3794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 368) took 1094 ms. Trace:
I20260709 13:15:19.094951  3794 rpcz_store.cc:276] 0709 13:15:18.000542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.002627 (+  2085us) service_pool.cc:224] Handling call
0709 13:15:18.027408 (+ 24781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.094173 (+1066765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.094380 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:19.095804  5044 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:19.063023  5241 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:19.077509  5314 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:19.097977  5073 raft_consensus.cc:3055] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:19.098732  5073 raft_consensus.cc:740] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:19.099303  5314 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:19.099819  5073 consensus_queue.cc:260] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:19.102015  4978 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:19.102167  5136 raft_consensus.cc:3055] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:19.102818  5136 raft_consensus.cc:740] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:19.103926  5136 consensus_queue.cc:260] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:19.064672  5189 raft_consensus.cc:740] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:19.042656  5166 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:19.072190  5159 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:19.109299  5159 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:19.109727  5159 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:19.088107  3798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 377) took 1045 ms. Trace:
I20260709 13:15:19.073961  5330 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:19.083930  5250 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:19.027787  5185 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:19.054013  5237 consensus_meta.cc:287] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.829s	user 0.009s	sys 0.004s
I20260709 13:15:19.093241  5244 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:19.094549  5155 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:19.054795  5269 consensus_queue.cc:237] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:19.119357  5136 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:19.101679  5073 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:18.914628  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 493779us
W20260709 13:15:18.952080  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 195303us
W20260709 13:15:19.175858  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:19.176154  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 211038us
W20260709 13:15:19.223955  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:19.224517  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.947615  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 268) took 1494 ms. Trace:
I20260709 13:15:19.178273  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:19.225951  5192 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:19.182725  3120 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:15:19.184221  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 264) took 1841 ms. Trace:
I20260709 13:15:19.225860  3118 rpcz_store.cc:276] 0709 13:15:17.452996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.196245 (+743249us) service_pool.cc:224] Handling call
0709 13:15:18.206217 (+  9972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.206484 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:18.587897 (+381413us) log.cc:844] Serialized 14 byte log entry
0709 13:15:18.923845 (+335948us) log.cc:844] Serialized 14 byte log entry
0709 13:15:18.924423 (+   578us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:18.924612 (+   189us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:18.924774 (+   162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.925043 (+   269us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.947528 (+ 22485us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1543,"prepare.queue_time_us":192581,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":100,"raft.queue_time_us":21757,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":12501,"spinlock_wait_cycles":6978944,"thread_start_us":696626,"threads_started":2,"wal-append.queue_time_us":443021}
I20260709 13:15:19.228189  3122 rpcz_store.cc:276] 0709 13:15:17.342478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.096641 (+754163us) service_pool.cc:224] Handling call
0709 13:15:18.153234 (+ 56593us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.153707 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.153834 (+   127us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:18.154390 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:15:18.373013 (+218623us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:18.373069 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.373163 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:19.183597 (+810434us) raft_consensus.cc:1685] finished
0709 13:15:19.183643 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.183995 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17338,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8811,"thread_start_us":218253,"threads_started":1,"wal-append.queue_time_us":490046}
I20260709 13:15:19.184475  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1527) took 1487 ms. Trace:
I20260709 13:15:19.063969  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1438) took 2574 ms. Trace:
I20260709 13:15:19.232772  5124 consensus_queue.cc:1059] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:19.232734  3191 rpcz_store.cc:276] 0709 13:15:16.489618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.489783 (+   165us) service_pool.cc:224] Handling call
0709 13:15:16.505704 (+ 15921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.578047 (+1072343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.063626 (+1485579us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001b80d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:19.063864 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2404745600}
I20260709 13:15:19.232466  3126 rpcz_store.cc:276] 0709 13:15:17.697077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.703004 (+1005927us) service_pool.cc:224] Handling call
0709 13:15:18.703369 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.754166 (+ 50797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.754199 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:18.772435 (+ 18236us) log.cc:844] Serialized 26 byte log entry
0709 13:15:18.944426 (+171991us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:18.944479 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.944551 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:19.183659 (+239108us) raft_consensus.cc:1685] finished
0709 13:15:19.183714 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.184134 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70323,"raft.queue_time_us":85301,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":14988,"thread_start_us":103750,"threads_started":1,"wal-append.queue_time_us":232210}
I20260709 13:15:19.236284  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:19.187680  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 234) took 2527 ms. Trace:
I20260709 13:15:19.237888  3196 rpcz_store.cc:276] 0709 13:15:16.660451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.152545 (+1492094us) service_pool.cc:224] Handling call
0709 13:15:18.170650 (+ 18105us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.172237 (+  1587us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:18.197366 (+ 25129us) log.cc:844] Serialized 14 byte log entry
0709 13:15:18.705774 (+508408us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:18.706399 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 13:15:18.758872 (+ 52473us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:18.949533 (+190661us) log.cc:844] Serialized 14 byte log entry
0709 13:15:18.949779 (+   246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.949874 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:19.186906 (+237032us) raft_consensus.cc:1685] finished
0709 13:15:19.186956 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.187378 (+   422us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":186429,"prepare.queue_time_us":340186,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":11880,"raft.queue_time_us":129483,"raft.run_cpu_time_us":449,"raft.run_wall_time_us":21029,"thread_start_us":542202,"threads_started":2,"wal-append.queue_time_us":468766}
I20260709 13:15:19.240036  3090 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:19.205365  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:19.066987  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 65243.6us
I20260709 13:15:19.076984  4835 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:19.066238  4910 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:19.112053  3798 rpcz_store.cc:276] 0709 13:15:18.042491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.131546 (+ 89055us) service_pool.cc:224] Handling call
0709 13:15:18.182541 (+ 50995us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.182966 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.183002 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:18.466028 (+283026us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b4c000efa40. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82e67fa20 00007ff82e690a29 00007ff82e656644 00007ff82e67df2d 00007ff82e67db93 00007ff8303ae18b 00007ff8303aecb5 00007ff8303b0004 00007ff8303af729 00007ff8303b4d96 00007ff8303a9adb
0709 13:15:18.466889 (+   861us) log.cc:844] Serialized 564 byte log entry
0709 13:15:18.815295 (+348406us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:18.815348 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.815444 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:19.087773 (+272329us) raft_consensus.cc:1685] finished
0709 13:15:19.087807 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.088027 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10268416,"thread_start_us":348057,"threads_started":1,"wal-append.queue_time_us":478713}
I20260709 13:15:19.112512  5181 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:19.131390  5185 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:19.132695  5189 consensus_queue.cc:260] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:19.122139  5237 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:19.127669  5250 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:19.127130  5266 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:19.125578  5330 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:19.217640  5095 consensus_queue.cc:1059] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:19.187683  3198 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:19.241479  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:19.289152  5124 raft_consensus.cc:3055] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:19.289819  5124 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:19.291268  5189 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:19.291289  5124 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:19.292397  3046 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:19.293551  5124 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:19.295854  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:19.296940  3191 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:19.281445  5207 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:19.302382  5207 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:19.303006  4835 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:19.280728  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:19.273535  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:19.275290  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:19.266561  3090 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:19.333401  3046 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:19.311795  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:19.278478  5048 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:19.365329  5048 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:19.365585  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:19.311432  3762 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:19.371676  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:19.372927  5207 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:19.424225  3193 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:19.426450  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 237) took 2765 ms. Trace:
I20260709 13:15:19.322763  5266 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:19.426893  3193 rpcz_store.cc:276] 0709 13:15:16.661316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.160004 (+1498688us) service_pool.cc:224] Handling call
0709 13:15:19.423708 (+1263704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.424880 (+  1172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.426186 (+  1306us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54003bae50. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:19.426384 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2884429184}
I20260709 13:15:19.428407  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:19.429538  3196 raft_consensus.cc:2393] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:19.430799  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:19.431620  3196 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 3.
I20260709 13:15:19.432384  5086 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:19.432622  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:19.375159  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:19.375494  5159 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:19.243906  5339 consensus_queue.cc:1059] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.133s
I20260709 13:15:19.246866  5192 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:19.368553  5048 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:19.369439  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1899) took 1156 ms. Trace:
I20260709 13:15:19.341074  5181 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:19.319749  3192 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:19.312155  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:19.442109  3046 rpcz_store.cc:276] 0709 13:15:18.213421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.216373 (+  2952us) service_pool.cc:224] Handling call
0709 13:15:18.217180 (+   807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.291797 (+1074617us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b5800750bd0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83030f0aa 00007ff830391447 00007ff8303a9fe7 00007ff8303ab7de 00007ff8303b5b49 00007ff8303b6416 00007ff8303b2d8f 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4
0709 13:15:19.363533 (+ 71736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.369325 (+  5792us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1104203008}
I20260709 13:15:19.267146  5226 consensus_queue.cc:1059] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.108s
I20260709 13:15:19.443748  3047 raft_consensus.cc:2410] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:19.444407  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 1513) took 1697 ms. Trace:
I20260709 13:15:19.444792  3047 rpcz_store.cc:276] 0709 13:15:17.746950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.748953 (+  2003us) service_pool.cc:224] Handling call
0709 13:15:19.311825 (+1562872us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b5800000f98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28eeee 0000000000375939 00007ff8353021e0 00007ff8353cb0c4 00007ff8353cb131 00007ff8353790a0 00007ff835378984 00007ff82e8f36d4 00007ff82e8f3662
0709 13:15:19.444294 (+132469us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8195200}
I20260709 13:15:19.273557  3091 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:19.387207  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1447) took 2857 ms. Trace:
I20260709 13:15:19.446491  3194 rpcz_store.cc:276] 0709 13:15:16.529795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.631192 (+101397us) service_pool.cc:224] Handling call
0709 13:15:16.644454 (+ 13262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.499402 (+854948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.386608 (+1887206us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b540002b2d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:19.386970 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1962771712}
I20260709 13:15:19.448662  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:19.450131  5124 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:19.437557  5159 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:19.393304  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1736) took 2745 ms. Trace:
I20260709 13:15:19.394937  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1763) took 1563 ms. Trace:
I20260709 13:15:19.433422  3196 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:19.396926  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1738) took 2748 ms. Trace:
I20260709 13:15:19.404385  3191 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:19.412663  3795 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:15:19.415657  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:19.415956  3126 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:19.428450  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:19.390760  3195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1759) took 1574 ms (client timeout 1750 ms). Trace:
W20260709 13:15:19.452049  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 178843us
I20260709 13:15:19.452806  3199 rpcz_store.cc:276] 0709 13:15:17.831302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.097003 (+265701us) service_pool.cc:224] Handling call
0709 13:15:19.394453 (+1297450us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b54003bb354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:19.394728 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75965312}
I20260709 13:15:19.473150  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:19.453474  3197 rpcz_store.cc:276] 0709 13:15:16.648550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.641911 (+993361us) service_pool.cc:224] Handling call
0709 13:15:18.037888 (+395977us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.198441 (+160553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.395906 (+1197465us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540013bad4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:19.396531 (+   625us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b540013bad0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:19.396739 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1155961984}
W20260709 13:15:19.459455  3195 rpcz_store.cc:269] 0709 13:15:17.816523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.971696 (+155173us) service_pool.cc:224] Handling call
0709 13:15:19.390263 (+1418567us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54003bae54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:19.390552 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302607104}
I20260709 13:15:19.497347  4692 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:19.497785  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:19.528820  5042 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:19.529613  5042 raft_consensus.cc:697] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:19.530553  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:19.531044  5042 consensus_queue.cc:237] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:19.533553  5339 raft_consensus.cc:3055] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:19.533667  3196 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:19.534157  5339 raft_consensus.cc:740] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:19.534741  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:19.539011  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:19.539736  5226 raft_consensus.cc:3055] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:19.540238  5226 raft_consensus.cc:740] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:19.540939  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:19.540287  3191 raft_consensus.cc:2393] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 5: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:19.536909  3793 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:19.595996  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1765) took 1016 ms. Trace:
I20260709 13:15:19.598964  3193 rpcz_store.cc:276] 0709 13:15:18.580053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.428027 (+847974us) service_pool.cc:224] Handling call
0709 13:15:19.595915 (+167888us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67200}
I20260709 13:15:19.615448  3091 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:19.614209  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:19.618258  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 351881us
I20260709 13:15:19.622735  3125 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:15:19.623708  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.625396  3199 raft_consensus.cc:2410] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:15:19.627348  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1769) took 1046 ms. Trace:
I20260709 13:15:19.627904  3199 rpcz_store.cc:276] 0709 13:15:18.581299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.518924 (+937625us) service_pool.cc:224] Handling call
0709 13:15:19.627263 (+108339us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:19.630831  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:19.629235  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 318180us
I20260709 13:15:19.611658  3795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 370) took 1597 ms. Trace:
I20260709 13:15:19.634331  3795 rpcz_store.cc:276] 0709 13:15:18.001409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.002673 (+  1264us) service_pool.cc:224] Handling call
0709 13:15:19.411732 (+1409059us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b58000c4b98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff83538cfc0 00007ff835377929 00007ff8353773d2 00007ff82e8eebd4
0709 13:15:19.412132 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:19.477274 (+ 65142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.595742 (+118468us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26545408}
I20260709 13:15:19.632990  5079 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:19.636044  5079 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.636520  5079 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:19.637943  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.639627  5339 consensus_queue.cc:260] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:19.633473  3123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 1504) took 2613 ms (client timeout 2072 ms). Trace:
W20260709 13:15:19.640921  3123 rpcz_store.cc:269] 0709 13:15:17.019443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.475680 (+456237us) service_pool.cc:224] Handling call
0709 13:15:19.632960 (+2157280us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54003e8354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:19.633201 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230877056}
I20260709 13:15:19.642504  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:19.645131  4959 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:19.646522  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:19.626561  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:19.641424  5339 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:19.452487  3200 rpcz_store.cc:276] 0709 13:15:16.647945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.525583 (+877638us) service_pool.cc:224] Handling call
0709 13:15:17.855579 (+329996us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:17.858848 (+  3269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:17.858879 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:17.859265 (+   386us) log.cc:844] Serialized 26 byte log entry
0709 13:15:18.039588 (+180323us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b48001b0258. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff8352dcaa1 00007ff8352d3b37 00007ff8352d39ca 00007ff8353cb26f 00007ff8353caf37 00007ff8353df55c 00007ff8353df508 00007ff8353df488 00007ff8353df443 00007ff8353de6ec 00007ff834308a96
0709 13:15:18.808097 (+768509us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b18003c3a00. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:15:18.956500 (+148403us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:19.065222 (+108722us) log.cc:844] Serialized 14 byte log entry
0709 13:15:19.065548 (+   326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.065663 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:19.065726 (+    63us) raft_consensus.cc:1685] finished
0709 13:15:19.065787 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.392877 (+327090us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b5400043dd0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:19.393095 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2799,"prepare.queue_time_us":148526,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":4806,"raft.run_cpu_time_us":1431,"raft.run_wall_time_us":183274,"spinlock_wait_cycles":774188672,"thread_start_us":246267,"threads_started":2,"wal-append.queue_time_us":1165520}
I20260709 13:15:19.648259  5137 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:19.648836  5197 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:19.661454  5197 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.650384  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:19.650683  5175 raft_consensus.cc:3055] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:19.651191  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:19.651499  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:19.651782  5277 raft_consensus.cc:3055] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:19.652715  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:19.668208  3791 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:15:19.662005  5197 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:19.663883  5175 raft_consensus.cc:740] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:19.675624  5175 consensus_queue.cc:260] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:19.677172  5175 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:19.665849  5277 raft_consensus.cc:740] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:19.679075  5258 raft_consensus.cc:3055] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:19.679534  5258 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:19.680088  5277 consensus_queue.cc:260] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:19.680676  5258 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:19.682152  5258 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:19.652818  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:19.653952  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:19.648306  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 143461us
I20260709 13:15:19.629611  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:19.657379  3199 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:19.647351  3794 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:15:19.659164  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0461761730000489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
I20260709 13:15:19.687759  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:19.689302  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:19.663615  5192 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:19.690642  3197 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:19.690835  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:19.691773  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:19.693084  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:19.692121  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:19.701894  3197 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:19.710175  3200 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:19.710213  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:19.700981  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:19.700832  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:19.727250  4893 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:19.727422  5321 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:19.728209  4893 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:19.734009  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.736953  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:19.737821  5285 log.cc:927] Time spent T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 2.271s	user 0.007s	sys 0.009s
I20260709 13:15:19.741966  3048 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:19.743093  3198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1755) took 1953 ms (client timeout 1825 ms). Trace:
I20260709 13:15:19.748338  3196 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:19.749564  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 143406us
W20260709 13:15:19.750066  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 91541.4us
W20260709 13:15:19.743726  3198 rpcz_store.cc:269] 0709 13:15:17.789255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.972353 (+183098us) service_pool.cc:224] Handling call
0709 13:15:19.742731 (+1770378us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54002bbbd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:19.742983 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2790741376}
I20260709 13:15:19.723872  5189 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:19.759291  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1889) took 1669 ms. Trace:
I20260709 13:15:19.759428  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:19.760071  3198 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:19.759824  3042 rpcz_store.cc:276] 0709 13:15:18.085931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.169524 (+ 83593us) service_pool.cc:224] Handling call
0709 13:15:18.169932 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.463010 (+293078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.754006 (+1290996us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54001ae5d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:19.755478 (+  1472us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672700288}
I20260709 13:15:19.726435  5181 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:19.783295  3762 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:19.784072  3090 leader_election.cc:400] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6.
I20260709 13:15:19.785274  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:19.786013  4893 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:19.786656  3793 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
W20260709 13:15:19.799716  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.790268  5269 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:19.792294  3048 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:19.794723  4978 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.797611  3050 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:15:19.798550  3044 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:19.798308  5191 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:19.789496  5192 consensus_queue.cc:1059] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:19.800247  3198 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:19.791085  5277 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:19.806605  3199 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:19.810056  4692 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:19.810743  5192 raft_consensus.cc:3055] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:19.810890  5186 consensus_queue.cc:1059] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:15:19.811286  5192 raft_consensus.cc:740] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:19.811908  5186 raft_consensus.cc:3055] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:15:19.811854  3192 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1767) took 1231 ms (client timeout 1554 ms). Trace:
I20260709 13:15:19.813066  3042 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:19.812520  3192 rpcz_store.cc:269] 0709 13:15:18.580693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.982691 (+401998us) service_pool.cc:224] Handling call
0709 13:15:19.811650 (+828959us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b5400179154. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:19.811770 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":683320576}
I20260709 13:15:19.812518  5192 consensus_queue.cc:260] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:19.814177  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:19.780093  5189 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:19.818761  3192 raft_consensus.cc:2393] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 5: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:19.812425  5186 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:19.820171  5186 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:19.820655  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:19.821630  5186 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:19.822340  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:19.823035  3192 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:19.823009  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:19.824457  3199 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:19.803563  4835 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.826159  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:19.826103  4835 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:19.827044  3126 raft_consensus.cc:2393] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:19.827606  5093 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:19.827732  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:19.827915  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:19.828217  5093 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:19.825135  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:19.829169  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:19.829389  3198 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:19.830139  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:19.830559  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 239) took 3168 ms. Trace:
I20260709 13:15:19.831277  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:19.830927  3192 rpcz_store.cc:276] 0709 13:15:16.662171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.829690 (+3167519us) service_pool.cc:224] Handling call
0709 13:15:19.830051 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.830238 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:19.830262 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:19.830315 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:19.830343 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.830392 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.830492 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:19.832453  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:19.833914  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 238) took 3172 ms. Trace:
I20260709 13:15:19.834424  3198 rpcz_store.cc:276] 0709 13:15:16.661615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.828881 (+3167266us) service_pool.cc:224] Handling call
0709 13:15:19.829232 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.829839 (+   607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.833816 (+  3977us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:19.834951  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:19.835623  3125 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:19.835832  3198 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:19.836630  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1749) took 2073 ms. Trace:
I20260709 13:15:19.837007  3198 rpcz_store.cc:276] 0709 13:15:17.763025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.835150 (+2072125us) service_pool.cc:224] Handling call
0709 13:15:19.835476 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:19.836311 (+   835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.836543 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:19.844663  4978 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:19.833511  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:19.851970  3199 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:19.852172  3200 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:15:19.808084  5191 consensus_queue.cc:1243] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:19.858770  5192 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:19.857973  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.873180  3196 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:19.874001  3199 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:19.816176  5181 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:19.875386  4978 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:19.885265  3761 leader_election.cc:336] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 2.176s (SENT)
I20260709 13:15:19.875084  5189 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:19.813649  5226 consensus_queue.cc:260] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:19.940104  3200 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:19.874450  5079 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:19.950156  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1754) took 2162 ms. Trace:
I20260709 13:15:19.950662  3200 rpcz_store.cc:276] 0709 13:15:17.784410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.852892 (+2068482us) service_pool.cc:224] Handling call
0709 13:15:19.931152 (+ 78260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:19.946519 (+ 15367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.946698 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:19.937817  3761 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:19.963212  5181 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:19.966020  5197 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:19.967787  5226 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:19.978235  3796 raft_consensus.cc:2368] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5.
I20260709 13:15:19.971740  5269 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:19.995826  4835 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:20.000419  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:20.004913  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 201265us
W20260709 13:15:20.005937  5359 log.cc:927] Time spent T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:15:20.007555  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 122703us
I20260709 13:15:20.011925  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:20.012128  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:20.012118  5197 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:20.084153  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 53107.5us
I20260709 13:15:20.085846  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:20.087419  5079 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:20.088376  4978 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:20.089681  4893 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:20.091154  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:20.090508  4893 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:20.100642  5189 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:20.080327  5112 consensus_queue.cc:1059] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:15:20.101248  5189 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:20.095332  5181 consensus_queue.cc:1059] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:15:20.107246  5112 raft_consensus.cc:3055] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:20.107724  5112 raft_consensus.cc:740] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:20.108778  5112 consensus_queue.cc:260] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.110265  5181 raft_consensus.cc:3055] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:20.110796  5181 raft_consensus.cc:740] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:20.111891  5181 consensus_queue.cc:260] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.113883  5181 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:20.124091  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:20.125618  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:20.128683  5366 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:20.130287  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:20.130712  3194 raft_consensus.cc:2410] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:15:20.135728  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 248) took 1378 ms. Trace:
I20260709 13:15:20.139041  5368 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:20.139760  5368 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:20.136536  5366 raft_consensus.cc:697] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:20.145191  5368 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:20.136420  3195 rpcz_store.cc:276] 0709 13:15:18.757697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.001579 (+1243882us) service_pool.cc:224] Handling call
0709 13:15:20.008299 (+  6720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:20.016129 (+  7830us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:20.092029 (+ 75900us) log.cc:844] Serialized 14 byte log entry
0709 13:15:20.135291 (+ 43262us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:20.135359 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:20.135406 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.135478 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:20.135629 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":77880,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":1048,"thread_start_us":96013,"threads_started":2,"wal-append.queue_time_us":38239}
I20260709 13:15:20.147303  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:20.148026  5369 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:20.148242  3195 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:20.148757  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:20.149706  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 250) took 1355 ms. Trace:
I20260709 13:15:20.149397  5366 consensus_queue.cc:237] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.150193  3195 rpcz_store.cc:276] 0709 13:15:18.795030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.147389 (+1352359us) service_pool.cc:224] Handling call
0709 13:15:20.147797 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:20.149356 (+  1559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.149613 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:20.151852  3195 raft_consensus.cc:1240] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:20.152527  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1464) took 1166 ms. Trace:
I20260709 13:15:20.152900  3195 rpcz_store.cc:276] 0709 13:15:18.986633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.151197 (+1164564us) service_pool.cc:224] Handling call
0709 13:15:20.151620 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:20.152262 (+   642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.152450 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:20.154417  3196 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:20.154443  3195 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:15:20.155033  3195 pending_rounds.cc:85] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 2
I20260709 13:15:20.155295  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1756) took 2349 ms. Trace:
I20260709 13:15:20.155707  3196 rpcz_store.cc:276] 0709 13:15:17.807398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.874738 (+2067340us) service_pool.cc:224] Handling call
0709 13:15:19.952531 (+ 77793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:20.155028 (+202497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.155224 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:20.157128  3196 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:15:20.157693  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1471) took 1147 ms. Trace:
W20260709 13:15:20.158237  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 254788us
I20260709 13:15:20.155282  3195 pending_rounds.cc:107] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:15:20.158859  3195 raft_consensus.cc:2917] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:15:20.159376  3195 raft_consensus.cc:2889] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:20.160611  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1467) took 1151 ms. Trace:
I20260709 13:15:20.160912  3195 rpcz_store.cc:276] 0709 13:15:19.009427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.153731 (+1144304us) service_pool.cc:224] Handling call
0709 13:15:20.154077 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:20.160373 (+  6296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.160561 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:20.165616  3200 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:20.167528  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1775) took 1450 ms. Trace:
I20260709 13:15:20.167845  3200 rpcz_store.cc:276] 0709 13:15:18.717405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.970879 (+1253474us) service_pool.cc:224] Handling call
0709 13:15:20.165151 (+194272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:20.167221 (+  2070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.167451 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:20.169298  3200 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:20.170930  3200 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:20.172062  3200 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:15:20.174329  3200 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:20.176350  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34718 (request call id 13) took 3206 ms. Trace:
I20260709 13:15:20.178777  3200 rpcz_store.cc:276] 0709 13:15:16.969725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.175104 (+3205379us) service_pool.cc:224] Handling call
0709 13:15:20.176262 (+  1158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:20.165616  3195 raft_consensus.cc:1240] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:15:20.181267  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:20.181820  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1473) took 1170 ms. Trace:
I20260709 13:15:20.182325  3195 rpcz_store.cc:276] 0709 13:15:19.011480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.161578 (+1150098us) service_pool.cc:224] Handling call
0709 13:15:20.165341 (+  3763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:20.181523 (+ 16182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.181713 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:20.180240  5371 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:20.190282  5374 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:20.192929  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:20.194360  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:20.161654  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1748) took 2398 ms. Trace:
I20260709 13:15:20.221935  3192 rpcz_store.cc:276] 0709 13:15:17.762772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.832532 (+2069760us) service_pool.cc:224] Handling call
0709 13:15:19.832883 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:19.849986 (+ 17103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:19.850020 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:19.870341 (+ 20321us) log.cc:844] Serialized 26 byte log entry
0709 13:15:20.160905 (+290564us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:20.161215 (+   310us) log.cc:844] Serialized 14 byte log entry
0709 13:15:20.161387 (+   172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.161451 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:20.161485 (+    34us) raft_consensus.cc:1685] finished
0709 13:15:20.161495 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:20.161603 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":173,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":16657,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":22776,"thread_start_us":228162,"threads_started":1,"wal-append.queue_time_us":153774}
I20260709 13:15:20.158012  3196 rpcz_store.cc:276] 0709 13:15:19.010761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.156445 (+1145684us) service_pool.cc:224] Handling call
0709 13:15:20.156914 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:20.157451 (+   537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.157647 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:20.257349  5368 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.259945  5368 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:20.260742  5368 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:20.261200  5368 raft_consensus.cc:697] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:20.277109  5368 consensus_queue.cc:237] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.287878  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1514) took 2772 ms. Trace:
I20260709 13:15:20.288599  3124 rpcz_store.cc:276] 0709 13:15:17.515800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.468636 (+952836us) service_pool.cc:224] Handling call
0709 13:15:18.481570 (+ 12934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.969797 (+488227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.282302 (+1312505us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54002585d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:20.287683 (+  5381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":991215872}
I20260709 13:15:20.290555  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:20.291632  3124 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:20.293628  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:20.295431  3122 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:20.296947  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:20.298578  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:20.300310  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:20.300709  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.304750  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:20.308269  3123 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:20.323066  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:20.310078  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:20.315316  3045 pending_rounds.cc:85] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 3
I20260709 13:15:20.332089  3045 pending_rounds.cc:107] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:15:20.332448  3045 raft_consensus.cc:2889] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:20.315843  3125 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:20.316803  5322 consensus_queue.cc:1059] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:20.317723  3122 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:20.098397  4893 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:20.319350  5370 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:20.309818  3126 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:20.325898  5093 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:20.327236  5369 raft_consensus.cc:697] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:20.328121  5368 consensus_queue.cc:1059] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:20.331297  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1753) took 2551 ms. Trace:
I20260709 13:15:20.344343  5373 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.347056  3199 rpcz_store.cc:276] 0709 13:15:17.779548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.852639 (+2073091us) service_pool.cc:224] Handling call
0709 13:15:19.873827 (+ 21188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.874414 (+   587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.331040 (+456626us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b540013d8d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:20.331227 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34596224}
I20260709 13:15:20.339788  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:20.348340  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:20.349592  3125 raft_consensus.cc:2368] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4.
I20260709 13:15:20.349148  5373 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:20.353142  5373 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:20.354359  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:20.355082  3050 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:20.359607  5093 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:20.361104  5322 raft_consensus.cc:3055] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:20.361816  3042 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:20.362713  5369 consensus_queue.cc:237] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.361176  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:20.364573  3122 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:20.365981  3117 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:20.366212  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:20.369861  5370 raft_consensus.cc:697] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:20.370961  5370 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:20.344874  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 168266us
I20260709 13:15:20.373275  3164 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:20.375311  3164 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:20.376479  3117 raft_consensus.cc:2410] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:20.340296  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 269) took 2434 ms. Trace:
I20260709 13:15:20.378082  3120 rpcz_store.cc:276] 0709 13:15:17.906170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.717404 (+811234us) service_pool.cc:224] Handling call
0709 13:15:18.796568 (+ 79164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:19.227439 (+430871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.339974 (+1112535us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54000a9454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:20.340222 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886099200}
I20260709 13:15:20.361775  5322 raft_consensus.cc:740] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:20.377592  3164 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:20.341239  3123 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:20.344189  3124 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:20.395172  3050 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:20.396968  3091 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:20.407823  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 212201us
I20260709 13:15:20.413818  3123 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:20.414459  3120 raft_consensus.cc:1275] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:20.415535  3123 raft_consensus.cc:1275] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:20.415740  5322 consensus_queue.cc:260] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.409453  5277 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:20.413640  5249 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:20.419279  4910 raft_consensus.cc:2764] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:15:20.419380  5322 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:20.410851  5371 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:20.418589  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:20.423754  4893 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.419209  5277 raft_consensus.cc:697] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:20.427681  5277 consensus_queue.cc:237] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.430449  5375 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:20.432037  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:20.432986  5375 raft_consensus.cc:2764] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:15:20.433068  3164 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:20.434798  5249 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:20.434899  5375 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:20.435482  5249 raft_consensus.cc:697] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:20.437150  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:20.436818  5249 consensus_queue.cc:237] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.412708  5373 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:20.442703  5377 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:20.443645  4910 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:20.444064  3165 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.129:44609 timed out after 2.386s (SENT) [suppressed 27 similar messages]
I20260709 13:15:20.444133  4910 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.104221  5189 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:20.449656  4910 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:20.456205  5377 consensus_queue.cc:1059] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:20.457722  5375 raft_consensus.cc:3055] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:20.458317  5375 raft_consensus.cc:740] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:20.462024  3164 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:20.459787  5375 consensus_queue.cc:260] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:20.468150  4893 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:20.469983  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 684761us
I20260709 13:15:20.470325  5375 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:20.471475  3090 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:20.472354  5322 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:20.472824  3090 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:20.473714  5322 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:20.474200  3090 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:20.474373  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:20.475028  5322 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:20.475302  4910 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:20.475790  4910 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:20.475807  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:20.476305  4910 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:20.464051  5377 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:15:20.479853  3090 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:20.490376  4835 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:20.495289  3164 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:20.098953  4978 consensus_queue.cc:1059] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.401s
I20260709 13:15:20.495090  5373 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:20.502786  5377 raft_consensus.cc:3055] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:20.503297  5377 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:20.503335  5373 raft_consensus.cc:697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:20.504361  5377 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.505854  5377 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:20.508800  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:20.511783  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.515677  5189 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.518260  5371 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:20.524356  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 44627.1us
I20260709 13:15:20.532364  5112 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:20.537928  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 49030.5us
I20260709 13:15:20.541267  4910 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:20.546573  3194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1776) took 1828 ms (client timeout 2144 ms). Trace:
W20260709 13:15:20.553994  3194 rpcz_store.cc:269] 0709 13:15:18.717702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.448170 (+730468us) service_pool.cc:224] Handling call
0709 13:15:20.538898 (+1090728us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b540013c4d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:20.539110 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1565372800}
W20260709 13:15:20.562461  3198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.019s	sys 0.000s
W20260709 13:15:20.562948  3198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.020s	sys 0.000s
I20260709 13:15:20.564096  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1750) took 2800 ms. Trace:
I20260709 13:15:20.566241  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:20.564648  3198 rpcz_store.cc:276] 0709 13:15:17.763210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.837900 (+2074690us) service_pool.cc:224] Handling call
0709 13:15:19.838807 (+   907us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:19.871048 (+ 32241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:19.871165 (+   117us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:19.931726 (+ 60561us) log.cc:844] Serialized 52 byte log entry
0709 13:15:20.408743 (+477017us) spinlock_profiling.cc:243] Waited 8.21 ms on lock 0x7b48001b0258. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff8352dcaa1 00007ff8352d3b37 00007ff8352d39ca 00007ff8353cb26f 00007ff8353caf37 00007ff8353df55c 00007ff8353df508 00007ff8353df488 00007ff8353df443 00007ff8353de6ec 00007ff834308a96
0709 13:15:20.563460 (+154717us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:20.563524 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.563629 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:20.563693 (+    64us) raft_consensus.cc:1685] finished
0709 13:15:20.563714 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:20.564011 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14231,"raft.queue_time_us":27366,"raft.run_cpu_time_us":5072,"raft.run_wall_time_us":541565,"spinlock_wait_cycles":18877696,"thread_start_us":596278,"threads_started":1,"wal-append.queue_time_us":68901}
I20260709 13:15:20.567306  4835 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:20.567860  3090 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:20.567986  4835 raft_consensus.cc:697] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:20.570144  5322 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:20.570951  5322 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:20.571117  5181 consensus_queue.cc:1059] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:20.572139  5322 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:20.572515  5322 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:20.572904  5377 raft_consensus.cc:3055] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:20.573325  5377 raft_consensus.cc:740] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:20.574505  5377 consensus_queue.cc:260] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:20.569578  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:20.575872  5377 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:20.576826  3090 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:20.505123  5373 consensus_queue.cc:237] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:20.582229  4910 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:20.582943  4910 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:20.583339  4910 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.583772  4910 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:20.589056  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 101200us
I20260709 13:15:20.589541  3049 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:20.590176  3164 leader_election.cc:400] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4.
I20260709 13:15:20.569407  4835 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:20.590577  3164 leader_election.cc:403] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:15:20.593927  5137 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:20.594846  5137 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:20.594249  5322 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.596236  5322 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:20.587947  5375 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:15:20.600207  5375 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:20.594218  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:20.612430  3048 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:20.614822  3762 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:20.617420  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:20.589056  5390 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:20.621990  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.621918  3164 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:20.622612  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.623579  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:20.624030  3050 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:15:20.624392  3050 pending_rounds.cc:85] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 6
I20260709 13:15:20.624634  3050 pending_rounds.cc:107] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:15:20.606835  5249 raft_consensus.cc:2764] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:15:20.625813  5249 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:20.626274  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:20.626507  5249 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:20.627478  5390 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:20.628419  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:20.628432  3122 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:20.630506  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:20.630658  5159 consensus_queue.cc:1059] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:20.631121  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:20.631949  3123 raft_consensus.cc:2410] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:15:20.632464  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:20.632779  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:20.617960  5277 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:20.633665  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:20.631748  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:20.635805  3191 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:20.624873  3164 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:20.624876  3050 raft_consensus.cc:2889] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:20.636458  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:20.637462  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 60773.6us
I20260709 13:15:20.637854  3123 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:20.638541  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:20.629460  5390 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:20.644697  3197 consensus_meta.cc:287] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.926s	user 0.012s	sys 0.001s
I20260709 13:15:20.646401  3197 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
W20260709 13:15:20.647065  3197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1768) took 2066 ms (client timeout 2675 ms). Trace:
W20260709 13:15:20.647306  3197 rpcz_store.cc:269] 0709 13:15:18.580991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.692788 (+1111797us) service_pool.cc:224] Handling call
0709 13:15:20.647011 (+954223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:20.644632  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:20.653041  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:20.682487  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 44053.3us
I20260709 13:15:20.631754  5159 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:20.706241  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.707262  3125 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:20.707633  4910 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.708456  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:20.709059  3125 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:20.710089  3194 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:20.702374  5159 raft_consensus.cc:697] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:20.686652  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:20.687628  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:20.636706  5197 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:20.689347  3045 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:20.653841  3122 raft_consensus.cc:2376] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3. Re-sending same reply.
I20260709 13:15:20.711648  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:20.698247  5189 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:20.621208  5166 consensus_queue.cc:1059] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:15:20.643888  5322 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:20.698925  5395 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:15:20.699190  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 74405.2us
I20260709 13:15:20.731917  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:20.733958  5390 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:20.735360  5375 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.733559  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:20.713120  3191 raft_consensus.cc:2393] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 5: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:20.709684  4910 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:20.736063  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.734344  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:20.713510  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:20.737769  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:20.738119  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:20.741928  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:20.743192  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 125960us
I20260709 13:15:20.726378  5373 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:20.749259  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:20.752305  3090 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:20.755095  3122 raft_consensus.cc:2393] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 4: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:20.744451  5390 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:20.744201  5371 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:20.757833  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:20.758354  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:20.758517  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46935us
I20260709 13:15:20.749081  5377 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.762434  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:20.756490  5322 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:20.771674  5377 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:20.772719  3043 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.041s	user 0.003s	sys 0.024s
W20260709 13:15:20.773217  3043 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.003s	sys 0.024s
I20260709 13:15:20.774740  5181 consensus_queue.cc:1059] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:20.775740  5181 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:20.777264  5181 consensus_queue.cc:1059] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:20.777897  4978 consensus_queue.cc:1059] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:20.778189  5175 raft_consensus.cc:3055] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:20.778630  5175 raft_consensus.cc:740] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:20.748543  5375 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.779026  5322 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.779568  5175 consensus_queue.cc:260] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.779598  5322 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:20.781848  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:20.783146  5322 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:20.783821  3125 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:15:20.751642  5159 consensus_queue.cc:237] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:20.781057  5375 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:20.797834  5390 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.798488  5390 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:20.801381  3047 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.108s	user 0.023s	sys 0.023s
W20260709 13:15:20.801892  3047 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.023s	sys 0.023s
I20260709 13:15:20.802906  5374 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:20.804766  5377 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:20.802913  5175 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:20.806998  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 54772.8us
I20260709 13:15:20.808156  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:20.803066  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 242) took 1111 ms. Trace:
I20260709 13:15:20.777390  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:20.785513  3125 raft_consensus.cc:1240] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:20.809224  4910 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:20.824707  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:20.830116  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 52795us
I20260709 13:15:20.809705  3043 rpcz_store.cc:276] 0709 13:15:19.691318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.693683 (+  2365us) service_pool.cc:224] Handling call
0709 13:15:19.713882 (+ 20199us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:19.719075 (+  5193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:19.719111 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:19.730928 (+ 11817us) log.cc:844] Serialized 26 byte log entry
0709 13:15:20.773673 (+1042745us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:20.773732 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.802811 (+ 29079us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:20.802856 (+    45us) raft_consensus.cc:1685] finished
0709 13:15:20.802870 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:20.803010 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3332,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":2430,"thread_start_us":1042211,"threads_started":1,"wal-append.queue_time_us":200095}
I20260709 13:15:20.824371  5374 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:20.833228  5374 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:20.835265  5396 raft_consensus.cc:3055] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:20.835858  5396 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:20.838131  5079 raft_consensus.cc:3055] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:20.838678  5079 raft_consensus.cc:740] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:20.839798  5079 consensus_queue.cc:260] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:20.809132  5373 consensus_queue.cc:1059] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:15:20.842831  4910 raft_consensus.cc:3055] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:20.837057  5396 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:20.843199  4910 raft_consensus.cc:740] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:20.843937  5396 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:20.844166  4910 consensus_queue.cc:260] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:20.845168  3761 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:20.850214  5079 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:20.850518  5377 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.851210  5377 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.830149  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:20.854882  5377 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:20.855373  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:20.856041  3123 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
W20260709 13:15:20.856228  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 48148us
I20260709 13:15:20.856920  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:20.862962  3045 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:20.857653  3123 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:20.845607  4910 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:20.874544  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 240) took 1189 ms. Trace:
I20260709 13:15:20.877350  3122 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:20.850246  5189 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:20.879096  5189 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:20.879508  5189 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:20.883795  3046 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:20.884737  5277 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:20.873945  5322 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:20.890075  5166 consensus_queue.cc:1059] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:20.885931  5197 consensus_queue.cc:1059] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:20.891707  5197 raft_consensus.cc:3055] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:20.892067  5197 raft_consensus.cc:740] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:15:20.885614  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 123299us
W20260709 13:15:20.890292  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 45230.2us
I20260709 13:15:20.893082  5197 consensus_queue.cc:260] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:20.894961  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:20.895380  5197 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:20.893573  5316 consensus_queue.cc:1059] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:20.896799  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:20.897212  5374 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:20.899468  5226 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:20.899540  5374 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:20.899762  5042 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:20.900116  5226 raft_consensus.cc:697] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:20.900692  5042 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:20.900926  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:20.901516  3118 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:20.901132  5226 consensus_queue.cc:237] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.902508  5321 raft_consensus.cc:3055] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:20.910950  5321 raft_consensus.cc:740] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:20.911640  5322 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:20.911842  5321 consensus_queue.cc:260] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.904735  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:20.886638  5390 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:20.906495  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1536) took 1082 ms. Trace:
I20260709 13:15:20.909827  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:20.905015  5079 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:15:20.918072  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 169779us
I20260709 13:15:20.913841  3117 rpcz_store.cc:276] 0709 13:15:19.823643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.377194 (+553551us) service_pool.cc:224] Handling call
0709 13:15:20.377569 (+   375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:20.410465 (+ 32896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:20.410485 (+    20us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:20.413150 (+  2665us) log.cc:844] Serialized 52 byte log entry
0709 13:15:20.712608 (+299458us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:20.727772 (+ 15164us) log.cc:844] Serialized 14 byte log entry
0709 13:15:20.728009 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.728100 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:20.906268 (+178168us) raft_consensus.cc:1685] finished
0709 13:15:20.906286 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:20.906434 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15569,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":69,"raft.queue_time_us":15045,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":192,"thread_start_us":295950,"threads_started":1,"wal-append.queue_time_us":406347}
I20260709 13:15:20.876955  3047 rpcz_store.cc:276] 0709 13:15:19.690595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.692611 (+  2016us) service_pool.cc:224] Handling call
0709 13:15:19.693062 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.693388 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:20.802293 (+1108905us) log.cc:844] Serialized 14 byte log entry
0709 13:15:20.873928 (+ 71635us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:20.874227 (+   299us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:20.874338 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.874403 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:20.874498 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":248398,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":150,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":17459,"thread_start_us":1179123,"threads_started":2,"wal-append.queue_time_us":91851}
I20260709 13:15:20.910034  5374 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.926921  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:20.918826  5321 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:20.923863  5137 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4.
I20260709 13:15:20.931546  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:20.934689  3125 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:20.932960  3117 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:20.942173  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:20.943754  5377 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.944324  4910 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:20.944362  5377 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:20.950660  3043 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:20.951738  5377 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:20.953615  3123 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:20.954239  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:20.956727  3042 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 13:15:20.957110  3042 pending_rounds.cc:85] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 7
I20260709 13:15:20.959509  3042 pending_rounds.cc:107] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:15:20.959764  5322 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:15:20.960861  5322 raft_consensus.cc:3055] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:20.961210  5322 raft_consensus.cc:740] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:15:20.961328  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 66558.4us
I20260709 13:15:20.962091  5322 consensus_queue.cc:260] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.962643  3124 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:20.963299  5322 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:20.963532  3761 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:20.963915  3124 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:20.959786  3042 raft_consensus.cc:2889] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:20.930231  5399 raft_consensus.cc:3055] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:20.972859  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:20.975201  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:20.976008  3123 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 5: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:20.969348  3118 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:20.981873  5390 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:20.924147  5374 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:20.987336  3117 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:20.987840  3122 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
W20260709 13:15:20.988517  3165 leader_election.cc:336] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Timed out: RequestConsensusVote RPC to 127.1.227.129:44609 timed out after 1.748s (SENT)
I20260709 13:15:20.992973  3165 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:20.994853  3123 raft_consensus.cc:1275] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:20.975165  5399 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:15:20.999217  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 79128.5us
I20260709 13:15:19.953963  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:21.000658  3762 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:21.007930  3122 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:21.009820  4835 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:21.014829  3119 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:21.015640  3090 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:20.990639  5390 raft_consensus.cc:697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:15:21.018235  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:21.027659  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.027493  5249 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:21.029513  4893 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:21.030197  4893 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:21.030980  3049 raft_consensus.cc:1275] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:15:21.031621  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.030229  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:21.034293  3042 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:21.030663  5390 consensus_queue.cc:237] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
W20260709 13:15:21.036196  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.036602  3050 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:15:21.037000  3050 pending_rounds.cc:85] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 2
I20260709 13:15:21.037236  3050 pending_rounds.cc:107] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:15:21.037472  3050 raft_consensus.cc:2889] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:21.038800  5373 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
W20260709 13:15:21.042654  3126 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 1531) took 1220 ms (client timeout 1578 ms). Trace:
W20260709 13:15:21.043102  3126 rpcz_store.cc:269] 0709 13:15:19.822235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.828876 (+  6641us) service_pool.cc:224] Handling call
0709 13:15:21.042427 (+1213551us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b540031ae54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:21.042554 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":801339776}
I20260709 13:15:21.044410  3120 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:21.021560  5137 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:21.045009  5398 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:21.046296  5398 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:21.047030  5398 raft_consensus.cc:697] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:21.048393  5398 consensus_queue.cc:237] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:21.029580  5277 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:21.051633  5277 raft_consensus.cc:697] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:21.052577  5277 consensus_queue.cc:237] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:21.053553  5189 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:21.029515  5249 consensus_queue.cc:1048] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:15:20.994246  5226 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:15:21.058547  5226 raft_consensus.cc:3055] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:21.058915  5226 raft_consensus.cc:740] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:21.060421  3045 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:21.059809  5226 consensus_queue.cc:260] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:21.059732  5399 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:21.061296  5226 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:21.062105  5093 raft_consensus.cc:3055] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:21.062511  5093 raft_consensus.cc:740] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:21.063429  5093 consensus_queue.cc:260] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:21.042501  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 57313.2us
I20260709 13:15:21.050017  5401 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:15:21.050974  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:21.036728  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.067330  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:21.074721  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:21.072127  3119 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:21.077328  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:21.080832  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 117411us
I20260709 13:15:21.064749  5093 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:21.061523  5399 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.088682  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:21.084169  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:21.085057  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:21.082831  5249 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:21.088014  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 96492.1us
I20260709 13:15:21.088582  5316 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:21.075662  5159 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:21.091928  3123 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:21.100312  3126 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:21.101574  5407 consensus_queue.cc:1059] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:15:21.102348  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:21.080894  4910 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:21.111972  3047 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:21.114113  5316 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:21.114720  4893 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:21.086596  5378 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:21.116418  5316 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:21.116600  5378 raft_consensus.cc:697] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:21.092880  5249 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.118023  5249 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.117630  5378 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:21.119875  5377 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:21.079105  5181 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:15:21.111941  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:21.124387  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:21.130606  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:21.131906  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:21.132987  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:21.133613  3046 raft_consensus.cc:2368] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5.
I20260709 13:15:21.136647  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:21.138049  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:21.139671  5189 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:21.145000  2980 debug-util.cc:398] Leaking SignalData structure 0x7b08000642e0 after lost signal to thread 1937
I20260709 13:15:21.145452  3043 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:21.146062  3047 raft_consensus.cc:1275] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:21.146328  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:21.146509  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:21.147075  3196 raft_consensus.cc:2393] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:21.147109  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:21.147689  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:21.147878  3047 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:21.148486  3043 raft_consensus.cc:2410] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:21.148777  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:21.149708  2980 debug-util.cc:398] Leaking SignalData structure 0x7b0800065ee0 after lost signal to thread 2983
I20260709 13:15:21.137305  3193 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:21.143190  3123 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:21.090602  5137 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:15:21.154343  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:21.155802  3090 connection.cc:256] RPC call timeout handler was delayed by -1.2200371589999577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
I20260709 13:15:21.156021  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:21.156951  3194 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:21.159778  3090 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:21.160053  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:21.162276  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:21.165866  3046 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:21.168944  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:21.170126  3050 raft_consensus.cc:2376] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5. Re-sending same reply.
I20260709 13:15:21.172017  3199 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:21.113065  4910 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.177028  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:21.148700  5159 raft_consensus.cc:697] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:21.197247  3191 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:21.185406  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:21.185377  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:15:21.199497  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 115429us
I20260709 13:15:21.179862  4910 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:21.172422  5197 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:21.171850  5401 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:15:21.168324  5322 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:21.208370  3192 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:21.175834  5407 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:15:21.213915  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 45053.2us
I20260709 13:15:21.208845  5181 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:21.219298  3090 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:21.220623  5408 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.221266  5408 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:21.223785  5408 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:21.235117  3043 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:21.236764  5322 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:21.179090  5316 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:15:21.215596  5042 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:21.251451  5042 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:21.251984  5042 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:21.216648  5390 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:21.253135  5390 raft_consensus.cc:697] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:21.254118  5390 consensus_queue.cc:237] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:21.239149  5407 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:21.261346  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.265363  5048 consensus_queue.cc:1048] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:21.267088  5411 raft_consensus.cc:3055] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:21.267575  5411 raft_consensus.cc:740] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:21.268415  5322 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:21.215337  5374 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:21.269574  5322 consensus_queue.cc:1059] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:21.270987  5277 raft_consensus.cc:3055] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:21.271088  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:21.271492  5277 raft_consensus.cc:740] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:21.272607  5277 consensus_queue.cc:260] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:21.272845  5414 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:21.273439  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:21.260479  5197 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:21.273586  5277 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:21.274542  5371 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:21.275215  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:21.218683  5181 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:21.275861  5181 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:21.277305  5413 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:21.277324  5166 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:21.278431  5413 raft_consensus.cc:3055] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:21.278925  5413 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:21.279716  5413 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:21.281292  3123 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:21.275231  5371 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:21.281204  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:21.282572  3126 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:21.202994  5402 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:15:21.283305  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:21.286742  3119 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:21.234896  5159 consensus_queue.cc:237] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:21.287963  5413 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:21.284166  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:21.289356  3043 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:21.290118  5411 consensus_queue.cc:260] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:21.291628  3051 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 1500) took 4523 ms (client timeout 1748 ms). Trace:
I20260709 13:15:21.292667  3042 raft_consensus.cc:2410] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:21.293668  5407 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:21.297881  5249 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:21.300028  3796 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:21.300302  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:21.300630  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:21.301826  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:21.301971  3792 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:21.302265  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:21.303478  2997 auto_rebalancer.cc:893] Removing replace marker failed: Replica 501fdf2af2bc4b0c971ae880e98f466b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:15:21.303378  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:21.304471  2980 debug-util.cc:398] Leaking SignalData structure 0x7b0800112880 after lost signal to thread 3075
I20260709 13:15:21.304634  5079 raft_consensus.cc:3055] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:21.304939  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:21.305034  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:21.307685  5093 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:21.317660  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:21.321280  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:21.354718  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:21.343766  3051 rpcz_store.cc:269] 0709 13:15:16.768194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.940331 (+172137us) service_pool.cc:224] Handling call
0709 13:15:21.291303 (+4350972us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54001d7ed4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:21.291443 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1431756672}
I20260709 13:15:21.358018  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:21.361482  2980 debug-util.cc:398] Leaking SignalData structure 0x7b08002974a0 after lost signal to thread 3076
W20260709 13:15:21.372850  2980 debug-util.cc:398] Leaking SignalData structure 0x7b08003cd600 after lost signal to thread 3150
W20260709 13:15:21.373246  2980 debug-util.cc:398] Leaking SignalData structure 0x7b08003593c0 after lost signal to thread 3151
I20260709 13:15:21.358942  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:21.364269  3049 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:21.374667  3797 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:21.367502  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:21.366983  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 185937us
W20260709 13:15:21.376739  2997 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:15:21.378410  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:21.378654  2980 debug-util.cc:398] Leaking SignalData structure 0x7b080031f400 after lost signal to thread 3224
I20260709 13:15:21.379173  3193 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 5: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:15:21.379879  2980 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0740 after lost signal to thread 3823
W20260709 13:15:21.380180  2980 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0680 after lost signal to thread 3824
I20260709 13:15:21.381016  3191 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:21.386030  5399 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.386902  3194 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:21.387323  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:21.387933  3192 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:15:21.388851  5402 raft_consensus.cc:670] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } [suppressed 4 similar messages]
I20260709 13:15:21.389802  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:21.390331  3043 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:15:21.390681  3043 pending_rounds.cc:85] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 4
I20260709 13:15:21.390911  3043 pending_rounds.cc:107] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:15:21.391146  3043 raft_consensus.cc:2889] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:21.391326  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 73720.8us
I20260709 13:15:21.392359  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:21.393128  5366 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:21.393889  5366 consensus_queue.cc:1059] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:21.394230  5374 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:21.394737  5366 raft_consensus.cc:3055] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:21.394907  5378 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:21.395133  5366 raft_consensus.cc:740] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:21.395555  5378 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:21.366367  5079 raft_consensus.cc:740] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:21.399936  3191 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:15:21.400313  3045 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:15:21.400415  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 79244.1us
I20260709 13:15:21.393515  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:21.386669  5399 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:21.401762  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:21.355599  5316 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:15:21.402477  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:21.407935  3192 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
W20260709 13:15:21.410837  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 210317us
W20260709 13:15:21.397871  2997 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:15:21.465075  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:21.399308  3794 raft_consensus.cc:2393] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:21.474460  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:21.390355  5411 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:21.482208  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 81477.3us
W20260709 13:15:21.483292  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 71849.2us
I20260709 13:15:21.467926  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:21.476202  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 74693.8us
I20260709 13:15:21.490340  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:21.491775  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:21.492193  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.501928  5419 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:21.515265  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:21.531077  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 63252.6us
I20260709 13:15:21.531454  3050 raft_consensus.cc:2410] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:21.535720  3762 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:21.409637  5368 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:21.409215  5166 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:21.411893  5175 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:21.549636  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:21.396225  5366 consensus_queue.cc:260] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:21.564297  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:21.509451  3790 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:21.548296  5371 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:15:21.582070  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 52169us
I20260709 13:15:21.587695  3762 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:21.589223  5402 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:21.548880  5226 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.550738  5368 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:21.622582  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 106137us
I20260709 13:15:21.476588  5370 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 13:15:21.621868  3165 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:21.582754  4835 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:21.509532  5181 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:21.581064  5258 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:21.581158  4893 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:15:21.548612  5277 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:15:21.549330  5407 consensus_queue.cc:1059] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:15:21.563663  5175 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.514424  5042 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:21.623867  5368 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:21.639001  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.514024  5079 consensus_queue.cc:260] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:21.679051  3049 raft_consensus.cc:1275] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:21.680004  3050 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:15:21.673631  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 77873us
I20260709 13:15:21.575212  4910 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:21.581383  4959 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:15:21.666038  5378 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:21.672803  5366 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.656701  5390 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:15:21.575160  5166 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:21.634076  5226 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:21.679240  5175 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.683197  5424 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:21.701926  3200 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:21.681896  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:21.678642  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:21.670240  5137 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
W20260709 13:15:21.700757  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.721483  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:21.680922  5433 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.693751  4959 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:21.707722  4893 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:15:21.754539  3123 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:21.718868  5419 raft_consensus.cc:3055] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:21.716288  5249 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:21.728425  5425 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.702867  4910 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:21.730377  5181 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:21.732211  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:21.733420  3121 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:21.711357  5402 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:21.737433  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:21.696699  5042 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:21.746562  3796 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:21.791882  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:21.690152  5432 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:21.728112  5418 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:15:21.760872  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 101976us
I20260709 13:15:21.765530  5368 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:21.780135  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.777415  3794 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:21.787295  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:21.726910  5370 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:21.745213  5079 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:21.794528  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 57222us
I20260709 13:15:21.755798  5093 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:21.683259  5421 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.104s
W20260709 13:15:21.824048  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 145645us
W20260709 13:15:21.815737  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 193963us
I20260709 13:15:21.785503  5419 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:21.754830  5433 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:21.706825  3049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:15:21.827062  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:21.810860  5398 raft_consensus.cc:3055] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:21.835804  3165 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:21.783983  3124 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:15:21.810559  5399 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:21.838151  3049 raft_consensus.cc:606] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:21.815004  5181 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:21.841188  3165 leader_election.cc:400] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5.
I20260709 13:15:21.847500  3165 leader_election.cc:403] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:21.815929  5432 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:21.845306  3049 raft_consensus.cc:614] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:21.789291  5425 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:21.825194  5371 raft_consensus.cc:697] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 6 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:21.855021  3124 raft_consensus.cc:1240] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:21.834815  5258 raft_consensus.cc:697] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:21.857910  3165 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:21.844149  5398 raft_consensus.cc:740] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:21.848935  5137 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:21.848708  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:21.869560  5434 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:21.870209  5428 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:15:21.870654  5189 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.871385  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:21.855262  5048 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5.
I20260709 13:15:21.874269  3165 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:21.874457  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:21.851487  5093 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:21.863164  4910 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:21.883828  5413 consensus_meta.cc:287] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.000s
I20260709 13:15:21.865375  5390 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:21.934041  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:21.934743  3793 raft_consensus.cc:2410] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:15:21.935801  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 61594.2us
I20260709 13:15:21.936704  3165 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:21.868583  5137 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.948506  3165 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:21.937317  5421 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:21.940965  5226 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:21.970731  3164 leader_election.cc:336] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Timed out: RequestConsensusVote RPC to 127.1.227.132:43109 timed out after 1.599s (SENT)
I20260709 13:15:21.948477  5137 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:21.887748  5189 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:21.928221  5370 raft_consensus.cc:697] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:21.972126  3049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b91597ece9742ebad558605a654e02a"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:15:21.981247  3164 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:21.892136  5093 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:21.966318  5444 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:15:21.940375  5366 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:15:21.980274  5197 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.981705  3049 raft_consensus.cc:606] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:21.988549  3045 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:15:21.978744  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:21.988768  3049 raft_consensus.cc:614] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:21.936439  4910 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:21.989271  3045 pending_rounds.cc:85] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 3
I20260709 13:15:21.989928  3799 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:21.990204  3045 pending_rounds.cc:107] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 13:15:21.994143  3045 raft_consensus.cc:2917] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 13:15:21.967885  5425 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:21.984493  5390 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:21.984822  5421 raft_consensus.cc:697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:22.005177  5421 consensus_queue.cc:237] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:22.003154  5441 log.cc:927] Time spent T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:15:22.003476  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:22.003932  5437 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:22.009455  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:22.010433  3051 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:22.012763  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:21.990793  4959 consensus_queue.cc:1059] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:15:22.025507  3045 raft_consensus.cc:2889] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:21.952108  5432 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:21.887930  5419 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.032508  5419 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:22.025596  3044 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:21.964542  5258 consensus_queue.cc:237] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:22.024040  3048 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:15:22.024361  5166 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:22.030824  5390 raft_consensus.cc:3055] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:21.977147  5371 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:21.992933  5197 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.042321  5390 raft_consensus.cc:740] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:22.048115  5390 consensus_queue.cc:260] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:22.051129  3197 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:15:22.051915  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1491) took 1401 ms. Trace:
I20260709 13:15:22.052394  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:22.053505  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:22.054061  5430 log.cc:927] Time spent T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:15:22.052268  3197 rpcz_store.cc:276] 0709 13:15:20.650876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.050442 (+1399566us) service_pool.cc:224] Handling call
0709 13:15:22.050841 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:22.051621 (+   780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.051855 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:22.054363  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:22.055146  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:22.055651  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:22.056233  3117 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:22.057021  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:22.057485  3117 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.058214  3192 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:22.059697  3197 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:22.054407  3195 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 5: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:22.061650  3120 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:22.062795  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:22.008100  5425 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:15:22.060842  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:22.034706  5368 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:22.027436  5401 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:22.035014  5373 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:22.096653  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:22.008810  5451 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.141s
I20260709 13:15:22.023394  5442 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.023903  5452 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:22.110905  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:22.111627  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.099996  3121 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:22.116979  3199 raft_consensus.cc:1275] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:22.118085  3195 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:22.102128  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:22.103062  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:22.104117  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:22.105634  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:22.109112  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:22.168233  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 71694.4us
I20260709 13:15:22.169461  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:22.207790  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:22.210732  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:22.206987  3193 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:22.219365  3121 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.222312  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:22.223253  3198 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:15:22.220919  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:22.226847  3192 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:22.030722  5370 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:22.227766  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 257096us
I20260709 13:15:22.199401  5368 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.225896  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:22.243615  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:22.244836  3120 raft_consensus.cc:2410] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:22.108300  5401 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:22.253419  3197 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:22.258530  3117 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:22.237809  5189 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:22.115628  5442 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.241716  5452 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:22.247246  5093 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:22.253520  3791 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:22.271341  3120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:15:22.272244  3120 raft_consensus.cc:606] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:22.272804  3120 raft_consensus.cc:614] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:22.273108  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:22.259749  5421 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:22.300397  5453 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:15:22.300822  5421 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:22.302273  5093 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:22.305019  5421 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:22.308292  5137 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.310048  3191 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:22.311697  5137 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:22.277907  5425 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:22.264688  4910 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:22.280164  5197 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:22.280766  5464 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.282447  5455 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.283021  5435 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.283571  5461 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.343842  5461 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
W20260709 13:15:22.289378  5462 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:15:22.348093  5461 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:22.348955  3045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:15:22.349838  3045 raft_consensus.cc:606] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:22.350297  3045 raft_consensus.cc:614] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:22.354607  3045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:55618
W20260709 13:15:22.291139  5411 consensus_meta.cc:287] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.776s	user 0.011s	sys 0.000s
I20260709 13:15:22.356312  3799 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:22.292119  5442 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:22.294376  5401 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:22.296062  5175 consensus_meta.cc:287] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.004s
I20260709 13:15:22.358886  5175 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.247041  5368 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:22.312698  3195 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:15:22.347190  3120 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:15:22.315770  5452 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:22.364912  5435 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.366573  3120 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:22.374236  5455 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.378676  3043 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:15:22.343120  5464 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:22.383224  5464 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:22.385422  5435 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:22.276904  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:22.388234  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 111450us
I20260709 13:15:22.389918  3196 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:22.389986  5425 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:22.391541  5137 consensus_queue.cc:1059] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:22.393038  4910 raft_consensus.cc:3055] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:22.393584  4910 raft_consensus.cc:740] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:22.394822  4910 consensus_queue.cc:260] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.391799  5425 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:22.397068  5425 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.403290  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:22.404865  5079 consensus_meta.cc:287] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.576s	user 0.005s	sys 0.006s
I20260709 13:15:22.405833  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:22.410481  5455 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:22.490307  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:22.491320  3164 leader_election.cc:336] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Timed out: RequestConsensusVote RPC to 127.1.227.132:43109 timed out after 2.216s (SENT)
W20260709 13:15:22.495507  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 311277us
I20260709 13:15:22.500114  3121 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:22.501097  3120 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:22.497846  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:22.503588  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:22.498378  5366 raft_consensus.cc:3055] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:22.513770  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:22.515527  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:22.498795  5442 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.520021  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:22.520695  3121 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:22.520522  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:22.524960  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:22.503494  5455 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:22.528122  3050 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:22.514153  5444 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:22.517885  5371 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.516670  5366 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:22.534322  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:22.526108  5079 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.540894  3044 raft_consensus.cc:1275] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:15:22.535000  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:22.541271  3044 pending_rounds.cc:85] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 2
I20260709 13:15:22.519125  5451 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:22.535733  5370 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:22.541600  3044 pending_rounds.cc:107] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:15:22.543217  3044 raft_consensus.cc:2889] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:22.541729  5471 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:22.545086  5470 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:22.540659  5450 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:15:22.542680  5079 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:22.546869  5469 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:22.548032  5366 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:22.548653  5079 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:22.540015  5444 raft_consensus.cc:697] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:22.549080  5366 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:22.549885  5444 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:22.540373  5371 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:22.545307  5440 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.556617  5440 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.558732  5474 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:22.559087  5440 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:22.559732  5474 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:22.544292  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:22.561177  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:22.561620  5480 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:22.561967  3796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43926 (request call id 497) took 1078 ms. Trace:
I20260709 13:15:22.561774  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:22.562189  5480 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.562674  5480 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:22.563051  5474 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:22.563553  5474 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:22.564121  5474 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.564429  3794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 392) took 1258 ms. Trace:
I20260709 13:15:22.564858  3794 rpcz_store.cc:276] 0709 13:15:21.306221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.490039 (+183818us) service_pool.cc:224] Handling call
0709 13:15:22.564236 (+1074197us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54006ea0d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:22.564346 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":583719168}
I20260709 13:15:22.562382  3796 rpcz_store.cc:276] 0709 13:15:21.483738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.560936 (+1077198us) service_pool.cc:224] Handling call
0709 13:15:22.561901 (+   965us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:22.566746  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:22.567907  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:22.569144  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:22.570228  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:22.571067  3794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43926 (request call id 499) took 1086 ms. Trace:
I20260709 13:15:22.571370  5463 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.571813  3796 raft_consensus.cc:2410] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:22.571947  5463 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.571480  3794 rpcz_store.cc:276] 0709 13:15:21.484396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.569983 (+1085587us) service_pool.cc:224] Handling call
0709 13:15:22.571012 (+  1029us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:22.573696  5398 consensus_queue.cc:260] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:22.575294  5398 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:22.565212  5425 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.528653  5442 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.585772  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:22.541194  5432 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:15:22.600618  5370 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:22.535241  5455 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.603108  5455 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:22.581915  5425 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:22.595408  5093 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:22.608059  5442 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:22.612370  3198 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:22.612876  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:22.586248  3791 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:22.582031  5463 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:22.608224  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:22.604463  5366 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:15:22.584163  5258 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.617439  5258 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.619371  3797 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:22.621053  3797 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 393) took 1313 ms. Trace:
I20260709 13:15:22.621416  3797 rpcz_store.cc:276] 0709 13:15:21.306517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.618832 (+1312315us) service_pool.cc:224] Handling call
0709 13:15:22.619113 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:22.619769 (+   656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.619949 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:22.640550  3119 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:22.650381  3119 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:22.650673  3797 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:22.649622  5197 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.652335  5197 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:22.654490  5197 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:22.659111  3797 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 494) took 1243 ms. Trace:
I20260709 13:15:22.659627  3797 rpcz_store.cc:276] 0709 13:15:21.412517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.640367 (+1227850us) service_pool.cc:224] Handling call
0709 13:15:22.647703 (+  7336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:22.651251 (+  3548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.651490 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:22.657485  5366 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.675392  5366 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.640700  5435 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.648083  5455 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.688406  3119 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:15:22.622149  5480 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.686725  5258 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:22.684806  5366 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:22.692111  5471 raft_consensus.cc:697] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:22.703011  3798 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:22.704314  3119 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:22.703132  5442 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.706175  3798 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:22.710520  5471 consensus_queue.cc:237] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.711045  4910 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.706168  5442 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.713016  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:22.714924  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:22.715817  3122 raft_consensus.cc:2368] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5.
I20260709 13:15:22.695212  5435 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:22.695397  5455 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.717808  5397 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:15:22.724803  5079 consensus_queue.cc:1059] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:22.731151  5442 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:22.713900  5398 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.731751  5079 raft_consensus.cc:3055] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:22.732183  5079 raft_consensus.cc:740] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:22.732066  5398 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:22.718227  5258 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.734512  5398 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:22.734155  5258 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:22.734908  3793 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 363) took 1435 ms (client timeout 1557 ms). Trace:
I20260709 13:15:22.718698  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:22.718137  5482 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:15:22.717073  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:22.735386  3793 rpcz_store.cc:269] 0709 13:15:21.299620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.300369 (+   749us) service_pool.cc:224] Handling call
0709 13:15:22.734722 (+1434353us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b54005c0dd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:22.734850 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1326636800}
I20260709 13:15:22.737967  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:22.741442  3798 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:15:22.742017  3798 pending_rounds.cc:85] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Aborting all ops after (but not including) 3
I20260709 13:15:22.742319  3798 pending_rounds.cc:107] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 13:15:22.742652  3798 raft_consensus.cc:2917] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 13:15:22.743191  3798 raft_consensus.cc:2889] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:22.751303  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:22.753429  5444 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.755219  5455 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:22.759423  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:22.761224  3793 raft_consensus.cc:2376] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3. Re-sending same reply.
I20260709 13:15:22.761536  3164 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:22.759886  3124 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:22.763110  3119 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:22.766676  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:22.769670  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:22.771708  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:22.772019  3050 raft_consensus.cc:2410] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:22.774521  3121 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:22.776609  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:22.777323  3050 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:22.778224  3045 raft_consensus.cc:606] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:22.778177  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:22.778820  3045 raft_consensus.cc:614] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:22.779860  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:22.780970  3050 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:22.782868  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:22.786049  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:22.787221  3050 raft_consensus.cc:2410] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:22.771222  5048 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:22.744251  5197 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.790422  3044 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:15:22.792927  3044 pending_rounds.cc:85] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 2
I20260709 13:15:22.793170  3044 pending_rounds.cc:107] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:15:22.793390  3044 raft_consensus.cc:2889] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:22.795590  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:22.762715  5398 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:22.733129  5079 consensus_queue.cc:260] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:22.796162  3048 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:22.790853  5419 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:22.793785  5411 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:15:22.790103  5048 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.809252  3794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 388) took 1504 ms. Trace:
I20260709 13:15:22.810109  5330 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:22.810914  5435 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:22.812014  3797 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEARNER]: Advancing to term 6
I20260709 13:15:22.760802  5444 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.782060  5397 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:15:22.814170  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:22.822257  5079 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:22.803419  3050 raft_consensus.cc:3055] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:22.877365  3050 raft_consensus.cc:740] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:22.815528  3794 rpcz_store.cc:276] 0709 13:15:21.305113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.574616 (+1269503us) service_pool.cc:224] Handling call
0709 13:15:22.574947 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:22.575472 (+   525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:22.575506 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:22.597407 (+ 21901us) log.cc:844] Serialized 26 byte log entry
0709 13:15:22.743734 (+146327us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:22.745396 (+  1662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.771794 (+ 26398us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:22.808988 (+ 37194us) raft_consensus.cc:1685] finished
0709 13:15:22.809005 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:22.809172 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2192,"spinlock_wait_cycles":11826560,"thread_start_us":127391,"threads_started":1,"wal-append.queue_time_us":186918}
I20260709 13:15:22.878427  5401 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.878238  3050 consensus_queue.cc:260] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.820888  3044 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:22.878970  5401 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:22.879572  3050 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:22.878953  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 100021us
I20260709 13:15:22.820279  5463 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:15:22.804658  5474 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:22.820256  5443 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.864s	user 0.000s	sys 0.004s
I20260709 13:15:22.796727  5197 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.817992  5048 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:22.927697  5197 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:22.929447  3050 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:15:22.872597  5419 raft_consensus.cc:697] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:22.929912  3050 pending_rounds.cc:85] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 2
I20260709 13:15:22.891371  5480 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:22.893757  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.930029  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:22.931304  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:22.930285  3050 pending_rounds.cc:107] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:15:22.933610  3050 raft_consensus.cc:2889] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:22.820405  5425 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:15:22.952553  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 65823.4us
I20260709 13:15:22.952704  3048 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:15:22.930119  5474 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:22.958540  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:22.962114  5446 log.cc:927] Time spent T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.995s	user 0.002s	sys 0.001s
I20260709 13:15:22.963191  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1786) took 1821 ms. Trace:
I20260709 13:15:22.963367  3194 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:22.963941  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1922) took 1620 ms. Trace:
I20260709 13:15:22.964236  5474 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.965332  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 264) took 1585 ms. Trace:
I20260709 13:15:22.964885  5474 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:22.964320  3046 rpcz_store.cc:276] 0709 13:15:21.343985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.344115 (+   130us) service_pool.cc:224] Handling call
0709 13:15:21.344471 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:21.369264 (+ 24793us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:21.399244 (+ 29980us) log.cc:844] Serialized 14 byte log entry
0709 13:15:21.733393 (+334149us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b18003464e0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff5323a 00007ff8303bda2a
0709 13:15:21.860908 (+127515us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:21.881672 (+ 20764us) log.cc:844] Serialized 26 byte log entry
0709 13:15:21.881880 (+   208us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:21.881925 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.882004 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:22.961269 (+1079265us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:22.963746 (+  2477us) raft_consensus.cc:1685] finished
0709 13:15:22.963768 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:22.963887 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12820,"prepare.queue_time_us":34214,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":6244,"raft.queue_time_us":32890,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":6752,"spinlock_wait_cycles":143594368,"thread_start_us":127218,"threads_started":2,"wal-append.queue_time_us":473567}
I20260709 13:15:22.963635  3200 rpcz_store.cc:276] 0709 13:15:21.141801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.141915 (+   114us) service_pool.cc:224] Handling call
0709 13:15:22.962931 (+1821016us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b54002bcad4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:22.963123 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1243938048}
I20260709 13:15:22.967411  5474 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:22.969640  3799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43926 (request call id 496) took 1486 ms. Trace:
I20260709 13:15:22.970103  3799 rpcz_store.cc:276] 0709 13:15:21.483415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.994957 (+511542us) service_pool.cc:224] Handling call
0709 13:15:22.969477 (+974520us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54006540d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:22.969580 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":798142336}
I20260709 13:15:22.970695  3797 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEARNER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:15:22.971267  3797 pending_rounds.cc:85] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: Aborting all ops after (but not including) 2
I20260709 13:15:22.971696  3797 pending_rounds.cc:107] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:15:22.970908  5419 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.972082  3797 raft_consensus.cc:2889] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:22.973719  5401 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:22.965832  3194 rpcz_store.cc:276] 0709 13:15:21.380246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.387774 (+  7528us) service_pool.cc:224] Handling call
0709 13:15:22.963070 (+1575296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:22.963924 (+   854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.965139 (+  1215us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54002bcad0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:22.965276 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3621959040}
W20260709 13:15:22.979632  5488 log.cc:927] Time spent T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:15:22.981009  3796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 387) took 1676 ms. Trace:
I20260709 13:15:22.981204  5417 consensus_queue.cc:1059] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:22.982079  5417 consensus_queue.cc:1243] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:22.981434  3796 rpcz_store.cc:276] 0709 13:15:21.304758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.572445 (+1267687us) service_pool.cc:224] Handling call
0709 13:15:22.572802 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:22.573177 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:22.573208 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:22.576033 (+  2825us) log.cc:844] Serialized 26 byte log entry
0709 13:15:22.743951 (+167918us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:22.744007 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.744094 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:22.980764 (+236670us) raft_consensus.cc:1685] finished
0709 13:15:22.980788 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:22.980949 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4435,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":7633,"thread_start_us":167427,"threads_started":1,"wal-append.queue_time_us":221189}
I20260709 13:15:22.982653  5417 raft_consensus.cc:3055] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:22.983016  5417 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:22.985626  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:22.986876  3196 raft_consensus.cc:2410] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:22.989924  3761 leader_election.cc:400] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5.
I20260709 13:15:22.990423  3761 leader_election.cc:403] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:22.994732  3761 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:22.996562  3761 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:22.992741  5474 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:15:23.001878  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 48425us
I20260709 13:15:22.993461  4910 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.984351  5417 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:22.954873  5425 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:23.008272  3117 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:15:23.008853  3117 pending_rounds.cc:85] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 2
I20260709 13:15:23.009128  3117 pending_rounds.cc:107] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:15:23.009452  3117 raft_consensus.cc:2889] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:23.004777  5463 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.996253  5401 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEARNER]: Leader pre-election lost for term 4. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5.
I20260709 13:15:22.998098  5330 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:22.998512  5079 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:23.015185  5445 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.999766  5493 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:15:23.015542  5405 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:15:23.015703  5445 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:23.013697  5463 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:22.999702  5192 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.998631  3791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 389) took 1693 ms. Trace:
I20260709 13:15:23.017150  5494 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:15:23.012921  5474 raft_consensus.cc:697] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:23.020498  5417 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:23.021180  5474 consensus_queue.cc:237] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:23.025664  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:22.999565  5048 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:23.014384  5079 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.014561  5330 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:23.030558  5498 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:15:23.030951  5464 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:15:23.036164  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:23.031482  5192 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:23.010681  4910 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:23.046476  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:23.026528  3791 rpcz_store.cc:276] 0709 13:15:21.305378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.614544 (+1309166us) service_pool.cc:224] Handling call
0709 13:15:22.614857 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:22.615079 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:22.775722 (+160643us) log.cc:844] Serialized 14 byte log entry
0709 13:15:22.946931 (+171209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:22.954693 (+  7762us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:22.988243 (+ 33550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.992867 (+  4624us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:22.997639 (+  4772us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":251134,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":1438,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":9310,"spinlock_wait_cycles":9143552,"thread_start_us":259887,"threads_started":2,"wal-append.queue_time_us":211909}
I20260709 13:15:23.047137  5497 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:23.047672  5048 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:23.048183  5445 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:23.052692  5330 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:23.053280  5444 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:23.053210  5368 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:23.053722  5079 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:23.056378  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.057448  5137 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.077907  5450 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.102283  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:23.055110  5425 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:23.067783  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:23.067373  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:23.181126  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:23.079833  3046 raft_consensus.cc:2410] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:23.079264  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:23.068856  3796 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEARNER]: Advancing to term 5
I20260709 13:15:23.067373  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:23.069237  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:23.225343  3165 leader_election.cc:336] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Timed out: RequestConsensusVote RPC to 127.1.227.129:44609 timed out after 1.730s (SENT)
I20260709 13:15:23.202015  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:23.230018  3165 leader_election.cc:336] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Timed out: RequestConsensusVote RPC to 127.1.227.129:44609 timed out after 2.040s (SENT)
I20260709 13:15:23.230273  3793 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:23.086220  4835 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.088462  5197 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:23.216763  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:23.244896  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:23.245411  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.062242  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:23.248158  3121 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:23.064215  5398 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.062613  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:23.054621  5433 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:23.054030  5503 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:23.221490  3048 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 5: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:23.058458  5175 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:23.180115  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:23.224126  3198 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:23.078081  5494 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.206192  5445 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.228120  3194 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:23.069984  5455 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.151s
I20260709 13:15:23.215924  5366 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.069628  5435 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.153s
I20260709 13:15:23.219129  5502 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.221130  5444 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.291925  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:23.292905  3193 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:23.293525  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:23.286420  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:23.220796  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:23.289624  3124 raft_consensus.cc:2393] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 8: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:23.290778  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:23.284147  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:23.206750  5497 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:23.222473  5137 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:23.229696  5450 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:23.282373  5455 consensus_queue.cc:1243] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:23.298151  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:23.449930  5507 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:15:23.339383  3796 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEARNER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:23.460994  3792 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:23.299716  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:23.461462  3044 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:23.356213  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1562) took 1348 ms. Trace:
I20260709 13:15:23.298993  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:23.466115  3043 rpcz_store.cc:276] 0709 13:15:22.008212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.008376 (+   164us) service_pool.cc:224] Handling call
0709 13:15:22.010126 (+  1750us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:22.379394 (+369268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.355858 (+976464us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b540027c9d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:23.356129 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":846625664}
I20260709 13:15:23.304535  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:23.468010  3124 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:23.473867  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:23.469048  3793 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:23.312214  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:23.475651  3046 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:23.476823  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:23.477656  3046 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:23.478756  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:23.308929  3051 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:23.306351  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:23.466717  3121 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:23.491675  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:23.493114  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:23.446576  5508 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:15:23.498543  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:23.363202  5505 log.cc:927] Time spent T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:15:23.495579  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:23.288945  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:23.493883  3046 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:23.464229  3193 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:23.444778  5321 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:23.483470  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.526015  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:23.502285  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:23.526988  3044 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 5: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:23.510841  3042 raft_consensus.cc:2410] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:23.343783  5511 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.343559  5368 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.511948  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:23.243672  4835 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:23.447384  4910 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:23.297825  5502 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:23.349435  5258 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:23.496227  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:23.533944  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:23.535810  3198 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:23.536222  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:23.520331  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:23.306376  5366 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:23.289320  5503 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:23.306399  5494 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:23.522038  5321 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:23.587601  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:23.589067  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.525144  5450 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:23.492491  5197 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:23.290001  5398 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:23.498397  4959 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.494961  5435 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:15:23.507977  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.630317  5435 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:23.528093  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:23.631454  3046 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:23.631672  5197 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:23.632206  5401 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.632853  5401 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:23.299651  5444 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:23.520102  3791 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:23.534970  3090 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:23.664710  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 129836us
W20260709 13:15:23.531948  5474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.006s	sys 0.012s
W20260709 13:15:23.666293  5474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.006s	sys 0.026s
I20260709 13:15:23.668794  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55618 (request call id 23) took 1314 ms. Trace:
I20260709 13:15:23.576292  5510 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:23.530979  5192 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:23.671849  5192 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:23.579453  5425 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.673480  5425 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:23.575338  5137 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:23.580405  5421 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:23.574296  4835 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:23.496760  5445 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:23.584645  5417 consensus_meta.cc:287] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.000s
W20260709 13:15:23.585206  5189 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 13:15:23.586130  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 49958.5us
I20260709 13:15:23.527084  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:23.715628  3124 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:23.620069  5509 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.716302  3121 raft_consensus.cc:2410] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:23.620800  5048 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.622327  3197 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
W20260709 13:15:23.788031  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 122259us
I20260709 13:15:23.620464  5464 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:23.624116  5321 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:23.624656  3122 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:23.627700  5366 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:23.628788  5398 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:23.629307  4959 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:23.616837  5112 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:23.546802  4893 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:23.669386  3045 rpcz_store.cc:276] 0709 13:15:22.354231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.354413 (+   182us) service_pool.cc:224] Handling call
0709 13:15:23.668503 (+1314090us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54003c37d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303ad853 00007ff83537b60a 00007ff82e9017d4 00007ff82e901762 00007ff82e901691 00007ff82e90160c 00007ff82e9008c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:23.668673 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":972269824}
I20260709 13:15:23.592235  5373 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.786069  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:23.786227  5509 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:23.661532  5414 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:23.545786  5512 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.790035  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:23.887955  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:23.537611  5368 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:23.889878  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:23.897866  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:23.898965  5444 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:23.818573  5137 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:23.899303  5494 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:23.942657  5137 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:23.944964  5137 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:23.907069  5398 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:15:23.911924  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 121943us
I20260709 13:15:23.911988  3119 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:23.945886  5366 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:23.911291  5373 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:23.946616  5366 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.947113  5366 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:23.948112  5373 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:23.889298  4893 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.948706  4893 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:23.834152  5417 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.949836  5449 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:23.950448  5449 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.919624  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 272) took 1007 ms. Trace:
I20260709 13:15:23.950917  5449 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:23.950964  3192 rpcz_store.cc:276] 0709 13:15:22.912658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.912774 (+   116us) service_pool.cc:224] Handling call
0709 13:15:22.913150 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:22.913506 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:22.913545 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:22.914117 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 13:15:22.991554 (+ 77437us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:22.991595 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.991666 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:23.917674 (+926008us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b180042e080. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:15:23.919302 (+  1628us) raft_consensus.cc:1685] finished
0709 13:15:23.919323 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:23.919553 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":78849,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":5815,"spinlock_wait_cycles":3433344,"thread_start_us":77060,"threads_started":1,"wal-append.queue_time_us":87861}
I20260709 13:15:23.953161  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:23.888234  5435 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:23.921020  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:23.926208  5401 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:23.800895  5048 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:23.954622  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:23.955932  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:23.956156  5048 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:23.956624  3192 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:23.958390  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:23.800489  5192 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.132s
I20260709 13:15:23.536532  5511 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:23.800709  4835 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.132s
I20260709 13:15:23.963433  5511 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:23.964249  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:23.908216  5445 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:23.934368  4959 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:23.938230  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:23.968588  3121 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:23.969472  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:23.970047  3121 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:23.970886  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:23.971596  3121 raft_consensus.cc:2410] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 6 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:23.979169  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:23.938691  5512 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:23.910336  5464 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:23.941602  3045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "f20672b2852447a6bc1e137c4dd40904"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:15:23.946010  3090 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:23.990471  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 44554.9us
I20260709 13:15:23.991478  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:23.918112  5368 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:23.950165  5417 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:23.958575  5398 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:23.960865  3119 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:23.998494  3119 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:15:23.961035  5330 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.744s	user 0.007s	sys 0.002s
I20260709 13:15:23.919809  5414 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:23.931375  5509 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:23.984150  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:23.984942  5450 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:23.984980  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:23.987037  3051 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:15:24.007711  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.991744  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:23.992626  3045 raft_consensus.cc:606] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Received request to transfer leadership to TS f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:24.008563  3045 raft_consensus.cc:614] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:24.000751  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:23.990061  5452 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:24.011502  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:23.908778  5112 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.958410  4893 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:23.997218  5445 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:24.052374  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.053139  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:24.054193  3090 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:24.015130  3043 raft_consensus.cc:2368] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5.
I20260709 13:15:24.001868  4835 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:24.057713  3049 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:24.006505  5450 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.010599  5368 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:24.084350  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.085227  4893 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:24.085300  3051 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:24.051399  5112 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:24.087589  5502 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:24.088891  5464 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:24.089522  5425 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:24.054971  5192 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:24.090360  5192 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.090728  5192 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:24.092162  3042 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:24.052026  5509 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.094883  5509 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:24.096447  5112 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:24.097121  5509 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:24.098800  5503 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:24.099236  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.059624  5474 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:24.101483  5474 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:24.102013  3046 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:24.104156  5474 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:24.105640  5112 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:24.108214  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:24.108814  3124 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:24.111110  5417 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:24.112882  5512 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:24.113488  5450 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:24.114223  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 62568.9us
I20260709 13:15:24.114948  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 291) took 2251 ms. Trace:
I20260709 13:15:24.115312  3120 rpcz_store.cc:276] 0709 13:15:21.863836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.418114 (+554278us) service_pool.cc:224] Handling call
0709 13:15:22.500766 (+ 82652us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:22.501940 (+  1174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.114760 (+1612820us) spinlock_profiling.cc:243] Waited 81.8 ms on lock 0x7b540032df50. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:24.114888 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188202240}
I20260709 13:15:24.119138  5414 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:24.119730  5414 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:15:24.121220  5079 consensus_meta.cc:287] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.900s	user 0.011s	sys 0.000s
I20260709 13:15:24.121637  5079 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:24.122608  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:24.123278  3193 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:24.123665  5079 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:24.053566  5440 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:24.014123  5189 consensus_queue.cc:1059] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.110s
I20260709 13:15:24.124486  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 1594) took 1038 ms. Trace:
I20260709 13:15:24.124903  3122 rpcz_store.cc:276] 0709 13:15:23.085705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.243708 (+158003us) service_pool.cc:224] Handling call
0709 13:15:24.124330 (+880622us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b540011d0d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:24.124428 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373781376}
I20260709 13:15:24.125586  3799 raft_consensus.cc:2368] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
I20260709 13:15:24.010123  5048 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:24.126567  3799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 395) took 1058 ms. Trace:
I20260709 13:15:24.126166  5048 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:24.126928  3799 rpcz_store.cc:276] 0709 13:15:23.068575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.068950 (+   375us) service_pool.cc:224] Handling call
0709 13:15:24.126387 (+1057437us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b54005c0dd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:24.126510 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2061999360}
W20260709 13:15:24.055723  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.129833  5368 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.130198  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1512) took 1063 ms. Trace:
I20260709 13:15:24.130307  5368 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:24.130657  3197 rpcz_store.cc:276] 0709 13:15:23.066879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.067072 (+   193us) service_pool.cc:224] Handling call
0709 13:15:24.130045 (+1062973us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b540002b2d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:24.130142 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":911242752}
I20260709 13:15:24.002985  5330 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:24.135251  5330 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:24.135888  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.121424  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:24.139580  3046 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:15:24.139905  3046 pending_rounds.cc:85] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 5
I20260709 13:15:24.140146  3046 pending_rounds.cc:107] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:15:24.140393  3046 raft_consensus.cc:2889] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:24.050601  5435 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:15:24.142220  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.143070  3043 raft_consensus.cc:2410] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:24.141574  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.141242  3164 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:24.147786  3762 leader_election.cc:400] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5.
W20260709 13:15:24.147653  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 93572.6us
I20260709 13:15:24.149171  3762 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:24.159421  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:24.166548  3192 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.159704  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.162679  3165 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:24.163815  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:24.153803  3042 raft_consensus.cc:1240] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:24.169842  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.171082  3796 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:24.173533  3051 raft_consensus.cc:2393] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:24.164590  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:24.164927  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 47247.7us
I20260709 13:15:24.164532  3124 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:24.156431  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:24.174944  3048 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:24.176312  3194 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:24.162670  3799 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:24.171516  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.179984  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:24.180687  3796 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:24.181619  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:24.181674  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.182277  3796 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:24.183295  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.183496  3044 raft_consensus.cc:2393] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:24.193622  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.195683  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:24.196298  3194 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:24.196801  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.197190  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:24.197520  3045 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:24.198107  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.195853  3043 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:24.218678  3799 raft_consensus.cc:1240] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:24.197435  3165 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:24.221381  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:24.222018  3194 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:24.222491  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1804) took 1026 ms. Trace:
I20260709 13:15:24.222836  3194 rpcz_store.cc:276] 0709 13:15:23.195692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.221130 (+1025438us) service_pool.cc:224] Handling call
0709 13:15:24.222441 (+  1311us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.219237  3164 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:24.223652  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:24.198753  3046 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:24.225673  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.226328  3048 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:24.158001  5511 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:24.224542  3164 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:24.179050  5512 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:24.194343  5396 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:24.252218  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:24.257573  3194 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:24.258553  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:24.258721  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.259555  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:24.183607  5249 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:24.248234  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:24.267443  3124 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:24.250072  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.184005  4835 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.183706  5440 raft_consensus.cc:697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:24.266609  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1797) took 1193 ms. Trace:
I20260709 13:15:24.252301  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:24.279626  3194 rpcz_store.cc:276] 0709 13:15:23.072926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.259367 (+1186441us) service_pool.cc:224] Handling call
0709 13:15:24.266544 (+  7177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.280912  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:24.282614  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 85259.3us
I20260709 13:15:24.283736  3165 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:24.285199  3124 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:24.152958  5520 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.146s
I20260709 13:15:24.285483  3165 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:24.183925  5079 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:15:24.252714  5433 raft_consensus.cc:3055] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:24.165374  5449 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:24.291045  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1517) took 1109 ms. Trace:
I20260709 13:15:24.164412  5368 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:24.298033  3194 rpcz_store.cc:276] 0709 13:15:23.182013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.280579 (+1098566us) service_pool.cc:224] Handling call
0709 13:15:24.290971 (+ 10392us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.296249  3165 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:24.293346  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:24.195012  5366 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:24.275177  5249 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.250972  5461 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:15:24.222163  5417 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:15:24.294499  5373 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:24.310842  3194 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:24.227733  5509 consensus_queue.cc:1059] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:15:24.268224  5396 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:24.279156  5112 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:24.292377  3791 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:24.314167  5494 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:24.220892  5420 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:15:24.290242  3792 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:24.291884  5502 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.279124  5512 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:24.336308  3051 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:24.338100  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1803) took 1259 ms. Trace:
I20260709 13:15:24.382339  3194 rpcz_store.cc:276] 0709 13:15:23.079127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.302523 (+1223396us) service_pool.cc:224] Handling call
0709 13:15:24.302815 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.337769 (+ 34954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.338033 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:24.383788  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 159334us
I20260709 13:15:24.294654  5421 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:24.385385  5421 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.385865  5421 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:24.345010  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:24.291363  5526 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:24.293944  5433 raft_consensus.cc:740] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:24.361639  3790 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:15:24.300256  5435 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:24.334504  5249 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:24.340548  5518 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:15:24.314780  5510 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:15:24.390430  5440 consensus_queue.cc:237] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:24.378307  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 235195us
I20260709 13:15:24.355073  5396 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:24.289722  3192 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:24.294113  5137 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:24.288278  4835 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:24.315026  5444 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
W20260709 13:15:24.379833  5434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.421s	user 0.012s	sys 0.007s
I20260709 13:15:24.387444  5398 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:24.390337  5445 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:24.386662  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:24.397373  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:24.397675  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 179235us
W20260709 13:15:24.397991  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 86295.3us
I20260709 13:15:24.393319  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1591) took 1244 ms. Trace:
I20260709 13:15:24.422432  3091 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:24.401515  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:24.423331  3091 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:24.423894  5530 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:24.424317  5530 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.395735  3790 pending_rounds.cc:85] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161: Aborting all ops after (but not including) 6
I20260709 13:15:24.424891  5530 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:24.425043  3790 pending_rounds.cc:107] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:15:24.364567  5112 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:24.425698  3790 raft_consensus.cc:2889] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:24.427228  5112 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:24.424916  5321 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:24.397204  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:24.428129  5321 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.374017  5373 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:15:24.422936  3165 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:24.429183  5533 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:24.429626  5533 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.430013  5533 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:24.422765  3120 rpcz_store.cc:276] 0709 13:15:23.149228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.116299 (+967071us) service_pool.cc:224] Handling call
0709 13:15:24.116589 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.116803 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:24.369391 (+252588us) log.cc:844] Serialized 14 byte log entry
0709 13:15:24.392863 (+ 23472us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:24.392929 (+    66us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:24.393007 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.393090 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.393253 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23007,"prepare.queue_time_us":41203,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":1356,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"spinlock_wait_cycles":12870912,"thread_start_us":235469,"threads_started":2,"wal-append.queue_time_us":23451}
I20260709 13:15:24.424460  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:24.428516  5321 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:24.396111  5526 raft_consensus.cc:697] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:15:24.440515  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 53959.8us
W20260709 13:15:24.416854  5434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.475s	user 0.012s	sys 0.007s
I20260709 13:15:24.424264  3091 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:24.445914  3164 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:24.414980  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:24.413565  4959 raft_consensus.cc:2764] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:15:24.400600  5435 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:24.387296  5502 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:24.438505  5445 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.480816  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.489959  3046 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:15:24.492214  3048 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:15:24.492789  5527 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:15:24.493120  4835 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:24.494218  3042 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:24.440037  5112 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.494544  5414 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:24.439963  5189 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:24.497787  3045 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:24.442332  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:24.467996  5434 raft_consensus.cc:697] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:24.446224  5433 consensus_queue.cc:260] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:24.756227  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.750438  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1514) took 1668 ms. Trace:
I20260709 13:15:24.748891  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.748668  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1931) took 1501 ms. Trace:
W20260709 13:15:24.563889  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 118040us
I20260709 13:15:24.760774  3050 rpcz_store.cc:276] 0709 13:15:23.246848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.249140 (+  2292us) service_pool.cc:224] Handling call
0709 13:15:23.249520 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:23.249962 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:23.250001 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:23.250535 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:15:23.529133 (+278598us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:23.529171 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.529246 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:24.748388 (+1219142us) raft_consensus.cc:1685] finished
0709 13:15:24.748413 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.748592 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1197,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":7336,"thread_start_us":183524,"threads_started":1,"wal-append.queue_time_us":784666}
I20260709 13:15:24.425364  5534 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:24.563141  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:24.650203  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 215041us
I20260709 13:15:24.511394  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:24.754863  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 331947us
I20260709 13:15:24.775415  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.776957  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1596) took 1279 ms. Trace:
I20260709 13:15:24.758684  3194 rpcz_store.cc:276] 0709 13:15:23.081551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.383083 (+1301532us) service_pool.cc:224] Handling call
0709 13:15:24.383468 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:24.383932 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.383981 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:24.384445 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:15:24.403506 (+ 19061us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:24.403542 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.403608 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:24.747794 (+344186us) raft_consensus.cc:1685] finished
0709 13:15:24.747823 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.750351 (+  2528us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76699,"raft.queue_time_us":56675,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":22208,"thread_start_us":18630,"threads_started":1,"wal-append.queue_time_us":116272}
I20260709 13:15:24.495658  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:24.459641  5542 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:24.501996  3792 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
W20260709 13:15:24.994498  3120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.013s	sys 0.005s
I20260709 13:15:24.489835  5461 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:24.777995  3126 rpcz_store.cc:276] 0709 13:15:23.497896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.776018 (+1278122us) service_pool.cc:224] Handling call
0709 13:15:24.776347 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.776574 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.776611 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:24.776655 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:24.776715 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.776777 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.776894 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:24.778316  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:24.748791  5371 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:24.929344  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 156229us
I20260709 13:15:24.562532  5449 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:24.963786  3196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1510) took 2558 ms (client timeout 1970 ms). Trace:
W20260709 13:15:25.000093  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 226417us
W20260709 13:15:25.154975  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.879984  5366 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:24.754313  5501 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:24.864109  5526 consensus_queue.cc:237] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:24.966452  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1791) took 2855 ms. Trace:
I20260709 13:15:25.245296  3191 rpcz_store.cc:276] 0709 13:15:22.111300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.118147 (+  6847us) service_pool.cc:224] Handling call
0709 13:15:22.118468 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:22.310498 (+192030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.966094 (+2655596us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b540013c4d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:24.966356 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440079104}
I20260709 13:15:25.112593  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:24.963013  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1564) took 3126 ms. Trace:
I20260709 13:15:25.112392  5189 raft_consensus.cc:697] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:15:25.110684  3120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.013s	sys 0.012s
I20260709 13:15:24.917646  5474 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:25.157423  3165 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:24.952801  5450 consensus_meta.cc:287] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.839s	user 0.009s	sys 0.000s
W20260709 13:15:25.154744  3196 rpcz_store.cc:269] 0709 13:15:22.405233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.405447 (+   214us) service_pool.cc:224] Handling call
0709 13:15:24.963474 (+2558027us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b5400178c54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:24.963665 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1333305088}
I20260709 13:15:24.770130  5534 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.882978  4835 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:24.965598  5535 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:24.777916  5112 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:25.237752  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:25.282123  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:25.282547  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:25.282877  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:25.284483  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:25.285040  3050 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:15:25.284873  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:24.815052  5433 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:25.074609  5549 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.311s
I20260709 13:15:25.244415  5371 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:25.248124  3123 rpcz_store.cc:276] 0709 13:15:21.836663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.839424 (+  2761us) service_pool.cc:224] Handling call
0709 13:15:21.839776 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:21.846460 (+  6684us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:21.846498 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:21.853987 (+  7489us) log.cc:844] Serialized 26 byte log entry
0709 13:15:24.962288 (+3108301us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b18003dd5c0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82ff5b4bc 00007ff82d2a948b 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1
0709 13:15:24.962490 (+   202us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:24.962533 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.962627 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:24.962672 (+    45us) raft_consensus.cc:1685] finished
0709 13:15:24.962683 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.962915 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87057,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":23783,"spinlock_wait_cycles":2999168,"thread_start_us":91027,"threads_started":1,"wal-append.queue_time_us":166915,"wal-append.run_cpu_time_us":3194,"wal-append.run_wall_time_us":1272471}
I20260709 13:15:24.775405  4893 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:24.789673  5417 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:24.964720  5249 consensus_meta.cc:287] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.000s
I20260709 13:15:24.804141  5520 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:24.962858  5042 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:25.323417  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1586) took 2263 ms. Trace:
I20260709 13:15:25.256511  3126 raft_consensus.cc:1275] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:25.326175  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1597) took 1828 ms. Trace:
I20260709 13:15:25.326623  3126 rpcz_store.cc:276] 0709 13:15:23.520016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.255656 (+1735640us) service_pool.cc:224] Handling call
0709 13:15:25.256070 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:25.325815 (+ 69745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.326104 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:25.110982  5542 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:24.896919  5414 raft_consensus.cc:697] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:25.057978  5536 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.057523  5197 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:24.785394  5374 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:25.264256  4835 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:25.259698  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 103636us
W20260709 13:15:25.261050  3092 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.028s	sys 0.020s
I20260709 13:15:24.962400  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:15:25.336577  3092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.028s	sys 0.020s
I20260709 13:15:25.337628  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:15:25.264889  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 107545us
I20260709 13:15:25.113492  5461 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.268324  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1576) took 3342 ms. Trace:
W20260709 13:15:25.292935  5192 consensus_meta.cc:287] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.202s	user 0.007s	sys 0.003s
I20260709 13:15:25.273002  3797 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 500) took 3455 ms. Trace:
I20260709 13:15:25.275334  3193 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:25.285853  3046 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:25.286164  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:25.266018  5450 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:25.248770  5501 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:25.294934  3050 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:15:25.313562  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 1590) took 1132 ms. Trace:
I20260709 13:15:25.328275  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:25.278301  5366 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.911096  5533 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:25.345693  3165 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:25.320091  5435 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:25.262467  3791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43926 (request call id 517) took 1078 ms. Trace:
W20260709 13:15:25.290179  5321 consensus_meta.cc:287] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.856s	user 0.007s	sys 0.004s
I20260709 13:15:25.270920  5511 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:25.331977  5371 raft_consensus.cc:697] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:25.335686  3044 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:25.323535  5417 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:25.343770  5461 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:24.949833  5434 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:25.376469  3048 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
W20260709 13:15:25.376883  3091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.020s	sys 0.052s
I20260709 13:15:25.340265  3125 rpcz_store.cc:276] 0709 13:15:21.925592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.615241 (+689649us) service_pool.cc:224] Handling call
0709 13:15:22.615537 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:22.619065 (+  3528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:22.619092 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:22.619533 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:15:22.713700 (+ 94167us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:22.713759 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.267924 (+2554165us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b540031ae54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:25.267975 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:25.268017 (+    42us) raft_consensus.cc:1685] finished
0709 13:15:25.268029 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:25.268258 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1062,"raft.queue_time_us":891,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":874,"spinlock_wait_cycles":7331712,"thread_start_us":93792,"threads_started":1,"wal-append.queue_time_us":125834,"wal-append.run_cpu_time_us":1836,"wal-append.run_wall_time_us":1061503}
I20260709 13:15:25.312044  5469 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.314828  5502 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:25.379335  3090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.044s	sys 0.129s
I20260709 13:15:25.260735  5474 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:25.341763  3126 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:25.323995  5249 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:25.332784  5512 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:25.331094  3123 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:25.370759  5112 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:25.323992  3121 rpcz_store.cc:276] 0709 13:15:23.059995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.995614 (+935619us) service_pool.cc:224] Handling call
0709 13:15:23.995905 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.058748 (+ 62843us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:24.349121 (+290373us) log.cc:844] Serialized 14 byte log entry
0709 13:15:24.389114 (+ 39993us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:24.389182 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:24.389258 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.309478 (+920220us) spinlock_profiling.cc:243] Waited 62.5 ms on lock 0x7b540010cf54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:25.309546 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:25.323337 (+ 13791us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":98986,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":238,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":2363,"spinlock_wait_cycles":143701376,"thread_start_us":270483,"threads_started":2,"wal-append.queue_time_us":34941}
I20260709 13:15:25.265753  5534 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:25.333570  5542 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:25.343883  4835 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:25.375528  3051 rpcz_store.cc:276] 0709 13:15:24.181130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.181413 (+   283us) service_pool.cc:224] Handling call
0709 13:15:25.313247 (+1131834us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b540027d3d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:25.313477 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353336576}
I20260709 13:15:25.323457  4893 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:25.437140  3797 rpcz_store.cc:276] 0709 13:15:21.817878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.686985 (+869107us) service_pool.cc:224] Handling call
0709 13:15:22.809643 (+122658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:22.972907 (+163264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.272756 (+2299849us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54004af1d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:25.272912 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261315328}
I20260709 13:15:25.392815  3165 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:25.437192  3090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.044s	sys 0.129s
W20260709 13:15:25.483973  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 98286.2us
I20260709 13:15:25.484715  3165 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:15:25.485849  3090 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.132:43109 timed out after 1.627s (SENT) [suppressed 17 similar messages]
I20260709 13:15:25.398033  3049 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
W20260709 13:15:25.430413  3015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.012s	sys 0.030s
I20260709 13:15:25.438019  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1507) took 3317 ms. Trace:
W20260709 13:15:25.486722  3015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.014s	sys 0.030s
I20260709 13:15:25.438280  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1520) took 2153 ms. Trace:
I20260709 13:15:25.386958  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1577) took 3647 ms. Trace:
I20260709 13:15:25.440181  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1600) took 1499 ms. Trace:
I20260709 13:15:25.486797  3195 rpcz_store.cc:276] 0709 13:15:22.120253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.261226 (+140973us) service_pool.cc:224] Handling call
0709 13:15:22.276519 (+ 15293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:22.362180 (+ 85661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.437704 (+3075524us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b5400040bd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:25.437949 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82353024}
I20260709 13:15:25.343879  5197 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:25.382658  5366 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:25.441937  5469 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:25.438906  5511 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:25.379125  5501 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:25.287019  5550 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:25.339712  5042 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:25.390867  5373 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:25.371075  5540 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:25.439086  3045 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
W20260709 13:15:25.449018  3091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.021s	sys 0.055s
I20260709 13:15:25.476287  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1598) took 1758 ms. Trace:
I20260709 13:15:25.370983  5549 consensus_queue.cc:1059] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:15:25.379415  5555 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.320719  5535 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:25.487136  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 1.04482e+06us
I20260709 13:15:25.487684  3126 rpcz_store.cc:276] 0709 13:15:23.940583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.340911 (+1400328us) service_pool.cc:224] Handling call
0709 13:15:25.341321 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:25.439933 (+ 98612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.440121 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:25.487308  3193 rpcz_store.cc:276] 0709 13:15:23.285427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.274498 (+1989071us) service_pool.cc:224] Handling call
0709 13:15:25.274914 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:25.438041 (+163127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.438231 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:25.487542  3118 rpcz_store.cc:276] 0709 13:15:21.739727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.739882 (+   155us) service_pool.cc:224] Handling call
0709 13:15:21.785475 (+ 45593us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:21.854868 (+ 69393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:21.854897 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:21.859894 (+  4997us) log.cc:844] Serialized 26 byte log entry
0709 13:15:24.494821 (+2634927us) spinlock_profiling.cc:243] Waited 9.03 ms on lock 0x7b180003fb80. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:15:24.987046 (+492225us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:24.987111 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.987245 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:25.371345 (+384100us) raft_consensus.cc:1685] finished
0709 13:15:25.371363 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:25.386869 (+ 15506us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36739,"raft.queue_time_us":75880,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":18381,"spinlock_wait_cycles":20761472,"thread_start_us":558319,"threads_started":2,"wal-append.queue_time_us":3437677}
I20260709 13:15:25.485579  3165 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:25.493566  3121 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:15:25.480196  5421 consensus_meta.cc:287] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.093s	user 0.010s	sys 0.002s
W20260709 13:15:25.496628  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 190096us
I20260709 13:15:25.498113  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1595) took 2411 ms. Trace:
I20260709 13:15:25.440405  5316 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:25.482188  5530 consensus_meta.cc:287] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.056s	user 0.008s	sys 0.004s
I20260709 13:15:25.383665  3791 rpcz_store.cc:276] 0709 13:15:24.181180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.415056 (+233876us) service_pool.cc:224] Handling call
0709 13:15:25.259099 (+844043us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:25.370450  5414 consensus_queue.cc:237] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:25.332590  5520 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:25.524820  3125 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:25.525415  3123 rpcz_store.cc:276] 0709 13:15:23.718122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.330263 (+1612141us) service_pool.cc:224] Handling call
0709 13:15:25.330654 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:25.475986 (+145332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.476226 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:25.526088  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 1.10178e+06us
I20260709 13:15:25.391103  5321 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:25.527545  5540 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.495388  5503 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:25.436282  5192 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:25.497175  5502 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:25.494550  5112 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:25.539676  5562 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:25.546669  5546 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:15:25.522089  5373 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:25.547912  5554 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:15:25.555267  5497 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:25.553475  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1556) took 4176 ms. Trace:
I20260709 13:15:25.370497  5536 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:25.392409  5189 consensus_queue.cc:237] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:25.560403  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1585) took 1418 ms. Trace:
I20260709 13:15:25.560099  5371 consensus_queue.cc:237] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:25.541231  5559 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:25.540596  5557 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:25.578646  5417 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:25.370576  5374 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:25.566789  5249 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:25.717572  3048 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:25.750809  3790 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.002s	sys 0.029s
I20260709 13:15:25.606325  3046 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:25.748569  3119 rpcz_store.cc:276] 0709 13:15:23.086780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.999380 (+912600us) service_pool.cc:224] Handling call
0709 13:15:23.999654 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:23.999883 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:24.017603 (+ 17720us) log.cc:844] Serialized 14 byte log entry
0709 13:15:25.278620 (+1261017us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b18002bd440. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff5323a 00007ff8303bda2a
0709 13:15:25.497717 (+219097us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:25.497804 (+    87us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:25.497864 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.497932 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:25.498055 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16578,"prepare.queue_time_us":13706,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":95,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":20895,"spinlock_wait_cycles":3351808,"thread_start_us":218793,"threads_started":1,"wal-append.queue_time_us":1506879}
I20260709 13:15:25.847615  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:25.848055  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:25.621423  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1582) took 2562 ms. Trace:
I20260709 13:15:25.848877  3117 rpcz_store.cc:276] 0709 13:15:23.058670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.080504 (+ 21834us) service_pool.cc:224] Handling call
0709 13:15:23.201413 (+120909us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:23.629300 (+427887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:23.629346 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:23.629883 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:15:24.002084 (+372201us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:24.002181 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.554101 (+1551920us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b540010e354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:25.554157 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:25.554212 (+    55us) raft_consensus.cc:1685] finished
0709 13:15:25.554224 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:25.621354 (+ 67130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1168,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"spinlock_wait_cycles":983006080,"thread_start_us":371703,"threads_started":1,"wal-append.queue_time_us":495091,"wal-append.run_cpu_time_us":1566,"wal-append.run_wall_time_us":1028264}
I20260709 13:15:25.654371  5550 raft_consensus.cc:3055] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:25.752655  5411 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:25.759593  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 274067us
I20260709 13:15:25.754647  5540 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:25.808408  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1516) took 2726 ms. Trace:
I20260709 13:15:25.801192  3049 rpcz_store.cc:276] 0709 13:15:24.141552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.141899 (+   347us) service_pool.cc:224] Handling call
0709 13:15:24.156684 (+ 14785us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:25.486683 (+1329999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.560141 (+ 73458us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54000c6554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:25.560332 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2840696192}
W20260709 13:15:25.779004  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 293156us
I20260709 13:15:25.811396  5450 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:25.814702  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:25.814131  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:25.879232  3126 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:25.878937  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:25.880319  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:25.813704  5552 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.719844  5398 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.754065  5266 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.754184  5373 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:25.748792  5503 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.901921  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:25.728258  5445 consensus_meta.cc:287] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.076s	user 0.012s	sys 0.002s
W20260709 13:15:25.837400  3015 connection.cc:256] RPC call timeout handler was delayed by -1.2855397000000721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
W20260709 13:15:25.902915  3015 connection.cc:256] RPC call timeout handler was delayed by -1.2540397000000212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
W20260709 13:15:25.903264  3015 connection.cc:256] RPC call timeout handler was delayed by -1.2255902200001856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
W20260709 13:15:25.903647  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0911396999999852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
W20260709 13:15:25.904021  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0911396999999852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
I20260709 13:15:25.904906  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:25.579438  4893 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:25.719838  5560 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:25.755460  5502 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.761695  3091 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:25.865581  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:25.918263  3797 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:25.813446  3122 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:15:25.868980  3194 rpcz_store.cc:276] 0709 13:15:23.082205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.803224 (+1721019us) service_pool.cc:224] Handling call
0709 13:15:24.803671 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:24.886772 (+ 83101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.886824 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:25.105181 (+218357us) log.cc:844] Serialized 26 byte log entry
0709 13:15:25.422295 (+317114us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:25.802295 (+380000us) log.cc:844] Serialized 14 byte log entry
0709 13:15:25.808049 (+  5754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.808133 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:25.808176 (+    43us) raft_consensus.cc:1685] finished
0709 13:15:25.808192 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:25.808342 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":165691,"raft.queue_time_us":26360,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":21889,"thread_start_us":656231,"threads_started":2,"wal-append.queue_time_us":395361}
I20260709 13:15:25.874903  3090 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:25.921300  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 46478.2us
I20260709 13:15:25.875955  5440 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:25.876983  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:25.801561  5549 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:25.934962  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:25.812930  5470 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.885824  5249 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:25.817900  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:25.621563  5555 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:25.758004  3047 rpcz_store.cc:276] 0709 13:15:21.376808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.378068 (+  1260us) service_pool.cc:224] Handling call
0709 13:15:21.409777 (+ 31709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:23.670969 (+2261192us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:23.891861 (+220892us) log.cc:844] Serialized 14 byte log entry
0709 13:15:24.258133 (+366272us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:24.258179 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:24.258242 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.553146 (+1294904us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b54003c46d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:25.553199 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:25.553361 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78689,"prepare.queue_time_us":220667,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":74117,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"spinlock_wait_cycles":5199304576,"thread_start_us":291963,"threads_started":1,"wal-append.queue_time_us":405802,"wal-append.run_cpu_time_us":2017,"wal-append.run_wall_time_us":1263007}
I20260709 13:15:25.497298  5420 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.352s
I20260709 13:15:25.883365  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1598) took 2686 ms. Trace:
I20260709 13:15:25.904592  5511 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:25.759562  5112 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:25.758013  5438 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 13:15:25.758356  5562 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:25.879356  5411 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:25.931924  5502 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:25.982381  4835 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:25.983901  3125 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:15:25.847095  3790 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.003s	sys 0.029s
I20260709 13:15:25.848070  5366 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:25.906857  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:25.995682  3117 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:25.996137  4835 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:25.996709  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:25.851488  5509 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.997984  5509 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:26.000058  5509 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:25.852701  5550 raft_consensus.cc:740] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:26.002348  5550 consensus_queue.cc:260] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:26.004074  5550 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:25.875447  5512 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:15:25.924336  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:25.922236  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:26.010946  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:26.011379  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:25.898372  5563 log.cc:927] Time spent T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:15:25.848730  5417 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:15:25.880961  3126 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:26.014308  5494 raft_consensus.cc:3055] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:26.014736  5494 raft_consensus.cc:740] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:26.015620  5494 consensus_queue.cc:260] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:26.017086  5494 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:25.947757  5470 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:26.019845  5470 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:25.952095  5450 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:26.020617  5450 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.021056  5450 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:26.021987  3126 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:26.023151  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:25.885419  5497 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:25.884861  5570 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:26.025954  5497 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:26.026099  5570 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:26.028301  5497 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:25.946298  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:25.880879  3118 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:26.029872  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:26.030455  3118 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:15:26.030397  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:26.031291  3796 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43926 (request call id 518) took 1849 ms (client timeout 1696 ms). Trace:
W20260709 13:15:26.031687  3796 rpcz_store.cc:269] 0709 13:15:24.181423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.182880 (+  1457us) service_pool.cc:224] Handling call
0709 13:15:26.030239 (+1847359us) spinlock_profiling.cc:243] Waited 6.32 ms on lock 0x7b58000c4b98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff8353790a0 00007ff835378984 00007ff82e8f36d4 00007ff82e8f3662
0709 13:15:26.031216 (+   977us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14543744}
I20260709 13:15:25.946980  3799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 520) took 1561 ms. Trace:
I20260709 13:15:26.033911  3799 rpcz_store.cc:276] 0709 13:15:24.385594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.441372 (+ 55778us) service_pool.cc:224] Handling call
0709 13:15:24.441757 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:24.442141 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.442172 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:24.748490 (+306318us) log.cc:844] Serialized 26 byte log entry
0709 13:15:25.082081 (+333591us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:25.082136 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.082236 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:25.946760 (+864524us) raft_consensus.cc:1685] finished
0709 13:15:25.946779 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:25.946924 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":600,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":22626,"thread_start_us":306091,"threads_started":1,"wal-append.queue_time_us":630418}
W20260709 13:15:25.947026  3192 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.008s	sys 0.020s
W20260709 13:15:26.035558  3192 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.008s	sys 0.020s
I20260709 13:15:25.902029  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:25.949864  3120 rpcz_store.cc:276] 0709 13:15:23.196515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.430860 (+1234345us) service_pool.cc:224] Handling call
0709 13:15:24.431187 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:24.431485 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.431512 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:24.432179 (+   667us) log.cc:844] Serialized 26 byte log entry
0709 13:15:25.252675 (+820496us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:25.252720 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.252790 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:25.883090 (+630300us) raft_consensus.cc:1685] finished
0709 13:15:25.883116 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:25.883282 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":340165,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":27243,"thread_start_us":819998,"threads_started":1,"wal-append.queue_time_us":903233}
I20260709 13:15:25.753252  5316 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:25.826759  5559 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:25.811424  5530 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
W20260709 13:15:26.011180  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 89067.7us
I20260709 13:15:25.878911  5469 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:25.941628  4893 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:26.024583  5463 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:25.887925  5533 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:26.028501  5570 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:25.907866  5503 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:25.834544  5557 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:26.036336  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1515) took 2954 ms. Trace:
I20260709 13:15:26.063103  3090 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:26.037022  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:26.072101  3117 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
W20260709 13:15:26.041919  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 217147us
I20260709 13:15:26.041539  3118 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:25.907505  5266 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:25.833331  5421 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:25.902374  5398 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:25.918159  5445 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:26.073598  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1518) took 2862 ms. Trace:
I20260709 13:15:26.009390  5511 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:26.074682  3090 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:26.074963  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:26.088339  3799 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:26.075387  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:26.089017  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1528) took 2371 ms. Trace:
I20260709 13:15:26.076134  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:26.076237  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:26.090003  3797 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:26.090104  3796 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:26.079753  3043 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:15:26.058120  5396 consensus_meta.cc:287] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.633s	user 0.009s	sys 0.004s
I20260709 13:15:26.050313  4835 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:26.092741  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 516930us
W20260709 13:15:26.054337  5433 consensus_meta.cc:287] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.752s	user 0.009s	sys 0.003s
I20260709 13:15:26.085986  3191 rpcz_store.cc:276] 0709 13:15:23.211436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.246968 (+2035532us) service_pool.cc:224] Handling call
0709 13:15:25.247424 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:25.298133 (+ 50709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:25.298181 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:25.298792 (+   611us) log.cc:844] Serialized 26 byte log entry
0709 13:15:25.496231 (+197439us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:25.496284 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.496432 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:26.073364 (+576932us) raft_consensus.cc:1685] finished
0709 13:15:26.073384 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:26.073522 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50137,"raft.queue_time_us":63021,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"thread_start_us":196948,"threads_started":1,"wal-append.queue_time_us":423772}
I20260709 13:15:25.900120  5552 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:25.951743  5249 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:26.045874  5556 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:26.112013  3196 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:26.111120  5561 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:25.936779  5560 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:26.115660  5561 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.122474  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:26.104763  5440 raft_consensus.cc:2764] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:15:26.070267  5455 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:15:26.048801  5512 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:26.089455  3195 rpcz_store.cc:276] 0709 13:15:23.717323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.495122 (+1777799us) service_pool.cc:224] Handling call
0709 13:15:25.495418 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:25.495758 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:25.811151 (+315393us) log.cc:844] Serialized 14 byte log entry
0709 13:15:26.088684 (+277533us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:26.088734 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:26.088784 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.088843 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:26.088962 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4622,"prepare.queue_time_us":436839,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":86,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":7956,"thread_start_us":535923,"threads_started":2}
I20260709 13:15:26.126168  3123 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:26.123173  3191 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:26.131047  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:26.132745  3119 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:15:26.116961  5553 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:26.117139  5192 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:26.103884  5396 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:26.143954  3123 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:15:26.126041  5561 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:26.160983  3191 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:26.137284  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:26.168862  3121 raft_consensus.cc:2410] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:26.191097  3799 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:26.290750  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:26.070746  3192 rpcz_store.cc:276] 0709 13:15:23.081896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.413067 (+1331171us) service_pool.cc:224] Handling call
0709 13:15:24.414209 (+  1142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.414376 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:24.440862 (+ 26486us) log.cc:844] Serialized 14 byte log entry
0709 13:15:25.314285 (+873423us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b18003b15e0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff5323a 00007ff8303bda2a
0709 13:15:26.036003 (+721718us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:26.036053 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:26.036106 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.036168 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:26.036285 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26041,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":14960,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":16332,"spinlock_wait_cycles":20005632,"thread_start_us":721463,"threads_started":1,"wal-append.queue_time_us":1630963}
W20260709 13:15:26.387707  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:26.154601  3119 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:26.186120  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1597) took 2989 ms. Trace:
W20260709 13:15:26.584594  3048 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.000s	sys 0.013s
W20260709 13:15:26.739094  3048 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.000s	sys 0.017s
I20260709 13:15:26.297833  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:26.602356  3762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.009s	sys 0.005s
W20260709 13:15:26.732411  3047 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.005s	sys 0.017s
W20260709 13:15:26.740206  3762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.011s	sys 0.007s
W20260709 13:15:26.740512  3047 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.005s	sys 0.017s
W20260709 13:15:26.740641  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 985115us
I20260709 13:15:26.182448  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:26.182088  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:26.742360  3193 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:26.601086  3090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.014s	sys 0.012s
W20260709 13:15:26.742988  3090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.014s	sys 0.015s
W20260709 13:15:26.743614  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 668968us
W20260709 13:15:26.166474  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 416735us
W20260709 13:15:26.154742  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 219820us
W20260709 13:15:26.639588  3051 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.006s	sys 0.009s
I20260709 13:15:26.746999  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:26.747081  3051 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.006s	sys 0.012s
W20260709 13:15:26.814851  3049 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.010s	sys 0.014s
W20260709 13:15:26.805568  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 63770us
I20260709 13:15:26.817206  3762 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:26.819550  3762 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:26.738157  3124 rpcz_store.cc:276] 0709 13:15:23.196249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.298387 (+1102138us) service_pool.cc:224] Handling call
0709 13:15:24.298795 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:24.314365 (+ 15570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.314405 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:24.333619 (+ 19214us) log.cc:844] Serialized 26 byte log entry
0709 13:15:25.559450 (+1225831us) spinlock_profiling.cc:243] Waited 8.83 ms on lock 0x7b18003748c0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:15:25.908539 (+349089us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:25.908579 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.908642 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:26.185802 (+277160us) raft_consensus.cc:1685] finished
0709 13:15:26.185824 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:26.186050 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38963,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":17297,"spinlock_wait_cycles":20299008,"thread_start_us":348893,"threads_started":1,"wal-append.queue_time_us":1735041}
W20260709 13:15:26.815557  3049 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.011s	sys 0.014s
I20260709 13:15:26.821596  3762 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:26.827590  3762 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:15:26.831470  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:26.562793  5373 consensus_meta.cc:287] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.645s	user 0.007s	sys 0.003s
W20260709 13:15:26.720434  3790 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.009s	sys 0.032s
W20260709 13:15:26.320240  5541 log.cc:927] Time spent T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 1.927s	user 0.000s	sys 0.012s
W20260709 13:15:26.214819  5542 consensus_meta.cc:287] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.714s	user 0.007s	sys 0.007s
W20260709 13:15:26.591180  5189 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.002s	sys 0.011s
I20260709 13:15:26.148476  5520 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:26.290766  5397 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:26.600710  5526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.018s	sys 0.024s
I20260709 13:15:26.148070  5374 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:26.208508  5562 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:26.309441  5461 consensus_meta.cc:287] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.857s	user 0.009s	sys 0.000s
I20260709 13:15:26.334638  5555 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:26.315995  5445 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:26.855345  5373 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:26.208097  5530 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:26.311841  5112 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:26.861188  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:26.892055  3192 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:26.892653  5373 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:26.868721  5189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.002s	sys 0.015s
I20260709 13:15:26.213804  5396 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:26.873520  5542 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:26.894150  5396 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:26.893994  5461 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:26.894632  5396 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:26.895051  5396 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:26.862445  5534 consensus_meta.cc:287] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.366s	user 0.003s	sys 0.008s
I20260709 13:15:26.895903  5461 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:26.299782  4835 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.213907  5560 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:26.186131  5398 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:26.736092  5512 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:26.268021  5535 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:26.312856  5559 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:26.208313  5266 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:26.896265  5534 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:26.920951  5398 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:26.923290  5266 consensus_queue.cc:1059] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:26.924136  5266 consensus_queue.cc:1243] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:26.924634  5266 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:26.925042  5266 raft_consensus.cc:697] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:26.925269  5534 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:26.208914  5536 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:26.318787  5368 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:26.920678  5560 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:15:26.926519  5266 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:26.868260  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 121340us
I20260709 13:15:26.895921  5542 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:26.930259  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:26.931171  5368 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:26.931531  5368 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:26.931881  5368 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:26.932257  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:26.872200  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:26.872812  5588 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:26.749594  5579 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.311278  5557 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:26.749963  5434 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.303027  5421 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:26.135879  5556 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:26.884336  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:26.885882  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 139746us
I20260709 13:15:26.943897  3091 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:26.877009  5397 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.212586  5552 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:26.328063  5450 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:26.906052  3192 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:26.955498  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:26.868186  5405 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:15:26.885046  5526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.026s	sys 0.032s
I20260709 13:15:26.155845  5411 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:26.819387  5580 consensus_queue.cc:1059] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:15:26.923648  5398 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.877465  5414 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.951188  5397 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:26.322822  5042 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:26.936553  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:26.939486  3761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.027s	sys 0.010s
I20260709 13:15:26.905078  4835 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:26.896868  5249 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:26.847832  3790 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.013s	sys 0.040s
I20260709 13:15:26.945313  3091 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:26.946086  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 201698us
I20260709 13:15:26.961889  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1603) took 1102 ms. Trace:
I20260709 13:15:26.967083  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1599) took 1109 ms. Trace:
I20260709 13:15:27.050773  3045 rpcz_store.cc:276] 0709 13:15:25.859214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.243834 (+384620us) service_pool.cc:224] Handling call
0709 13:15:26.244240 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:26.244568 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:26.626495 (+381927us) log.cc:844] Serialized 14 byte log entry
0709 13:15:26.961427 (+334932us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:26.961494 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:26.961570 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.961657 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:26.961820 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":125,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":4769,"thread_start_us":445788,"threads_started":2}
W20260709 13:15:27.052053  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:26.186470  5316 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:26.977892  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:26.951412  5445 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:27.022281  3761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.032s	sys 0.022s
W20260709 13:15:27.092375  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 1.01627e+06us
I20260709 13:15:27.092502  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1605) took 1232 ms. Trace:
I20260709 13:15:27.093621  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:26.940698  5542 consensus_queue.cc:1059] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:15:26.938033  5588 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:15:27.058564  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 231022us
I20260709 13:15:26.982007  5405 raft_consensus.cc:697] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:27.110314  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:26.967118  5559 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:27.052781  5580 raft_consensus.cc:3055] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:27.129156  5450 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:27.129536  5580 raft_consensus.cc:740] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:15:27.130520  5594 log.cc:927] Time spent T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:15:27.130678  5580 consensus_queue.cc:260] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:27.132143  5580 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:27.093070  3045 rpcz_store.cc:276] 0709 13:15:25.859772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.091525 (+1231753us) service_pool.cc:224] Handling call
0709 13:15:27.091855 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.092076 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:27.092111 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:27.092176 (+    65us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:27.092239 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.092308 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.092439 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:27.134353  3151 heartbeater.cc:646] Failed to heartbeat to 127.1.227.190:44821 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.1.227.190:44821 timed out after 15.000s (SENT)
I20260709 13:15:26.956984  5434 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:26.985417  5398 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:27.050832  3048 rpcz_store.cc:276] 0709 13:15:25.858068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.945532 (+ 87464us) service_pool.cc:224] Handling call
0709 13:15:25.975281 (+ 29749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:25.975497 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:26.739565 (+764068us) log.cc:844] Serialized 14 byte log entry
0709 13:15:26.966412 (+226847us) log.cc:844] Serialized 14 byte log entry
0709 13:15:26.966652 (+   240us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:26.966709 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:26.966789 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.966880 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:26.967019 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4056,"prepare.queue_time_us":892896,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":3004,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":11413,"spinlock_wait_cycles":149620736,"thread_start_us":916656,"threads_started":2}
I20260709 13:15:26.981184  5373 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.137662  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 275) took 1448 ms. Trace:
W20260709 13:15:27.096561  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 151327us
I20260709 13:15:27.143301  3091 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:27.097085  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46501.7us
W20260709 13:15:27.100994  5604 log.cc:927] Time spent T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:15:26.982547  5411 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:27.146895  3193 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:27.147156  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:27.147522  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1533) took 1029 ms. Trace:
I20260709 13:15:27.147888  3193 rpcz_store.cc:276] 0709 13:15:26.118057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.144841 (+ 26784us) service_pool.cc:224] Handling call
0709 13:15:27.147427 (+1002586us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:27.148175  3090 connection.cc:256] RPC call timeout handler was delayed by -1.0408724999999777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
I20260709 13:15:27.104882  3790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 522) took 2718 ms. Trace:
I20260709 13:15:26.986346  5421 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:27.114670  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.109328  5588 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:27.118538  5590 log.cc:927] Time spent T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:15:27.112804  5042 consensus_queue.cc:1059] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:15:27.210487  5042 consensus_queue.cc:1243] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:27.210915  5421 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:27.119285  5601 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
W20260709 13:15:27.119438  5550 consensus_meta.cc:287] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.115s	user 0.011s	sys 0.001s
W20260709 13:15:27.120163  5540 consensus_meta.cc:287] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.223s	user 0.007s	sys 0.004s
W20260709 13:15:27.121068  5501 consensus_meta.cc:287] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.597s	user 0.009s	sys 0.003s
I20260709 13:15:27.214474  5540 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:27.125922  5461 raft_consensus.cc:3055] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:27.215467  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1598) took 1357 ms. Trace:
I20260709 13:15:27.215438  5461 raft_consensus.cc:740] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:27.215849  3042 rpcz_store.cc:276] 0709 13:15:25.857724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.861606 (+  3882us) service_pool.cc:224] Handling call
0709 13:15:25.897878 (+ 36272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:25.906169 (+  8291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:25.906213 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:25.906667 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:15:26.161842 (+255175us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:26.161898 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.161988 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:27.215248 (+1053260us) raft_consensus.cc:1685] finished
0709 13:15:27.215267 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.215410 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8182,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":18963,"thread_start_us":207695,"threads_started":1,"wal-append.queue_time_us":997888}
I20260709 13:15:27.216483  5461 consensus_queue.cc:260] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:27.217443  3197 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:27.146582  5048 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:27.217661  5461 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:27.211428  5552 consensus_queue.cc:1059] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:15:27.218346  5048 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.218729  5552 consensus_queue.cc:1243] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:27.218842  5048 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:27.148253  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 1611) took 1270 ms. Trace:
I20260709 13:15:27.148597  5586 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:27.220876  5586 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.104645  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1602) took 1245 ms. Trace:
W20260709 13:15:27.149434  3119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55318 (request call id 303) took 1334 ms (client timeout 1654 ms). Trace:
I20260709 13:15:27.128201  5591 raft_consensus.cc:3055] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:27.147105  5411 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:27.221668  3119 rpcz_store.cc:269] 0709 13:15:25.815974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.847834 (+ 31860us) service_pool.cc:224] Handling call
0709 13:15:27.149271 (+1301437us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b5400216954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:27.149373 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":653067648}
I20260709 13:15:27.150079  5434 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:27.150957  3123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55318 (request call id 302) took 1336 ms (client timeout 1675 ms). Trace:
I20260709 13:15:27.210995  5042 raft_consensus.cc:3055] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:27.150486  3792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 523) took 1811 ms. Trace:
I20260709 13:15:27.223140  5042 raft_consensus.cc:740] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:27.150470  5373 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:27.224151  5042 consensus_queue.cc:260] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:27.225162  5373 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:27.152220  5503 consensus_meta.cc:287] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.072s	user 0.007s	sys 0.003s
W20260709 13:15:27.153463  5564 log.cc:927] Time spent T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 1.261s	user 0.004s	sys 0.007s
I20260709 13:15:27.225589  5042 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:27.213609  5421 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:27.155519  5474 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:27.154906  5556 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:27.000497  5414 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:27.221572  3046 rpcz_store.cc:276] 0709 13:15:25.858925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.018921 (+159996us) service_pool.cc:224] Handling call
0709 13:15:26.019286 (+   365us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:26.019701 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:26.019730 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:26.020336 (+   606us) log.cc:844] Serialized 52 byte log entry
0709 13:15:26.255198 (+234862us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:26.255256 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.255354 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:27.104407 (+849053us) raft_consensus.cc:1685] finished
0709 13:15:27.104428 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.104584 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":107,"thread_start_us":234409,"threads_started":1,"wal-append.queue_time_us":982777}
I20260709 13:15:27.230273  5414 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:27.231030  3798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 377) took 2799 ms. Trace:
I20260709 13:15:27.231448  3798 rpcz_store.cc:276] 0709 13:15:24.431613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.878239 (+446626us) service_pool.cc:224] Handling call
0709 13:15:24.919200 (+ 40961us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:24.919677 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.919744 (+    67us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:25.113837 (+194093us) log.cc:844] Serialized 52 byte log entry
0709 13:15:25.529617 (+415780us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:25.906091 (+376474us) log.cc:844] Serialized 14 byte log entry
0709 13:15:25.916984 (+ 10893us) log.cc:844] Serialized 14 byte log entry
0709 13:15:26.306400 (+389416us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b18003de940. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:15:26.338796 (+ 32396us) spinlock_profiling.cc:243] Waited 54.8 ms on lock 0x7b18003de940. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82ff5b4bc 00007ff82d2a948b 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c3455 00007ff8303ab060 00007ff8303bd716 00007ff8303ce287
0709 13:15:26.338991 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.339094 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:27.152894 (+813800us) spinlock_profiling.cc:243] Waited 7.49 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:27.230791 (+ 77897us) raft_consensus.cc:1685] finished
0709 13:15:27.230815 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.230970 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":375860,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":85,"raft.queue_time_us":734646,"raft.run_cpu_time_us":476,"raft.run_wall_time_us":42154,"spinlock_wait_cycles":176481792,"thread_start_us":963614,"threads_started":3,"wal-append.queue_time_us":736295}
I20260709 13:15:27.113615  5455 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:27.156905  5502 consensus_meta.cc:287] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.109s	user 0.010s	sys 0.000s
I20260709 13:15:27.234201  5502 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:27.234549  5048 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:15:27.160194  5561 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:27.164219  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:27.237509  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:27.238860  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:27.238915  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:27.239871  3191 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:27.161584  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:27.240103  3046 raft_consensus.cc:2410] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:15:27.167459  3044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 1954) took 2643 ms (client timeout 2041 ms). Trace:
I20260709 13:15:27.142122  3051 rpcz_store.cc:276] 0709 13:15:25.688838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.689225 (+   387us) service_pool.cc:224] Handling call
0709 13:15:25.689666 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:25.690180 (+   514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:25.690222 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:25.690805 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:15:26.812201 (+1121396us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:26.812242 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.812315 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:27.137447 (+325132us) raft_consensus.cc:1685] finished
0709 13:15:27.137464 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.137610 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":907,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":12661,"thread_start_us":1094042,"threads_started":1,"wal-append.queue_time_us":1324430}
I20260709 13:15:27.172509  3091 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:27.240768  3193 raft_consensus.cc:2410] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:15:27.241290  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 68871us
I20260709 13:15:27.173153  5610 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:27.173779  5587 consensus_queue.cc:1059] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:27.249785  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:27.250027  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:27.250396  3191 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:27.251206  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:27.252081  5561 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:27.252202  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:27.221470  5586 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:27.252904  3191 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 5: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:27.179463  5534 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.206051  5595 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:27.206645  5609 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.192749  3790 rpcz_store.cc:276] 0709 13:15:24.386275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.427312 (+ 41037us) service_pool.cc:224] Handling call
0709 13:15:24.427766 (+   454us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:24.470258 (+ 42492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.471784 (+  1526us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:24.748103 (+276319us) log.cc:844] Serialized 52 byte log entry
0709 13:15:25.080476 (+332373us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:25.311692 (+231216us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b480027c3d8. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff8352dcaa1 00007ff8352d3b37 00007ff8352d39ca 00007ff8353cb26f 00007ff8353caf37 00007ff8353df55c 00007ff8353df508 00007ff8353df488 00007ff8353df443 00007ff8353de6ec 00007ff834308a96
0709 13:15:25.994329 (+682637us) log.cc:844] Serialized 14 byte log entry
0709 13:15:27.085384 (+1091055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.104532 (+ 19148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:27.104575 (+    43us) raft_consensus.cc:1685] finished
0709 13:15:27.104655 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.104823 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9930,"prepare.queue_time_us":797868,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":307951,"raft.run_cpu_time_us":5618,"raft.run_wall_time_us":865402,"spinlock_wait_cycles":30487296,"thread_start_us":2273931,"threads_started":3,"wal-append.queue_time_us":742586,"wal-append.run_cpu_time_us":2754,"wal-append.run_wall_time_us":1505476}
I20260709 13:15:27.208565  5390 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:27.214581  5501 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:27.216725  5540 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:26.948560  5579 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:27.220702  3121 rpcz_store.cc:276] 0709 13:15:25.878231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.946056 (+ 67825us) service_pool.cc:224] Handling call
0709 13:15:27.148082 (+1202026us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54000a8f54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:27.148192 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292256512}
I20260709 13:15:27.223489  3792 rpcz_store.cc:276] 0709 13:15:25.338778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.344036 (+  5258us) service_pool.cc:224] Handling call
0709 13:15:25.371007 (+ 26971us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:25.478217 (+107210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:25.480746 (+  2529us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:25.563551 (+ 82805us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b2c00047618. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:15:25.563987 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:15:25.866250 (+302263us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:25.882734 (+ 16484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.150142 (+1267408us) spinlock_profiling.cc:243] Waited 71.5 ms on lock 0x7b54004bb254. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:27.150196 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:27.150261 (+    65us) raft_consensus.cc:1685] finished
0709 13:15:27.150274 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.150427 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10783,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":18295,"spinlock_wait_cycles":172338304,"thread_start_us":278103,"threads_started":1,"wal-append.queue_time_us":377719,"wal-append.run_cpu_time_us":8540,"wal-append.run_wall_time_us":1100687}
I20260709 13:15:27.141774  5266 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:27.148392  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:27.223062  3123 rpcz_store.cc:269] 0709 13:15:25.814398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.814506 (+   108us) service_pool.cc:224] Handling call
0709 13:15:27.150810 (+1336304us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54000a9454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:27.150906 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568390528}
I20260709 13:15:27.153074  5405 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:27.162300  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1806) took 3937 ms. Trace:
I20260709 13:15:27.235875  3200 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:15:27.243109  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:27.161372  5606 consensus_queue.cc:1059] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:27.220003  5398 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:27.244343  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:27.245489  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 1951) took 2754 ms. Trace:
W20260709 13:15:27.240741  3044 rpcz_store.cc:269] 0709 13:15:24.523663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.527127 (+  3464us) service_pool.cc:224] Handling call
0709 13:15:27.167165 (+2640038us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b54001d83d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:27.167314 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1299223424}
I20260709 13:15:27.246390  3050 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:15:27.235193  5397 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:27.374827  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:27.400343  3043 rpcz_store.cc:276] 0709 13:15:24.491326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.491464 (+   138us) service_pool.cc:224] Handling call
0709 13:15:27.245311 (+2753847us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54001aefd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:27.245439 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3036919040}
I20260709 13:15:27.303987  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:27.328459  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:27.326467  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1600) took 1468 ms. Trace:
I20260709 13:15:27.402642  3196 rpcz_store.cc:276] 0709 13:15:23.224534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.259293 (+2034759us) service_pool.cc:224] Handling call
0709 13:15:25.319111 (+ 59818us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:26.112619 (+793508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.162047 (+1049428us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b54001b76d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:27.162241 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817278336}
W20260709 13:15:27.372651  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.262905  3124 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:15:27.358666  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.303118  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:27.405439  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.250672  3193 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
W20260709 13:15:27.361989  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.402004  3046 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:27.385367  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1592) took 4235 ms. Trace:
I20260709 13:15:27.409618  3122 rpcz_store.cc:276] 0709 13:15:23.149969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.125911 (+975942us) service_pool.cc:224] Handling call
0709 13:15:24.126215 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:25.919412 (+1793197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.384987 (+1465575us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54003e8354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:27.385275 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3879696128}
I20260709 13:15:27.403012  3195 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:27.404034  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1542) took 1118 ms. Trace:
I20260709 13:15:27.420120  3198 rpcz_store.cc:276] 0709 13:15:26.285398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.148151 (+862753us) service_pool.cc:224] Handling call
0709 13:15:27.403973 (+255822us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.422005  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:27.422811  3198 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:27.423625  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1541) took 1138 ms. Trace:
I20260709 13:15:27.421056  3048 raft_consensus.cc:2393] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:27.424103  3198 rpcz_store.cc:276] 0709 13:15:26.285130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.421633 (+1136503us) service_pool.cc:224] Handling call
0709 13:15:27.423555 (+  1922us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.427255  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:27.425558  3164 connection.cc:256] RPC call timeout handler was delayed by -1.2495005820001097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24230000000000002s for a response
I20260709 13:15:27.427424  3122 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:15:27.401443  3051 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:27.474525  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:27.403378  3049 rpcz_store.cc:276] 0709 13:15:25.858366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.947659 (+ 89293us) service_pool.cc:224] Handling call
0709 13:15:25.947980 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:26.107041 (+159061us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:26.207445 (+100404us) log.cc:844] Serialized 14 byte log entry
0709 13:15:27.060484 (+853039us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:27.060555 (+    71us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:27.060631 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.326147 (+265516us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54003c37d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:27.326200 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.326388 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41818,"prepare.queue_time_us":828582,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":5302,"raft.queue_time_us":64963,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":365289344,"thread_start_us":892276,"threads_started":3,"wal-append.queue_time_us":945737}
I20260709 13:15:27.428547  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:27.428788  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:27.429221  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:27.430546  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:27.476105  3191 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:27.431646  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:27.221855  5591 raft_consensus.cc:740] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:27.432689  3120 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:27.250088  5503 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:27.332998  5445 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:27.218447  5396 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:27.245149  5610 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.255604  3090 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:27.512669  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:27.513674  3120 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:27.444197  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:27.290838  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.445608  3793 raft_consensus.cc:2393] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 7: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:27.445725  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:27.446812  3192 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:27.250028  5502 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:27.419533  5266 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:27.428941  5595 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:27.443010  5425 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.018s	sys 0.026s
I20260709 13:15:27.223527  5411 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:27.253803  5455 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:27.344260  5561 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.104s
I20260709 13:15:27.476493  3124 raft_consensus.cc:2393] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:27.476606  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1536) took 1192 ms. Trace:
I20260709 13:15:27.475495  3043 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:27.529081  3191 rpcz_store.cc:276] 0709 13:15:26.283742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.422474 (+1138732us) service_pool.cc:224] Handling call
0709 13:15:27.476548 (+ 54074us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.529544  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:27.530172  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:27.530419  3124 raft_consensus.cc:2410] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:27.530640  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:27.530887  3191 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:27.531217  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:27.531536  5595 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:27.531692  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:27.525007  5425 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.018s	sys 0.026s
I20260709 13:15:27.532294  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:27.533062  5425 raft_consensus.cc:1064] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:15:27.533210  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:27.535261  5425 consensus_queue.cc:237] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:27.524259  5266 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:27.543794  5445 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:27.543201  2945 catalog_manager.cc:5697] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.524947  5540 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.545810  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:27.545756  5540 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:27.546375  5501 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:27.528674  5455 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:27.547901  5455 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:27.547935  5540 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:27.334815  5368 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:27.480804  3048 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:27.489374  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:27.475160  3198 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:27.568336  3049 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:27.568709  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:27.492148  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:27.569916  3051 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:27.448343  5534 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:27.500336  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.507247  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:27.576092  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.576190  3122 raft_consensus.cc:2393] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:27.337455  5588 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:27.432717  5609 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:27.515666  3194 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:15:27.515691  3044 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 5: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:27.518759  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:27.577682  3796 raft_consensus.cc:2410] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:27.530215  5397 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:27.519398  3119 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:27.519649  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:27.578894  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:27.518700  3123 raft_consensus.cc:2393] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:15:27.522276  3793 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 375) took 3362 ms (client timeout 1952 ms). Trace:
W20260709 13:15:27.581907  3793 rpcz_store.cc:269] 0709 13:15:24.155750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.171844 (+ 16094us) service_pool.cc:224] Handling call
0709 13:15:26.297588 (+2125744us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b58000c4b98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff8353790a0 00007ff835378984 00007ff82e8f36d4 00007ff82e8f3662
0709 13:15:27.518281 (+1220693us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b5400627fd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:27.518426 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1628271360}
I20260709 13:15:27.522511  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:27.583330  3799 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 5: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:27.522666  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34728 (request call id 275) took 1403 ms. Trace:
I20260709 13:15:27.583793  3197 rpcz_store.cc:276] 0709 13:15:26.119043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.147242 (+ 28199us) service_pool.cc:224] Handling call
0709 13:15:27.522480 (+1375238us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b54003bae54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:27.522608 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1092785024}
I20260709 13:15:27.510015  5316 raft_consensus.cc:3055] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:27.526304  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:27.510300  5610 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:27.529696  3795 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:27.535279  5321 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:27.336021  4835 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:27.532703  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:27.545408  2945 catalog_manager.cc:5697] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 2 to 3, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 3 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.573571  3198 raft_consensus.cc:2410] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:27.525439  5396 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:27.523627  5197 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:27.584425  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:27.592289  3123 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:15:27.549629  5503 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:27.586174  3120 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:27.549583  5586 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:27.588840  3191 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:27.588193  3122 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:27.592659  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:27.600481  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:27.601135  3197 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 2.
I20260709 13:15:27.588815  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:27.602083  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:27.602576  3117 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 5: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:27.602663  3042 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:15:27.603564  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 492358us
I20260709 13:15:27.600159  2945 catalog_manager.cc:5697] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 1 to 2, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 2 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.610955  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:27.612126  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:27.614504  3124 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:27.613425  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:27.615167  3117 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:27.585937  5316 raft_consensus.cc:740] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:27.634370  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:27.634397  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 124467us
W20260709 13:15:27.626008  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 529544us
I20260709 13:15:27.635142  3197 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:27.625677  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:27.646023  2946 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57732 (request call id 229) took 14898 ms (client timeout 15000 ms). Trace:
I20260709 13:15:27.647367  2945 catalog_manager.cc:5697] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 3 to 4, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 4 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.633992  5425 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:27.650488  5425 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:27.646200  3794 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:27.651582  5266 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:27.650180  2945 catalog_manager.cc:5697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 1 to 2, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 2 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.663223  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:27.646577  2946 rpcz_store.cc:269] 0709 13:15:12.678454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.681274 (+  2820us) service_pool.cc:224] Handling call
0709 13:15:13.831884 (+1150610us) spinlock_profiling.cc:243] Waited 73.3 ms on lock 0x7b54000d98d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031d090 00007ff8303bbf3a 00007ff8361721cc 00007ff83627037e 00007ff8347312a4 00007ff834731232 00007ff834731161 00007ff8347310dc 00007ff834730392 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:27.571877 (+13739993us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:17.753675 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:17.776446 (+ 22771us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:17.776479 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:15:17.776495 (+    16us) tablet.cc:662] Decoding operations
0709 13:15:17.941567 (+165072us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:17.948929 (+  7362us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:17.948971 (+    42us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:15:17.950960 (+  1989us) tablet.cc:701] Row locks acquired
0709 13:15:17.950975 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:15:17.951142 (+   167us) write_op.cc:270] Start()
0709 13:15:17.951271 (+   129us) write_op.cc:276] Timestamp: P: 1783602917951082 usec, L: 0
0709 13:15:17.951289 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:15:17.952087 (+   798us) log.cc:844] Serialized 5610 byte log entry
0709 13:15:19.129141 (+1177054us) op_driver.cc:464] REPLICATION: finished
0709 13:15:19.144244 (+ 15103us) write_op.cc:301] APPLY: starting
0709 13:15:19.144308 (+    64us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:19.144525 (+   217us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:19.144637 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:19.146305 (+  1668us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:19.146482 (+   177us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:15:19.146523 (+    41us) write_op.cc:312] APPLY: finished
0709 13:15:19.146839 (+   316us) log.cc:844] Serialized 101 byte log entry
0709 13:15:19.215596 (+ 68757us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:19.216081 (+   485us) write_op.cc:454] Released schema lock
0709 13:15:19.216269 (+   188us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:19.220035 (+  3766us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:19.220086 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2051191,"reported_tablets":32,"spinlock_wait_cycles":168571136,"child_traces":[["op",{"apply.queue_time_us":14791,"apply.run_cpu_time_us":4432,"apply.run_wall_time_us":75550,"num_ops":14,"prepare.queue_time_us":133147,"prepare.run_cpu_time_us":81544,"prepare.run_wall_time_us":368250,"raft.queue_time_us":84509,"raft.run_cpu_time_us":9125,"raft.run_wall_time_us":15236,"replication_time_us":1177705,"thread_start_us":271862,"threads_started":4,"wal-append.queue_time_us":279746,"wal-append.run_cpu_time_us":37734,"wal-append.run_wall_time_us":2607594}]]}
I20260709 13:15:27.665771  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:27.666360  3195 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:27.668454  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 274) took 1549 ms. Trace:
I20260709 13:15:27.668952  3200 rpcz_store.cc:276] 0709 13:15:26.118657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.118794 (+   137us) service_pool.cc:224] Handling call
0709 13:15:26.127252 (+  8458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:27.402184 (+1274932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.668159 (+265975us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001de054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:27.668382 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2548836096}
I20260709 13:15:27.670473  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:27.670993  5588 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:27.671633  5398 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:27.671775  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:27.673101  5368 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:27.678138  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 276) took 1535 ms. Trace:
I20260709 13:15:27.678772  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:27.677642  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:27.679060  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:27.679637  3193 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:27.679781  3197 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.678107  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:27.680886  3198 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:27.679091  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:27.679733  3191 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:27.684203  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 278) took 1541 ms. Trace:
I20260709 13:15:27.686228  3198 rpcz_store.cc:276] 0709 13:15:26.142857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.681683 (+1538826us) service_pool.cc:224] Handling call
0709 13:15:27.683713 (+  2030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.683890 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:27.683916 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:27.683955 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:27.684004 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.684055 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.684152 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.678617  3200 rpcz_store.cc:276] 0709 13:15:26.142253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.672921 (+1530668us) service_pool.cc:224] Handling call
0709 13:15:27.673325 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.673557 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:27.673594 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:27.673648 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:27.673707 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.677870 (+  4163us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.677987 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.690666  5445 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.691164  5445 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:27.694267  3200 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:27.694981  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1535) took 1411 ms. Trace:
I20260709 13:15:27.695287  3200 rpcz_store.cc:276] 0709 13:15:26.283400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.687691 (+1404291us) service_pool.cc:224] Handling call
0709 13:15:27.694078 (+  6387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.694731 (+   653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.694925 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.696851  3200 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:27.699156  3195 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:27.699754  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1539) took 1415 ms. Trace:
I20260709 13:15:27.700059  3195 rpcz_store.cc:276] 0709 13:15:26.284572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.665424 (+1380852us) service_pool.cc:224] Handling call
0709 13:15:27.699693 (+ 34269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.701814  3195 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:27.703274  3195 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:27.705188  3195 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:15:27.685343  3164 connection.cc:256] RPC call timeout handler was delayed by -1.0595025460002034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3094s for a response
I20260709 13:15:27.706760  3795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 396) took 4619 ms. Trace:
W20260709 13:15:27.707535  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:27.707988  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.708202  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 273) took 1592 ms. Trace:
I20260709 13:15:27.708549  3194 rpcz_store.cc:276] 0709 13:15:26.115387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.121227 (+  5840us) service_pool.cc:224] Handling call
0709 13:15:26.121536 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:27.576849 (+1455313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.707978 (+131129us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400177354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:27.708153 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3205619072}
I20260709 13:15:27.710577  5586 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:27.674681  5534 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:27.674693  4835 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:27.716557  5316 consensus_queue.cc:260] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:27.717624  5316 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:27.717546  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:27.707154  3795 rpcz_store.cc:276] 0709 13:15:23.087598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.201043 (+113445us) service_pool.cc:224] Handling call
0709 13:15:24.494127 (+1293084us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b58000c4b98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff83538cfc0 00007ff835377929 00007ff8353773d2 00007ff82e8eebd4
0709 13:15:26.920977 (+2426850us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b58000c4b98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28ee9c 00007ff82d28ea5b 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff83538cfc0 00007ff835377929 00007ff8353773d2 00007ff82e8eebd4
0709 13:15:27.521386 (+600409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.591498 (+ 70112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.706515 (+115017us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b5400627fd0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:27.706671 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1382304640}
I20260709 13:15:27.726226  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:27.727090  3794 raft_consensus.cc:2368] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 6. Current term is 7.
I20260709 13:15:27.728726  5579 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:27.730938  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:27.732092  3118 raft_consensus.cc:2410] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:15:27.733896  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 478317us
I20260709 13:15:27.588670  5591 consensus_queue.cc:260] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:28.014484  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:27.741412  3192 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34728 (request call id 280) took 1598 ms (client timeout 1893 ms). Trace:
I20260709 13:15:27.763660  3193 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:27.905246  5609 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:27.896565  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:28.018659  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.794104  3164 leader_election.cc:400] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 6. Current term is 7.
I20260709 13:15:28.022236  3164 leader_election.cc:403] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:15:28.018276  5591 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:28.011656  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:28.022967  3192 rpcz_store.cc:269] 0709 13:15:26.143405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.977546 (+834141us) service_pool.cc:224] Handling call
0709 13:15:27.741205 (+763659us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54003ba454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:27.741350 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":830155648}
I20260709 13:15:27.830440  3197 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:27.797467  5266 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:27.773408  3191 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:28.020193  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 279) took 1877 ms. Trace:
I20260709 13:15:28.021251  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1823) took 1189 ms. Trace:
I20260709 13:15:28.025456  3193 rpcz_store.cc:276] 0709 13:15:26.143126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.683501 (+1540375us) service_pool.cc:224] Handling call
0709 13:15:27.763414 (+ 79913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.019771 (+256357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.020111 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.026149  3195 rpcz_store.cc:276] 0709 13:15:26.831431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.734828 (+903397us) service_pool.cc:224] Handling call
0709 13:15:27.794540 (+ 59712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.794728 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:27.794754 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:27.794794 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:28.011481 (+216687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.021069 (+  9588us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.021196 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.855671  5425 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:27.736171  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1604) took 1876 ms. Trace:
I20260709 13:15:27.761575  3200 raft_consensus.cc:1275] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:28.035311  3050 rpcz_store.cc:276] 0709 13:15:25.859506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.634753 (+775247us) service_pool.cc:224] Handling call
0709 13:15:27.246166 (+611413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:27.402403 (+156237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.735916 (+333513us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54001aefd0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:27.736094 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1405191424}
I20260709 13:15:28.036302  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1540) took 1751 ms. Trace:
I20260709 13:15:28.036936  3200 rpcz_store.cc:276] 0709 13:15:26.284851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.696442 (+1411591us) service_pool.cc:224] Handling call
0709 13:15:27.696740 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.035898 (+339158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.036211 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:28.047525  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:28.050230  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:28.074745  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:28.075515  3049 consensus_meta.cc:287] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.003s
I20260709 13:15:28.075965  3049 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:28.074326  5425 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:28.087386  5390 consensus_meta.cc:287] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.668s	user 0.004s	sys 0.005s
I20260709 13:15:28.087973  5493 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.088611  5493 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:28.093554  5455 consensus_meta.cc:287] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.004s
I20260709 13:15:28.094635  5455 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:28.095623  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.094059  5316 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.096516  5316 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:28.098770  3199 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:28.100363  3194 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:28.101563  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1824) took 1269 ms. Trace:
I20260709 13:15:28.101974  3194 rpcz_store.cc:276] 0709 13:15:26.831708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.969182 (+1137474us) service_pool.cc:224] Handling call
0709 13:15:28.100035 (+130853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.100715 (+   680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.101359 (+   644us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54001b85d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:28.101497 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299913600}
W20260709 13:15:28.103300  3199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1793) took 5991 ms (client timeout 2108 ms). Trace:
W20260709 13:15:28.103813  3199 rpcz_store.cc:269] 0709 13:15:22.111849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.117731 (+  5882us) service_pool.cc:224] Handling call
0709 13:15:28.099913 (+5982182us) spinlock_profiling.cc:243] Waited 5.87 s on lock 0x7b54001b85d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:28.103048 (+  3135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13500780800}
I20260709 13:15:28.104568  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:28.106303  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.106577  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:28.107395  3117 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 5: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:28.107561  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:28.108155  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:28.108680  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.109509  3121 raft_consensus.cc:2410] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:28.112308  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.113145  3125 raft_consensus.cc:2393] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:28.116904  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:28.117704  3199 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:28.118175  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:28.118788  3194 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:28.118675  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.119817  3118 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:28.035619  5445 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:28.124750  3117 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:28.126025  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:28.127100  3121 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:28.131669  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:28.132737  3200 raft_consensus.cc:2410] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:28.101359  5455 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:28.129200  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:28.134423  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.135932  3118 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:28.137626  3165 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:28.136824  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:28.138743  3165 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:28.139691  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:28.140450  3118 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:28.135214  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.141084  3125 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:28.140995  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:28.142196  3192 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:28.144496  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.140182  3165 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:28.157791  3165 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:28.158986  5373 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:28.159564  5373 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:28.160073  5373 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:28.160660  5610 consensus_meta.cc:287] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.562s	user 0.007s	sys 0.000s
I20260709 13:15:28.161481  5610 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:28.162580  3123 raft_consensus.cc:2368] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5.
I20260709 13:15:28.162691  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.163831  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.164479  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.165236  3122 raft_consensus.cc:2410] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:15:28.165302  3123 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:28.166379  3122 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:28.168828  5510 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:28.169098  5610 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:28.169255  5510 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.174348  3117 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
W20260709 13:15:28.175808  5636 log.cc:927] Time spent T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 13:15:28.178349  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:28.178900  5635 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.148s	user 0.001s	sys 0.001s
I20260709 13:15:28.180159  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:28.181056  3195 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:28.182339  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.182855  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:28.183763  3195 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:28.184572  5493 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:28.185154  5493 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.185377  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:28.187171  3195 raft_consensus.cc:2410] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:28.188005  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:28.155977  5512 raft_consensus.cc:3055] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:28.153297  5461 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:28.163836  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.198074  3124 raft_consensus.cc:2410] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:28.200553  3118 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:28.206692  3118 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:28.213804  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:28.218253  3761 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:28.169649  5510 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:28.219822  5606 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:28.192113  3121 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:28.194816  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.225240  3119 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:28.225585  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1601) took 2367 ms. Trace:
I20260709 13:15:28.196524  5512 raft_consensus.cc:740] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:15:28.217097  5639 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.184s	user 0.004s	sys 0.000s
I20260709 13:15:28.226128  3047 rpcz_store.cc:276] 0709 13:15:25.858647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.955288 (+ 96641us) service_pool.cc:224] Handling call
0709 13:15:26.045410 (+ 90122us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:26.049184 (+  3774us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:26.049228 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:26.049795 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 13:15:26.741031 (+691236us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:27.084646 (+343615us) log.cc:844] Serialized 14 byte log entry
0709 13:15:28.225177 (+1140531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.225281 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:28.225334 (+    53us) raft_consensus.cc:1685] finished
0709 13:15:28.225353 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.225519 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1138842,"prepare.queue_time_us":380629,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":7464,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":14119,"thread_start_us":861915,"threads_started":2,"wal-append.queue_time_us":891922,"wal-append.run_cpu_time_us":2370,"wal-append.run_wall_time_us":1141630}
W20260709 13:15:28.224478  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 1.28789e+06us
I20260709 13:15:28.234356  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:28.196290  5461 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:28.202771  5316 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:28.229321  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 435334us
I20260709 13:15:28.235256  5461 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:28.239671  3794 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:28.216781  5610 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.185623  5493 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:28.247779  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:28.248605  3799 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
W20260709 13:15:28.260229  3091 connection.cc:256] RPC call timeout handler was delayed by -2.874341806999837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
I20260709 13:15:28.264781  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:28.265975  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:28.267479  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:28.235244  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 498212us
W20260709 13:15:28.243178  3164 leader_election.cc:336] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 1.552s (SENT)
I20260709 13:15:28.282316  3091 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:28.295588  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.296264  3119 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:28.297727  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.298480  3119 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:28.299434  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.300287  3124 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 2.
I20260709 13:15:28.302654  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.303418  3118 raft_consensus.cc:2410] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:28.303550  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.304487  3123 raft_consensus.cc:2368] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5.
I20260709 13:15:28.305703  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.306314  3123 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:28.307587  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.308359  3123 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:28.309269  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.281692  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 281) took 2138 ms. Trace:
I20260709 13:15:28.310946  3198 rpcz_store.cc:276] 0709 13:15:26.363599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.687397 (+1323798us) service_pool.cc:224] Handling call
0709 13:15:27.687664 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.687873 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:27.711947 (+ 24074us) log.cc:844] Serialized 14 byte log entry
0709 13:15:28.174815 (+462868us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b18002bcc60. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2942a6 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db
0709 13:15:28.175281 (+   466us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:28.236135 (+ 60854us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.236313 (+   178us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:28.281379 (+ 45066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.281474 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.281624 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20415,"prepare.queue_time_us":23904,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":46582,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":1992,"spinlock_wait_cycles":43163648,"thread_start_us":502118,"threads_started":2,"wal-append.queue_time_us":320190}
I20260709 13:15:28.242830  5450 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:28.320111  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:28.320560  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:28.324561  3195 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:28.292507  3164 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:28.325544  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 82407.9us
W20260709 13:15:28.326754  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:28.327324  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.272401  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:28.323132  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.329535  3124 raft_consensus.cc:2368] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5.
I20260709 13:15:28.331048  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.222148  5373 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:28.332546  3793 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:28.334354  3197 raft_consensus.cc:2393] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 5: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:28.343834  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:28.344687  3193 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:28.346621  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1616) took 1069 ms. Trace:
I20260709 13:15:28.347138  3046 rpcz_store.cc:276] 0709 13:15:27.277025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.486028 (+209003us) service_pool.cc:224] Handling call
0709 13:15:27.486301 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.346231 (+859930us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:28.346265 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.346307 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:28.346360 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.346437 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.346565 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":859567}
I20260709 13:15:28.319624  5540 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:28.349201  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1607) took 2488 ms. Trace:
I20260709 13:15:28.352936  3165 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:28.323807  5455 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:28.353397  3045 rpcz_store.cc:276] 0709 13:15:25.860365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.134497 (+1274132us) service_pool.cc:224] Handling call
0709 13:15:27.134786 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.134973 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:27.135250 (+   277us) log.cc:844] Serialized 14 byte log entry
0709 13:15:28.348748 (+1213498us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.348821 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:28.348892 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.348990 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.349133 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":828135,"prepare.queue_time_us":1903,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":829155,"thread_start_us":384943,"threads_started":1,"wal-append.queue_time_us":502485}
I20260709 13:15:28.362740  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:28.223685  5606 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:28.322240  5425 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 6. Current term is 7.
W20260709 13:15:28.341990  5639 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:15:28.361416  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:15:28.361685  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 127424us
I20260709 13:15:28.363762  3798 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:28.251335  5266 consensus_queue.cc:1059] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:15:28.332484  5501 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:28.252542  5610 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:28.341872  5560 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.385457  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:28.375471  3090 leader_election.cc:336] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Timed out: RequestConsensusVote RPC to 127.1.227.132:43109 timed out after 1.627s (SENT)
I20260709 13:15:28.376128  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:28.377794  3793 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:28.387833  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:28.388824  3049 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:28.389431  3090 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:28.387483  3045 raft_consensus.cc:2393] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:28.319306  5579 consensus_queue.cc:1059] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:15:28.406613  5606 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:28.362489  5455 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.378827  3794 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEARNER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:28.394059  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:28.415004  3126 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.006s	sys 0.007s
I20260709 13:15:28.396126  3050 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:28.398015  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:28.400599  5588 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:28.401564  5560 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:28.402768  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.404712  5461 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:28.405241  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:28.405486  3797 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:28.405956  5628 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:28.390846  5316 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:28.351711  5474 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:28.391719  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:28.413532  3051 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:28.440601  3798 raft_consensus.cc:2393] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 7: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:28.415140  3046 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:28.395917  5610 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:28.416786  3090 leader_election.cc:336] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 2.108s (SENT)
I20260709 13:15:28.367620  5434 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:28.417467  3793 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:28.421983  3047 raft_consensus.cc:2393] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:28.427030  3191 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:28.444023  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:28.428799  3126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.006s	sys 0.007s
W20260709 13:15:28.429086  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.418145  5455 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:28.432257  3794 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:28.433491  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.355418  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:28.436111  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:15:28.418440  5632 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.303s	user 0.001s	sys 0.001s
I20260709 13:15:28.437250  5559 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:28.451161  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:28.435901  5445 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:28.483876  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:28.484557  3046 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:28.451841  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:28.454391  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:28.440095  5316 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.457935  3797 raft_consensus.cc:2410] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:28.456233  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:28.452498  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:28.491554  3048 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:28.492360  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:28.493201  3045 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:28.345635  5512 consensus_queue.cc:260] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:28.478581  3090 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:28.481292  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.486707  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:28.495092  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:28.495940  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:28.496447  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:28.496955  3049 raft_consensus.cc:2393] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 9: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:28.456835  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:28.498524  3043 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:28.499981  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:28.500669  3047 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:28.477644  5434 raft_consensus.cc:697] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:28.501986  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:28.502393  5434 consensus_queue.cc:237] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:28.480041  5419 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:28.505300  5493 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:28.462980  5552 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:28.462730  5614 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.488839  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:28.462730  5595 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:28.508590  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.508860  3090 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:28.509516  3045 raft_consensus.cc:2368] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 7. Current term is 8.
I20260709 13:15:28.463721  5474 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:28.510504  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.535399  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:28.539131  5552 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:28.539898  5461 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:28.541599  5586 raft_consensus.cc:3055] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:28.543653  5536 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:28.519712  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1604) took 1213 ms. Trace:
I20260709 13:15:28.519367  3046 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:28.558264  3047 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:28.558885  3048 raft_consensus.cc:2410] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:15:28.560137  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:28.480165  5609 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:28.487629  5610 consensus_queue.cc:1059] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:15:28.550379  5512 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:28.537767  5624 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:28.550174  5398 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:28.554338  5042 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:28.550150  5559 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.511214  5628 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:28.506398  5316 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:28.565336  3126 rpcz_store.cc:276] 0709 13:15:27.306401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.307224 (+   823us) service_pool.cc:224] Handling call
0709 13:15:27.390693 (+ 83469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.390930 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:27.839511 (+448581us) log.cc:844] Serialized 14 byte log entry
0709 13:15:28.482608 (+643097us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.482650 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:28.482697 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.482843 (+   146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.519632 (+ 36789us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32122,"prepare.queue_time_us":640377,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":36922,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":19628,"spinlock_wait_cycles":8448,"thread_start_us":1014489,"threads_started":2}
I20260709 13:15:28.554081  5595 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:28.581069  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:28.579768  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:28.566224  5586 raft_consensus.cc:740] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:28.584897  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:28.586203  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:28.550061  5614 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:28.578855  3790 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:28.572926  5609 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:28.576243  5536 raft_consensus.cc:697] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:28.575641  3792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 524) took 1059 ms. Trace:
I20260709 13:15:28.576930  5624 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:28.562217  5445 consensus_queue.cc:1059] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:15:28.617182  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:28.621659  3045 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:28.582490  5628 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:28.584141  5373 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:28.658439  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:28.667573  3048 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:28.583999  5559 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:28.622509  5560 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:28.629563  5609 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:28.668931  5628 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:28.664394  5624 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:28.692306  3045 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
W20260709 13:15:28.672950  3120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.013s	sys 0.032s
W20260709 13:15:28.693215  3120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.013s	sys 0.032s
W20260709 13:15:28.693722  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 421359us
I20260709 13:15:28.708881  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:28.722153  5591 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:28.726198  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:28.727097  3045 raft_consensus.cc:2376] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9. Re-sending same reply.
W20260709 13:15:28.696049  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.739622  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:28.740432  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 304408us
I20260709 13:15:28.751924  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:28.757496  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 428580us
I20260709 13:15:28.752709  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:28.722604  5591 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.771967  3126 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:28.779827  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.780951  3126 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 5: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:15:28.792693  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:28.819154  5640 log.cc:927] Time spent T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
W20260709 13:15:28.820210  5643 log.cc:927] Time spent T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:15:28.818944  5390 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:28.782398  5373 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:15:28.767838  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:28.691676  5586 consensus_queue.cc:260] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:28.821838  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:28.821209  5474 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:28.838610  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 70884.5us
W20260709 13:15:28.823647  5648 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:15:28.825176  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:28.726096  5455 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:28.744946  5579 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:15:28.723042  5536 consensus_queue.cc:237] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:28.824165  3164 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:28.840018  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:28.840691  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:28.782263  5588 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:28.783963  5552 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:28.838785  3125 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:28.824381  5591 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:28.838585  5646 log.cc:927] Time spent T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:15:28.830664  5540 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:28.873078  3045 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:15:28.873895  3165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.020s	sys 0.018s
W20260709 13:15:28.874289  3165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.020s	sys 0.018s
W20260709 13:15:28.875047  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 522217us
I20260709 13:15:28.875980  3165 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:28.867545  3048 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:28.823457  5501 consensus_queue.cc:1059] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:15:28.872958  5398 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:28.856417  5588 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.909166  3165 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:28.885356  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:28.856839  5606 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:28.855995  5390 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:28.890453  5644 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:28.887410  5595 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:28.930652  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:28.956398  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 71121.2us
I20260709 13:15:28.925093  3048 raft_consensus.cc:1240] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:28.957491  3164 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:28.958117  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 49048.2us
I20260709 13:15:28.914512  5588 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:28.910154  5661 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:28.980139  3165 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:28.982523  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:28.916474  5614 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:28.984792  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:28.987071  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 435766us
I20260709 13:15:28.908468  5371 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:15:28.929188  5398 raft_consensus.cc:697] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:28.948252  5644 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.982314  5661 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:28.639189  3792 rpcz_store.cc:276] 0709 13:15:27.516155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.518349 (+  2194us) service_pool.cc:224] Handling call
0709 13:15:27.544742 (+ 26393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:27.566223 (+ 21481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:27.569300 (+  3077us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:27.579998 (+ 10698us) log.cc:844] Serialized 26 byte log entry
0709 13:15:27.908194 (+328196us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:27.959273 (+ 51079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.992546 (+ 33273us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:28.558993 (+566447us) raft_consensus.cc:1685] finished
0709 13:15:28.561972 (+  2979us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.571565 (+  9593us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1370,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":270613,"threads_started":1,"wal-append.queue_time_us":465205}
I20260709 13:15:28.963287  5493 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:29.062577  3121 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:28.962119  5606 raft_consensus.cc:697] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:28.984140  5373 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:28.983080  5652 raft_consensus.cc:3055] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:28.916746  5642 consensus_queue.cc:1059] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
W20260709 13:15:29.060945  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.069414  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:29.068547  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1621) took 1482 ms. Trace:
I20260709 13:15:29.117947  3120 rpcz_store.cc:276] 0709 13:15:27.586098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.150033 (+563935us) service_pool.cc:224] Handling call
0709 13:15:28.150362 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.150584 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:28.150884 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 13:15:28.694069 (+543185us) log.cc:844] Serialized 14 byte log entry
0709 13:15:29.061248 (+367179us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:29.061306 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:29.061354 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.061431 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.068487 (+  7056us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":46542,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":6744,"raft.queue_time_us":821567,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":210,"thread_start_us":844210,"threads_started":2,"wal-append.queue_time_us":522258}
I20260709 13:15:28.992190  5644 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:29.126832  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:29.093904  3091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.009s	sys 0.039s
W20260709 13:15:29.131302  3091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.009s	sys 0.039s
I20260709 13:15:28.990720  5656 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:28.989233  5653 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:28.991816  5661 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:29.119269  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:29.193356  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 74158.2us
I20260709 13:15:29.194687  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:28.990078  5562 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
W20260709 13:15:29.196751  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 341384us
I20260709 13:15:29.197599  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:29.198741  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:29.095278  5652 raft_consensus.cc:740] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:15:29.215126  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 153158us
I20260709 13:15:29.173079  5445 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.175181  5651 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:29.191787  5510 consensus_meta.cc:287] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.963s	user 0.008s	sys 0.005s
I20260709 13:15:29.121079  5655 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:15:29.202150  5645 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.373s	user 0.001s	sys 0.000s
I20260709 13:15:29.173157  5493 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:29.227566  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 247470us
I20260709 13:15:29.174619  5373 raft_consensus.cc:697] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:29.207460  5614 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:29.211447  5657 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:29.236371  3090 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:29.207324  5580 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:29.207422  5579 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:29.209447  5595 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:15:29.258651  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 117034us
W20260709 13:15:29.268863  3762 leader_election.cc:336] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Timed out: RequestConsensusVote RPC to 127.1.227.129:44609 timed out after 1.571s (SENT)
I20260709 13:15:29.251370  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:29.263792  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 279078us
I20260709 13:15:29.270890  3044 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:29.272887  3164 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:29.275677  3090 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:29.275957  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:29.229682  5455 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:29.284744  3164 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:29.242358  5493 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:15:29.268509  5647 log.cc:927] Time spent T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.373s	user 0.000s	sys 0.001s
I20260709 13:15:29.300992  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:29.298759  3165 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:29.305807  3165 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:29.300791  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 102145us
I20260709 13:15:29.256286  5657 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:29.264482  5580 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.310303  5373 consensus_queue.cc:237] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:29.311863  5680 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:29.315289  3015 leader_election.cc:400] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
I20260709 13:15:29.209681  5398 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:29.316124  3090 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:29.321852  5502 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:29.319710  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:29.242887  5510 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:29.314731  3048 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:29.326117  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:29.325541  3015 leader_election.cc:403] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:29.338575  3049 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:29.255254  5445 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:29.318958  5512 consensus_meta.cc:287] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.736s	user 0.012s	sys 0.000s
I20260709 13:15:29.304328  5419 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:29.379877  5562 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
I20260709 13:15:29.374377  5502 raft_consensus.cc:697] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:15:29.369076  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 53065.5us
I20260709 13:15:29.381666  3790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 535) took 1143 ms. Trace:
I20260709 13:15:29.317544  5677 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:29.318065  5654 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.322062  5461 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:29.374580  5680 raft_consensus.cc:697] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:29.385335  3090 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:29.302770  5493 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:29.245666  5651 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:29.381568  5502 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:29.295251  5642 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:15:29.375314  5655 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:29.297000  5672 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.130s
I20260709 13:15:29.333602  5455 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:15:29.389200  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.410495  3091 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:29.360836  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 51985.7us
I20260709 13:15:29.419538  3799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 383) took 1156 ms. Trace:
I20260709 13:15:29.428743  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1632) took 1010 ms. Trace:
I20260709 13:15:29.252010  5606 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:29.281661  5595 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:29.442864  3762 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:29.445585  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:29.382349  5560 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:29.320840  5580 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:29.321878  5390 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:15:29.464550  3049 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:29.374666  5671 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:29.499567  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:29.498186  3799 rpcz_store.cc:276] 0709 13:15:28.263661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.319363 (+ 55702us) service_pool.cc:224] Handling call
0709 13:15:28.319620 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:28.759011 (+439391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.759040 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:28.759567 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:15:29.115922 (+356355us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:29.115983 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.116082 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:29.419185 (+303103us) raft_consensus.cc:1685] finished
0709 13:15:29.419285 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.419468 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21416,"raft.queue_time_us":51912,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":10150,"thread_start_us":686979,"threads_started":2,"wal-append.queue_time_us":477971}
I20260709 13:15:29.418581  5674 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:29.500332  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:29.420125  5668 log.cc:927] Time spent T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:15:29.502312  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:29.413955  5461 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:29.503165  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 92760.1us
W20260709 13:15:29.416167  5663 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
W20260709 13:15:29.508857  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.432394  5641 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:29.422098  5653 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:29.512619  3091 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:29.513470  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 207761us
I20260709 13:15:29.446965  5512 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.498330  3050 rpcz_store.cc:276] 0709 13:15:28.418055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.418206 (+   151us) service_pool.cc:224] Handling call
0709 13:15:28.418598 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.418856 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:28.747641 (+328785us) log.cc:844] Serialized 14 byte log entry
0709 13:15:29.107967 (+360326us) log.cc:844] Serialized 14 byte log entry
0709 13:15:29.428106 (+320139us) spinlock_profiling.cc:243] Waited 7.64 ms on lock 0x7b180037ace0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82ff5b4bc 00007ff82d2a948b 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c3455 00007ff8303ab060 00007ff8303bd716 00007ff8303ce287
0709 13:15:29.428241 (+   135us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:29.428326 (+    85us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:29.428397 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.428493 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.428665 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34498,"prepare.queue_time_us":574340,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":18196,"raft.queue_time_us":258832,"raft.run_cpu_time_us":751,"raft.run_wall_time_us":37995,"spinlock_wait_cycles":36127616,"thread_start_us":749521,"threads_started":3}
I20260709 13:15:29.445897  5642 consensus_queue.cc:1243] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:29.522115  5562 consensus_queue.cc:1059] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:29.523916  5368 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:29.525418  5536 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:29.514379  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:29.417799  5559 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:29.487512  5656 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:29.385622  5684 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.151s
I20260709 13:15:29.420362  5425 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 13:15:29.333160  5652 consensus_queue.cc:260] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:29.430339  5654 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:29.509682  5560 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:29.516202  5461 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:29.501173  5682 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.512246  5674 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:29.384572  3790 rpcz_store.cc:276] 0709 13:15:28.238221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.251172 (+ 12951us) service_pool.cc:224] Handling call
0709 13:15:28.393728 (+142556us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b58000c4b98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff83538cfc0 00007ff835377929 00007ff8353773d2 00007ff82e8eebd4
0709 13:15:28.564617 (+170889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.626205 (+ 61588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.381433 (+755228us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54005a5350. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:29.381604 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":400449024}
I20260709 13:15:29.558220  5664 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:29.595255  5664 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:15:29.595549  5670 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:15:29.595829  5664 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:29.596966  5689 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:29.501271  5657 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:29.587392  5560 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:29.590340  5674 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:29.597956  3796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 388) took 1332 ms. Trace:
I20260709 13:15:29.603744  3796 rpcz_store.cc:276] 0709 13:15:28.265318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.319188 (+ 53870us) service_pool.cc:224] Handling call
0709 13:15:28.319586 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:28.729524 (+409938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.729561 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:28.730190 (+   629us) log.cc:844] Serialized 52 byte log entry
0709 13:15:29.084002 (+353812us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:29.084061 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.084159 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:29.597649 (+513490us) raft_consensus.cc:1685] finished
0709 13:15:29.597671 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.597887 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1778,"raft.queue_time_us":35823,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6551,"thread_start_us":652763,"threads_started":2,"wal-append.queue_time_us":671086}
I20260709 13:15:29.512624  5677 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:15:29.606213  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1978) took 1032 ms. Trace:
I20260709 13:15:29.606779  3051 rpcz_store.cc:276] 0709 13:15:28.573723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.575980 (+  2257us) service_pool.cc:224] Handling call
0709 13:15:28.576324 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:28.577801 (+  1477us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:15:28.577838 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:28.581537 (+  3699us) log.cc:844] Serialized 26 byte log entry
0709 13:15:28.970305 (+388768us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:28.970365 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.970466 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:29.605989 (+635523us) raft_consensus.cc:1685] finished
0709 13:15:29.606011 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.606149 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":998,"raft.queue_time_us":4070,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4662,"thread_start_us":342396,"threads_started":1,"wal-append.queue_time_us":634758}
I20260709 13:15:29.551915  5512 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:29.590569  5669 log.cc:927] Time spent T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:15:29.592481  5652 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:29.415572  5680 consensus_queue.cc:237] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:29.609462  5628 consensus_meta.cc:287] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.903s	user 0.007s	sys 0.005s
I20260709 13:15:29.577890  5455 raft_consensus.cc:697] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:29.597949  5689 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:29.575789  5683 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:15:29.518445  5671 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:29.622962  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 296935us
I20260709 13:15:29.623661  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:29.635388  3044 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
W20260709 13:15:29.576855  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 366102us
I20260709 13:15:29.639228  3090 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:29.641402  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:29.642743  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 199959us
I20260709 13:15:29.618645  5655 raft_consensus.cc:3055] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:29.654196  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:29.613333  5559 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:15:29.628230  5683 consensus_queue.cc:1243] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:29.662221  3197 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:15:29.665647  3164 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:29.666754  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:29.671736  5699 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:29.672811  5609 consensus_meta.cc:287] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.988s	user 0.011s	sys 0.000s
I20260709 13:15:29.672624  5699 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:29.597892  5682 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:29.661489  5510 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:15:29.675560  5671 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:29.658329  5666 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:15:29.675300  5493 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:29.676739  3193 raft_consensus.cc:1240] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:29.652774  5655 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:29.677980  5493 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:29.677853  5655 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:29.679039  5655 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:29.679183  5316 consensus_meta.cc:287] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.063s	user 0.010s	sys 0.001s
I20260709 13:15:29.679666  5316 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:29.683465  5512 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:29.687541  5042 consensus_meta.cc:287] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.104s	user 0.011s	sys 0.000s
I20260709 13:15:29.688211  5042 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:29.689458  5588 consensus_meta.cc:287] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.703s	user 0.008s	sys 0.000s
I20260709 13:15:29.689652  5654 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:29.627460  5628 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:29.658576  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.697264  5316 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:29.690214  5266 consensus_queue.cc:1059] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:29.690688  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:29.713922  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:29.714668  3198 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:29.655313  5689 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:29.718106  3191 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:29.719269  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:29.673286  5609 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:29.628676  5687 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 13:15:29.692523  5445 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:29.714078  5591 consensus_meta.cc:287] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.842s	user 0.004s	sys 0.008s
I20260709 13:15:29.661934  5703 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:29.675555  5682 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:29.723591  5694 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:29.732157  5651 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:29.743260  5591 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:29.704070  5588 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:29.759440  5588 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:29.758971  5560 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:29.761453  5657 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:29.746449  5690 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:15:29.762094  5560 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:29.764528  5673 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
W20260709 13:15:29.754323  5693 log.cc:927] Time spent T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:15:29.743242  5595 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:29.671805  5644 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:29.754215  5610 raft_consensus.cc:3055] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:29.637828  5656 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:29.756125  5664 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:29.767364  5661 consensus_meta.cc:287] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.001s
I20260709 13:15:29.751335  5694 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:29.777448  5694 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:29.777421  5661 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:29.786677  5674 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:29.788010  5661 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:29.788203  5674 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:29.789997  5694 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:29.820356  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:29.836472  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 309545us
I20260709 13:15:29.839407  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:29.840677  3046 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:15:29.852588  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 340584us
W20260709 13:15:29.855043  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 215695us
I20260709 13:15:29.856639  3090 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:29.860711  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:29.862658  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 222415us
W20260709 13:15:29.863897  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:29.864151  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 198432us
W20260709 13:15:29.865576  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.867435  5591 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:29.768548  5610 raft_consensus.cc:740] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:29.871448  5502 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:29.871672  5450 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:15:29.768128  5624 consensus_meta.cc:287] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.061s	user 0.009s	sys 0.003s
I20260709 13:15:29.896979  5694 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:29.896668  5610 consensus_queue.cc:260] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:29.897640  5624 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:29.703501  5455 consensus_queue.cc:237] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:29.873332  5664 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:29.904309  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:29.875923  5609 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:29.880329  5628 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:29.884589  5425 raft_consensus.cc:3055] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:29.895855  5502 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:15:29.899876  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.915818  3164 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:29.917994  5450 raft_consensus.cc:697] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:29.920176  5450 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:29.898578  5610 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:29.910356  5425 raft_consensus.cc:740] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:29.938570  5644 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:29.942553  3195 raft_consensus.cc:2410] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:15:29.946615  3164 leader_election.cc:400] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5.
I20260709 13:15:29.947116  3164 leader_election.cc:403] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:29.925793  5502 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:29.947078  5674 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:29.953553  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:29.954667  3120 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 5: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:29.954947  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:29.955681  5705 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.956202  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:29.956411  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:29.957350  3194 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:29.958127  5687 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:29.958472  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:29.959067  5687 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:29.962469  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:29.963485  3196 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:29.937141  5694 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:29.965137  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:29.956447  5705 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:29.968302  5705 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:29.969167  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:29.970326  3195 raft_consensus.cc:2410] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:29.980083  3164 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:29.980630  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1640) took 1685 ms. Trace:
I20260709 13:15:29.981067  3121 rpcz_store.cc:276] 0709 13:15:28.294912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.295055 (+   143us) service_pool.cc:224] Handling call
0709 13:15:29.061547 (+766492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.075517 (+ 13970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.980198 (+904681us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b54000a8f50. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:29.980431 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1762065664}
I20260709 13:15:29.981860  5501 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:29.982522  5501 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:29.983016  5501 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:29.983495  3047 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:29.984386  5628 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:29.986004  5664 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:29.986815  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:29.986967  5664 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:29.950659  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:29.989728  5624 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:29.993067  3191 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:29.993229  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 138805us
I20260709 13:15:29.998613  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:29.999176  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:29.999513  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:30.008594  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.996946  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:30.003504  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:30.003806  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.005328  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:29.993593  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:30.005815  5552 raft_consensus.cc:3055] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:29.994107  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:30.032884  5552 raft_consensus.cc:740] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:30.036094  3051 pending_rounds.cc:85] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 3
I20260709 13:15:30.036831  3196 raft_consensus.cc:2393] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 7: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:30.037060  5556 raft_consensus.cc:1064] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:15:30.036516  5552 consensus_queue.cc:260] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:29.989723  5664 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:30.038251  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:30.038740  3045 raft_consensus.cc:1240] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:30.039079  3046 raft_consensus.cc:2410] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:30.039846  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:30.044032  3091 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:30.002251  5687 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:30.002483  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:30.047848  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 67947.2us
I20260709 13:15:30.040797  3043 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.039103  3120 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:15:30.002899  5674 raft_consensus.cc:697] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:30.036530  3051 pending_rounds.cc:107] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:15:30.053174  5552 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:30.053063  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:30.057247  5580 consensus_meta.cc:287] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.512s	user 0.013s	sys 0.004s
I20260709 13:15:30.053035  3051 raft_consensus.cc:2889] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:30.060446  3042 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:30.061896  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 407313us
I20260709 13:15:30.062950  3762 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:30.070593  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:30.071632  3125 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:30.071548  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:30.071943  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:30.072937  3126 raft_consensus.cc:2410] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:30.073817  3164 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:30.074204  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:30.075068  3123 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:30.077270  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:30.077615  3164 leader_election.cc:400] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5.
I20260709 13:15:30.078989  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:30.088889  3164 leader_election.cc:403] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:30.089550  3126 raft_consensus.cc:2410] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:15:30.078545  5642 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:30.090550  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:30.091611  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 47862.3us
I20260709 13:15:29.989850  5609 consensus_queue.cc:1059] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:15:30.092715  3091 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:30.081547  3124 raft_consensus.cc:2410] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:30.093636  5609 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:30.094211  5609 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:30.094615  5609 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:30.095402  3091 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:30.081593  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:30.096294  5642 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:30.096549  3123 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
W20260709 13:15:30.097978  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 145650us
I20260709 13:15:30.099684  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:30.102046  5266 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:30.102563  5266 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.102969  5266 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:30.109179  5586 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:30.083734  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:30.085296  5503 raft_consensus.cc:3055] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:30.086894  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:30.089550  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1979) took 1515 ms. Trace:
I20260709 13:15:30.078689  3198 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:30.113451  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:30.114158  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:29.991473  5425 consensus_queue.cc:260] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:30.087996  5580 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:30.120505  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:30.121912  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:30.120287  5705 raft_consensus.cc:3055] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:30.120213  5503 raft_consensus.cc:740] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:30.130435  5705 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:30.130570  3194 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:30.131389  5503 consensus_queue.cc:260] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:30.131764  5705 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:30.132692  5503 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:30.133188  5705 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:30.117118  3047 rpcz_store.cc:276] 0709 13:15:28.574228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.579425 (+  5197us) service_pool.cc:224] Handling call
0709 13:15:28.588768 (+  9343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:29.982896 (+1394128us) spinlock_profiling.cc:243] Waited 8.9 ms on lock 0x7b54002a60a0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83032adc0 00007ff8303b51c0 00007ff8303b6231 00007ff8303b2d8f 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c
0709 13:15:29.983978 (+  1082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.089213 (+105235us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54003d59d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:30.089467 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1215538176}
I20260709 13:15:30.131796  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:30.135073  3042 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:30.137851  3191 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
W20260709 13:15:30.142644  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 79890.9us
I20260709 13:15:30.144276  3043 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:30.152498  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:30.007017  5461 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:30.153728  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:30.164284  5536 raft_consensus.cc:3055] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:30.164424  5266 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:30.166795  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:30.166859  5536 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:30.167155  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:30.167811  3199 raft_consensus.cc:2393] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:30.168273  5536 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:30.168802  5266 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:30.169114  3042 pending_rounds.cc:85] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 3
I20260709 13:15:30.169777  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:30.170812  3124 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.172900  3120 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:15:30.173919  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 65328.8us
I20260709 13:15:30.174706  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:30.175356  3090 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:30.177055  5680 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:30.160248  3762 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:30.161376  5419 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5.
W20260709 13:15:30.162170  5652 consensus_meta.cc:287] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.541s	user 0.003s	sys 0.013s
I20260709 13:15:30.162897  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:30.175660  3198 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:15:30.161953  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 66655.9us
I20260709 13:15:30.133867  5694 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5.
I20260709 13:15:30.169450  5536 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.169493  3042 pending_rounds.cc:107] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:15:30.133826  5624 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:30.194782  3123 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:30.195434  3200 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:30.191532  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:30.196267  3121 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:30.196707  3091 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:30.197046  3194 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:30.191987  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:30.162262  5580 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:30.193943  3042 raft_consensus.cc:2889] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:30.194548  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.203137  3124 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:30.205837  5610 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:30.206339  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:30.207108  3118 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:30.207332  3126 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:30.206561  3091 leader_election.cc:400] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 7. Current term is 8.
I20260709 13:15:30.208240  3091 leader_election.cc:403] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:30.198850  3090 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:30.204044  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:30.214473  3191 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:30.209656  3120 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:30.194649  5591 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:30.230391  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:30.230286  3125 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
W20260709 13:15:30.237262  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46675.2us
W20260709 13:15:30.239934  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 96574.2us
W20260709 13:15:30.243261  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 83169.1us
I20260709 13:15:30.244761  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:30.234030  5266 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:30.253520  3192 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:30.257263  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:30.259248  3198 raft_consensus.cc:2393] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:30.262154  5672 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:30.266700  5556 consensus_queue.cc:237] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:30.249980  5610 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:30.284173  3194 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:15:30.285902  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.287405  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:30.297024  5652 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:30.296833  5674 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:30.297302  3762 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:30.299033  5652 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:30.300750  5425 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.300879  5716 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:30.301541  5716 raft_consensus.cc:697] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:30.302410  5461 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:30.302565  5716 consensus_queue.cc:237] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:30.303469  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 55197.8us
I20260709 13:15:30.306862  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:30.307265  5502 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:30.307837  3193 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.306558  3191 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:30.253222  5591 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:30.310587  5591 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:30.311590  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:30.290910  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 50329.7us
I20260709 13:15:30.290865  3090 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:30.313766  5610 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.313400  5502 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:30.348047  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:30.335546  5552 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 7. Current term is 8.
I20260709 13:15:30.344467  5610 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:30.355512  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:30.366187  3197 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:30.351575  5461 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:30.370009  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:30.370507  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.370918  3194 raft_consensus.cc:1240] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:30.351019  5510 consensus_queue.cc:1059] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.088s
W20260709 13:15:30.386869  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 133708us
I20260709 13:15:30.387532  3197 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:30.368311  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:30.414175  3123 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:30.416078  3043 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:30.416600  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:30.366658  5628 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:30.394726  5461 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:30.419768  5722 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:15:30.421128  5503 consensus_queue.cc:1059] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:30.421918  3045 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:30.431730  3044 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
W20260709 13:15:30.437645  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.439800  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:30.444486  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.451941  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:30.429975  5266 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:30.455555  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 206531us
I20260709 13:15:30.428455  5461 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:30.455274  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.459885  3194 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:30.460242  3091 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:30.469461  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:30.451093  5502 raft_consensus.cc:3055] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:30.477650  3125 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:30.479317  3118 raft_consensus.cc:1275] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:15:30.480732  3124 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:30.482087  3191 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:30.478083  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:30.479831  3118 pending_rounds.cc:85] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 1
I20260709 13:15:30.486567  3118 pending_rounds.cc:107] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:15:30.486856  3118 raft_consensus.cc:2889] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:30.487474  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.485809  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:30.485939  3121 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:30.483398  3198 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
W20260709 13:15:30.495548  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 77160.7us
I20260709 13:15:30.495934  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:30.476950  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:30.473379  5502 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:30.514492  5502 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:30.515362  3126 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:30.516085  5502 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:30.517287  5586 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.462283  5266 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:30.517920  5586 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:30.519881  5266 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:30.520236  5586 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:30.521275  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:30.498543  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:30.502295  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:30.502609  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:30.502947  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:30.503654  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:30.507754  3195 raft_consensus.cc:2410] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:15:30.541042  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.509898  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 1987) took 1031 ms. Trace:
I20260709 13:15:30.510056  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:30.541296  3123 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:30.488565  5705 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:30.510643  3165 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:30.511389  3194 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:30.488557  5609 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:30.482501  5501 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:30.524632  3762 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:30.524493  5694 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:30.555312  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:30.525858  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:30.526811  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:30.527515  2945 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57744 (request call id 240) took 19128 ms (client timeout 15000 ms). Trace:
I20260709 13:15:30.528663  3793 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:30.528975  5510 raft_consensus.cc:3055] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:30.529582  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:30.530803  3051 raft_consensus.cc:2410] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:15:30.558480  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 95848us
I20260709 13:15:30.530725  3198 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:15:30.535480  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:30.538911  3799 raft_consensus.cc:2393] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 5: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
W20260709 13:15:30.561079  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 50592.7us
I20260709 13:15:30.561347  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:30.544934  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 84840.2us
I20260709 13:15:30.541579  3048 rpcz_store.cc:276] 0709 13:15:29.445103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.445291 (+   188us) service_pool.cc:224] Handling call
0709 13:15:30.462890 (+1017599us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b540027d3d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:30.475963 (+ 13073us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1454529792}
I20260709 13:15:30.530768  3791 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:15:30.549178  3796 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:30.558604  3196 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: []
W20260709 13:15:30.498059  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:30.564657  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 71792.1us
I20260709 13:15:30.564972  5702 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:30.568709  3091 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:30.548934  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:30.565528  3090 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:30.570456  3045 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:30.573948  3200 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:15:30.558089  5614 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:30.577059  3762 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:30.576851  3165 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:15:30.587790  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:30.588738  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.578498  3043 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:30.581038  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:30.581878  3794 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:30.560735  5510 raft_consensus.cc:740] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:30.592784  3124 raft_consensus.cc:2393] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:30.594249  3044 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:30.569393  5425 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:30.568806  5702 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.595192  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:30.600422  3194 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:30.591107  3792 raft_consensus.cc:2410] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:30.605317  5702 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:30.609328  5674 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:30.609889  3119 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:30.602779  5705 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:30.611900  5705 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.612383  5705 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:30.614420  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 52471.8us
W20260709 13:15:30.624612  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 55981.4us
I20260709 13:15:30.623346  3090 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:30.634682  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 66291.9us
I20260709 13:15:30.626127  5586 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:30.623445  5425 raft_consensus.cc:697] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:30.640862  3762 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:30.652367  3762 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:30.605388  5614 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:30.639735  5687 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:30.655047  3762 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:30.655939  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 58741.2us
I20260709 13:15:30.645284  5586 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.643024  5674 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:30.637221  5266 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:30.661576  3091 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:30.663964  5398 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:30.663771  2948 catalog_manager.cc:5697] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 2 to 3, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 3 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:15:30.668136  3798 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:30.668161  3090 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:30.680166  5610 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:30.682773  5609 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:30.634461  5510 consensus_queue.cc:260] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:30.686826  5510 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:30.695266  3797 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:30.698282  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:30.700603  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:30.700675  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 52776.9us
I20260709 13:15:30.702173  3797 raft_consensus.cc:2410] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:30.660995  5687 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:30.665637  5586 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:30.665304  5266 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.716557  5610 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:30.559137  2945 rpcz_store.cc:269] 0709 13:15:11.398651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.399797 (+  1146us) service_pool.cc:224] Handling call
0709 13:15:30.527079 (+19127282us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:28.411048 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:28.432255 (+ 21207us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:28.432303 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:15:28.432327 (+    24us) tablet.cc:662] Decoding operations
0709 13:15:28.504056 (+ 71729us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:28.504131 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:28.504159 (+    28us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:15:28.504795 (+   636us) tablet.cc:701] Row locks acquired
0709 13:15:28.504845 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:15:28.505030 (+   185us) write_op.cc:270] Start()
0709 13:15:28.505180 (+   150us) write_op.cc:276] Timestamp: P: 1783602928504969 usec, L: 0
0709 13:15:28.505205 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:15:28.535518 (+ 30313us) log.cc:844] Serialized 2085 byte log entry
0709 13:15:29.790793 (+1255275us) op_driver.cc:464] REPLICATION: finished
0709 13:15:29.792143 (+  1350us) write_op.cc:301] APPLY: starting
0709 13:15:29.792217 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:29.792397 (+   180us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:29.792543 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:29.899938 (+107395us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:29.900398 (+   460us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:15:29.900500 (+   102us) write_op.cc:312] APPLY: finished
0709 13:15:29.901067 (+   567us) log.cc:844] Serialized 47 byte log entry
0709 13:15:29.901340 (+   273us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:29.901651 (+   311us) write_op.cc:454] Released schema lock
0709 13:15:29.901713 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:29.902419 (+   706us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:29.902456 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6083958,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":1091,"apply.run_cpu_time_us":4762,"apply.run_wall_time_us":110158,"num_ops":5,"prepare.queue_time_us":718768,"prepare.run_cpu_time_us":38242,"prepare.run_wall_time_us":518203,"raft.queue_time_us":143663,"raft.run_cpu_time_us":1336,"raft.run_wall_time_us":1361,"replication_time_us":1285303,"thread_start_us":780621,"threads_started":4,"wal-append.queue_time_us":672045}]]}
W20260709 13:15:30.718227  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 57759.1us
I20260709 13:15:30.668936  5398 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:30.726728  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 86119.2us
I20260709 13:15:30.704748  5716 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:30.707309  5652 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:30.733608  5683 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:30.718295  5536 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:30.723604  5266 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.763985  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:30.739807  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:30.713799  5687 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:30.719405  5680 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:30.712471  5674 raft_consensus.cc:697] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:15:30.742517  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.742640  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:15:30.743345  5729 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.232s	user 0.002s	sys 0.000s
I20260709 13:15:30.745399  5655 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.745808  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:30.759140  5716 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.762238  5501 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:30.762617  5725 log.cc:927] Time spent T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.266s	user 0.000s	sys 0.002s
I20260709 13:15:30.731594  5609 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:30.773094  3193 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:30.762245  5419 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:30.777208  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.723855  5398 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.791164  3798 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:30.741432  5536 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:15:30.791991  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 63733.8us
W20260709 13:15:30.793224  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 138232us
I20260709 13:15:30.769603  5652 raft_consensus.cc:697] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:30.771108  5683 raft_consensus.cc:697] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:30.777959  5716 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:30.805131  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 65578.5us
I20260709 13:15:30.813133  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:30.810248  2948 catalog_manager.cc:5697] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.734807  5425 consensus_queue.cc:237] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:30.796995  5536 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.788139  5680 raft_consensus.cc:697] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:15:30.820393  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 56507.8us
I20260709 13:15:30.821580  5368 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:30.822089  5368 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:30.812943  5450 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:15:30.795483  5419 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:30.822559  5368 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.812757  5580 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:30.796268  5609 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:30.825256  5731 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.183s	user 0.004s	sys 0.000s
I20260709 13:15:30.835108  3091 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:30.834403  5450 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:30.843981  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:30.802664  5655 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:30.837534  5450 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:30.841866  5501 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:30.868173  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:30.882994  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 55593us
I20260709 13:15:30.884351  3761 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:30.896239  5656 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:15:30.897843  5733 log.cc:927] Time spent T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:15:30.873502  5652 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:30.901614  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.902676  5615 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:30.904749  5702 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:30.906852  5419 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:30.908753  5655 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:30.862460  5450 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.884130  5461 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:30.914361  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.917604  5580 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:30.918251  5580 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.918707  5580 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:30.924482  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.926766  5680 consensus_queue.cc:237] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:30.876376  5614 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:30.872720  5628 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:30.930608  5628 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.930948  5628 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:30.883101  5501 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:30.935546  5501 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:30.943706  5461 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:30.845886  5674 consensus_queue.cc:237] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:30.906843  5702 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:30.962348  5266 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:30.966766  5687 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:30.945021  5683 consensus_queue.cc:237] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:30.968266  5580 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:30.971055  5586 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:30.974152  5586 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:30.980695  3090 leader_election.cc:336] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Timed out: RequestConsensusVote RPC to 127.1.227.132:43109 timed out after 1.562s (SENT)
I20260709 13:15:30.981350  3090 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:30.925186  5705 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:31.008150  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.008733  5687 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:31.009429  5716 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:31.016968  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 132750us
W20260709 13:15:31.014045  3120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.026s	sys 0.030s
W20260709 13:15:31.019140  3120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.026s	sys 0.030s
I20260709 13:15:31.016058  5716 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:31.041985  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 309524us
I20260709 13:15:30.971468  5580 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:31.114125  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:31.115216  3799 raft_consensus.cc:2368] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7.
I20260709 13:15:31.116096  5716 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:31.116843  5716 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:31.119457  5716 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:31.120455  3193 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:31.120774  5609 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:31.121490  5609 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:31.123281  5368 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:31.126330  5368 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:31.130626  5705 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:31.134819  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:31.136072  3164 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:31.136135  5398 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:31.138010  5461 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:31.138345  5738 log.cc:927] Time spent T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.002s
I20260709 13:15:31.138537  5510 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:31.139437  5266 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:31.046653  5586 consensus_queue.cc:1059] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:15:31.140609  5586 raft_consensus.cc:3055] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:31.140954  5586 raft_consensus.cc:740] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:31.141894  5586 consensus_queue.cc:260] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:31.143330  5586 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:31.146755  5536 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:31.149032  5536 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:31.150131  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:31.150992  3791 raft_consensus.cc:2368] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6.
I20260709 13:15:31.154356  3797 raft_consensus.cc:1240] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:15:31.151862  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:31.155540  3792 raft_consensus.cc:2368] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7.
I20260709 13:15:31.156109  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:31.156939  3046 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:31.157204  5700 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:31.157590  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.158064  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:31.159185  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:31.159755  3043 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:31.169836  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.181840  3050 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:31.182153  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:31.182967  3792 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:31.184046  5536 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.184335  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:31.186561  3044 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:31.184121  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:31.190073  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:31.190397  3048 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:31.190943  3797 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:31.197858  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:31.198734  3050 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:31.191576  3164 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:31.208092  3193 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:31.207420  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:31.157696  5700 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:31.200376  5503 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:15:31.218050  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 361598us
W20260709 13:15:31.235297  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.237629  3193 raft_consensus.cc:1240] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:15:31.190109  5536 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:31.260021  5536 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:31.262768  3193 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:15:31.264637  5628 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:31.266388  5368 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:31.267244  5628 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:31.267143  5368 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:31.268021  3048 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:31.270236  3762 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:31.271394  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:31.272217  3195 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:31.273988  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:31.275710  5580 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:31.277019  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:31.278139  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:31.279999  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:31.281894  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:31.282577  3195 raft_consensus.cc:2368] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7.
I20260709 13:15:31.205111  5266 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:15:31.283875  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:31.284749  5266 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:31.285264  5266 raft_consensus.cc:697] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:31.285885  5700 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:31.286060  3090 leader_election.cc:336] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Timed out: RequestConsensusVote RPC to 127.1.227.132:43109 timed out after 1.867s (SENT)
W20260709 13:15:31.291750  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 287735us
W20260709 13:15:31.292057  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.295497  3043 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:31.296862  3762 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:15:31.297950  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.298211  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:31.298624  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.300374  3044 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:31.303400  3762 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:31.297557  5503 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:31.310307  5716 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:31.311069  5716 raft_consensus.cc:697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:31.312415  5716 consensus_queue.cc:237] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:31.287773  5501 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:31.247012  5747 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:31.249023  5398 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:31.335537  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:31.336745  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:31.337628  3050 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:31.330161  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:31.341018  3091 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:31.342629  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.286680  5266 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:31.316745  5503 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:31.397935  5398 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:31.398725  5398 raft_consensus.cc:697] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:31.315356  5700 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:15:31.399883  5398 consensus_queue.cc:237] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:31.379148  5674 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:31.381436  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:31.383585  5455 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:15:31.392016  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 106018us
I20260709 13:15:31.393100  5536 consensus_queue.cc:1059] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:31.393781  5368 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:31.328547  5501 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:31.439747  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.445070  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:31.439803  3193 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:31.444802  3195 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:31.451397  5501 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:31.453037  5615 consensus_queue.cc:1059] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:15:31.452097  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:31.471127  5580 raft_consensus.cc:697] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:15:31.471304  5742 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:15:31.457783  5591 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:31.375875  5450 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:31.490628  5552 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:31.515137  3193 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:31.319483  5656 raft_consensus.cc:697] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 6 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:15:31.526041  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 74018.5us
I20260709 13:15:31.538475  5556 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:31.539009  5556 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:31.539309  5750 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.539427  5556 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:31.541476  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 238137us
I20260709 13:15:31.541985  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:31.552407  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:31.555850  3762 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:31.568560  5757 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.569208  5757 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:31.575553  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:31.576714  3193 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 5: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:31.580045  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:31.580832  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 252043us
I20260709 13:15:31.516606  5591 raft_consensus.cc:697] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:31.582893  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:31.584499  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:31.583809  3050 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:15:31.603312  3199 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:31.605062  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:31.493956  5368 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 13:15:31.606441  3050 pending_rounds.cc:85] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 6
I20260709 13:15:31.607179  3050 pending_rounds.cc:107] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:15:31.603906  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:31.607546  3050 raft_consensus.cc:2889] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:31.605679  3195 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:31.607724  3200 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:31.607611  3191 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:31.540655  5450 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:31.611411  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:31.610785  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 322780us
I20260709 13:15:31.615028  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:31.615796  3043 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:15:31.607939  5758 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:15:31.616252  3124 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:31.603612  5455 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.618911  5455 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:31.619961  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:31.620363  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.621217  5455 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:31.622068  5752 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.622184  5266 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:31.622565  5752 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:31.624096  5656 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:31.625203  5614 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:15:31.627794  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.628434  3051 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:31.633332  3042 raft_consensus.cc:1240] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:31.635382  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:31.638332  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:31.640164  3045 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:31.642823  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:31.642951  3091 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:31.644129  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:31.644892  3199 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:31.645535  5680 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.645670  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:31.646284  3199 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:31.646209  5680 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:31.648730  5680 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:31.649296  5680 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:31.650032  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:31.650275  3198 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:31.650691  3196 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:31.650847  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:31.651481  3124 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:31.651949  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:31.652246  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:31.653086  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:31.654225  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:31.661834  3194 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:31.663053  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:31.663287  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:31.663398  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:31.668013  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:31.668982  3048 raft_consensus.cc:2368] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7.
I20260709 13:15:31.675222  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:31.637848  5425 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.692958  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:31.694469  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 62787.8us
I20260709 13:15:31.698499  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:31.700350  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:31.701146  3196 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:31.677958  3043 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:31.711001  3046 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:31.712385  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:31.555226  5750 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:31.719226  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.726727  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:31.729269  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:31.729885  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:31.730160  3122 raft_consensus.cc:2368] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6.
I20260709 13:15:31.730593  3121 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:31.730989  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:31.729350  5752 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:31.731637  3124 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:31.733709  3050 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:31.737039  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:31.738054  3200 raft_consensus.cc:2410] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:15:31.739405  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.702913  5745 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.741145  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:31.743266  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:31.740518  5745 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:31.745349  5745 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:31.745872  5373 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:31.746186  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:31.746416  5373 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:31.746997  3194 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:31.747392  5765 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:31.615171  5580 consensus_queue.cc:237] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:31.748492  5373 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:31.739946  3192 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:31.742676  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:31.754815  3200 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:31.755445  3192 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:31.755668  3194 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:31.756906  3043 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:31.757930  3199 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
W20260709 13:15:31.758805  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.770862  3043 raft_consensus.cc:1275] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:31.772239  3761 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:31.741988  5766 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.780783  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:31.789366  3192 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:15:31.786346  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:31.788194  3191 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
W20260709 13:15:31.756404  5586 consensus_meta.cc:287] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.608s	user 0.013s	sys 0.000s
I20260709 13:15:31.792510  3046 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:15:31.793759  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:31.795276  5767 raft_consensus.cc:2764] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:15:31.735137  5694 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:15:31.798079  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:31.755626  5398 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:31.799712  5652 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:31.717677  5425 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:31.802395  3197 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:31.802793  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:31.803503  5425 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:31.803615  5652 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:31.804030  5652 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.804385  5652 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:31.804833  5556 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:31.806118  3049 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 5: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:31.806921  5556 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:31.777456  5536 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:31.807756  5536 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:31.809237  3195 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:31.810328  5757 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:31.810532  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:31.814546  5652 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:31.741202  5591 consensus_queue.cc:237] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:31.777915  5765 raft_consensus.cc:697] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:31.818020  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:31.818643  3121 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:31.818626  5765 consensus_queue.cc:237] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:31.820071  5425 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.820636  5425 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:31.820987  5501 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:31.823271  5501 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:31.849398  3196 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:31.851500  3121 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:31.852907  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:31.853454  3200 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:31.858965  5586 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:31.859174  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:31.859632  5586 raft_consensus.cc:697] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:31.859961  3791 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:31.860829  3046 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:31.860737  5586 consensus_queue.cc:237] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:31.790463  5750 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:31.865334  5768 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:15:31.867479  5746 log.cc:927] Time spent T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.559s	user 0.013s	sys 0.005s
I20260709 13:15:31.834718  5536 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:31.869014  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:31.863231  3046 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:31.833861  5425 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:31.780453  5700 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
W20260709 13:15:31.877430  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 302819us
I20260709 13:15:31.877574  3121 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:31.883807  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:31.857924  5766 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:31.895252  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:31.903043  3121 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:31.905234  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 158066us
I20260709 13:15:31.884769  5536 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:31.885190  5750 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.913655  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:31.907516  5425 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:31.909072  5501 consensus_queue.cc:1059] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:15:31.951259  3121 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:31.918155  5652 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:31.912719  5750 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:31.928735  3794 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:15:31.935954  5759 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.242s	user 0.001s	sys 0.001s
I20260709 13:15:31.956693  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:31.919904  5694 consensus_queue.cc:1059] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:15:31.930738  5536 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:31.964486  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 44387.4us
I20260709 13:15:31.923763  5745 consensus_queue.cc:1059] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:15:31.969359  3165 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:31.780473  5683 raft_consensus.cc:2955] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 2 to 5, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:15:31.976805  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:31.971612  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:31.929412  5425 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:31.974731  3121 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:31.983091  3126 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:32.003283  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:32.013121  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 44478.3us
I20260709 13:15:31.961906  5781 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:15:32.017669  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:32.020375  3117 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 9: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:15:32.013458  5773 log.cc:927] Time spent T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:15:32.024353  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:32.029987  5774 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:32.031145  5793 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:15:32.040952  5779 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:15:32.041347  5782 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:15:32.042846  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:32.002264  5680 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:32.034596  3118 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:32.039868  3121 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:32.040805  5793 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:32.032939  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 56204.3us
I20260709 13:15:32.065429  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:32.040966  5780 log.cc:927] Time spent T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:15:32.068090  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:32.069520  3122 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:15:32.076928  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:32.103277  3123 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:32.103679  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:32.103477  3164 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 1.546s (SENT) [suppressed 27 similar messages]
I20260709 13:15:32.068507  5556 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:32.102910  5773 log.cc:927] Time spent T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:15:32.111939  3122 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:32.112066  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:32.114667  5786 log.cc:927] Time spent T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:15:32.115274  5795 raft_consensus.cc:3055] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:32.115727  5795 raft_consensus.cc:740] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:32.116591  3791 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:32.116591  5795 consensus_queue.cc:260] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:32.118326  5775 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:32.118666  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:32.103060  5680 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:32.123171  5656 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:32.123991  5656 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:32.124758  5680 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:32.109861  5774 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:15:32.125803  5795 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:32.126798  5425 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:32.130801  5774 consensus_queue.cc:1059] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:32.132228  5774 raft_consensus.cc:3055] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:32.132728  5774 raft_consensus.cc:740] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:32.133721  5774 consensus_queue.cc:260] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:32.135133  5774 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:32.135919  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:32.137341  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:32.149539  5656 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:15:32.150398  5652 raft_consensus.cc:670] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } [suppressed 5 similar messages]
I20260709 13:15:32.156672  3126 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:15:32.131618  5772 consensus_queue.cc:1059] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:15:32.161397  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:32.169847  5791 log.cc:927] Time spent T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:15:32.153131  5781 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
W20260709 13:15:32.175107  5787 log.cc:927] Time spent T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:15:32.176304  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:32.176873  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.177043  5772 raft_consensus.cc:3055] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:32.177472  5772 raft_consensus.cc:740] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:15:32.178725  5739 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.869s	user 0.000s	sys 0.018s
I20260709 13:15:32.178438  5772 consensus_queue.cc:260] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:32.179739  5772 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:32.181126  5702 raft_consensus.cc:3055] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:32.159263  5425 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:32.182832  5777 log.cc:927] Time spent T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.298s	user 0.000s	sys 0.007s
I20260709 13:15:32.182911  5425 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:32.184966  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1630) took 1730 ms. Trace:
I20260709 13:15:32.181555  5702 raft_consensus.cc:740] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:32.186358  5793 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:32.176123  3126 raft_consensus.cc:1217] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 3.3->[5.4-8.6]   Dedup: 5.4->[6.5-8.6]
I20260709 13:15:32.185492  5425 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:32.186949  5750 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:32.212361  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 197741us
I20260709 13:15:32.196053  3123 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:32.167871  5789 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:32.203572  3126 pending_rounds.cc:85] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 4
I20260709 13:15:32.213773  3118 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:32.214267  3126 pending_rounds.cc:107] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 7.5
W20260709 13:15:32.215196  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.216331  3126 raft_consensus.cc:2889] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:32.185341  3120 rpcz_store.cc:276] 0709 13:15:30.454156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.454277 (+   121us) service_pool.cc:224] Handling call
0709 13:15:30.477389 (+ 23112us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:30.511142 (+ 33753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:30.511192 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:30.511837 (+   645us) log.cc:844] Serialized 52 byte log entry
0709 13:15:31.020059 (+508222us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:31.045185 (+ 25126us) log.cc:844] Serialized 14 byte log entry
0709 13:15:31.481472 (+436287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:31.481637 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:32.178011 (+696374us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:32.184652 (+  6641us) raft_consensus.cc:1685] finished
0709 13:15:32.184744 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:32.184903 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25417,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":4871,"raft.queue_time_us":79458,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":161,"spinlock_wait_cycles":40946944,"thread_start_us":943654,"threads_started":2,"wal-append.queue_time_us":736668}
I20260709 13:15:32.168371  5775 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:32.222882  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:32.224223  3118 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:15:32.224589  3118 pending_rounds.cc:85] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 2
I20260709 13:15:32.226881  3118 pending_rounds.cc:107] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:15:32.227114  3118 raft_consensus.cc:2889] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:32.210106  5656 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:32.229792  5368 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:15:32.213907  5789 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:15:32.236222  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 132755us
W20260709 13:15:32.237730  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.238024  3123 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:32.229318  5656 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:15:32.253396  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.237867  5789 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:32.214098  5702 consensus_queue.cc:260] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:32.262420  5702 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:32.264211  3164 leader_election.cc:336] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 1.601s (SENT)
I20260709 13:15:32.264279  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:32.264788  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:32.269868  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:32.271363  3048 raft_consensus.cc:2393] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:32.268646  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:32.272066  3119 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:32.275300  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:32.276033  3120 raft_consensus.cc:1275] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:15:32.276737  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.251610  5656 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:32.242743  5775 consensus_queue.cc:1059] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:15:32.281371  5536 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.287804  5536 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:32.288385  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:32.289424  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:32.290072  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.291110  3120 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:15:32.292143  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:32.292382  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:32.292739  3197 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:32.292850  3120 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:32.285331  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:32.304445  3048 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:32.305002  3123 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:32.307855  3196 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:32.281459  5795 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.308730  3165 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:32.309149  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:32.309690  3197 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
W20260709 13:15:32.309712  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 82271.7us
I20260709 13:15:32.313685  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:32.290095  5536 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:32.263805  5556 consensus_queue.cc:1175] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "501fdf2af2bc4b0c971ae880e98f466b" responder_term: 5 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: [4.3-4.3]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:32.316951  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:32.327838  3123 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 5: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:32.324077  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:32.324404  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:32.332191  3195 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:32.324703  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:32.326380  3196 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:32.326676  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:32.317492  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:32.310262  5775 consensus_queue.cc:1243] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:32.326776  3048 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:32.340929  3120 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:32.338802  3118 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:32.328269  3197 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:32.342088  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:32.343528  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:32.346463  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:32.347961  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:32.312050  5503 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 13:15:32.349709  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 99997.1us
I20260709 13:15:32.314723  5800 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:32.340250  5789 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:32.317250  5796 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:32.357084  5789 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:32.362437  5802 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:15:32.366535  3199 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:32.350889  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:32.366851  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:32.313884  5795 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:32.370828  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:32.366886  5702 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.371899  3120 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:32.371955  5702 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:32.315701  5794 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:15:32.373512  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:32.374783  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:32.375777  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:32.377159  3200 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:32.377826  5501 raft_consensus.cc:3055] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:32.378243  5501 raft_consensus.cc:740] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:15:32.379266  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0213939429997936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
I20260709 13:15:32.380065  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:32.381927  5772 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:32.384964  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:32.386163  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:32.325282  5368 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:32.387612  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:32.388001  5368 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:32.388480  5368 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:32.388737  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:32.388865  5368 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:32.392172  5804 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:32.392997  5804 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:32.393549  5749 raft_consensus.cc:3055] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:32.394001  5749 raft_consensus.cc:740] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:32.394794  5749 consensus_queue.cc:260] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:32.396003  5749 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:32.396693  5368 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:32.404889  5797 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:15:32.405190  3792 raft_consensus.cc:2955] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:15:32.377826  5789 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:32.407608  5789 raft_consensus.cc:697] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:32.379031  5501 consensus_queue.cc:260] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:32.403439  5799 log.cc:927] Time spent T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:15:32.414238  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:32.366902  5425 consensus_queue.cc:1059] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:15:32.406358  5702 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:32.414110  3790 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEARNER]: Advancing to term 6
I20260709 13:15:32.415452  3119 raft_consensus.cc:2410] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:15:32.367575  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:32.426898  3164 leader_election.cc:400] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6.
I20260709 13:15:32.429503  3091 leader_election.cc:400] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7.
I20260709 13:15:32.429945  3091 leader_election.cc:403] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:15:32.443049  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:32.443290  3199 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:15:32.445477  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:32.447165  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55318 (request call id 329) took 1075 ms. Trace:
I20260709 13:15:32.446050  3199 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:15:32.450192  3195 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:32.447688  3119 rpcz_store.cc:276] 0709 13:15:31.353483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.353626 (+   143us) service_pool.cc:224] Handling call
0709 13:15:32.268495 (+914869us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b5800003398. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff8353790a0 00007ff835378984 00007ff82e8f36d4 00007ff82e8f3662
0709 13:15:32.428751 (+160256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23635840}
I20260709 13:15:32.452553  3761 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:32.457506  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:32.458005  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.450834  5775 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
W20260709 13:15:32.459218  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 89250.3us
I20260709 13:15:32.459709  5775 consensus_queue.cc:1243] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer e9165fe61ab04bfb9a48889156d5c161 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:32.460093  3164 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:32.460944  5775 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:32.428587  5796 raft_consensus.cc:3055] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:32.462263  5796 raft_consensus.cc:740] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:32.408766  5789 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:32.463119  5795 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:32.463596  5586 consensus_queue.cc:1059] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:32.464687  5586 raft_consensus.cc:3055] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:32.465011  5586 raft_consensus.cc:740] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:32.406405  5368 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:32.463165  5580 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:32.465911  5586 consensus_queue.cc:260] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:32.466691  5580 raft_consensus.cc:697] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:32.466869  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:32.467531  5796 consensus_queue.cc:260] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:32.467535  3126 raft_consensus.cc:3055] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:32.470750  5804 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:32.455636  5750 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7.
I20260709 13:15:32.446734  5501 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:32.426568  5772 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:32.476866  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 160325us
I20260709 13:15:32.478071  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:32.477892  3126 raft_consensus.cc:740] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:15:32.471611  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.490485  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:32.496098  3798 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 9: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:32.492237  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:32.489639  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:32.461691  5775 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:32.499821  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:32.504421  3165 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:32.507169  3165 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:32.508129  3165 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:32.465992  5652 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:15:32.451071  5702 consensus_queue.cc:1059] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:15:32.493242  5795 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:32.476207  5552 consensus_queue.cc:1059] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:15:32.496577  5368 raft_consensus.cc:2764] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:15:32.524905  3197 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:32.524312  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:32.530998  3199 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:32.506976  5586 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:32.533982  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 73991.7us
I20260709 13:15:32.533353  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:32.536682  3050 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:15:32.509621  5796 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:32.514463  5503 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:32.518636  5772 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:32.542254  3045 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:32.518142  5373 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:32.558547  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 81787.5us
I20260709 13:15:32.504416  5656 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:32.516177  5808 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:32.601300  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:32.610277  3050 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:32.535080  5702 raft_consensus.cc:3055] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:32.505762  5775 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:32.606211  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 71450.7us
W20260709 13:15:32.615116  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 94368.4us
W20260709 13:15:32.607561  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.616922  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:32.544183  5503 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.621394  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:32.630741  5398 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:32.609972  5808 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.632037  5808 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:32.632891  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:32.633682  3200 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:32.634788  3200 raft_consensus.cc:1275] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:32.634982  5656 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:32.636022  3164 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:32.637253  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:32.638017  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:32.638495  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:32.638903  3045 raft_consensus.cc:2410] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:32.622213  5503 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:32.639881  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:32.641095  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:32.535982  5536 consensus_queue.cc:1059] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 13:15:32.637360  5775 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:32.643250  3125 raft_consensus.cc:1217] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[7.7-7.7]   Dedup: 7.7->[]
I20260709 13:15:32.644021  3125 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:15:32.641626  3045 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:32.646409  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:32.610564  5795 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.609520  5772 raft_consensus.cc:697] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:15:32.649835  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.606775  5368 consensus_queue.cc:1059] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:15:32.668136  5752 raft_consensus.cc:3055] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:32.668725  5752 raft_consensus.cc:740] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:32.670034  5752 consensus_queue.cc:260] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:32.581663  5580 consensus_queue.cc:237] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:32.671981  5752 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:32.676633  5795 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:32.678787  5795 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:32.654662  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:32.680313  3193 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:32.681903  5817 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:32.682497  5817 raft_consensus.cc:697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:32.683591  5373 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:32.683449  5817 consensus_queue.cc:237] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:32.684486  5373 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:32.660434  3790 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEARNER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:32.661448  5536 consensus_queue.cc:1243] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:15:32.662009  5591 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:32.686090  5591 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:32.689266  5591 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:32.666345  5772 consensus_queue.cc:237] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:32.648748  5425 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:32.651212  5683 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:32.694697  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:32.681574  3193 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:32.695451  3045 raft_consensus.cc:2410] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:15:32.695967  3164 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:32.696437  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:32.663306  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 310) took 1025 ms. Trace:
I20260709 13:15:32.696982  3193 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:32.703542  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 1992) took 1052 ms. Trace:
I20260709 13:15:32.704661  3193 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:32.703490  3042 rpcz_store.cc:276] 0709 13:15:31.638354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.638480 (+   126us) service_pool.cc:224] Handling call
0709 13:15:31.678631 (+ 40151us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:31.679068 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:31.679107 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:31.679641 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:15:32.395867 (+716226us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b18002f1280. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:15:32.531425 (+135558us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:32.531465 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:32.531552 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:32.662855 (+131303us) raft_consensus.cc:1685] finished
0709 13:15:32.662888 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:32.663218 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14317,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":17610,"spinlock_wait_cycles":32798592,"thread_start_us":135362,"threads_started":1,"wal-append.queue_time_us":942994}
I20260709 13:15:32.705165  3046 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:32.616120  5702 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:32.705928  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:32.659317  3050 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:32.702036  5552 consensus_queue.cc:1059] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:32.706454  5702 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:32.707111  5552 raft_consensus.cc:3055] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:32.707489  5552 raft_consensus.cc:740] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:32.707722  5702 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:32.708336  5552 consensus_queue.cc:260] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:32.709550  5552 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:32.710165  5804 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:32.710552  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:32.711179  5811 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:32.704109  3049 rpcz_store.cc:276] 0709 13:15:31.651228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.652017 (+   789us) service_pool.cc:224] Handling call
0709 13:15:32.703297 (+1051280us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54003c2dd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:32.703453 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352081152}
I20260709 13:15:32.713009  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:32.713614  3049 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:32.714669  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:32.685499  5809 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:32.700987  5808 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:32.707588  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:32.702881  5781 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:15:32.740077  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:32.701884  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 51415.6us
I20260709 13:15:32.706492  3042 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:32.723685  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:32.702718  5373 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:32.737192  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:32.749222  3090 leader_election.cc:400] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7.
I20260709 13:15:32.749630  3045 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:32.749792  3043 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:32.749563  3090 leader_election.cc:403] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:15:32.751494  3043 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:32.755700  3165 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:32.760980  3200 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:32.762259  3043 raft_consensus.cc:3055] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:32.762811  3043 raft_consensus.cc:740] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:32.763938  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:32.764961  3050 raft_consensus.cc:2410] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:32.769142  3045 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:32.771063  3042 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:32.772678  3043 consensus_queue.cc:260] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:32.774179  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 155443us
I20260709 13:15:32.778851  3050 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:32.781832  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.758297  5809 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.785326  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:32.742712  5683 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:15:32.786247  3043 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:32.770967  5789 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:32.788897  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:32.792469  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 142084us
I20260709 13:15:32.790067  3042 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:32.771236  5781 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:32.790608  3797 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEARNER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:32.788658  3126 consensus_queue.cc:260] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:32.791878  3117 raft_consensus.cc:2376] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6. Re-sending same reply.
I20260709 13:15:32.763471  5795 consensus_queue.cc:1059] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:15:32.799993  3126 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:32.806255  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:32.808130  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 66444us
I20260709 13:15:32.807924  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:15:32.825129  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:32.825762  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:32.828167  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:32.834730  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 65246.6us
I20260709 13:15:32.836725  3043 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:15:32.837658  3043 pending_rounds.cc:85] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 6
I20260709 13:15:32.807554  5789 raft_consensus.cc:697] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:32.840351  3043 pending_rounds.cc:107] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:15:32.843122  3043 raft_consensus.cc:2889] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:32.842168  3045 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:15:32.844125  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.844282  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:32.821449  5752 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:32.788820  5809 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:32.863412  5800 raft_consensus.cc:3055] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:32.842411  5552 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.885435  3045 raft_consensus.cc:1275] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:15:32.885833  3045 pending_rounds.cc:85] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 2
I20260709 13:15:32.841992  5781 raft_consensus.cc:697] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:15:32.883347  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 47448.1us
I20260709 13:15:32.854548  5752 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.822678  5450 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:15:32.845887  5803 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:32.886049  3045 pending_rounds.cc:107] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:15:32.826411  5819 consensus_queue.cc:1059] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
W20260709 13:15:32.906996  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.819161  5811 consensus_queue.cc:1059] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
W20260709 13:15:32.908030  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 99122.9us
I20260709 13:15:32.910462  3043 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:32.882995  5755 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.910821  3045 raft_consensus.cc:2889] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:32.918910  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:32.920254  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.878068  5830 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7.
I20260709 13:15:32.917089  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:32.926126  3042 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:32.926384  3050 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:32.923408  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:32.924253  3199 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:15:32.882277  5800 raft_consensus.cc:740] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:32.928011  3043 raft_consensus.cc:2393] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:32.896631  5373 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:32.909773  5752 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:32.939721  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:32.934582  3164 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:32.908135  5552 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:32.941895  5836 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:15:32.925559  5755 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:32.942667  3045 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:32.943884  5552 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:32.944284  5755 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:32.944880  5755 consensus_queue.cc:1059] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:15:32.947154  5823 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260709 13:15:32.948150  5822 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:15:32.948385  5821 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.949291  5821 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:32.944873  3045 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:32.952809  3045 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:32.955166  5789 consensus_queue.cc:237] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:32.959756  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.970582  3193 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:32.925637  5827 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.924650  5766 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:32.980027  3126 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:15:32.929344  5772 raft_consensus.cc:3055] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:32.934376  5808 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:32.994431  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 59998.3us
I20260709 13:15:32.957693  5820 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:15:32.910804  5614 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:15:32.998481  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:32.995067  5750 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:15:32.936643  5683 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.061s
W20260709 13:15:33.006253  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 250654us
W20260709 13:15:33.008754  5826 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.137s	user 0.001s	sys 0.001s
W20260709 13:15:33.010274  5825 log.cc:927] Time spent T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.105s	user 0.001s	sys 0.001s
I20260709 13:15:32.991654  5503 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
W20260709 13:15:32.987672  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46150.5us
I20260709 13:15:33.021171  3090 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:33.022305  5833 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:33.022826  5833 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.023205  5833 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:33.026645  3197 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:33.026046  5800 consensus_queue.cc:260] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:33.028342  5800 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:33.030143  5808 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:33.032341  5833 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:32.992278  5772 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:33.035214  5772 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:33.036782  5772 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:33.040335  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.041281  3046 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
W20260709 13:15:33.046099  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 47732.8us
I20260709 13:15:33.048492  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:33.048544  3164 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:33.049580  5828 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:33.050979  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:33.051919  3048 raft_consensus.cc:2410] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:33.054633  3091 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:33.056298  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 142776us
I20260709 13:15:33.067207  3091 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:32.990054  5803 consensus_queue.cc:1059] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:15:33.000803  5835 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:33.079195  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 58087.5us
I20260709 13:15:33.082667  3090 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:33.083181  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 120569us
I20260709 13:15:33.088028  5834 raft_consensus.cc:3055] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:33.089102  5834 raft_consensus.cc:740] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:33.090368  5834 consensus_queue.cc:260] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:33.091432  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1658) took 1224 ms. Trace:
I20260709 13:15:33.092193  5834 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:33.092020  3125 rpcz_store.cc:276] 0709 13:15:31.866910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.874732 (+  7822us) service_pool.cc:224] Handling call
0709 13:15:32.643129 (+768397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:32.644360 (+  1231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.091119 (+446759us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b540032df50. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:33.091343 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1766123264}
I20260709 13:15:33.094192  3762 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:33.088428  5552 raft_consensus.cc:3055] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:33.077356  5830 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:33.081218  5835 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:33.101102  5828 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:33.077553  5755 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:33.074735  5767 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:33.104868  3125 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:33.106055  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 309) took 1435 ms. Trace:
I20260709 13:15:33.007762  5819 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:15:32.992755  5827 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:33.112252  3126 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:33.158906  3124 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:33.116673  3117 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:33.117892  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 178255us
I20260709 13:15:33.205042  3194 rpcz_store.cc:276] 0709 13:15:31.670274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.747895 (+ 77621us) service_pool.cc:224] Handling call
0709 13:15:31.754273 (+  6378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:31.756327 (+  2054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.105819 (+1349492us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b54002bcad0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:33.105986 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13822208}
I20260709 13:15:33.098090  5833 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:33.001703  5781 consensus_queue.cc:237] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:33.114038  5765 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.029s	sys 0.023s
W20260709 13:15:33.202535  5783 log.cc:927] Time spent T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 1.001s	user 0.007s	sys 0.000s
I20260709 13:15:33.159704  3120 raft_consensus.cc:1240] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: []
W20260709 13:15:33.202391  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 146453us
W20260709 13:15:33.175627  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 81545.6us
W20260709 13:15:33.224210  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.207998  5755 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.118728  5830 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.214092  5835 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:33.206207  5820 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:33.118606  5552 raft_consensus.cc:740] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:15:33.219751  5765 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.030s	sys 0.023s
I20260709 13:15:33.119704  5503 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:33.242384  5833 consensus_queue.cc:1059] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:15:33.250963  3126 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:15:33.254263  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.288074  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:33.168715  5794 raft_consensus.cc:3055] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:33.237979  5755 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:33.268085  5552 consensus_queue.cc:260] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:33.273401  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.255476  5830 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:33.268133  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:33.276363  3123 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:33.277572  5536 raft_consensus.cc:3055] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:33.233530  5580 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:15:33.278177  5614 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:33.278743  5774 raft_consensus.cc:3055] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:33.281037  3794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 399) took 1482 ms. Trace:
I20260709 13:15:33.282581  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 309) took 1707 ms. Trace:
I20260709 13:15:33.284209  5795 raft_consensus.cc:3055] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:33.264847  5820 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:33.288383  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 52640.9us
I20260709 13:15:33.292482  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:33.294049  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 186632us
I20260709 13:15:33.290035  5794 raft_consensus.cc:740] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:15:33.299134  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 54696.8us
I20260709 13:15:33.254462  5843 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:15:33.313395  3164 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:33.289338  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:33.310281  3044 rpcz_store.cc:276] 0709 13:15:31.575121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.576798 (+  1677us) service_pool.cc:224] Handling call
0709 13:15:31.609250 (+ 32452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:31.734835 (+125585us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:31.817999 (+ 83164us) log.cc:844] Serialized 14 byte log entry
0709 13:15:31.928075 (+110076us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:31.950244 (+ 22169us) log.cc:844] Serialized 26 byte log entry
0709 13:15:31.950470 (+   226us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:31.950523 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:31.950623 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:32.877801 (+927178us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:33.282247 (+404446us) raft_consensus.cc:1685] finished
0709 13:15:33.282360 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:33.282496 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14054,"prepare.queue_time_us":88920,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":34199,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":16492,"spinlock_wait_cycles":56164736,"thread_start_us":205277,"threads_started":2,"wal-append.queue_time_us":148647}
I20260709 13:15:33.316879  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:33.320168  3123 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:33.292456  5827 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:33.328011  3050 raft_consensus.cc:3055] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:33.328578  3050 raft_consensus.cc:740] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:33.329584  3050 consensus_queue.cc:260] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:33.333029  3050 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:33.342936  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:33.298807  5536 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:33.349637  3125 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:33.352188  3124 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:15:33.345876  3050 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260709 13:15:33.346541  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.346690  3117 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:33.315207  5820 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:33.315235  5774 raft_consensus.cc:740] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:33.367697  3120 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:33.319170  5808 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:33.315107  5795 raft_consensus.cc:740] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:33.354960  5840 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.394482  5840 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:33.394551  5794 consensus_queue.cc:260] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:33.396795  5794 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:33.355230  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:33.398906  5656 raft_consensus.cc:3055] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:33.399498  5656 raft_consensus.cc:740] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:33.400650  5656 consensus_queue.cc:260] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:33.414372  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.352046  5833 consensus_queue.cc:1059] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.052s
W20260709 13:15:33.405592  3121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 1669) took 1501 ms (client timeout 1833 ms). Trace:
I20260709 13:15:33.314116  5849 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:15:33.406271  5536 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:33.347679  5552 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:33.354527  5503 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 13:15:33.423462  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:33.423992  3121 rpcz_store.cc:269] 0709 13:15:31.904138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.954850 (+ 50712us) service_pool.cc:224] Handling call
0709 13:15:33.405394 (+1450544us) spinlock_profiling.cc:243] Waited 8.57 ms on lock 0x7b54003e8854. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:33.405519 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19700096}
W20260709 13:15:33.424825  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 342259us
I20260709 13:15:33.381057  5800 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:33.397145  5840 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:33.352867  5853 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:33.428004  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:33.441913  3200 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:33.407653  5827 raft_consensus.cc:3055] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:33.436259  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:33.444859  3123 raft_consensus.cc:2410] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:15:33.442936  3090 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:33.446094  3120 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:33.383908  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:33.433099  5656 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:33.439097  5833 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:15:33.445365  5840 raft_consensus.cc:3055] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:33.477228  5840 raft_consensus.cc:740] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:33.478111  5840 consensus_queue.cc:260] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:33.479261  5840 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:33.444227  5827 raft_consensus.cc:740] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:33.480898  5827 consensus_queue.cc:260] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:33.481952  5827 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:33.447808  3799 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:33.482796  5835 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:33.483791  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:33.485073  5536 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:33.485378  5835 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:33.462123  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:33.463233  3117 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:33.463716  5752 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:33.464990  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:33.493376  3124 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:15:33.465718  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:33.494747  3125 raft_consensus.cc:2410] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:15:33.466475  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:33.466171  5774 consensus_queue.cc:260] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:33.315222  3794 rpcz_store.cc:276] 0709 13:15:31.798506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.801804 (+  3298us) service_pool.cc:224] Handling call
0709 13:15:31.802118 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:31.965965 (+163847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.280732 (+1314767us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400622854. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:33.280967 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261904768}
I20260709 13:15:33.467137  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:33.467399  5795 consensus_queue.cc:260] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:33.468061  5821 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:33.468132  3119 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:33.468830  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:33.522634  3118 raft_consensus.cc:2393] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:33.456982  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:33.476886  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.490289  3121 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
W20260709 13:15:33.498085  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 55233.9us
W20260709 13:15:33.524580  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.525055  3090 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:33.498627  5843 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:33.353425  3050 pending_rounds.cc:85] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 6
I20260709 13:15:33.527711  3050 pending_rounds.cc:107] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:15:33.528093  3050 raft_consensus.cc:2889] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:33.503239  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 188744us
I20260709 13:15:33.532495  3117 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:33.534672  3124 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:33.501048  5694 raft_consensus.cc:3055] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:33.542979  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:33.520022  5755 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
W20260709 13:15:33.557888  5450 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:15:33.500974  5830 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:33.558885  5694 raft_consensus.cc:740] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:15:33.583026  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:33.602944  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.587182  3120 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:33.520841  5835 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.590445  3090 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:33.543627  5705 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:15:33.591519  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 53684.5us
I20260709 13:15:33.591691  3118 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:33.528833  5774 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:33.612869  3090 leader_election.cc:400] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7.
I20260709 13:15:33.614151  3090 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:33.596480  3124 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:33.596518  5854 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 13:15:33.605863  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 240480us
I20260709 13:15:33.609365  3091 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:33.610914  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 400954us
I20260709 13:15:33.614880  3121 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:33.620977  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:33.601344  5855 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:33.612210  5843 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:33.635569  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:15:33.637169  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.615260  5591 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.652959  3799 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:15:33.658066  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:33.651841  5800 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:33.659262  5800 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:33.659296  3120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54672
I20260709 13:15:33.659812  5800 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:33.660228  3120 raft_consensus.cc:606] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Received request to transfer leadership
I20260709 13:15:33.660597  3120 raft_consensus.cc:614] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:33.626886  5680 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:33.611717  5835 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:33.670881  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:33.642314  5503 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:33.682849  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.684820  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:33.685417  3050 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:33.635886  5849 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:15:33.665992  5855 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:33.650595  5580 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:15:33.665263  5841 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:33.671733  5843 raft_consensus.cc:2764] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:15:33.649531  5614 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:15:33.680357  5819 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.663105  5591 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:33.708128  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:33.711558  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.686489  5556 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:33.714174  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.655215  5858 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:15:33.680688  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:33.719090  3165 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:33.727602  3200 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:33.730818  3196 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:33.731292  5828 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:33.740237  5828 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.740671  5828 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:33.741899  5755 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:33.743784  5830 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:33.746634  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.748211  5853 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:33.732113  5846 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:15:33.750898  5820 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:33.752669  3791 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 7. Ops: []
I20260709 13:15:33.752395  5828 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:33.753125  5820 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:33.712757  5752 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:33.754657  5591 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:33.704312  5767 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 13:15:33.757076  5859 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:15:33.758209  5835 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:33.764679  5804 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.765544  5804 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:33.766341  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:33.766804  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.769320  3193 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:33.770680  3050 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:33.694986  5503 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:33.856215  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:33.822045  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 157396us
I20260709 13:15:33.860319  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:33.860941  3200 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:33.727272  3794 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:33.867302  3196 raft_consensus.cc:1217] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Deduplicated request from leader. Original: 2.1->[4.2-8.4]   Dedup: 6.3->[8.4-8.4]
I20260709 13:15:33.862795  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:33.675406  5694 consensus_queue.cc:260] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:33.868151  3196 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: [4.2-8.4]
I20260709 13:15:33.872779  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:33.877028  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:33.708712  5841 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:33.881361  3191 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:33.881021  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:33.889658  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:33.890606  3047 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:33.719288  5819 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:33.724169  5556 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:33.908730  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.868706  5536 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.922811  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1877) took 1387 ms. Trace:
W20260709 13:15:33.925501  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 201455us
I20260709 13:15:33.924175  3197 rpcz_store.cc:276] 0709 13:15:32.530361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:32.530499 (+   138us) service_pool.cc:224] Handling call
0709 13:15:33.917364 (+1386865us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54003bb354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:33.917525 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124069120}
W20260709 13:15:33.931843  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 310899us
I20260709 13:15:33.890664  5775 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:33.897018  5821 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:33.938494  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:33.940177  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:33.938797  3165 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:33.879004  5752 consensus_queue.cc:1059] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:15:33.917646  5862 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.924330  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:33.883544  5837 consensus_queue.cc:1059] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:15:33.957434  3046 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:33.895951  5800 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:33.906119  5614 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:15:33.943804  3090 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:33.958393  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 287609us
I20260709 13:15:33.931705  5749 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:33.961138  3200 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
W20260709 13:15:33.967067  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 357724us
I20260709 13:15:33.936085  5772 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.971812  3090 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:33.946509  5840 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:33.946195  5552 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:33.996384  3117 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:15:33.998041  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:34.003211  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:34.003571  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.929970  5536 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:34.006367  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:34.007036  3119 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:33.937804  5858 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:15:34.009032  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:34.000674  3090 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:33.971426  5614 consensus_queue.cc:1243] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:34.017614  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:34.022392  3119 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 8: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:34.000432  5830 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:34.020639  3762 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:34.024149  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:34.024371  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:33.998229  5853 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:33.978121  5809 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:34.025710  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 86979.8us
I20260709 13:15:34.027813  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:34.040601  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:34.013257  5793 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:34.077929  3045 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:34.031665  3120 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
W20260709 13:15:34.057412  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.077987  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:34.078478  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:34.083173  3044 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:34.081370  3117 raft_consensus.cc:2376] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7. Re-sending same reply.
I20260709 13:15:33.968395  5862 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:34.013499  5755 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:15:34.109143  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 81432.1us
I20260709 13:15:34.013314  5843 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.110555  3090 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:34.004806  5772 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:34.083410  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:34.085398  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 204468us
I20260709 13:15:34.085374  3048 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:34.084312  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:34.087252  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 66701.4us
I20260709 13:15:34.020941  5804 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:34.079095  5864 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 13:15:34.030572  5840 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:34.158927  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:34.031580  5870 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:34.150871  3046 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:34.152185  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:34.016943  5766 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:15:34.171970  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:34.104699  5752 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.102074  5809 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.177053  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:34.181713  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:34.176452  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:34.151341  5705 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:34.086836  5830 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:34.183961  3048 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:34.084182  5853 raft_consensus.cc:697] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:34.190201  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:34.200924  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:34.197268  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:34.198033  3126 raft_consensus.cc:2376] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6. Re-sending same reply.
W20260709 13:15:34.201313  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 194382us
I20260709 13:15:34.030439  5580 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.148s
I20260709 13:15:34.041414  5855 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.144s
I20260709 13:15:34.204082  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:34.177614  5820 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.208478  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:34.209424  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:34.177134  5804 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:34.154330  5843 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:34.205169  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:34.191815  5811 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:34.226974  3799 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:34.153016  5755 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:34.195067  5765 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:34.222935  5873 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 13:15:34.235379  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 82251us
I20260709 13:15:34.235630  3047 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:34.239604  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:34.240168  3047 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:34.236685  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:34.242512  3121 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 3: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:34.235657  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:34.246315  3046 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:34.207378  5503 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:34.177804  5840 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:34.191299  5652 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:15:34.269730  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:34.270280  3124 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:34.213297  5804 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.274377  3042 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:34.212930  5819 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:34.217008  5800 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:34.191035  5848 consensus_queue.cc:1059] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:15:34.195120  5809 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:34.227098  5556 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:34.195165  5752 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:34.233945  5765 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.233373  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:34.312359  5556 raft_consensus.cc:3055] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:34.312856  5556 raft_consensus.cc:740] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:34.313802  5556 consensus_queue.cc:260] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:34.272786  5868 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
W20260709 13:15:34.277418  5850 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:15:34.273023  5811 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:34.217871  5820 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:34.275403  5804 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:34.312071  5881 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.290143  3042 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:34.280675  5887 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:34.305295  5827 consensus_meta.cc:287] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.823s	user 0.010s	sys 0.003s
I20260709 13:15:34.291220  5793 raft_consensus.cc:697] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:34.294739  5819 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:34.316831  5772 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:34.361392  5819 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:34.362660  5862 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:34.351326  5887 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:34.364014  5819 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:34.292893  5888 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:34.315304  5765 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:34.315066  5556 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:34.339180  5843 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:34.340744  5755 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:34.342352  5883 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 13:15:34.342352  5877 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:15:34.318619  5853 consensus_queue.cc:237] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:34.345116  5552 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:34.347682  5809 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:34.351814  3042 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:34.327702  5830 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:34.320950  5536 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:34.301873  5614 consensus_queue.cc:1059] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:15:34.356436  5880 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:34.358677  5820 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:34.375355  3046 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:34.382628  3048 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:34.365402  5887 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:34.331280  5800 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.335621  5881 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:34.440057  5900 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:15:34.440248  5800 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:34.412628  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:34.414350  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.442353  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:34.443219  3797 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:34.444783  3194 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:34.438426  5752 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:34.450178  5840 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:34.362706  5793 consensus_queue.cc:237] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:34.366412  5694 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.419616  3165 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:15:34.520476  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:34.520645  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 101904us
I20260709 13:15:34.521333  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:34.521759  3165 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:34.424629  3196 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:34.384002  5888 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:34.395991  3792 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:34.409161  5892 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.438273  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:34.526435  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:34.529233  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 324120us
I20260709 13:15:34.530252  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:34.534284  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:34.526268  5888 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:34.438676  5580 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:15:34.529323  5892 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:34.439564  5880 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:34.548804  5886 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.521035  5652 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:15:34.549644  3165 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:34.548877  5898 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:34.549408  5905 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.550377  5887 consensus_queue.cc:1059] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:34.542303  5907 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:34.542582  5808 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:34.545528  5809 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:34.604796  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.605507  3042 raft_consensus.cc:1275] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:15:34.629345  3042 pending_rounds.cc:85] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 1
W20260709 13:15:34.605662  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 84414.6us
I20260709 13:15:34.629668  3042 pending_rounds.cc:107] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:15:34.629760  3797 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:34.629961  3042 raft_consensus.cc:2889] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:34.613022  3122 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
W20260709 13:15:34.618412  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 68858.6us
W20260709 13:15:34.606865  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 76734.3us
I20260709 13:15:34.630118  3164 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:34.636138  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:34.639197  5908 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:34.641678  5908 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:34.642899  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:34.646047  5908 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:34.646473  5908 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:34.646855  5908 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:34.650017  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:34.652298  5892 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:34.655529  5804 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:34.655652  5821 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:34.657910  5804 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:34.658318  5881 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:34.659119  5774 consensus_meta.cc:287] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.041s	user 0.014s	sys 0.007s
I20260709 13:15:34.660106  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:34.662493  3048 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:34.663275  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:34.665426  3794 consensus_meta.cc:287] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.746s	user 0.013s	sys 0.005s
I20260709 13:15:34.667886  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:34.662163  5908 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:34.620942  5898 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:34.676924  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 46888.7us
I20260709 13:15:34.623034  5907 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.623379  5781 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:34.681473  3164 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:34.677641  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.672335  5804 raft_consensus.cc:2764] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:15:34.684181  3164 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:34.685690  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:34.686803  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:34.636138  5586 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:34.704173  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:34.704813  3196 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:34.711609  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:34.711927  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:34.627025  5809 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:34.680361  5808 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:34.678421  5892 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:15:34.680253  3794 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:34.621582  5886 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:34.697906  5881 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:34.719923  3196 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:34.682178  5821 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:34.723526  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:34.724481  3798 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:34.702245  5887 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.730055  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:34.682096  5898 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:34.716919  5536 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:34.724315  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 320) took 1012 ms. Trace:
I20260709 13:15:34.694554  5907 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:34.719748  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:34.726711  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:34.624850  5905 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:34.733072  3793 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:15:34.697402  5774 consensus_queue.cc:1059] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:15:34.706305  5781 raft_consensus.cc:697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:34.728814  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:34.697122  5450 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:15:34.729933  3194 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:34.728139  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:34.735723  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:34.720715  5808 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.717711  5901 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:34.744469  3196 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:34.729681  5821 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:34.730654  5846 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:34.731508  3199 rpcz_store.cc:276] 0709 13:15:33.712287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.712463 (+   176us) service_pool.cc:224] Handling call
0709 13:15:33.712962 (+   499us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:33.718345 (+  5383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:33.718396 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:33.738142 (+ 19746us) log.cc:844] Serialized 52 byte log entry
0709 13:15:33.945114 (+206972us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:33.958229 (+ 13115us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.563788 (+605559us) spinlock_profiling.cc:243] Waited 7.96 ms on lock 0x7b18002f1700. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c3455 00007ff8303ab060 00007ff8303bd716 00007ff8303ce287 00007ff8303ce208
0709 13:15:34.712060 (+148272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.712144 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:34.712193 (+    49us) raft_consensus.cc:1685] finished
0709 13:15:34.724102 (+ 11909us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.724255 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4706,"prepare.queue_time_us":12859,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":285411,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":79468,"spinlock_wait_cycles":18297728,"thread_start_us":329555,"threads_started":2,"wal-append.queue_time_us":390149}
I20260709 13:15:34.751973  3791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 417) took 2363 ms. Trace:
W20260709 13:15:34.753026  5913 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:15:34.742615  5902 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:34.717715  5586 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:34.734246  5800 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:34.758879  5781 consensus_queue.cc:237] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:34.743502  5808 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:34.757381  2948 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49738 (request call id 146) took 19625 ms (client timeout 15000 ms). Trace:
I20260709 13:15:34.734074  3794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 422) took 1099 ms. Trace:
I20260709 13:15:34.734266  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:34.763175  5821 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:34.717566  5893 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:15:34.774964  5901 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:34.765413  5886 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:34.776080  5909 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:34.782518  5908 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:34.784896  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:34.746459  5536 raft_consensus.cc:697] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:34.787648  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:34.762663  5834 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:34.734578  5887 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:34.763703  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:34.798610  5914 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:15:34.840395  3122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 1665) took 1381 ms (client timeout 1675 ms). Trace:
W20260709 13:15:34.840808  3122 rpcz_store.cc:269] 0709 13:15:33.459436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.466921 (+  7485us) service_pool.cc:224] Handling call
0709 13:15:34.840238 (+1373317us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b54002585d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:34.840335 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920774528}
I20260709 13:15:34.843089  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:34.844586  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:34.847926  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.849361  5902 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.850041  5902 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:34.850914  5880 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:34.852850  5902 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:34.853170  5905 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:34.855077  5809 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:34.856899  5917 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:15:34.860908  5536 consensus_queue.cc:237] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:34.807909  5803 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:15:34.867097  5774 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:34.867498  5811 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.867825  5774 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:34.868110  5811 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:34.859786  5752 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:34.870810  5752 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.871318  5752 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:34.835146  5921 log.cc:927] Time spent T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:15:34.838403  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:34.926218  3191 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:34.838999  3796 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:15:34.857457  5884 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.641s	user 0.001s	sys 0.003s
I20260709 13:15:34.918450  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:34.833670  3199 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:34.941494  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:34.942674  3199 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:34.956451  3164 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:34.960466  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:34.924817  5765 consensus_meta.cc:287] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.012s
I20260709 13:15:34.967872  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 327) took 1080 ms. Trace:
W20260709 13:15:34.962792  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:34.769505  2948 rpcz_store.cc:269] 0709 13:15:15.132436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.132675 (+   239us) service_pool.cc:224] Handling call
0709 13:15:34.757290 (+19624615us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:31.567687 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:31.568351 (+   664us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:31.568405 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:15:31.568424 (+    19us) tablet.cc:662] Decoding operations
0709 13:15:31.568891 (+   467us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:31.569009 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:31.569038 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:15:31.569484 (+   446us) tablet.cc:701] Row locks acquired
0709 13:15:31.569537 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:15:31.569757 (+   220us) write_op.cc:270] Start()
0709 13:15:31.569908 (+   151us) write_op.cc:276] Timestamp: P: 1783602931569679 usec, L: 0
0709 13:15:31.569931 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:15:31.661622 (+ 91691us) log.cc:844] Serialized 982 byte log entry
0709 13:15:32.313679 (+652057us) op_driver.cc:464] REPLICATION: finished
0709 13:15:32.613710 (+300031us) write_op.cc:301] APPLY: starting
0709 13:15:32.627222 (+ 13512us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:32.627411 (+   189us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:32.627570 (+   159us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:32.627975 (+   405us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:32.628179 (+   204us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:15:32.628225 (+    46us) write_op.cc:312] APPLY: finished
0709 13:15:32.628436 (+   211us) log.cc:844] Serialized 29 byte log entry
0709 13:15:32.628621 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:32.628724 (+   103us) write_op.cc:454] Released schema lock
0709 13:15:32.628764 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:32.629184 (+   420us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:32.629215 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":930677,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":217474,"apply.run_cpu_time_us":2133,"apply.run_wall_time_us":22723,"num_ops":2,"prepare.queue_time_us":670945,"prepare.run_cpu_time_us":28918,"prepare.run_wall_time_us":345182,"raft.queue_time_us":223278,"raft.run_cpu_time_us":23552,"raft.run_wall_time_us":224743,"replication_time_us":711629,"thread_start_us":904211,"threads_started":4,"wal-append.queue_time_us":264325,"wal-append.run_cpu_time_us":29397,"wal-append.run_wall_time_us":1701571}]]}
I20260709 13:15:34.968538  3050 rpcz_store.cc:276] 0709 13:15:33.887107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.888135 (+  1028us) service_pool.cc:224] Handling call
0709 13:15:33.888569 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:33.889077 (+   508us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:33.918239 (+ 29162us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.560402 (+642163us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b1800346060. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff5323a 00007ff8303bda2a
0709 13:15:34.686996 (+126594us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:34.707517 (+ 20521us) log.cc:844] Serialized 26 byte log entry
0709 13:15:34.707661 (+   144us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:34.707695 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.707758 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:34.956635 (+248877us) raft_consensus.cc:1685] finished
0709 13:15:34.967585 (+ 10950us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.967763 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6767,"prepare.queue_time_us":29117,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":3680,"raft.queue_time_us":14267,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":13711,"spinlock_wait_cycles":22598400,"thread_start_us":119546,"threads_started":1,"wal-append.queue_time_us":804146}
I20260709 13:15:34.965442  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:34.975632  3199 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:34.809262  5450 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.853595  5902 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.786365  3794 rpcz_store.cc:276] 0709 13:15:33.629318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.633776 (+  4458us) service_pool.cc:224] Handling call
0709 13:15:34.728665 (+1094889us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:34.956795  5914 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.115s	user 0.002s	sys 0.000s
I20260709 13:15:34.925203  5887 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:34.978295  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:34.956034  5819 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:34.955718  5556 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:34.960937  5905 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:34.976625  5765 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:35.038056  5886 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.976780  5794 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:34.764499  3791 rpcz_store.cc:276] 0709 13:15:32.388566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:32.396882 (+  8316us) service_pool.cc:224] Handling call
0709 13:15:33.280927 (+884045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:33.753147 (+472220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.750721 (+997574us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b5400622854. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:34.751749 (+  1028us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b5400622850. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:34.751909 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3116481152}
I20260709 13:15:34.941936  5834 raft_consensus.cc:697] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:35.023407  5880 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.022957  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:35.097177  3792 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:35.097993  5775 raft_consensus.cc:3055] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:35.098506  5775 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:35.099387  5775 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:35.100158  3762 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:35.100730  5775 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:35.101125  5892 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:35.079125  3191 raft_consensus.cc:2410] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:15:35.033373  5425 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.077677  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:35.107928  3799 raft_consensus.cc:2393] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:35.084126  5887 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.085398  5774 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:35.023207  5450 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:35.025314  5898 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:35.089795  5794 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.033768  5902 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:35.119992  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:35.123051  5854 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:35.124423  5854 raft_consensus.cc:3055] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:35.124833  5854 raft_consensus.cc:740] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:35.110088  5908 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.116938  5774 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.114334  5887 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:35.090072  5905 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:35.108031  5892 raft_consensus.cc:697] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:15:35.126677  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.140236  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:35.140434  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:35.087212  5556 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:35.083607  5819 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:35.144582  3197 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:35.132423  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:35.134691  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:35.120981  3199 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
W20260709 13:15:35.134366  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.137238  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:35.112097  5811 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:35.137867  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1699) took 1129 ms. Trace:
I20260709 13:15:35.153497  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:35.151059  3192 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:35.092584  5886 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:35.134855  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 875920us
I20260709 13:15:35.153245  3125 rpcz_store.cc:276] 0709 13:15:34.010534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.010755 (+   221us) service_pool.cc:224] Handling call
0709 13:15:34.011058 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:34.011436 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:34.011464 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:34.014899 (+  3435us) log.cc:844] Serialized 26 byte log entry
0709 13:15:34.419888 (+404989us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:34.530526 (+110638us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.137472 (+606946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.137555 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:35.137596 (+    41us) raft_consensus.cc:1685] finished
0709 13:15:35.137609 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.137811 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":624597,"prepare.queue_time_us":114083,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":628576,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":26569,"thread_start_us":334813,"threads_started":1,"wal-append.queue_time_us":508650}
W20260709 13:15:35.150653  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.120556  5794 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:35.150564  3197 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:15:35.149430  3122 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:35.170712  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:35.171321  3122 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:35.137054  5830 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.151624  5843 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.108652  5907 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:35.141374  5755 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.105010  5880 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:35.162065  5909 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:35.267939  3091 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:35.269297  3091 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:35.205482  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:35.270115  3125 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:35.132993  5887 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:35.141522  5872 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:35.135529  5841 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:35.111414  5425 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:35.135040  5905 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:35.208062  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 69562.7us
I20260709 13:15:35.244545  3122 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:35.279789  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:35.289659  3125 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:35.229837  3192 raft_consensus.cc:2410] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:35.135026  5840 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:15:35.153954  5894 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:35.275003  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 378253us
I20260709 13:15:35.208329  5586 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:35.202505  5750 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.130129  5908 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:35.280192  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:35.307850  3050 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 3: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:35.308156  3194 raft_consensus.cc:2393] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:35.170262  5828 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:35.280678  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:35.278568  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.286971  5895 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.297220  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:35.130628  5774 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:35.231395  5901 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:35.265818  5833 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.300357  5891 raft_consensus.cc:3055] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:35.301599  3042 pending_rounds.cc:85] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 5
I20260709 13:15:35.340175  3042 pending_rounds.cc:107] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:15:35.340538  3042 raft_consensus.cc:2889] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:35.302277  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:35.137562  5892 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:35.275177  5827 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.125716  5854 consensus_queue.cc:260] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:35.163053  5821 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:35.305884  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.263147  5834 consensus_queue.cc:237] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:35.312369  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:35.376610  3050 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:35.373772  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:35.314183  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:35.277958  5931 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.320382  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:35.321668  3122 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:35.294961  5680 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:35.332412  3793 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:35.294406  5841 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.283427  5897 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:35.336688  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:35.293779  5853 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:35.263396  5843 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:35.231808  5830 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:35.298174  5909 raft_consensus.cc:697] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:35.319963  5750 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:35.400635  5909 consensus_queue.cc:237] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:35.310572  5552 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:35.402006  5552 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.402453  5552 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:35.402649  5841 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:35.276490  5755 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:35.408290  5774 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:35.409711  5888 consensus_meta.cc:287] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.794s	user 0.009s	sys 0.003s
I20260709 13:15:35.410250  5888 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:35.412472  5888 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:35.414233  3046 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:35.415323  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 325) took 1001 ms. Trace:
W20260709 13:15:35.334286  5808 consensus_meta.cc:287] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.003s
I20260709 13:15:35.288679  5855 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:15:35.282886  5811 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.340080  5891 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:35.398010  5556 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:35.398689  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:35.466727  3044 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:35.398954  3119 raft_consensus.cc:2410] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:15:35.399524  5929 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.366400  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:35.349917  5833 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:35.421525  5841 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:35.372573  5827 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:35.380832  5765 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:35.384279  5680 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.420938  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:35.516718  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:35.486167  5938 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:15:35.337178  5901 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:35.464928  5398 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:35.333576  5895 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:35.415850  3200 rpcz_store.cc:276] 0709 13:15:34.414243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.414394 (+   151us) service_pool.cc:224] Handling call
0709 13:15:34.414721 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:34.627833 (+213112us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:34.639276 (+ 11443us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.727927 (+ 88651us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:34.727987 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:34.728034 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.415041 (+687007us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54003ba454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:35.415092 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.415249 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10162,"prepare.queue_time_us":17178,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":3934,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":2824,"spinlock_wait_cycles":489537792,"thread_start_us":85902,"threads_started":1,"wal-append.queue_time_us":138974}
I20260709 13:15:35.384645  5870 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.139s
W20260709 13:15:35.486238  5922 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
I20260709 13:15:35.301637  5894 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:35.674763  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 405511us
I20260709 13:15:35.420058  5853 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:35.390579  5931 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:35.460553  5808 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:35.472956  5811 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:35.732050  3091 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:35.413920  5897 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:35.486340  5929 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:35.772338  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:35.903990  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 530297us
I20260709 13:15:35.908715  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:35.637358  5680 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:35.905821  3125 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:35.914181  5450 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:35.918658  3044 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:35.929864  3762 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:35.934047  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:35.674044  5398 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.946795  5586 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:35.947129  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:35.952296  3125 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:35.934724  5536 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:35.957760  3196 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:35.958135  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:35.959152  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.961684  3126 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:35.897946  5843 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:35.959565  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:35.934032  5809 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:35.934695  5886 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:35.974831  3761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.013s	sys 0.025s
W20260709 13:15:35.976167  3761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.013s	sys 0.025s
I20260709 13:15:35.976017  3118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:15:35.950982  5398 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:35.948525  5907 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:35.980993  3042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.018s	sys 0.021s
W20260709 13:15:35.985493  3042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.018s	sys 0.021s
W20260709 13:15:35.978307  3049 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.995s	user 0.000s	sys 0.014s
W20260709 13:15:35.978621  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 664431us
W20260709 13:15:35.986531  3049 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.000s	sys 0.015s
I20260709 13:15:35.961227  5536 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:35.994238  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 85628.2us
I20260709 13:15:35.997934  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:35.994227  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.960911  5586 raft_consensus.cc:697] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:36.015347  5586 consensus_queue.cc:237] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:36.021009  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:36.024653  5937 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:15:36.026332  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1700) took 2015 ms. Trace:
W20260709 13:15:36.026705  5935 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:15:36.026795  3120 rpcz_store.cc:276] 0709 13:15:34.011779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.210216 (+198437us) service_pool.cc:224] Handling call
0709 13:15:34.235960 (+ 25744us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:35.129958 (+893998us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:35.129990 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:35.130531 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:15:35.240035 (+109504us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:35.240104 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.240210 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.026040 (+785830us) raft_consensus.cc:1685] finished
0709 13:15:36.026078 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.026253 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":893597,"raft.queue_time_us":896101,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":84755,"threads_started":1,"wal-append.queue_time_us":742192}
I20260709 13:15:35.982565  5934 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:15:36.026613  5936 log.cc:927] Time spent T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:15:36.049016  5811 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:35.995620  5908 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:35.997570  5765 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.007048  5536 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:36.027788  5943 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:15:35.995334  5833 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:36.029146  5933 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.760871  5891 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:36.019344  5425 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:35.979413  5809 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:36.133200  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.056825  5934 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:36.177248  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 323) took 2463 ms. Trace:
I20260709 13:15:36.177767  3195 rpcz_store.cc:276] 0709 13:15:33.713375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.713478 (+   103us) service_pool.cc:224] Handling call
0709 13:15:33.713819 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:33.723606 (+  9787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:33.723642 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:33.738667 (+ 15025us) log.cc:844] Serialized 52 byte log entry
0709 13:15:33.955864 (+217197us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:34.265841 (+309977us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.527308 (+261467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.527393 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.168985 (+1641592us) spinlock_profiling.cc:243] Waited 5.75 ms on lock 0x7b18003fbbc0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:15:36.176893 (+  7908us) raft_consensus.cc:1685] finished
0709 13:15:36.177000 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.177176 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95275,"prepare.queue_time_us":61354,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":11252,"raft.queue_time_us":179624,"raft.run_cpu_time_us":402,"raft.run_wall_time_us":24772,"spinlock_wait_cycles":13218560,"thread_start_us":738029,"threads_started":3,"wal-append.queue_time_us":364342}
I20260709 13:15:36.180594  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1705) took 2166 ms. Trace:
I20260709 13:15:36.181026  3121 rpcz_store.cc:276] 0709 13:15:34.013856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.276587 (+262731us) service_pool.cc:224] Handling call
0709 13:15:34.278481 (+  1894us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:35.137962 (+859481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:35.137990 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:35.142411 (+  4421us) log.cc:844] Serialized 26 byte log entry
0709 13:15:35.322863 (+180452us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:35.322935 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.323023 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.180385 (+857362us) raft_consensus.cc:1685] finished
0709 13:15:36.180404 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.180536 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":952588,"raft.queue_time_us":867862,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":6532,"thread_start_us":106279,"threads_started":1,"wal-append.queue_time_us":1012339}
W20260709 13:15:36.185189  5775 consensus_meta.cc:287] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.084s	user 0.010s	sys 0.002s
I20260709 13:15:36.121263  3126 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:36.187278  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 1682) took 1016 ms. Trace:
W20260709 13:15:36.089979  5940 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.022s	sys 0.041s
I20260709 13:15:36.188026  3126 rpcz_store.cc:276] 0709 13:15:35.170761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.934112 (+763351us) service_pool.cc:224] Handling call
0709 13:15:36.187191 (+253079us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:36.147011  5827 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:36.191799  5940 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.022s	sys 0.042s
W20260709 13:15:36.265861  3051 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.010s	sys 0.007s
W20260709 13:15:36.266278  3051 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.010s	sys 0.007s
I20260709 13:15:36.267659  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1669) took 2790 ms. Trace:
I20260709 13:15:36.191452  5901 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:36.194725  5891 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:36.272416  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1704) took 2259 ms. Trace:
I20260709 13:15:36.146428  5765 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:36.197248  5833 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:36.238770  5591 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.003s	sys 0.010s
I20260709 13:15:36.268291  3123 rpcz_store.cc:276] 0709 13:15:33.460602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.484717 (+ 24115us) service_pool.cc:224] Handling call
0709 13:15:33.485021 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:33.485218 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:33.775651 (+290433us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.856702 (+1081051us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:35.337167 (+480465us) spinlock_profiling.cc:243] Waited 73.3 ms on lock 0x7b18001b1f00. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82ff5b4bc 00007ff82d2a948b 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff5323a
0709 13:15:36.235304 (+898137us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:36.251008 (+ 15704us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:36.251065 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.251119 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.251277 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":567995,"prepare.queue_time_us":522474,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":3394,"raft.queue_time_us":634525,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":9318,"spinlock_wait_cycles":174636288,"thread_start_us":834092,"threads_started":3,"wal-append.queue_time_us":408782,"wal-append.run_cpu_time_us":6056,"wal-append.run_wall_time_us":1771072}
I20260709 13:15:36.250294  5853 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:36.258262  5934 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:36.156893  5933 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:36.370851  5752 consensus_meta.cc:287] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.499s	user 0.013s	sys 0.002s
I20260709 13:15:36.371603  5933 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:36.275664  5895 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:36.284880  5591 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.004s	sys 0.011s
I20260709 13:15:36.280814  3124 rpcz_store.cc:276] 0709 13:15:34.013406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.276236 (+262830us) service_pool.cc:224] Handling call
0709 13:15:34.276509 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:34.276720 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:34.304332 (+ 27612us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.301425 (+997093us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b18000eb660. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff5323a 00007ff8303bda2a
0709 13:15:35.655111 (+353686us) log.cc:844] Serialized 14 byte log entry
0709 13:15:36.261251 (+606140us) log.cc:844] Serialized 14 byte log entry
0709 13:15:36.261490 (+   239us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:36.261557 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:36.261631 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.265216 (+  3585us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.272288 (+  7072us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":310728,"prepare.queue_time_us":719649,"prepare.run_cpu_time_us":224,"prepare.run_wall_time_us":3149,"spinlock_wait_cycles":34780416,"thread_start_us":645351,"threads_started":3,"wal-append.queue_time_us":1852893}
I20260709 13:15:36.307924  3118 raft_consensus.cc:606] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:36.374092  3118 raft_consensus.cc:614] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:36.286271  5808 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:36.304597  5929 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:36.304870  5897 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:36.287729  5833 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:36.375490  5843 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:15:36.375924  3196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1615) took 1628 ms (client timeout 1877 ms). Trace:
I20260709 13:15:36.376073  5843 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:36.376330  3196 rpcz_store.cc:269] 0709 13:15:34.748009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.784572 (+ 36563us) service_pool.cc:224] Handling call
0709 13:15:36.375683 (+1591111us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540013bad4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:36.375858 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2646323072}
I20260709 13:15:36.376886  5833 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:36.318207  5894 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:36.300752  5652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.163s	user 0.012s	sys 0.013s
W20260709 13:15:36.331939  5804 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.011s	sys 0.023s
W20260709 13:15:36.344962  5945 log.cc:927] Time spent T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:15:36.377926  5804 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.011s	sys 0.024s
I20260709 13:15:36.345678  3799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43926 (request call id 553) took 1921 ms. Trace:
I20260709 13:15:36.350211  5854 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:36.326468  5846 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.347319  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 331) took 1066 ms. Trace:
I20260709 13:15:36.328118  5931 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:36.389796  3042 rpcz_store.cc:276] 0709 13:15:35.281185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.281324 (+   139us) service_pool.cc:224] Handling call
0709 13:15:35.301407 (+ 20083us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:35.341260 (+ 39853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:35.341292 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:35.341848 (+   556us) log.cc:844] Serialized 52 byte log entry
0709 13:15:35.986131 (+644283us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:35.986178 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.986270 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.347061 (+360791us) raft_consensus.cc:1685] finished
0709 13:15:36.347083 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.347252 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2575,"raft.queue_time_us":86,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":15658,"thread_start_us":605334,"threads_started":1,"wal-append.queue_time_us":954827}
I20260709 13:15:36.398947  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1685) took 1099 ms. Trace:
I20260709 13:15:36.399482  3123 rpcz_store.cc:276] 0709 13:15:35.299237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.374949 (+1075712us) service_pool.cc:224] Handling call
0709 13:15:36.397907 (+ 22958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.398373 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:36.398451 (+    78us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:36.398571 (+   120us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:36.398646 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.398717 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.398877 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:36.381786  5652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.244s	user 0.012s	sys 0.013s
I20260709 13:15:36.371356  5752 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:36.303702  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 571717us
I20260709 13:15:36.378747  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1894) took 1643 ms. Trace:
I20260709 13:15:36.378525  3799 rpcz_store.cc:276] 0709 13:15:34.424263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.424417 (+   154us) service_pool.cc:224] Handling call
0709 13:15:36.345306 (+1920889us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b5400653454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:36.345550 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1337259904}
I20260709 13:15:36.349958  5765 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:36.427685  5794 consensus_meta.cc:287] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.206s	user 0.009s	sys 0.004s
I20260709 13:15:36.298749  5855 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.363415  5956 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:36.428148  5794 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:36.428750  3043 raft_consensus.cc:1240] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:15:36.429879  5752 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:36.429512  5855 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:36.430346  5794 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:36.431605  3191 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 5: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:36.432071  5855 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:36.434422  5809 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:36.434270  3091 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:36.435137  5855 consensus_queue.cc:1059] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:15:36.437515  5958 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:36.426295  3199 rpcz_store.cc:276] 0709 13:15:34.734974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.150250 (+415276us) service_pool.cc:224] Handling call
0709 13:15:35.150572 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:35.156714 (+  6142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:35.156742 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:35.179884 (+ 23142us) log.cc:844] Serialized 26 byte log entry
0709 13:15:35.340148 (+160264us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:35.340208 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.340306 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.378541 (+1038235us) raft_consensus.cc:1685] finished
0709 13:15:36.378562 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.378690 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5714,"raft.queue_time_us":5842,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":41801,"thread_start_us":61248,"threads_started":1,"wal-append.queue_time_us":915634}
I20260709 13:15:36.440104  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 353) took 1311 ms. Trace:
I20260709 13:15:36.440546  3125 rpcz_store.cc:276] 0709 13:15:35.129129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.968361 (+839232us) service_pool.cc:224] Handling call
0709 13:15:35.968759 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:35.972051 (+  3292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:35.972083 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:35.983506 (+ 11423us) log.cc:844] Serialized 52 byte log entry
0709 13:15:36.307754 (+324248us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:36.307799 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.308266 (+   467us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.439889 (+131623us) raft_consensus.cc:1685] finished
0709 13:15:36.439915 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.440051 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2866,"raft.queue_time_us":386503,"spinlock_wait_cycles":6758656,"thread_start_us":262280,"threads_started":1,"wal-append.queue_time_us":430156}
I20260709 13:15:36.441519  5398 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:36.442420  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:36.443627  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:36.444451  3125 raft_consensus.cc:2410] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:15:36.445230  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:36.443733  5398 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:36.401485  5895 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:36.451900  5680 consensus_meta.cc:287] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.536s	user 0.007s	sys 0.003s
I20260709 13:15:36.472548  5963 raft_consensus.cc:3055] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:15:36.454025  3194 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.009s	sys 0.053s
W20260709 13:15:36.499454  3194 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.009s	sys 0.053s
W20260709 13:15:36.457684  3045 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.037s	sys 0.027s
W20260709 13:15:36.468142  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 200290us
I20260709 13:15:36.468665  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:36.500545  3045 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.037s	sys 0.027s
I20260709 13:15:36.501048  3117 raft_consensus.cc:2393] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 8: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:36.408233  5965 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:36.480754  3125 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:36.473661  5552 consensus_meta.cc:287] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.071s	user 0.006s	sys 0.012s
I20260709 13:15:36.395651  5846 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:36.494868  5895 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:36.495651  5680 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:36.472301  5958 raft_consensus.cc:697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:36.497480  5880 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:36.525758  3197 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:36.529240  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.499264  5963 raft_consensus.cc:740] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:36.529572  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:36.533273  3125 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:36.537714  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:36.540042  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:36.540851  3125 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:36.530151  5853 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:36.531267  5705 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.567200  5705 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:36.569037  5953 log.cc:927] Time spent T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:15:36.569648  5705 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:36.572444  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 334) took 1806 ms. Trace:
I20260709 13:15:36.572837  3194 rpcz_store.cc:276] 0709 13:15:34.766126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.402954 (+636828us) service_pool.cc:224] Handling call
0709 13:15:35.906591 (+503637us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:35.916914 (+ 10323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:35.916962 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:35.917834 (+   872us) log.cc:844] Serialized 52 byte log entry
0709 13:15:36.499982 (+582148us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:36.513069 (+ 13087us) log.cc:844] Serialized 14 byte log entry
0709 13:15:36.513513 (+   444us) log.cc:844] Serialized 14 byte log entry
0709 13:15:36.513690 (+   177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.513808 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.572238 (+ 58430us) raft_consensus.cc:1685] finished
0709 13:15:36.572258 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.572388 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8648,"prepare.queue_time_us":51107,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":3246,"raft.queue_time_us":9826,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":322,"spinlock_wait_cycles":8365440,"thread_start_us":581641,"threads_started":1,"wal-append.queue_time_us":633952}
I20260709 13:15:36.574819  5846 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:36.517884  5552 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:36.579481  5552 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:36.580477  5795 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:36.582199  5958 consensus_queue.cc:237] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:36.551326  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:36.586555  3791 raft_consensus.cc:2410] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:36.590963  5895 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:36.592171  5963 consensus_queue.cc:260] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:36.593525  5963 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:36.598966  5680 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:36.600800  5827 raft_consensus.cc:3055] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:36.601323  5827 raft_consensus.cc:740] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:36.602222  5827 consensus_queue.cc:260] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:36.603288  5827 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:36.518431  5965 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:36.609051  5926 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 1.201s	user 0.000s	sys 0.014s
I20260709 13:15:36.627842  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:36.628242  3199 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:36.628697  3194 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:36.629905  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:36.631618  3196 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:36.628727  5901 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.637547  5973 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:36.637852  5901 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:36.638602  5973 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:36.638996  5965 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:36.639494  5755 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:36.640022  5901 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:36.640920  5973 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:36.640975  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 332) took 1892 ms. Trace:
I20260709 13:15:36.642063  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 354) took 1512 ms. Trace:
I20260709 13:15:36.641592  3193 rpcz_store.cc:276] 0709 13:15:34.748760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.303673 (+554913us) service_pool.cc:224] Handling call
0709 13:15:35.327260 (+ 23587us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:35.336856 (+  9596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:35.336888 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:35.337371 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:15:36.378160 (+1040789us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b180027fd00. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:15:36.614010 (+235850us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:36.616531 (+  2521us) log.cc:844] Serialized 14 byte log entry
0709 13:15:36.616853 (+   322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.616962 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.640641 (+ 23679us) raft_consensus.cc:1685] finished
0709 13:15:36.640768 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.640913 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":468710,"prepare.queue_time_us":2588,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":7308,"raft.run_cpu_time_us":652,"raft.run_wall_time_us":28247,"spinlock_wait_cycles":155491712,"thread_start_us":235370,"threads_started":1,"wal-append.queue_time_us":1277795}
I20260709 13:15:36.643468  5536 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:36.644411  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 356) took 1514 ms. Trace:
I20260709 13:15:36.644814  3121 rpcz_store.cc:276] 0709 13:15:35.135302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.182624 (+1047322us) service_pool.cc:224] Handling call
0709 13:15:36.190207 (+  7583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:36.209554 (+ 19347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:36.256345 (+ 46791us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:36.256937 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:15:36.558054 (+301117us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:36.558115 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.558210 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.644182 (+ 85972us) raft_consensus.cc:1685] finished
0709 13:15:36.644208 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.644339 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28459,"raft.queue_time_us":188903,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":24360,"spinlock_wait_cycles":39296,"thread_start_us":300693,"threads_started":1,"wal-append.queue_time_us":383142}
I20260709 13:15:36.646857  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:36.647625  3121 raft_consensus.cc:2393] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:36.648447  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:36.649065  3121 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:36.614365  5853 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:36.642656  3120 rpcz_store.cc:276] 0709 13:15:35.129367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.045877 (+916510us) service_pool.cc:224] Handling call
0709 13:15:36.099114 (+ 53237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:36.191094 (+ 91980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:36.191145 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:36.197623 (+  6478us) log.cc:844] Serialized 26 byte log entry
0709 13:15:36.456027 (+258404us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:36.456083 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.456176 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.641861 (+185685us) raft_consensus.cc:1685] finished
0709 13:15:36.641881 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.642008 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119137,"raft.queue_time_us":263451,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":3099,"thread_start_us":170484,"threads_started":1,"wal-append.queue_time_us":344587}
I20260709 13:15:36.652915  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:36.653352  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1681) took 1483 ms. Trace:
I20260709 13:15:36.656374  3124 rpcz_store.cc:276] 0709 13:15:35.170449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.374161 (+1203712us) service_pool.cc:224] Handling call
0709 13:15:36.374555 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:36.401782 (+ 27227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:36.401828 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:36.402424 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 13:15:36.614009 (+211585us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:36.614050 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.614113 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.653145 (+ 39032us) raft_consensus.cc:1685] finished
0709 13:15:36.653178 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.653299 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26785,"raft.queue_time_us":31640,"spinlock_wait_cycles":43170176,"thread_start_us":188964,"threads_started":1,"wal-append.queue_time_us":226843}
I20260709 13:15:36.649729  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:36.658520  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:36.655939  3120 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:15:36.670248  3121 raft_consensus.cc:1275] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:15:36.673048  3124 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:15:36.671980  3121 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:36.677544  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1616) took 1897 ms. Trace:
I20260709 13:15:36.678097  3200 rpcz_store.cc:276] 0709 13:15:34.780595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.728039 (+947444us) service_pool.cc:224] Handling call
0709 13:15:35.907163 (+179124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:35.907487 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:36.337249 (+429762us) log.cc:844] Serialized 14 byte log entry
0709 13:15:36.676989 (+339740us) log.cc:844] Serialized 14 byte log entry
0709 13:15:36.677210 (+   221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:36.677259 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:36.677306 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.677379 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.677490 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37,"prepare.queue_time_us":509602,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":102,"raft.queue_time_us":3523,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":3869,"spinlock_wait_cycles":1456384,"thread_start_us":665316,"threads_started":3}
W20260709 13:15:36.681149  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.681874  3120 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:36.645555  5536 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:36.651425  5853 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:36.686700  3044 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:15:36.727933  3044 pending_rounds.cc:85] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 4
I20260709 13:15:36.728181  3044 pending_rounds.cc:107] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:15:36.728435  3044 raft_consensus.cc:2889] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:36.728937  3122 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:15:36.729542  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:36.687489  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:36.691629  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.730792  3047 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:36.701471  5830 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:36.706138  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34728 (request call id 330) took 1965 ms. Trace:
I20260709 13:15:36.706349  3195 raft_consensus.cc:1240] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:36.710772  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55318 (request call id 357) took 1575 ms. Trace:
I20260709 13:15:36.730166  3044 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:36.680734  5811 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.734999  3119 rpcz_store.cc:276] 0709 13:15:35.135683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.153252 (+ 17569us) service_pool.cc:224] Handling call
0709 13:15:36.710481 (+1557229us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54003020d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:36.710692 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":562059008}
I20260709 13:15:36.712175  5898 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:36.717046  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.676946  5450 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.724459  5580 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.670679  5774 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:36.731752  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:36.733356  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:36.750991  3121 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:36.750897  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:36.751919  3047 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:36.753711  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:36.677103  5841 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.723578  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:36.680897  5908 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:36.677428  5828 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:36.772166  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:36.734371  3191 rpcz_store.cc:276] 0709 13:15:34.740283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.111045 (+370762us) service_pool.cc:224] Handling call
0709 13:15:36.705839 (+1594794us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400037354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:36.706055 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2967805184}
I20260709 13:15:36.763082  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:36.763520  3042 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:15:36.774293  3042 pending_rounds.cc:85] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 4
I20260709 13:15:36.774670  3042 pending_rounds.cc:107] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:15:36.752518  5934 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.769032  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:36.775327  3042 raft_consensus.cc:2889] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:36.762238  5804 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.773793  3047 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:36.762570  5898 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.762477  5774 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:36.786530  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:36.762157  5853 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:36.754761  5929 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.778553  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:36.799074  3090 leader_election.cc:336] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 1.507s (SENT)
I20260709 13:15:36.736995  5811 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:36.786616  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:36.787878  3047 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:15:36.822477  3120 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:36.823211  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:36.824254  3047 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:36.781391  3091 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:36.771682  5834 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.826488  5834 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:36.825347  5774 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:36.749171  5450 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:36.832010  5450 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:36.818254  5827 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.833936  5827 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:36.764737  5830 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:15:36.836376  5928 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 1.256s	user 0.000s	sys 0.003s
I20260709 13:15:36.835894  5830 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:36.799535  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:36.788503  5803 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.840083  5803 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:36.842854  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 61556.5us
I20260709 13:15:36.843926  3091 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:36.802438  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:36.837814  3048 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:36.802589  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:36.802665  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:36.803459  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:36.803210  5929 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:36.787289  5828 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:36.880132  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 330) took 1599 ms. Trace:
I20260709 13:15:36.893611  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:36.752393  5580 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:36.784907  5958 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:15:36.788184  5804 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:36.770906  5841 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:36.807152  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:36.793643  5898 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:36.807662  5952 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:36.800331  5586 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.808251  5793 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.808385  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:36.803151  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:36.809947  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1679) took 1641 ms. Trace:
W20260709 13:15:36.810209  5983 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:15:36.810766  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42960 (request call id 11) took 1673 ms. Trace:
I20260709 13:15:36.811585  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:36.814008  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:36.814147  5819 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:36.776187  5880 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.825531  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:36.848296  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:36.845490  3091 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:36.799530  3090 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:36.868067  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.774304  5908 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:36.829617  5834 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:36.814878  5853 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:36.792533  5934 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:37.126160  5964 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:37.126652  5398 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:37.127130  5963 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:37.127287  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 320195us
W20260709 13:15:37.127290  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 328223us
I20260709 13:15:37.127485  5880 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:37.128916  5853 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:37.128484  5586 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:37.168435  5586 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:37.169117  5795 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.169612  5795 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:37.169911  3791 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
W20260709 13:15:37.171203  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.171600  5795 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:37.129318  3118 rpcz_store.cc:276] 0709 13:15:35.137624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.958641 (+821017us) service_pool.cc:224] Handling call
0709 13:15:36.810523 (+851882us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b5400216e54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303ad853 00007ff83537b60a 00007ff82e9017d4 00007ff82e901762 00007ff82e901691 00007ff82e90160c 00007ff82e9008c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:36.810672 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":758423296}
I20260709 13:15:37.152931  5398 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.172601  5398 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:37.126073  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 280662us
W20260709 13:15:37.175874  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.175915  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1618) took 2299 ms. Trace:
W20260709 13:15:37.128793  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.176481  3195 rpcz_store.cc:276] 0709 13:15:34.876872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.179911 (+1303039us) service_pool.cc:224] Handling call
0709 13:15:36.706024 (+526113us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:36.734602 (+ 28578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.175678 (+441076us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b5400037350. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:37.175843 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1208964992}
W20260709 13:15:37.176309  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.130694  3048 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:36.837720  5854 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.131673  3120 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:36.937834  5950 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.197819  5963 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:15:37.129964  3047 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
I20260709 13:15:37.049453  5803 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:37.206916  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:37.207945  3047 raft_consensus.cc:2393] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:37.133493  3798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 403) took 2523 ms. Trace:
I20260709 13:15:36.951006  3796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 427) took 2349 ms. Trace:
I20260709 13:15:37.133370  3117 raft_consensus.cc:2410] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:15:37.134645  3042 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:15:36.859366  5840 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:37.146761  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.131742  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:37.208320  3798 rpcz_store.cc:276] 0709 13:15:34.610449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.610595 (+   146us) service_pool.cc:224] Handling call
0709 13:15:34.724294 (+113699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:34.730163 (+  5869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.133306 (+2403143us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54005415d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:37.133440 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245233536}
I20260709 13:15:37.214100  3194 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:37.148183  5964 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.904933  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:37.127974  5898 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:37.155961  3090 leader_election.cc:336] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 1.621s (SENT)
I20260709 13:15:37.165897  5880 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:37.218300  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:36.906159  5897 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:36.876359  5892 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.005s	sys 0.000s
I20260709 13:15:37.132238  3051 rpcz_store.cc:276] 0709 13:15:35.280438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.280666 (+   228us) service_pool.cc:224] Handling call
0709 13:15:35.301303 (+ 20637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:35.301521 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:35.326670 (+ 25149us) log.cc:844] Serialized 14 byte log entry
0709 13:15:36.878118 (+1551448us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:36.878210 (+    92us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:36.878299 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.878426 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.880021 (+  1595us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":982847,"prepare.queue_time_us":31787,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":5385,"raft.queue_time_us":496005,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":3957,"thread_start_us":1083910,"threads_started":2,"wal-append.queue_time_us":1013441}
I20260709 13:15:37.128317  3126 rpcz_store.cc:276] 0709 13:15:35.168400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.198285 (+1029885us) service_pool.cc:224] Handling call
0709 13:15:36.198767 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:36.517701 (+318934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:36.517756 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:36.523303 (+  5547us) log.cc:844] Serialized 26 byte log entry
0709 13:15:36.656707 (+133404us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:36.656743 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.656826 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.809607 (+152781us) raft_consensus.cc:1685] finished
0709 13:15:36.809627 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.809877 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96256,"raft.queue_time_us":196333,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":23452,"thread_start_us":393763,"threads_started":2,"wal-append.queue_time_us":240602}
I20260709 13:15:37.173592  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2033) took 1893 ms. Trace:
I20260709 13:15:37.183754  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:37.184408  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 1.18654e+06us
W20260709 13:15:37.159734  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 309325us
I20260709 13:15:37.194892  5556 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:37.195753  5908 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:37.197081  5450 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:37.197435  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.198657  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1895) took 2461 ms. Trace:
I20260709 13:15:37.205539  5821 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:37.128734  3793 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:15:37.199573  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 335) took 1906 ms. Trace:
I20260709 13:15:37.208405  3796 rpcz_store.cc:276] 0709 13:15:34.601880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.602040 (+   160us) service_pool.cc:224] Handling call
0709 13:15:34.838578 (+236538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:34.927114 (+ 88536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.950588 (+2023474us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54004ba350. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:36.950808 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509016960}
I20260709 13:15:37.212598  3044 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:36.904426  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:37.220876  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:37.355984  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 200048us
I20260709 13:15:37.366323  3195 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:37.365600  3193 raft_consensus.cc:2393] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:37.131546  5841 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:37.131903  5793 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:37.365447  3197 rpcz_store.cc:276] 0709 13:15:34.736919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.202581 (+465662us) service_pool.cc:224] Handling call
0709 13:15:35.202930 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.529178 (+1326248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.198390 (+669212us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400177854. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:37.198587 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3041529728}
I20260709 13:15:37.125890  5952 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:37.374023  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:37.365881  3046 rpcz_store.cc:276] 0709 13:15:35.293328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.320039 (+ 26711us) service_pool.cc:224] Handling call
0709 13:15:35.347276 (+ 27237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:35.414667 (+ 67391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.199318 (+1784651us) spinlock_profiling.cc:243] Waited 66.7 ms on lock 0x7b54000c6f54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:37.199507 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153522944}
W20260709 13:15:37.374055  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.358088  5828 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:37.419641  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:37.213562  5840 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.203959  5750 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:37.198915  5990 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.450599  3200 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:37.453332  3195 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:37.456727  3048 raft_consensus.cc:2410] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:15:37.367834  5556 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.222596  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 336) took 1926 ms. Trace:
I20260709 13:15:37.201236  5950 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:37.428845  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.219619  5964 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:37.431435  3043 rpcz_store.cc:276] 0709 13:15:35.280114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.280274 (+   160us) service_pool.cc:224] Handling call
0709 13:15:35.280587 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:36.429167 (+1148580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.173257 (+744090us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54000f32d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:37.173519 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2639952640}
I20260709 13:15:37.467818  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:37.468076  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:37.468943  3043 raft_consensus.cc:2393] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:37.468984  3048 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:37.470474  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:37.471156  3048 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
W20260709 13:15:37.472054  3164 connection.cc:256] RPC call timeout handler was delayed by -1.3335411619998467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
W20260709 13:15:37.472868  3164 connection.cc:256] RPC call timeout handler was delayed by -1.3200411620000523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
W20260709 13:15:37.400664  5892 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.022s	sys 0.013s
I20260709 13:15:37.227444  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:37.442752  3126 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:15:37.484053  3126 pending_rounds.cc:85] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 2
I20260709 13:15:37.484447  3126 pending_rounds.cc:107] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:15:37.484769  3126 raft_consensus.cc:2889] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:37.444782  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:37.445459  5993 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
I20260709 13:15:37.359356  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:37.222280  5811 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:37.490710  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:37.502889  3043 raft_consensus.cc:2393] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:37.441780  5830 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:37.504002  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:37.368264  3165 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:37.416893  3793 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:37.367941  5897 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.231089  5902 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:37.359387  5580 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:37.462493  3049 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.044s	sys 0.027s
I20260709 13:15:37.458133  3050 rpcz_store.cc:276] 0709 13:15:35.296712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.377574 (+ 80862us) service_pool.cc:224] Handling call
0709 13:15:35.378078 (+   504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:35.904338 (+526260us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:35.975705 (+ 71367us) log.cc:844] Serialized 14 byte log entry
0709 13:15:36.670454 (+694749us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b1800346d80. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d240c0a 00007ff836980219 00007ff83428758f 00007ff82d2c6571 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd
0709 13:15:37.191788 (+521334us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:37.215388 (+ 23600us) log.cc:844] Serialized 26 byte log entry
0709 13:15:37.215556 (+   168us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:37.215589 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.215631 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:37.222328 (+  6697us) raft_consensus.cc:1685] finished
0709 13:15:37.222414 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:37.222544 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1023472,"prepare.queue_time_us":61560,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":1261268,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":13479,"spinlock_wait_cycles":46234240,"thread_start_us":424643,"threads_started":1,"wal-append.queue_time_us":537951}
I20260709 13:15:37.213409  5854 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:37.423115  5450 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:37.442210  5840 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:37.487371  3042 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:37.488822  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:37.870582  3049 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.199s	user 0.048s	sys 0.031s
I20260709 13:15:37.699132  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:37.871946  3046 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
W20260709 13:15:37.670650  3163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.019s	sys 0.031s
I20260709 13:15:37.504714  5958 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:15:37.873168  3163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.025s	sys 0.050s
I20260709 13:15:37.466830  5828 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.566265  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:37.874532  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.465974  5556 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:37.877301  3051 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
W20260709 13:15:37.789067  3089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.005s	sys 0.043s
W20260709 13:15:37.730525  3045 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.008s	sys 0.031s
W20260709 13:15:37.883891  3089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.008s	sys 0.051s
W20260709 13:15:37.883996  3045 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.019s	sys 0.038s
I20260709 13:15:37.602267  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:37.878391  3799 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:15:37.683472  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.505290  3164 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:37.876618  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:37.504729  3043 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:37.886220  3048 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:37.886899  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2043) took 1111 ms. Trace:
I20260709 13:15:37.609185  3091 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:37.566969  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:37.732822  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:37.889108  3122 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:37.466313  5750 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:37.887267  3048 rpcz_store.cc:276] 0709 13:15:36.775751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.489783 (+714032us) service_pool.cc:224] Handling call
0709 13:15:37.886832 (+397049us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:37.876720  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:37.894886  3125 raft_consensus.cc:2410] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:15:37.891068  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 281985us
W20260709 13:15:37.505216  5976 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:15:37.892385  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 524161us
I20260709 13:15:37.604681  5849 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.292s
W20260709 13:15:37.896401  3198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1887) took 3198 ms (client timeout 3077 ms). Trace:
W20260709 13:15:37.897054  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0013230310000836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
I20260709 13:15:37.906312  3091 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:37.912647  3199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.012s	sys 0.004s
W20260709 13:15:37.913182  3199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.012s	sys 0.004s
I20260709 13:15:37.815009  5929 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:37.832732  5993 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:15:37.897393  5901 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:37.790625  5934 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:37.813217  5804 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:37.897571  5902 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:37.464008  5990 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:37.898384  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:37.899194  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 393992us
I20260709 13:15:37.943382  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:37.899552  5908 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.899744  5898 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:37.900161  5994 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:37.892556  5828 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:37.901774  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:37.902583  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:37.482762  5880 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:37.903854  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:37.929579  5901 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.872195  5897 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:37.651297  5996 log.cc:927] Time spent T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:15:37.911007  3165 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:15:37.911566  3118 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.021s	sys 0.041s
I20260709 13:15:37.883123  5811 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.913277  3091 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:37.912393  3198 rpcz_store.cc:269] 0709 13:15:34.685067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.685795 (+   728us) service_pool.cc:224] Handling call
0709 13:15:37.883304 (+3197509us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b5400035054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:37.883511 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1195140992}
I20260709 13:15:37.963243  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:37.918453  5750 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:37.920274  5450 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:37.921507  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:37.971571  3042 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:15:37.931443  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:37.914791  5830 consensus_queue.cc:1059] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
W20260709 13:15:37.985850  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:37.932142  3194 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.009s	sys 0.005s
I20260709 13:15:37.933017  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:37.934036  3793 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
W20260709 13:15:37.990610  3194 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.009s	sys 0.005s
I20260709 13:15:37.932559  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 342) took 1082 ms. Trace:
I20260709 13:15:37.913470  5952 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:37.929272  5580 raft_consensus.cc:3055] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:37.953591  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1725) took 1504 ms. Trace:
I20260709 13:15:37.954794  3197 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:37.974287  5750 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.946230  5950 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:37.960781  3118 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.021s	sys 0.041s
I20260709 13:15:37.967283  5854 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:37.963866  3200 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:37.973697  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:37.977301  5934 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:37.873523  5958 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:38.019064  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:38.019937  3200 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:38.021057  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:38.021260  5958 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:37.990808  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:37.961325  5901 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:37.991190  3199 rpcz_store.cc:276] 0709 13:15:36.849873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.206988 (+357115us) service_pool.cc:224] Handling call
0709 13:15:37.207299 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:37.207543 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:37.207830 (+   287us) log.cc:844] Serialized 14 byte log entry
0709 13:15:37.929272 (+721442us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:37.929556 (+   284us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:37.929608 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.929675 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:37.932497 (+  2822us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":103,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":47411,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":8474,"thread_start_us":705463,"threads_started":1}
I20260709 13:15:38.017313  5934 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.050981  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:38.054093  3199 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:38.055265  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:38.056128  3199 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:15:38.042930  5854 raft_consensus.cc:3055] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:38.058121  5854 raft_consensus.cc:740] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:38.059279  5854 consensus_queue.cc:260] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:38.061141  5854 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:37.971863  5997 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.304s	user 0.002s	sys 0.000s
I20260709 13:15:37.998842  3043 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:38.064160  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:38.065001  3043 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:38.002731  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:38.065907  5941 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 2.657s	user 0.007s	sys 0.004s
I20260709 13:15:38.066818  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:38.067767  3197 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 3.
I20260709 13:15:38.068876  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:37.904302  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:38.070830  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:38.071406  5804 raft_consensus.cc:1064] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:15:38.071660  3193 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:38.072836  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:38.004259  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 343) took 1154 ms. Trace:
W20260709 13:15:38.000681  3120 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.011s	sys 0.021s
W20260709 13:15:37.963287  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 50107.1us
I20260709 13:15:37.950538  5908 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:38.065624  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 1721) took 1253 ms. Trace:
I20260709 13:15:38.073598  3193 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:37.950593  5902 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:38.011173  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 366) took 1240 ms. Trace:
I20260709 13:15:38.000864  3124 rpcz_store.cc:276] 0709 13:15:36.448961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.674248 (+225287us) service_pool.cc:224] Handling call
0709 13:15:36.674639 (+   391us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:36.676030 (+  1391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:36.676076 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:36.684002 (+  7926us) log.cc:844] Serialized 52 byte log entry
0709 13:15:36.801817 (+117815us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:36.838813 (+ 36996us) log.cc:844] Serialized 14 byte log entry
0709 13:15:37.089084 (+250271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.089203 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:37.953273 (+864070us) raft_consensus.cc:1685] finished
0709 13:15:37.953307 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:37.953509 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22037,"prepare.queue_time_us":153,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":39,"raft.queue_time_us":67064,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":10387,"thread_start_us":34298,"threads_started":1,"wal-append.queue_time_us":175937}
I20260709 13:15:38.014956  3042 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:38.083725  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:38.084515  3042 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:37.990810  3122 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:38.022082  6000 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:38.023021  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:38.024123  5995 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:38.024748  5450 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:38.015573  5898 raft_consensus.cc:2764] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:15:38.003494  5952 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:38.100265  5952 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:38.077642  5902 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:38.012349  5750 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:38.026139  3200 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:38.027254  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:38.029716  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:38.106727  3121 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:38.031980  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:38.107800  3047 raft_consensus.cc:2393] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:38.108428  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 1708) took 1385 ms. Trace:
I20260709 13:15:37.960757  5880 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:38.000782  5580 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:37.954784  5994 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:37.967263  5811 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:38.017730  5830 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:37.994333  3117 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.004s	sys 0.015s
I20260709 13:15:38.005100  5999 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:38.044026  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:38.131866  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 87934.2us
I20260709 13:15:38.132457  5892 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:38.133008  5892 raft_consensus.cc:697] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:15:38.057672  5398 consensus_meta.cc:287] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.885s	user 0.011s	sys 0.001s
I20260709 13:15:38.133855  5892 consensus_queue.cc:237] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:38.134152  5398 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:38.137262  5398 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:38.074486  3091 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:38.145197  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 70792.2us
W20260709 13:15:38.149258  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.074708  3197 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:38.076472  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:38.151069  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 1723) took 1338 ms. Trace:
I20260709 13:15:38.151553  3046 rpcz_store.cc:276] 0709 13:15:36.812856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.076220 (+1263364us) service_pool.cc:224] Handling call
0709 13:15:38.150983 (+ 74763us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.078152  3118 rpcz_store.cc:276] 0709 13:15:36.770546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.174268 (+403722us) service_pool.cc:224] Handling call
0709 13:15:37.174536 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:37.174705 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:37.194263 (+ 19558us) log.cc:844] Serialized 14 byte log entry
0709 13:15:38.010691 (+816428us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.010766 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:38.010834 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.010926 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.011100 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16454,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":255671,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":16998,"thread_start_us":816130,"threads_started":1}
W20260709 13:15:38.074119  3120 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.012s	sys 0.021s
I20260709 13:15:38.153623  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 367) took 1382 ms. Trace:
I20260709 13:15:38.155543  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:38.154254  3120 rpcz_store.cc:276] 0709 13:15:36.770865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.191484 (+420619us) service_pool.cc:224] Handling call
0709 13:15:37.233509 (+ 42025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:37.233776 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:37.401228 (+167452us) log.cc:844] Serialized 14 byte log entry
0709 13:15:38.153126 (+751898us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.153210 (+    84us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:38.153287 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.153387 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.153550 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":167731,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":488243,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":12710,"thread_start_us":751574,"threads_started":1}
I20260709 13:15:38.156235  3793 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:15:38.082852  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:38.075362  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:38.158854  3048 raft_consensus.cc:2410] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:15:38.073935  3194 rpcz_store.cc:276] 0709 13:15:36.850154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.214693 (+364539us) service_pool.cc:224] Handling call
0709 13:15:37.214986 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:37.215182 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:37.366521 (+151339us) log.cc:844] Serialized 14 byte log entry
0709 13:15:38.003868 (+637347us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.003932 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:38.003985 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.004068 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.004201 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12657,"prepare.queue_time_us":153172,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"thread_start_us":624287,"threads_started":1,"wal-append.queue_time_us":711786}
I20260709 13:15:38.086786  3762 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:15:38.160355  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 73651.7us
I20260709 13:15:38.096505  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:38.162359  3042 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:38.037683  5556 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:37.995460  3191 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.014s	sys 0.028s
I20260709 13:15:38.054857  5934 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:38.005401  3090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.011s	sys 0.004s
I20260709 13:15:38.105291  5952 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:38.076128  5908 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:38.123734  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:38.178079  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:38.123250  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:38.179513  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:38.180269  3794 raft_consensus.cc:2376] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7. Re-sending same reply.
I20260709 13:15:38.108841  3047 rpcz_store.cc:276] 0709 13:15:36.722740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.031628 (+1308888us) service_pool.cc:224] Handling call
0709 13:15:38.108359 (+ 76731us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.094837  6000 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:38.104498  5992 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:38.183930  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:38.184283  5992 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:38.184736  5992 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:38.128675  3117 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.004s	sys 0.015s
I20260709 13:15:38.057178  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:38.128427  5830 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:38.187283  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:55310 (request call id 8) took 3028 ms. Trace:
I20260709 13:15:38.187570  5830 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:38.187692  3123 rpcz_store.cc:276] 0709 13:15:35.154543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.400619 (+1246076us) service_pool.cc:224] Handling call
0709 13:15:38.173242 (+1772623us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54004777d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b9735 00007ff835379d29 00007ff82e8f81d4 00007ff82e8f8162 00007ff82e8f8091 00007ff82e8f800c 00007ff82e8f72c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:38.182439 (+  9197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":588533120}
I20260709 13:15:38.074672  3043 rpcz_store.cc:276] 0709 13:15:36.812375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.063804 (+1251429us) service_pool.cc:224] Handling call
0709 13:15:38.065548 (+  1744us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:38.153887  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.190390  3091 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:38.103397  3198 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:38.157439  3124 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 3.
W20260709 13:15:38.191641  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.165597  3762 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:38.168254  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47488 (request call id 344) took 1366 ms. Trace:
I20260709 13:15:38.192622  3048 rpcz_store.cc:276] 0709 13:15:36.801518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.075099 (+1273581us) service_pool.cc:224] Handling call
0709 13:15:38.168167 (+ 93068us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:38.169076  3191 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.015s	sys 0.028s
I20260709 13:15:38.193753  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 336) took 1347 ms. Trace:
I20260709 13:15:38.175869  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:38.195242  3042 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
W20260709 13:15:38.173213  3090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.012s	sys 0.004s
W20260709 13:15:38.196085  3090 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 1.760s (SENT) [suppressed 8 similar messages]
I20260709 13:15:38.170442  3120 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:38.172219  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:38.182960  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:38.073729  5804 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:38.171180  5998 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:15:38.219480  6004 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:38.183686  6000 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:38.185967  3199 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:38.221012  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 335) took 1375 ms. Trace:
I20260709 13:15:38.144327  3195 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:38.181668  5875 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:38.222235  5875 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.222652  5875 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:38.221431  3192 rpcz_store.cc:276] 0709 13:15:36.846120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.847308 (+  1188us) service_pool.cc:224] Handling call
0709 13:15:36.847843 (+   535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:37.079508 (+231665us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:37.079892 (+   384us) log.cc:844] Serialized 14 byte log entry
0709 13:15:37.213491 (+133599us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:37.248895 (+ 35404us) log.cc:844] Serialized 26 byte log entry
0709 13:15:37.249107 (+   212us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:37.249156 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.249263 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:38.220799 (+971536us) raft_consensus.cc:1685] finished
0709 13:15:38.220817 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.220955 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":794,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":8316,"raft.queue_time_us":298258,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":2476,"spinlock_wait_cycles":25728384,"thread_start_us":133139,"threads_started":1,"wal-append.queue_time_us":871637}
I20260709 13:15:38.169226  6005 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:38.223317  6005 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.223678  6005 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:38.198621  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:38.225390  3048 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:38.226533  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:38.227985  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:38.199752  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:38.200002  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:38.183105  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:38.229154  3043 raft_consensus.cc:2410] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:15:38.216053  3091 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:38.229557  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2042) took 1458 ms. Trace:
I20260709 13:15:38.229905  3043 rpcz_store.cc:276] 0709 13:15:36.771697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.199434 (+1427737us) service_pool.cc:224] Handling call
0709 13:15:38.229505 (+ 30071us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.230270  3091 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:38.230859  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:38.231119  3091 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:38.213393  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:38.220070  6004 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:38.217581  3762 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:38.229161  3047 raft_consensus.cc:2410] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:15:38.233132  3046 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:38.241935  3043 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:38.234687  3048 raft_consensus.cc:2410] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 9 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:38.202539  3799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 407) took 1689 ms. Trace:
I20260709 13:15:38.242583  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:38.245707  3799 rpcz_store.cc:276] 0709 13:15:36.513174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.514184 (+  1010us) service_pool.cc:224] Handling call
0709 13:15:36.523596 (+  9412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:37.892047 (+1368451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.202284 (+310237us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400622854. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:38.202484 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3114975488}
I20260709 13:15:38.226974  3795 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 7: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:38.242674  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 1711) took 1479 ms. Trace:
I20260709 13:15:38.249367  3047 rpcz_store.cc:276] 0709 13:15:36.763278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.199771 (+1436493us) service_pool.cc:224] Handling call
0709 13:15:38.242611 (+ 42840us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:38.233171  5964 consensus_meta.cc:287] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.733s	user 0.005s	sys 0.006s
I20260709 13:15:38.218396  5398 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:38.194075  3191 rpcz_store.cc:276] 0709 13:15:36.846471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.846976 (+   505us) service_pool.cc:224] Handling call
0709 13:15:36.904634 (+ 57658us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:37.154348 (+249714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:37.154396 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:37.211659 (+ 57263us) log.cc:844] Serialized 52 byte log entry
0709 13:15:38.193412 (+981753us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:38.193451 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.193516 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:38.193556 (+    40us) raft_consensus.cc:1685] finished
0709 13:15:38.193566 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.193686 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":250491,"raft.queue_time_us":254578,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":789304,"threads_started":1,"wal-append.queue_time_us":924380}
I20260709 13:15:38.251282  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1706) took 1529 ms. Trace:
I20260709 13:15:38.242323  6004 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:38.242846  5958 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.267555  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:38.235669  5843 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:38.243109  5580 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:38.247188  5952 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:38.280781  5580 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:38.259455  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 1726) took 1445 ms. Trace:
I20260709 13:15:38.206620  5999 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.200644  5990 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:38.226828  5828 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:38.262161  3043 rpcz_store.cc:276] 0709 13:15:36.722233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.250385 (+1528152us) service_pool.cc:224] Handling call
0709 13:15:38.250671 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.250870 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.250909 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.250967 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:38.251013 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.251084 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.251216 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.291034  3043 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:15:38.291687  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1713) took 1517 ms. Trace:
I20260709 13:15:38.252175  3046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0940cf459a7741b58bd85191d095a404"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:15:38.293087  3046 raft_consensus.cc:606] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:38.293466  3046 raft_consensus.cc:614] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:38.247741  5870 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:38.236066  6001 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:38.247601  5767 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:38.276710  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.261502  5964 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:38.263237  5398 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.292026  3043 rpcz_store.cc:276] 0709 13:15:36.774210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.290472 (+1516262us) service_pool.cc:224] Handling call
0709 13:15:38.290810 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:38.291407 (+   597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.291631 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:38.312646  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 369361us
I20260709 13:15:38.299386  3046 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:38.289510  5952 raft_consensus.cc:697] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:38.286795  3048 rpcz_store.cc:276] 0709 13:15:36.813728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.227687 (+1413959us) service_pool.cc:224] Handling call
0709 13:15:38.259371 (+ 31684us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.313704  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2044) took 1534 ms. Trace:
W20260709 13:15:38.309324  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.318859  3046 rpcz_store.cc:276] 0709 13:15:36.779343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.298892 (+1519549us) service_pool.cc:224] Handling call
0709 13:15:38.299214 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.313468 (+ 14254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.313652 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:38.319785  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.322156  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 342) took 1524 ms. Trace:
I20260709 13:15:38.316876  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:38.284978  5901 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:38.301390  6001 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.278713  5958 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:38.322746  3048 rpcz_store.cc:276] 0709 13:15:36.798093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.321003 (+1522910us) service_pool.cc:224] Handling call
0709 13:15:38.321424 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.321659 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.321700 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.321788 (+    88us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:38.321847 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.321934 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.322082 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.340592  3048 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:38.314870  3164 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:38.315290  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 404324us
I20260709 13:15:38.342247  3042 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:38.343122  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 345) took 1541 ms. Trace:
I20260709 13:15:38.342996  3165 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:38.315533  3199 raft_consensus.cc:2410] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:38.301265  5870 raft_consensus.cc:697] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:38.341464  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 343) took 1540 ms. Trace:
I20260709 13:15:38.344519  3091 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:38.351334  3048 rpcz_store.cc:276] 0709 13:15:36.801171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.339882 (+1538711us) service_pool.cc:224] Handling call
0709 13:15:38.340326 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.341098 (+   772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.341387 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.343673  3042 rpcz_store.cc:276] 0709 13:15:36.801847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.341432 (+1539585us) service_pool.cc:224] Handling call
0709 13:15:38.341814 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.342793 (+   979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.343053 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.313973  5398 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:38.349560  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 337) took 3027 ms. Trace:
I20260709 13:15:38.354266  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1717) took 1543 ms. Trace:
I20260709 13:15:38.352142  3091 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:38.356034  3048 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:15:38.357059  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1716) took 1546 ms. Trace:
I20260709 13:15:38.358371  3165 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:38.360339  3165 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:15:38.360332  3044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2038) took 1622 ms (client timeout 1636 ms). Trace:
W20260709 13:15:38.361122  3044 rpcz_store.cc:269] 0709 13:15:36.738319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.742075 (+  3756us) service_pool.cc:224] Handling call
0709 13:15:38.360153 (+1618078us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54001f6654. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:38.360278 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1031842048}
I20260709 13:15:38.289341  5999 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:38.355791  3045 rpcz_store.cc:276] 0709 13:15:35.301911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.391163 (+ 89252us) service_pool.cc:224] Handling call
0709 13:15:35.409601 (+ 18438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:35.414056 (+  4455us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:35.949665 (+535609us) log.cc:844] Serialized 14 byte log entry
0709 13:15:37.884585 (+1934920us) log.cc:844] Serialized 14 byte log entry
0709 13:15:38.328663 (+444078us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.328720 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:38.328776 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.328870 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.328996 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1184987,"prepare.queue_time_us":1341888,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":95,"raft.queue_time_us":695396,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":15496,"thread_start_us":1682517,"threads_started":3,"wal-append.queue_time_us":600744,"wal-append.run_cpu_time_us":1076,"wal-append.run_wall_time_us":1037489}
I20260709 13:15:38.357563  3048 rpcz_store.cc:276] 0709 13:15:36.810898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.352654 (+1541756us) service_pool.cc:224] Handling call
0709 13:15:38.353102 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.356688 (+  3586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.356983 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.298120  5840 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:38.365204  3761 leader_election.cc:336] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 1.639s (SENT)
I20260709 13:15:38.379570  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:38.380700  3121 raft_consensus.cc:2393] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:38.365916  3042 rpcz_store.cc:276] 0709 13:15:36.811282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.352994 (+1541712us) service_pool.cc:224] Handling call
0709 13:15:38.353703 (+   709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.353888 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.353913 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.353954 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:38.354001 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.354075 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.354203 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.324378  3799 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:38.372848  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1727) took 1542 ms. Trace:
I20260709 13:15:38.361397  3165 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:38.383829  3048 rpcz_store.cc:276] 0709 13:15:36.830975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.371941 (+1540966us) service_pool.cc:224] Handling call
0709 13:15:38.372289 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.372486 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.372515 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.372564 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:38.372605 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.372669 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.372787 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.373579  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:38.374782  3091 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:38.358456  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:38.375533  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:38.385437  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:38.385957  3123 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:38.355732  6007 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
W20260709 13:15:38.508131  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 150819us
I20260709 13:15:38.508926  3091 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:38.509044  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:38.442082  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:38.510161  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:38.466296  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.510951  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 349) took 1297 ms. Trace:
I20260709 13:15:38.512919  3048 rpcz_store.cc:276] 0709 13:15:37.213128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.509871 (+1296743us) service_pool.cc:224] Handling call
0709 13:15:38.510167 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.510512 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.510540 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.510583 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:38.510617 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.510675 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.510898 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.338639  6001 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:38.374087  5854 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:38.515506  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:38.515574  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:38.532290  3119 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 5: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:38.534173  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:38.546257  3122 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:38.542515  3123 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:15:38.378598  5843 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:38.378794  5828 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:38.377221  5750 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:38.551086  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:38.545912  2997 auto_rebalancer.cc:893] Removing replace marker failed: Replica f20672b2852447a6bc1e137c4dd40904 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
W20260709 13:15:38.631021  2997 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:15:38.548388  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:38.379096  5898 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:38.550465  5556 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:38.377668  5853 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.617929  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:38.632686  3122 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:38.617120  5994 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:38.611690  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.373206  5891 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.177s
I20260709 13:15:38.373342  5950 consensus_queue.cc:1059] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.178s
I20260709 13:15:38.515728  5811 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:38.603786  3121 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:15:38.535916  5880 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:38.547489  5908 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.581401  5828 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.638307  3118 raft_consensus.cc:2368] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 7. Current term is 8.
I20260709 13:15:38.635563  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:38.651324  3123 raft_consensus.cc:2410] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:15:38.631481  2997 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:15:38.550163  5854 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.584224  5843 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:38.641848  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:38.661572  3121 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 2.
I20260709 13:15:38.662842  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:38.628521  5808 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:38.634653  5988 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 1.873s	user 0.005s	sys 0.005s
I20260709 13:15:38.666373  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:38.667174  3015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.061s	sys 0.088s
I20260709 13:15:38.689493  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:38.692494  3122 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:38.693799  3015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.062s	sys 0.088s
I20260709 13:15:38.628261  6014 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:38.694842  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 671816us
I20260709 13:15:38.657123  5908 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:38.635869  5898 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:38.704384  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:38.705276  3123 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:38.706251  3123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:15:38.706938  3123 raft_consensus.cc:606] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:38.707321  3123 raft_consensus.cc:614] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:38.647763  5994 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:38.634127  6013 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:38.634368  6011 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:38.657258  5828 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:38.660498  5854 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:38.722178  3090 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.015s	sys 0.068s
I20260709 13:15:38.688541  5843 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:38.660095  5963 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:38.726575  3090 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.015s	sys 0.068s
W20260709 13:15:38.739938  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 543822us
I20260709 13:15:38.691097  5808 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.690622  5580 raft_consensus.cc:3055] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:38.720353  5898 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:38.745532  5964 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:38.749476  5964 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.750038  5964 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:38.752636  5964 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:38.753801  3049 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.000s	sys 0.008s
I20260709 13:15:38.643126  5853 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:38.702095  6014 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.724143  6013 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.699734  5908 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:38.722600  5556 consensus_queue.cc:1059] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:15:38.712200  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:15:38.728511  5765 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.024s	sys 0.060s
I20260709 13:15:38.742455  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:38.767932  3123 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:38.769066  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:38.754372  3049 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.000s	sys 0.008s
I20260709 13:15:38.723574  5994 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:38.761489  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 49364.2us
I20260709 13:15:38.724318  6011 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:38.772678  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:38.774770  3122 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:38.745864  5808 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:38.739012  5963 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:38.780680  3050 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:15:38.746271  5580 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:38.785547  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:38.726686  5995 consensus_queue.cc:1059] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:15:38.801482  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 368) took 2030 ms. Trace:
I20260709 13:15:38.780656  5840 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:38.790818  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2054) took 1281 ms. Trace:
I20260709 13:15:38.804679  3050 rpcz_store.cc:276] 0709 13:15:37.509659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.779980 (+1270321us) service_pool.cc:224] Handling call
0709 13:15:38.780332 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.790461 (+ 10129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.790744 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.782722  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:38.774497  5765 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.025s	sys 0.060s
I20260709 13:15:38.771613  5811 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:38.813908  5811 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.814342  5811 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:38.816710  3796 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
W20260709 13:15:38.813835  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.820222  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1712) took 2052 ms. Trace:
W20260709 13:15:38.820447  6012 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:15:38.820689  3047 rpcz_store.cc:276] 0709 13:15:36.767844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.253108 (+1485264us) service_pool.cc:224] Handling call
0709 13:15:38.253446 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:38.253812 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:15:38.253840 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:38.254415 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:15:38.753770 (+499355us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:38.755364 (+  1594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.755446 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:38.819962 (+ 64516us) raft_consensus.cc:1685] finished
0709 13:15:38.819988 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.820161 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1180,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":84,"thread_start_us":498943,"threads_started":1,"wal-append.queue_time_us":563442}
I20260709 13:15:38.822516  3047 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:15:38.823148  3047 raft_consensus.cc:606] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:38.823540  3047 raft_consensus.cc:614] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:15:38.823622  5992 consensus_meta.cc:287] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.625s	user 0.009s	sys 0.000s
I20260709 13:15:38.824131  5811 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:38.802147  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 293275us
I20260709 13:15:38.745707  5880 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:38.753194  5964 consensus_queue.cc:1059] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:15:38.805449  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:38.776360  5994 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:38.770123  6013 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:38.768625  6014 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:38.809135  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 450689us
I20260709 13:15:38.811266  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:38.877904  3122 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:38.694825  5952 consensus_queue.cc:237] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:38.813287  3123 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:38.781603  5901 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:38.826594  3047 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:38.778820  6011 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:38.808001  3117 rpcz_store.cc:276] 0709 13:15:36.771142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.218487 (+447345us) service_pool.cc:224] Handling call
0709 13:15:37.369459 (+150972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:37.369695 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:38.185365 (+815670us) log.cc:844] Serialized 14 byte log entry
0709 13:15:38.801111 (+615746us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.801167 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:38.801215 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.801282 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.801417 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32258,"prepare.queue_time_us":74517,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":127163,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":87,"thread_start_us":1359205,"threads_started":3,"wal-append.queue_time_us":621044}
I20260709 13:15:38.799361  5963 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:38.824129  5992 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:38.873440  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:38.887995  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.838263  5958 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:38.892769  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 373767us
I20260709 13:15:38.893801  3122 raft_consensus.cc:2410] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:15:38.777096  5775 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:38.660550  5870 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:38.874723  3043 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.012s	sys 0.004s
W20260709 13:15:38.898532  3043 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.012s	sys 0.004s
I20260709 13:15:38.894558  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:38.896785  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.882761  5909 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:15:38.901753  5909 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:38.903559  5909 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:15:38.887930  3165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.003s	sys 0.013s
W20260709 13:15:38.904904  3165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.003s	sys 0.013s
I20260709 13:15:38.893582  5750 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:38.905544  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 544192us
I20260709 13:15:38.906268  5750 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.906644  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:38.906760  5750 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:38.907301  3048 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:38.908396  3165 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:38.908957  5750 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:38.909863  3165 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:15:38.911602  5934 consensus_meta.cc:287] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.725s	user 0.004s	sys 0.004s
I20260709 13:15:38.912093  5934 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:38.911645  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:38.914686  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:38.915448  5992 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:38.915829  3042 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:38.884020  5999 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:38.872036  5840 consensus_queue.cc:1059] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:15:38.920876  3047 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:38.927492  3761 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.001s	sys 0.022s
W20260709 13:15:38.931115  3761 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.002s	sys 0.022s
I20260709 13:15:38.877997  5880 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:38.931749  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 538659us
W20260709 13:15:38.932380  3046 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.010s	sys 0.015s
W20260709 13:15:38.933965  3046 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.010s	sys 0.015s
I20260709 13:15:38.916312  5811 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:38.917208  5958 raft_consensus.cc:3055] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:38.938836  3048 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:38.940610  3091 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:38.942102  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:38.942988  3048 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:38.944389  3091 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:38.946115  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:38.950547  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:38.953246  3051 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:38.965708  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 341) took 2181 ms. Trace:
I20260709 13:15:38.969154  3046 rpcz_store.cc:276] 0709 13:15:36.784302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.320023 (+1535721us) service_pool.cc:224] Handling call
0709 13:15:38.349120 (+ 29097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.349376 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:38.354371 (+  4995us) log.cc:844] Serialized 14 byte log entry
0709 13:15:38.934449 (+580078us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.934520 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:38.934589 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.965495 (+ 30906us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.965639 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4588,"prepare.queue_time_us":5276,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"thread_start_us":579671,"threads_started":1}
W20260709 13:15:38.966210  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.976668  3048 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:38.916965  5901 consensus_queue.cc:1059] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:15:38.916930  5775 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:38.935901  5999 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:38.890143  5580 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:38.935637  5556 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:38.953892  5750 raft_consensus.cc:3055] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:38.923292  5858 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:15:39.000926  5992 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:38.997907  6027 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:38.953718  5958 raft_consensus.cc:740] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:38.983289  5840 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:39.007727  5908 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:39.013839  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 271898us
I20260709 13:15:39.036604  3090 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:39.009533  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:39.009877  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 204492us
I20260709 13:15:39.037933  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:39.039386  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:39.053701  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:39.010293  5750 raft_consensus.cc:740] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:15:39.061216  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 124980us
I20260709 13:15:39.079175  5750 consensus_queue.cc:260] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:39.080140  6017 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:15:39.035754  6027 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.021777  5580 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:39.010761  5827 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:39.020478  6031 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:39.028553  6025 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:39.004140  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 112235us
I20260709 13:15:39.099890  3046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:15:39.024288  5992 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:39.111547  5992 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:39.112658  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:39.113117  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:39.113415  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:39.114701  6004 consensus_meta.cc:287] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.836s	user 0.010s	sys 0.000s
I20260709 13:15:39.117601  6004 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:39.104518  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 68016.2us
I20260709 13:15:39.109965  6031 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:39.066479  6024 consensus_queue.cc:1059] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:15:39.110890  5827 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:39.111063  5990 raft_consensus.cc:3055] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:39.102639  6025 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.116830  5908 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:39.103713  3164 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:39.119609  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2053) took 1637 ms. Trace:
I20260709 13:15:39.104352  3046 raft_consensus.cc:606] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 6 LEADER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:39.123687  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 346) took 2307 ms. Trace:
I20260709 13:15:39.099650  6027 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:39.161270  3090 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:39.126223  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.103325  5750 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:39.129211  3047 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:39.100912  6040 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:39.178211  3091 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:39.169589  3045 rpcz_store.cc:276] 0709 13:15:37.481792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.547199 (+1065407us) service_pool.cc:224] Handling call
0709 13:15:38.622532 (+ 75333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:38.623007 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:38.623046 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:38.623644 (+   598us) log.cc:844] Serialized 26 byte log entry
0709 13:15:38.961610 (+337966us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:38.961670 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.961797 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:39.119321 (+157524us) raft_consensus.cc:1685] finished
0709 13:15:39.119349 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.119533 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3972,"raft.queue_time_us":6867,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":8102,"thread_start_us":292859,"threads_started":1,"wal-append.queue_time_us":441970}
W20260709 13:15:39.182605  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 78966.9us
I20260709 13:15:39.183673  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:39.166920  5995 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:39.125911  5853 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:39.187700  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 340) took 2407 ms. Trace:
I20260709 13:15:39.126674  6038 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:39.172381  5908 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:39.166827  5990 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:39.179699  5840 raft_consensus.cc:697] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:39.170439  6025 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:39.180248  6000 consensus_meta.cc:287] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.956s	user 0.016s	sys 0.000s
I20260709 13:15:39.192902  3043 rpcz_store.cc:276] 0709 13:15:36.780577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.312622 (+1532045us) service_pool.cc:224] Handling call
0709 13:15:38.312924 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.313119 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:38.325948 (+ 12829us) log.cc:844] Serialized 14 byte log entry
0709 13:15:39.102987 (+777039us) log.cc:844] Serialized 14 byte log entry
0709 13:15:39.187211 (+ 84224us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:39.187282 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:39.187355 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.187498 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.187629 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21304,"prepare.queue_time_us":42049,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":88,"raft.queue_time_us":160635,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":2370,"spinlock_wait_cycles":5026048,"thread_start_us":838887,"threads_started":3,"wal-append.queue_time_us":847955}
I20260709 13:15:39.100531  5999 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:15:39.198204  3090 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:39.179303  6040 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:39.216167  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:39.213224  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 131676us
I20260709 13:15:39.188762  6033 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:39.190791  5827 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:39.190428  5995 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.120996  5958 consensus_queue.cc:260] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:39.220060  3090 connection.cc:256] RPC call timeout handler was delayed by -2.2339949730001081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
I20260709 13:15:39.219892  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:39.233898  3090 connection.cc:256] RPC call timeout handler was delayed by -2.2060259300001235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30770000000000003s for a response
W20260709 13:15:39.220744  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 222106us
W20260709 13:15:39.234529  3090 connection.cc:256] RPC call timeout handler was delayed by -1.5144848679999541s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 13:15:39.234848  3090 connection.cc:256] RPC call timeout handler was delayed by -1.4910848679999162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 13:15:39.235278  3090 connection.cc:256] RPC call timeout handler was delayed by -1.3029848680000669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 13:15:39.235564  3090 connection.cc:256] RPC call timeout handler was delayed by -1.2246848679999403s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260709 13:15:39.235831  3090 connection.cc:256] RPC call timeout handler was delayed by -1.0895876550000594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
W20260709 13:15:39.236143  3090 connection.cc:256] RPC call timeout handler was delayed by -1.0823876550000477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
W20260709 13:15:39.236402  3090 connection.cc:256] RPC call timeout handler was delayed by -1.0725848679999217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
W20260709 13:15:39.236660  3090 connection.cc:256] RPC call timeout handler was delayed by -1.0346876549999706s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
I20260709 13:15:39.239040  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.239864  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.240083  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.240455  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.196699  6038 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.241899  6038 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:39.242238  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.245563  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.246392  3196 raft_consensus.cc:2393] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:39.199968  5794 raft_consensus.cc:3055] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:39.246685  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.246850  5794 raft_consensus.cc:740] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:39.247375  3200 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:39.247797  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.247872  5794 consensus_queue.cc:260] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:39.248903  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.230896  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.250038  3192 raft_consensus.cc:2410] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:39.250887  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:39.231289  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:39.248647  3196 raft_consensus.cc:2410] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:15:39.253034  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.253705  3196 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:39.254647  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.255810  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.256562  3196 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:39.246142  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.258533  3199 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:39.259434  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.260620  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:39.261379  3199 raft_consensus.cc:2393] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:39.262624  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.263300  3197 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:39.264271  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:39.207902  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 154291us
I20260709 13:15:39.266927  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:39.272809  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.275187  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.276176  3199 raft_consensus.cc:2393] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:39.277096  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.249343  5794 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:39.265398  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.277498  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:39.282378  3197 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 3.
I20260709 13:15:39.283408  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:39.284685  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.285390  3197 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:39.286342  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.257386  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.293975  3792 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEARNER]: Advancing to term 8
I20260709 13:15:39.294083  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:15:39.294804  5830 consensus_meta.cc:287] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.107s	user 0.011s	sys 0.000s
I20260709 13:15:39.310066  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:15:39.297194  6001 consensus_meta.cc:287] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.716s	user 0.006s	sys 0.004s
I20260709 13:15:39.213950  5880 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:39.305251  3199 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:39.232784  5995 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:39.306277  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:39.306713  6035 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 13:15:39.306838  5767 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:39.307493  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.214100  6042 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:39.311280  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 352) took 1065 ms. Trace:
W20260709 13:15:39.315547  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 131985us
I20260709 13:15:39.336828  3047 rpcz_store.cc:276] 0709 13:15:38.246036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.186537 (+940501us) service_pool.cc:224] Handling call
0709 13:15:39.202177 (+ 15640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:39.202375 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:39.209675 (+  7300us) log.cc:844] Serialized 14 byte log entry
0709 13:15:39.310929 (+101254us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:39.310981 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:39.311029 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.311104 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.311224 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8535,"prepare.queue_time_us":1723,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":1974,"raft.queue_time_us":8730,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":10889,"thread_start_us":91795,"threads_started":1,"wal-append.queue_time_us":96107}
I20260709 13:15:39.315974  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:39.340276  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:39.227448  5901 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:39.216290  6040 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:39.323477  3195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1625) took 1422 ms (client timeout 1595 ms). Trace:
W20260709 13:15:39.342213  3195 rpcz_store.cc:269] 0709 13:15:37.901357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.902313 (+   956us) service_pool.cc:224] Handling call
0709 13:15:39.323227 (+1420914us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54001de054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:39.323397 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438847360}
I20260709 13:15:39.343422  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.344795  3195 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:39.212975  6000 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:39.341466  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:39.349310  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.328122  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.351471  3197 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:39.351589  3195 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:15:39.313194  6043 raft_consensus.cc:2764] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:15:39.324388  6050 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:39.312788  5990 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:39.365283  6016 raft_consensus.cc:3055] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:39.365760  6016 raft_consensus.cc:740] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:15:39.369194  5808 consensus_meta.cc:287] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.002s
W20260709 13:15:39.363139  5897 consensus_meta.cc:287] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.391s	user 0.013s	sys 0.005s
I20260709 13:15:39.370126  5793 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:39.370195  5897 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:39.373127  5897 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:39.363420  6050 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.374450  6050 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:39.374691  6034 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 13:15:39.334436  5840 consensus_queue.cc:237] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:39.349104  5811 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:39.378799  5811 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.379176  5811 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:39.380128  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:39.380602  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.365316  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:39.381294  3796 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 434) took 1225 ms (client timeout 1524 ms). Trace:
I20260709 13:15:39.381630  3047 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 9: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:15:39.381697  3796 rpcz_store.cc:269] 0709 13:15:38.155447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.157056 (+  1609us) service_pool.cc:224] Handling call
0709 13:15:39.381122 (+1224066us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54005c0dd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:39.381237 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1083279232}
I20260709 13:15:39.382141  3125 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:39.380769  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 1732) took 1983 ms. Trace:
I20260709 13:15:39.384594  3119 rpcz_store.cc:276] 0709 13:15:37.397607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.026917 (+629310us) service_pool.cc:224] Handling call
0709 13:15:39.380564 (+1353647us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b5400319554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:39.380711 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":979141888}
I20260709 13:15:39.386174  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2055) took 1815 ms. Trace:
I20260709 13:15:39.386642  3050 rpcz_store.cc:276] 0709 13:15:37.570403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.805501 (+1235098us) service_pool.cc:224] Handling call
0709 13:15:38.806343 (+   842us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:38.827037 (+ 20694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.827068 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:38.827553 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:15:39.000400 (+172847us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:39.000438 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.000512 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:39.385822 (+385310us) raft_consensus.cc:1685] finished
0709 13:15:39.385851 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.386095 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30452,"raft.queue_time_us":123207,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":19430,"thread_start_us":172561,"threads_started":1,"wal-append.queue_time_us":237980}
I20260709 13:15:39.388923  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:39.392014  5990 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:39.396704  3050 raft_consensus.cc:2393] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:39.348711  5901 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.354523  3198 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:15:39.330339  5934 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:39.359072  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:39.331073  6033 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:39.318136  5830 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:39.354161  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 71159.7us
I20260709 13:15:39.417255  3165 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:39.396763  3120 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:39.348398  6049 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:39.324981  6001 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:39.379520  6013 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:39.413213  5994 consensus_meta.cc:287] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.528s	user 0.003s	sys 0.014s
W20260709 13:15:39.425657  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 66692.7us
W20260709 13:15:39.426316  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 147764us
I20260709 13:15:39.406159  6043 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:39.438501  3164 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:39.416744  6022 log.cc:927] Time spent T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.214s	user 0.002s	sys 0.000s
I20260709 13:15:39.411656  5901 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:39.436838  3090 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:39.369665  5808 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:39.468299  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:39.469329  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:39.470377  3121 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:39.355578  6038 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:39.425254  5793 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:39.459108  5828 consensus_meta.cc:287] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.007s
I20260709 13:15:39.482590  3199 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:39.485625  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:39.414091  5897 consensus_queue.cc:1059] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 13:15:39.495432  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 154019us
I20260709 13:15:39.441105  6048 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:39.441799  6043 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:39.458467  5999 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:39.499838  3090 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:39.506557  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:39.540692  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 81394.4us
W20260709 13:15:39.506714  6041 log.cc:927] Time spent T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.285s	user 0.000s	sys 0.002s
W20260709 13:15:39.521389  6022 log.cc:927] Time spent T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:15:39.544960  3164 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:39.502936  3191 raft_consensus.cc:2368] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4.
I20260709 13:15:39.471449  5952 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:39.508554  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:39.546778  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:39.547734  5934 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:39.546720  3164 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:39.548199  5934 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:39.459753  5994 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:39.548784  5934 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:39.498483  6029 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:39.553045  3118 pending_rounds.cc:85] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 6
I20260709 13:15:39.553354  3118 pending_rounds.cc:107] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:15:39.553627  3118 raft_consensus.cc:2889] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:39.550204  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 50488.2us
I20260709 13:15:39.556057  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:39.529168  5897 consensus_queue.cc:1243] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:39.501350  6058 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:39.548130  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:39.550551  3164 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:39.562846  3090 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:39.538622  6048 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.500352  5828 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:39.535100  6031 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:39.566393  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:39.548534  6051 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:39.540591  6043 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:39.434370  6016 consensus_queue.cc:260] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:39.549870  6049 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:39.611344  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 60867.8us
I20260709 13:15:39.629511  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:39.608763  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:39.630728  5994 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:39.631796  3090 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:39.632961  5840 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:39.633369  5840 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.633728  5840 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:39.556563  5870 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:39.636401  5870 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:39.636960  5870 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.637455  5870 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:39.562264  5880 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:39.562765  6000 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:39.645756  3193 raft_consensus.cc:2368] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 7. Current term is 8.
I20260709 13:15:39.568620  5897 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:39.650395  3090 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:39.601657  5929 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:39.664700  3164 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:39.666962  6068 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:39.667588  6068 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:39.667721  6062 log.cc:927] Time spent T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:15:39.668058  6068 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:39.669795  6053 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
W20260709 13:15:39.672166  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:39.672873  6056 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:15:39.675256  5775 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:39.679201  6067 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:15:39.679982  5580 consensus_meta.cc:287] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.578s	user 0.002s	sys 0.006s
I20260709 13:15:39.565907  5999 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:15:39.680869  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:39.681684  6051 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:39.683534  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:39.684424  5854 consensus_meta.cc:287] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.938s	user 0.009s	sys 0.000s
I20260709 13:15:39.602097  6048 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:39.688979  3164 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:39.695708  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:39.693531  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:39.685030  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:39.703475  5750 consensus_meta.cc:287] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.000s
W20260709 13:15:39.707043  5398 consensus_meta.cc:287] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.321s	user 0.004s	sys 0.008s
I20260709 13:15:39.707114  5808 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:39.687726  6061 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:15:39.714295  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:39.714448  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 64160.7us
I20260709 13:15:39.643837  6055 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:39.659631  6046 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:39.657115  5880 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.665998  3791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 559) took 2298 ms. Trace:
I20260709 13:15:39.723129  3090 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:39.687242  6051 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:39.704118  6014 consensus_meta.cc:287] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.817s	user 0.016s	sys 0.000s
I20260709 13:15:39.731763  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:39.704118  5963 consensus_meta.cc:287] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.808s	user 0.011s	sys 0.001s
I20260709 13:15:39.733333  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:39.694500  6013 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:39.734259  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:39.643718  6057 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:39.663172  5897 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:15:39.707901  6005 consensus_meta.cc:287] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.482s	user 0.015s	sys 0.001s
I20260709 13:15:39.703737  6016 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:39.739761  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:39.685022  5854 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:39.740622  5750 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:39.741569  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:39.741057  5793 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:39.723160  5875 consensus_meta.cc:287] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.500s	user 0.011s	sys 0.004s
W20260709 13:15:39.728145  6011 consensus_meta.cc:287] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.830s	user 0.009s	sys 0.007s
I20260709 13:15:39.740232  6058 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:39.729887  5880 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:39.760504  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:39.765508  6001 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:39.713385  5398 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:39.730053  3791 rpcz_store.cc:276] 0709 13:15:37.358531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.358706 (+   175us) service_pool.cc:224] Handling call
0709 13:15:37.359183 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:37.445423 (+ 86240us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:38.037480 (+592057us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b1800344e00. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c3455 00007ff833dab3c7 00007ff8303bd9a7 00007ff8303cd0bf 00007ff8303cd038
0709 13:15:38.375901 (+338421us) log.cc:844] Serialized 14 byte log entry
0709 13:15:39.001627 (+625726us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:39.114852 (+113225us) log.cc:844] Serialized 26 byte log entry
0709 13:15:39.115317 (+   465us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:39.115393 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.115539 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:39.502990 (+387451us) raft_consensus.cc:1685] finished
0709 13:15:39.621848 (+118858us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.657068 (+ 35220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85954,"prepare.queue_time_us":737585,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":110521,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":14335,"spinlock_wait_cycles":28871936,"thread_start_us":549073,"threads_started":2,"wal-append.queue_time_us":468697}
I20260709 13:15:39.739213  5999 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:39.777628  3797 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:15:39.741305  5843 consensus_meta.cc:287] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.003s	user 0.010s	sys 0.001s
I20260709 13:15:39.791837  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:39.792892  3046 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
W20260709 13:15:39.794505  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.736892  5952 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.170259  3044 rpcz_store.cc:276] 0709 13:15:36.816007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.362645 (+1546638us) service_pool.cc:224] Handling call
0709 13:15:38.362939 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.363153 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:38.836213 (+473060us) log.cc:844] Serialized 14 byte log entry
0709 13:15:39.011458 (+175245us) log.cc:844] Serialized 14 byte log entry
0709 13:15:39.123346 (+111888us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:39.123399 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:39.123447 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.123507 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.123633 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131565,"prepare.queue_time_us":172539,"prepare.run_cpu_time_us":134,"prepare.run_wall_time_us":2822,"raft.queue_time_us":206658,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":25137,"thread_start_us":571826,"threads_started":2,"wal-append.queue_time_us":242729}
W20260709 13:15:39.880826  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 323081us
I20260709 13:15:39.736544  6000 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:39.885013  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 263567us
I20260709 13:15:39.776134  6033 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:39.753116  5897 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:39.886943  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:39.892045  3196 raft_consensus.cc:2393] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:39.888454  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:39.893863  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:39.703770  6068 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:39.894487  3794 raft_consensus.cc:2393] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:39.894114  6033 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.897593  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:39.795765  5898 consensus_meta.cc:287] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.022s	user 0.017s	sys 0.000s
I20260709 13:15:39.915253  5775 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:39.914870  6033 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:39.915482  5898 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:39.916366  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:39.917166  5775 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:39.917610  3015 leader_election.cc:400] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 7. Current term is 8.
I20260709 13:15:39.917708  5775 raft_consensus.cc:697] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:39.917927  3197 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:39.918010  3015 leader_election.cc:403] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:15:39.886200  5952 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:39.918841  5775 consensus_queue.cc:237] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:39.887148  5999 raft_consensus.cc:697] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:39.923844  5999 consensus_queue.cc:237] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:39.912312  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:39.926592  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:39.790122  6011 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:39.927743  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:39.928349  3046 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:39.928490  3126 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:39.929227  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:39.931711  5450 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:39.754040  5963 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:39.783769  6058 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.790643  6057 raft_consensus.cc:697] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:39.921486  5952 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:39.939244  3046 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:39.939682  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:39.751647  6014 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:39.798102  5908 consensus_meta.cc:287] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.589s	user 0.013s	sys 0.001s
I20260709 13:15:39.776799  6005 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:39.944072  6038 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:39.877707  5843 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:39.953361  3196 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:39.958356  3192 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:39.933512  5450 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.964187  3124 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:39.930157  5990 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:39.957762  6014 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:39.941025  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:39.969202  5450 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:39.790174  5875 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:39.884370  6050 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:39.955423  5963 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:39.963655  6025 consensus_meta.cc:287] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.748s	user 0.008s	sys 0.002s
I20260709 13:15:39.790407  6055 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.161s
I20260709 13:15:39.942891  6058 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:39.936977  3792 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEARNER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:15:39.991410  3119 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: []
W20260709 13:15:39.969601  5811 consensus_meta.cc:287] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.000s
W20260709 13:15:40.007213  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 89702.7us
I20260709 13:15:39.956041  5908 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:40.017560  3790 raft_consensus.cc:2368] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 6. Current term is 7.
W20260709 13:15:40.018402  6070 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:15:40.018164  5811 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:40.020605  5811 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:40.025177  5908 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:40.027379  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:40.028228  3191 raft_consensus.cc:2368] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9.
W20260709 13:15:40.028340  3795 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 415) took 3236 ms (client timeout 1845 ms). Trace:
W20260709 13:15:40.028787  3795 rpcz_store.cc:269] 0709 13:15:36.791877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.794305 (+  2428us) service_pool.cc:224] Handling call
0709 13:15:40.028099 (+3233794us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54005c0154. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:40.028234 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2320267008}
I20260709 13:15:40.030155  6039 raft_consensus.cc:3055] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:40.030606  6039 raft_consensus.cc:740] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:40.010754  6025 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:40.031669  6039 consensus_queue.cc:260] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:40.032339  3194 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 5: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:40.032728  6039 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:40.033380  6025 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:40.033829  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:40.042888  3194 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
W20260709 13:15:40.034364  3125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 1735) took 2608 ms (client timeout 2597 ms). Trace:
W20260709 13:15:40.043447  3125 rpcz_store.cc:269] 0709 13:15:37.426246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.898125 (+471879us) service_pool.cc:224] Handling call
0709 13:15:40.034136 (+2136011us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400302ad4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:40.034255 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3310116224}
I20260709 13:15:40.043866  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:40.035385  3046 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:40.020941  6011 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:39.990718  5828 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:40.051438  6020 log.cc:927] Time spent T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 1.171s	user 0.003s	sys 0.000s
W20260709 13:15:40.053719  6072 log.cc:927] Time spent T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:15:40.049821  6074 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:39.991205  5950 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.054921  6074 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:40.055512  5950 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:40.057307  6074 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:40.049260  3015 connection.cc:256] RPC call timeout handler was delayed by -1.2465453209999851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
W20260709 13:15:40.058079  3015 connection.cc:256] RPC call timeout handler was delayed by -1.1826453209998817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
W20260709 13:15:40.058558  3015 connection.cc:256] RPC call timeout handler was delayed by -1.1826453209998817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
W20260709 13:15:40.058921  3015 connection.cc:256] RPC call timeout handler was delayed by -1.1385453210000378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
I20260709 13:15:40.059038  6050 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:40.059316  3015 connection.cc:256] RPC call timeout handler was delayed by -1.1106453209999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
W20260709 13:15:40.059777  3015 connection.cc:256] RPC call timeout handler was delayed by -1.1016453209999781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1685s for a response
I20260709 13:15:40.060773  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:40.061570  6050 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:40.061993  6050 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.062357  6050 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:40.062973  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 1702) took 1424 ms. Trace:
I20260709 13:15:40.063340  3121 rpcz_store.cc:276] 0709 13:15:38.639056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.662527 (+ 23471us) service_pool.cc:224] Handling call
0709 13:15:40.062775 (+1400248us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b540011b7d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:40.062916 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1854926592}
I20260709 13:15:40.063818  5870 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:40.066651  5830 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:40.071512  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:40.015589  3047 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:40.073649  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:40.074957  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:40.030773  6005 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:39.991576  6038 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 7. Current term is 8.
I20260709 13:15:40.035837  6068 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:40.042421  5811 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:40.090591  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1699) took 5450 ms. Trace:
I20260709 13:15:40.049778  5556 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:40.044476  3194 raft_consensus.cc:2376] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6. Re-sending same reply.
I20260709 13:15:39.964928  5898 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:40.029055  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:40.094874  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:40.095111  3191 raft_consensus.cc:2410] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:15:40.083627  3196 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:39.990061  5990 raft_consensus.cc:697] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:40.057601  5950 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:40.121212  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:40.120795  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:40.089089  6040 consensus_meta.cc:287] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.732s	user 0.010s	sys 0.000s
I20260709 13:15:40.123862  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:40.125164  5398 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:40.096359  5811 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:40.125672  5854 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:40.128297  3196 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:40.128427  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:40.088507  5908 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:40.131546  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:40.097879  6057 consensus_queue.cc:237] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:40.131796  5995 consensus_meta.cc:287] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.794s	user 0.007s	sys 0.003s
I20260709 13:15:40.132099  5875 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:40.096372  5556 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:40.090168  6074 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:40.132661  5990 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:40.133996  6050 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:40.136616  5843 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:40.096246  6038 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:40.139146  6027 consensus_meta.cc:287] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.953s	user 0.012s	sys 0.002s
I20260709 13:15:40.062980  6043 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:40.140991  5450 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:40.143872  6051 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:40.185297  5880 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:40.148134  5934 consensus_meta.cc:287] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.599s	user 0.007s	sys 0.000s
I20260709 13:15:40.189360  6050 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:40.168476  6040 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:40.189816  5934 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:40.190086  6027 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:40.191164  5880 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:40.191299  6040 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:40.191885  5934 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:40.192059  6027 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:40.151019  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:40.193157  3792 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
W20260709 13:15:40.152453  5840 consensus_meta.cc:287] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.518s	user 0.005s	sys 0.002s
I20260709 13:15:40.194470  5450 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:40.157171  6054 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.862s	user 0.000s	sys 0.002s
I20260709 13:15:40.157752  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:40.164955  5901 consensus_meta.cc:287] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.697s	user 0.008s	sys 0.001s
W20260709 13:15:40.172830  6076 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
W20260709 13:15:40.174314  5827 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.011s	sys 0.007s
I20260709 13:15:40.169618  5870 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:40.183213  5992 consensus_meta.cc:287] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.071s	user 0.011s	sys 0.000s
I20260709 13:15:40.164955  6048 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:40.188194  6004 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:40.188915  5811 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:40.194092  5840 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:40.198628  5901 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:40.184568  5995 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:40.196344  6043 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:40.196646  6033 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:40.204490  5992 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:40.207674  6048 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:40.215014  6058 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:40.215675  6033 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:40.255311  2947 catalog_manager.cc:5697] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 3 to 4, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 4 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:15:40.087219  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:40.260735  2947 catalog_manager.cc:5697] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 3 to 5, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 5 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.264014  2947 catalog_manager.cc:5697] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 2 to 4, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 4 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:40.265386  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.268118  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:40.269467  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 347) took 3422 ms. Trace:
I20260709 13:15:40.270212  3042 rpcz_store.cc:276] 0709 13:15:36.847119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.383848 (+1536729us) service_pool.cc:224] Handling call
0709 13:15:38.384142 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.923736 (+539594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:40.268603 (+1344867us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b540028c154. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:40.269150 (+   547us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1222348544}
I20260709 13:15:40.275079  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 355) took 1038 ms. Trace:
I20260709 13:15:40.279386  3045 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 10: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:40.266773  2947 catalog_manager.cc:5697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 3 to 5, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 5 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.281378  2947 catalog_manager.cc:5697] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.284739  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.284585  2947 catalog_manager.cc:5697] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 3 to 5, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 5 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:15:40.091037  3049 rpcz_store.cc:276] 0709 13:15:34.632428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.632564 (+   136us) service_pool.cc:224] Handling call
0709 13:15:34.632891 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:34.771298 (+138407us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:34.973776 (+202478us) log.cc:844] Serialized 14 byte log entry
0709 13:15:38.166574 (+3192798us) log.cc:844] Serialized 14 byte log entry
0709 13:15:38.776786 (+610212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.776868 (+    82us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:38.776938 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:40.082875 (+1305937us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540027c9d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:40.082939 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:40.083110 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":698325,"prepare.queue_time_us":449994,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":4243,"raft.queue_time_us":766684,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":15377,"spinlock_wait_cycles":317782272,"thread_start_us":3312420,"threads_started":5,"wal-append.queue_time_us":1980936,"wal-append.run_cpu_time_us":13399,"wal-append.run_wall_time_us":2211988}
W20260709 13:15:40.179680  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 101039us
I20260709 13:15:40.289283  3051 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:40.179031  3197 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:40.157725  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:40.295384  3197 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:40.295593  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:40.296860  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:40.140075  3193 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:40.296887  3194 raft_consensus.cc:2368] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4.
I20260709 13:15:40.299363  3197 raft_consensus.cc:2368] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5.
I20260709 13:15:40.299211  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:40.300189  3193 raft_consensus.cc:2376] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7. Re-sending same reply.
I20260709 13:15:40.301918  3164 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:40.305343  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 1733) took 1026 ms. Trace:
I20260709 13:15:40.196877  3794 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:40.163866  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:15:40.201524  5827 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.011s	sys 0.008s
I20260709 13:15:40.331573  5827 raft_consensus.cc:697] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:40.196245  5897 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:40.334895  3198 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:40.335739  6058 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:40.336524  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:40.336966  5897 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:40.337080  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:40.211668  5958 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:40.338296  3197 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 8: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:40.339692  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:40.340924  5840 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:40.343546  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:40.215205  5995 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:40.346832  5995 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:40.347278  5995 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:40.347765  5995 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:40.351073  5990 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.352046  5990 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:40.286600  2947 catalog_manager.cc:5697] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 1 to 2, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 2 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
W20260709 13:15:40.316876  3120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 1686) took 1945 ms (client timeout 1849 ms). Trace:
I20260709 13:15:40.318429  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:40.321002  5901 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:40.321573  3191 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:15:40.275767  3043 rpcz_store.cc:276] 0709 13:15:39.236613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.238407 (+  1794us) service_pool.cc:224] Handling call
0709 13:15:39.238692 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:39.238897 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:39.238921 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:39.239393 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:15:39.266074 (+ 26681us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:39.266125 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.266199 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:40.156652 (+890453us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:40.274101 (+117449us) raft_consensus.cc:1685] finished
0709 13:15:40.274200 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:40.274801 (+   601us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6286720,"thread_start_us":26283,"threads_started":1,"wal-append.queue_time_us":55390}
I20260709 13:15:40.273176  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.327734  5992 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:40.375278  5990 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:40.321004  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1912) took 1070 ms. Trace:
I20260709 13:15:40.328547  3194 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:40.310391  3047 rpcz_store.cc:276] 0709 13:15:39.279060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.425299 (+146239us) service_pool.cc:224] Handling call
0709 13:15:40.304793 (+879494us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b54003c2dd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:40.305107 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1256293632}
I20260709 13:15:40.340889  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:40.336403  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 249116us
I20260709 13:15:40.358361  3191 pending_rounds.cc:85] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 2
I20260709 13:15:40.367412  3200 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:40.369395  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:40.357124  3120 rpcz_store.cc:269] 0709 13:15:38.371729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.372412 (+   683us) service_pool.cc:224] Handling call
0709 13:15:40.316321 (+1943909us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b5400478bd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:40.316580 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2039911296}
I20260709 13:15:40.370687  5808 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:40.373024  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:40.372742  5909 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:40.379604  3191 pending_rounds.cc:107] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:15:40.387918  3191 raft_consensus.cc:2889] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:40.378151  3192 rpcz_store.cc:276] 0709 13:15:39.250503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.250647 (+   144us) service_pool.cc:224] Handling call
0709 13:15:40.320491 (+1069844us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b54001def54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:40.320732 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1625146624}
I20260709 13:15:40.333179  5827 consensus_queue.cc:237] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:40.392469  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.393312  3048 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:40.393530  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:40.393831  3126 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:40.394382  3197 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:40.394845  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.395911  3048 raft_consensus.cc:2393] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 8: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:40.396968  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:40.401005  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 345) took 1067 ms. Trace:
I20260709 13:15:40.401593  3123 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:15:40.403067  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:40.404171  3123 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:40.405570  3047 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:40.404192  3165 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:40.406342  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:40.407248  3125 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
W20260709 13:15:40.407332  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 110537us
I20260709 13:15:40.408876  3125 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:40.410394  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:40.410647  5794 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:40.411079  3118 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:40.411577  3192 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 9: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:40.412250  3123 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:15:40.412549  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:40.413400  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:40.414031  3165 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:40.414487  3122 raft_consensus.cc:2393] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 8: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:15:40.416586  3124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 1687) took 2043 ms (client timeout 1909 ms). Trace:
I20260709 13:15:40.416885  3164 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:40.418010  5794 raft_consensus.cc:2764] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:15:40.419898  5794 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:40.420392  5794 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.420841  5794 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:40.423676  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.423326  5875 consensus_queue.cc:1059] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:40.427328  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:40.428613  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:40.429440  3194 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 4: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:40.430100  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.430954  3043 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:15:40.432365  5556 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:40.433945  3046 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:40.434377  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:40.417128  3124 rpcz_store.cc:269] 0709 13:15:38.372766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.373261 (+   495us) service_pool.cc:224] Handling call
0709 13:15:40.416168 (+2042907us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54004786d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:40.416379 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3631185792}
I20260709 13:15:40.436616  3042 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:40.436681  3197 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:40.413597  3192 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:40.412639  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:40.442327  3048 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 10: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:40.444144  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:40.450875  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:40.465066  3044 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:40.470482  5556 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:40.472841  5875 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.473493  5875 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:40.469429  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 1730) took 1191 ms. Trace:
I20260709 13:15:40.475829  3051 rpcz_store.cc:276] 0709 13:15:39.278217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.663081 (+384864us) service_pool.cc:224] Handling call
0709 13:15:40.469158 (+806077us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54003c37d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:40.469361 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315044608}
I20260709 13:15:40.480531  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:40.482432  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 349) took 1142 ms. Trace:
I20260709 13:15:40.484242  3199 rpcz_store.cc:276] 0709 13:15:39.339767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.136460 (+796693us) service_pool.cc:224] Handling call
0709 13:15:40.136717 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:40.470641 (+333924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:40.470686 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:40.470725 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:40.470879 (+   154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:40.472473 (+  1594us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54003ba454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:40.472521 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:40.482215 (+  9694us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":749256960}
I20260709 13:15:40.439769  6048 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:15:40.488530  2947 catalog_manager.cc:5697] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 3 to 5, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 5 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:15:40.483733  5875 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:40.401495  3195 rpcz_store.cc:276] 0709 13:15:39.333609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.352826 (+ 19217us) service_pool.cc:224] Handling call
0709 13:15:39.353123 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:39.357773 (+  4650us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:39.509149 (+151376us) log.cc:844] Serialized 14 byte log entry
0709 13:15:40.399770 (+890621us) spinlock_profiling.cc:243] Waited 947 us on lock 0x7b1800475600. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82ff5b4bc 00007ff82d2a948b 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff5323a
0709 13:15:40.400172 (+   402us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:40.400280 (+   108us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:40.400461 (+   181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:40.400577 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:40.400785 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":196367,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":39,"raft.queue_time_us":9833,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":132,"spinlock_wait_cycles":2178304,"thread_start_us":225298,"threads_started":2,"wal-append.queue_time_us":143197}
I20260709 13:15:40.497772  2947 catalog_manager.cc:5697] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 2 to 3, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 3 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
W20260709 13:15:40.499876  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 53600.5us
I20260709 13:15:40.501919  3192 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:15:40.505244  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.518754  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:40.507046  3193 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:40.541119  3043 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:40.545212  3117 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:15:40.441334  5794 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:40.529649  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.572718  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1743) took 1172 ms. Trace:
I20260709 13:15:40.573199  3049 rpcz_store.cc:276] 0709 13:15:39.399014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.287080 (+888066us) service_pool.cc:224] Handling call
0709 13:15:40.287675 (+   595us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:40.345547 (+ 57872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:40.345597 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:40.346394 (+   797us) log.cc:844] Serialized 26 byte log entry
0709 13:15:40.441156 (+ 94762us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:40.441200 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:40.441275 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:40.570010 (+128735us) raft_consensus.cc:1685] finished
0709 13:15:40.570034 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:40.571779 (+  1745us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56911,"raft.queue_time_us":70049,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":33311,"thread_start_us":94146,"threads_started":1,"wal-append.queue_time_us":163890}
I20260709 13:15:40.574371  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1910) took 1326 ms. Trace:
I20260709 13:15:40.576293  3198 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:15:40.575021  3200 rpcz_store.cc:276] 0709 13:15:39.248418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.248674 (+   256us) service_pool.cc:224] Handling call
0709 13:15:40.574104 (+1325430us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540013b0d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:40.574291 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2474545408}
I20260709 13:15:40.581712  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:40.602142  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:40.603525  3121 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:40.578896  2947 catalog_manager.cc:5697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 5 to 6, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 6 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:15:40.612507  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.611129  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:40.612692  3042 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:15:40.612651  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1728) took 1338 ms. Trace:
I20260709 13:15:40.611845  3048 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:40.602267  3117 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:40.612074  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.626983  3044 rpcz_store.cc:276] 0709 13:15:39.273864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.987257 (+713393us) service_pool.cc:224] Handling call
0709 13:15:39.987577 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:40.464747 (+477170us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b54002a4ca0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83032adc0 00007ff8303b51c0 00007ff8303b6231 00007ff8303b2d8f 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c
0709 13:15:40.465691 (+   944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:40.610219 (+144528us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54001f7054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:40.612562 (+  2343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":784498304}
I20260709 13:15:40.638788  3045 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:40.631909  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:40.643242  3050 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:40.643061  3119 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:40.650601  2947 catalog_manager.cc:5697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.654430  3200 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:40.654613  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:40.655342  3196 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 7: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:40.655710  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:40.606068  5909 consensus_queue.cc:1059] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:15:40.656781  3051 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:40.661931  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.664340  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:40.662185  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.652966  2947 catalog_manager.cc:5697] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 3 to 4, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 4 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.671236  3049 raft_consensus.cc:2368] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9.
I20260709 13:15:40.673787  3192 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 3. Current term is 5. Ops: []
I20260709 13:15:40.675257  3043 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:40.679317  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:40.656721  5909 raft_consensus.cc:3055] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:40.679713  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:40.685098  3051 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:15:40.691159  3126 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:40.695088  3120 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:40.691390  3121 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:40.698216  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:40.701510  3117 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:40.706782  5897 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.707013  6085 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.698349  3047 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:40.707600  5897 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:40.716086  5858 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:40.717896  5897 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:40.707695  6085 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:40.719439  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 359) took 1075 ms. Trace:
I20260709 13:15:40.720203  5767 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.720832  5767 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:40.721529  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.722335  3051 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:40.722942  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.723133  5767 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:40.723788  3050 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:40.724200  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:40.724809  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.726042  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.727927  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.728850  3044 raft_consensus.cc:2393] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:40.729699  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.730464  3043 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:40.719869  3046 rpcz_store.cc:276] 0709 13:15:39.644222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.337994 (+693772us) service_pool.cc:224] Handling call
0709 13:15:40.338517 (+   523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:40.434367 (+ 95850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:40.719179 (+284812us) spinlock_profiling.cc:243] Waited 95.2 ms on lock 0x7b54001ae354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:40.719368 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218983168}
I20260709 13:15:40.714423  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:40.686331  5909 raft_consensus.cc:740] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:15:40.735226  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.739415  3051 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:40.741999  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:40.742813  3117 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:15:40.742818  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:40.743867  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:40.745411  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:40.748980  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.751899  3119 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:15:40.749547  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.751392  2947 catalog_manager.cc:5697] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 1 to 4, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 4 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.730280  6048 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.757891  3123 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:40.763640  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:40.764485  3121 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 7: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:40.757844  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:40.766796  3049 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:40.760722  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:40.758464  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 43895.7us
I20260709 13:15:40.770083  3122 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:40.781230  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:40.785470  3120 raft_consensus.cc:2410] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:15:40.786139  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:40.789808  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:40.796778  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:40.797704  3051 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:40.797935  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:40.798491  6095 log.cc:927] Time spent T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:15:40.799379  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:40.800062  3197 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:40.799531  2947 catalog_manager.cc:5697] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 4 to 7, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 7 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.804316  3125 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:15:40.805006  3790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 437) took 2648 ms (client timeout 1956 ms). Trace:
I20260709 13:15:40.806869  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:40.807684  3195 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:40.807751  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:40.808611  3194 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:40.809345  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:40.810227  3792 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:40.814535  3124 raft_consensus.cc:1240] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:40.810246  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:40.815289  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:40.816237  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.818508  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.819473  3051 raft_consensus.cc:2393] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:40.790831  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:40.820777  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.821564  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.822849  3051 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:40.819345  6085 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:40.820850  3090 leader_election.cc:400] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9.
I20260709 13:15:40.831094  3090 leader_election.cc:403] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:15:40.831890  3117 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:15:40.828737  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:40.834236  3118 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:40.836853  3045 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:40.841109  3049 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:40.842115  3126 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:40.801550  2947 catalog_manager.cc:5697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.844460  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:40.850310  3044 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:40.851729  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:40.805450  3790 rpcz_store.cc:269] 0709 13:15:38.156351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.157591 (+  1240us) service_pool.cc:224] Handling call
0709 13:15:40.804545 (+2646954us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54004be954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:40.804765 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4133164416}
I20260709 13:15:40.864300  3048 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:40.863304  3125 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:40.865785  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:40.874511  3043 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 5: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:40.880787  3123 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:15:40.882948  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 62573.5us
I20260709 13:15:40.884882  5909 consensus_queue.cc:260] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:40.886309  5909 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:40.886477  6094 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:15:40.897015  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:40.898940  3790 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:40.901077  3091 leader_election.cc:400] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9.
I20260709 13:15:40.902570  5963 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:40.904980  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:40.905264  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:40.905958  3121 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:40.845463  6048 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:40.904394  5963 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:15:40.908007  6048 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:40.905975  5950 consensus_queue.cc:1059] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:15:40.909355  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:40.909698  5950 raft_consensus.cc:3055] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:40.910133  5950 raft_consensus.cc:740] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:40.910276  3123 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 4: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:40.911222  5950 consensus_queue.cc:260] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:40.911734  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:40.912587  3120 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:40.914276  3762 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:40.915678  5875 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:40.915792  3762 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:40.916267  5875 raft_consensus.cc:697] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:40.916923  3125 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:40.917420  5875 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:40.918124  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:40.914253  2947 catalog_manager.cc:5697] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 1 to 3, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 3 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:15:40.918675  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:40.919412  3194 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:40.920257  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:40.919659  2947 catalog_manager.cc:5697] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 2 to 5, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 5 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.920876  3191 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:40.912524  5950 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:40.911247  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:40.932633  3047 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:40.918064  6030 consensus_queue.cc:1059] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:15:40.931531  3117 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:40.934445  3124 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:40.931372  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:40.941962  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.944530  6030 raft_consensus.cc:3055] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:40.944943  6030 raft_consensus.cc:740] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:40.945930  6030 consensus_queue.cc:260] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:40.947269  6030 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:40.947800  3121 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:15:40.950830  2947 catalog_manager.cc:5697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 2 to 5, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 5 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.953214  2947 catalog_manager.cc:5697] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 2 to 4, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 4 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.956410  3118 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:40.960618  6099 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:40.934885  5995 consensus_meta.cc:287] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.587s	user 0.015s	sys 0.000s
I20260709 13:15:40.969964  5995 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:40.970990  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:40.971797  3120 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:40.972201  5995 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:40.972749  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:40.920603  6063 raft_consensus.cc:3055] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:40.973924  6063 raft_consensus.cc:740] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:40.975198  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:40.975106  6063 consensus_queue.cc:260] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:40.963024  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:40.964843  6099 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.966171  5794 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:40.970160  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:40.980062  3126 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:40.960088  3049 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:15:40.964073  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:40.962848  3197 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:40.973963  3044 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:40.978571  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:41.004257  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:41.520426  3793 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 7: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
W20260709 13:15:41.103433  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:41.502799  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:41.371505  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.025897  3195 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:15:41.215260  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:41.523912  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:41.238590  3199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.043s	sys 0.054s
I20260709 13:15:41.386541  3117 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
W20260709 13:15:41.525087  3199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.049s	sys 0.073s
W20260709 13:15:41.134977  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.979743  6099 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:41.527763  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.985441  3120 raft_consensus.cc:2393] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 8: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:40.986012  2947 catalog_manager.cc:5697] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 1 to 2, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 2 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.928453  6048 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:40.976351  6063 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:41.356992  6098 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.425s	user 0.000s	sys 0.001s
I20260709 13:15:40.980854  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:40.980217  3125 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:15:41.542845  3122 consensus_meta.cc:287] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.769s	user 0.008s	sys 0.009s
I20260709 13:15:41.554404  3122 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:41.533948  2947 catalog_manager.cc:5697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 2 to 4, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 4 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:41.543056  3015 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.011s	sys 0.004s
W20260709 13:15:41.555441  3015 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.012s	sys 0.004s
W20260709 13:15:41.555720  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 662108us
W20260709 13:15:41.545653  3193 consensus_meta.cc:287] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.553s	user 0.002s	sys 0.007s
I20260709 13:15:41.556674  3193 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:41.543668  3118 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:41.557951  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1655) took 1185 ms. Trace:
I20260709 13:15:41.080962  3045 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:41.541690  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:41.043201  3091 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:41.558461  3197 rpcz_store.cc:276] 0709 13:15:40.333893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.504088 (+170195us) service_pool.cc:224] Handling call
0709 13:15:40.799254 (+295166us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b5800136e98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28eeee 0000000000375939 00007ff8353021e0 00007ff8353cb0c4 00007ff8353cb131 00007ff8353790a0 00007ff835378984 00007ff82e8f36d4 00007ff82e8f3662
0709 13:15:41.519417 (+720163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35710848}
I20260709 13:15:40.996836  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:41.557461  2947 catalog_manager.cc:5697] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 2 to 4, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 4 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:41.325510  3792 consensus_meta.cc:287] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
I20260709 13:15:41.148062  5995 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:41.566283  5840 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.009s	sys 0.016s
I20260709 13:15:41.542315  6085 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9.
W20260709 13:15:41.529706  6030 consensus_meta.cc:287] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.582s	user 0.004s	sys 0.004s
I20260709 13:15:41.042750  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:41.580293  3123 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:41.520470  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:41.579943  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:41.578354  3795 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:15:41.534490  6048 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:41.573627  3792 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
W20260709 13:15:41.580338  5840 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.009s	sys 0.016s
W20260709 13:15:41.578819  5963 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.016s	sys 0.013s
I20260709 13:15:41.588981  2947 catalog_manager.cc:5697] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 3 to 5, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 5 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:41.592815  5875 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.013s	sys 0.017s
W20260709 13:15:41.607656  3042 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.015s	sys 0.018s
W20260709 13:15:41.608147  3042 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.015s	sys 0.018s
W20260709 13:15:41.605705  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 341535us
I20260709 13:15:41.608649  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1646) took 1284 ms. Trace:
W20260709 13:15:41.609189  3046 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.015s	sys 0.033s
W20260709 13:15:41.609884  3046 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.016s	sys 0.033s
W20260709 13:15:41.606151  5963 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.017s	sys 0.013s
W20260709 13:15:41.606230  5875 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.013s	sys 0.017s
I20260709 13:15:41.602145  5840 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:41.609061  3199 rpcz_store.cc:276] 0709 13:15:40.321517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.539289 (+217772us) service_pool.cc:224] Handling call
0709 13:15:40.609362 (+ 70073us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:40.610008 (+   646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:40.610037 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:40.610580 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:15:41.525572 (+914992us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:41.525611 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.525692 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:41.605670 (+ 79978us) raft_consensus.cc:1685] finished
0709 13:15:41.605689 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:41.605836 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":131,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":861266,"threads_started":1,"wal-append.queue_time_us":963480}
I20260709 13:15:41.593140  5995 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:41.620898  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:41.625284  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:41.626027  3045 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:15:41.629340  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 45953.9us
I20260709 13:15:41.633368  3043 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:41.632467  3761 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:41.637492  5794 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:41.638357  5794 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:41.631032  5840 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:41.643934  6109 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.644676  6109 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:41.651325  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:41.652180  3045 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:41.652385  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:41.660177  3049 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:41.646535  5840 raft_consensus.cc:697] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:15:41.690258  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:41.690344  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 726548us
I20260709 13:15:41.696887  6048 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:41.697141  5794 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:41.694252  3795 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:41.698439  5875 raft_consensus.cc:2764] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:15:41.699918  6110 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:41.700520  6110 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:41.702591  6110 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:41.702893  5995 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:41.703531  5995 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:41.696372  3043 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:41.697458  6048 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.739899  3043 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:41.742852  3091 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:41.743005  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:41.737551  5808 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.016s	sys 0.020s
W20260709 13:15:41.746196  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 125618us
I20260709 13:15:41.750378  3125 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:41.750705  3122 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:15:41.749816  5808 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.016s	sys 0.020s
I20260709 13:15:41.762465  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:41.768958  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:41.771109  5849 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:15:41.773967  3049 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:41.776647  3091 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:41.779125  6112 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:41.779688  6112 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:41.780740  6112 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:41.781932  6113 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:41.778932  6114 consensus_queue.cc:1059] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:15:41.785461  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 848819us
I20260709 13:15:41.786296  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:41.786875  3123 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:41.741803  6048 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:41.794929  3048 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:15:41.799038  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 103246us
W20260709 13:15:41.801306  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 63452.7us
I20260709 13:15:41.804715  3761 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:41.806641  6029 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:41.806950  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:41.808503  6029 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:41.808689  5767 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:41.810164  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:41.810382  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:41.823680  3122 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:41.802408  6114 raft_consensus.cc:3055] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:41.799682  6113 raft_consensus.cc:697] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:41.814641  6110 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:41.827306  5950 consensus_meta.cc:287] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.890s	user 0.011s	sys 0.002s
W20260709 13:15:41.837944  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 61414us
I20260709 13:15:41.758242  5840 consensus_queue.cc:237] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:41.845027  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:41.828090  5963 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.850582  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:41.830796  6114 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:41.852026  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:41.855473  3191 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:41.855583  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:41.856634  3192 raft_consensus.cc:2368] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 7. Current term is 8.
I20260709 13:15:41.858914  6114 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:41.860345  6114 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:41.852703  3091 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:41.873842  6113 consensus_queue.cc:237] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:41.876151  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:41.881834  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:41.884840  3194 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:41.856014  6110 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:41.889042  6110 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:41.889900  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 44272.2us
I20260709 13:15:41.885439  6099 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:41.892868  6119 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:41.885582  5950 consensus_queue.cc:1059] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:15:41.893687  6085 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:41.917826  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:41.895244  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:41.898590  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:41.931245  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 158522us
I20260709 13:15:41.931838  3192 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:41.899737  6123 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:41.938009  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:41.900101  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:41.900523  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:41.852566  5963 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:41.906908  6096 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 1.114s	user 0.006s	sys 0.014s
I20260709 13:15:41.907225  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1664) took 1028 ms. Trace:
W20260709 13:15:41.908423  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.910007  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:41.910323  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:41.870426  6109 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:41.922410  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:41.949779  3048 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:41.950227  3198 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:41.934135  6129 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:41.935595  3164 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:41.943704  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:41.922320  5767 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:41.943738  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:41.944167  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:41.946055  3193 rpcz_store.cc:276] 0709 13:15:40.879114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.879253 (+   139us) service_pool.cc:224] Handling call
0709 13:15:41.907016 (+1027763us) spinlock_profiling.cc:243] Waited 87.5 ms on lock 0x7b540002add4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:41.907160 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201204096}
I20260709 13:15:41.955039  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:41.959781  3200 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:41.944182  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:41.956947  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 56924.3us
I20260709 13:15:41.960752  3192 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:41.963825  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.957376  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:41.957619  3047 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:41.966071  3198 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:15:41.984222  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:41.984867  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.000306  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:42.000545  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:42.001339  3193 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:42.003278  6134 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:42.003891  3165 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:42.003978  6134 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.004442  5828 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:42.004771  6134 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:42.005039  5828 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:42.004077  6121 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:42.006803  6121 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:42.009706  6121 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:42.010470  6121 consensus_queue.cc:1059] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:42.018126  3191 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 4: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:41.949717  6110 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:42.027217  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:42.027884  3196 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:42.023525  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:42.028936  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 72832.6us
W20260709 13:15:42.030862  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.005934  5808 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:41.972540  6122 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:42.034533  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:42.035679  3045 raft_consensus.cc:2393] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 9: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:42.032078  3194 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 5: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:42.000422  6123 raft_consensus.cc:3055] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:42.018345  5840 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.040447  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:42.044085  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:42.048280  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:42.048686  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:42.049049  3118 raft_consensus.cc:2376] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4. Re-sending same reply.
I20260709 13:15:42.049614  3117 raft_consensus.cc:2376] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10. Re-sending same reply.
W20260709 13:15:42.052394  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 157230us
I20260709 13:15:41.982805  5767 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:42.067401  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:42.065719  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 60131.3us
W20260709 13:15:42.068898  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.071046  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:42.071835  3122 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:42.073356  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:42.039810  6123 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:42.038398  6122 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:42.079253  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:42.044895  6099 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:42.081244  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:42.082240  3090 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:42.084153  3117 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 9: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:42.084079  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:42.094059  6141 consensus_queue.cc:1059] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:42.095765  6141 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:42.097983  3164 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:42.099819  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:42.001435  6129 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:42.104513  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 64193.4us
I20260709 13:15:42.037211  6110 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:42.080195  5808 raft_consensus.cc:3055] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:42.111716  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:42.085318  6122 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:42.080178  6048 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:42.114308  3125 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:42.115643  3165 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:42.121938  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:42.126701  3192 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
W20260709 13:15:42.139012  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.078183  5840 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:42.120012  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:42.164575  6125 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.170236  6126 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:42.170490  6118 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.240s	user 0.003s	sys 0.000s
I20260709 13:15:42.171155  6048 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:42.170861  6126 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.171849  6045 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.150s
I20260709 13:15:42.175455  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:42.176153  3119 raft_consensus.cc:2376] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8. Re-sending same reply.
I20260709 13:15:42.177254  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:42.164563  6109 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:42.177924  6046 raft_consensus.cc:3055] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:42.178452  6109 raft_consensus.cc:697] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 6 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:42.178524  5794 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.178982  5828 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:42.179373  5794 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.170639  6125 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.179579  6109 consensus_queue.cc:237] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.181928  6125 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:42.182617  6125 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.183254  3126 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:42.165850  3051 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:42.179687  5828 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:42.166828  3125 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:42.185832  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:42.187011  3119 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:42.185770  3048 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
I20260709 13:15:42.113874  5808 raft_consensus.cc:740] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:42.191673  3051 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:42.191944  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:42.190315  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 71721.6us
I20260709 13:15:42.188853  3200 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:15:42.192747  3122 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
W20260709 13:15:42.189134  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 162130us
W20260709 13:15:42.178642  6135 log.cc:927] Time spent T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:15:42.121519  6111 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:42.173501  6126 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:42.205510  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:42.167390  6146 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:42.178570  6046 raft_consensus.cc:740] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:42.194267  5794 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:42.233455  3165 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:42.235836  6145 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.237795  3165 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:42.236011  6136 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:42.239060  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:42.242658  3120 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:42.244742  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 1728) took 1277 ms. Trace:
I20260709 13:15:42.194900  6125 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.226425  5828 raft_consensus.cc:697] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:42.245086  3120 rpcz_store.cc:276] 0709 13:15:40.967553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.530686 (+563133us) service_pool.cc:224] Handling call
0709 13:15:42.238855 (+708169us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b5800003398. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff8353790a0 00007ff835378984 00007ff82e8f36d4 00007ff82e8f3662
0709 13:15:42.244683 (+  5828us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32230272}
I20260709 13:15:42.231256  5950 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:42.225198  5963 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:42.278014  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 195908us
I20260709 13:15:42.282305  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:42.283109  3121 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:42.285065  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 1730) took 1317 ms. Trace:
I20260709 13:15:42.245024  5794 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:42.283283  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 371) took 1360 ms. Trace:
W20260709 13:15:42.285975  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 48315.2us
I20260709 13:15:42.285451  3121 rpcz_store.cc:276] 0709 13:15:40.968041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.526180 (+558139us) service_pool.cc:224] Handling call
0709 13:15:42.282144 (+755964us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b5800003398. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff8353790a0 00007ff835378984 00007ff82e8f36d4 00007ff82e8f3662
0709 13:15:42.285012 (+  2868us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45017344}
I20260709 13:15:42.224356  6134 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:42.290194  3118 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:15:42.274379  6112 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:42.278491  6146 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:42.293229  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:42.194023  6123 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.286976  3042 rpcz_store.cc:276] 0709 13:15:40.922876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.923021 (+   145us) service_pool.cc:224] Handling call
0709 13:15:40.938201 (+ 15180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:40.976650 (+ 38449us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:41.608585 (+631935us) log.cc:844] Serialized 14 byte log entry
0709 13:15:41.892299 (+283714us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b18003c1060. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c6522 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:15:41.948910 (+ 56611us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:41.948994 (+    84us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:41.949074 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:42.169770 (+220696us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:42.283055 (+113285us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b54003a93d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:42.283105 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:42.283229 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":682564,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":45,"raft.queue_time_us":82459,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":4203,"spinlock_wait_cycles":378760704,"thread_start_us":900433,"threads_started":3,"wal-append.queue_time_us":240188}
I20260709 13:15:42.309530  6138 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:42.310730  6139 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:15:42.310341  6138 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.312950  6138 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:42.289518  6140 consensus_queue.cc:1059] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:15:42.314178  5828 consensus_queue.cc:237] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.315176  6140 raft_consensus.cc:3055] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:42.315518  6140 raft_consensus.cc:740] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:42.316506  5840 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:42.316567  6140 consensus_queue.cc:260] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.318384  6110 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:42.321018  3123 consensus_meta.cc:287] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.519s	user 0.007s	sys 0.000s
I20260709 13:15:42.321357  3123 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:42.322364  6129 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:42.321933  6046 consensus_queue.cc:260] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.323231  6125 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:42.288546  5963 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:15:42.323845  6046 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:42.289373  6127 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:42.325224  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:42.325941  6134 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:42.325790  6127 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:42.326869  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:42.327541  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:42.328286  3048 raft_consensus.cc:2410] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:15:42.328377  6127 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:42.329663  6123 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:42.330132  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 369) took 1410 ms. Trace:
I20260709 13:15:42.330173  5808 consensus_queue.cc:260] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.330691  3044 rpcz_store.cc:276] 0709 13:15:40.919798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.920295 (+   497us) service_pool.cc:224] Handling call
0709 13:15:40.920609 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:41.557689 (+637080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:42.329935 (+772246us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b54001f5254. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:42.330084 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122192256}
I20260709 13:15:42.331526  5808 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:42.332437  6140 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:42.293715  5794 raft_consensus.cc:697] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:15:42.309834  6142 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:15:42.312849  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:42.322510  6132 log.cc:927] Time spent T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.351s	user 0.003s	sys 0.000s
W20260709 13:15:42.333969  6113 consensus_queue.cc:1175] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aaf88538197a49adb8bcf3790309a67e" responder_term: 9 status { last_received { term: 8 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:42.334444  3165 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:42.351516  3049 raft_consensus.cc:2393] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:42.351436  3196 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:42.351681  3051 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
W20260709 13:15:42.351385  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 62871.3us
W20260709 13:15:42.358140  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.359418  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:42.360399  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:42.361963  6126 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:42.362462  6126 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:42.362876  6126 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:42.364364  6143 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:15:42.365944  5995 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:42.366617  5995 raft_consensus.cc:697] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:15:42.366992  6137 log.cc:927] Time spent T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.359s	user 0.002s	sys 0.000s
I20260709 13:15:42.367601  5995 consensus_queue.cc:237] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.354730  6144 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.368731  6144 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:42.369946  6131 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:42.370970  6144 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:42.372175  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:42.356767  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:42.374732  3044 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:42.374753  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:42.376107  3197 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:42.322011  5767 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:42.378685  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 87344.8us
I20260709 13:15:42.380288  3762 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:42.379555  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:42.380997  3123 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:15:42.381991  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:42.389056  3799 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 2 LEARNER]: Advancing to term 4
W20260709 13:15:42.400831  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 299362us
I20260709 13:15:42.401422  3117 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:42.402061  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:42.242558  6145 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.402807  3045 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:42.403290  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:42.436076  3121 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
W20260709 13:15:42.436460  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 229414us
I20260709 13:15:42.406528  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:42.378705  6129 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:42.378794  6141 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.308933  6112 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.398100  5767 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:42.383118  6085 raft_consensus.cc:697] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:42.435920  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:42.403450  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:42.444141  3090 leader_election.cc:400] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4.
I20260709 13:15:42.443516  3126 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:42.450358  3793 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:42.451885  3762 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:42.451896  3090 leader_election.cc:403] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:42.388953  6111 consensus_queue.cc:1059] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:15:42.461015  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:42.461381  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:42.462131  3796 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:42.464165  6145 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:42.455320  5794 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:42.453987  6013 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.482s	user 0.014s	sys 0.041s
I20260709 13:15:42.472713  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:42.462167  6154 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:15:42.473562  3049 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:42.472923  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:42.481683  3197 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:42.485304  3793 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:42.454627  5767 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:42.452589  6129 raft_consensus.cc:697] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:42.456123  6045 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:42.492905  3799 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEARNER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 4.
I20260709 13:15:42.462324  5999 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:42.479791  6013 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.677s	user 0.014s	sys 0.041s
I20260709 13:15:42.497565  3049 pending_rounds.cc:85] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 5
I20260709 13:15:42.507905  3049 pending_rounds.cc:107] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:15:42.508258  3049 raft_consensus.cc:2889] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:42.503659  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:42.468746  6125 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 3. Current term is 4.
I20260709 13:15:42.506637  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:42.511621  3050 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:42.513056  3192 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:42.513091  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:42.513799  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 75197.8us
I20260709 13:15:42.515848  3090 leader_election.cc:400] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5.
I20260709 13:15:42.516338  3090 leader_election.cc:403] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:42.517267  3199 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:42.521015  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:42.523221  6085 consensus_queue.cc:237] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.523496  6129 consensus_queue.cc:237] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.444832  6141 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.495597  6045 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.511507  3091 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:42.498777  5999 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.538136  3194 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:15:42.542173  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 44599.6us
I20260709 13:15:42.544296  3126 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:42.539593  6045 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:42.539294  6109 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:42.558614  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.543570  5999 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:42.561256  3164 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:42.563015  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:42.563992  3046 raft_consensus.cc:2410] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:42.564142  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:42.570699  3118 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:42.574452  3125 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:42.577147  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:42.577829  3125 raft_consensus.cc:2376] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9. Re-sending same reply.
I20260709 13:15:42.578328  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:42.579131  3122 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:42.557801  6145 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:42.586122  3045 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:15:42.560045  6109 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:42.589457  3120 raft_consensus.cc:1275] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:15:42.603078  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:42.604815  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 89125.3us
I20260709 13:15:42.544008  6122 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:42.613894  3792 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEARNER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:42.613992  6128 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:42.661078  6128 raft_consensus.cc:697] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 6 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:42.662173  6114 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:42.662099  6128 consensus_queue.cc:237] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.662684  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:42.604243  6156 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.195s
I20260709 13:15:42.664928  6156 raft_consensus.cc:3055] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:15:42.616698  6160 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:15:42.580214  5767 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:42.621214  3795 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
W20260709 13:15:42.622501  6159 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:15:42.601140  6109 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:42.692461  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:42.692687  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:42.695415  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:42.695849  3122 raft_consensus.cc:2410] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:42.630662  5808 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:42.582304  6163 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 4. Current term is 5.
I20260709 13:15:42.633054  6112 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:42.635432  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:42.587452  6145 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.666862  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:42.700671  3123 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:42.665407  6156 raft_consensus.cc:740] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:42.665196  5999 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.681103  6122 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:42.581889  6136 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 13:15:42.686842  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:42.706051  3118 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
W20260709 13:15:42.690490  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 142378us
I20260709 13:15:42.662093  6141 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:42.696136  3125 raft_consensus.cc:2393] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 8: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:15:42.691697  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 186884us
W20260709 13:15:42.703110  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 154559us
I20260709 13:15:42.709884  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:42.701711  6145 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:42.712261  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1723) took 1742 ms. Trace:
I20260709 13:15:42.713950  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:42.710546  3195 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:42.716341  3197 raft_consensus.cc:1275] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:15:42.856962  3045 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:42.761432  3198 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:42.823243  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:42.716754  3197 pending_rounds.cc:85] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 1
I20260709 13:15:42.718559  3164 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:42.884864  3197 pending_rounds.cc:107] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:15:42.716945  3761 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:42.794791  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.762419  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:42.773311  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:42.885422  3197 raft_consensus.cc:2889] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:42.759505  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 124184us
I20260709 13:15:42.717067  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:42.887439  3194 raft_consensus.cc:2393] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 8: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:42.716109  3124 rpcz_store.cc:276] 0709 13:15:40.965921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.976677 (+ 10756us) service_pool.cc:224] Handling call
0709 13:15:41.908753 (+932076us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b5800003398. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff83538cfc0 00007ff835377929 00007ff8353773d2 00007ff82e8eebd4
0709 13:15:41.908978 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:41.909234 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:41.909565 (+   331us) log.cc:844] Serialized 14 byte log entry
0709 13:15:42.469309 (+559744us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b1800301180. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff5323a 00007ff8303bda2a
0709 13:15:42.707809 (+238500us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:42.707863 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:42.707908 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:42.707973 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:42.708071 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5907,"prepare.queue_time_us":1487,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":5271,"raft.queue_time_us":12861,"spinlock_wait_cycles":79636608,"thread_start_us":221964,"threads_started":1,"wal-append.queue_time_us":891009}
I20260709 13:15:42.889986  3090 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:42.890903  5963 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:42.892518  3090 leader_election.cc:400] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 7. Current term is 8.
I20260709 13:15:42.892894  3090 leader_election.cc:403] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:42.893577  5963 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 7. Current term is 8.
I20260709 13:15:42.857263  5794 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:42.746425  6168 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:15:42.711529  6127 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:42.713580  3015 connection.cc:256] RPC call timeout handler was delayed by -1.1868998730001294s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
I20260709 13:15:42.761307  3196 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 7. Current term is 8. Ops: [4.3-7.4]
I20260709 13:15:42.762079  3195 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:15:42.762734  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:42.825502  6063 raft_consensus.cc:3055] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:15:42.895511  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 177074us
W20260709 13:15:42.898154  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 181278us
I20260709 13:15:42.902989  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:42.748297  6167 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:15:42.922290  3046 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:42.922629  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:42.901520  5875 raft_consensus.cc:3055] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:42.903362  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:42.903700  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:42.896955  3015 connection.cc:256] RPC call timeout handler was delayed by -1.1553998730000785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 13:15:42.936028  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0482998730001327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
I20260709 13:15:42.914968  3191 raft_consensus.cc:2393] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 5: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:42.895383  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:42.928871  6063 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:42.717844  6157 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:42.707520  6126 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:42.902617  6172 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:15:42.774874  5999 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:42.897689  6100 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:42.951087  6100 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.951594  6100 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:42.951843  6063 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:42.780067  6030 consensus_queue.cc:1059] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.162s
I20260709 13:15:42.942111  6111 consensus_queue.cc:1059] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:15:42.945055  5849 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:42.957082  5849 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:42.957542  5849 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:42.896461  6122 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:42.953416  6063 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:42.843864  6123 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
W20260709 13:15:42.965170  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.064517  6111 raft_consensus.cc:3055] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:43.065004  6111 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:43.068231  3048 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:43.001987  6125 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.896680  6127 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.933398  5875 raft_consensus.cc:740] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:43.078181  5828 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:15:42.964797  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:43.001498  6029 raft_consensus.cc:3055] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:15:43.001075  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 105789us
I20260709 13:15:43.092029  3090 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:42.999691  6109 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.092962  3051 raft_consensus.cc:1240] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:42.749671  6045 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:42.894838  5794 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:43.001178  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 50457.2us
I20260709 13:15:42.717880  6156 consensus_queue.cc:260] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:42.945546  5950 consensus_queue.cc:1059] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:15:42.985721  6044 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:15:43.000494  6126 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:43.058583  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 92652.4us
I20260709 13:15:43.108767  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:43.109871  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:43.110158  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:43.110785  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:42.966787  5808 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:15:43.052311  6100 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:42.953482  6136 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:43.117128  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:43.117151  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:43.117856  3121 raft_consensus.cc:2376] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7. Re-sending same reply.
I20260709 13:15:43.118242  3050 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:43.090682  6029 raft_consensus.cc:740] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:43.104689  3051 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:43.105664  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:43.083088  6125 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.070564  3046 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:43.124048  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:43.124287  3090 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:43.105168  6121 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:15:43.139678  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 174971us
I20260709 13:15:43.115320  6131 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:43.117518  5995 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:43.115540  6085 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:43.118427  6126 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:43.152935  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:43.144765  3795 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:43.123481  5950 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:15:43.165391  3090 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:43.112530  3124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:15:43.166944  3124 raft_consensus.cc:606] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:43.094861  6111 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:43.149850  5840 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:43.167521  3124 raft_consensus.cc:614] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:43.113507  3195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51690
I20260709 13:15:43.176182  3195 raft_consensus.cc:606] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 13:15:43.176537  3195 raft_consensus.cc:614] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:43.168416  6121 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:43.170994  6125 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:43.144644  5398 consensus_queue.cc:1059] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:15:43.182736  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:43.156824  5995 raft_consensus.cc:697] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:43.165479  6044 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:43.151786  6180 consensus_queue.cc:1059] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:15:43.186658  6163 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:43.166373  6145 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.188093  6126 raft_consensus.cc:697] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:43.182256  6165 consensus_queue.cc:1059] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:15:43.207321  3090 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:43.208033  6100 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:43.208884  6045 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:43.194834  6044 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:43.193861  6121 raft_consensus.cc:697] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:43.195596  6129 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:43.209694  3090 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:43.216490  3120 raft_consensus.cc:2393] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 7: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:43.271363  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:43.339525  3164 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:43.293404  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 83779.1us
I20260709 13:15:43.350106  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:43.349454  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 113675us
I20260709 13:15:43.225015  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:43.225915  3793 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
W20260709 13:15:43.349015  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 95116.2us
I20260709 13:15:43.224375  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:43.222237  3193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7480597af1f341178e465e8723f7320e"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:15:43.359393  3193 raft_consensus.cc:606] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:43.359963  3193 raft_consensus.cc:614] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:43.353510  3165 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:15:43.361660  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 156139us
I20260709 13:15:43.368465  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:43.227368  6121 consensus_queue.cc:237] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.374225  6175 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:43.351441  3195 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:43.209831  6109 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:43.359459  6150 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:15:43.369949  6046 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:43.226861  5794 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:43.220077  6044 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:43.213335  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:43.231081  6193 raft_consensus.cc:3055] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:43.351464  6123 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:43.382850  6192 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.208s	user 0.004s	sys 0.000s
I20260709 13:15:43.216043  6145 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:43.225953  6127 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:43.220971  6163 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:43.227767  6129 raft_consensus.cc:697] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:43.379951  5840 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:43.382272  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:43.220191  6190 log.cc:927] Time spent T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:15:43.378576  6131 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.378101  6175 raft_consensus.cc:697] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:43.411341  6131 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.411927  6175 consensus_queue.cc:237] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.214035  6194 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.172s
I20260709 13:15:43.399462  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:43.416131  3051 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:43.391578  6123 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.418012  6123 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:43.405786  3090 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:43.403075  6136 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:43.387152  6046 raft_consensus.cc:697] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:43.388844  5849 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:43.407522  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.408398  6174 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:43.408633  6111 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:43.409387  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:43.410415  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:43.426249  3051 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:15:43.423067  6122 raft_consensus.cc:3055] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:43.220688  5995 consensus_queue.cc:237] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:43.431983  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 63584.6us
I20260709 13:15:43.210690  6126 consensus_queue.cc:237] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:43.447639  3124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efef22a7096a40bdb96063353ee98827"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:15:43.448225  3124 raft_consensus.cc:606] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:43.448562  3124 raft_consensus.cc:614] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:43.448662  6109 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:43.453724  6202 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:43.230270  5875 consensus_queue.cc:260] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:43.436789  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.455389  6129 consensus_queue.cc:237] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:43.456409  6156 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:43.441190  6145 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:43.458148  6131 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:43.458611  6145 raft_consensus.cc:697] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:43.459699  6145 consensus_queue.cc:237] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.434346  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:43.406493  3792 raft_consensus.cc:2368] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
I20260709 13:15:43.388484  6193 raft_consensus.cc:740] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:43.442334  3193 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:15:43.385808  6029 consensus_queue.cc:260] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:43.447139  5849 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:43.468107  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:43.475589  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:43.462707  6122 raft_consensus.cc:740] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:43.503118  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:43.469377  6141 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:43.464907  6174 raft_consensus.cc:697] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:43.470851  5840 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:43.507405  6046 consensus_queue.cc:237] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.441543  6136 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:43.510277  6157 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:43.510527  3121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:15:43.529870  3121 raft_consensus.cc:606] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:43.530292  3121 raft_consensus.cc:614] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:43.511157  6122 consensus_queue.cc:260] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.512337  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:43.534210  3200 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:43.513073  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:43.535434  3194 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:43.513713  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:43.514111  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:43.514912  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:43.515633  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:43.517633  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:43.518077  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:43.518527  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:43.539671  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:43.539887  3197 raft_consensus.cc:2410] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:43.518585  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:43.506018  5849 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:15:43.495007  6201 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:43.526361  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 117074us
I20260709 13:15:43.545964  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:43.546303  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:43.546409  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:43.533241  3090 connection.cc:256] RPC call timeout handler was delayed by -2.3481066200001806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
I20260709 13:15:43.540141  3793 raft_consensus.cc:2410] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:15:43.540493  3195 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
W20260709 13:15:43.547204  3090 connection.cc:256] RPC call timeout handler was delayed by -1.8822347089999312s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
I20260709 13:15:43.545022  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:15:43.500170  6163 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:15:43.549477  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:43.547573  3090 connection.cc:256] RPC call timeout handler was delayed by -1.8417347090000931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
I20260709 13:15:43.550352  3194 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:43.547545  3192 raft_consensus.cc:1275] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:15:43.550709  3090 connection.cc:256] RPC call timeout handler was delayed by -1.7043176150000363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
I20260709 13:15:43.531092  5840 raft_consensus.cc:697] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:43.555249  3164 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:43.555143  3193 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:15:43.557588  3090 connection.cc:256] RPC call timeout handler was delayed by -1.5585176150000279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 13:15:43.559808  3090 connection.cc:256] RPC call timeout handler was delayed by -1.3718247110002721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
I20260709 13:15:43.561615  3200 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:43.536679  6157 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:43.541877  6126 raft_consensus.cc:2764] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:15:43.563364  3199 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:43.624902  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:43.556540  6109 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:43.627229  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:43.568773  3795 raft_consensus.cc:2393] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:43.564479  6141 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.568352  6048 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:43.565466  6138 raft_consensus.cc:3055] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:43.567286  6163 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:43.637192  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 68780.2us
I20260709 13:15:43.641852  6163 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.644589  5840 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:43.640003  5963 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:43.654467  6123 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.659080  6123 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:43.635741  6141 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.672464  6141 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:43.673677  6109 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.674413  6109 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.674084  6157 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.629611  5995 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:43.661588  6136 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:43.646593  6163 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:43.678224  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 123048us
I20260709 13:15:43.686784  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:43.687000  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:43.678329  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 51211.8us
I20260709 13:15:43.691020  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:43.691874  3121 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:43.696846  3194 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:43.636737  6138 raft_consensus.cc:740] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:43.548045  6193 consensus_queue.cc:260] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:43.704541  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:43.705991  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:43.706636  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:43.707520  3126 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:43.704118  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:43.709299  3125 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:43.711428  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:43.713482  3090 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:43.715801  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:43.681298  5995 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:43.734146  5995 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:43.712669  5999 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:43.737128  5999 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.737561  5999 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:43.633903  6174 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.700114  6201 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:43.741962  6121 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:43.742532  6121 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:43.742895  6121 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:43.750334  6109 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:43.720685  6127 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:43.751318  6127 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:43.751834  6127 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:43.726101  3051 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:15:43.755533  3121 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:15:43.729803  3125 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:43.730337  5398 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:43.731102  6194 raft_consensus.cc:3055] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:43.731273  6193 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:43.719468  6205 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:43.755726  3124 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:15:43.757936  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 44575.8us
I20260709 13:15:43.727061  6138 consensus_queue.cc:260] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.762583  3047 raft_consensus.cc:1275] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:15:43.788636  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 82704.2us
I20260709 13:15:43.789716  3164 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:43.765111  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:43.766427  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:43.791043  3051 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:43.767073  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:43.767745  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:43.768605  6125 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:43.786921  6165 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.821237  6165 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:43.823638  6109 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:43.824087  6109 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:43.824504  6165 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:43.774807  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:43.825165  6109 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:43.825913  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 51221us
I20260709 13:15:43.764196  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:43.827432  3042 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:43.827564  3761 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:43.828466  5849 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:43.828990  5849 raft_consensus.cc:697] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:15:43.769378  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 58044us
I20260709 13:15:43.778491  6141 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:43.820546  6138 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:43.812312  6212 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:43.859807  6048 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.860477  6048 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.860364  5849 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:43.779811  6194 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:43.867508  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:43.826862  6109 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:43.833423  3164 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:43.836189  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:43.779309  5398 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:43.837420  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:43.787454  6180 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.833182  3048 raft_consensus.cc:2410] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:15:43.779145  6085 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:43.891156  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.835675  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:43.898524  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:43.902117  3124 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:43.903417  3043 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:43.904803  6129 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:43.910277  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 72950.3us
I20260709 13:15:43.914525  3090 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:43.836616  6197 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:43.863066  6175 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.862783  6048 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:43.919267  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 83143.4us
I20260709 13:15:43.878871  6210 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:15:43.898387  6205 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:43.895802  6125 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.895586  5398 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:43.896030  6212 raft_consensus.cc:697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:15:43.940985  3120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 1739) took 1273 ms (client timeout 1619 ms). Trace:
W20260709 13:15:43.941610  3120 rpcz_store.cc:269] 0709 13:15:42.668042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.668200 (+   158us) service_pool.cc:224] Handling call
0709 13:15:43.940698 (+1272498us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b54003e7954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:43.940909 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1198873984}
I20260709 13:15:43.935667  3090 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:43.863602  5999 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.922447  5840 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:43.930871  6123 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:43.878579  5767 consensus_queue.cc:1059] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:15:43.958328  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:43.911069  6085 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.906071  6180 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.957409  6136 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:15:43.954203  6044 raft_consensus.cc:670] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } [suppressed 5 similar messages]
I20260709 13:15:43.976704  6194 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:43.970893  6217 log.cc:927] Time spent T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.100s	user 0.001s	sys 0.008s
I20260709 13:15:43.985483  6030 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:15:43.986192  6156 consensus_meta.cc:287] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.529s	user 0.012s	sys 0.000s
I20260709 13:15:43.986075  6030 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:43.931216  6129 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:43.990263  6212 consensus_queue.cc:237] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:43.991993  6129 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:43.980191  5999 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:43.949534  6125 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.993095  5999 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.993613  5999 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.995055  6125 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:43.999447  6085 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:43.998186  6030 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:43.947273  6048 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:44.000584  6048 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:44.001089  6048 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:44.001977  6201 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:44.002839  5999 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:43.936441  6197 raft_consensus.cc:697] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:44.032780  6197 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:43.922734  6175 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:43.975904  5995 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:44.038726  6175 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:44.015506  3042 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:44.039247  5995 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:44.016366  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:44.022558  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 91824.1us
I20260709 13:15:44.040840  3090 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:44.028215  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 70004.7us
I20260709 13:15:44.042425  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:44.043537  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:44.044809  6129 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:44.045476  6129 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:44.051028  6201 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:44.054193  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:44.056159  5995 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:44.055667  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:44.059455  5995 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:44.070724  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:44.088261  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:44.088986  6029 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:44.089627  5995 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:15:44.090204  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 49441.5us
I20260709 13:15:44.090971  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:44.091378  6210 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:44.091773  5995 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:44.091449  6121 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:44.091970  3090 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:44.093530  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:44.093918  6157 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:44.094329  5995 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:44.095583  6125 raft_consensus.cc:1064] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:15:44.096378  5995 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:44.097357  5995 consensus_queue.cc:1243] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:44.097822  6109 raft_consensus.cc:3055] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:44.098202  6109 raft_consensus.cc:740] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:44.090250  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:44.099196  6219 log.cc:927] Time spent T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 13:15:44.088887  3048 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:15:44.099289  6109 consensus_queue.cc:260] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:44.100919  6109 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.102062  5398 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:44.102873  6121 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:44.104305  5398 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:44.110296  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:44.111069  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:44.111902  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.115688  3048 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:44.116536  3761 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:44.116721  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:44.117230  3197 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:44.118443  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:44.017491  6180 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:44.120170  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:44.118971  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:44.072906  6194 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:44.119261  3192 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:44.017495  6136 raft_consensus.cc:697] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:44.120304  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:44.124061  3120 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.124976  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:44.145392  3043 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:44.136016  3195 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:44.142580  3048 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:44.152426  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:44.157829  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:44.153405  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:44.159610  3200 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
W20260709 13:15:44.160007  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 326648us
I20260709 13:15:44.154908  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:44.156476  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:44.150382  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:44.161934  3191 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
W20260709 13:15:44.162379  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 57290.7us
I20260709 13:15:44.163097  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:44.124010  5767 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:44.146538  6126 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:44.145387  6085 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:44.185209  3197 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:44.186524  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:44.216321  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:44.222111  3799 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:44.177923  6085 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.194586  6131 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:44.193171  5767 raft_consensus.cc:697] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:44.227232  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:44.228353  5875 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.228731  5767 consensus_queue.cc:237] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:44.230492  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:44.231395  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:44.232095  3044 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:44.109519  6125 consensus_queue.cc:237] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 3, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:44.259251  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:44.262944  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 46730.6us
I20260709 13:15:44.259644  3762 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:44.226717  6085 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:44.276834  3120 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:44.280092  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:44.283341  6225 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.283854  5808 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:44.283964  6225 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:44.286262  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:44.287081  3799 raft_consensus.cc:2393] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:44.236140  6126 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:15:44.296371  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 169671us
I20260709 13:15:44.259505  3795 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:44.305478  3091 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:44.303040  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:44.295605  6127 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.001s
W20260709 13:15:44.321385  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.271116  6044 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:15:44.325673  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:44.332623  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:44.294799  6099 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:44.334021  6099 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.334522  6099 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:44.343585  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.357426  3164 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:44.294978  5828 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:15:44.372514  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 97725us
I20260709 13:15:44.300244  6226 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:15:44.377525  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 252593us
W20260709 13:15:44.364092  6228 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:15:44.397305  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.357636  6127 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:44.359910  5963 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:44.359565  5808 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.271729  6136 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:44.363255  3164 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:44.414266  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 55235.5us
I20260709 13:15:44.312960  6174 consensus_queue.cc:1059] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:15:44.391556  3090 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:44.419459  3090 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:44.381693  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 49214.3us
I20260709 13:15:44.386296  6193 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:44.421636  3761 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:44.373719  5828 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:44.408169  6129 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:44.428555  3048 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:44.420837  6212 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.424192  6030 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:44.424803  6205 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:44.409617  6131 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:15:44.441057  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:44.442135  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 136716us
I20260709 13:15:44.456045  3091 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:44.457504  6131 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:44.458166  6131 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:44.458626  6131 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:44.461026  6227 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:15:44.465440  6222 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:15:44.471310  3194 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:44.477442  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:44.478426  3195 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:44.474490  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:44.487304  3194 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.434356  6193 raft_consensus.cc:697] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:44.412161  6226 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:44.491410  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:44.503243  3192 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:44.489784  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:44.427311  6180 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:15:44.498234  3194 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:44.430148  6126 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:15:44.502266  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:44.505450  3200 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:15:44.510740  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 54765.5us
W20260709 13:15:44.510819  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 91440.7us
I20260709 13:15:44.474308  5963 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:44.442570  6238 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:44.520717  3090 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:44.488937  6240 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:44.433673  6237 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 13:15:44.522370  2948 catalog_manager.cc:5697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:44.519513  5398 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:44.531068  6236 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:15:44.548729  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1973) took 1026 ms. Trace:
I20260709 13:15:44.548691  6193 consensus_queue.cc:237] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:44.549367  3196 rpcz_store.cc:276] 0709 13:15:43.522622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.543007 (+ 20385us) service_pool.cc:224] Handling call
0709 13:15:43.558022 (+ 15015us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:43.685572 (+127550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:43.685617 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:44.104049 (+418432us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b2c000fc108. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:15:44.104443 (+   394us) log.cc:844] Serialized 26 byte log entry
0709 13:15:44.262545 (+158102us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:44.279540 (+ 16995us) log.cc:844] Serialized 14 byte log entry
0709 13:15:44.283382 (+  3842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.283469 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:44.548435 (+264966us) raft_consensus.cc:1685] finished
0709 13:15:44.548528 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.548665 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7641,"prepare.queue_time_us":17013,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":44,"raft.queue_time_us":14589,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":41042,"spinlock_wait_cycles":2810112,"thread_start_us":276656,"threads_started":2,"wal-append.queue_time_us":314581}
W20260709 13:15:44.552839  6235 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:15:44.553145  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:44.525090  6180 consensus_queue.cc:1243] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer e9165fe61ab04bfb9a48889156d5c161 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:15:44.554904  3196 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:15:44.528287  6238 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.564373  6127 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:44.569850  6199 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.570582  6199 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:44.574412  3797 raft_consensus.cc:2410] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:15:44.575078  6048 consensus_meta.cc:287] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.002s
I20260709 13:15:44.573450  3790 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:44.578481  6122 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:44.580487  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:44.549319  5398 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:44.599647  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.600662  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:44.602854  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:44.607705  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 51143.3us
I20260709 13:15:44.609201  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:44.562449  6238 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.610800  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:44.560185  6240 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:44.575675  6048 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:44.626943  3191 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:15:44.616959  6109 consensus_meta.cc:287] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.002s
I20260709 13:15:44.630370  3192 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:44.625555  6252 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:44.602736  6225 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:44.619434  6138 consensus_meta.cc:287] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.753s	user 0.009s	sys 0.002s
I20260709 13:15:44.615751  6201 raft_consensus.cc:2764] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:15:44.648964  3042 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:44.613864  6248 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.616009  6129 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:44.619124  5963 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.618176  6126 consensus_queue.cc:1059] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:15:44.687394  6126 raft_consensus.cc:3055] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:44.687945  6126 raft_consensus.cc:740] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:44.654887  6245 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:44.649827  6136 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:15:44.639029  6240 raft_consensus.cc:697] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:15:44.661924  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:44.692447  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.663980  6131 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:44.674660  6048 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:44.675213  6248 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:44.677487  6099 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:44.678321  6109 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:44.680303  6194 consensus_meta.cc:287] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.001s
I20260709 13:15:44.682760  3048 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:44.618335  6205 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:15:44.666069  6156 raft_consensus.cc:3055] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:44.695397  5808 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:44.720702  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 111682us
I20260709 13:15:44.732301  3125 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:15:44.722352  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 111642us
W20260709 13:15:44.691684  6241 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 13:15:44.702036  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 183068us
I20260709 13:15:44.728724  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:44.734191  3091 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:44.734627  3120 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:44.729616  3118 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:15:44.689132  6126 consensus_queue.cc:260] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:44.692142  6195 consensus_queue.cc:1059] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:15:44.744520  3124 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:44.692348  5963 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:44.745913  6237 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:44.747220  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:44.758606  3118 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:44.750137  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:44.728227  6156 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:44.752152  6044 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.752331  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:44.721683  6085 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:44.695221  6138 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:15:44.753298  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:44.750707  5398 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:44.757562  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:44.760718  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:44.761242  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.766117  3044 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:44.766148  3050 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:44.767280  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:44.773501  3046 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:44.755792  6253 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:44.777413  3015 leader_election.cc:400] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
I20260709 13:15:44.757423  6205 consensus_queue.cc:1059] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
W20260709 13:15:44.768175  6246 log.cc:927] Time spent T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.227s	user 0.003s	sys 0.001s
I20260709 13:15:44.778858  3015 leader_election.cc:403] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:15:44.773172  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:44.779585  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:44.780114  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:44.732795  6233 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:15:44.786010  3120 raft_consensus.cc:2393] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:44.786839  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:44.787961  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:44.788669  3120 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:44.788918  6205 raft_consensus.cc:3055] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:44.794138  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:44.794732  3117 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:44.796416  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:44.797030  3121 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:44.797091  3048 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:15:44.797593  3048 pending_rounds.cc:85] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 3
I20260709 13:15:44.797897  3048 pending_rounds.cc:107] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:15:44.798106  3048 raft_consensus.cc:2889] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:44.798388  3048 pending_rounds.cc:107] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:15:44.798390  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:44.798997  3048 raft_consensus.cc:2889] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:44.802577  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:44.803515  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:44.804142  3123 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:15:44.805897  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:44.810593  6248 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:44.812420  5963 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:44.815048  6099 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:44.815696  6156 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:44.817206  6156 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:44.794296  6205 raft_consensus.cc:740] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:44.824057  6205 consensus_queue.cc:260] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:44.825241  6205 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:44.778807  6253 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.779047  6126 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:44.829778  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:44.844038  3051 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.803313  6259 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:44.770007  6240 consensus_queue.cc:237] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:44.831681  3047 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:15:44.782213  5995 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:44.842284  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:44.768409  6044 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:44.851011  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:44.873930  3047 raft_consensus.cc:2393] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:44.852265  3120 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:44.852516  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:44.859184  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:44.877231  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:44.846982  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.880163  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:44.881629  3121 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
W20260709 13:15:44.882226  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.877846  3045 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:15:44.883539  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:44.884743  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:44.889488  3051 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:44.889931  3045 raft_consensus.cc:2393] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 9: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:44.890388  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:44.862373  5963 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.877555  6099 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.914027  6099 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:44.914908  6044 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:44.915092  6254 log.cc:927] Time spent T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.368s	user 0.002s	sys 0.000s
I20260709 13:15:44.916158  6099 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:44.916333  6238 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:44.894457  6085 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:44.852811  6253 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:44.898094  6131 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:44.897639  3045 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:44.870980  5767 raft_consensus.cc:3055] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:44.851289  5995 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:44.893887  6224 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.904738  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:44.878945  6194 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
I20260709 13:15:44.936249  5963 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:44.903716  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:44.921881  6257 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.039191  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:45.066181  3119 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:45.039614  3126 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
W20260709 13:15:45.040571  6212 consensus_meta.cc:287] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.599s	user 0.015s	sys 0.000s
I20260709 13:15:44.868189  6248 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:15:45.041177  3194 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:45.043974  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.853473  6252 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:15:45.043849  3124 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:15:45.110613  3126 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:45.113135  3195 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:15:45.051530  3165 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:45.053148  5767 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:45.063309  6260 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:45.049026  6210 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:45.050212  6109 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:45.072907  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.072773  3119 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:45.072750  6253 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:45.073565  6257 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:45.079375  5963 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:45.061730  5995 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:45.079607  6238 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:45.081664  6259 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:45.066398  6224 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:45.083407  6242 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.506s	user 0.003s	sys 0.005s
I20260709 13:15:45.084357  3120 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:45.070904  6212 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:45.107724  3790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 454) took 2003 ms (client timeout 2131 ms). Trace:
I20260709 13:15:45.059849  6122 consensus_queue.cc:1059] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 13:15:45.116528  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 65119.2us
I20260709 13:15:45.117554  3124 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:45.265199  3124 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:15:45.266081  3790 rpcz_store.cc:269] 0709 13:15:43.104664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.109866 (+  5202us) service_pool.cc:224] Handling call
0709 13:15:45.107499 (+1997633us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54005a19d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:45.107635 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3309063552}
I20260709 13:15:45.266728  6224 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:45.118758  5767 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:45.268312  5767 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:45.137589  3117 raft_consensus.cc:1240] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:45.118341  3126 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:45.222999  6029 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.175848  6226 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:45.270677  6029 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:45.261533  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:45.272118  3117 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 13:15:45.272293  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:45.272979  6029 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:45.273669  6157 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:45.274094  6157 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.274431  6157 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:45.274648  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:45.274852  5963 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:45.275369  3048 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:45.276706  3762 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:45.277194  6253 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:45.110551  6175 raft_consensus.cc:3055] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:45.278149  6175 raft_consensus.cc:740] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:45.278950  6210 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:45.279265  6175 consensus_queue.cc:260] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:45.280766  6175 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:45.281020  6210 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:45.133564  6199 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:45.274384  3090 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:45.282343  6199 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:45.282807  6044 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.285070  6044 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:45.287387  6044 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:45.287989  6199 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.288458  6199 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:45.289096  6259 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:45.288934  3122 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:45.289613  6259 raft_consensus.cc:697] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:45.179837  6156 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:45.290352  3043 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
W20260709 13:15:45.191798  6268 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:15:45.290541  6156 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.290664  6259 consensus_queue.cc:237] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:45.288235  5995 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:45.294150  6260 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:45.136936  3015 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.132:43109 timed out after 2.131s (SENT) [suppressed 33 similar messages]
W20260709 13:15:45.283011  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.297803  3043 pending_rounds.cc:85] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 8
W20260709 13:15:45.311579  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.311293  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:45.350260  3043 pending_rounds.cc:107] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:15:45.350335  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:45.350627  3043 raft_consensus.cc:2889] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:45.317587  3044 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:45.318431  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:45.327926  6270 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:15:45.329886  6238 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:45.331084  6122 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:45.333664  6248 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:45.334842  3091 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:45.350718  3047 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 4.
I20260709 13:15:45.352815  3042 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:45.341009  6157 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:45.349256  6156 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:45.382962  3794 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:15:45.383042  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 84806.5us
I20260709 13:15:45.386273  3165 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:45.352203  6126 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:45.317886  6210 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:15:45.401286  3193 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 13:15:45.402209  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:45.404529  3200 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:45.407845  3196 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:45.352957  5767 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:45.413340  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 78604.1us
I20260709 13:15:45.416335  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:45.374941  6224 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.412635  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:45.391824  6205 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.422528  3793 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:15:45.433851  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:45.436849  3199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34728 (request call id 381) took 1570 ms (client timeout 1989 ms). Trace:
W20260709 13:15:45.451897  3199 rpcz_store.cc:269] 0709 13:15:43.866911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.867182 (+   271us) service_pool.cc:224] Handling call
0709 13:15:45.436647 (+1569465us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b5400037854. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:45.436793 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1183982336}
W20260709 13:15:45.438131  3797 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 432) took 1920 ms (client timeout 2131 ms). Trace:
W20260709 13:15:45.433126  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:45.453613  3797 rpcz_store.cc:269] 0709 13:15:43.517351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.517836 (+   485us) service_pool.cc:224] Handling call
0709 13:15:45.437955 (+1920119us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54005c1a54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:45.438078 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2378452352}
I20260709 13:15:45.459616  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:45.368536  5398 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:15:45.420764  6269 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:45.483973  6274 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:45.484401  6269 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.484835  6269 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:45.484701  6274 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:45.485188  5828 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:45.486385  6122 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:45.486542  6238 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:45.487046  6122 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:45.487779  6109 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:45.488274  6109 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:45.406876  6131 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:15:45.432928  2997 auto_rebalancer.cc:893] Removing replace marker failed: Leader has not yet committed an operation in its own term
W20260709 13:15:45.495590  2997 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:15:45.494295  6257 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:45.497526  6131 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:45.489342  5828 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:45.471125  3091 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:45.439440  6244 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.900s	user 0.001s	sys 0.002s
I20260709 13:15:45.462199  6224 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:45.498750  5828 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:45.437728  6125 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:15:45.497789  3797 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 4 LEARNER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:45.504050  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:45.508309  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:45.518023  3121 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 4.
W20260709 13:15:45.518952  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.500800  6257 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:45.523666  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:45.428886  6226 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:45.528038  3048 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:45.531139  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:45.532966  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:45.533073  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:45.533792  3047 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:45.537590  3793 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:15:45.506129  2997 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:15:45.542474  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:45.542908  5828 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:45.542354  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:45.543757  3117 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:45.545038  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:45.545722  3121 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:45.550411  3118 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:15:45.411617  6126 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:45.522979  6125 consensus_queue.cc:1243] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:45.557049  3042 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:45.599784  6267 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.604511  6224 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:45.605523  6274 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:45.421634  5767 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:45.621076  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:45.613071  3799 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:15:45.616060  3119 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:45.515117  6240 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:15:45.615820  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 228492us
I20260709 13:15:45.556586  6259 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.556911  6237 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:45.600503  6131 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:45.645138  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.522874  6253 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.431314  6205 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:45.556597  6123 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:15:45.527711  6257 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.555437  6226 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.627010  6122 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:45.693183  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:45.695652  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:45.696566  3197 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:15:45.632009  6129 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:45.667461  3091 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:45.685371  3164 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:45.681527  3047 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:15:45.700090  3046 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:45.701304  3197 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:15:45.701869  3199 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:45.705610  3197 pending_rounds.cc:85] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 3
I20260709 13:15:45.706000  3197 pending_rounds.cc:107] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:15:45.706269  3197 raft_consensus.cc:2889] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:45.706825  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:45.552553  6252 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.132s
I20260709 13:15:45.703517  3091 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:45.710898  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:45.711755  3051 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
W20260709 13:15:45.716941  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 579986us
W20260709 13:15:45.717710  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.681264  6257 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:45.719662  3196 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:45.720261  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:45.683902  6226 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:45.723680  3199 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:45.636969  6274 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:15:45.697657  6212 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:45.796061  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.665838  6259 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:45.847610  3197 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:15:45.701963  6122 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:45.679206  6224 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:15:45.636907  6240 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:45.717497  6085 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:45.863556  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:45.886220  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:45.723897  6260 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:45.729348  6238 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:45.844758  6274 consensus_queue.cc:1243] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:15:45.710747  6253 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:45.715830  6129 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:45.897881  5828 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:45.904260  6273 log.cc:927] Time spent T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 13:15:45.863492  6085 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.861049  5995 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:45.907279  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:45.882455  6272 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:15:45.912096  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:45.905043  6109 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:45.927479  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 229759us
I20260709 13:15:45.931052  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:45.932031  3046 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:45.887777  6122 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:45.896377  6126 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:45.947317  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:45.948015  3197 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:45.889828  6194 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:15:45.906751  6123 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:45.889654  6131 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
W20260709 13:15:45.949622  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 264318us
I20260709 13:15:45.950555  3164 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:45.928329  6085 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:45.862460  6212 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:45.914667  6238 raft_consensus.cc:697] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:45.909869  6260 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:15:45.965154  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:45.977676  3044 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:45.618563  6267 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:45.967171  3046 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:45.992591  3164 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:45.994306  3164 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:45.988857  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:45.905464  6269 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:45.987295  3197 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:15:45.988368  3126 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:15:45.950524  6125 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.001051  3121 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:46.017526  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:46.030853  3047 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:46.032437  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:46.033309  3047 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
W20260709 13:15:46.037426  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.030125  6252 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:45.979095  6278 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:45.948510  5875 consensus_queue.cc:1059] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:15:45.968813  6044 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:15:45.998198  6272 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:15:46.045909  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:46.042716  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:46.052130  3197 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:46.043233  3046 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:15:46.042737  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:46.053257  3126 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:46.051388  3123 raft_consensus.cc:2368] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10.
I20260709 13:15:46.048100  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:46.054689  3118 raft_consensus.cc:2410] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:15:46.062327  3126 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:45.979773  6123 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:46.045117  6242 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:15:46.019955  5767 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:46.073252  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 79077us
I20260709 13:15:46.064901  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:46.018074  6211 raft_consensus.cc:3055] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:46.067512  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:46.040342  6121 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:46.075878  3197 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:46.078461  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:46.085510  3118 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:15:46.085695  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:46.108763  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:46.109679  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:46.090131  3197 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:46.063978  6225 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:46.115340  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:46.117630  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:46.064538  6205 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:46.121404  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:46.126199  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.126026  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:46.128693  3197 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:46.069211  6224 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:46.082288  6211 raft_consensus.cc:740] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:46.126981  3126 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:46.060767  6044 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:46.124291  6274 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:46.044116  6125 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:46.115537  6121 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:46.137544  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 75246.1us
I20260709 13:15:46.166266  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:46.075074  6252 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:46.115324  6225 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.165452  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:46.166898  3195 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:46.113291  5828 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:46.167747  3761 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:46.192634  3090 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:46.191188  3117 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:15:46.198634  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 62098.3us
I20260709 13:15:46.198892  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:46.197898  3196 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:46.199602  3192 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:46.204311  3119 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:46.203091  3164 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:46.147246  6300 raft_consensus.cc:3055] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:15:46.254653  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 51660.9us
I20260709 13:15:46.163921  6274 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:46.274870  6272 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:15:46.277443  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.374961  3164 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:46.278105  6122 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:46.199455  6240 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:46.254477  3091 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:46.285192  6283 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:46.285871  3796 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:15:46.286245  6293 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:46.286931  3122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 1791) took 1503 ms (client timeout 1780 ms). Trace:
W20260709 13:15:46.287845  6284 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.213s	user 0.000s	sys 0.003s
I20260709 13:15:46.396313  6237 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:46.253032  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:46.288648  3120 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:46.399991  6237 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:15:46.400414  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 147469us
I20260709 13:15:46.396461  6293 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.401166  6293 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:46.400897  6237 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:46.401899  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1754) took 1530 ms. Trace:
I20260709 13:15:46.402257  3120 rpcz_store.cc:276] 0709 13:15:44.871432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.267277 (+395845us) service_pool.cc:224] Handling call
0709 13:15:46.288152 (+1020875us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:46.400123 (+111971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.401695 (+  1572us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54004777d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:46.401841 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2337326464}
I20260709 13:15:46.403102  3090 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:46.293219  6157 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:46.293926  5995 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.289362  3119 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:46.405781  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1788) took 1626 ms. Trace:
I20260709 13:15:46.405826  5995 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:46.300868  3762 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:46.406325  3125 rpcz_store.cc:276] 0709 13:15:44.779640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.780046 (+   406us) service_pool.cc:224] Handling call
0709 13:15:44.780385 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:44.780813 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:45.222710 (+441897us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b18003893e0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82ff5b4bc 00007ff82d2a948b 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c3455 00007ff833dab3c7 00007ff8303bd9a7 00007ff8303c65e5
0709 13:15:45.222938 (+   228us) log.cc:844] Serialized 14 byte log entry
0709 13:15:45.374384 (+151446us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:45.386607 (+ 12223us) log.cc:844] Serialized 52 byte log entry
0709 13:15:45.386797 (+   190us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:45.390060 (+  3263us) log.cc:844] Serialized 14 byte log entry
0709 13:15:45.416722 (+ 26662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.416799 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:46.405512 (+988713us) raft_consensus.cc:1685] finished
0709 13:15:46.405540 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.405702 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64920,"prepare.queue_time_us":100226,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":76,"raft.queue_time_us":38595,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":27303,"spinlock_wait_cycles":23561984,"thread_start_us":142596,"threads_started":2,"wal-append.queue_time_us":370540}
W20260709 13:15:46.407940  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 107149us
I20260709 13:15:46.408355  6240 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:46.408718  5995 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:46.409092  6240 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:46.303411  6224 consensus_queue.cc:1059] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:46.410885  6240 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:46.308663  6248 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:46.411718  5767 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:46.412205  5767 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.411875  6248 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:46.412639  5767 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:46.414644  6248 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:46.415342  6248 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:46.415745  6248 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:46.415959  6233 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:46.416227  6248 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:46.416563  6233 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:46.418030  5995 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:46.418582  5995 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:46.380082  6274 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:46.420689  5995 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:46.306394  6281 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
W20260709 13:15:46.424770  6286 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.329s	user 0.001s	sys 0.001s
I20260709 13:15:46.310444  6269 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:46.343253  6123 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:46.425529  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:46.342890  2948 catalog_manager.cc:5697] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 3 to 6, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 6 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:15:46.427304  2948 catalog_manager.cc:5697] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:45.505148  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:46.431567  6085 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:46.344765  6044 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:46.353386  6125 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:46.354151  6212 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:46.354595  6109 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:46.190984  6129 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:46.358359  6304 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:46.203632  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:46.251727  6295 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:46.364365  6289 log.cc:927] Time spent T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.289s	user 0.002s	sys 0.000s
I20260709 13:15:46.146070  6238 consensus_queue.cc:237] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:46.367456  6288 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:15:46.369405  6252 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:46.370438  6267 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:46.255350  5840 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:15:46.278589  6287 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:15:46.475548  3796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 460) took 1058 ms. Trace:
I20260709 13:15:46.275629  6211 consensus_queue.cc:260] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:46.380924  3164 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:46.321312  6275 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:46.250473  6279 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
W20260709 13:15:46.386101  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 131699us
I20260709 13:15:46.193468  6225 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:46.374397  6300 raft_consensus.cc:740] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:46.501013  6300 consensus_queue.cc:260] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:46.502054  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:46.502311  6300 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:46.502897  3050 raft_consensus.cc:2410] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:15:46.503973  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:46.504704  3047 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:15:46.505105  3047 pending_rounds.cc:85] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 3
I20260709 13:15:46.505358  3047 pending_rounds.cc:107] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:15:46.505578  3047 raft_consensus.cc:2889] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:46.506587  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:46.507236  3047 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:46.507997  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:46.404134  3794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 459) took 1015 ms. Trace:
I20260709 13:15:46.507651  5767 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:46.508513  3794 rpcz_store.cc:276] 0709 13:15:45.389135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.389375 (+   240us) service_pool.cc:224] Handling call
0709 13:15:45.414678 (+ 25303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:45.418257 (+  3579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.418306 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:45.419632 (+  1326us) log.cc:844] Serialized 564 byte log entry
0709 13:15:45.866088 (+446456us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:45.866146 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.866240 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:46.403904 (+537664us) raft_consensus.cc:1685] finished
0709 13:15:46.403926 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.404065 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":446077,"threads_started":1,"wal-append.queue_time_us":624286}
I20260709 13:15:46.511031  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:46.511184  6293 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:46.511847  3048 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:46.512580  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:46.512149  6274 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:46.513108  3048 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:46.513727  6257 consensus_meta.cc:287] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.687s	user 0.009s	sys 0.002s
I20260709 13:15:46.399533  6122 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:46.514360  6257 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:46.472523  6044 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:46.516242  6044 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.516583  6044 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:46.517210  6257 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:46.411201  6224 raft_consensus.cc:3055] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:46.518286  3124 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:46.518435  3047 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
W20260709 13:15:46.396744  3122 rpcz_store.cc:269] 0709 13:15:44.783261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.783397 (+   136us) service_pool.cc:224] Handling call
0709 13:15:46.286768 (+1503371us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54004777d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:46.286875 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1099187584}
I20260709 13:15:46.202188  6292 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:46.437985  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.202090  6253 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:46.445297  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 241745us
I20260709 13:15:46.476022  3796 rpcz_store.cc:276] 0709 13:15:45.407875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.408065 (+   190us) service_pool.cc:224] Handling call
0709 13:15:45.438504 (+ 30439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:46.274516 (+836012us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54005c15a0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83032adc0 00007ff8303b51c0 00007ff8303b6231 00007ff8303b2d8f 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c
0709 13:15:46.396274 (+121758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.466237 (+ 69963us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b54005c15a0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83032adc0 00007ff8303b6a02 00007ff8303b2dd6 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:15:46.466504 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467046016}
I20260709 13:15:46.384545  5828 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.081s
W20260709 13:15:46.490814  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 109987us
I20260709 13:15:46.495718  6125 consensus_queue.cc:1059] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:46.203910  6278 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.263s
I20260709 13:15:46.499528  6309 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:46.500104  6085 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:46.502718  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:46.508193  3044 pending_rounds.cc:85] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 3
I20260709 13:15:46.514942  6122 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.313755  6121 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:46.482923  6175 consensus_meta.cc:287] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.202s	user 0.019s	sys 0.002s
W20260709 13:15:46.483166  6156 consensus_meta.cc:287] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.074s	user 0.014s	sys 0.002s
I20260709 13:15:46.428877  2948 catalog_manager.cc:5697] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 3 to 7, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 7 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.523366  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:46.504877  3050 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 9: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:46.568945  3046 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:46.560734  3091 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:46.570057  3048 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:46.513453  6293 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:46.566010  3044 pending_rounds.cc:107] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:15:46.557061  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1813) took 1022 ms. Trace:
W20260709 13:15:46.562762  2947 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57750 (request call id 227) took 20669 ms (client timeout 15000 ms). Trace:
W20260709 13:15:46.329093  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.559388  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:46.494107  6199 consensus_meta.cc:287] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.205s	user 0.014s	sys 0.006s
I20260709 13:15:46.200003  6259 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:46.575280  3197 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:46.572290  2948 catalog_manager.cc:5697] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 1 to 7, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 7 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.576259  3044 raft_consensus.cc:2889] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:46.577253  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:46.579367  3051 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:46.576921  3124 rpcz_store.cc:276] 0709 13:15:45.534510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.534627 (+   117us) service_pool.cc:224] Handling call
0709 13:15:45.534913 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:46.555265 (+1020352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.556685 (+  1420us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b54003921d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:46.556977 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2260885760}
I20260709 13:15:46.582294  2948 catalog_manager.cc:5697] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.578778  3091 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:46.555033  6233 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:46.585331  6299 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:46.586717  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2143) took 1033 ms. Trace:
I20260709 13:15:46.526968  6211 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:46.517942  6224 raft_consensus.cc:740] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:46.578254  6267 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.587160  3045 rpcz_store.cc:276] 0709 13:15:45.553392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.553560 (+   168us) service_pool.cc:224] Handling call
0709 13:15:45.553964 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:45.554333 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.554372 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:45.554896 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:15:45.951299 (+396403us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:45.951349 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.951411 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:46.586454 (+635043us) raft_consensus.cc:1685] finished
0709 13:15:46.586475 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.586659 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":868,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":52730,"thread_start_us":314575,"threads_started":1,"wal-append.queue_time_us":456573}
I20260709 13:15:46.594925  3164 leader_election.cc:400] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10.
I20260709 13:15:46.527366  5840 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.588768  2948 catalog_manager.cc:5697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 2 to 5, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:15:46.597491  3164 leader_election.cc:403] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:15:46.599944  3163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.001s	sys 0.012s
W20260709 13:15:46.601140  3163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.001s	sys 0.012s
I20260709 13:15:46.603672  3046 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:15:46.568285  6122 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:46.558050  5767 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:46.604893  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:46.613245  3091 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:46.621189  3015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.000s	sys 0.014s
I20260709 13:15:46.612799  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:46.627157  3015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.000s	sys 0.014s
I20260709 13:15:46.627509  3045 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:46.609097  2948 catalog_manager.cc:5697] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.556936  6274 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:46.566493  6121 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.566282  6309 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:15:46.629827  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 758925us
I20260709 13:15:46.518101  6275 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:46.579651  6292 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:46.639719  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 55674.4us
W20260709 13:15:46.659101  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 52608us
I20260709 13:15:46.659265  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2137) took 1333 ms. Trace:
I20260709 13:15:46.561143  6295 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:15:46.659770  3164 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:46.659761  3049 rpcz_store.cc:276] 0709 13:15:45.326379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.349161 (+ 22782us) service_pool.cc:224] Handling call
0709 13:15:45.369361 (+ 20200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:45.369822 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.369854 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:45.387455 (+ 17601us) log.cc:844] Serialized 564 byte log entry
0709 13:15:45.618816 (+231361us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:45.618855 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.618920 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:46.659028 (+1040108us) raft_consensus.cc:1685] finished
0709 13:15:46.659049 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.659208 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":231039,"threads_started":1,"wal-append.queue_time_us":495056}
I20260709 13:15:46.659765  3761 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:46.640686  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.648830  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:46.586896  6085 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:46.578114  6156 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:46.629873  2948 catalog_manager.cc:5697] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 5 to 9, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 9 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.571220  6212 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:15:46.560849  6248 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:46.664623  3051 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:46.736743  3048 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:15:46.663384  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 50213.5us
I20260709 13:15:46.688083  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:46.593524  6304 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
W20260709 13:15:46.743577  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 83886.9us
I20260709 13:15:46.739507  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:46.738188  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 50182.8us
I20260709 13:15:46.686468  2948 catalog_manager.cc:5697] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.755235  3045 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:15:46.583843  6199 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:46.639492  6253 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:15:46.610551  3790 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.008s	sys 0.005s
I20260709 13:15:46.622687  6259 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:46.822201  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 83721.1us
I20260709 13:15:46.827708  3091 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:46.827927  3194 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:46.823853  2948 catalog_manager.cc:5697] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.649315  6121 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:46.612038  6267 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:46.831845  6193 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.832125  5963 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:46.832470  3790 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.009s	sys 0.018s
I20260709 13:15:46.664985  6292 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:46.833272  6313 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:46.834532  6312 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:46.835129  6238 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:46.587781  6231 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.149s
W20260709 13:15:46.833320  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 93266.2us
I20260709 13:15:46.919377  3050 raft_consensus.cc:1217] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Deduplicated request from leader. Original: 2.1->[4.2-10.5]   Dedup: 6.3->[7.4-10.5]
I20260709 13:15:46.919898  3050 pending_rounds.cc:85] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 3
I20260709 13:15:46.920110  3050 pending_rounds.cc:107] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:15:46.920343  3050 raft_consensus.cc:2889] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:46.838929  2948 catalog_manager.cc:5697] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.922206  2948 catalog_manager.cc:5697] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 4 to 7, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 7 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.924266  2948 catalog_manager.cc:5697] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.612360  5840 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:46.658800  6109 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.171s
I20260709 13:15:46.920387  3762 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:15:46.577394  2947 rpcz_store.cc:269] 0709 13:15:25.893555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.893775 (+   220us) service_pool.cc:224] Handling call
0709 13:15:26.302391 (+408616us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b54000d98d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031d090 00007ff8303bbf3a 00007ff8361721cc 00007ff83627037e 00007ff8347312a4 00007ff834731232 00007ff834731161 00007ff8347310dc 00007ff834730392 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:46.562647 (+20260256us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:41.894078 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:41.894838 (+   760us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:41.894893 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:15:41.894934 (+    41us) tablet.cc:662] Decoding operations
0709 13:15:42.043262 (+148328us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:42.066442 (+ 23180us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:42.071030 (+  4588us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:15:42.179629 (+108599us) tablet.cc:701] Row locks acquired
0709 13:15:42.179686 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:15:42.179868 (+   182us) write_op.cc:270] Start()
0709 13:15:42.180055 (+   187us) write_op.cc:276] Timestamp: P: 1783602942179805 usec, L: 0
0709 13:15:42.180077 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:15:42.323065 (+142988us) log.cc:844] Serialized 9209 byte log entry
0709 13:15:42.564393 (+241328us) spinlock_profiling.cc:243] Waited 7.94 ms on lock 0x7b54000d98d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303aee28 00007ff833de9581 00007ff833de8d58 00007ff833ded9f1 00007ff833ded9a9 00007ff833ded939 00007ff833ded901 00007ff833decb2d 000000000038f354 000000000038f199
0709 13:15:42.929623 (+365230us) op_driver.cc:464] REPLICATION: finished
0709 13:15:43.049914 (+120291us) write_op.cc:301] APPLY: starting
0709 13:15:43.050053 (+   139us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:43.050770 (+   717us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:43.050827 (+    57us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:43.054512 (+  3685us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:43.055469 (+   957us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 13:15:43.055519 (+    50us) write_op.cc:312] APPLY: finished
0709 13:15:43.056155 (+   636us) log.cc:844] Serialized 158 byte log entry
0709 13:15:43.056384 (+   229us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:43.056601 (+   217us) write_op.cc:454] Released schema lock
0709 13:15:43.056685 (+    84us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:43.057247 (+   562us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:43.057292 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1256460,"reported_tablets":39,"spinlock_wait_cycles":8340736,"child_traces":[["op",{"apply.queue_time_us":119819,"apply.run_cpu_time_us":7301,"apply.run_wall_time_us":7308,"num_ops":23,"prepare.queue_time_us":110634,"prepare.run_cpu_time_us":27048,"prepare.run_wall_time_us":670548,"raft.queue_time_us":235564,"raft.run_cpu_time_us":21255,"raft.run_wall_time_us":129258,"replication_time_us":749368,"spinlock_wait_cycles":18257792,"thread_start_us":482189,"threads_started":4,"wal-append.queue_time_us":142662,"wal-append.run_cpu_time_us":13253,"wal-append.run_wall_time_us":1591215}]]}
I20260709 13:15:46.907663  3795 raft_consensus.cc:2368] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
I20260709 13:15:46.823047  5398 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:46.737404  6308 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:46.656546  6309 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:46.743160  6226 consensus_meta.cc:287] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.883s	user 0.009s	sys 0.003s
W20260709 13:15:46.829700  6286 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:15:46.735576  6085 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.686407  6274 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:46.735772  6157 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.830590  5828 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:46.927205  2948 catalog_manager.cc:5697] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.945148  2948 catalog_manager.cc:5697] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 5 to 8, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 8 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.740628  5995 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:46.934944  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:46.843062  6299 consensus_queue.cc:1059] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
W20260709 13:15:46.939770  3191 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.021s	sys 0.076s
W20260709 13:15:46.970521  3191 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.021s	sys 0.076s
I20260709 13:15:46.824617  6224 consensus_queue.cc:260] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:46.948671  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:46.971661  3119 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:46.948722  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:46.972787  3125 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:46.846256  6259 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:46.912029  5963 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:46.908257  6193 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:46.933974  6238 raft_consensus.cc:697] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:46.968765  6157 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:46.940325  6085 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:46.949828  6275 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:46.991113  3119 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:15:46.991323  6193 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:46.943609  6257 raft_consensus.cc:3055] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:46.991554  5849 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:15:47.007922  3090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.027s	sys 0.040s
W20260709 13:15:47.017238  3090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.027s	sys 0.040s
I20260709 13:15:46.969015  5995 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:46.992416  6238 consensus_queue.cc:237] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:46.948092  6308 raft_consensus.cc:697] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:46.994973  5840 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:46.996061  3795 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 458) took 1614 ms (client timeout 1766 ms). Trace:
I20260709 13:15:46.955761  6248 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:46.939635  6310 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:47.054093  6310 raft_consensus.cc:697] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:47.054908  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1999) took 1126 ms. Trace:
I20260709 13:15:47.055059  6310 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:47.055368  3199 rpcz_store.cc:276] 0709 13:15:45.928961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.929322 (+   361us) service_pool.cc:224] Handling call
0709 13:15:45.929732 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:46.035291 (+105559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:46.035338 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:46.035975 (+   637us) log.cc:844] Serialized 26 byte log entry
0709 13:15:46.367940 (+331965us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b180049b8e0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:15:46.669976 (+302036us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:46.670027 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.834716 (+164689us) spinlock_profiling.cc:243] Waited 91.3 ms on lock 0x7b54002bcad4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:46.834766 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:47.054662 (+219896us) raft_consensus.cc:1685] finished
0709 13:15:47.054682 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:47.054837 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32583,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":11295,"spinlock_wait_cycles":217530496,"thread_start_us":301817,"threads_started":1,"wal-append.queue_time_us":944319}
I20260709 13:15:46.997524  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1990) took 1305 ms. Trace:
I20260709 13:15:47.057062  3194 rpcz_store.cc:276] 0709 13:15:45.692366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.693421 (+  1055us) service_pool.cc:224] Handling call
0709 13:15:45.693795 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:46.828316 (+1134521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.997302 (+168986us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001dea54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:46.997469 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2607689984}
I20260709 13:15:46.998946  3125 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:15:47.062227  6267 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:47.063832  6224 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:47.067866  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:47.043314  3795 rpcz_store.cc:269] 0709 13:15:45.381509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.382842 (+  1333us) service_pool.cc:224] Handling call
0709 13:15:46.995861 (+1613019us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400653454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:46.995996 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3413409664}
I20260709 13:15:47.000506  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:46.954780  6156 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:46.955870  5398 raft_consensus.cc:697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:46.969852  5828 raft_consensus.cc:697] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:15:47.017954  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 614856us
I20260709 13:15:46.947177  6226 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:47.009265  6300 consensus_meta.cc:287] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.003s
I20260709 13:15:47.011936  6029 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:15:47.041148  5995 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:47.046424  6259 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:47.047962  6157 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:47.051548  5963 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:47.013052  6257 raft_consensus.cc:740] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:47.042758  6260 consensus_queue.cc:1059] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 13:15:47.092351  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 417640us
W20260709 13:15:47.120371  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 436558us
W20260709 13:15:47.124485  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.228873  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:47.229638  3051 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:47.143695  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 143273us
W20260709 13:15:47.167348  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 339510us
I20260709 13:15:47.233678  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:47.233783  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:47.236932  3045 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:47.138682  6129 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:47.183144  3198 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:15:47.182331  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 79616.4us
I20260709 13:15:47.240587  3165 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:47.241003  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:47.186488  6233 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:47.228993  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 391236us
I20260709 13:15:47.185158  5849 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.182837  6283 raft_consensus.cc:3055] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:47.066066  6308 consensus_queue.cc:237] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:47.042085  6044 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:47.264238  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:47.264793  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:47.265759  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:47.266420  3119 raft_consensus.cc:2368] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
I20260709 13:15:47.267163  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:47.268220  6317 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.268767  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:47.270686  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:47.271404  6259 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.271904  6259 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:47.272362  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:47.275308  6210 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.275888  6210 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:47.192092  6253 raft_consensus.cc:697] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:47.262777  3761 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:47.262866  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:47.262931  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:47.281243  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:47.283398  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:47.284474  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:47.313493  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 50796.7us
I20260709 13:15:47.317081  3045 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:15:47.318190  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:47.320978  3194 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:47.185410  6175 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:47.286635  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:47.292363  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 45484.2us
I20260709 13:15:47.331409  3164 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:47.294653  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1994) took 1596 ms. Trace:
I20260709 13:15:47.332297  3198 rpcz_store.cc:276] 0709 13:15:45.698645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.698760 (+   115us) service_pool.cc:224] Handling call
0709 13:15:45.699029 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:47.239503 (+1540474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.281919 (+ 42416us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400178754. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:47.294593 (+ 12674us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3323644288}
I20260709 13:15:47.282702  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:47.333757  3193 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:47.338886  3015 connection.cc:256] RPC call timeout handler was delayed by -1.2776286590001291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 13:15:47.339509  3015 connection.cc:256] RPC call timeout handler was delayed by -1.2137286590000258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 13:15:47.339953  3015 connection.cc:256] RPC call timeout handler was delayed by -1.2137286590000258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 13:15:47.340410  3015 connection.cc:256] RPC call timeout handler was delayed by -1.190328658999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
I20260709 13:15:47.295341  3051 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:15:47.331780  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:47.351197  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:47.351613  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:47.251525  6275 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:47.256426  6278 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:47.358467  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:47.359779  3119 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:47.353322  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:47.353592  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:47.314957  3200 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:47.361074  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:47.355826  3193 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:47.356253  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:47.260627  6291 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:47.367066  3795 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:47.367331  3117 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:15:47.368100  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:47.368914  3797 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:47.363356  3793 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 9: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:47.256171  6283 raft_consensus.cc:740] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:47.362581  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:47.364356  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 117295us
W20260709 13:15:47.364877  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 73835.3us
I20260709 13:15:47.360925  3118 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:47.259554  6199 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:47.379581  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:47.377702  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 111476us
W20260709 13:15:47.389339  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 58064.6us
I20260709 13:15:47.391613  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:47.392069  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:47.392943  3793 raft_consensus.cc:2368] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8.
I20260709 13:15:47.393155  3762 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:47.396237  5767 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:47.396762  5767 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.397193  5767 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:47.401873  3049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:35708
I20260709 13:15:47.402513  3049 raft_consensus.cc:606] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Received request to transfer leadership
I20260709 13:15:47.249660  6212 consensus_queue.cc:1059] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:15:47.252310  6129 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:47.317767  6312 raft_consensus.cc:697] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:47.405701  3799 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:47.358438  6293 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:47.460500  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:47.417220  6319 log.cc:927] Time spent T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 13:15:47.278950  6267 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.105s
I20260709 13:15:47.358080  6275 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.420693  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 400) took 1249 ms. Trace:
I20260709 13:15:47.268743  6317 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:47.379253  6291 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.279655  5849 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:47.493269  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:47.508334  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 45952.7us
I20260709 13:15:47.389753  6210 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:47.485921  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 76995.6us
I20260709 13:15:47.410542  6299 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:47.498445  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:47.359611  6260 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:15:47.367358  6233 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
I20260709 13:15:47.363514  6175 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:47.420419  6259 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:47.460062  6293 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.522927  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:47.459661  6287 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.523694  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:47.525934  3047 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:47.529237  3126 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:15:47.500452  6275 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:47.573849  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 62617.4us
W20260709 13:15:47.576614  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 216643us
I20260709 13:15:47.363842  6257 consensus_queue.cc:260] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:47.507982  6291 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:47.510870  6029 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.577549  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:47.524518  6313 raft_consensus.cc:3055] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:47.608083  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:47.577667  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:47.529177  6226 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:47.403837  5828 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:47.522315  6125 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 13:15:47.448442  5398 consensus_queue.cc:237] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:47.621452  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:47.710147  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:47.574360  6293 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:47.597587  6320 log.cc:927] Time spent T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.410s	user 0.001s	sys 0.000s
I20260709 13:15:47.680640  6335 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
W20260709 13:15:47.710175  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.648483  6029 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:47.681270  6288 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:15:47.606410  5840 consensus_queue.cc:1175] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "501fdf2af2bc4b0c971ae880e98f466b" responder_term: 5 status { last_received { term: 5 index: 3 } last_committed_idx: 2 last_received_current_leader { term: 5 index: 3 } }
I20260709 13:15:47.597324  6253 consensus_queue.cc:237] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:47.586642  6299 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.610594  6324 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:15:47.651558  6286 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:15:47.579329  6287 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:47.769425  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:47.523237  6283 consensus_queue.cc:260] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:47.757341  3799 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
W20260709 13:15:47.709538  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 315124us
W20260709 13:15:47.654062  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 76602.9us
I20260709 13:15:47.734395  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:47.876366  6292 consensus_meta.cc:287] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.947s	user 0.007s	sys 0.000s
W20260709 13:15:47.902048  6344 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:15:47.897439  6175 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:47.880903  6274 consensus_meta.cc:287] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.919s	user 0.007s	sys 0.000s
I20260709 13:15:47.863868  6329 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.882627  6044 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:47.729175  6349 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.160s
W20260709 13:15:47.880488  6122 consensus_meta.cc:287] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.224s	user 0.010s	sys 0.000s
W20260709 13:15:47.877521  6336 log.cc:927] Time spent T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.329s	user 0.000s	sys 0.000s
I20260709 13:15:47.903685  6353 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:47.606868  6313 raft_consensus.cc:740] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:47.866673  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2149) took 1366 ms. Trace:
W20260709 13:15:47.876413  6121 consensus_meta.cc:287] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.993s	user 0.008s	sys 0.000s
W20260709 13:15:47.730803  6318 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.512s	user 0.001s	sys 0.001s
I20260709 13:15:47.877314  5849 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:47.868636  6225 consensus_meta.cc:287] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.302s	user 0.009s	sys 0.000s
I20260709 13:15:47.936049  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:47.927453  6211 consensus_meta.cc:287] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.315s	user 0.007s	sys 0.000s
I20260709 13:15:47.680696  6333 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.869999  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:47.957103  6029 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:47.948563  6157 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.000s	sys 0.008s
I20260709 13:15:48.033229  6210 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:48.056077  6210 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:48.015609  6292 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:48.060770  6292 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:48.063591  6224 consensus_meta.cc:287] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.999s	user 0.012s	sys 0.000s
I20260709 13:15:48.028107  6122 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:47.972008  6085 consensus_meta.cc:287] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.934s	user 0.005s	sys 0.005s
I20260709 13:15:47.996410  6278 consensus_queue.cc:1059] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:48.012347  3762 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:15:48.014015  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 279697us
W20260709 13:15:48.071748  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.072326  3761 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:48.017547  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 492158us
I20260709 13:15:48.018539  3015 leader_election.cc:400] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
W20260709 13:15:48.024092  3016 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.010s	sys 0.004s
I20260709 13:15:48.074581  3015 leader_election.cc:403] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:15:48.074776  3016 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.010s	sys 0.004s
I20260709 13:15:47.712177  6312 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:48.027995  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:48.016813  5995 consensus_meta.cc:287] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.793s	user 0.010s	sys 0.001s
I20260709 13:15:48.029968  3795 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:48.030524  3043 rpcz_store.cc:276] 0709 13:15:46.500216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.506154 (+  5938us) service_pool.cc:224] Handling call
0709 13:15:46.506441 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:46.506765 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:46.506794 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:46.507199 (+   405us) log.cc:844] Serialized 26 byte log entry
0709 13:15:46.938584 (+431385us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:46.938649 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.938747 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:47.866457 (+927710us) raft_consensus.cc:1685] finished
0709 13:15:47.866478 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:47.866612 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7346,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":430952,"threads_started":1,"wal-append.queue_time_us":623955}
W20260709 13:15:48.033200  3165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.010s	sys 0.005s
I20260709 13:15:48.036660  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:48.028574  6309 consensus_meta.cc:287] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.066s	user 0.011s	sys 0.000s
I20260709 13:15:48.022095  6317 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:48.020833  6347 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:48.025605  6274 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10.
I20260709 13:15:48.090319  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:47.998037  6299 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:48.051105  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.047248  6225 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:48.052431  6313 consensus_queue.cc:260] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:48.054600  6323 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.017277  6324 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:48.078770  3165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.010s	sys 0.005s
W20260709 13:15:48.097591  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.099407  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:48.100158  3200 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:48.035053  6353 raft_consensus.cc:697] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:48.092422  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:48.093298  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 81048us
I20260709 13:15:48.093832  5398 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:48.096468  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:48.101341  3193 raft_consensus.cc:1275] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:48.102563  3195 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:48.102916  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:48.104802  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:48.112509  3199 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:48.101222  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:48.040056  6121 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:48.121693  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:48.125483  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:48.091749  6231 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:15:48.127292  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.127813  3192 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:48.119731  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:48.156651  3200 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:15:48.157341  3792 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEARNER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:48.107604  6260 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.085500  5995 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:48.155871  3194 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:48.159092  6225 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:48.076805  6085 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:48.158905  6327 consensus_queue.cc:1059] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:15:48.158425  6287 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:48.027874  6329 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:48.190434  6085 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:48.190802  6329 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:48.114931  6325 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.107292  6331 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:48.155958  3197 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:15:48.164875  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2148) took 1674 ms. Trace:
I20260709 13:15:48.149255  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:48.165601  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:48.193698  3042 rpcz_store.cc:276] 0709 13:15:46.490206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.490365 (+   159us) service_pool.cc:224] Handling call
0709 13:15:46.498156 (+  7791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:46.498500 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:46.498527 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:46.498943 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 13:15:46.972981 (+474038us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:46.973018 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.973082 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:48.164660 (+1191578us) raft_consensus.cc:1685] finished
0709 13:15:48.164681 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.164807 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7504,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":71,"thread_start_us":473068,"threads_started":1,"wal-append.queue_time_us":639355}
I20260709 13:15:48.169368  6122 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:48.170241  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:48.170688  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 64126.8us
I20260709 13:15:48.173190  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:48.170884  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 63096.9us
I20260709 13:15:48.068536  6333 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:48.166458  6313 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:48.178972  6349 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
W20260709 13:15:48.165055  5767 consensus_meta.cc:287] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.765s	user 0.019s	sys 0.000s
I20260709 13:15:48.181084  5995 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:48.181998  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:48.182368  6231 raft_consensus.cc:697] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:48.183121  5398 raft_consensus.cc:697] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:48.183245  6292 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.185971  6274 consensus_queue.cc:1059] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:48.115546  6323 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:48.091605  6309 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:48.574512  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 556165us
I20260709 13:15:47.494586  3191 rpcz_store.cc:276] 0709 13:15:46.170903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.171024 (+   121us) service_pool.cc:224] Handling call
0709 13:15:46.254069 (+ 83045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:46.254257 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:46.424321 (+170064us) spinlock_profiling.cc:243] Waited 7.68 ms on lock 0x7b180039f520. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:15:46.971098 (+546777us) log.cc:844] Serialized 14 byte log entry
0709 13:15:47.420322 (+449224us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:47.420379 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:47.420431 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.420516 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:47.420639 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62735,"prepare.queue_time_us":48148,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":63171,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":33510,"spinlock_wait_cycles":17665792,"thread_start_us":983287,"threads_started":2}
I20260709 13:15:48.146898  3790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 434) took 2771 ms. Trace:
I20260709 13:15:48.242166  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:48.948225  3194 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:48.949334  3043 raft_consensus.cc:2410] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:15:48.253046  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:48.217196  3123 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:48.329388  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:48.951907  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 1772) took 1599 ms. Trace:
I20260709 13:15:48.253269  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:48.195865  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:48.952469  3126 rpcz_store.cc:276] 0709 13:15:47.352546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.353135 (+   589us) service_pool.cc:224] Handling call
0709 13:15:48.951722 (+1598587us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540031a454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:48.951825 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342001536}
I20260709 13:15:48.953699  3193 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:48.959036  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:48.959865  3197 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:48.961982  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:48.963414  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:48.966974  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:48.946409  5398 consensus_queue.cc:237] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:48.986828  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:48.987571  3193 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:48.988520  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:48.626147  6361 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:15:49.004922  3193 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:15:48.271837  6275 consensus_meta.cc:287] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.665s	user 0.003s	sys 0.008s
I20260709 13:15:49.008427  6275 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.009843  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:49.010645  6275 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:49.011092  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:49.013401  3198 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:49.013581  3194 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:15:49.014988  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:49.015718  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:49.016600  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:49.016621  3198 raft_consensus.cc:2410] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:15:48.270750  6226 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:48.265039  6351 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.364s	user 0.002s	sys 0.000s
W20260709 13:15:48.748169  6291 consensus_meta.cc:287] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.099s	user 0.011s	sys 0.001s
W20260709 13:15:48.634795  6293 consensus_meta.cc:287] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.817s	user 0.009s	sys 0.002s
W20260709 13:15:48.257121  6358 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:15:48.929418  6367 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.394s	user 0.000s	sys 0.000s
I20260709 13:15:49.024410  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:48.990342  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:48.992336  3047 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.009s	sys 0.033s
W20260709 13:15:49.068353  3047 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.009s	sys 0.033s
W20260709 13:15:49.023113  6337 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 1.116s	user 0.010s	sys 0.016s
I20260709 13:15:48.999514  3042 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:48.461621  6329 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:48.466060  6362 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.351s	user 0.000s	sys 0.001s
W20260709 13:15:48.668665  6366 log.cc:927] Time spent T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:15:48.253147  6331 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:49.006228  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:49.007169  6333 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:48.193766  6260 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:49.013477  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:48.667462  6363 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:15:48.946332  6257 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:49.017493  3194 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:48.425616  6224 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.163972  6248 consensus_queue.cc:1059] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.822s
I20260709 13:15:48.667762  6359 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.274717  6210 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:48.270763  6353 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:48.967124  6283 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:49.045038  6308 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.006s	sys 0.009s
W20260709 13:15:49.096022  5828 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.001s	sys 0.018s
W20260709 13:15:49.069492  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 124837us
I20260709 13:15:49.067032  6226 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.069224  3197 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:48.998657  3043 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:48.992137  5995 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:49.096962  6333 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:49.023643  6085 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.024333  6328 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:49.018661  6287 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.192624  6325 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:48.954108  6292 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:49.144394  6325 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:49.144454  6292 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:49.093546  6231 consensus_queue.cc:237] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:49.088122  3122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.016s	sys 0.033s
I20260709 13:15:49.133177  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:49.148403  3122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.017s	sys 0.033s
I20260709 13:15:49.140380  6210 raft_consensus.cc:3055] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:49.149895  6210 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:49.150668  6210 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.151803  6210 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:49.117928  6377 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.140162  5995 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:49.155396  6331 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:49.156335  5995 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:49.157001  6085 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:49.159771  3193 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:49.127650  6382 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:15:49.162416  6382 consensus_queue.cc:1243] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:49.163617  6129 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:49.062173  6109 raft_consensus.cc:3055] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:49.094966  3042 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
W20260709 13:15:49.100778  3121 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.005s	sys 0.013s
W20260709 13:15:49.174221  3121 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.005s	sys 0.013s
W20260709 13:15:49.100837  3118 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.004s	sys 0.014s
W20260709 13:15:49.101306  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 925055us
I20260709 13:15:48.511272  6278 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:49.065182  6356 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:15:48.966423  6324 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:49.093269  6369 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.066185  6291 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:48.948016  5767 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:49.133894  3194 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:49.136540  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:49.070554  6293 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:49.126693  6308 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.007s	sys 0.009s
W20260709 13:15:49.129751  5828 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.002s	sys 0.018s
I20260709 13:15:49.088120  6329 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:49.171722  6364 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.636s	user 0.003s	sys 0.008s
W20260709 13:15:49.174688  3118 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.004s	sys 0.014s
I20260709 13:15:49.185258  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2016) took 1030 ms. Trace:
I20260709 13:15:49.199146  3194 rpcz_store.cc:276] 0709 13:15:48.154569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.016273 (+861704us) service_pool.cc:224] Handling call
0709 13:15:49.185185 (+168912us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:49.189262  3126 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:15:49.187960  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 51476.2us
I20260709 13:15:49.201782  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:49.189456  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1770) took 1898 ms. Trace:
I20260709 13:15:49.202699  3121 rpcz_store.cc:276] 0709 13:15:47.291399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.295989 (+  4590us) service_pool.cc:224] Handling call
0709 13:15:47.296441 (+   452us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:47.316653 (+ 20212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.316686 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:15:47.358374 (+ 41688us) log.cc:844] Serialized 78 byte log entry
0709 13:15:48.017166 (+658792us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:48.264022 (+246856us) spinlock_profiling.cc:243] Waited 8.13 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:49.176398 (+912376us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.176846 (+   448us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.177002 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.177078 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.189101 (+ 12023us) raft_consensus.cc:1685] finished
0709 13:15:49.189135 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.189383 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":475427,"prepare.queue_time_us":508785,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":20342,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":10221,"spinlock_wait_cycles":18703744,"thread_start_us":1170862,"threads_started":2,"wal-append.queue_time_us":512598}
I20260709 13:15:49.137638  6355 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:49.118973  6224 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.171424  6328 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:49.173219  6109 raft_consensus.cc:740] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:49.215415  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:49.154110  6377 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:49.335191  3121 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:49.337028  6377 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:49.120594  6359 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.339949  6359 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:49.186003  6295 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:49.340889  6295 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.185931  6275 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.342640  6275 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:48.956594  3790 rpcz_store.cc:276] 0709 13:15:45.350643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.352144 (+  1501us) service_pool.cc:224] Handling call
0709 13:15:45.409428 (+ 57284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.426050 (+ 16622us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:45.882500 (+456450us) log.cc:844] Serialized 14 byte log entry
0709 13:15:47.881659 (+1999159us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b1800401bc0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82ff5b4bc 00007ff82d2a948b 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c3455 00007ff833dab3c7 00007ff8303bd9a7 00007ff8303cd0bf
0709 13:15:47.881862 (+   203us) log.cc:844] Serialized 14 byte log entry
0709 13:15:48.081313 (+199451us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:48.090021 (+  8708us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:48.096021 (+  6000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.106608 (+ 10587us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.121842 (+ 15234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24619,"prepare.queue_time_us":1494274,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":98,"raft.queue_time_us":100370,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":19666,"spinlock_wait_cycles":219441280,"thread_start_us":1909742,"threads_started":5,"wal-append.queue_time_us":561905,"wal-append.run_cpu_time_us":1264,"wal-append.run_wall_time_us":1103098}
I20260709 13:15:49.184141  6278 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:49.166015  6287 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.346320  6278 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:49.347123  6287 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:49.191987  6129 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:49.348578  6129 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:49.349218  6129 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:49.224304  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:49.350613  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 126380us
I20260709 13:15:49.352187  6331 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:49.352877  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:49.352984  6331 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:49.229916  6379 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:49.354264  6379 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:49.230530  3798 raft_consensus.cc:2368] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
I20260709 13:15:49.231791  6328 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:49.232550  6381 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:49.355995  6381 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:49.356879  6379 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:49.233136  6109 consensus_queue.cc:260] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.359364  6109 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:49.207337  6292 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.235064  3792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 436) took 3870 ms. Trace:
I20260709 13:15:49.361985  3792 rpcz_store.cc:276] 0709 13:15:45.364244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.374209 (+  9965us) service_pool.cc:224] Handling call
0709 13:15:48.123624 (+2749415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.166140 (+ 42516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.234841 (+1068701us) spinlock_profiling.cc:243] Waited 2.69 s on lock 0x7b54004af1d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:49.234999 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6184700288}
I20260709 13:15:49.235312  6085 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:49.236989  6342 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 1.334s	user 0.031s	sys 0.012s
W20260709 13:15:49.362843  6331 consensus_queue.cc:1175] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "501fdf2af2bc4b0c971ae880e98f466b" responder_term: 6 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: [5.2-5.2]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:49.235908  5767 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:49.237658  6293 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:49.240722  3193 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:15:49.192551  6369 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.364497  3193 pending_rounds.cc:85] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 3
I20260709 13:15:49.364909  3193 pending_rounds.cc:107] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:15:49.365293  3193 raft_consensus.cc:2889] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:49.366962  6369 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:49.166893  6333 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.370075  6333 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:49.249826  6309 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:49.370632  6381 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:49.249876  6385 consensus_queue.cc:1059] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:49.184507  6378 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:15:49.257161  6299 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:49.213860  6355 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.210227  5828 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:15:49.247313  6368 log.cc:927] Time spent T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.712s	user 0.004s	sys 0.007s
I20260709 13:15:49.259439  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:49.373553  5828 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:49.374351  3200 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:49.375630  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:49.376355  3200 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:15:49.259315  6374 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:15:49.263983  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:49.378407  3196 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:49.379061  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1766) took 2089 ms. Trace:
I20260709 13:15:49.376663  5828 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:49.271682  6326 log.cc:927] Time spent T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 1.369s	user 0.008s	sys 0.005s
I20260709 13:15:49.380925  3796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 439) took 2050 ms. Trace:
W20260709 13:15:49.273996  6354 log.cc:927] Time spent T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 1.372s	user 0.016s	sys 0.017s
W20260709 13:15:49.270349  6339 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 1.366s	user 0.009s	sys 0.032s
I20260709 13:15:49.381781  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2150) took 2881 ms. Trace:
I20260709 13:15:49.382157  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:49.301306  3795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 588) took 1899 ms. Trace:
I20260709 13:15:49.303134  6360 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.281675  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 1818) took 1255 ms. Trace:
I20260709 13:15:49.311307  6121 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:49.313699  6335 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:49.383195  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:49.383772  6335 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:49.384223  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 439) took 2442 ms. Trace:
I20260709 13:15:49.307905  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1830) took 1779 ms. Trace:
I20260709 13:15:49.382987  3795 rpcz_store.cc:276] 0709 13:15:47.402224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.402572 (+   348us) service_pool.cc:224] Handling call
0709 13:15:47.454992 (+ 52420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.085931 (+630939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.300930 (+1214999us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54006ea0d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:49.301204 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1321757568}
W20260709 13:15:49.315632  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 50283us
I20260709 13:15:49.386132  6335 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:49.384778  3120 rpcz_store.cc:276] 0709 13:15:46.941325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.941469 (+   144us) service_pool.cc:224] Handling call
0709 13:15:46.948224 (+  6755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:47.041886 (+ 93662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.041914 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:47.045358 (+  3444us) log.cc:844] Serialized 26 byte log entry
0709 13:15:47.226299 (+180941us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b18004193e0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:15:47.392930 (+166631us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:47.392989 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.487401 (+ 94412us) spinlock_profiling.cc:243] Waited 93.1 ms on lock 0x7b54000a9454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:47.488980 (+  1579us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.269597 (+1780617us) spinlock_profiling.cc:243] Waited 29.7 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:49.383953 (+114356us) raft_consensus.cc:1685] finished
0709 13:15:49.383979 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.384140 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1364,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":155,"spinlock_wait_cycles":344011136,"thread_start_us":166434,"threads_started":1,"wal-append.queue_time_us":858118}
I20260709 13:15:49.386821  6335 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:49.386715  6348 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:49.387349  6335 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:15:49.318629  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:49.319366  6365 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.785s	user 0.003s	sys 0.008s
I20260709 13:15:49.383527  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1764) took 2094 ms. Trace:
I20260709 13:15:49.319291  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:49.387663  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:49.387861  6335 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:49.389226  3120 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:49.294791  6350 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 1.397s	user 0.002s	sys 0.030s
I20260709 13:15:49.323599  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:49.381281  3796 rpcz_store.cc:276] 0709 13:15:47.330336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.330454 (+   118us) service_pool.cc:224] Handling call
0709 13:15:47.383283 (+ 52829us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:47.578597 (+195314us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:48.024683 (+446086us) log.cc:844] Serialized 14 byte log entry
0709 13:15:48.165549 (+140866us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:48.176831 (+ 11282us) log.cc:844] Serialized 52 byte log entry
0709 13:15:48.177058 (+   227us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:48.177091 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.246537 (+1069446us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:49.258420 (+ 11883us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5400494154. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:49.258479 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.380705 (+122226us) raft_consensus.cc:1685] finished
0709 13:15:49.380725 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.380870 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53999,"prepare.queue_time_us":328485,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":81552,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":149471,"spinlock_wait_cycles":499664384,"thread_start_us":283064,"threads_started":2,"wal-append.queue_time_us":140688}
I20260709 13:15:49.325100  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:49.388690  6348 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:49.398619  6348 raft_consensus.cc:697] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 6 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:49.399219  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:49.399868  6348 consensus_queue.cc:237] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.400810  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:49.362053  6292 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:49.239885  6224 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:49.379592  3122 rpcz_store.cc:276] 0709 13:15:47.290092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.290206 (+   114us) service_pool.cc:224] Handling call
0709 13:15:47.351239 (+ 61033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:47.421706 (+ 70467us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:48.058263 (+636557us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b4800002dd8. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff8352dcaa1 00007ff8352d3b37 00007ff8352d39ca 00007ff8353cb26f 00007ff8353caf37 00007ff8353df55c 00007ff8353df508 00007ff8353df488 00007ff8353df443 00007ff8353de6ec 00007ff834308a96
0709 13:15:48.329828 (+271565us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b180035abe0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d240c0a 00007ff836980219 00007ff82d2c8a40 00007ff82d2c34e4 00007ff82d2c3455 00007ff833dab3c7 00007ff8303bd9a7 00007ff8303cd0bf 00007ff8303cd038
0709 13:15:48.330204 (+   376us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.149232 (+819028us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:49.149703 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:15:49.149865 (+   162us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:49.149906 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.149979 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.378819 (+228840us) raft_consensus.cc:1685] finished
0709 13:15:49.378841 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.378984 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":154696,"prepare.queue_time_us":1002732,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":119283,"raft.run_cpu_time_us":24871,"raft.run_wall_time_us":618646,"spinlock_wait_cycles":56978560,"thread_start_us":818471,"threads_started":1,"wal-append.queue_time_us":814881}
I20260709 13:15:49.364594  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2166) took 2099 ms. Trace:
I20260709 13:15:49.208377  6324 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.403735  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:49.379719  6378 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:49.404436  3122 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:49.380219  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2030) took 1195 ms. Trace:
I20260709 13:15:49.403947  3048 rpcz_store.cc:276] 0709 13:15:47.265456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.266428 (+   972us) service_pool.cc:224] Handling call
0709 13:15:47.266719 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:47.267005 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.267032 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:47.267483 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:15:47.420970 (+153487us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:47.421008 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.421073 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.236421 (+1815348us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:49.364266 (+127845us) raft_consensus.cc:1685] finished
0709 13:15:49.364288 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.364512 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22949,"raft.queue_time_us":236482,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":19108,"spinlock_wait_cycles":70175104,"thread_start_us":152711,"threads_started":1,"wal-append.queue_time_us":635299}
I20260709 13:15:49.405445  3196 rpcz_store.cc:276] 0709 13:15:48.185297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.379200 (+1193903us) service_pool.cc:224] Handling call
0709 13:15:49.379597 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.379788 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:49.379827 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:49.379882 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:49.379927 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.380003 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.380151 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:49.269140  3192 raft_consensus.cc:2410] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:49.384042  6360 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.406998  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:49.407294  6122 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.382265  3044 rpcz_store.cc:276] 0709 13:15:46.500526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.507670 (+  7144us) service_pool.cc:224] Handling call
0709 13:15:46.508013 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:46.596774 (+ 88761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:46.596803 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:46.610978 (+ 14175us) log.cc:844] Serialized 52 byte log entry
0709 13:15:47.133670 (+522692us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:47.133728 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.133848 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.270995 (+2137147us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:49.381434 (+110439us) raft_consensus.cc:1685] finished
0709 13:15:49.381456 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.381701 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11186,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":16212,"spinlock_wait_cycles":70847872,"thread_start_us":377004,"threads_started":1,"wal-append.queue_time_us":1239027}
I20260709 13:15:49.407859  6122 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.321506  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:49.408649  6360 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:49.313894  6267 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:49.408836  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:49.403754  6292 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:49.321831  6226 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:49.396261  6381 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.388985  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 440) took 1980 ms. Trace:
I20260709 13:15:49.409427  6267 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.409888  6381 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.410660  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:49.409101  3051 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:49.417867  3049 raft_consensus.cc:2393] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:49.418514  3126 rpcz_store.cc:276] 0709 13:15:48.026502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.005924 (+979422us) service_pool.cc:224] Handling call
0709 13:15:49.281381 (+275457us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54004781d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:49.281587 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238477056}
I20260709 13:15:49.422854  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:49.404150  6324 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.424070  3049 raft_consensus.cc:2410] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:15:49.408133  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:49.411597  6267 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:49.429837  3048 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:15:49.431488  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:49.412247  6381 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:49.410035  3117 rpcz_store.cc:276] 0709 13:15:47.408760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.408919 (+   159us) service_pool.cc:224] Handling call
0709 13:15:47.482133 (+ 73214us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:47.522413 (+ 40280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.522450 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:47.551222 (+ 28772us) log.cc:844] Serialized 26 byte log entry
0709 13:15:47.937597 (+386375us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:47.937648 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.937714 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.312214 (+1374500us) spinlock_profiling.cc:243] Waited 86.7 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:49.388660 (+ 76446us) raft_consensus.cc:1685] finished
0709 13:15:49.388687 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.388917 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":490072,"raft.queue_time_us":45847,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":52075,"spinlock_wait_cycles":199506176,"thread_start_us":385918,"threads_started":1,"wal-append.queue_time_us":706077}
I20260709 13:15:49.388485  3124 rpcz_store.cc:276] 0709 13:15:47.289411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.291506 (+  2095us) service_pool.cc:224] Handling call
0709 13:15:47.291828 (+   322us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:47.407362 (+115534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.407404 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:47.455674 (+ 48270us) log.cc:844] Serialized 52 byte log entry
0709 13:15:48.061729 (+606055us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b18004194a0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82ff5b4bc 00007ff82d2a948b 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1
0709 13:15:48.061918 (+   189us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:48.061960 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.062032 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.273022 (+1210990us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:49.383303 (+110281us) raft_consensus.cc:1685] finished
0709 13:15:49.383333 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.383469 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":132343,"raft.queue_time_us":129346,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":39289,"spinlock_wait_cycles":109563008,"thread_start_us":9630,"threads_started":1,"wal-append.queue_time_us":402075}
I20260709 13:15:49.471519  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:49.384953  3047 rpcz_store.cc:276] 0709 13:15:47.528621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.811912 (+283291us) service_pool.cc:224] Handling call
0709 13:15:47.812315 (+   403us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:48.191809 (+379494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.191838 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:48.192372 (+   534us) log.cc:844] Serialized 52 byte log entry
0709 13:15:49.077250 (+884878us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:49.077301 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.293282 (+215981us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54000f32d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:49.293386 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.293461 (+    75us) raft_consensus.cc:1685] finished
0709 13:15:49.293483 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.307784 (+ 14301us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25328,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":90255,"spinlock_wait_cycles":871869696,"thread_start_us":875978,"threads_started":1,"wal-append.queue_time_us":931796}
W20260709 13:15:49.472417  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 138380us
I20260709 13:15:49.324851  6329 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:49.436391  3051 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:49.314772  6260 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:49.317469  3125 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:49.445593  3200 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
W20260709 13:15:49.457237  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 74103.4us
I20260709 13:15:49.323215  6323 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:49.474403  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:49.526504  3121 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:15:49.527390  3048 raft_consensus.cc:2410] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:15:49.476944  3165 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:49.481562  3122 raft_consensus.cc:2410] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:15:49.528756  3121 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260709 13:15:49.436990  3044 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:49.525058  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:49.532773  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:49.533196  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:49.533656  3794 raft_consensus.cc:2410] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:15:49.535181  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:49.535862  3044 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:49.537490  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:49.539889  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:49.530298  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1830) took 1489 ms. Trace:
I20260709 13:15:49.542049  3122 rpcz_store.cc:276] 0709 13:15:48.041217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.529390 (+1488173us) service_pool.cc:224] Handling call
0709 13:15:49.529723 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.529967 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:49.530003 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:49.530051 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:49.530087 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.530145 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.530250 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:49.518384  3120 raft_consensus.cc:2410] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:49.547273  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1828) took 1507 ms. Trace:
I20260709 13:15:49.547807  3121 rpcz_store.cc:276] 0709 13:15:48.040476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.527767 (+1487291us) service_pool.cc:224] Handling call
0709 13:15:49.528407 (+   640us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:49.532165 (+  3758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.547203 (+ 15038us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:49.550266  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:49.516976  6211 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.516552  6225 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.551736  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:49.553858  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 82432.5us
I20260709 13:15:49.555769  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:49.545257  3015 leader_election.cc:400] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
I20260709 13:15:49.524811  6267 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:49.516717  6377 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:49.558882  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2019) took 1396 ms. Trace:
I20260709 13:15:49.559585  3015 leader_election.cc:403] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:15:49.526186  6125 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.525056  6129 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.544450  6260 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:49.647050  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 91416.2us
W20260709 13:15:49.730365  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 185202us
W20260709 13:15:49.626771  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 239629us
W20260709 13:15:49.570158  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.568706  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:49.733654  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:49.732517  3164 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:49.563036  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 86189.4us
I20260709 13:15:49.587044  3090 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:49.736513  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:49.600229  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:49.729557  3197 rpcz_store.cc:276] 0709 13:15:48.162269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.132817 (+970548us) service_pool.cc:224] Handling call
0709 13:15:49.164490 (+ 31673us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:49.164847 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:49.164873 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:49.170049 (+  5176us) log.cc:844] Serialized 564 byte log entry
0709 13:15:49.545715 (+375666us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:49.545769 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.546079 (+   310us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.558532 (+ 12453us) raft_consensus.cc:1685] finished
0709 13:15:49.558559 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.558781 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":375297,"threads_started":1,"wal-append.queue_time_us":386487}
W20260709 13:15:49.645364  3798 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 470) took 2135 ms (client timeout 2131 ms). Trace:
W20260709 13:15:49.563299  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:49.655763  3762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.004s	sys 0.016s
I20260709 13:15:49.734472  3047 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
W20260709 13:15:49.712872  6391 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:15:49.655071  3089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.006s	sys 0.015s
W20260709 13:15:49.656013  3761 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.002s	sys 0.018s
W20260709 13:15:49.776103  3089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.008s	sys 0.017s
W20260709 13:15:49.776288  3761 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.005s	sys 0.020s
W20260709 13:15:49.776660  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 656982us
I20260709 13:15:49.777064  3165 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:49.606858  6323 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:49.740971  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.779953  3165 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:49.649168  6355 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:49.739135  3798 rpcz_store.cc:269] 0709 13:15:47.510208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.649016 (+138808us) service_pool.cc:224] Handling call
0709 13:15:49.645136 (+1996120us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54005a19d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:49.645284 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2680862592}
W20260709 13:15:49.741144  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 154242us
I20260709 13:15:49.735596  6260 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:49.743603  6387 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:49.739429  6353 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:49.790395  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:49.746353  6313 consensus_meta.cc:287] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.780s	user 0.012s	sys 0.000s
I20260709 13:15:49.747733  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2015) took 1593 ms. Trace:
I20260709 13:15:49.559511  6211 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:49.621587  6327 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.022s	sys 0.009s
W20260709 13:15:49.749970  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.731288  6329 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
I20260709 13:15:49.751336  6369 consensus_queue.cc:1059] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:49.786223  6226 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:49.753237  6291 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:49.749827  6238 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:49.758488  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1824) took 1731 ms. Trace:
I20260709 13:15:49.740092  6377 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.606813  6248 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:49.800061  6327 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.029s	sys 0.025s
I20260709 13:15:49.763870  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 442) took 2314 ms. Trace:
I20260709 13:15:49.795346  6353 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:49.767539  6129 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:49.769268  3164 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:49.822715  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 53574.1us
I20260709 13:15:49.770183  6283 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:49.772526  3042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 1837) took 1591 ms (client timeout 1623 ms). Trace:
I20260709 13:15:49.553179  6324 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:49.646149  6311 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:49.649902  6392 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:49.778508  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:49.712414  2935 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 43731.8us
W20260709 13:15:49.740674  3762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.004s	sys 0.020s
I20260709 13:15:49.742419  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:49.786248  3165 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:49.790570  3796 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:15:49.559587  6225 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.831971  6225 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:49.792022  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:49.832993  3798 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:15:49.745412  3043 raft_consensus.cc:2410] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 7 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:49.798111  3199 raft_consensus.cc:2410] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:15:49.798022  3761 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:49.834877  6274 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.835670  6274 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:49.837579  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1826) took 1807 ms. Trace:
I20260709 13:15:49.838997  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2018) took 1683 ms. Trace:
I20260709 13:15:49.838181  3124 rpcz_store.cc:276] 0709 13:15:48.030406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.470677 (+1440271us) service_pool.cc:224] Handling call
0709 13:15:49.471065 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:49.471451 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:49.471482 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:49.522795 (+ 51313us) log.cc:844] Serialized 26 byte log entry
0709 13:15:49.748573 (+225778us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:49.748611 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.748672 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.837340 (+ 88668us) raft_consensus.cc:1685] finished
0709 13:15:49.837365 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.837517 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16868,"raft.queue_time_us":45182,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4683,"thread_start_us":179415,"threads_started":1,"wal-append.queue_time_us":272096}
I20260709 13:15:49.839355  3192 rpcz_store.cc:276] 0709 13:15:48.156385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.156891 (+   506us) service_pool.cc:224] Handling call
0709 13:15:49.838810 (+1681919us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b5400177d54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:49.838941 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":608070912}
I20260709 13:15:49.840018  3196 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:15:49.840394  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:49.840590  6311 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:49.840972  3121 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:15:49.841022  3192 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:49.842856  6311 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:49.844072  6122 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:49.818401  6335 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:49.845014  3123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 1817) took 1818 ms (client timeout 2246 ms). Trace:
W20260709 13:15:49.845404  3123 rpcz_store.cc:269] 0709 13:15:48.026228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.026342 (+   114us) service_pool.cc:224] Handling call
0709 13:15:49.844839 (+1818497us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400319f54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:49.844959 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268572928}
I20260709 13:15:49.846434  6335 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:49.846871  6388 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:49.847440  3125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 1767) took 2557 ms (client timeout 1744 ms). Trace:
I20260709 13:15:49.847896  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:49.847627  6388 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.826504  6313 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:49.840394  3196 pending_rounds.cc:85] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 2
I20260709 13:15:49.849512  3196 pending_rounds.cc:107] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:15:49.798827  3090 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:49.849764  3196 raft_consensus.cc:2889] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:49.850517  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 51777.3us
I20260709 13:15:49.857331  6253 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:15:49.847819  3125 rpcz_store.cc:269] 0709 13:15:47.290404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.311085 (+ 20681us) service_pool.cc:224] Handling call
0709 13:15:49.847221 (+2536136us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b5400319554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:49.847333 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4299185536}
I20260709 13:15:49.860018  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:49.794880  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:49.862519  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 64584.9us
I20260709 13:15:49.802007  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:49.732983  6125 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.783877  6323 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.789507  6260 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:49.882460  3124 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 13:15:49.788506  6292 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:49.712625  6389 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:49.807113  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 404) took 1637 ms. Trace:
I20260709 13:15:49.796653  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:49.810832  3091 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:49.806283  3126 rpcz_store.cc:276] 0709 13:15:48.027402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.419623 (+1392221us) service_pool.cc:224] Handling call
0709 13:15:49.420097 (+   474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:49.420570 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:49.420607 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:49.421203 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 13:15:49.622075 (+200872us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:49.681798 (+ 59723us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.686809 (+  5011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.686935 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.757655 (+ 70720us) raft_consensus.cc:1685] finished
0709 13:15:49.757679 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.758417 (+   738us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":67076,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":2119,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":40586624,"thread_start_us":200407,"threads_started":1,"wal-append.queue_time_us":307682}
I20260709 13:15:49.778107  6109 consensus_queue.cc:1059] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:15:49.569970  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:49.815474  6248 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:49.765470  3048 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:15:49.824270  3042 rpcz_store.cc:269] 0709 13:15:48.181080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.252678 (+ 71598us) service_pool.cc:224] Handling call
0709 13:15:49.772228 (+1519550us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b540029cf54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:49.772410 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111860096}
I20260709 13:15:49.816386  3118 rpcz_store.cc:276] 0709 13:15:47.449953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.450120 (+   167us) service_pool.cc:224] Handling call
0709 13:15:47.498495 (+ 48375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:47.937772 (+439277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.937809 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:47.941984 (+  4175us) log.cc:844] Serialized 52 byte log entry
0709 13:15:48.091645 (+149661us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:49.198573 (+1106928us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.763329 (+564756us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b54000afb20. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83032e733 00007ff8303b3dbf 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c
0709 13:15:49.763396 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.763478 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.763529 (+    51us) raft_consensus.cc:1685] finished
0709 13:15:49.763630 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.763789 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":829254,"prepare.queue_time_us":446632,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":54,"raft.queue_time_us":87571,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":6977,"spinlock_wait_cycles":35613952,"thread_start_us":1196151,"threads_started":3,"wal-append.queue_time_us":264838}
I20260709 13:15:49.806654  6226 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:49.800027  6390 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:49.825068  3164 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:49.822532  6353 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:49.847074  3049 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:49.606411  6267 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:49.792819  3198 rpcz_store.cc:276] 0709 13:15:48.154188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.081863 (+927675us) service_pool.cc:224] Handling call
0709 13:15:49.082899 (+  1036us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:49.111783 (+ 28884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:49.111834 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:49.136605 (+ 24771us) log.cc:844] Serialized 26 byte log entry
0709 13:15:49.470637 (+334032us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:49.470695 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.470776 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.747498 (+276722us) raft_consensus.cc:1685] finished
0709 13:15:49.747519 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.747676 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14807,"raft.queue_time_us":62703,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":276938,"threads_started":1,"wal-append.queue_time_us":394876}
I20260709 13:15:49.882196  6387 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:49.863322  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:49.904469  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:49.905037  3042 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:49.906529  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:49.865952  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 79778.3us
I20260709 13:15:49.874745  6384 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:49.911434  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:49.875487  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2013) took 1756 ms. Trace:
I20260709 13:15:49.886243  3194 rpcz_store.cc:276] 0709 13:15:48.169510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.200251 (+1030741us) service_pool.cc:224] Handling call
0709 13:15:49.200705 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:49.213941 (+ 13236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:49.213970 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:49.223255 (+  9285us) log.cc:844] Serialized 26 byte log entry
0709 13:15:49.603182 (+379927us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:49.603245 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.603354 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.806923 (+203569us) raft_consensus.cc:1685] finished
0709 13:15:49.806947 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.807068 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12778,"raft.queue_time_us":16720,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"thread_start_us":371985,"threads_started":1,"wal-append.queue_time_us":513760}
W20260709 13:15:49.886871  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 76094.9us
I20260709 13:15:49.889451  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:49.891870  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:49.912770  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:49.867527  5875 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:49.900733  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:49.919576  3198 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:15:49.919831  3118 raft_consensus.cc:1240] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:49.920419  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:49.750921  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:49.901996  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 77038.9us
I20260709 13:15:49.881990  6323 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:49.866982  6231 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.887923  6291 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:49.912770  3126 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 8: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:49.891433  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:49.895692  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:49.898306  6292 raft_consensus.cc:697] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:15:49.922714  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 171867us
I20260709 13:15:49.961943  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:49.901322  6226 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:49.887338  6210 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:15:49.960664  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:49.901161  6390 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.962369  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:49.912897  3195 rpcz_store.cc:276] 0709 13:15:48.119164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.120034 (+   870us) service_pool.cc:224] Handling call
0709 13:15:48.120509 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:48.147461 (+ 26952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.147513 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:48.164362 (+ 16849us) log.cc:844] Serialized 26 byte log entry
0709 13:15:49.254988 (+1090626us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b18001dd340. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:15:49.655456 (+400468us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:49.873439 (+217983us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.874613 (+  1174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.875160 (+   547us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.875205 (+    45us) raft_consensus.cc:1685] finished
0709 13:15:49.875298 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.875430 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26322,"prepare.queue_time_us":245835,"raft.queue_time_us":40581,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":12102,"spinlock_wait_cycles":93820288,"thread_start_us":569368,"threads_started":2,"wal-append.queue_time_us":1622864}
W20260709 13:15:49.963246  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 110075us
I20260709 13:15:49.897327  6248 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:49.964675  3042 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:15:49.964465  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:49.889534  6327 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:15:49.925539  3164 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:49.989444  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 64032.7us
I20260709 13:15:49.914556  6381 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:49.966415  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:49.963670  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 61628.7us
I20260709 13:15:49.974269  3194 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:15:49.976663  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:49.968950  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:49.911011  6099 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:49.974284  3124 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:49.919006  6389 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:49.993827  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:49.994223  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:49.998003  3194 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:49.965621  6129 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:50.003610  3762 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:50.004034  3194 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:15:49.998340  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:49.990916  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:49.897548  6335 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:49.991338  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 75413.3us
I20260709 13:15:50.005297  3761 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:49.995697  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:49.955170  6109 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:49.922118  6238 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:49.911854  6387 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.993350  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:50.011745  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:50.012137  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:49.992444  6324 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:49.999069  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:50.019520  3124 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:50.006345  3118 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 7: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:50.008302  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:49.985226  6390 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:49.994908  6381 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:50.013417  3015 leader_election.cc:400] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
I20260709 13:15:50.028738  3015 leader_election.cc:403] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:15:50.030118  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:49.990777  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:50.010619  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:50.031294  3195 raft_consensus.cc:2376] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9. Re-sending same reply.
I20260709 13:15:50.032750  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:49.992920  6348 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:49.924830  6384 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:50.002511  6211 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:50.036067  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:49.972441  6231 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:49.992564  6311 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:50.019024  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:49.980268  6291 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:50.009158  6099 raft_consensus.cc:697] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:50.027824  6355 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:50.105146  6355 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:50.105696  6355 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:50.107020  6380 log.cc:927] Time spent T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.873s	user 0.003s	sys 0.000s
I20260709 13:15:50.108626  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2178) took 2017 ms. Trace:
I20260709 13:15:50.040285  6129 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
I20260709 13:15:50.109050  3046 rpcz_store.cc:276] 0709 13:15:48.091603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.092991 (+  1388us) service_pool.cc:224] Handling call
0709 13:15:48.093393 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:48.646939 (+553546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.646991 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:48.647714 (+   723us) log.cc:844] Serialized 26 byte log entry
0709 13:15:49.136468 (+488754us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:49.136508 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.136625 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:50.106327 (+969702us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:50.108279 (+  1952us) raft_consensus.cc:1685] finished
0709 13:15:50.108302 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.108556 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4101,"raft.queue_time_us":97636,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"spinlock_wait_cycles":91279232,"thread_start_us":670727,"threads_started":2,"wal-append.queue_time_us":388020}
I20260709 13:15:50.110369  6099 consensus_queue.cc:237] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:50.111361  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:50.111682  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2012) took 1993 ms. Trace:
I20260709 13:15:50.112179  3046 raft_consensus.cc:2393] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 10: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:50.076376  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:50.075348  6238 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:50.116852  3792 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:50.081682  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:50.118014  3118 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:50.095252  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:50.021996  6387 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:50.057914  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:50.011125  6389 raft_consensus.cc:697] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:50.020143  6369 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:50.006064  6388 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:50.038749  6030 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:50.038789  6381 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:50.145632  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:50.146441  3125 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:15:50.146262  6248 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:50.148614  6248 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:50.112130  3199 rpcz_store.cc:276] 0709 13:15:48.118749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.119311 (+   562us) service_pool.cc:224] Handling call
0709 13:15:50.111496 (+1992185us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b5400037854. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:50.111627 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3772770176}
I20260709 13:15:50.150799  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:50.151073  6421 log.cc:927] Time spent T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:15:50.152132  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:50.152673  6125 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:50.080489  6331 consensus_queue.cc:1059] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:15:50.113968  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:50.114593  6231 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:50.074154  3195 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:50.098081  6311 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:50.126058  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:50.027381  6313 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:50.055689  6404 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:50.132290  3196 raft_consensus.cc:2393] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:50.134057  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:50.036916  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:50.075733  6360 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:50.140967  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:50.127786  6238 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:50.144814  6030 raft_consensus.cc:697] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:50.144399  6389 consensus_queue.cc:237] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:50.010141  6335 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:50.086259  5767 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:50.098598  6377 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:50.077469  6292 consensus_queue.cc:237] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:50.149309  6355 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:50.153345  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:50.610399  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 633831us
W20260709 13:15:50.382145  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 376462us
I20260709 13:15:50.470389  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:50.612085  3043 raft_consensus.cc:2410] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:15:50.613065  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.613186  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:50.369357  6287 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.407928  6341 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:50.470850  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:50.615104  6287 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:50.615933  6360 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:50.616425  6360 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:50.422047  6125 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:50.241855  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.611024  3199 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:50.489144  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:50.620077  3164 connection.cc:256] RPC call timeout handler was delayed by -1.0123821559998305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
I20260709 13:15:50.621296  3125 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:15:50.621393  3120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.007s	sys 0.009s
W20260709 13:15:50.622085  3120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.007s	sys 0.009s
I20260709 13:15:50.621317  3164 leader_election.cc:400] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8.
I20260709 13:15:50.181066  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:50.623610  3164 leader_election.cc:403] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:50.624010  3042 raft_consensus.cc:2410] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:15:50.622797  3090 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:50.626052  3761 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:50.627353  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:50.191781  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:50.392737  3118 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:50.635313  3043 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:50.191314  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:50.638079  3121 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:50.639278  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:50.640745  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:50.198489  6333 raft_consensus.cc:3055] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:50.645300  6333 raft_consensus.cc:740] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:50.618414  6238 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:50.646581  6333 consensus_queue.cc:260] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:50.647763  6333 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:50.644826  5767 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:50.650105  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:50.650722  3199 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:50.160370  3791 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:50.651081  6347 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:50.651568  6347 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.652107  6347 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:50.201858  6396 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 13:15:50.658246  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2189) took 1310 ms. Trace:
I20260709 13:15:50.658803  3043 rpcz_store.cc:276] 0709 13:15:49.347354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.634677 (+1287323us) service_pool.cc:224] Handling call
0709 13:15:50.634972 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.635812 (+   840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.658177 (+ 22365us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:50.672394  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 51273.6us
W20260709 13:15:50.482151  6414 log.cc:927] Time spent T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.422s	user 0.002s	sys 0.000s
W20260709 13:15:50.673480  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 50767.3us
I20260709 13:15:50.673830  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:50.204985  6343 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 2.304s	user 0.012s	sys 0.016s
W20260709 13:15:50.158324  6371 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.924s	user 0.000s	sys 0.003s
I20260709 13:15:50.740538  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:50.741248  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 67547.5us
I20260709 13:15:50.739825  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:50.179708  6416 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 13:15:50.182337  6299 raft_consensus.cc:3055] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:50.742868  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:50.708827  6313 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8.
W20260709 13:15:50.668732  6386 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.000s	sys 0.015s
I20260709 13:15:50.746675  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:50.742640  3048 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:50.728403  3090 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:50.774892  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46597.3us
I20260709 13:15:50.776262  3090 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:50.749717  3196 raft_consensus.cc:2410] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:15:50.369755  6370 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.212809  6384 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:50.656992  5840 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.122s
I20260709 13:15:50.788466  6384 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:50.773715  6386 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.000s	sys 0.016s
I20260709 13:15:50.789655  5840 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:50.790822  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1710) took 1054 ms. Trace:
I20260709 13:15:50.791318  3196 rpcz_store.cc:276] 0709 13:15:49.736124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.740246 (+1004122us) service_pool.cc:224] Handling call
0709 13:15:50.790745 (+ 50499us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:50.791205  6370 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:50.794405  3046 raft_consensus.cc:2410] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 7 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:50.204398  6267 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:50.563530  6248 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:50.795701  6248 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:50.756990  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1823) took 4180 ms. Trace:
I20260709 13:15:50.797906  3050 rpcz_store.cc:276] 0709 13:15:46.576146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.587974 (+ 11828us) service_pool.cc:224] Handling call
0709 13:15:46.588346 (+   372us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:15:47.218471 (+630125us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:15:47.218506 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:47.219394 (+   888us) log.cc:844] Serialized 52 byte log entry
0709 13:15:47.415407 (+196013us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:47.415463 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.521538 (+106075us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54000c6554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:47.521632 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:50.204229 (+2682597us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:50.756666 (+552437us) raft_consensus.cc:1685] finished
0709 13:15:50.756708 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.756910 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":130824,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":47,"spinlock_wait_cycles":840992512,"thread_start_us":370239,"threads_started":2,"wal-append.queue_time_us":448368}
I20260709 13:15:50.801443  6248 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:50.803392  6248 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:50.764000  3195 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:50.186453  6295 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:50.657296  6388 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:50.808465  6388 raft_consensus.cc:697] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:50.810246  6425 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:50.809624  6388 consensus_queue.cc:237] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:50.777213  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:50.815490  3118 raft_consensus.cc:2410] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:15:50.816663  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:50.633029  6125 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:50.818840  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:50.817404  3118 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:50.820721  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:50.820551  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:50.823205  3794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 474) took 1039 ms. Trace:
I20260709 13:15:50.823585  3118 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 8: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:50.824807  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:50.803992  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.828361  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 406) took 1578 ms. Trace:
I20260709 13:15:50.739944  6423 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:50.753995  6390 consensus_meta.cc:287] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.692s	user 0.010s	sys 0.000s
I20260709 13:15:50.830210  3195 rpcz_store.cc:276] 0709 13:15:49.250161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.826703 (+1576542us) service_pool.cc:224] Handling call
0709 13:15:50.827740 (+  1037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.827952 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:50.827991 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:50.828044 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:50.828087 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.828157 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.828293 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:50.825583  3118 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:50.708856  6404 raft_consensus.cc:697] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:50.191429  6381 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:50.823834  3794 rpcz_store.cc:276] 0709 13:15:49.785487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.789408 (+  3921us) service_pool.cc:224] Handling call
0709 13:15:49.803040 (+ 13632us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:49.810664 (+  7624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:49.810716 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:49.814565 (+  3849us) log.cc:844] Serialized 590 byte log entry
0709 13:15:49.886872 (+ 72307us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:49.886952 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.887071 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:50.822881 (+935810us) raft_consensus.cc:1685] finished
0709 13:15:50.822914 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.823112 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6968,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5054,"thread_start_us":70945,"threads_started":1,"wal-append.queue_time_us":179531}
I20260709 13:15:50.742053  6287 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:50.472283  6226 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:50.751832  6324 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:50.752522  6299 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:50.632736  6341 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:50.895795  6275 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:50.920778  6341 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:50.922389  6370 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:50.923187  6360 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:50.928699  6426 raft_consensus.cc:3055] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:50.935248  6226 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:50.920838  6238 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:50.936913  5767 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:50.937491  6291 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:50.938122  6355 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:50.939438  6329 raft_consensus.cc:3055] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:15:50.939708  6323 consensus_meta.cc:287] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.979s	user 0.010s	sys 0.005s
I20260709 13:15:50.991191  6323 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:50.861373  6356 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:15:50.861936  6390 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:50.857725  6423 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:50.898104  6404 consensus_queue.cc:237] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:50.913822  6299 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:51.056702  3015 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.938s	user 0.026s	sys 0.029s
I20260709 13:15:51.061385  3126 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:51.063534  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1781) took 1133 ms. Trace:
I20260709 13:15:51.064231  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:51.066136  3124 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:51.067188  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:51.068754  3122 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 8: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:51.069049  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2180) took 1743 ms. Trace:
I20260709 13:15:51.071504  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:15:51.069865  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 443673us
I20260709 13:15:51.067219  3125 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:51.071527  3192 raft_consensus.cc:2393] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:51.078379  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1822) took 3037 ms. Trace:
I20260709 13:15:51.083065  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2025) took 2915 ms. Trace:
I20260709 13:15:51.084807  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2033) took 1875 ms. Trace:
I20260709 13:15:51.086079  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:51.088042  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.866544  6030 consensus_queue.cc:237] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:51.172443  3049 rpcz_store.cc:276] 0709 13:15:49.325268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.649660 (+324392us) service_pool.cc:224] Handling call
0709 13:15:49.660744 (+ 11084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.903559 (+242815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.068355 (+1164796us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54003c50d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:51.068762 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":428071168}
I20260709 13:15:51.191201  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:50.954427  6353 consensus_meta.cc:287] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.031s	user 0.009s	sys 0.007s
I20260709 13:15:51.195376  6353 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:51.198153  3047 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:51.022611  6390 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:51.017715  6406 log.cc:927] Time spent T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 1.305s	user 0.003s	sys 0.016s
W20260709 13:15:51.015340  6413 log.cc:927] Time spent T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.865s	user 0.008s	sys 0.008s
W20260709 13:15:51.019137  6420 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.820s	user 0.000s	sys 0.002s
I20260709 13:15:50.950770  6426 raft_consensus.cc:740] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:51.210541  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1825) took 3182 ms. Trace:
I20260709 13:15:51.211059  3117 rpcz_store.cc:276] 0709 13:15:48.027613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.522108 (+1494495us) service_pool.cc:224] Handling call
0709 13:15:49.542673 (+ 20565us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:49.559974 (+ 17301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:49.560005 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:49.652260 (+ 92255us) log.cc:844] Serialized 52 byte log entry
0709 13:15:49.994466 (+342206us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:49.994509 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.994580 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:51.018453 (+1023873us) spinlock_profiling.cc:243] Waited 7.27 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:51.209856 (+191403us) raft_consensus.cc:1685] finished
0709 13:15:51.209909 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.210355 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16901,"raft.queue_time_us":19962,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":37340,"spinlock_wait_cycles":16720768,"thread_start_us":264154,"threads_started":1,"wal-append.queue_time_us":451877}
I20260709 13:15:51.164697  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2192) took 1366 ms. Trace:
W20260709 13:15:51.165566  6347 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.513s	user 0.013s	sys 0.001s
I20260709 13:15:51.179260  3051 pending_rounds.cc:85] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 6
I20260709 13:15:51.173202  3119 rpcz_store.cc:276] 0709 13:15:48.027101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.012987 (+985886us) service_pool.cc:224] Handling call
0709 13:15:49.020628 (+  7641us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:49.358618 (+337990us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:49.359070 (+   452us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.644331 (+285261us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:49.684758 (+ 40427us) log.cc:844] Serialized 26 byte log entry
0709 13:15:49.684970 (+   212us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:49.709495 (+ 24525us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.715912 (+  6417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.063969 (+1348057us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b540011bcd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:51.064078 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:51.064363 (+   285us) raft_consensus.cc:1685] finished
0709 13:15:51.064387 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.064772 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44821,"prepare.queue_time_us":29683,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":83,"raft.queue_time_us":38701,"raft.run_cpu_time_us":421,"raft.run_wall_time_us":30032,"spinlock_wait_cycles":776024448,"thread_start_us":269445,"threads_started":1,"wal-append.queue_time_us":452280,"wal-append.run_cpu_time_us":2431,"wal-append.run_wall_time_us":1028929}
I20260709 13:15:51.173311  3193 rpcz_store.cc:276] 0709 13:15:48.167804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.160920 (+993116us) service_pool.cc:224] Handling call
0709 13:15:49.161262 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.366134 (+204872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.082290 (+1716156us) spinlock_profiling.cc:243] Waited 79.1 ms on lock 0x7b54003b9f54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:51.082766 (+   476us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181880192}
I20260709 13:15:51.173941  3200 rpcz_store.cc:276] 0709 13:15:49.208878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.523555 (+314677us) service_pool.cc:224] Handling call
0709 13:15:49.523834 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.825312 (+301478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:49.825341 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:49.825385 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:49.825422 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.084296 (+1258874us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b540013c4d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:51.084362 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.084620 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":692855552}
I20260709 13:15:51.184257  3043 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:51.186874  6238 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:51.188570  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:50.990005  6329 raft_consensus.cc:740] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:51.194334  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2194) took 1393 ms. Trace:
W20260709 13:15:51.175571  3015 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.026s	sys 0.030s
I20260709 13:15:51.222414  3049 rpcz_store.cc:276] 0709 13:15:49.800539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.192827 (+1392288us) service_pool.cc:224] Handling call
0709 13:15:51.193469 (+   642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.193943 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:51.193970 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:51.194033 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:51.194070 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.194143 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.194260 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.216130  3046 rpcz_store.cc:276] 0709 13:15:49.798376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.116971 (+318595us) service_pool.cc:224] Handling call
0709 13:15:51.163987 (+1047016us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54003d59d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:51.164405 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396897664}
I20260709 13:15:51.222843  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2193) took 1418 ms. Trace:
I20260709 13:15:51.228520  3043 rpcz_store.cc:276] 0709 13:15:49.799511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.182827 (+1383316us) service_pool.cc:224] Handling call
0709 13:15:51.183495 (+   668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.218052 (+ 34557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.218323 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.270844  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:51.275851  3043 raft_consensus.cc:1275] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:51.276834  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2197) took 1475 ms. Trace:
I20260709 13:15:51.282109  3043 rpcz_store.cc:276] 0709 13:15:49.801287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.237399 (+1436112us) service_pool.cc:224] Handling call
0709 13:15:51.266526 (+ 29127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.276485 (+  9959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.276763 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.171440  3120 rpcz_store.cc:276] 0709 13:15:49.930110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.930429 (+   319us) service_pool.cc:224] Handling call
0709 13:15:49.931071 (+   642us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:49.961152 (+ 30081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:49.961184 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:49.965683 (+  4499us) log.cc:844] Serialized 590 byte log entry
0709 13:15:50.622529 (+656846us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:50.622571 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.622641 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:51.062634 (+439993us) raft_consensus.cc:1685] finished
0709 13:15:51.062699 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.063219 (+   520us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":68953,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":21505,"thread_start_us":614089,"threads_started":1,"wal-append.queue_time_us":868604}
I20260709 13:15:51.216929  3051 pending_rounds.cc:107] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.7
I20260709 13:15:51.209229  6426 consensus_queue.cc:260] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:51.299252  3118 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:51.228070  6347 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:51.290588  3051 raft_consensus.cc:2917] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Aborting config change with OpId 6.7: Aborted: Op aborted by new leader
I20260709 13:15:51.305140  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:51.298413  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 1.1802e+06us
I20260709 13:15:51.310335  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:51.284780  6226 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:51.316282  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2017) took 3133 ms. Trace:
I20260709 13:15:51.325135  6347 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:51.329424  3051 raft_consensus.cc:2889] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:51.329254  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:51.311770  6359 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.334292  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:51.335845  6426 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:51.337229  6323 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:51.338267  3042 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:51.338482  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:51.339075  6248 consensus_meta.cc:287] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.007s
W20260709 13:15:51.340077  3791 consensus_meta.cc:287] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.689s	user 0.018s	sys 0.007s
I20260709 13:15:51.339147  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 446) took 1468 ms. Trace:
I20260709 13:15:51.339939  6248 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:51.330665  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 454) took 1136 ms. Trace:
I20260709 13:15:51.340914  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 447) took 1469 ms. Trace:
I20260709 13:15:51.340842  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:51.340610  3042 rpcz_store.cc:276] 0709 13:15:49.871069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.283326 (+1412257us) service_pool.cc:224] Handling call
0709 13:15:51.322234 (+ 38908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.338797 (+ 16563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.339082 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.343143  3043 rpcz_store.cc:276] 0709 13:15:49.871924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.284611 (+1412687us) service_pool.cc:224] Handling call
0709 13:15:51.319874 (+ 35263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.321770 (+  1896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:51.321803 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:51.327700 (+  5897us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:51.340685 (+ 12985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.340759 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.340861 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.349550  3049 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:51.354642  6311 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:51.347731  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:51.345351  3196 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.000s	sys 0.015s
I20260709 13:15:51.359151  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2195) took 1549 ms. Trace:
I20260709 13:15:51.359701  3049 rpcz_store.cc:276] 0709 13:15:49.800775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.223924 (+1423149us) service_pool.cc:224] Handling call
0709 13:15:51.309843 (+ 85919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.350051 (+ 40208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.350279 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:51.362946  3199 consensus_meta.cc:287] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.712s	user 0.005s	sys 0.022s
I20260709 13:15:51.362315  6226 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:51.363778  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:51.368616  6295 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.010s	sys 0.038s
I20260709 13:15:51.370417  6360 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:51.342442  3123 rpcz_store.cc:276] 0709 13:15:50.188656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.626913 (+438257us) service_pool.cc:224] Handling call
0709 13:15:50.634264 (+  7351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.634478 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:51.069642 (+435164us) log.cc:844] Serialized 14 byte log entry
0709 13:15:51.314998 (+245356us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:51.318228 (+  3230us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:51.323818 (+  5590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.324188 (+   370us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.325141 (+   953us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6726,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":7172,"thread_start_us":643649,"threads_started":2,"wal-append.queue_time_us":266653}
I20260709 13:15:51.371802  6359 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:51.372308  3196 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.000s	sys 0.016s
I20260709 13:15:51.366793  6226 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:51.367466  3199 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:51.375052  6274 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:51.322485  3191 rpcz_store.cc:276] 0709 13:15:48.154914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.097427 (+942513us) service_pool.cc:224] Handling call
0709 13:15:49.123863 (+ 26436us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:49.522568 (+398705us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:49.708967 (+186399us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.916841 (+207874us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:15:49.926956 (+ 10115us) log.cc:844] Serialized 78 byte log entry
0709 13:15:49.927151 (+   195us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:49.966332 (+ 39181us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.985319 (+ 18987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.179527 (+194208us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b180035ede0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:15:51.014564 (+835037us) spinlock_profiling.cc:243] Waited 53.5 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:51.088911 (+ 74347us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54001de554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:51.088970 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:51.215702 (+126732us) raft_consensus.cc:1685] finished
0709 13:15:51.215727 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.288219 (+ 72492us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":269758,"prepare.queue_time_us":346674,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":80,"raft.queue_time_us":200471,"raft.run_cpu_time_us":410,"raft.run_wall_time_us":31246,"spinlock_wait_cycles":648190464,"thread_start_us":299894,"threads_started":2,"wal-append.queue_time_us":419916}
I20260709 13:15:51.350642  6353 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:51.382867  6353 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.383651  6353 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:51.385326  6260 consensus_meta.cc:287] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.493s	user 0.011s	sys 0.007s
I20260709 13:15:51.386260  6353 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:51.371913  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:51.388444  3117 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:51.375308  6359 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:51.380874  3191 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
W20260709 13:15:51.346486  6387 consensus_meta.cc:287] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.206s	user 0.012s	sys 0.003s
I20260709 13:15:51.389127  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55318 (request call id 450) took 1201 ms. Trace:
I20260709 13:15:51.392380  3122 rpcz_store.cc:276] 0709 13:15:50.187334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.191506 (+  4172us) service_pool.cc:224] Handling call
0709 13:15:51.388883 (+1197377us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54003020d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:51.389051 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1008148736}
I20260709 13:15:51.392431  6387 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:51.391479  3191 pending_rounds.cc:85] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 5
I20260709 13:15:51.377583  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1723) took 1241 ms. Trace:
I20260709 13:15:51.400210  3191 pending_rounds.cc:107] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:15:51.400660  3191 raft_consensus.cc:2889] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:51.359282  3119 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:51.400349  3199 rpcz_store.cc:276] 0709 13:15:50.135573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.649833 (+514260us) service_pool.cc:224] Handling call
0709 13:15:51.376704 (+726871us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.406376  3121 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:15:51.403752  3164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.004s	sys 0.038s
W20260709 13:15:51.408941  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.410629  3194 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 9: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:15:51.411218  3089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.007s	sys 0.008s
W20260709 13:15:51.411659  3089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.008s	sys 0.008s
W20260709 13:15:51.413431  3164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.005s	sys 0.038s
I20260709 13:15:51.411711  6386 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:15:51.404558  3790 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.012s	sys 0.032s
I20260709 13:15:51.431937  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:15:51.457178  3790 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.013s	sys 0.032s
I20260709 13:15:51.458154  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:51.433509  3049 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:51.459587  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 451) took 1583 ms. Trace:
I20260709 13:15:51.460009  3049 rpcz_store.cc:276] 0709 13:15:49.875812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.389185 (+1513373us) service_pool.cc:224] Handling call
0709 13:15:51.432990 (+ 43805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.459330 (+ 26340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.459532 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.439658  6237 raft_consensus.cc:3055] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:15:51.442903  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.346567  6329 consensus_queue.cc:260] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:51.446169  3090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.010s	sys 0.077s
I20260709 13:15:51.447527  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 449) took 1573 ms. Trace:
I20260709 13:15:51.448665  6381 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:51.433568  6387 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:51.450786  6390 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:51.452011  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 448) took 1579 ms. Trace:
I20260709 13:15:51.453790  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:51.456341  6335 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:51.461547  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:51.478541  3193 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:51.461053  6030 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:51.465698  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1843) took 2140 ms. Trace:
I20260709 13:15:51.482467  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:51.483081  3042 rpcz_store.cc:276] 0709 13:15:49.873960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.390769 (+1516809us) service_pool.cc:224] Handling call
0709 13:15:51.446729 (+ 55960us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.447083 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:51.447123 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:51.447198 (+    75us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:51.447242 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.447313 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.447464 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.464826  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 453) took 1276 ms. Trace:
I20260709 13:15:51.477537  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 450) took 1602 ms. Trace:
W20260709 13:15:51.489900  3090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.010s	sys 0.081s
I20260709 13:15:51.490700  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:51.490558  3043 rpcz_store.cc:276] 0709 13:15:49.874963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.469030 (+1594067us) service_pool.cc:224] Handling call
0709 13:15:51.469472 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.477124 (+  7652us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:51.477153 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:51.477214 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:51.477259 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.477337 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.477461 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.463958  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 452) took 1276 ms. Trace:
I20260709 13:15:51.391757  6260 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:51.483983  3046 rpcz_store.cc:276] 0709 13:15:49.872983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.305426 (+1432443us) service_pool.cc:224] Handling call
0709 13:15:51.361042 (+ 55616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.451568 (+ 90526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:51.451602 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:51.451688 (+    86us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:51.451755 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.451832 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.451937 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.481122  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 411) took 2165 ms. Trace:
I20260709 13:15:51.490228  3125 rpcz_store.cc:276] 0709 13:15:50.188358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.622439 (+434081us) service_pool.cc:224] Handling call
0709 13:15:50.708405 (+ 85966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.173550 (+465145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.464537 (+290987us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b5400189cd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:51.464748 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":823632256}
W20260709 13:15:51.463088  3192 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1707) took 1727 ms (client timeout 1885 ms). Trace:
I20260709 13:15:51.492240  3126 rpcz_store.cc:276] 0709 13:15:50.188051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.622135 (+434084us) service_pool.cc:224] Handling call
0709 13:15:50.709090 (+ 86955us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.177084 (+467994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.463659 (+286575us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b5400301bd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:51.463910 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":808544512}
I20260709 13:15:51.463855  5767 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:15:51.495272  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 719059us
I20260709 13:15:51.496474  6390 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:51.497624  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 448) took 1311 ms. Trace:
I20260709 13:15:51.472339  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:51.485628  6030 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:51.503134  3192 rpcz_store.cc:269] 0709 13:15:49.735212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.861934 (+126722us) service_pool.cc:224] Handling call
0709 13:15:51.462821 (+1600887us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54003b9054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:51.463012 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2555510144}
W20260709 13:15:51.462294  6333 consensus_meta.cc:287] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.814s	user 0.006s	sys 0.016s
I20260709 13:15:51.514377  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1706) took 1779 ms. Trace:
I20260709 13:15:51.537700  3124 rpcz_store.cc:276] 0709 13:15:50.186606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.618621 (+432015us) service_pool.cc:224] Handling call
0709 13:15:50.619025 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.214319 (+595294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.497283 (+282964us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b5400319054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:51.497554 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1025628928}
I20260709 13:15:51.514437  3126 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:51.535394  3791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 594) took 1510 ms. Trace:
I20260709 13:15:51.503860  3191 rpcz_store.cc:276] 0709 13:15:49.315994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.379862 (+2063868us) service_pool.cc:224] Handling call
0709 13:15:51.380306 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.480552 (+100246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.481026 (+   474us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.498564  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:51.539453  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.490996  3047 rpcz_store.cc:276] 0709 13:15:49.325526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.743150 (+417624us) service_pool.cc:224] Handling call
0709 13:15:49.743490 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.198686 (+1455196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.465409 (+266723us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b540027c9d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:51.465643 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3344407424}
I20260709 13:15:51.483393  6237 raft_consensus.cc:740] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:51.544140  3198 rpcz_store.cc:276] 0709 13:15:49.734929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.920204 (+185275us) service_pool.cc:224] Handling call
0709 13:15:51.513860 (+1593656us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54003b9554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:51.514108 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3413465856}
I20260709 13:15:51.544744  6030 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:51.624984  3044 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:51.585201  6404 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:15:51.569588  3790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 593) took 1546 ms. Trace:
I20260709 13:15:51.629357  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:51.552242  5767 raft_consensus.cc:697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:51.627584  3790 rpcz_store.cc:276] 0709 13:15:50.023126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.027779 (+  4653us) service_pool.cc:224] Handling call
0709 13:15:50.138549 (+110770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.205007 (+ 66458us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:50.654123 (+449116us) log.cc:844] Serialized 14 byte log entry
0709 13:15:51.482937 (+828814us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:51.541873 (+ 58936us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:51.569107 (+ 27234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.569295 (+   188us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.569510 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":662642,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":4304,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":1180473,"threads_started":2,"wal-append.queue_time_us":777018}
I20260709 13:15:51.706990  3047 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:51.707881  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1855) took 1790 ms. Trace:
I20260709 13:15:51.708276  3047 rpcz_store.cc:276] 0709 13:15:49.917165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.586416 (+1669251us) service_pool.cc:224] Handling call
0709 13:15:51.706726 (+120310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.707555 (+   829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.707809 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.716223  6390 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:51.598097  6387 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:51.476347  6433 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.319s
W20260709 13:15:51.825197  3194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34728 (request call id 414) took 1891 ms (client timeout 1793 ms). Trace:
I20260709 13:15:51.793958  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:51.709676  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:52.008055  3047 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
W20260709 13:15:52.006595  3194 rpcz_store.cc:269] 0709 13:15:49.934014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.010287 (+ 76273us) service_pool.cc:224] Handling call
0709 13:15:51.824754 (+1814467us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54001de054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:51.825079 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3132840192}
W20260709 13:15:52.009405  6099 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.865s	user 0.015s	sys 0.020s
I20260709 13:15:52.009341  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:52.009995  3199 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 4. Current term is 5. Ops: [2.4-4.5]
I20260709 13:15:52.010154  3194 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 13:15:52.010016  6099 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.866s	user 0.016s	sys 0.020s
I20260709 13:15:52.010967  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1713) took 2233 ms. Trace:
I20260709 13:15:52.011046  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1716) took 2187 ms. Trace:
I20260709 13:15:51.825223  6333 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:52.011348  3199 rpcz_store.cc:276] 0709 13:15:49.777988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.945087 (+2167099us) service_pool.cc:224] Handling call
0709 13:15:51.946044 (+   957us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:52.010620 (+ 64576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.010917 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:52.011548  3194 rpcz_store.cc:276] 0709 13:15:49.823510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.009344 (+2185834us) service_pool.cc:224] Handling call
0709 13:15:52.009768 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:52.010733 (+   965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.010961 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:51.753408  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 57958.1us
I20260709 13:15:51.652222  6426 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:15:51.792613  3165 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.129:44609 timed out after 1.782s (SENT) [suppressed 4 similar messages]
I20260709 13:15:51.991145  6260 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:52.031216  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:52.034518  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.036150  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.037012  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.012042  6333 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:52.043197  3198 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:15:51.824987  6237 consensus_queue.cc:260] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:52.051966  3125 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:52.052802  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1708) took 2312 ms. Trace:
I20260709 13:15:52.052826  3194 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:52.053275  3198 rpcz_store.cc:276] 0709 13:15:49.735604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.670704 (+1935100us) service_pool.cc:224] Handling call
0709 13:15:52.026483 (+355779us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:52.045176 (+ 18693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.048105 (+  2929us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.549980  3791 rpcz_store.cc:276] 0709 13:15:50.025061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.027863 (+  2802us) service_pool.cc:224] Handling call
0709 13:15:50.099232 (+ 71369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.431016 (+1331784us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:51.431100 (+    84us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:51.431192 (+    92us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:51.431308 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.535039 (+103731us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b54004e3754. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:51.535091 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.535285 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42920,"raft.queue_time_us":46671,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":21175,"spinlock_wait_cycles":116596480}
I20260709 13:15:52.051427  6237 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:52.066075  3192 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:15:52.066634  6389 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:52.067508  6389 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:51.992084  5767 consensus_queue.cc:237] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:52.066883  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1712) took 2326 ms. Trace:
I20260709 13:15:52.074069  3192 rpcz_store.cc:276] 0709 13:15:49.740333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.631058 (+1890725us) service_pool.cc:224] Handling call
0709 13:15:52.032903 (+401845us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:52.066594 (+ 33691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.066812 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:52.076043  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 416) took 2140 ms. Trace:
I20260709 13:15:52.076520  3192 rpcz_store.cc:276] 0709 13:15:49.936149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.074903 (+2138754us) service_pool.cc:224] Handling call
0709 13:15:52.075283 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.075690 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:52.075716 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:52.075780 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:52.075819 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.075895 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.075993 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:52.076604  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 1.33368e+06us
I20260709 13:15:52.047055  6433 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:52.079507  3047 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:52.080567  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1717) took 2195 ms. Trace:
I20260709 13:15:52.080013  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2034) took 2843 ms. Trace:
I20260709 13:15:52.081063  3194 rpcz_store.cc:276] 0709 13:15:49.858706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.014387 (+2155681us) service_pool.cc:224] Handling call
0709 13:15:52.021300 (+  6913us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:52.053613 (+ 32313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.053908 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:52.077255  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:52.083220  3199 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:15:52.084008  3042 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:52.084908  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 452) took 2208 ms. Trace:
I20260709 13:15:52.085316  3042 rpcz_store.cc:276] 0709 13:15:49.876916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.536018 (+1659102us) service_pool.cc:224] Handling call
0709 13:15:52.033589 (+497571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.084543 (+ 50954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.084812 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:52.086432  6325 raft_consensus.cc:3055] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:52.086826  6295 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.087567  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1861) took 2049 ms. Trace:
I20260709 13:15:52.087954  3042 rpcz_store.cc:276] 0709 13:15:50.038205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.086416 (+2048211us) service_pool.cc:224] Handling call
0709 13:15:52.086828 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.087132 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:52.087156 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:52.087215 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:52.087254 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.087321 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.087479 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:52.088917  3046 raft_consensus.cc:1240] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:52.086938  6325 raft_consensus.cc:740] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:52.090667  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 408) took 2775 ms. Trace:
I20260709 13:15:52.091074  3193 rpcz_store.cc:276] 0709 13:15:49.314968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.261068 (+1946100us) service_pool.cc:224] Handling call
0709 13:15:51.478276 (+217208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.489755 (+ 11479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.090435 (+600680us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54003b9050. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:52.090592 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498002304}
I20260709 13:15:52.090744  6325 consensus_queue.cc:260] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:52.087801  6295 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:52.084041  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1718) took 2225 ms. Trace:
W20260709 13:15:52.094698  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.054214  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:52.089560  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1862) took 1902 ms. Trace:
I20260709 13:15:52.098011  3046 rpcz_store.cc:276] 0709 13:15:50.186777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.088238 (+1901461us) service_pool.cc:224] Handling call
0709 13:15:52.088647 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.089325 (+   678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.089513 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:52.097275  3199 rpcz_store.cc:276] 0709 13:15:49.859053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.026339 (+2167286us) service_pool.cc:224] Handling call
0709 13:15:52.082852 (+ 56513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:52.083756 (+   904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.083977 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:52.075953  6333 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:52.101850  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 412) took 2785 ms. Trace:
I20260709 13:15:52.103193  6329 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:52.102639  3191 rpcz_store.cc:276] 0709 13:15:49.316240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.633163 (+2316923us) service_pool.cc:224] Handling call
0709 13:15:52.030166 (+397003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.101323 (+ 71157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:52.101372 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:52.101440 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:52.101488 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.101577 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.101774 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:52.092571  6325 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:52.108966  6381 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:52.123888  6381 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:52.124501  6381 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:52.134902  6389 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:52.135345  6240 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:52.136018  6240 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:52.137396  6295 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:52.138262  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 87337.9us
I20260709 13:15:52.138862  6240 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:52.050740  6387 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:52.140588  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 108587us
I20260709 13:15:52.048455  6426 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:52.142902  6333 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:52.079658  6404 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:52.081677  3196 rpcz_store.cc:276] 0709 13:15:49.209150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.792540 (+1583390us) service_pool.cc:224] Handling call
0709 13:15:50.792903 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.793152 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:51.378103 (+584951us) log.cc:844] Serialized 14 byte log entry
0709 13:15:52.015756 (+637653us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:52.021024 (+  5268us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:52.033530 (+ 12506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.042720 (+  9190us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.052304 (+  9584us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6841,"prepare.queue_time_us":606074,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":163739,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":9127,"thread_start_us":842758,"threads_started":2}
I20260709 13:15:52.151362  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 413) took 2218 ms. Trace:
I20260709 13:15:52.151772  3198 rpcz_store.cc:276] 0709 13:15:49.933551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.054138 (+2120587us) service_pool.cc:224] Handling call
0709 13:15:52.142294 (+ 88156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.148898 (+  6604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:52.148930 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:52.151066 (+  2136us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:52.151097 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.151163 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.151304 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:52.146335  6333 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:52.140173  6030 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:52.156203  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 684002us
I20260709 13:15:52.160544  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 421) took 1942 ms. Trace:
I20260709 13:15:52.160924  3192 rpcz_store.cc:276] 0709 13:15:50.217951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.093207 (+1875256us) service_pool.cc:224] Handling call
0709 13:15:52.147605 (+ 54398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.160108 (+ 12503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:52.160139 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:52.160211 (+    72us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:52.160265 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.160361 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.160492 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:52.156682  6333 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:52.176946  6240 consensus_queue.cc:1059] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:52.178215  6240 raft_consensus.cc:3055] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:52.178666  6240 raft_consensus.cc:740] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:52.179893  6240 consensus_queue.cc:260] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:52.181428  6240 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:52.183365  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:52.189895  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:52.191185  6260 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:52.192517  3121 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:52.154541  6404 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:52.208825  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:52.206825  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:52.191745  6260 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.227907  6260 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:52.242318  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 449890us
W20260709 13:15:52.263058  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 87874.1us
W20260709 13:15:52.266700  6452 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:15:52.266755  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:52.269138  6237 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:52.270601  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1854) took 2486 ms. Trace:
I20260709 13:15:52.273407  3051 rpcz_store.cc:276] 0709 13:15:49.784360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.177868 (+1393508us) service_pool.cc:224] Handling call
0709 13:15:51.178575 (+   707us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:51.333823 (+155248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:51.333867 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:51.334592 (+   725us) log.cc:844] Serialized 26 byte log entry
0709 13:15:51.491637 (+157045us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:51.491685 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.491750 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:52.270234 (+778484us) raft_consensus.cc:1685] finished
0709 13:15:52.270259 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.270482 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":156366,"threads_started":1,"wal-append.queue_time_us":771913}
I20260709 13:15:52.291400  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:15:52.296563  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 130534us
I20260709 13:15:52.304437  6292 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:52.307358  6125 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:52.308815  6455 log.cc:927] Time spent T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.147s	user 0.001s	sys 0.001s
W20260709 13:15:52.310540  6454 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.162s	user 0.001s	sys 0.001s
W20260709 13:15:52.312070  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.313174  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 407) took 3062 ms. Trace:
I20260709 13:15:52.308380  6125 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:52.313565  3195 rpcz_store.cc:276] 0709 13:15:49.250490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.850265 (+1599775us) service_pool.cc:224] Handling call
0709 13:15:50.850723 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:50.851841 (+  1118us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:51.313848 (+462007us) log.cc:844] Serialized 14 byte log entry
0709 13:15:51.820937 (+507089us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:51.826079 (+  5142us) log.cc:844] Serialized 26 byte log entry
0709 13:15:51.826251 (+   172us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:51.826894 (+   643us) log.cc:844] Serialized 14 byte log entry
0709 13:15:51.827477 (+   583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.827621 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:52.312769 (+485148us) raft_consensus.cc:1685] finished
0709 13:15:52.312791 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.312974 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":547849,"prepare.run_cpu_time_us":134,"prepare.run_wall_time_us":3058,"raft.queue_time_us":77387,"raft.run_cpu_time_us":617,"raft.run_wall_time_us":11088,"thread_start_us":479608,"threads_started":2,"wal-append.queue_time_us":735752}
I20260709 13:15:52.316570  6387 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:52.272702  6389 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:52.322093  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 158260us
I20260709 13:15:52.301229  6426 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:52.333438  3164 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:52.330915  6459 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:15:52.323520  6030 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:52.331764  6387 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.357757  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1841) took 1696 ms. Trace:
W20260709 13:15:52.363811  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 132109us
I20260709 13:15:52.366919  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:52.368651  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2199) took 1733 ms. Trace:
I20260709 13:15:52.369280  3046 rpcz_store.cc:276] 0709 13:15:50.635289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.099272 (+1463983us) service_pool.cc:224] Handling call
0709 13:15:52.156547 (+ 57275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.160330 (+  3783us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:52.290797 (+130467us) log.cc:844] Serialized 14 byte log entry
0709 13:15:52.368157 (+ 77360us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:52.368231 (+    74us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:52.368296 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.368386 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.368544 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8540,"thread_start_us":151759,"threads_started":2}
I20260709 13:15:52.371798  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 454) took 1184 ms. Trace:
I20260709 13:15:52.373297  3051 rpcz_store.cc:276] 0709 13:15:51.187802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.295377 (+1107575us) service_pool.cc:224] Handling call
0709 13:15:52.322433 (+ 27056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.357505 (+ 35072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:52.357541 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:52.371454 (+ 13913us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:52.371504 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.371581 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.371711 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:52.360080  3120 rpcz_store.cc:276] 0709 13:15:50.660960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.386923 (+725963us) service_pool.cc:224] Handling call
0709 13:15:51.387458 (+   535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.388232 (+   774us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:51.446302 (+ 58070us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b1800322840. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:15:51.611804 (+165502us) log.cc:844] Serialized 14 byte log entry
0709 13:15:52.354014 (+742210us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:52.354089 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:52.356230 (+  2141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.356623 (+   393us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.357287 (+   664us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9142,"prepare.queue_time_us":23741,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"raft.queue_time_us":82432,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":18303,"spinlock_wait_cycles":30099712,"thread_start_us":587602,"threads_started":3,"wal-append.queue_time_us":455953}
I20260709 13:15:52.349172  6426 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.334816  6381 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:52.419164  6461 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.419024  6293 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:15:52.420163  6461 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:52.421663  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.421852  6123 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:52.429963  6462 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:15:52.437749  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 52258.2us
I20260709 13:15:52.439960  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:52.442193  6476 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:52.443028  6476 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.443533  6476 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:52.444736  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:52.446151  3050 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:52.417135  6387 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:52.465204  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.465785  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.467022  6457 log.cc:927] Time spent T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
W20260709 13:15:52.467746  3048 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 1858) took 2475 ms (client timeout 1782 ms). Trace:
W20260709 13:15:52.468267  3048 rpcz_store.cc:269] 0709 13:15:49.924801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.966169 (+ 41368us) service_pool.cc:224] Handling call
0709 13:15:52.379695 (+2413526us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b5400074c54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:52.400387 (+ 20692us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1723797248}
I20260709 13:15:52.470072  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:15:52.470513  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 203926us
I20260709 13:15:52.471246  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2188) took 3115 ms. Trace:
W20260709 13:15:52.471518  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 88572.1us
W20260709 13:15:52.464697  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 97931.3us
I20260709 13:15:52.471726  3044 rpcz_store.cc:276] 0709 13:15:49.347086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.183529 (+836443us) service_pool.cc:224] Handling call
0709 13:15:50.183845 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.625712 (+1441867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.396264 (+770552us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54003c32d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:52.462472 (+ 66208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3188402560}
I20260709 13:15:52.379144  6389 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:52.482301  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 457) took 1293 ms. Trace:
I20260709 13:15:52.484117  3046 rpcz_store.cc:276] 0709 13:15:51.189111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.395164 (+1206053us) service_pool.cc:224] Handling call
0709 13:15:52.416400 (+ 21236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.478731 (+ 62331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:52.478766 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:52.482084 (+  3318us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:52.482126 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.482169 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.482257 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:52.487507  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 47631.1us
I20260709 13:15:52.471200  6461 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:52.471239  6404 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:52.471086  6381 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:52.475332  6472 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.492434  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:52.485832  6293 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:52.497397  3090 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:52.474582  6426 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:52.494410  6479 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.514067  6479 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:52.516659  6479 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:52.523062  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:52.524036  3049 raft_consensus.cc:2410] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:15:52.524706  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:52.526562  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:52.501092  6387 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:52.499611  6461 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:52.505149  6404 consensus_queue.cc:1059] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:15:52.546367  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:52.534996  6381 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:52.547962  5398 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:15:52.560746  3049 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:52.545532  6475 consensus_queue.cc:1048] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:15:52.566453  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:52.567622  3046 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 9: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:15:52.570048  3795 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43926 (request call id 597) took 2416 ms (client timeout 2733 ms). Trace:
W20260709 13:15:52.570609  3795 rpcz_store.cc:269] 0709 13:15:50.133051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.133326 (+   275us) service_pool.cc:224] Handling call
0709 13:15:52.537066 (+2403740us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b54005a19d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:52.549085 (+ 12019us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1912264960}
W20260709 13:15:52.575122  3197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1714) took 2781 ms (client timeout 1612 ms). Trace:
W20260709 13:15:52.575670  3197 rpcz_store.cc:269] 0709 13:15:49.793231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.829088 (+ 35857us) service_pool.cc:224] Handling call
0709 13:15:52.574678 (+2745590us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b5400178254. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:52.574894 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5291540736}
I20260709 13:15:52.548121  6293 consensus_queue.cc:1059] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
W20260709 13:15:52.577208  3045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2176) took 5211 ms (client timeout 1987 ms). Trace:
W20260709 13:15:52.577780  3045 rpcz_store.cc:269] 0709 13:15:47.293709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.317915 (+ 24206us) service_pool.cc:224] Handling call
0709 13:15:52.496763 (+5178848us) spinlock_profiling.cc:243] Waited 4.22 s on lock 0x7b54001d83d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:52.505250 (+  8487us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9701336960}
I20260709 13:15:52.579365  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:52.584749  6458 log.cc:927] Time spent T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.510s	user 0.004s	sys 0.000s
W20260709 13:15:52.594043  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 111240us
I20260709 13:15:52.595275  3090 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:52.597289  6456 log.cc:927] Time spent T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.421s	user 0.000s	sys 0.002s
I20260709 13:15:52.598207  6123 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:52.598737  6123 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:52.597213  3090 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:52.599138  6123 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:52.600639  6475 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:52.599121  6299 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:52.552232  6387 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:52.610255  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:52.512109  6472 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:52.555912  6487 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.618264  3046 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 9: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:52.620486  6423 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:52.614799  6030 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:52.632429  6389 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:52.634019  3091 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:52.635149  6295 consensus_queue.cc:1059] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:52.636003  6237 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:52.636479  6237 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.636948  6237 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:52.636605  6240 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:52.637784  6475 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:52.638154  6475 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:52.639274  6475 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:52.642612  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.546391  3125 raft_consensus.cc:2955] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:15:52.646545  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 158351us
I20260709 13:15:52.616506  6482 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:52.612169  6387 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:52.650398  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 104128us
I20260709 13:15:52.661116  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:52.667891  3761 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:52.670149  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 45112.6us
I20260709 13:15:52.641237  6475 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:52.685405  5398 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:52.687309  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:52.564569  6329 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.636682  6295 raft_consensus.cc:3055] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:52.694847  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2198) took 2059 ms. Trace:
W20260709 13:15:52.696404  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.671680  6387 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:52.690438  3090 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:52.674043  6030 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:52.701484  3046 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:52.709650  6489 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:52.696555  3042 rpcz_store.cc:276] 0709 13:15:50.634955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.089125 (+1454170us) service_pool.cc:224] Handling call
0709 13:15:52.089546 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.107604 (+ 18058us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:52.322688 (+215084us) log.cc:844] Serialized 14 byte log entry
0709 13:15:52.694266 (+371578us) log.cc:844] Serialized 14 byte log entry
0709 13:15:52.694469 (+   203us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:52.694519 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:52.694579 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.694646 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.694771 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2006,"prepare.queue_time_us":212535,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":8626,"raft.queue_time_us":67394,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":47121,"thread_start_us":433837,"threads_started":3,"wal-append.queue_time_us":180844}
I20260709 13:15:52.721354  6386 raft_consensus.cc:3055] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:52.722296  5767 raft_consensus.cc:3055] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:15:52.727236  3047 consensus_meta.cc:287] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.631s	user 0.013s	sys 0.000s
I20260709 13:15:52.735715  3047 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
W20260709 13:15:52.737013  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 330289us
I20260709 13:15:52.649772  6487 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:52.732824  3051 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:15:52.696488  6295 raft_consensus.cc:740] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:52.694135  6390 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:15:52.727399  6477 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:15:52.730779  6333 consensus_meta.cc:287] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.554s	user 0.014s	sys 0.000s
I20260709 13:15:52.693480  6329 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:52.674561  6423 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:52.762496  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:52.763947  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:52.730180  6386 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:52.734205  5767 raft_consensus.cc:740] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:52.713574  6123 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:52.766996  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.765442  3045 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:52.685520  6462 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:15:52.770130  6328 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:52.770537  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:52.779610  3121 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.555s	user 0.013s	sys 0.000s
I20260709 13:15:52.780002  3121 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:15:52.765803  6426 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:52.769222  6389 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.758704  6482 consensus_queue.cc:1059] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:15:52.794872  3195 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:52.776404  6477 raft_consensus.cc:697] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:52.775961  6328 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:52.801190  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2207) took 1123 ms. Trace:
I20260709 13:15:52.765653  6333 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:52.804708  3047 rpcz_store.cc:276] 0709 13:15:51.678379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.008909 (+330530us) service_pool.cc:224] Handling call
0709 13:15:52.800980 (+792071us) spinlock_profiling.cc:243] Waited 69.2 ms on lock 0x7b5400075154. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:52.801128 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159122304}
I20260709 13:15:52.807837  3043 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: []
W20260709 13:15:52.812114  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.814174  3042 raft_consensus.cc:2410] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:15:52.814838  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 124533us
W20260709 13:15:52.815738  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 104323us
I20260709 13:15:52.818712  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:52.811838  6260 consensus_meta.cc:287] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.547s	user 0.012s	sys 0.000s
I20260709 13:15:52.830070  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 455) took 1641 ms. Trace:
I20260709 13:15:52.830555  3043 rpcz_store.cc:276] 0709 13:15:51.188233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.313344 (+1125111us) service_pool.cc:224] Handling call
0709 13:15:52.801126 (+487782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.813148 (+ 12022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.829276 (+ 16128us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b5400075150. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:52.829592 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1120888192}
I20260709 13:15:52.832480  3091 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:52.806777  6328 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:52.832235  3049 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:15:52.838022  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:52.839002  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 106835us
I20260709 13:15:52.840590  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:52.842074  6329 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:52.841918  6492 consensus_queue.cc:1059] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:15:52.843421  6492 raft_consensus.cc:3055] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:52.843773  6492 raft_consensus.cc:740] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:52.844458  6123 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:52.844594  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:52.844816  6333 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:52.845016  6488 consensus_queue.cc:1059] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:15:52.845549  6240 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:52.846156  6240 raft_consensus.cc:697] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:52.782821  6490 consensus_queue.cc:1059] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:15:52.847846  6498 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:52.848232  6490 raft_consensus.cc:3055] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:52.848371  6498 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:52.770576  6386 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:52.848764  6490 raft_consensus.cc:740] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:52.848928  6498 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:52.849498  6386 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:52.784642  6423 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:52.848609  6486 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.163s	user 0.000s	sys 0.002s
I20260709 13:15:52.834031  6482 raft_consensus.cc:3055] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:52.852108  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:52.801539  6389 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:52.850600  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:52.855237  3090 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:52.856765  6487 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:52.857216  3164 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:52.826958  5767 consensus_queue.cc:260] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:52.889948  6299 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:52.859372  2945 catalog_manager.cc:5697] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 2 to 6, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 6 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:52.890558  3164 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:52.867683  3046 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:52.869011  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:52.871338  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:52.874162  6477 consensus_queue.cc:237] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:52.848742  6240 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:52.876868  6237 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:52.880688  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.878907  6482 raft_consensus.cc:740] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:52.816866  6295 consensus_queue.cc:260] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:52.889827  6479 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.836488  6260 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:52.894919  3042 raft_consensus.cc:2410] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:15:52.895229  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:52.916628  3043 raft_consensus.cc:2410] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:15:52.891762  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 409) took 3576 ms. Trace:
I20260709 13:15:52.883118  3761 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:52.904516  2948 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49738 (request call id 147) took 11661 ms (client timeout 15000 ms). Trace:
I20260709 13:15:52.851356  6490 consensus_queue.cc:260] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:52.904867  6299 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:52.904999  6123 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:52.905328  3051 raft_consensus.cc:2410] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 9 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:15:52.889961  6472 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:52.909858  6237 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:52.910073  6476 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:52.906016  2945 catalog_manager.cc:5697] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 3 to 6, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 6 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:52.911171  5767 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:52.911417  6389 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:52.911828  6479 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:52.912865  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:52.913017  6489 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:52.912681  6439 consensus_queue.cc:1059] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:52.913548  6295 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:52.914409  6482 consensus_queue.cc:260] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:52.926210  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.926612  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 43575us
W20260709 13:15:52.932945  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 88452.5us
I20260709 13:15:52.901630  6329 raft_consensus.cc:3055] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:52.917064  3200 rpcz_store.cc:276] 0709 13:15:49.315420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.384471 (+3069051us) service_pool.cc:224] Handling call
0709 13:15:52.426341 (+ 41870us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:52.492461 (+ 66120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:52.492499 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:52.493067 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:15:52.756457 (+263390us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:52.756507 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.756681 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:52.891564 (+134883us) raft_consensus.cc:1685] finished
0709 13:15:52.891581 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.891711 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9336,"raft.queue_time_us":91496,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":11746,"thread_start_us":280875,"threads_started":2,"wal-append.queue_time_us":277062}
I20260709 13:15:52.937141  3165 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:52.882128  6480 consensus_queue.cc:1059] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:15:52.949133  3044 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:15:52.949560  6487 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:52.936264  6404 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:52.953078  3051 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:15:52.966161  3051 pending_rounds.cc:85] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 8
I20260709 13:15:52.966555  3051 pending_rounds.cc:107] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:15:52.966888  3051 raft_consensus.cc:2889] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:52.967526  6299 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:52.954591  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 114378us
I20260709 13:15:52.957937  3045 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:52.959401  3049 raft_consensus.cc:2393] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:52.932958  3795 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "f20672b2852447a6bc1e137c4dd40904"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:15:52.844697  6492 consensus_queue.cc:260] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:52.973376  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:52.974009  3121 raft_consensus.cc:2376] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8. Re-sending same reply.
I20260709 13:15:52.975224  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:52.976147  3120 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:15:52.977591  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 87199.1us
I20260709 13:15:52.977869  3165 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:52.978621  3795 raft_consensus.cc:606] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Received request to transfer leadership to TS f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:52.981174  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.955565  6329 raft_consensus.cc:740] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:52.982319  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:52.983944  3042 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:52.985176  6293 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:52.985374  3091 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:52.985808  6293 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:52.987912  6099 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:52.989079  6293 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:52.990293  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.990574  6099 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:52.969808  6423 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:52.992228  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2209) took 1144 ms. Trace:
I20260709 13:15:52.993882  3044 rpcz_store.cc:276] 0709 13:15:51.931256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.488528 (+557272us) service_pool.cc:224] Handling call
0709 13:15:52.505169 (+ 16641us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:52.960981 (+455812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.984608 (+ 23627us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b540027d3d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:52.992167 (+  7559us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1014387584}
I20260709 13:15:52.995334  3045 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
W20260709 13:15:52.917351  2948 rpcz_store.cc:269] 0709 13:15:41.269807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.270177 (+   370us) service_pool.cc:224] Handling call
0709 13:15:41.714046 (+443869us) spinlock_profiling.cc:243] Waited 57.4 ms on lock 0x7b5400002490. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28f0b2 00007ff836208a89 00007ff8361a0da6 00007ff836172088 00007ff83627037e 00007ff8347312a4 00007ff834731232 00007ff834731161 00007ff8347310dc
0709 13:15:52.904238 (+11190192us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:47.650475 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:47.898359 (+247884us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:47.898401 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:15:47.898420 (+    19us) tablet.cc:662] Decoding operations
0709 13:15:47.899931 (+  1511us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:47.900000 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:47.900031 (+    31us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:15:47.901417 (+  1386us) tablet.cc:701] Row locks acquired
0709 13:15:47.901442 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:15:47.901607 (+   165us) write_op.cc:270] Start()
0709 13:15:47.929209 (+ 27602us) write_op.cc:276] Timestamp: P: 1783602947901557 usec, L: 0
0709 13:15:47.933529 (+  4320us) op_driver.cc:348] REPLICATION: starting
0709 13:15:48.065121 (+131592us) log.cc:844] Serialized 6408 byte log entry
0709 13:15:49.319830 (+1254709us) op_driver.cc:464] REPLICATION: finished
0709 13:15:49.555005 (+235175us) write_op.cc:301] APPLY: starting
0709 13:15:49.555103 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:49.555581 (+   478us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:49.555745 (+   164us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:49.560712 (+  4967us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:49.708874 (+148162us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:15:49.711479 (+  2605us) write_op.cc:312] APPLY: finished
0709 13:15:49.751302 (+ 39823us) log.cc:844] Serialized 113 byte log entry
0709 13:15:49.751482 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:49.751637 (+   155us) write_op.cc:454] Released schema lock
0709 13:15:49.751691 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:49.752098 (+   407us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:49.752129 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2902697,"reported_tablets":28,"spinlock_wait_cycles":132128128,"child_traces":[["op",{"apply.queue_time_us":234893,"apply.run_cpu_time_us":5108,"apply.run_wall_time_us":197074,"num_ops":16,"prepare.queue_time_us":474534,"prepare.run_cpu_time_us":48171,"prepare.run_wall_time_us":579543,"raft.queue_time_us":185258,"raft.run_cpu_time_us":73888,"raft.run_wall_time_us":218153,"replication_time_us":1386139,"thread_start_us":753619,"threads_started":4,"wal-append.queue_time_us":419932,"wal-append.run_cpu_time_us":8652,"wal-append.run_wall_time_us":2252080}]]}
I20260709 13:15:52.999807  3051 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:53.002556  3122 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:15:53.003057  3122 pending_rounds.cc:85] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 6
I20260709 13:15:53.003409  3122 pending_rounds.cc:107] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:15:53.003687  3122 raft_consensus.cc:2889] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:53.005407  6482 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:53.008566  6476 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:52.971935  6299 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:53.014958  6299 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:53.010556  6389 raft_consensus.cc:3055] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:53.013219  6492 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:53.013929  6439 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:53.014531  6494 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 13:15:53.016079  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.017496  3165 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:52.991648  6490 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:53.022919  3125 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:52.977559  6404 raft_consensus.cc:697] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:53.026386  6439 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.995695  3045 pending_rounds.cc:85] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 7
I20260709 13:15:53.043277  3045 pending_rounds.cc:107] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:15:53.043555  3045 raft_consensus.cc:2889] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:53.037674  2945 catalog_manager.cc:5697] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.040807  6328 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:53.052889  3164 connection.cc:256] RPC call timeout handler was delayed by -1.6105211550000149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
W20260709 13:15:53.053494  3164 connection.cc:256] RPC call timeout handler was delayed by -1.5484211549999145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 13:15:53.053941  3164 connection.cc:256] RPC call timeout handler was delayed by -1.5376211550001244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
W20260709 13:15:53.054257  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.054287  3164 connection.cc:256] RPC call timeout handler was delayed by -1.48542115500004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
W20260709 13:15:53.055102  3164 connection.cc:256] RPC call timeout handler was delayed by -1.4170211549999294s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260709 13:15:53.055485  3164 connection.cc:256] RPC call timeout handler was delayed by -1.4143211549999251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
W20260709 13:15:53.055892  3164 connection.cc:256] RPC call timeout handler was delayed by -1.406221154999912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
W20260709 13:15:53.056273  3164 connection.cc:256] RPC call timeout handler was delayed by -1.4053211549999105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
W20260709 13:15:53.056666  3164 connection.cc:256] RPC call timeout handler was delayed by -1.2235211550000713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19970000000000002s for a response
I20260709 13:15:53.059017  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:53.026589  6237 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:53.020380  6389 raft_consensus.cc:740] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:52.984041  6487 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:53.058473  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:53.058357  6489 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.064465  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:53.064261  6329 consensus_queue.cc:260] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:53.065780  6237 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.067072  3045 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:15:53.067314  2945 catalog_manager.cc:5697] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.046479  6439 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:53.114151  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 56700.2us
I20260709 13:15:53.113195  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2214) took 1041 ms. Trace:
I20260709 13:15:53.070735  6325 raft_consensus.cc:3055] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:53.072944  6260 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:53.076412  6387 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:53.052460  6328 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:53.078516  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:53.018146  6293 consensus_queue.cc:1059] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:15:53.111340  3126 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: []
W20260709 13:15:53.115629  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.126109  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:53.125838  6389 consensus_queue.cc:260] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:53.126737  2945 catalog_manager.cc:5697] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 1 to 4, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 4 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.127539  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:53.129125  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:53.118158  6325 raft_consensus.cc:740] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:53.128736  2945 catalog_manager.cc:5697] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 2 to 6, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 6 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:53.131358  6325 consensus_queue.cc:260] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:53.132663  6325 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:53.132699  2945 catalog_manager.cc:5697] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:15:53.114499  6237 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:53.134573  6329 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.136029  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:53.135223  6295 raft_consensus.cc:2955] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Committing config change with OpId 8.5: config changed from index 2 to 5, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:15:53.126154  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:53.139665  6487 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:53.115919  3091 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:53.115464  3046 rpcz_store.cc:276] 0709 13:15:52.071351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.949691 (+878340us) service_pool.cc:224] Handling call
0709 13:15:52.950076 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.950320 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:52.950651 (+   331us) log.cc:844] Serialized 14 byte log entry
0709 13:15:53.086475 (+135824us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:53.086558 (+    83us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:53.086619 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:53.086726 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:53.113123 (+ 26397us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4906,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":53599,"thread_start_us":107930,"threads_started":1}
W20260709 13:15:53.145629  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 65757.2us
I20260709 13:15:53.157992  3200 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 8: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:53.153466  2945 catalog_manager.cc:5697] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.127557  6389 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:53.163990  3045 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:53.165125  3164 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:53.165570  3045 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:15:53.166000  3045 pending_rounds.cc:85] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 4
I20260709 13:15:53.166992  3195 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:53.166867  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 459) took 1713 ms. Trace:
I20260709 13:15:53.166179  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:53.169495  3165 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:53.198104  3045 pending_rounds.cc:107] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:15:53.198499  3045 raft_consensus.cc:2889] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:53.160876  3046 raft_consensus.cc:2955] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:15:53.202839  2945 catalog_manager.cc:5697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 4 to 5, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 5 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.140882  6484 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:53.116082  6489 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:53.214552  3192 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:53.119918  6381 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:15:53.194109  3048 rpcz_store.cc:276] 0709 13:15:51.453074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.469409 (+1016335us) service_pool.cc:224] Handling call
0709 13:15:52.469911 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:52.519153 (+ 49242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:52.519174 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:52.538714 (+ 19540us) log.cc:844] Serialized 26 byte log entry
0709 13:15:52.815788 (+277074us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:52.815831 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.815900 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:53.166660 (+350760us) raft_consensus.cc:1685] finished
0709 13:15:53.166692 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:53.166813 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12590,"raft.queue_time_us":68644,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3615,"thread_start_us":193963,"threads_started":2,"wal-append.queue_time_us":331553}
W20260709 13:15:53.208784  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 43789.7us
I20260709 13:15:53.215736  2945 catalog_manager.cc:5697] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 2 to 6, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 6 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.221557  3044 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:15:53.222770  6123 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.223500  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:53.224156  3118 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
W20260709 13:15:53.225814  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.118736  6496 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:15:53.230144  6472 raft_consensus.cc:3055] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:53.230571  6472 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:15:53.231571  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 112683us
I20260709 13:15:53.231751  6489 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:53.231464  6472 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:53.161312  6479 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:53.223335  6123 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:53.242748  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.162623  6328 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:53.247225  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:53.210150  3125 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:53.112648  6404 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:53.248059  3119 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
W20260709 13:15:53.234908  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 94480.2us
I20260709 13:15:53.163007  6461 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:15:53.206149  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:53.215687  6292 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:53.238068  3198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:15:53.253357  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:53.199872  6423 consensus_queue.cc:1059] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:15:53.259028  3198 raft_consensus.cc:606] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:53.234256  6484 raft_consensus.cc:697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:53.238497  6472 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:53.263950  3120 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:53.261229  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:53.257892  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:53.265908  3164 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:53.270108  3048 raft_consensus.cc:2368] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9.
I20260709 13:15:53.266866  2945 catalog_manager.cc:5697] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 2 to 3, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 3 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:15:53.265060  6499 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:53.270148  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:53.270776  3045 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:53.273274  3119 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 8: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:53.272147  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:53.235028  6462 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:15:53.271484  3044 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:53.243961  3791 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
W20260709 13:15:53.276223  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.260386  6275 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:53.258594  6292 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.288702  6292 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:53.294207  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:53.295054  3799 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:15:53.295288  6475 raft_consensus.cc:3055] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:53.295761  6475 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:53.297020  3044 raft_consensus.cc:1275] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:53.296710  6475 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:53.281172  6487 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:53.294252  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:53.302700  3126 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:53.246464  6328 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:53.258776  6240 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.243886  6381 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:15:53.283377  6513 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:53.284945  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2204) took 2095 ms. Trace:
I20260709 13:15:53.274431  6392 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.328107  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:53.304268  3045 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:53.305109  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:53.307225  6123 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:53.308799  3047 raft_consensus.cc:2410] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:15:53.310636  6491 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:53.312702  6387 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:53.313949  6484 consensus_queue.cc:237] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:53.324661  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:53.339865  3125 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
W20260709 13:15:53.331103  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.343593  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 111234us
I20260709 13:15:53.327045  3050 rpcz_store.cc:276] 0709 13:15:51.189574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.447321 (+1257747us) service_pool.cc:224] Handling call
0709 13:15:52.447780 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:52.827938 (+380158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:52.827962 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:52.851103 (+ 23141us) log.cc:844] Serialized 26 byte log entry
0709 13:15:53.019385 (+168282us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:53.019413 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:53.019460 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:53.284720 (+265260us) raft_consensus.cc:1685] finished
0709 13:15:53.284743 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:53.284879 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4247,"raft.queue_time_us":85855,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":6789,"thread_start_us":419077,"threads_started":2,"wal-append.queue_time_us":246635}
W20260709 13:15:53.348860  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.362912  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 123890us
I20260709 13:15:53.363116  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:53.364019  5398 raft_consensus.cc:3055] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:53.365643  5398 raft_consensus.cc:740] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:15:53.367471  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 62496.1us
I20260709 13:15:53.329123  6328 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:53.327366  6475 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:53.335274  6491 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.340116  6490 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:53.289515  6439 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:53.381772  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:53.380278  3050 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:53.344966  6392 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:53.386485  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:53.388885  3126 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:15:53.338891  6404 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:15:53.373497  6387 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.335964  6240 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:53.395864  6392 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:53.396121  6439 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:53.400202  3049 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:53.401959  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:53.402172  6488 consensus_queue.cc:1059] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:15:53.405081  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 68197.1us
I20260709 13:15:53.343132  6499 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:15:53.377215  6491 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:53.407513  5398 consensus_queue.cc:260] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:53.390657  6498 consensus_meta.cc:287] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.004s
I20260709 13:15:53.438635  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:53.437565  3197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:15:53.480697  3051 raft_consensus.cc:2410] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:15:53.484910  3125 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:15:53.488052  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:53.493427  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:53.493809  6295 consensus_queue.cc:1059] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:15:53.494656  6514 log.cc:927] Time spent T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:15:53.495074  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:53.495227  6295 raft_consensus.cc:3055] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:53.495857  6295 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:53.496124  3118 raft_consensus.cc:2410] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:15:53.494465  3126 raft_consensus.cc:2410] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:15:53.500561  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:53.415176  6329 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:53.505028  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:53.507511  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:53.508440  3090 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:53.515535  5398 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:53.415225  6387 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:53.526127  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 139317us
I20260709 13:15:53.527561  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:53.528702  3125 raft_consensus.cc:2410] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:15:53.437525  6462 consensus_queue.cc:1059] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:15:53.501617  6381 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:53.438004  6498 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:53.548069  6498 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:53.478732  6496 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:15:53.550760  6492 consensus_meta.cc:287] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.000s
W20260709 13:15:53.552032  6299 consensus_meta.cc:287] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.000s
I20260709 13:15:53.552563  6299 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:53.554001  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.554473  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.555224  3045 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:53.537679  6381 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:53.540217  6462 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:53.540645  6517 consensus_queue.cc:1059] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:53.542130  6237 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:53.512373  6423 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:15:53.497563  6295 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:53.585369  3164 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:53.586445  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 101476us
I20260709 13:15:53.556712  6490 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:53.594723  3120 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 9: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:53.610188  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:53.611670  3048 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
W20260709 13:15:53.594286  6524 log.cc:927] Time spent T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:15:53.590786  6123 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:53.602559  6462 raft_consensus.cc:697] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:53.607837  6516 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:15:53.631783  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 143808us
I20260709 13:15:53.635396  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:53.636077  6237 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:53.636251  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:53.636905  3125 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 4.
I20260709 13:15:53.646044  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:53.647980  3198 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 9: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:53.632681  6295 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:53.649623  3125 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: []
W20260709 13:15:53.655037  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 96706.4us
I20260709 13:15:53.641254  6237 raft_consensus.cc:3055] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:15:53.660574  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.644673  6240 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:53.661244  3192 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 5: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:15:53.672950  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.693264  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.696380  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.655193  6387 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:53.677475  6489 raft_consensus.cc:3055] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:53.706009  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:53.685643  6237 raft_consensus.cc:740] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:53.673817  6462 consensus_queue.cc:237] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:53.685336  6516 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:15:53.726495  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.758725  3051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:35708
I20260709 13:15:53.759443  3051 raft_consensus.cc:606] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 13:15:53.759754  3051 raft_consensus.cc:614] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:15:53.718717  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 101995us
W20260709 13:15:53.719338  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 43838.5us
I20260709 13:15:53.704979  6489 raft_consensus.cc:740] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:15:53.763846  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 49750.2us
I20260709 13:15:53.712360  6299 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:53.719072  6490 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:53.789716  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 87204.3us
W20260709 13:15:53.794493  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 356466us
I20260709 13:15:53.790716  3164 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:53.802333  6526 raft_consensus.cc:993] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: : Instructing follower f20672b2852447a6bc1e137c4dd40904 to start an election
I20260709 13:15:53.802676  3762 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:53.811488  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 308100us
I20260709 13:15:53.791592  6490 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:53.801352  6513 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
W20260709 13:15:53.813722  6518 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:15:53.842504  6513 raft_consensus.cc:3055] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:53.842996  6513 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:53.849135  6513 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:53.850455  6381 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:53.850662  6513 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:53.851580  6531 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:15:53.832546  6237 consensus_queue.cc:260] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:53.853415  6237 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:53.863773  6472 consensus_meta.cc:287] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
W20260709 13:15:53.870433  6522 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:15:53.837968  6030 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:53.872725  6030 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:53.873202  6030 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.877939  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:53.879097  3049 raft_consensus.cc:2410] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:53.880153  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:53.882335  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 467) took 1218 ms. Trace:
W20260709 13:15:53.883486  6523 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.256s	user 0.002s	sys 0.000s
I20260709 13:15:53.811496  6496 raft_consensus.cc:1081] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Signalling peer f20672b2852447a6bc1e137c4dd40904 to start an election
I20260709 13:15:53.841123  3091 leader_election.cc:400] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9.
I20260709 13:15:53.841367  6299 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:53.785336  6516 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:53.814033  6475 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
W20260709 13:15:53.923223  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.882841  3046 rpcz_store.cc:276] 0709 13:15:52.663591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.159998 (+496407us) service_pool.cc:224] Handling call
0709 13:15:53.160371 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:53.160756 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:53.320834 (+160078us) log.cc:844] Serialized 14 byte log entry
0709 13:15:53.561302 (+240468us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:53.607662 (+ 46360us) log.cc:844] Serialized 26 byte log entry
0709 13:15:53.607889 (+   227us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:53.607939 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:53.608032 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:53.882084 (+274052us) raft_consensus.cc:1685] finished
0709 13:15:53.882109 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:53.882266 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32654,"raft.queue_time_us":38711,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":43833,"thread_start_us":155957,"threads_started":1,"wal-append.queue_time_us":301020}
I20260709 13:15:53.899991  3091 leader_election.cc:403] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:15:53.887065  6389 consensus_meta.cc:287] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.720s	user 0.009s	sys 0.002s
W20260709 13:15:53.907187  6325 consensus_meta.cc:287] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.774s	user 0.017s	sys 0.000s
W20260709 13:15:53.908083  6292 consensus_meta.cc:287] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.002s
W20260709 13:15:53.925210  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 111866us
I20260709 13:15:53.925693  6475 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9.
I20260709 13:15:53.930665  6392 consensus_queue.cc:1059] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:53.932494  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.987278  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.933975  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2219) took 1208 ms. Trace:
I20260709 13:15:53.938413  6516 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:53.944289  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.891019  6489 consensus_queue.cc:260] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:53.839468  6490 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:53.957237  6520 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.362s	user 0.002s	sys 0.000s
W20260709 13:15:53.897394  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 78439.7us
I20260709 13:15:53.988636  3043 rpcz_store.cc:276] 0709 13:15:52.726102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.193756 (+467654us) service_pool.cc:224] Handling call
0709 13:15:53.214136 (+ 20380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:53.214568 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:53.214608 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:53.238392 (+ 23784us) log.cc:844] Serialized 26 byte log entry
0709 13:15:53.481890 (+243498us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:53.481951 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:53.482052 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:53.882768 (+400716us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:53.924333 (+ 41565us) raft_consensus.cc:1685] finished
0709 13:15:53.924363 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:53.933893 (+  9530us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1949,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":17415,"spinlock_wait_cycles":14974848,"thread_start_us":216197,"threads_started":1,"wal-append.queue_time_us":317080}
I20260709 13:15:53.984530  3091 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:53.992537  3197 raft_consensus.cc:606] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:54.002593  3197 raft_consensus.cc:614] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:53.986605  3194 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:15:53.985688  6292 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:54.007953  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 217335us
I20260709 13:15:54.008772  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:54.013057  3200 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:53.890799  6328 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:54.027740  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:53.900815  6491 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:54.053916  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:54.059063  3042 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
I20260709 13:15:54.059916  3119 raft_consensus.cc:2410] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:15:54.056658  3164 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:54.009423  6439 raft_consensus.cc:3055] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:15:54.062265  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 261154us
I20260709 13:15:54.060984  3091 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:54.064177  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:54.066257  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:54.067561  3043 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:15:54.037492  6538 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:54.080941  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 69766.7us
I20260709 13:15:54.057098  6487 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:54.083583  3118 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:15:54.065093  6439 raft_consensus.cc:740] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:54.088794  3045 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:54.092520  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:54.131976  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.094146  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:54.095105  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:54.095733  6121 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:54.071805  6538 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.102910  6292 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:54.104117  5767 raft_consensus.cc:3055] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:54.138468  6538 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:54.138792  5767 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:54.108724  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 474) took 1086 ms. Trace:
I20260709 13:15:54.133925  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:54.139842  3050 rpcz_store.cc:276] 0709 13:15:53.021934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.384399 (+362465us) service_pool.cc:224] Handling call
0709 13:15:53.408272 (+ 23873us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:53.504882 (+ 96610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:53.504933 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:53.519648 (+ 14715us) log.cc:844] Serialized 26 byte log entry
0709 13:15:53.709258 (+189610us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:53.709319 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:53.709408 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:54.108513 (+399105us) raft_consensus.cc:1685] finished
0709 13:15:54.108540 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:54.108665 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107957,"raft.queue_time_us":98375,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":7815,"thread_start_us":131510,"threads_started":1,"wal-append.queue_time_us":474933}
I20260709 13:15:54.109556  3195 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:54.111212  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:54.142189  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:54.112509  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 75111.2us
I20260709 13:15:54.112932  3194 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:54.143342  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:54.114300  6491 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:54.115681  6490 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:54.120464  3197 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:54.122766  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:54.143910  6237 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:15:54.146870  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:54.147439  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:54.149230  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:54.154461  3049 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:54.164412  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.160493  3200 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:54.158303  6533 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:54.167171  6533 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.168056  6513 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.168557  6513 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:54.169461  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:54.158463  3192 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 6.
W20260709 13:15:54.151172  6522 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:15:54.161703  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:54.174880  3045 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:54.182102  3051 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:54.173774  3791 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:54.174932  6533 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:54.191803  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:54.198271  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 55003.8us
I20260709 13:15:54.208236  3191 raft_consensus.cc:2393] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:54.210553  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:54.214506  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:54.215342  3192 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:54.221302  3049 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
W20260709 13:15:54.222812  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.161259  3118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
 from {username='slave'} at 127.0.0.1:55318
I20260709 13:15:54.224552  3118 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:54.224893  3118 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:54.170917  6392 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:54.226380  3197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:15:54.226979  3197 raft_consensus.cc:606] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:54.227072  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:54.227316  3197 raft_consensus.cc:614] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:54.229794  3164 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:54.178753  6328 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:54.234318  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:54.238288  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:54.238893  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:54.238759  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 62036.2us
I20260709 13:15:54.227741  3194 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:54.245265  3193 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:54.243058  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:54.249621  3197 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
W20260709 13:15:54.250248  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.223839  6488 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:54.251847  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.258586  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:54.295002  3197 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:15:54.296221  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:54.299008  3194 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 5: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:54.251142  6475 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:54.216411  5767 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:54.256017  6491 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:54.303107  3048 raft_consensus.cc:2955] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Committing config change with OpId 8.5: config changed from index 2 to 5, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:15:54.319298  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:54.319741  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:54.323648  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.320657  3193 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:15:54.311088  6523 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:15:54.325650  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 183560us
I20260709 13:15:54.304441  6475 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:54.332841  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:54.257220  6030 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:54.343989  3043 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:15:54.347541  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:54.354105  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:54.386129  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.251884  6439 consensus_queue.cc:260] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:54.386536  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 73799.7us
I20260709 13:15:54.390339  3164 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:54.387315  3049 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:54.388631  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:54.335152  6475 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:54.332772  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:54.348438  6513 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:54.400074  3049 raft_consensus.cc:3055] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:54.390326  6439 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:54.404994  3049 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:54.389055  6392 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:54.409403  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:54.410588  3164 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:54.411417  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.411010  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:54.407816  3049 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:54.420177  6558 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:15:54.426929  6553 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:15:54.429668  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:54.430598  3198 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:54.430866  3193 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:15:54.434944  3049 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:54.412241  6121 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:54.439567  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:54.452929  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:54.434752  3197 raft_consensus.cc:2955] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Committing config change with OpId 8.5: config changed from index 2 to 5, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:15:54.428748  6564 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.417239  6490 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:54.465122  3049 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:15:54.470178  3049 pending_rounds.cc:85] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 7
I20260709 13:15:54.470475  3049 pending_rounds.cc:107] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:15:54.470747  3049 raft_consensus.cc:2889] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:54.457943  6551 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
W20260709 13:15:54.475816  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.477838  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:54.478109  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:54.478435  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:54.480196  6557 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:15:54.480545  6491 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:54.481330  6550 log.cc:927] Time spent T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:15:54.481666  6492 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:15:54.471804  6496 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.009s
I20260709 13:15:54.464190  6497 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:54.495815  3794 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 5: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:54.501396  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:54.490556  6562 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:54.505892  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.509867  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.518581  6555 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 13:15:54.497047  6496 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.000s	sys 0.009s
I20260709 13:15:54.528574  3795 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:54.534307  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:54.536391  3192 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:54.538134  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 46490.9us
W20260709 13:15:54.539228  6561 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:15:54.542276  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:54.474457  6564 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:54.556344  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:54.543077  6389 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:54.557633  6389 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.558171  6389 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:54.559487  3761 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:54.560269  6293 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:54.560659  6293 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:54.561014  6293 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:54.543821  3198 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:54.544230  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:54.544899  3117 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:15:54.546098  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:54.546191  3790 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:54.504981  6497 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:54.542768  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:54.566728  6497 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:54.568055  3791 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:54.576839  3195 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:54.584092  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:54.585616  3795 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:54.587832  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:54.588414  3117 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:15:54.588588  3198 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:54.590225  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:54.599556  3120 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:54.601307  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:54.601406  5398 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:54.605540  6564 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:54.605964  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:54.606618  3125 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:54.607857  6489 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:54.613605  6566 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:15:54.614041  3164 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:54.615649  3164 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:54.617075  6491 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:54.622416  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:54.622336  6389 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:54.624596  6389 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:54.625046  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.625823  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:54.625931  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:54.626616  3125 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:54.626582  3120 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:15:54.628402  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:15:54.633138  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.628405  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:54.634938  3191 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:15:54.636291  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.638713  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.603844  3118 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:54.639595  3122 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:54.640215  3762 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:54.642228  3192 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
W20260709 13:15:54.643429  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.616765  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:54.633491  6491 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:15:54.649704  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 46617.9us
I20260709 13:15:54.651539  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:54.652125  3091 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:54.665009  3117 raft_consensus.cc:2368] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
I20260709 13:15:54.605985  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:54.676577  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:54.680537  3125 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:54.692423  3118 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:54.694197  3200 raft_consensus.cc:2368] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 7. Current term is 8.
W20260709 13:15:54.695080  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 78396.6us
I20260709 13:15:54.699393  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:54.701999  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:54.661422  6569 log.cc:927] Time spent T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:15:54.714399  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:54.710460  3044 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 5.
I20260709 13:15:54.710666  3090 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:54.661118  6510 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:54.660175  6491 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:54.727520  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:54.660636  6439 raft_consensus.cc:2764] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:15:54.597874  6293 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:54.729241  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 78927.7us
I20260709 13:15:54.735498  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:54.743250  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.712220  6295 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:54.651391  6386 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
W20260709 13:15:54.731305  6533 consensus_meta.cc:287] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.541s	user 0.012s	sys 0.000s
I20260709 13:15:54.749351  3164 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:54.750461  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:54.711568  6240 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:54.727183  6538 consensus_meta.cc:287] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.588s	user 0.013s	sys 0.000s
I20260709 13:15:54.744223  3196 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
W20260709 13:15:54.754621  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.756203  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:54.757078  3164 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:54.745179  6392 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.776446  3798 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:15:54.737202  6491 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:54.731599  6510 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.713666  6389 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:15:54.789876  6510 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:54.784475  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:54.759678  6533 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:54.778141  6472 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:54.804076  6533 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:54.809639  3795 raft_consensus.cc:1217] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Deduplicated request from leader. Original: 7.7->[8.8-8.8]   Dedup: 8.8->[]
I20260709 13:15:54.810217  3795 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:15:54.811064  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:54.807672  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.782537  6488 consensus_meta.cc:287] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.003s
I20260709 13:15:54.784853  6295 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:54.778913  6538 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:54.813458  6392 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:54.778508  6439 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:54.834278  6475 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:54.755072  6546 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:15:54.755705  6527 consensus_queue.cc:1059] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
W20260709 13:15:54.831539  6578 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:15:54.810221  6293 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:54.871687  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.836989  6488 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:54.935062  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.928247  3117 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:15:54.929978  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:54.937371  3125 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:54.893859  6121 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:54.951475  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:54.955628  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:54.848919  6439 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:55.038792  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:55.039314  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:55.040051  3118 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 9: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:15:55.040354  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 329744us
I20260709 13:15:55.040946  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:55.041107  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:55.048336  3117 raft_consensus.cc:2376] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6. Re-sending same reply.
W20260709 13:15:55.056576  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 338721us
W20260709 13:15:55.055855  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 307550us
I20260709 13:15:55.059551  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:55.060513  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:55.061081  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:55.061275  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:54.959131  6121 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:55.034771  6585 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:55.069214  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 258280us
I20260709 13:15:55.070153  3126 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:15:55.073593  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:55.078657  3164 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:55.083369  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:55.084373  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:55.087759  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:55.061501  6123 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:55.090150  3164 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:55.071319  6121 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:55.093497  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:55.094599  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:55.072052  6487 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.097060  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:55.089308  3117 raft_consensus.cc:2410] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:15:55.107806  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:55.112016  3051 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:55.091019  3090 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:55.108362  3126 raft_consensus.cc:2410] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:15:55.074607  6584 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:55.115621  3125 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:55.112982  3090 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:55.114060  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:55.119786  3121 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:55.070988  6295 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:55.122236  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:55.097939  6123 raft_consensus.cc:697] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:55.132040  3126 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: [8.4-8.4]
W20260709 13:15:55.135360  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.111230  6533 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.125378  3090 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:55.075831  6585 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:55.110144  6583 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:55.170825  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.146229  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:55.171495  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.171828  3047 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:55.124076  6328 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.155743  6488 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:55.176505  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:55.177326  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:55.183888  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.192414  3121 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:15:55.196959  3118 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:55.204646  3200 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:55.130316  6292 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:15:55.160065  6584 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:55.211272  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 85950.7us
I20260709 13:15:55.212365  6590 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:55.213117  6598 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:55.117678  6487 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:55.235574  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 63081.2us
I20260709 13:15:55.238811  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:55.244719  3118 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:55.141556  6491 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:55.248834  6538 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:55.249280  6030 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:55.234956  6581 log.cc:927] Time spent T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:15:55.218413  6392 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:15:55.240228  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:55.213619  5767 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:55.243798  3196 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:55.171728  6533 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:55.261572  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:55.238018  6582 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:15:55.265232  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:55.268054  3042 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:55.266175  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:55.271306  3196 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:15:55.238974  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:55.272425  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:55.250017  6123 consensus_queue.cc:237] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:55.273358  6589 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:55.249569  6538 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:55.273922  6593 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:55.206132  6328 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:55.289523  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.235241  6488 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:55.277643  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:55.282740  6585 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:55.284531  6475 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:55.268569  6510 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:55.302287  6510 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:55.303088  3794 raft_consensus.cc:2368] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
I20260709 13:15:55.286314  6590 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:55.288113  6533 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:55.269711  6575 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 13:15:55.263523  6439 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:55.275029  3196 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:55.293191  3119 raft_consensus.cc:1240] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 7. Current term is 8. Ops: []
W20260709 13:15:55.310596  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.291383  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:55.312348  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 45434.7us
I20260709 13:15:55.313524  3015 leader_election.cc:400] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
I20260709 13:15:55.305860  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:55.298463  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:55.289829  6546 consensus_queue.cc:1059] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:15:55.318209  6546 raft_consensus.cc:3055] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:55.318601  6546 raft_consensus.cc:740] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:55.319521  6546 consensus_queue.cc:260] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:55.321059  6546 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:55.321951  6498 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:55.322422  6498 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.322760  6498 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:55.323305  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:55.324290  6488 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:55.324481  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:55.325825  3015 leader_election.cc:403] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:55.326781  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:55.327600  3196 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:55.335819  3165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.019s	sys 0.029s
W20260709 13:15:55.336369  3165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.019s	sys 0.029s
W20260709 13:15:55.336717  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 671865us
I20260709 13:15:55.335862  6475 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.343487  6475 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:55.346060  6488 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
I20260709 13:15:55.347028  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:55.347836  6488 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:55.348335  6488 raft_consensus.cc:697] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:55.349692  6491 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:55.348407  6537 raft_consensus.cc:3055] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:55.347160  3197 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:55.350490  6537 raft_consensus.cc:740] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:55.349324  6488 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:55.351337  6537 consensus_queue.cc:260] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:55.337491  3165 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:55.354029  6328 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:55.355227  6608 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:55.355810  6608 raft_consensus.cc:697] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:15:55.355949  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.356756  6608 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:55.367450  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:55.373926  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:55.374816  3049 raft_consensus.cc:2393] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 10: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:55.363759  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:55.368487  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:55.374574  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:55.375468  3045 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:15:55.375542  3044 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
W20260709 13:15:55.377858  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 80145.2us
I20260709 13:15:55.385208  3195 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:55.385607  3091 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:55.386972  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:55.388964  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:55.389575  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:55.389642  3045 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:15:55.390425  3044 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:15:55.390748  3198 raft_consensus.cc:1240] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:55.391855  3192 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 8: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:55.394490  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:55.395628  3122 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:55.396701  3196 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:15:55.335951  6590 raft_consensus.cc:697] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:55.401484  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:15:55.399983  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 46252.7us
I20260709 13:15:55.360801  3790 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:55.366140  6475 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:55.407302  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:55.411806  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:55.413420  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:55.429556  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:55.430639  3196 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
W20260709 13:15:55.437649  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:55.438668  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 53161.3us
I20260709 13:15:55.441213  3051 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:55.414194  6593 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:55.500758  3192 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:15:55.490631  3198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:15:55.510464  3198 raft_consensus.cc:606] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:55.510939  3198 raft_consensus.cc:614] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:55.483843  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:55.512521  3196 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 5: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:15:55.503863  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.519208  3195 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:55.491145  3091 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:55.442607  6489 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:55.444684  6475 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:55.529762  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:55.534799  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:55.537266  6517 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.528404  6538 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:55.543277  6590 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:55.548534  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.549141  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:55.537781  3091 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:55.516738  6328 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.550813  3192 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:55.524925  6423 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.559823  3191 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:15:55.558475  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 468402us
I20260709 13:15:55.549790  6475 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.564165  3164 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:55.558532  6517 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:55.588518  6475 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:55.584905  3796 raft_consensus.cc:2410] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:15:55.591559  6517 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:55.592548  6517 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.522842  6593 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:55.593984  6589 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:55.593230  6517 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:55.594933  6123 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:55.595209  6593 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:55.598452  6517 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:55.594444  6589 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.534894  6588 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:55.584228  3794 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:15:55.545986  6487 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:55.551920  6538 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:55.607985  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 43924us
I20260709 13:15:55.587280  6121 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:55.609241  3164 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:55.603609  6589 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:55.619024  3193 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.004s	sys 0.017s
W20260709 13:15:55.625463  3193 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.004s	sys 0.017s
I20260709 13:15:55.610533  6538 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:55.611629  6487 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:55.630820  3200 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 9: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:55.636116  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:55.567612  6423 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:55.564991  6328 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:55.615482  6593 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:55.611999  6606 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:55.629781  3794 pending_rounds.cc:85] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Aborting all ops after (but not including) 6
I20260709 13:15:55.641101  3794 pending_rounds.cc:107] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.7
I20260709 13:15:55.641433  3794 raft_consensus.cc:2917] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Aborting config change with OpId 6.7: Aborted: Op aborted by new leader
I20260709 13:15:55.663436  3794 raft_consensus.cc:2889] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:55.677845  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:55.678879  3193 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:55.678813  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:55.681146  3165 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:15:55.694626  3164 connection.cc:256] RPC call timeout handler was delayed by -1.2205401569999594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
W20260709 13:15:55.695278  3164 connection.cc:256] RPC call timeout handler was delayed by -1.1557401569998547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
W20260709 13:15:55.696256  3164 connection.cc:256] RPC call timeout handler was delayed by -1.1017401569997674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 13:15:55.698228  3164 connection.cc:256] RPC call timeout handler was delayed by -1.0873401569999714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
I20260709 13:15:55.702508  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:55.703438  3196 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:55.684720  3761 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:55.708702  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:55.709477  3198 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:55.728825  3164 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:55.732653  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:55.611433  6588 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:55.744918  3042 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:15:55.731654  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:55.747558  3195 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:55.758277  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:55.759380  3192 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:15:55.761936  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 448) took 1123 ms. Trace:
I20260709 13:15:55.769838  3199 rpcz_store.cc:276] 0709 13:15:54.638494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.701168 (+ 62674us) service_pool.cc:224] Handling call
0709 13:15:54.728714 (+ 27546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:54.728913 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:55.321000 (+592087us) log.cc:844] Serialized 14 byte log entry
0709 13:15:55.761534 (+440534us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:55.761590 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:55.761642 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.761713 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.761854 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":617407,"prepare.queue_time_us":592613,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"thread_start_us":414485,"threads_started":1}
W20260709 13:15:55.763283  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.763016  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:55.762699  3196 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
W20260709 13:15:55.775038  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 46531.6us
I20260709 13:15:55.776093  3164 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:55.779454  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:55.725662  6491 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:55.781293  3762 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:15:55.771795  6392 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:55.774462  3191 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:15:55.785013  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:55.743284  6510 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:55.800066  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:55.787351  6577 log.cc:927] Time spent T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:15:55.814239  3164 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:55.813210  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 286154us
I20260709 13:15:55.784948  6585 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.786306  6491 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.820691  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:55.837383  3049 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:55.792847  6510 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.784685  6462 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:55.827237  3091 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:55.838873  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:55.848045  3791 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 8: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:15:55.840245  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.743553  6591 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:15:55.851194  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:55.817205  6496 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:55.854432  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 447004us
I20260709 13:15:55.835716  6292 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:55.843258  6491 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:55.846287  6510 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:55.837193  6489 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:15:55.873165  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 338420us
I20260709 13:15:55.901001  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:55.877408  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:55.902369  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:55.879221  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 52061.9us
I20260709 13:15:55.878377  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:55.887261  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.906491  3164 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:55.862035  6583 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:55.914023  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:55.919672  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.922890  3090 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:55.843040  6585 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:55.902509  6598 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:55.908773  6123 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:55.907512  6612 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:55.910717  6292 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:55.923606  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:55.907548  6496 raft_consensus.cc:697] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:55.908805  6121 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:55.856437  6462 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:55.931883  6610 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
W20260709 13:15:55.931524  6601 log.cc:927] Time spent T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 13:15:55.907171  6487 raft_consensus.cc:697] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:15:55.959769  6611 log.cc:927] Time spent T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
W20260709 13:15:55.960634  6613 log.cc:927] Time spent T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:15:55.959589  6496 consensus_queue.cc:237] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:55.961308  6605 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:15:55.933372  6590 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:55.942708  6598 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:55.967496  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:55.979115  3090 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:55.950543  6633 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:55.964529  6121 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:15:55.998522  6616 log.cc:927] Time spent T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:15:55.999329  6629 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:56.000156  6629 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:56.002833  6634 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:56.003222  6585 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:56.003868  6585 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:56.004377  6585 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:56.005959  6615 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:15:55.969492  6489 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.010238  6631 consensus_queue.cc:1059] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:15:56.011116  6631 raft_consensus.cc:3055] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:56.011480  6631 raft_consensus.cc:740] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:56.012264  6631 consensus_queue.cc:260] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:55.980279  6123 raft_consensus.cc:697] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:55.976771  6328 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:56.038252  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:56.046612  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 144300us
I20260709 13:15:56.052834  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:56.053166  3195 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
W20260709 13:15:56.060636  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 270415us
I20260709 13:15:55.985378  6590 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.063778  3762 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:56.019279  6588 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:56.066210  6624 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:55.994525  6598 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:56.019083  6498 consensus_meta.cc:287] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.696s	user 0.011s	sys 0.002s
W20260709 13:15:56.070515  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 91484.3us
I20260709 13:15:56.014101  6637 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:56.085642  3198 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:15:56.013712  6631 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:56.019418  6630 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:56.017936  6462 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:56.109906  6591 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEARNER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:56.089629  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:15:56.124006  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.024984  6475 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.079564  3090 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:56.063153  6634 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:55.986148  6488 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 13:15:56.071698  3762 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:56.071002  6590 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:56.091311  6585 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:56.086971  6487 consensus_queue.cc:237] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.081490  6638 consensus_queue.cc:1059] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:15:56.077696  6609 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:56.055362  6633 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:56.097177  3796 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 460) took 1605 ms (client timeout 1518 ms). Trace:
I20260709 13:15:56.034514  6121 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.073421  6624 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.102643  6637 raft_consensus.cc:697] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:56.103485  6439 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:56.020184  6123 consensus_queue.cc:237] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.108808  6538 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:56.133024  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 61407.5us
I20260709 13:15:56.086135  6498 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.134603  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:56.133523  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 43933.4us
I20260709 13:15:56.182087  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:56.142431  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 62941.5us
I20260709 13:15:56.143373  6606 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:56.119465  6598 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:56.143483  6389 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:56.148973  6392 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:15:56.160423  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 176184us
I20260709 13:15:56.132153  6533 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:56.156782  3796 rpcz_store.cc:269] 0709 13:15:54.491996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.541834 (+ 49838us) service_pool.cc:224] Handling call
0709 13:15:56.096811 (+1554977us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400627fd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:56.097048 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2367213824}
I20260709 13:15:56.185945  3762 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:56.204187  6591 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:56.137708  6510 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:56.154543  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:56.213922  3049 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:15:56.183527  3090 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:56.149603  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:56.178541  6624 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:56.212677  3047 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:56.211247  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:56.214501  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:56.216981  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:56.245975  3119 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 11: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:56.151732  6513 consensus_queue.cc:1059] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:15:56.245875  3118 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
W20260709 13:15:56.251184  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 69216.8us
I20260709 13:15:56.253398  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:56.276029  6647 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:56.277467  6650 log.cc:927] Time spent T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:15:56.247112  6630 raft_consensus.cc:697] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:56.278936  6630 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.162612  6609 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:56.327642  6609 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:56.202235  6389 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:56.328581  6491 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.330432  6389 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:56.331233  6491 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:15:56.199189  6606 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.249014  6629 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:56.208323  6392 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:56.310606  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 127180us
I20260709 13:15:56.344269  3090 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:56.199357  6439 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.316135  6538 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:56.289044  6644 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:15:56.317361  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.318521  6658 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:56.318635  6475 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:56.319656  6648 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:15:56.294186  6646 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:56.321276  6651 raft_consensus.cc:2764] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:15:56.322662  6598 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:56.324775  6498 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:56.325125  6657 raft_consensus.cc:3055] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:56.295320  6637 consensus_queue.cc:237] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:56.270889  6589 consensus_meta.cc:287] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.631s	user 0.012s	sys 0.000s
I20260709 13:15:56.337630  6489 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:56.357934  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:56.324769  6510 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:56.350234  6629 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:56.348474  6389 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:56.372196  6660 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.373018  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:56.374209  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:56.374401  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:56.357085  6295 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:56.360548  6644 raft_consensus.cc:697] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 6 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:15:56.380021  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 176375us
I20260709 13:15:56.382302  3046 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:56.365118  6608 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:56.385537  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:56.367394  6657 raft_consensus.cc:740] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:56.385617  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:56.394490  3047 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:15:56.379132  6629 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:15:56.390053  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 136725us
I20260709 13:15:56.390945  3762 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:56.395840  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:56.397012  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:56.398108  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:56.389181  6660 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:56.398800  6439 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:56.399832  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:56.400032  6660 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:56.400384  6392 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:56.400442  3049 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:56.390192  6489 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.393242  6538 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:56.404090  6489 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:56.395447  6608 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.406055  6462 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:56.406901  6608 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:56.410085  3796 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 8: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:56.410012  6121 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:56.413336  6606 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:56.386061  6295 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.414592  6295 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:56.417855  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.420531  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:56.383003  6389 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:56.422343  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:56.417515  6614 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.513s	user 0.000s	sys 0.005s
I20260709 13:15:56.416946  6634 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:56.429128  3049 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:56.432466  3762 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:56.445587  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:56.447830  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 50888.7us
I20260709 13:15:56.449723  3090 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:56.419992  6629 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:56.420930  6489 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:56.419577  6240 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:56.376435  6589 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.364445  6658 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.452755  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:56.429324  6651 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:56.458446  6654 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:56.458774  6389 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:56.442166  6660 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.443080  6498 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:15:56.455397  6489 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:56.479923  6121 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:15:56.488184  6617 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.644s	user 0.002s	sys 0.000s
I20260709 13:15:56.456141  6631 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:15:56.490167  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 495) took 1828 ms. Trace:
W20260709 13:15:56.500571  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:56.502071  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.507633  6629 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.467347  6538 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:56.510077  6644 consensus_queue.cc:237] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:56.513288  6589 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:56.518009  6593 raft_consensus.cc:1064] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:15:56.519641  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1733) took 1342 ms. Trace:
I20260709 13:15:56.563614  3200 rpcz_store.cc:276] 0709 13:15:55.177379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.270342 (+ 92963us) service_pool.cc:224] Handling call
0709 13:15:56.519364 (+1249022us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b540013bad4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:56.519558 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":772987136}
I20260709 13:15:56.520376  6657 consensus_queue.cc:260] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.521346  6423 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:56.537166  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 84472us
I20260709 13:15:56.405668  6624 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.544941  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:56.550323  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:56.538583  6489 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:56.541833  3120 rpcz_store.cc:276] 0709 13:15:54.661837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.662010 (+   173us) service_pool.cc:224] Handling call
0709 13:15:54.696595 (+ 34585us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:55.043879 (+347284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.043914 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:55.044400 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.393193 (+348793us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:55.393232 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.393310 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:56.471002 (+1077692us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b24001096e8. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d14c9c4 00007ff82d14aacb 00007ff82d305dc9 00007ff82d305a55 00007ff82d304fb0 00007ff82ff7b488 00007ff82ff7bbe8 00007ff82ff53398 00007ff82ff4e76a 00007ff82ff4dbb6
0709 13:15:56.489727 (+ 18725us) raft_consensus.cc:1685] finished
0709 13:15:56.489793 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.490094 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31750,"raft.queue_time_us":30684,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":4157824,"thread_start_us":628349,"threads_started":2,"wal-append.queue_time_us":540261}
W20260709 13:15:56.658346  3014 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.1.227.190:44821, user_credentials={real_user=slave}} blocked reactor thread for 84532.4us
W20260709 13:15:56.739284  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.658048  6655 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.163s
I20260709 13:15:56.545360  6631 consensus_queue.cc:1243] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:56.571830  6533 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:56.541241  6660 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:56.745026  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:56.746009  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:56.746757  3126 raft_consensus.cc:1240] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:56.747510  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:56.747576  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:56.540534  6590 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.547938  6609 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:56.549152  6381 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.556438  6121 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:56.735435  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 303124us
I20260709 13:15:56.541613  6656 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:56.699755  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:56.749540  3120 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:56.748605  3119 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:56.752879  3126 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:56.756547  3121 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:56.758427  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:56.759188  3762 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:56.761793  3123 raft_consensus.cc:2410] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:56.743979  6498 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.762181  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:56.763108  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:56.764757  6656 raft_consensus.cc:697] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:56.765645  6121 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:56.744060  6389 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:56.753638  6609 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.771643  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:56.778782  3119 raft_consensus.cc:2368] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11.
I20260709 13:15:56.779120  3126 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:15:56.771998  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:56.771246  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:56.750571  6488 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.762498  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:56.776081  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:56.780751  3125 raft_consensus.cc:2410] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:15:56.781422  3121 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:15:56.771183  3090 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:56.782111  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:56.783089  3125 raft_consensus.cc:1275] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:56.783288  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:56.765918  6637 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:56.784547  6637 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.753814  6662 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:56.788249  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:56.789778  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:56.791481  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:56.791924  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:56.792100  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:56.791682  3125 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 9: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:56.792232  3118 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 7: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:56.776415  6496 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:56.762614  6381 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:56.776654  6498 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.801046  6602 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:56.802032  6593 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:56.803390  3090 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:56.804543  6660 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:56.805188  6654 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:56.806131  6637 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:56.806732  3015 leader_election.cc:400] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
I20260709 13:15:56.806869  6590 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:56.810341  6633 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:56.781419  6609 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:56.792173  6488 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.773016  6487 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.815471  3121 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:15:56.788405  6630 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:56.780988  6389 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.796509  6625 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:56.796060  6533 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:56.845150  3015 leader_election.cc:403] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:15:56.847429  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 44099.9us
I20260709 13:15:56.815156  6651 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:56.848941  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:56.876314  3118 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 8: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:56.876474  3090 leader_election.cc:400] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 7. Current term is 8.
I20260709 13:15:56.876785  3090 leader_election.cc:403] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:15:56.859676  6656 consensus_queue.cc:237] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:56.877944  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 71350.6us
W20260709 13:15:56.881023  3015 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 2.156s (SENT) [suppressed 4 similar messages]
I20260709 13:15:56.881088  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:56.842288  6496 raft_consensus.cc:697] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:56.883414  6496 consensus_queue.cc:237] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:56.868152  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:56.843521  6295 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.839370  6629 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:56.877768  6654 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:56.883947  6537 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:56.886034  3121 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:56.850420  6589 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:56.862599  6662 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:56.896145  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:56.908514  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:56.909154  3047 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:15:56.885939  6533 raft_consensus.cc:697] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:56.873319  6487 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:56.886569  6590 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 7. Current term is 8.
I20260709 13:15:56.924400  6533 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.926895  6662 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:56.927485  6662 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:56.928333  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:56.929529  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:56.929821  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:56.930629  3048 raft_consensus.cc:2368] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7.
I20260709 13:15:56.930809  6381 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:56.894845  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:56.878599  6462 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:56.919636  3117 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 8: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:56.922163  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:56.933249  3790 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:15:56.898757  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.934173  3045 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:56.922693  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:56.935766  3125 raft_consensus.cc:2393] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:15:56.938021  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 57015us
W20260709 13:15:56.939636  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 47517us
I20260709 13:15:56.940392  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:56.941181  6678 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:56.923135  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:56.943197  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:56.943823  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:56.944837  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:56.945412  3191 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:15:56.917052  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.913350  6657 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:56.947779  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:56.948774  6462 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:56.898239  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:56.949297  6462 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:56.950639  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:56.951169  3049 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:56.951601  6462 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:56.952750  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:56.953341  3791 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:15:56.954768  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:56.955256  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:56.955621  6678 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:56.956383  6678 raft_consensus.cc:697] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:56.957266  6678 consensus_queue.cc:237] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:56.958303  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:56.960005  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:56.960908  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:56.916749  6295 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:56.973616  3198 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:56.974192  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:56.977003  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.963186  6654 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9.
I20260709 13:15:56.963923  6423 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:56.964047  6240 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:56.892580  6645 raft_consensus.cc:3055] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:56.964314  3091 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:56.964860  3191 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:56.965655  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:56.986922  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:56.966583  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:56.987552  3044 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:15:56.983280  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:56.988178  3047 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:56.899852  6121 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:56.998965  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:56.999392  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:57.008594  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:57.012100  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:57.012804  3199 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:56.935868  6612 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.008313  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:57.015900  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:56.915122  6389 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:57.020028  3050 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:57.017560  3051 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:57.005631  3121 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:15:56.935695  6608 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:56.970816  6684 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:57.029217  3049 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:15:57.034884  3047 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:15:56.933153  6631 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 13:15:56.998996  6645 raft_consensus.cc:740] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:15:57.037843  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 98920.7us
I20260709 13:15:57.041792  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:57.007853  6381 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:56.925665  6489 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:57.060855  6487 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:57.063045  6649 raft_consensus.cc:3055] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:57.063679  6649 raft_consensus.cc:740] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:15:57.066435  6685 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:15:57.040529  6389 consensus_queue.cc:1059] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.030s
W20260709 13:15:57.063167  2997 auto_rebalancer.cc:893] Removing replace marker failed: Replica aaf88538197a49adb8bcf3790309a67e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:15:57.068809  2997 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:15:57.072985  3199 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
W20260709 13:15:57.069132  2997 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:15:57.018953  6121 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:57.016024  6423 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:57.009557  6240 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:57.099494  6489 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:57.106455  6487 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.122006  6487 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:57.124107  6240 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:57.124539  6487 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:57.035852  6612 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:57.135890  6612 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:57.136632  6612 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:57.140031  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.140599  6121 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:57.143615  6423 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:57.041806  6684 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:57.039471  6608 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:57.072166  6381 raft_consensus.cc:697] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:57.064821  6649 consensus_queue.cc:260] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:57.153175  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 151244us
I20260709 13:15:57.161139  3091 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:57.187767  3091 leader_election.cc:400] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7.
I20260709 13:15:57.188215  3091 leader_election.cc:403] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:57.191653  6517 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7.
I20260709 13:15:57.137266  6612 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:57.200430  6240 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:57.154631  6496 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.214985  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.152413  6682 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:57.158874  6645 consensus_queue.cc:260] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:57.220625  6649 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:57.215107  6537 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.220376  6240 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:57.219998  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 174182us
I20260709 13:15:57.236367  6240 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:57.223067  6496 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:57.238925  6645 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:57.254273  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 232324us
I20260709 13:15:57.228103  6609 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:57.236604  6537 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:57.263646  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:57.240885  6686 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:15:57.264662  3165 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:57.264878  6608 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:57.228652  6381 consensus_queue.cc:237] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:57.269665  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:57.270828  3796 raft_consensus.cc:2368] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11.
I20260709 13:15:57.277197  3165 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:57.274101  6682 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:57.280370  3121 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:57.282392  6682 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:57.283613  6682 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:57.272248  6689 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:57.285801  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:57.292461  3126 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 7: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:57.286320  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.286724  3164 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:57.287207  3120 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:57.290475  3125 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:15:57.286787  6608 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:57.311643  6537 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:57.297382  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.320245  3121 raft_consensus.cc:2393] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:57.300786  6498 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:57.302030  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.322005  3122 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:15:57.308907  6121 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:57.309463  6691 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:57.292089  6612 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:57.339749  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 62585.7us
I20260709 13:15:57.347899  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:57.350015  3198 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:57.350926  6691 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:57.352758  6691 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:57.325824  6662 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:57.365136  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.327776  6121 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:57.327664  6631 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.384965  3193 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:57.387871  6389 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.388640  6389 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:57.373304  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:57.373682  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:57.374022  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:57.378098  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:57.394467  3195 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:57.372712  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:57.395707  3194 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:57.381692  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:57.397228  3051 raft_consensus.cc:2410] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:15:57.406622  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:57.402920  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:57.409929  3198 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:57.410395  3042 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:57.413827  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:57.417910  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:57.418540  3194 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:15:57.418579  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:57.421922  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:57.422891  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:57.423740  3193 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:57.425288  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:57.425581  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:57.426097  3194 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:57.426252  3197 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:57.407514  3200 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:57.427454  3198 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:57.438498  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:57.439831  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:57.445097  3191 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: [7.4-10.5]
W20260709 13:15:57.445504  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 158827us
I20260709 13:15:57.446926  6689 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:57.448514  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:57.449610  3191 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:57.452121  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:57.386447  6121 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:57.452939  3200 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:57.449898  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:57.455030  3091 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:57.466135  3164 leader_election.cc:400] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11.
I20260709 13:15:57.466702  3164 leader_election.cc:403] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:15:57.468127  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:57.469636  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:57.471022  3164 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:57.472497  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:57.409111  6631 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:57.476063  6691 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:57.424948  6612 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.476451  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:57.478024  6240 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:57.481171  6698 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:57.481478  3050 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:57.481900  6689 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:57.478073  6697 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:57.476125  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:57.483515  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.486594  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:57.488724  3193 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:15:57.503779  3121 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:15:57.490341  3197 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:15:57.494305  3046 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:15:57.494901  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.482390  6690 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:57.508414  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:57.509114  3200 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 5.
I20260709 13:15:57.515755  3123 raft_consensus.cc:2368] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12.
I20260709 13:15:57.515952  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:57.524294  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.495633  6609 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:57.544703  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.559638  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:57.545492  6589 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:57.561403  6589 raft_consensus.cc:697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:57.562731  6589 consensus_queue.cc:237] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:57.566035  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.568130  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:57.511304  6698 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:57.569218  3195 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:15:57.505263  6696 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11.
I20260709 13:15:57.576741  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:57.497040  6612 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:57.589589  3200 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:57.592844  6612 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:57.573939  6690 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:57.596145  6496 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:57.596733  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.640960  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:57.640848  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:57.642975  3192 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:15:57.644061  3090 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:57.644575  3193 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:15:57.645476  6123 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:57.645891  3090 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:57.646677  6123 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:57.647639  6687 raft_consensus.cc:3055] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:57.648113  6687 raft_consensus.cc:740] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:57.653550  6624 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:57.647780  6123 consensus_queue.cc:1059] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:15:57.604465  3044 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:57.647938  3090 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:15:57.601118  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.620033  3119 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:57.633630  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:57.658180  3117 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 8: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:57.606503  3796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 489) took 1032 ms. Trace:
I20260709 13:15:57.658813  3796 rpcz_store.cc:276] 0709 13:15:56.573613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.573858 (+   245us) service_pool.cc:224] Handling call
0709 13:15:57.606276 (+1032418us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b5400627fd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:15:57.606442 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1166928128}
I20260709 13:15:57.662223  3200 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:57.662694  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:57.663532  3191 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:57.667428  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:57.669559  6634 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:57.680572  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:57.681246  3051 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:15:57.597679  6488 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:57.623499  6683 log.cc:927] Time spent T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.439s	user 0.000s	sys 0.002s
I20260709 13:15:57.683789  3117 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:57.654388  6123 consensus_queue.cc:1243] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:57.636090  6658 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:57.627010  6631 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:57.621070  6690 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:57.689445  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.690495  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.691725  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:57.697852  3125 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:57.681764  3090 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:57.702065  3123 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:57.698431  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.702867  3090 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:57.687623  6634 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.685614  6688 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:15:57.721016  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 266080us
I20260709 13:15:57.683171  6513 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:15:57.714983  6631 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:57.720897  6634 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:57.731349  6682 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:57.732446  6631 raft_consensus.cc:697] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:57.733419  6631 consensus_queue.cc:237] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:57.733938  3198 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:57.717716  6293 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:15:57.740653  6517 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:15:57.747646  6517 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:57.737507  6121 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:57.690173  6497 consensus_queue.cc:1059] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:15:57.741304  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:57.758616  3125 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
W20260709 13:15:57.759178  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.763901  3051 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:15:57.778795  3762 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:57.721167  6123 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:57.798456  6497 raft_consensus.cc:3055] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:57.724162  6389 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:57.809618  3197 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:57.798024  6590 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:15:57.814582  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 92067.6us
W20260709 13:15:57.818747  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 312982us
I20260709 13:15:57.822252  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:57.823606  3164 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:57.764778  6538 raft_consensus.cc:3055] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:57.765585  6634 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:57.818218  6684 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:57.832880  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:57.835625  3164 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:57.842186  3091 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:57.855425  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:57.842770  6593 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:57.843676  6687 consensus_queue.cc:260] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:57.790063  6682 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:57.799930  6700 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:57.790136  6240 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:57.858917  3194 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:15:57.816332  6462 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:57.864185  3791 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEARNER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:57.810379  6497 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:57.861461  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:57.862228  3051 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:57.869186  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:57.866552  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.866698  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.871225  3123 raft_consensus.cc:2410] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:15:57.871109  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:57.871764  3794 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:15:57.874758  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:57.874940  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:57.875653  3050 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:57.875964  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:57.876888  3123 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:57.875483  3796 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:15:57.849205  6389 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:57.886801  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.889003  3126 raft_consensus.cc:1240] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:57.890172  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.890794  3121 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:15:57.891938  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:57.880965  3044 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:15:57.846850  6538 raft_consensus.cc:740] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:57.883209  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:57.849459  6123 raft_consensus.cc:697] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:57.894680  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:57.863592  6705 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:57.898834  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.897909  3045 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:57.874873  6645 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:57.863485  6658 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:57.902252  3048 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:15:57.888113  3164 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:57.884104  6498 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:57.863122  6700 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.913937  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.924786  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.915987  3120 raft_consensus.cc:1275] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:57.924984  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.893318  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.925819  3118 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
I20260709 13:15:57.880761  6682 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.214661  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:57.921170  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.926293  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:57.863391  6488 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:15:57.930029  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:57.934384  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 256351us
I20260709 13:15:57.937077  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:57.939015  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:57.939580  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:57.939074  3046 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:57.945215  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:57.946775  3164 leader_election.cc:400] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12.
I20260709 13:15:57.947147  3164 leader_election.cc:403] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:57.949168  3164 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:57.928923  6690 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:57.918064  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:57.920275  3762 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:57.886030  6462 raft_consensus.cc:697] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:15:57.926146  3126 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
W20260709 13:15:57.931123  6661 raft_consensus.cc:670] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:15:57.863794  6684 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:57.926829  3123 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:57.952107  3117 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:15:57.929078  6700 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:57.953501  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:57.962411  3198 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 9: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:57.955542  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:57.919124  6658 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:57.957067  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:57.983352  3193 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:15:57.923308  6687 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:57.954447  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:57.985366  3191 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 5.
W20260709 13:15:57.958472  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 61457.9us
I20260709 13:15:57.954195  3090 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:57.967262  3164 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:57.999900  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:57.951129  6696 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:57.938105  6497 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:57.960522  6684 raft_consensus.cc:697] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:15:58.014751  6497 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:57.956207  6686 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:58.015187  6684 consensus_queue.cc:237] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:57.952991  6712 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:57.932469  6682 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:57.956084  6689 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:15:58.002767  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:57.995296  6123 consensus_queue.cc:237] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:57.956343  6537 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:58.041013  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 495269us
I20260709 13:15:58.021368  6712 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:15:57.953198  6691 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:15:57.952414  6708 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:57.977488  6658 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:58.045054  3050 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:15:58.013022  6121 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:58.062486  3761 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:58.075323  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:15:58.056329  3199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.022s	sys 0.050s
W20260709 13:15:58.080219  3199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.023s	sys 0.051s
W20260709 13:15:58.094259  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.101390  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:15:58.102650  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.977913  6533 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:15:58.043732  6537 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:58.110545  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 116671us
I20260709 13:15:58.021387  6678 raft_consensus.cc:3055] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:15:58.117122  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 163045us
I20260709 13:15:58.048026  6712 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:58.125303  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.095695  6389 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:58.131925  3200 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:58.105357  6496 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:58.119302  6537 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:58.003695  6538 consensus_queue.cc:260] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:58.119655  6678 raft_consensus.cc:740] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:58.072975  6513 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:15:58.002741  6462 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:58.153431  3091 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:58.128070  6590 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:58.129276  6488 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.160056  3091 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:58.166276  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:58.167029  3200 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:15:58.167447  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:58.149873  6293 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:58.163506  6517 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:58.148197  6496 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:15:58.181403  6697 consensus_meta.cc:287] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.664s	user 0.008s	sys 0.004s
I20260709 13:15:58.181231  6496 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:58.170099  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:58.186005  6710 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.175833  6293 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.158371  6634 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:58.159683  6649 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:58.161147  6498 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:58.193856  3197 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:58.170979  6488 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:58.212991  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:58.157650  6589 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:15:58.158447  6602 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:15:58.160739  6240 consensus_queue.cc:1059] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:15:58.178741  6517 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.181612  6533 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.194681  6295 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:58.192772  6645 raft_consensus.cc:697] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:58.210318  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:15:58.231942  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 264772us
I20260709 13:15:58.232811  3200 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 8: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:15:58.218993  6697 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:58.224166  6293 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:58.245965  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:58.255668  3197 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:15:58.227854  6649 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.259622  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:58.267457  3195 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:15:58.270321  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:58.239634  6517 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:58.281695  3164 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:15:58.224665  6710 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:58.252779  6625 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.285493  3164 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:15:58.229241  6634 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:58.290793  3200 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:15:58.265946  6649 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:58.263269  6295 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:58.239288  6658 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:58.224258  6678 consensus_queue.cc:260] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:58.239655  6498 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:58.307477  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:58.284586  6682 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:58.252345  6533 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:58.288148  6724 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:58.283380  6698 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:58.315091  3050 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
W20260709 13:15:58.309365  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 99153.4us
I20260709 13:15:58.287153  6389 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:58.316731  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 158080us
I20260709 13:15:58.276324  6689 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:15:58.320220  6645 consensus_queue.cc:237] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:58.338295  3045 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:58.340118  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 238818us
I20260709 13:15:58.305246  6612 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:58.331204  3164 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:58.334488  3048 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:58.343010  3194 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:58.321560  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:58.317435  6624 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:58.284369  6719 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:15:58.346143  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:58.328722  6698 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.373391  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:58.317443  6590 raft_consensus.cc:697] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:58.346825  6612 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.293308  6625 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:58.320849  6678 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:58.351915  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:58.358175  6724 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:58.358688  6624 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:15:58.408896  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 57057.7us
I20260709 13:15:58.372452  6698 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:58.345100  6700 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:58.378604  6389 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:58.384436  6697 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:58.388127  6716 log.cc:927] Time spent T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
W20260709 13:15:58.390906  6593 consensus_meta.cc:287] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.527s	user 0.013s	sys 0.000s
I20260709 13:15:58.388810  6612 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:58.394243  6725 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:58.413908  6624 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:58.402058  6733 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:58.439774  6593 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:58.417773  6734 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:58.420814  6513 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.451967  3199 raft_consensus.cc:1275] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:58.434595  6697 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:15:58.386314  6295 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:58.460083  6697 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:58.419920  6720 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:15:58.445614  6488 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:58.491369  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.486090  6634 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:58.492511  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:58.461040  6723 log.cc:927] Time spent T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:15:58.445863  6719 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:15:58.454461  6658 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:58.509367  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 152776us
W20260709 13:15:58.517522  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 106742us
I20260709 13:15:58.518978  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:58.503051  6688 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:58.449993  6733 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:58.455096  6513 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:58.528177  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:58.527509  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:58.550139  3123 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:58.498613  6746 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:15:58.550803  3117 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:58.551666  3047 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:58.517596  6710 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:58.453423  6734 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:58.458918  6590 consensus_queue.cc:237] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:58.550518  6488 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:58.607029  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:58.607681  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:15:58.554373  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 209956us
I20260709 13:15:58.555104  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:58.532217  6498 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:58.543970  6533 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:58.554824  6738 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:15:58.600179  6722 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:15:58.599436  6744 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:15:58.585690  6684 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:58.617305  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:15:58.614802  6749 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:15:58.620082  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:58.608811  6488 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.541121  6688 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:58.622416  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:58.667194  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 44844.5us
I20260709 13:15:58.668658  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:58.670389  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:58.537489  6754 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:58.637398  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 86347.1us
W20260709 13:15:58.609057  6497 consensus_meta.cc:287] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.004s
W20260709 13:15:58.614424  6743 log.cc:927] Time spent T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:15:58.643857  3192 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:15:58.618768  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:58.637079  6700 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:15:58.647039  6687 consensus_meta.cc:287] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.641s	user 0.013s	sys 0.000s
W20260709 13:15:58.647930  6739 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:15:58.603693  6625 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:58.620422  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:58.676223  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:58.621125  6720 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:58.658039  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.662218  3121 raft_consensus.cc:1275] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:58.638969  6738 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.660998  6488 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:58.684988  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:15:58.685839  6753 log.cc:927] Time spent T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:15:58.685933  6724 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:58.687021  6724 consensus_queue.cc:1059] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:58.688153  6724 raft_consensus.cc:3055] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:15:58.688295  6748 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:15:58.688589  6724 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:58.689097  6538 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:58.690011  6742 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:15:58.675053  6757 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:58.690793  6757 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:58.691250  6757 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:58.692179  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:58.695631  6698 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:58.697805  6738 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:58.698231  6720 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:58.682411  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:58.700959  3192 raft_consensus.cc:2393] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 9: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:15:58.697397  6624 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:58.705037  6624 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:58.670123  6746 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:15:58.707062  6588 raft_consensus.cc:3055] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:58.707654  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:15:58.708530  6625 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:58.708776  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:58.709338  6625 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:58.709815  6625 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.674621  6763 consensus_queue.cc:1059] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:15:58.710278  6625 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:58.710676  6763 raft_consensus.cc:3055] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:58.711071  6763 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:58.711898  6763 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:58.713124  6763 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:58.677682  6498 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:58.713405  6496 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:58.714862  3791 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:58.650970  6733 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:58.689613  6724 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:58.716667  6496 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:58.717281  6724 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:58.672384  6754 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.717936  6754 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:58.719425  6662 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:58.722750  3200 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:58.723011  3165 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:58.726432  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:59.109473  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:59.110385  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:59.110608  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 396010us
I20260709 13:15:59.109084  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:58.997342  3798 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:15:58.783361  3118 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:15:58.801751  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 185311us
I20260709 13:15:58.728385  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:58.681988  6645 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:58.783427  6295 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.729967  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:15:58.680523  6725 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.438s
I20260709 13:15:58.707649  6588 raft_consensus.cc:740] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:15:59.242403  6293 consensus_meta.cc:287] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.966s	user 0.013s	sys 0.000s
I20260709 13:15:58.697676  6612 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:59.242955  6293 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:59.243044  6588 consensus_queue.cc:260] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:58.883186  6537 consensus_meta.cc:287] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.003s
I20260709 13:15:59.244736  6612 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:59.245225  6293 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:58.783447  6730 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:59.246104  6730 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:59.248350  6730 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:58.812065  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:15:59.178057  6682 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:59.250087  6682 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:59.252224  6682 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:59.148016  6690 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:15:59.249464  6295 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:59.256414  6625 consensus_meta.cc:287] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.546s	user 0.004s	sys 0.004s
I20260709 13:15:59.256520  6295 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:59.221648  6121 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:59.258232  6121 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:59.260212  6121 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:59.260861  6766 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.758155  6729 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:15:59.037336  6751 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:15:59.122684  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1754) took 1173 ms. Trace:
I20260709 13:15:59.265264  3194 rpcz_store.cc:276] 0709 13:15:57.949366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.949542 (+   176us) service_pool.cc:224] Handling call
0709 13:15:57.950108 (+   566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.344850 (+394742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.122457 (+777607us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b540033e5d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:15:59.122617 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":903117568}
I20260709 13:15:59.123030  3120 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:15:59.115932  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:59.128566  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:59.141090  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 363938us
I20260709 13:15:59.146126  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:58.702793  6720 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:15:59.176721  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 53279.5us
W20260709 13:15:59.249418  6757 consensus_meta.cc:287] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.000s
W20260709 13:15:59.182181  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.175326  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:59.098829  6734 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:59.222040  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:15:59.089689  6691 consensus_meta.cc:287] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.034s	user 0.005s	sys 0.006s
W20260709 13:15:59.040649  6712 consensus_meta.cc:287] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.898s	user 0.010s	sys 0.000s
W20260709 13:15:59.047108  6649 consensus_meta.cc:287] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.739s	user 0.010s	sys 0.001s
I20260709 13:15:59.244436  6537 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:58.690641  6513 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:59.262337  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 103190us
I20260709 13:15:59.286625  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:15:59.286928  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:59.287600  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.288300  6730 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:59.288475  6631 consensus_queue.cc:1059] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:59.289250  6746 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:59.289765  6746 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:59.290704  6590 raft_consensus.cc:3055] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:59.291183  6590 raft_consensus.cc:740] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:15:59.291998  6746 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:58.758397  6546 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.292841  3791 raft_consensus.cc:2368] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9.
I20260709 13:15:59.292698  6546 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:59.036342  6756 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:15:59.294086  6537 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:15:59.115284  3761 connection.cc:256] RPC call timeout handler was delayed by -1.2694372270000258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260709 13:15:59.295392  3761 connection.cc:256] RPC call timeout handler was delayed by -1.0236878969999452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
I20260709 13:15:59.295176  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2109) took 1022 ms. Trace:
I20260709 13:15:59.296351  3193 rpcz_store.cc:276] 0709 13:15:58.272465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.277657 (+  5192us) service_pool.cc:224] Handling call
0709 13:15:58.278104 (+   447us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:58.281540 (+  3436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:58.281568 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:58.293649 (+ 12081us) log.cc:844] Serialized 52 byte log entry
0709 13:15:58.556880 (+263231us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:58.556921 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.556988 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.294898 (+737910us) raft_consensus.cc:1685] finished
0709 13:15:59.294923 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.295100 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5007,"raft.queue_time_us":3529,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":6763,"thread_start_us":213244,"threads_started":1,"wal-append.queue_time_us":370579}
W20260709 13:15:58.980192  6752 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
I20260709 13:15:59.297528  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:59.298278  3792 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:15:59.299103  6293 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.299758  3795 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:59.299644  6293 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:59.300969  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1908) took 1413 ms. Trace:
I20260709 13:15:59.263140  3790 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:59.014739  6721 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.687s	user 0.003s	sys 0.001s
I20260709 13:15:58.973093  6688 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:58.933339  6589 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:58.942018  6698 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:59.121423  6687 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:59.272744  6682 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:15:59.267745  6697 consensus_meta.cc:287] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.780s	user 0.011s	sys 0.001s
I20260709 13:15:59.277132  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:59.261387  6766 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:59.257234  6625 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:59.276789  6121 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:59.275177  6662 consensus_queue.cc:1059] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:15:59.335464  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2284) took 1478 ms. Trace:
I20260709 13:15:59.336087  3043 rpcz_store.cc:276] 0709 13:15:57.857531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.859040 (+  1509us) service_pool.cc:224] Handling call
0709 13:15:57.859466 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:57.859817 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:57.859855 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:57.866078 (+  6223us) log.cc:844] Serialized 26 byte log entry
0709 13:15:58.175200 (+309122us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:58.175278 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.175383 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:58.723589 (+548206us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:15:59.325559 (+601970us) raft_consensus.cc:1685] finished
0709 13:15:59.325582 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.335373 (+  9791us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29082880,"thread_start_us":268682,"threads_started":1,"wal-append.queue_time_us":404844}
I20260709 13:15:59.320874  6687 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:59.340258  6121 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:59.301671  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:15:59.270407  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:59.306731  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:59.348541  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:15:59.353555  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 46918.2us
I20260709 13:15:59.301391  3122 rpcz_store.cc:276] 0709 13:15:57.887920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.888046 (+   126us) service_pool.cc:224] Handling call
0709 13:15:57.906912 (+ 18866us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:57.965466 (+ 58554us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:58.236795 (+271329us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b1800030820. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c3455 00007ff833dab3c7 00007ff8303bd9a7 00007ff8303cd0bf 00007ff8303cd038
0709 13:15:58.369067 (+132272us) log.cc:844] Serialized 14 byte log entry
0709 13:15:58.539502 (+170435us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:58.540148 (+   646us) log.cc:844] Serialized 26 byte log entry
0709 13:15:58.540335 (+   187us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:58.540385 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.540482 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.300688 (+760206us) raft_consensus.cc:1685] finished
0709 13:15:59.300785 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.300911 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":152932,"prepare.queue_time_us":442573,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":3681,"raft.queue_time_us":46600,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":48606,"spinlock_wait_cycles":4066560,"thread_start_us":254165,"threads_started":2,"wal-append.queue_time_us":207760}
I20260709 13:15:59.272833  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:59.355937  3120 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:15:59.279558  6691 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12.
I20260709 13:15:59.277437  6757 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:59.277905  6720 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:59.302690  6649 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:59.289595  6724 consensus_meta.cc:287] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.572s	user 0.005s	sys 0.002s
I20260709 13:15:59.320182  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:15:59.272269  6624 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:15:59.281445  6712 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:15:59.386174  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 98184.6us
I20260709 13:15:59.343425  6662 raft_consensus.cc:3055] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:59.349467  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:59.404314  3048 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:59.349794  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:59.290697  6763 consensus_meta.cc:287] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.577s	user 0.012s	sys 0.000s
I20260709 13:15:59.349395  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:59.406863  3121 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:15:59.407238  3047 raft_consensus.cc:2410] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:15:59.364261  3051 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: []
W20260709 13:15:59.364866  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 242786us
W20260709 13:15:59.383039  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 260522us
I20260709 13:15:59.339478  6293 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:15:59.345407  6687 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:59.408517  3164 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:59.365222  6725 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.349037  6121 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:59.411365  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:15:59.291998  6590 consensus_queue.cc:260] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:59.437724  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:59.438642  3125 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:15:59.439783  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:15:59.313344  6589 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:59.365060  6645 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:59.324548  6682 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:59.369809  6513 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:59.429648  3120 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:59.414013  3046 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:59.430248  3794 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:59.432996  3048 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:15:59.513827  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:59.515770  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:59.540799  3050 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
W20260709 13:15:59.526909  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 118105us
I20260709 13:15:59.542258  3165 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:59.546021  3197 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:15:59.547639  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:15:59.547320  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 144591us
I20260709 13:15:59.570497  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:59.404066  6662 raft_consensus.cc:740] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:15:59.410138  6724 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:59.580191  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 309826us
I20260709 13:15:59.573817  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:59.581027  3125 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:15:59.581482  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:15:59.387476  6609 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.167s
W20260709 13:15:59.532899  6517 consensus_meta.cc:287] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.240s	user 0.010s	sys 0.003s
I20260709 13:15:59.427196  6709 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:59.580339  3048 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:15:59.574970  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:59.589126  3044 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:59.589627  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 154675us
W20260709 13:15:59.567282  6780 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:15:59.592515  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:15:59.536636  6687 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.386125  6720 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:15:59.603806  6720 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:59.604526  6720 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:59.605201  6720 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:59.608253  3762 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:15:59.567857  6763 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:15:59.576403  6546 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:15:59.527380  6698 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
W20260709 13:15:59.631315  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 241999us
W20260709 13:15:59.643719  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 94418.9us
I20260709 13:15:59.589293  6691 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.597626  6687 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:59.618710  6488 consensus_meta.cc:287] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.909s	user 0.010s	sys 0.002s
I20260709 13:15:59.605870  6783 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:59.607165  6661 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:59.656417  6662 consensus_queue.cc:260] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:59.581020  6645 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:59.587693  6724 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:59.595041  6517 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:59.325420  6697 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:59.435367  6725 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:15:59.644219  6763 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:59.845574  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 234128us
W20260709 13:15:59.742177  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 93568.2us
W20260709 13:15:59.982617  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:59.945822  3017 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.005s	sys 0.005s
W20260709 13:16:00.001466  3017 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.008s	sys 0.005s
I20260709 13:15:59.995625  3047 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:15:59.784430  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1841) took 1196 ms. Trace:
I20260709 13:16:00.004738  3123 rpcz_store.cc:276] 0709 13:15:58.587881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.602199 (+ 14318us) service_pool.cc:224] Handling call
0709 13:15:58.602583 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:58.882116 (+279533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:58.882164 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:59.114073 (+231909us) log.cc:844] Serialized 26 byte log entry
0709 13:15:59.342493 (+228420us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:59.429424 (+ 86931us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.431066 (+  1642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.431172 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.784059 (+352887us) raft_consensus.cc:1685] finished
0709 13:15:59.784099 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.784333 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9506,"prepare.queue_time_us":273884,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":3172,"raft.queue_time_us":43245,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":92658,"thread_start_us":423061,"threads_started":3,"wal-append.queue_time_us":77529}
I20260709 13:15:59.998584  3091 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:15:59.896517  6771 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 13:16:00.013938  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:59.656710  6293 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:59.988312  6719 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:15:59.680238  6488 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:15:59.834301  6754 consensus_meta.cc:287] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.116s	user 0.012s	sys 0.001s
W20260709 13:15:59.894533  6788 log.cc:927] Time spent T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:16:00.039774  3196 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:00.018510  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:15:59.873428  6625 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:00.055128  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:00.058452  3798 consensus_meta.cc:287] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.695s	user 0.010s	sys 0.000s
I20260709 13:16:00.059201  3050 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:15:59.656231  6787 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:00.060009  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 371126us
I20260709 13:16:00.004908  6649 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:00.071646  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1775) took 1301 ms. Trace:
I20260709 13:16:00.072168  3193 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:16:00.081431  6293 raft_consensus.cc:697] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:00.019017  6757 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:15:59.649853  6691 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:00.166455  6689 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:00.166836  6488 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:00.167100  6689 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:00.168171  6738 consensus_meta.cc:287] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.470s	user 0.007s	sys 0.006s
I20260709 13:16:00.017995  6766 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:00.168632  6738 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:00.169267  6715 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:00.169970  6715 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:00.170542  6715 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:00.171032  6684 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:00.171584  6684 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:00.053871  6780 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:16:00.014578  6624 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:00.086825  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:00.020738  6798 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:00.015697  6801 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:00.097260  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:15:59.895707  6774 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.243s
I20260709 13:16:00.106691  3200 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:00.115299  3199 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:00.018256  6719 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:00.182461  3048 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:00.183152  6801 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:00.038692  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:00.116616  3798 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:16:00.121588  3044 raft_consensus.cc:2393] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:00.184634  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 146010us
I20260709 13:16:00.132323  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:00.184906  6786 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:16:00.185412  3193 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:16:00.171720  6738 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:00.186447  6687 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:00.186535  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:00.187544  3791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 475) took 1218 ms. Trace:
I20260709 13:16:00.187963  3791 rpcz_store.cc:276] 0709 13:15:58.969189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.969362 (+   173us) service_pool.cc:224] Handling call
0709 13:16:00.187320 (+1217958us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b5400622854. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:00.187479 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57992064}
I20260709 13:16:00.188386  6687 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.056435  6705 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:16:00.130986  3198 rpcz_store.cc:276] 0709 13:15:58.770398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.770576 (+   178us) service_pool.cc:224] Handling call
0709 13:15:58.771029 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:59.120408 (+349379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.120456 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:59.121011 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:15:59.335007 (+213996us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:59.335053 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.335128 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:00.071430 (+736302us) raft_consensus.cc:1685] finished
0709 13:16:00.071450 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.071584 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":347807,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":213334,"threads_started":1,"wal-append.queue_time_us":447452}
I20260709 13:16:00.191735  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:00.192867  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:00.195020  6697 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:00.195107  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2100) took 2561 ms. Trace:
I20260709 13:16:00.195744  6697 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:00.195653  3195 rpcz_store.cc:276] 0709 13:15:57.633718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.633890 (+   172us) service_pool.cc:224] Handling call
0709 13:15:57.634263 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.268068 (+633805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.194877 (+1926809us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b540013ced4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:00.195045 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1454974208}
I20260709 13:16:00.196460  6697 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:00.081563  6730 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:15:59.696204  6783 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:00.210206  6783 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:00.177672  6725 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:00.211570  6517 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:00.120903  6787 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.212468  6787 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:00.212792  6805 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.213519  6805 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:00.216646  6805 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:00.218006  6691 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:00.218501  6798 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:00.218989  3119 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:00.161257  6678 consensus_meta.cc:287] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.767s	user 0.014s	sys 0.000s
I20260709 13:16:00.162000  6808 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:00.162552  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2299) took 1055 ms. Trace:
I20260709 13:16:00.230713  3051 rpcz_store.cc:276] 0709 13:15:59.107115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.107308 (+   193us) service_pool.cc:224] Handling call
0709 13:15:59.107743 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.407794 (+300051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.162199 (+754405us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54001d83d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:00.162466 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589367040}
I20260709 13:16:00.167521  6488 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:00.084685  3194 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: [7.4-10.5]
I20260709 13:16:00.189148  6687 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:00.234858  3761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.002s	sys 0.015s
I20260709 13:16:00.039440  6698 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.182339  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:00.238004  3191 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:00.183745  6801 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:00.070592  6682 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:00.053318  6712 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:00.149660  3120 consensus_meta.cc:287] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.000s
I20260709 13:16:00.199702  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:00.261499  3120 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:00.261876  3045 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:16:00.200313  3198 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:00.198324  3790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 478) took 1194 ms. Trace:
I20260709 13:16:00.186524  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:00.263073  3790 rpcz_store.cc:276] 0709 13:15:59.003756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.005856 (+  2100us) service_pool.cc:224] Handling call
0709 13:15:59.006294 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.303028 (+296734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.198038 (+895010us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54005a5354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:00.198261 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590191360}
I20260709 13:16:00.206709  6719 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:00.057286  6754 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:00.207077  6763 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:00.197544  3195 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:00.177030  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1769) took 1624 ms. Trace:
I20260709 13:16:00.280222  3196 rpcz_store.cc:276] 0709 13:15:58.552527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.552728 (+   201us) service_pool.cc:224] Handling call
0709 13:15:58.553119 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:00.040273 (+1487154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.176729 (+136456us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54001df454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:00.176953 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3418397056}
I20260709 13:16:00.169463  6766 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:00.235234  3761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.002s	sys 0.015s
I20260709 13:16:00.258419  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:00.178637  6121 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.229072  6645 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:00.228790  6757 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:00.232534  6488 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:00.285753  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 99279.1us
I20260709 13:16:00.287935  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:00.295621  3195 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:00.289474  6803 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
W20260709 13:16:00.291086  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 222060us
I20260709 13:16:00.289122  6795 consensus_queue.cc:1059] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:16:00.302335  6797 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:00.305552  3121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 1846) took 1579 ms (client timeout 1822 ms). Trace:
I20260709 13:16:00.230288  6624 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:00.323221  3121 rpcz_store.cc:269] 0709 13:15:58.725965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.726130 (+   165us) service_pool.cc:224] Handling call
0709 13:16:00.305278 (+1579148us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b5400301bd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:00.305456 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1562817280}
I20260709 13:16:00.310227  6687 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:00.356755  3191 raft_consensus.cc:2410] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:16:00.360773  6797 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:00.383422  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.382884  3199 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:16:00.260820  6698 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:00.234925  6808 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:00.311125  6121 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:00.348771  6293 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:00.349372  6783 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:00.590306  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:00.665719  3191 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:00.537204  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:00.590992  3049 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.010s	sys 0.025s
W20260709 13:16:00.668499  3049 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.017s	sys 0.028s
I20260709 13:16:00.669824  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:00.360503  6712 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:00.661698  3165 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:00.536741  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:00.655557  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:00.652762  3090 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:00.656455  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:00.632087  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:00.656800  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:00.673811  6816 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:00.677481  6816 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:00.678158  6808 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:00.679885  6816 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:00.680655  3191 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:16:00.673837  3048 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:00.681969  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:00.500901  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 188827us
I20260709 13:16:00.659368  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:00.660100  3014 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.022s	sys 0.033s
I20260709 13:16:00.664438  3195 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:16:00.657629  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:00.681689  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:00.536478  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:00.375011  6689 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:00.382629  6719 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.382941  6757 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.680698  3193 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:16:00.676698  3090 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:00.685343  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:00.689371  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:00.695812  3195 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:00.532243  6691 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.581435  6688 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.654254  6697 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:00.530716  6754 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:00.529477  6798 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:00.692335  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:00.686070  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:00.576880  6763 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.675899  3791 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:00.712848  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:00.652330  6684 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:00.653439  6624 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:00.311299  6766 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:00.684935  3125 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:00.699172  3090 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:00.685462  3014 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.022s	sys 0.033s
I20260709 13:16:00.603240  6797 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:00.699116  3191 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:16:00.369407  6645 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.326s
I20260709 13:16:00.702500  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:00.691530  3126 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:16:00.703598  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:00.707311  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:00.683099  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:00.821580  3048 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:00.821962  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:00.822899  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:00.823702  3048 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:16:00.708536  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:00.680963  6625 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:00.653571  6815 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:16:00.676877  6746 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:00.687347  6801 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:00.717808  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:00.702402  6757 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:00.763679  6624 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:00.703029  6678 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:16:00.720948  6121 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:00.722232  3792 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:00.712848  6763 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:00.722785  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:00.723452  6715 consensus_meta.cc:287] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.552s	user 0.003s	sys 0.008s
I20260709 13:16:00.702301  6719 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:00.732785  6488 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:00.682229  6812 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:00.742466  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.010842  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.014241  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:00.700758  6700 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:00.684619  6712 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:00.745774  6766 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:00.746390  6818 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:00.748505  6698 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:00.748358  6794 consensus_queue.cc:1059] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:00.820076  3044 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:16:00.889056  6792 consensus_queue.cc:1059] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.211s
I20260709 13:16:01.044682  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:00.753758  6787 consensus_meta.cc:287] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.541s	user 0.005s	sys 0.005s
I20260709 13:16:00.715548  3195 raft_consensus.cc:2410] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:00.707528  6688 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:00.911528  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:01.029584  6712 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:00.665457  6783 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.982388  3051 raft_consensus.cc:2410] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 8 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:00.900267  6746 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.759378  3125 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
W20260709 13:16:01.017881  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 279369us
I20260709 13:16:01.022915  6812 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:01.023768  6817 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.024443  6719 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:01.024741  6754 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.026248  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:01.009546  6822 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 13:16:00.900038  6625 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:00.920346  6758 consensus_queue.cc:1059] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 13:16:00.704581  6691 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:01.052174  3198 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:00.919222  6813 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.118s
I20260709 13:16:01.055181  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:01.047858  3165 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:01.068176  6746 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:01.067617  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:01.010330  6715 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:01.139711  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:01.170365  3043 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:16:01.066779  6698 raft_consensus.cc:3055] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:00.982054  6624 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:01.068799  6783 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:01.168165  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:01.180212  3195 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:01.162421  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 114729us
I20260709 13:16:01.079113  6812 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:01.174460  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 431406us
I20260709 13:16:01.176772  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:01.055729  6787 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:01.136922  6754 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:01.181602  3165 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:01.191728  3165 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:16:01.188093  6825 log.cc:927] Time spent T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:16:01.188932  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 448073us
I20260709 13:16:01.170089  6712 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:01.200003  3200 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:01.203498  3165 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:01.174996  6813 consensus_queue.cc:1243] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:01.216943  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:01.217861  6706 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:01.220749  3195 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:01.222164  6706 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.175859  6698 raft_consensus.cc:740] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:01.199134  6121 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:01.137909  6817 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:01.231716  3200 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:01.199018  6712 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.243680  3198 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:01.223924  6697 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:01.265749  6697 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.266445  6697 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:01.238951  6684 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.243760  6121 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.273250  6609 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:01.273753  6121 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:01.273903  6609 raft_consensus.cc:697] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:01.274308  6715 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:01.274983  6609 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:01.276233  6754 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:01.277325  6688 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:01.225385  6792 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.225250  6776 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:01.227782  6813 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.222893  6706 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:01.285144  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.207422  6760 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:16:01.287053  3044 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:01.224804  6766 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:16:01.225100  6700 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:16:01.270831  6712 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:01.299834  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.272414  6801 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:01.304010  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:01.289121  6690 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.310349  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:01.308887  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 241392us
I20260709 13:16:01.286747  6757 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:01.287503  6776 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:01.301627  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 107565us
I20260709 13:16:01.291188  6787 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:01.320546  3044 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:01.323315  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 479) took 1103 ms. Trace:
I20260709 13:16:01.323928  3196 rpcz_store.cc:276] 0709 13:16:00.219540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.281569 (+ 62029us) service_pool.cc:224] Handling call
0709 13:16:00.282315 (+   746us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:00.282997 (+   682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:00.283038 (+    41us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:16:00.519270 (+236232us) log.cc:844] Serialized 616 byte log entry
0709 13:16:00.672305 (+153035us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:00.672344 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.672432 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:01.323005 (+650573us) raft_consensus.cc:1685] finished
0709 13:16:01.323034 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:01.323238 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11645,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":55578,"thread_start_us":62333,"threads_started":1,"wal-append.queue_time_us":453275}
I20260709 13:16:01.331899  3200 raft_consensus.cc:1240] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:01.273309  6684 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:01.301486  6763 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:01.303426  6830 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:01.293044  6792 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:01.328635  3196 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:01.348655  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:01.296113  6813 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:01.355105  3200 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:01.278298  6698 consensus_queue.cc:260] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:01.359166  3200 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:01.343581  6810 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:01.360203  3761 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:01.349877  6823 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:16:01.330276  6690 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:01.361876  6794 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:16:01.372044  6832 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:16:01.326496  6776 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:01.335348  6831 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:16:01.360662  6763 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:01.362764  6817 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:01.370985  6698 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:01.350114  6830 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:01.400770  6763 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:01.406366  6763 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:01.406989  6839 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.407675  6839 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:01.408845  6827 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:16:01.422592  6813 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:01.423844  6834 log.cc:927] Time spent T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:01.425549  6839 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:01.368976  6810 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:01.429716  6792 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:01.411435  6837 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:01.411603  6794 raft_consensus.cc:697] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:01.433969  6794 consensus_queue.cc:237] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:01.399531  6836 consensus_queue.cc:1059] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:16:01.414105  6845 raft_consensus.cc:3055] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:01.437765  6845 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:01.438197  6836 raft_consensus.cc:3055] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:01.438835  6836 raft_consensus.cc:740] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:01.440213  6836 consensus_queue.cc:260] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:01.438897  6845 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:01.502326  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.514364  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 283784us
I20260709 13:16:01.516113  3090 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:01.517274  3045 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:01.509382  3046 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:01.530530  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2308) took 2015 ms. Trace:
I20260709 13:16:01.531172  3047 rpcz_store.cc:276] 0709 13:15:59.514910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.515084 (+   174us) service_pool.cc:224] Handling call
0709 13:15:59.515408 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:00.003154 (+487746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:01.529924 (+1526770us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b54003c46d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:01.530313 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1103036672}
I20260709 13:16:01.535100  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1915) took 2927 ms. Trace:
W20260709 13:16:01.535262  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.535627  3124 rpcz_store.cc:276] 0709 13:15:58.606975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.607115 (+   140us) service_pool.cc:224] Handling call
0709 13:15:58.610243 (+  3128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.682967 (+ 72724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:58.683013 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:58.683070 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:58.683125 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:01.534300 (+2851175us) spinlock_profiling.cc:243] Waited 72.5 ms on lock 0x7b54003f1e54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:01.534402 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:01.534738 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166664960}
I20260709 13:16:01.546069  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:01.547199  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1837) took 3630 ms. Trace:
I20260709 13:16:01.547719  3119 rpcz_store.cc:276] 0709 13:15:57.916182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.928358 (+ 12176us) service_pool.cc:224] Handling call
0709 13:15:57.955040 (+ 26682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:00.219587 (+2264547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:01.546638 (+1327051us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b540045a1d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:01.546998 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5205915904}
I20260709 13:16:01.551672  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1925) took 1016 ms. Trace:
W20260709 13:16:01.553114  3050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2311) took 1983 ms (client timeout 1602 ms). Trace:
W20260709 13:16:01.553707  3050 rpcz_store.cc:269] 0709 13:15:59.569590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.570164 (+   574us) service_pool.cc:224] Handling call
0709 13:16:01.552678 (+1982514us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b54001d74d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:01.552882 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1079473024}
I20260709 13:16:01.574762  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:01.576210  3191 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:01.552477  3120 rpcz_store.cc:276] 0709 13:16:00.534515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.534626 (+   111us) service_pool.cc:224] Handling call
0709 13:16:00.662507 (+127881us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:01.203520 (+541013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:01.203576 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:01.214898 (+ 11322us) log.cc:844] Serialized 26 byte log entry
0709 13:16:01.517252 (+302354us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:01.517418 (+   166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:01.550575 (+ 33157us) spinlock_profiling.cc:243] Waited 87.6 ms on lock 0x7b54002c0bd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:01.550679 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:01.550801 (+   122us) raft_consensus.cc:1685] finished
0709 13:16:01.550821 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:01.551328 (+   507us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":361,"raft.queue_time_us":169590,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":201544576,"thread_start_us":730646,"threads_started":2,"wal-append.queue_time_us":171678}
W20260709 13:16:01.580603  3164 connection.cc:256] RPC call timeout handler was delayed by -1.1580702179999207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
I20260709 13:16:01.361812  3200 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:16:01.597585  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:01.599356  3200 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:01.383281  6624 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:01.612089  6763 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:01.349560  6462 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.265s
W20260709 13:16:01.616449  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 100738us
I20260709 13:16:01.621258  3046 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:16:01.419507  6778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.524s	user 0.008s	sys 0.019s
I20260709 13:16:01.612118  6624 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.617574  6488 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:01.367973  6625 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:01.673964  6688 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.675187  6688 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:01.677037  6801 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.678166  6488 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:01.679131  3197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2107) took 3420 ms (client timeout 1642 ms). Trace:
W20260709 13:16:01.679709  3197 rpcz_store.cc:269] 0709 13:15:58.259167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.259366 (+   199us) service_pool.cc:224] Handling call
0709 13:16:01.678716 (+3419350us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54000429d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:01.678934 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2576882048}
I20260709 13:16:01.679844  6121 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:01.682866  3194 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:01.684437  6684 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:01.684552  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:01.686755  6706 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:01.693917  6787 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.695029  6787 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:01.695608  3091 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:01.694039  6121 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:01.646279  6778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.750s	user 0.009s	sys 0.019s
I20260709 13:16:01.697357  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:01.688956  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:01.660115  6852 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.664175  6690 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:01.698257  6624 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:01.698570  6852 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:01.685326  6684 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:01.700193  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:01.700100  6684 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:01.700949  6852 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:01.700963  6624 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:01.702965  6684 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:01.705770  6766 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:01.710139  3091 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:01.665971  6792 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:01.730947  6792 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:01.736341  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:01.737200  3198 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:01.667629  6810 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:01.667730  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:01.668850  6836 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:01.669860  3090 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:01.678153  6801 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:01.721225  3164 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:01.724586  6766 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:01.681613  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:01.687126  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:01.803949  6121 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:01.804493  6121 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:01.804981  6121 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:01.805581  6846 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.806432  6846 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:01.809229  6846 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:01.810128  6746 consensus_meta.cc:287] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.636s	user 0.004s	sys 0.014s
I20260709 13:16:01.810822  6746 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:01.811247  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:01.812529  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:01.791183  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:01.813283  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 92264us
I20260709 13:16:01.802513  3196 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
W20260709 13:16:01.632462  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 76083.1us
W20260709 13:16:01.804761  6812 consensus_meta.cc:287] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.605s	user 0.013s	sys 0.004s
W20260709 13:16:02.051455  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.010322  6720 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.052475  6720 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:02.007244  6678 raft_consensus.cc:3055] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:02.054219  6678 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:02.054787  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:02.055745  6624 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:02.022027  3761 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 1.634s (SENT) [suppressed 12 similar messages]
I20260709 13:16:02.056000  6678 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:02.056588  6624 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:01.927042  6724 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:01.859130  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:01.910480  3123 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 8: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:01.851051  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.058375  3191 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:01.861325  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:01.822803  3200 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
W20260709 13:16:01.990693  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.062888  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:01.855813  3792 raft_consensus.cc:2376] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8. Re-sending same reply.
I20260709 13:16:01.858596  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.061851  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:02.064253  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 105573us
I20260709 13:16:02.091367  3043 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:01.729362  6688 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:02.057564  6678 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:02.002313  6723 log.cc:927] Time spent T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 3.399s	user 0.020s	sys 0.030s
W20260709 13:16:02.035843  6776 consensus_meta.cc:287] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.642s	user 0.014s	sys 0.000s
I20260709 13:16:02.092362  3198 raft_consensus.cc:2368] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 6. Current term is 7.
I20260709 13:16:02.081278  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:02.033385  6783 consensus_meta.cc:287] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.831s	user 0.005s	sys 0.018s
W20260709 13:16:01.864584  6697 consensus_meta.cc:287] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.597s	user 0.005s	sys 0.013s
I20260709 13:16:02.097350  6794 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.100461  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.101163  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:01.737560  6830 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:01.918651  6792 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:01.795616  6488 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:02.101948  6776 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.102833  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:02.103040  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.102000  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:01.931614  6121 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:02.105046  3124 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:16:02.101727  6590 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:01.793921  6684 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:01.798231  6787 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:02.105105  6724 consensus_queue.cc:1059] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:01.863663  6293 raft_consensus.cc:3055] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:01.919257  6746 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:02.059932  6625 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:02.100526  6691 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:02.117226  6839 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:02.124049  3120 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:16:02.111205  3125 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:16:02.110755  6794 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:02.112514  6292 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:02.080703  6766 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:16:02.115234  6801 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:02.117208  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:16:02.118620  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.131139  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:02.132092  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:02.105383  6720 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:02.123049  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:02.111130  6712 consensus_meta.cc:287] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.798s	user 0.019s	sys 0.000s
I20260709 13:16:02.127307  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:02.131115  3196 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 9: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:02.133932  3048 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:02.131605  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:02.139766  3197 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:02.141572  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:02.125197  6293 raft_consensus.cc:740] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:02.148474  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.143482  3198 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:16:02.144208  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 474591us
I20260709 13:16:02.121600  6697 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.144393  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.119721  6662 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:02.144209  6533 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:02.144237  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:02.145956  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 91329.1us
I20260709 13:16:02.120098  6783 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:02.093098  6812 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:02.148298  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.149900  3797 raft_consensus.cc:2393] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:02.153460  6766 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:02.157769  3044 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 5.
I20260709 13:16:02.147912  6292 raft_consensus.cc:697] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:02.162303  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:02.163131  6292 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.165999  6837 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:02.167287  3124 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:02.167898  3090 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:02.168233  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:02.168511  6757 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:02.168205  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:02.169201  6757 consensus_queue.cc:1243] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:02.167318  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:02.173331  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:02.173683  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:02.174291  3197 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:02.176671  3195 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:02.178097  6812 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:02.168296  6846 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.181193  6846 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.162349  3050 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:02.182101  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:02.183701  6846 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:02.183892  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.184795  3126 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:16:02.153954  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:02.161345  3200 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
W20260709 13:16:02.186017  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 66036.8us
I20260709 13:16:02.187647  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:02.189729  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.196194  3045 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:16:02.195958  6815 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:16:02.200340  6697 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:02.201128  6812 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:02.201601  6812 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.193936  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.202548  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:02.141208  6488 consensus_queue.cc:1059] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:16:02.208006  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:02.208360  3199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2125) took 1989 ms (client timeout 2150 ms). Trace:
I20260709 13:16:02.210053  3794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 472) took 3537 ms. Trace:
I20260709 13:16:02.209899  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.210487  6766 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.223501  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.151880  6712 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.224347  6731 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:02.225214  6731 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:02.226365  6712 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:02.211138  6121 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:02.211607  6776 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:02.191192  6839 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:02.217932  6783 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:02.218549  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.133864  6684 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:02.222579  3051 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:02.236505  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.224433  6766 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:02.202003  6812 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:02.228078  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 46102us
I20260709 13:16:02.210933  6644 raft_consensus.cc:3055] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:02.229821  3124 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:02.220520  3794 rpcz_store.cc:276] 0709 13:15:58.672463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.672689 (+   226us) service_pool.cc:224] Handling call
0709 13:15:58.673037 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.539541 (+866504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.209473 (+2669932us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b5400521554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:02.209765 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1740939136}
W20260709 13:16:02.219666  3199 rpcz_store.cc:269] 0709 13:16:00.218597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.228502 (+  9905us) service_pool.cc:224] Handling call
0709 13:16:02.207975 (+1979473us) spinlock_profiling.cc:243] Waited 97.6 ms on lock 0x7b54003bb854. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:02.208152 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224423808}
I20260709 13:16:02.224383  3043 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:16:02.238971  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:02.235067  3045 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:16:02.226946  6697 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.243103  3120 raft_consensus.cc:2410] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:16:02.246665  3044 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:02.247761  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.248811  3044 raft_consensus.cc:2410] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:02.248628  6706 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:02.249941  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:02.250989  3791 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 9: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:02.251039  6697 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.253681  3091 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:02.253850  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:02.247902  6684 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:02.259588  6815 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:02.228601  6625 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:02.463340  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.323575  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:02.259953  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:02.299005  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:02.311362  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.418354  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:16:02.464161  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 296444us
I20260709 13:16:02.466926  3125 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:02.299001  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:02.468516  3121 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:02.361308  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:02.470813  3120 raft_consensus.cc:2393] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 6: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:02.418505  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:02.473171  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:02.359032  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:16:02.411562  6775 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.295s	user 0.019s	sys 0.023s
W20260709 13:16:02.477089  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 289457us
I20260709 13:16:02.240221  6644 raft_consensus.cc:740] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:02.478855  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:02.479399  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.480000  3046 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:02.480685  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:02.463665  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:02.483381  3120 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:02.485706  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.487694  3791 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:16:02.486627  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:02.483260  3118 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
W20260709 13:16:02.484227  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.263216  6766 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:02.317803  6846 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:02.491343  3197 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:16:02.301304  6697 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:02.411648  6292 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.406423  6624 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:02.272425  6794 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:02.493149  3044 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:02.493356  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:02.493178  6829 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:02.478324  6775 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.581s	user 0.021s	sys 0.026s
I20260709 13:16:02.519187  6829 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:02.265295  6634 raft_consensus.cc:3055] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:02.496850  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:02.520887  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.521297  6634 raft_consensus.cc:740] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:02.502592  6644 consensus_queue.cc:260] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.503453  6818 raft_consensus.cc:3055] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:02.523301  6818 raft_consensus.cc:740] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:02.523680  3121 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:16:02.524312  6818 consensus_queue.cc:260] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.524729  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.525480  6818 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:02.526218  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.527484  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.528240  3121 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
W20260709 13:16:02.529034  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.529157  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:02.531114  6819 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 1.365s	user 0.003s	sys 0.000s
I20260709 13:16:02.531209  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.536268  6644 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:02.507007  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 208157us
I20260709 13:16:02.507792  3090 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:02.510147  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:02.540580  3191 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:16:02.541939  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:02.542840  3191 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 9: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:02.499578  3050 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:02.543817  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:02.522403  6634 consensus_queue.cc:260] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.546068  6634 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:02.547184  6731 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:02.511082  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.511771  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:02.514266  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.549249  3120 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:02.514427  3125 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
W20260709 13:16:02.550922  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 72386.7us
I20260709 13:16:02.356032  6293 consensus_queue.cc:260] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:02.514751  3199 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:02.554530  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:02.555111  3125 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:02.555687  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:02.556684  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:02.557039  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:02.556697  3196 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
W20260709 13:16:02.558490  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.558362  3117 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:16:02.550144  6662 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:02.548938  6766 raft_consensus.cc:697] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:02.553403  6684 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:02.555558  6624 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:02.566527  3090 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:02.567893  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1942) took 2496 ms. Trace:
I20260709 13:16:02.568774  3199 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:02.571014  3196 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:02.574442  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:02.573446  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:02.576535  3120 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:16:02.572365  3049 rpcz_store.cc:276] 0709 13:16:00.071471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.071695 (+   224us) service_pool.cc:224] Handling call
0709 13:16:00.072309 (+   614us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:00.072716 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:00.072752 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:00.083452 (+ 10700us) log.cc:844] Serialized 564 byte log entry
0709 13:16:00.668967 (+585515us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:00.669024 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.669117 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:02.530040 (+1860923us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:02.553215 (+ 23175us) raft_consensus.cc:1685] finished
0709 13:16:02.553236 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:02.567601 (+ 14365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13565184,"thread_start_us":585159,"threads_started":1,"wal-append.queue_time_us":983336}
I20260709 13:16:02.582360  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.583251  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.584640  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.574546  6783 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:02.586395  6783 raft_consensus.cc:697] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:02.587287  6783 consensus_queue.cc:237] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.588660  3045 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:02.587299  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.585530  3049 raft_consensus.cc:2393] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:02.591404  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.594697  6684 raft_consensus.cc:697] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:16:02.601337  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 48128us
I20260709 13:16:02.601786  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.602638  6684 consensus_queue.cc:237] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.603394  6589 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:02.603749  3015 leader_election.cc:400] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 6. Current term is 7.
I20260709 13:16:02.604064  3015 leader_election.cc:403] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:02.604115  6589 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:02.598690  3120 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:16:02.605473  3165 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:02.600957  3199 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:02.572901  6624 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.585476  6845 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:02.583264  3117 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:16:02.602558  3048 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:16:02.555377  6292 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.611702  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:02.607525  6850 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:02.607668  6848 consensus_queue.cc:1059] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:16:02.615952  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:02.617640  3044 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:16:02.617241  3165 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:02.619498  3042 raft_consensus.cc:1275] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:16:02.619828  3042 pending_rounds.cc:85] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 4
I20260709 13:16:02.562000  6846 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.621678  3051 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:02.622558  3125 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:16:02.624028  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:02.607909  6836 consensus_meta.cc:287] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.001s
I20260709 13:16:02.618042  6589 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.630087  6709 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:02.630312  6725 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 6. Current term is 7.
I20260709 13:16:02.631767  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.631958  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.620038  3042 pending_rounds.cc:107] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:16:02.633276  3042 raft_consensus.cc:2889] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:02.630741  6709 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.634797  3191 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:16:02.625949  3045 raft_consensus.cc:1217] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Deduplicated request from leader. Original: 4.2->[7.3-9.4]   Dedup: 7.3->[9.4-9.4]
I20260709 13:16:02.639946  3045 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: [7.3-9.4]
I20260709 13:16:02.610893  6624 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:02.638216  3798 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:02.630409  6848 raft_consensus.cc:3055] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:02.642776  6488 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:02.644172  6848 raft_consensus.cc:740] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:02.644754  6488 raft_consensus.cc:697] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:02.645177  6848 consensus_queue.cc:260] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:02.646556  6848 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:02.634047  6709 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:02.639355  3125 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:02.624765  6839 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:02.655599  3048 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:02.662137  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.663620  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:02.665439  3193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2119) took 2533 ms (client timeout 1720 ms). Trace:
I20260709 13:16:02.665572  6645 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.665947  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.666363  6705 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:16:02.666862  3125 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:16:02.667094  6705 consensus_queue.cc:1243] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:02.668310  3125 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:16:02.668378  3123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 1932) took 2112 ms (client timeout 2530 ms). Trace:
W20260709 13:16:02.668802  3123 rpcz_store.cc:269] 0709 13:16:00.555932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.685855 (+129923us) service_pool.cc:224] Handling call
0709 13:16:02.668160 (+1982305us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400319554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:02.668305 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2719684352}
I20260709 13:16:02.648612  6691 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:02.670117  6691 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.653702  6787 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:02.670558  6691 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:02.670646  6787 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:02.671721  6787 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:02.675047  6697 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:02.675944  6697 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:02.670349  3123 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:16:02.666122  6645 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.661708  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:02.646044  6488 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:02.665933  3193 rpcz_store.cc:269] 0709 13:16:00.113433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.186266 (+ 72833us) service_pool.cc:224] Handling call
0709 13:16:02.622649 (+2436383us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54001b85d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:02.646840 (+ 24191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1134075776}
I20260709 13:16:02.660912  3165 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:02.652328  6829 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:02.684906  6733 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:02.687279  6816 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:02.687528  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.687932  6816 raft_consensus.cc:697] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:02.689080  6816 consensus_queue.cc:237] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:02.697942  6862 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:16:02.698310  3123 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:16:02.698980  6864 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 13:16:02.701140  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 45622.1us
I20260709 13:16:02.678537  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:02.697454  6697 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:02.706993  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 57871.5us
W20260709 13:16:02.704638  6863 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.125s	user 0.001s	sys 0.001s
I20260709 13:16:02.713027  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.700621  6783 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:02.720307  6691 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.732892  6292 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:02.734474  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.735025  6709 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.735385  3126 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:16:02.737396  6709 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:02.737586  6787 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:02.740059  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.743732  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 484) took 2454 ms. Trace:
I20260709 13:16:02.747469  6754 raft_consensus.cc:3055] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:02.750589  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1939) took 2732 ms. Trace:
W20260709 13:16:02.815056  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 166214us
I20260709 13:16:02.815968  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:02.753639  6720 raft_consensus.cc:3055] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:02.756556  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.763520  2948 catalog_manager.cc:5697] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:02.577795  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:02.780652  6588 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:02.779735  6812 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.711503  6758 consensus_queue.cc:1059] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.161s
I20260709 13:16:02.786861  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:02.788659  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:02.789049  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:02.794090  6776 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.796080  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:02.822602  3191 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:16:02.797937  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:02.799806  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:02.802287  3192 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:02.802871  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:02.752421  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.817909  3124 raft_consensus.cc:2376] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9. Re-sending same reply.
I20260709 13:16:02.815387  3042 rpcz_store.cc:276] 0709 13:16:00.017767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.022937 (+  5170us) service_pool.cc:224] Handling call
0709 13:16:00.023369 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.642496 (+2619127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.750223 (+107727us) spinlock_profiling.cc:243] Waited 2.41 s on lock 0x7b540027c9d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:02.750509 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5553522432}
I20260709 13:16:02.813582  3195 rpcz_store.cc:276] 0709 13:16:00.288967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.221784 (+932817us) service_pool.cc:224] Handling call
0709 13:16:01.222117 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.177227 (+955110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.743377 (+566150us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b5400177354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:02.743646 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2194366720}
I20260709 13:16:02.824800  3199 raft_consensus.cc:1240] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:02.824245  3122 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:16:02.710986  6625 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:02.717423  6846 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:02.830250  3193 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:02.797495  6662 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:02.834722  3048 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:16:02.686118  6766 consensus_queue.cc:237] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.841269  3200 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 8: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:02.816989  6645 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:02.847368  3761 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:02.815233  6754 raft_consensus.cc:740] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:02.822508  6720 raft_consensus.cc:740] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:02.853258  3091 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:02.846386  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.862133  6609 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:02.867918  6609 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.862434  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:02.869725  6787 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:02.870214  3195 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 9: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:02.845474  6644 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:02.868404  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.866829  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:02.858695  6794 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:16:02.871742  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:02.869653  6754 consensus_queue.cc:260] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:02.876521  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 212653us
I20260709 13:16:02.839745  6662 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:02.878165  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:02.878659  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 170413us
I20260709 13:16:02.869797  6609 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:02.882614  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 66724.3us
I20260709 13:16:02.879515  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2124) took 2716 ms. Trace:
I20260709 13:16:02.884488  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:02.885278  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:02.884546  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:02.886574  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:02.882179  3050 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:16:02.884739  3194 rpcz_store.cc:276] 0709 13:16:00.199483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.236688 (+ 37205us) service_pool.cc:224] Handling call
0709 13:16:01.681958 (+1445270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:01.683345 (+  1387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.864278 (+1180933us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54000429d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:02.873015 (+  8737us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3322571136}
I20260709 13:16:02.894109  6631 raft_consensus.cc:3055] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:02.894371  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:02.894665  6631 raft_consensus.cc:740] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:02.894851  6828 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:16:02.895139  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:02.895906  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:02.895649  6631 consensus_queue.cc:260] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:02.894804  6644 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:02.896927  6513 consensus_queue.cc:1059] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:16:02.898249  6513 raft_consensus.cc:3055] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:02.898530  6462 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:02.897168  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:02.899101  6462 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.899475  6462 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:02.899667  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:02.900558  6688 consensus_queue.cc:1059] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:02.900846  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:02.898643  6513 raft_consensus.cc:740] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:02.880039  6763 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:02.901562  6758 raft_consensus.cc:3055] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:02.938733  6754 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:02.938985  6758 raft_consensus.cc:740] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:02.940094  6758 consensus_queue.cc:260] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:02.940651  6513 consensus_queue.cc:260] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:02.941387  6758 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:02.942168  6513 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:02.942265  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.946617  6691 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:02.975526  3042 raft_consensus.cc:1217] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Deduplicated request from leader. Original: 3.3->[5.4-12.7]   Dedup: 8.5->[10.6-12.7]
I20260709 13:16:02.976326  3042 pending_rounds.cc:85] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 5
I20260709 13:16:02.976619  3042 pending_rounds.cc:107] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:16:02.976934  3042 raft_consensus.cc:2889] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:02.978189  6851 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:16:02.849620  6776 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:02.952409  6763 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:02.980525  6763 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:02.989905  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 108135us
W20260709 13:16:02.999383  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.011273  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.037563  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 134806us
W20260709 13:16:03.042462  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 150262us
I20260709 13:16:02.991027  3164 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:03.052685  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.056197  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.060606  6814 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:03.061087  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:03.062245  6709 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:16:03.062433  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 71532.2us
I20260709 13:16:03.064168  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:03.065011  6709 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:03.065124  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:03.066098  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.066293  3090 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:03.065560  6709 raft_consensus.cc:697] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:03.048337  6691 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:03.070811  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:03.073707  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.081239  3043 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:03.082914  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:03.078884  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:03.082964  3762 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:03.092381  6661 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:03.076592  6830 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:03.076464  6787 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:03.074316  6691 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:03.072894  6631 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:03.097034  3164 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:03.098559  6724 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:03.102162  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 257896us
I20260709 13:16:03.088478  6645 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:03.085321  6814 consensus_queue.cc:1059] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:16:03.100883  6661 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:03.118713  6787 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:03.103797  6691 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:03.120093  6589 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:03.120782  6724 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:16:03.118844  6845 consensus_meta.cc:287] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.511s	user 0.013s	sys 0.018s
W20260709 13:16:03.105192  6634 consensus_meta.cc:287] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.007s
I20260709 13:16:03.123171  6724 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:03.107843  6776 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:03.127604  6709 consensus_queue.cc:237] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:03.132848  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.133646  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 56012.5us
I20260709 13:16:03.133937  3120 raft_consensus.cc:2410] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:16:03.143318  3121 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:16:03.157378  6715 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.158012  6715 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:03.152196  6733 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:03.159703  6733 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:03.126066  6645 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:03.176610  6661 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:03.133911  6589 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 13:16:03.187247  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 101431us
W20260709 13:16:03.189260  3118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55318 (request call id 525) took 4073 ms (client timeout 1970 ms). Trace:
W20260709 13:16:03.189841  3118 rpcz_store.cc:269] 0709 13:15:59.114993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.266858 (+151865us) service_pool.cc:224] Handling call
0709 13:16:03.182281 (+3915423us) spinlock_profiling.cc:243] Waited 3.01 s on lock 0x7b540011d0d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:03.187960 (+  5679us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6917298560}
I20260709 13:16:03.194144  3164 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:03.189407  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:03.203186  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:03.198909  3194 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:03.207628  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:03.207973  3090 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:03.209386  3050 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:16:03.214161  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:03.214337  3192 pending_rounds.cc:85] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 3
I20260709 13:16:03.214833  3192 pending_rounds.cc:107] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:03.215144  3192 raft_consensus.cc:2889] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:03.221685  6588 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:03.222285  6588 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.222652  6588 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:03.201925  6609 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:03.225944  6816 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:03.226964  6816 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:03.227224  6609 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:03.227468  6816 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.228024  6816 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:03.228504  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.230255  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:03.231317  6715 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:03.231843  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:03.232823  3198 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 9: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:03.233860  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:03.236384  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:03.236857  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.238605  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:03.234117  6812 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:03.247445  3124 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 13:16:03.248055  3124 pending_rounds.cc:85] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 9
I20260709 13:16:03.248315  3124 pending_rounds.cc:107] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 13:16:03.239373  3118 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:03.193266  6787 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:03.248586  3124 raft_consensus.cc:2889] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:03.274811  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.308091  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:03.319869  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:03.333962  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:03.182358  6794 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:16:03.339761  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:03.340471  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:16:03.341327  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.405776  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:03.341547  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:16:03.317945  6848 consensus_meta.cc:287] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.666s	user 0.030s	sys 0.015s
I20260709 13:16:03.406613  3122 raft_consensus.cc:2410] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:03.341720  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:03.407490  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:03.408042  3122 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:03.342280  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:03.350172  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:03.351055  6588 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:03.351604  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:03.352418  6878 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:16:03.353048  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:03.375095  6645 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:03.382452  6609 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:03.383594  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 175729us
I20260709 13:16:03.398551  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:03.404070  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:03.342125  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:03.414407  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:03.407481  3117 raft_consensus.cc:2410] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:16:03.430665  3118 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 9: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:03.418795  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:03.433621  3120 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
W20260709 13:16:03.336238  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 126563us
I20260709 13:16:03.392967  6662 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:03.427152  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:03.428543  3196 raft_consensus.cc:2393] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:03.446195  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:03.449152  3761 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:03.453210  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.389191  6691 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:03.437690  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:03.464838  3050 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:16:03.416471  6462 consensus_meta.cc:287] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.502s	user 0.013s	sys 0.030s
I20260709 13:16:03.462496  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:03.467434  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:03.465467  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:03.436198  3122 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:03.468922  3051 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:03.470232  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.472749  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.476342  3090 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:03.482391  3165 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:03.495793  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:03.506081  3165 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:03.513118  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:03.514623  3196 raft_consensus.cc:2410] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:16:03.529052  6589 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:03.529484  3200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1792) took 1638 ms (client timeout 1948 ms). Trace:
I20260709 13:16:03.493367  6848 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:03.526942  3165 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:03.532297  3043 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:03.530053  3200 rpcz_store.cc:269] 0709 13:16:01.895268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.193392 (+298124us) service_pool.cc:224] Handling call
0709 13:16:03.529253 (+1335861us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b5400179154. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:03.529418 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1382499072}
I20260709 13:16:03.533905  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:03.537436  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 61206.8us
I20260709 13:16:03.541004  3090 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:03.547164  3196 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:03.508677  6828 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:03.466771  6609 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:03.474826  6462 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:03.551834  3194 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:16:03.512192  6712 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:03.557631  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.575866  3198 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:03.533437  6624 consensus_meta.cc:287] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.868s	user 0.008s	sys 0.004s
I20260709 13:16:03.535532  3191 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
W20260709 13:16:03.584674  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 149587us
I20260709 13:16:03.565569  3200 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:03.560463  3050 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
W20260709 13:16:03.569351  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.518945  6684 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:03.534566  6848 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:03.602267  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 61380.8us
I20260709 13:16:03.603706  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:03.617415  3044 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 7: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:03.618783  3794 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 9: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:03.620538  3194 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:03.621366  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 565) took 1030 ms. Trace:
I20260709 13:16:03.574196  6712 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.578209  6688 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:03.628772  3199 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:03.630074  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:03.631531  3191 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
W20260709 13:16:03.633364  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 271370us
I20260709 13:16:03.626607  3043 raft_consensus.cc:2410] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 8 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:03.621757  3051 rpcz_store.cc:276] 0709 13:16:02.590541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.889775 (+299234us) service_pool.cc:224] Handling call
0709 13:16:02.897429 (+  7654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.474919 (+577490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.621165 (+146246us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b540028c154. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:03.621310 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1313910656}
I20260709 13:16:03.604525  6589 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.622676  3198 raft_consensus.cc:1240] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:03.623874  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 1861) took 1112 ms. Trace:
I20260709 13:16:03.583575  6830 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:03.626317  3196 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:16:03.604815  6684 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:03.612993  6848 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:03.608533  6709 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:03.570969  6845 consensus_queue.cc:1059] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:16:03.638089  3121 rpcz_store.cc:276] 0709 13:16:02.511343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.530980 (+ 19637us) service_pool.cc:224] Handling call
0709 13:16:03.623708 (+1092728us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54003921d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:03.623816 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1405159168}
I20260709 13:16:03.632611  6712 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:03.621713  3194 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:03.608026  6624 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:03.656776  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.657490  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.570034  6720 consensus_queue.cc:260] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:03.645642  6684 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:03.666420  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 163143us
W20260709 13:16:03.666627  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 78301.7us
I20260709 13:16:03.649281  6828 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:16:03.696264  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0305580960000498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 13:16:03.696839  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0305580960000498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 13:16:03.697211  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0197580960000323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
I20260709 13:16:03.704298  3046 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:03.658015  6588 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:03.707770  6733 consensus_meta.cc:287] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.000s
I20260709 13:16:03.647562  6830 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:03.710141  6881 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 13:16:03.710614  6880 log.cc:927] Time spent T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:16:03.710986  6720 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:03.711931  6513 consensus_meta.cc:287] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.769s	user 0.018s	sys 0.013s
I20260709 13:16:03.667806  6662 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:03.703337  6691 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:03.710141  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 86611.7us
I20260709 13:16:03.645824  6589 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:03.720036  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 251995us
I20260709 13:16:03.654014  6688 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 13:16:03.728852  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 112393us
W20260709 13:16:03.733340  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.742055  3164 connection.cc:256] RPC call timeout handler was delayed by -1.5127144099999441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
I20260709 13:16:03.701285  6724 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:03.742375  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 64295.5us
I20260709 13:16:03.742753  3761 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:03.724346  6709 raft_consensus.cc:697] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:16:03.746295  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 219453us
I20260709 13:16:03.728642  6645 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:03.754822  3090 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:03.736424  6812 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:03.768795  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.770936  6691 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:03.774207  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.766702  6645 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:03.777484  6758 consensus_meta.cc:287] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.794s	user 0.009s	sys 0.009s
I20260709 13:16:03.778056  6645 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:03.778784  6634 raft_consensus.cc:3055] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:03.779409  6634 raft_consensus.cc:740] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:03.779524  6609 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:03.780124  6609 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:03.778895  6462 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:03.728438  6733 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:03.786900  6812 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:03.787938  6589 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:03.790145  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.791831  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 43703.9us
I20260709 13:16:03.806234  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:03.789561  6624 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:03.791263  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:03.808506  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.808905  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 59686.9us
W20260709 13:16:03.810371  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 63128.7us
I20260709 13:16:03.640090  6787 raft_consensus.cc:2955] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 2 to 8, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:03.817806  6609 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:03.818902  6758 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:03.820978  6733 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:03.822741  3164 connection.cc:256] RPC call timeout handler was delayed by -1.3984144099997593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 13:16:03.823459  3164 connection.cc:256] RPC call timeout handler was delayed by -1.0474144099998739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
I20260709 13:16:03.823925  3795 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:03.824694  3164 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:03.824899  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:03.826691  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:03.827531  6754 consensus_meta.cc:287] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.888s	user 0.011s	sys 0.019s
I20260709 13:16:03.828747  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:03.829312  3121 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:03.830458  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:03.831033  3120 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 6.
I20260709 13:16:03.831629  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:03.832427  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:03.750613  6725 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 13:16:03.835776  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 54511.5us
I20260709 13:16:03.837366  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:03.839922  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:03.791451  6645 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:16:03.842667  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:03.845340  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 105964us
W20260709 13:16:03.845890  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 80536.7us
I20260709 13:16:03.849929  6814 consensus_queue.cc:1059] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:03.850246  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:03.850960  3125 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:03.851502  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:03.851727  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:03.852186  3118 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:03.858264  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 492) took 1615 ms. Trace:
I20260709 13:16:03.858961  3197 rpcz_store.cc:276] 0709 13:16:02.242824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.556409 (+313585us) service_pool.cc:224] Handling call
0709 13:16:02.566680 (+ 10271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:02.594434 (+ 27754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:02.594461 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:02.755948 (+161487us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b48001b0258. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff8352dcaa1 00007ff8352d3b37 00007ff8352d39ca 00007ff8353cb26f 00007ff8353caf37 00007ff8353df55c 00007ff8353df508 00007ff8353df488 00007ff8353df443 00007ff8353de6ec 00007ff834308a96
0709 13:16:02.861784 (+105836us) spinlock_profiling.cc:243] Waited 8.66 ms on lock 0x7b1800487240. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2942a6 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a
0709 13:16:03.127606 (+265822us) spinlock_profiling.cc:243] Waited 874 us on lock 0x7b2c000fc108. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:16:03.128035 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:16:03.193375 (+ 65340us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:03.206579 (+ 13204us) log.cc:844] Serialized 14 byte log entry
0709 13:16:03.206808 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.206880 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:03.847911 (+641031us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b24002004c8. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d14c9c4 00007ff82d14aacb 00007ff82d305dc9 00007ff82d305a55 00007ff82d304fb0 00007ff82ff7b488 00007ff82ff7bbe8 00007ff82ff53398 00007ff82ff4e76a 00007ff82ff4dbb6
0709 13:16:03.857955 (+ 10044us) raft_consensus.cc:1685] finished
0709 13:16:03.857990 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:03.858179 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12798,"prepare.queue_time_us":13477,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":10019,"raft.run_cpu_time_us":2670,"raft.run_wall_time_us":162574,"spinlock_wait_cycles":34157824,"thread_start_us":64967,"threads_started":1,"wal-append.queue_time_us":383957}
I20260709 13:16:03.871351  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:03.835831  6625 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:03.874867  3051 raft_consensus.cc:2393] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:03.872524  3165 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:03.837165  6898 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:03.882658  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:03.879860  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:03.880416  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 48871.7us
I20260709 13:16:03.790022  6724 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:03.887753  3121 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:16:03.905591  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:03.909547  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:03.911628  3125 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
W20260709 13:16:03.912225  6882 log.cc:927] Time spent T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:16:03.875344  6488 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:03.928587  6488 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:03.929419  6488 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:03.931190  3165 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:03.936110  3051 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:03.936332  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2340) took 1462 ms. Trace:
I20260709 13:16:03.936923  3046 rpcz_store.cc:276] 0709 13:16:02.473944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.873907 (+399963us) service_pool.cc:224] Handling call
0709 13:16:03.936090 (+1062183us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b54001d74d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:03.936262 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1869524224}
I20260709 13:16:03.939934  3042 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:16:03.940608  3042 pending_rounds.cc:85] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 5
I20260709 13:16:03.941002  3042 pending_rounds.cc:107] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:16:03.943945  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 543) took 1141 ms. Trace:
I20260709 13:16:03.944468  3124 rpcz_store.cc:276] 0709 13:16:02.802885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.901673 (+ 98788us) service_pool.cc:224] Handling call
0709 13:16:03.246979 (+345306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.383171 (+136192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.943680 (+560509us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54003e8350. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:03.943868 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":792200576}
I20260709 13:16:03.945470  6662 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:03.946401  6662 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:03.948225  6634 consensus_queue.cc:260] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:03.951290  6896 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:03.953125  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:03.954722  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:03.941381  3042 raft_consensus.cc:2889] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:03.960554  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55318 (request call id 536) took 1313 ms. Trace:
I20260709 13:16:03.962319  3126 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:16:03.962806  3126 pending_rounds.cc:85] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 9
I20260709 13:16:03.963588  3126 pending_rounds.cc:107] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:16:03.963963  3126 raft_consensus.cc:2889] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:03.962785  3794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 489) took 1079 ms. Trace:
I20260709 13:16:03.961120  3117 rpcz_store.cc:276] 0709 13:16:02.649512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.653868 (+  4356us) service_pool.cc:224] Handling call
0709 13:16:03.960270 (+1306402us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b5400477cd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:03.960476 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1615560576}
I20260709 13:16:03.974056  3124 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 6: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:03.975210  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:16:03.971781  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 121447us
I20260709 13:16:03.906464  6776 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:03.928709  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:03.927922  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:03.976567  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:03.981124  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:03.981963  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:03.990494  3117 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:03.992316  3124 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:03.992501  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:03.972486  3794 rpcz_store.cc:276] 0709 13:16:02.883178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.884528 (+  1350us) service_pool.cc:224] Handling call
0709 13:16:03.962439 (+1077911us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b5400691254. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:03.962642 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1647389056}
I20260709 13:16:03.996836  6812 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:03.998088  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:03.998315  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:03.998982  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.999213  3197 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
W20260709 13:16:03.999621  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.906446  6902 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:04.006479  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:03.916018  6894 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:04.003908  3121 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:16:04.009073  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:03.966308  6725 raft_consensus.cc:2764] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:16:04.012099  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:04.015272  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:04.002032  6889 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.239s	user 0.004s	sys 0.001s
I20260709 13:16:04.022997  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:03.977881  6901 raft_consensus.cc:3055] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:04.023844  3191 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:04.026051  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:04.027643  3124 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:04.028856  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:04.030654  3121 raft_consensus.cc:2410] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:04.031294  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:04.031980  3125 raft_consensus.cc:2393] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 8: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:03.876929  6709 consensus_queue.cc:237] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:04.043110  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 65886.2us
I20260709 13:16:04.014360  6899 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:04.044206  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:04.039479  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:04.048498  3046 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
W20260709 13:16:04.033454  6883 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
W20260709 13:16:04.055413  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 113992us
I20260709 13:16:04.044045  2948 catalog_manager.cc:5697] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:04.059230  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:04.059855  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:04.030043  6894 raft_consensus.cc:697] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:04.027015  6901 raft_consensus.cc:740] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:16:04.063278  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.018427  3042 raft_consensus.cc:2955] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 2 to 8, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:04.007897  6848 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:04.046141  6588 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.066612  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:04.046744  6624 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:04.067414  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.071919  6631 consensus_meta.cc:287] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.964s	user 0.013s	sys 0.000s
I20260709 13:16:04.088963  3194 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:04.082368  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:04.070426  6830 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:04.028872  6776 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:16:04.054615  6902 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:04.081673  6763 consensus_meta.cc:287] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.101s	user 0.015s	sys 0.001s
I20260709 13:16:04.081508  6893 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:04.060994  6758 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:04.100544  3117 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:16:04.063935  6845 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.120626  6845 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:04.111392  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:04.113801  3124 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:16:04.067696  6662 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:04.122805  6845 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:04.122871  6662 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.110159  6624 raft_consensus.cc:697] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:04.125962  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:04.126561  3123 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 9: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:04.140805  3194 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:16:04.146065  3164 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:04.097584  6812 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:04.158890  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.151796  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 58253us
I20260709 13:16:04.112115  6724 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:04.235392  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.100188  6814 consensus_queue.cc:1059] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 13:16:04.238675  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 156394us
I20260709 13:16:04.241391  3090 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:04.123515  6662 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:04.249531  3090 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:04.251626  3194 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:16:04.148948  6631 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:04.259099  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 117539us
I20260709 13:16:04.260762  3164 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:04.114696  6588 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:04.115363  6763 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:04.262545  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:04.116729  6712 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:04.264731  3194 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:04.265024  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:04.267928  3164 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:04.268841  3090 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:04.244728  6893 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:04.250694  6920 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.272161  3164 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:04.261026  6878 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.107s	user 0.004s	sys 0.020s
I20260709 13:16:04.279017  3164 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:04.279733  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.282060  3120 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:04.275442  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:04.295253  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.252436  6918 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:04.306622  3124 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:04.128895  3125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:16:04.306918  3195 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 10. Ops: []
I20260709 13:16:04.183965  6902 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:04.312264  3125 raft_consensus.cc:606] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:04.316560  3125 raft_consensus.cc:614] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:04.314497  3194 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:16:04.269582  6904 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:04.269917  6733 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:04.270759  6812 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:16:04.340162  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 61258.6us
I20260709 13:16:04.290614  6688 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:04.276969  6898 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:04.184166  6624 consensus_queue.cc:237] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:04.261153  6758 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:04.343312  3090 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:04.291445  6893 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:04.305020  6920 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:04.371783  6662 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:04.372574  6588 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:04.310137  6894 consensus_queue.cc:237] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:04.345155  6776 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.328838  6904 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.308907  6909 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.203s
I20260709 13:16:04.311609  6910 consensus_queue.cc:1059] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:16:04.057961  6903 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:16:04.347289  6688 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:16:04.418609  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 181636us
I20260709 13:16:04.261528  6901 consensus_queue.cc:260] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:04.412336  6879 log.cc:927] Time spent T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:16:04.449302  3761 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:04.405537  6918 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:04.319213  6897 consensus_queue.cc:1059] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 13:16:04.443957  6688 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:04.446461  6848 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:04.460536  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.462363  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.477653  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:04.450228  6898 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:04.412948  6904 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:04.486179  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:04.490679  3795 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:04.498579  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet 4b91597ece9742ebad558605a654e02a: Illegal state: Replica f20672b2852447a6bc1e137c4dd40904 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:04.501000  6895 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:04.505367  6919 log.cc:927] Time spent T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 13:16:04.507262  6923 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:16:04.509249  6763 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:04.537532  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.554471  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.556128  6902 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:04.557060  6893 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:04.558094  6904 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:04.502372  6488 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.002s
W20260709 13:16:04.495798  6915 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.343s	user 0.001s	sys 0.000s
W20260709 13:16:04.561089  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet 4b83202a913e45d5830d2ecdfb5354c2: Illegal state: Replica f20672b2852447a6bc1e137c4dd40904 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:04.572335  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:04.558943  6912 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.628s	user 0.002s	sys 0.000s
I20260709 13:16:04.488430  6462 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:04.574564  3790 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:04.579845  3119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44281a32716140bc805b71db0e071122"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:16:04.580428  3119 raft_consensus.cc:606] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:04.580754  3119 raft_consensus.cc:614] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:04.580653  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:04.583336  3164 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:04.585362  6928 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:16:04.587183  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:04.587836  3794 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:16:04.588385  6688 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:04.588893  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:04.573797  6720 consensus_meta.cc:287] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.821s	user 0.009s	sys 0.006s
I20260709 13:16:04.590036  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:04.590466  3790 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 9: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:04.558105  6712 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:04.591964  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:04.558961  6488 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:04.592312  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:04.593067  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:04.590061  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:04.589471  3794 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:04.594868  3795 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
W20260709 13:16:04.595811  3015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.007s	sys 0.007s
W20260709 13:16:04.596112  3015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.007s	sys 0.007s
I20260709 13:16:04.593644  3796 raft_consensus.cc:2376] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9. Re-sending same reply.
I20260709 13:16:04.597033  6920 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:04.596890  3799 raft_consensus.cc:2955] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 2 to 8, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:04.598539  3798 raft_consensus.cc:2410] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:16:04.599529  6631 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:04.599778  6684 consensus_meta.cc:287] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.887s	user 0.007s	sys 0.006s
I20260709 13:16:04.600216  6684 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:04.602226  3194 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:04.596356  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 668482us
W20260709 13:16:04.606262  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.613358  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.614698  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:04.638710  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 55448.9us
I20260709 13:16:04.487319  6898 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:04.641022  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:04.669598  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.673525  6684 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:04.673987  6720 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:04.648272  6939 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:04.679481  6488 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:04.679571  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:04.690547  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:04.691293  3046 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:04.691399  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:04.690138  3796 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
W20260709 13:16:04.699909  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 87086.4us
I20260709 13:16:04.699956  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:04.701062  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:04.646119  6920 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:04.704347  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.681941  6625 consensus_meta.cc:287] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.768s	user 0.015s	sys 0.000s
W20260709 13:16:04.681010  6816 consensus_meta.cc:287] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.452s	user 0.003s	sys 0.016s
W20260709 13:16:04.709365  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 68505.6us
I20260709 13:16:04.710192  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:04.710242  3164 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:04.712653  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:04.715385  6941 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:04.716069  6941 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:04.716596  6941 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:04.693663  6758 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:04.687687  6720 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:04.735342  3164 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:04.736943  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:16:04.740603  3042 consensus_meta.cc:287] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.004s
I20260709 13:16:04.713058  6625 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:04.729946  6688 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:04.728190  6903 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:04.746354  6712 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:04.762615  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:04.713605  6920 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:04.756276  6794 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:04.763880  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:04.770321  6935 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.741323  6720 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:04.712811  6816 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:04.767256  6462 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:04.779929  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:04.774673  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:04.790308  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 174691us
I20260709 13:16:05.106031  3164 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:05.654628  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 548612us
W20260709 13:16:05.179821  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 836551us
I20260709 13:16:05.658726  6959 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:16:05.206501  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:05.210261  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 454335us
I20260709 13:16:05.212603  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1960) took 1345 ms. Trace:
I20260709 13:16:05.665635  3124 rpcz_store.cc:276] 0709 13:16:03.867078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.123808 (+256730us) service_pool.cc:224] Handling call
0709 13:16:04.124074 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:04.311735 (+187661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.212396 (+900661us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b540011bcd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:05.212531 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419188608}
W20260709 13:16:05.214282  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 434440us
I20260709 13:16:05.667071  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:05.667976  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:05.669275  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:05.670370  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:05.670773  3049 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:05.671460  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:05.671785  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:05.215991  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 550) took 2409 ms. Trace:
I20260709 13:16:05.672351  3126 rpcz_store.cc:276] 0709 13:16:02.806105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.093192 (+287087us) service_pool.cc:224] Handling call
0709 13:16:03.961859 (+868667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.964672 (+  2813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.215760 (+1251088us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b5400477cd0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:05.215927 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1997089152}
W20260709 13:16:05.250144  2945 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57744 (request call id 241) took 31651 ms (client timeout 15000 ms). Trace:
I20260709 13:16:05.673048  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:05.250828  2948 catalog_manager.cc:5697] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:05.675020  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:05.028767  6634 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:05.678951  3048 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:05.679930  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:05.680932  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:05.179896  6688 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:04.891759  6896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.940s	user 0.015s	sys 0.009s
W20260709 13:16:05.746801  6896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.795s	user 0.017s	sys 0.010s
I20260709 13:16:05.747169  6896 raft_consensus.cc:697] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:05.748353  6896 consensus_queue.cc:237] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:04.842938  6898 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:04.766629  6910 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:16:05.827450  6624 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.244285  6916 raft_consensus.cc:3055] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:05.831274  6916 raft_consensus.cc:740] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:16:04.774588  6936 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:16:04.866868  6462 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:04.900098  6720 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:05.847906  6720 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:04.842149  6754 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:05.849263  6754 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:04.791357  6794 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:05.850975  6794 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:05.095739  6814 raft_consensus.cc:3055] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:04.833761  6816 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:04.803570  6684 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:05.876682  6684 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.877115  6684 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:04.756706  6894 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:05.878515  6894 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.878940  6894 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:05.880096  6794 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:04.845865  6776 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:05.157178  6918 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.884892  6918 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:04.874068  6920 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:05.180799  6897 raft_consensus.cc:3055] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:05.888501  6897 raft_consensus.cc:740] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:16:05.096903  6900 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 1.126s	user 0.024s	sys 0.018s
I20260709 13:16:04.801397  6935 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:05.896827  6935 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:04.875479  6941 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:05.889559  6897 consensus_queue.cc:260] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:05.899447  6897 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:05.173807  6293 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:05.271144  3046 consensus_meta.cc:287] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.579s	user 0.013s	sys 0.000s
I20260709 13:16:05.279424  3193 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 9: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:05.288503  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2145) took 2065 ms. Trace:
W20260709 13:16:05.642212  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.676220  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:05.678057  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:05.904613  3195 rpcz_store.cc:276] 0709 13:16:03.223047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.524157 (+301110us) service_pool.cc:224] Handling call
0709 13:16:03.550672 (+ 26515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:04.316136 (+765464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.288190 (+972054us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b54001de554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:05.288427 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1738564864}
W20260709 13:16:05.673434  2945 rpcz_store.cc:269] 0709 13:15:33.623136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.642518 (+ 19382us) service_pool.cc:224] Handling call
0709 13:16:05.249884 (+31607366us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:53.654848 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:53.820517 (+165669us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:53.830417 (+  9900us) write_op.cc:435] Acquired schema lock
0709 13:15:53.838170 (+  7753us) tablet.cc:662] Decoding operations
0709 13:15:53.930910 (+ 92740us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:53.931013 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:53.931059 (+    46us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:15:53.932235 (+  1176us) tablet.cc:701] Row locks acquired
0709 13:15:53.932296 (+    61us) write_op.cc:260] PREPARE: finished
0709 13:15:53.932508 (+   212us) write_op.cc:270] Start()
0709 13:15:53.932660 (+   152us) write_op.cc:276] Timestamp: P: 1783602953932442 usec, L: 0
0709 13:15:53.932682 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:15:53.933423 (+   741us) log.cc:844] Serialized 4402 byte log entry
0709 13:15:54.823711 (+890288us) op_driver.cc:464] REPLICATION: finished
0709 13:15:55.302360 (+478649us) write_op.cc:301] APPLY: starting
0709 13:15:55.302466 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:55.302749 (+   283us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:55.302888 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:55.606954 (+304066us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:55.763427 (+156473us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:15:55.778799 (+ 15372us) write_op.cc:312] APPLY: finished
0709 13:15:55.928116 (+149317us) log.cc:844] Serialized 83 byte log entry
0709 13:15:56.146368 (+218252us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:56.158584 (+ 12216us) write_op.cc:454] Released schema lock
0709 13:15:56.183112 (+ 24528us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:56.267196 (+ 84084us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:56.270556 (+  3360us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":929936,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":457506,"apply.run_cpu_time_us":33333,"apply.run_wall_time_us":915181,"num_ops":11,"prepare.queue_time_us":117477,"prepare.run_cpu_time_us":74140,"prepare.run_wall_time_us":448753,"raft.queue_time_us":303007,"raft.run_cpu_time_us":22873,"raft.run_wall_time_us":466937,"replication_time_us":824933,"thread_start_us":814546,"threads_started":5,"wal-append.queue_time_us":540372,"wal-append.run_cpu_time_us":25304,"wal-append.run_wall_time_us":2555080}]]}
I20260709 13:16:05.675664  2948 catalog_manager.cc:5697] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 4 to 6, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 6 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
W20260709 13:16:05.689113  3197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2165) took 1694 ms (client timeout 1700 ms). Trace:
I20260709 13:16:05.689901  3118 raft_consensus.cc:2410] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:16:05.697095  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 1959) took 1830 ms. Trace:
I20260709 13:16:05.906772  3045 raft_consensus.cc:2393] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:05.673604  3049 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
W20260709 13:16:05.906642  3197 rpcz_store.cc:269] 0709 13:16:04.003129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.010993 (+  7864us) service_pool.cc:224] Handling call
0709 13:16:05.688915 (+1677922us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b54003bb854. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:05.689049 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1663513856}
I20260709 13:16:05.907038  3121 rpcz_store.cc:276] 0709 13:16:03.866751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.011762 (+145011us) service_pool.cc:224] Handling call
0709 13:16:05.696872 (+1685110us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b5400478bd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:05.697016 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38324480}
I20260709 13:16:05.702896  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 507) took 1698 ms. Trace:
I20260709 13:16:05.908032  3194 rpcz_store.cc:276] 0709 13:16:04.004925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.318683 (+313758us) service_pool.cc:224] Handling call
0709 13:16:04.319330 (+   647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:04.602571 (+283241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.702650 (+1100079us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54003ba454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:05.702831 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650191232}
I20260709 13:16:05.703048  6966 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:16:05.709501  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.908121  3091 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:05.716393  3043 raft_consensus.cc:2393] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 10: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:05.720983  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:05.911691  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.725834  6971 raft_consensus.cc:2764] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:05.726622  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:05.737913  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1961) took 1870 ms. Trace:
W20260709 13:16:05.913570  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 187038us
I20260709 13:16:05.914932  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:05.915653  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:05.916049  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:05.740547  6709 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:05.741065  6959 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:05.742461  6947 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:05.923386  6709 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:05.745200  3042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.982s	user 0.011s	sys 0.031s
W20260709 13:16:05.755648  3760 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.019s	sys 0.030s
I20260709 13:16:05.924641  6918 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:05.756381  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:05.758661  6725 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:16:05.768149  3200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2163) took 1787 ms (client timeout 1777 ms). Trace:
I20260709 13:16:05.768884  3192 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 5. Current term is 7. Ops: []
I20260709 13:16:05.776719  3199 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:05.925899  6725 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:05.926146  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:05.926497  6725 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:05.927155  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:05.927590  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:05.928347  3121 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 9: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:05.771546  6932 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:05.918211  6845 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.925889  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:05.929805  6932 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:05.930402  6845 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:05.932114  6932 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:05.932312  6845 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:05.787376  3123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55318 (request call id 556) took 1936 ms (client timeout 1781 ms). Trace:
I20260709 13:16:05.789434  6763 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.932590  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:05.784557  6645 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:05.933450  3195 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 9: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:05.933820  6971 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:05.792495  6688 raft_consensus.cc:697] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:05.934962  6688 consensus_queue.cc:237] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:05.926160  6959 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:05.793087  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 134578us
I20260709 13:16:05.938417  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:05.938583  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:05.794866  6634 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.796296  6758 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:05.796743  6589 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:05.797310  6715 consensus_queue.cc:1059] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:05.802515  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:05.957041  3120 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:05.802788  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:05.802860  3122 raft_consensus.cc:2955] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 2 to 8, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:05.810479  6662 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:05.824863  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:05.828007  6624 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:05.828125  6488 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:05.832331  6916 consensus_queue.cc:260] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:05.971530  6624 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:05.971786  6916 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:05.839064  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:05.839510  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 144256us
I20260709 13:16:05.858757  6814 raft_consensus.cc:740] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:05.858974  3198 raft_consensus.cc:1240] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:05.859503  6903 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:05.865651  6938 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.986061  6903 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:05.987475  6932 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:05.874768  3791 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43926 (request call id 646) took 1332 ms (client timeout 1518 ms). Trace:
I20260709 13:16:05.883548  3191 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:05.893337  6776 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:05.899711  6941 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:05.214408  6724 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:05.900071  6794 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:05.904356  3046 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:05.909018  3044 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:06.000720  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 1995) took 1310 ms. Trace:
I20260709 13:16:06.000818  3119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:16:05.915014  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 2000) took 1140 ms. Trace:
I20260709 13:16:05.913769  3117 rpcz_store.cc:276] 0709 13:16:03.867382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.124376 (+256994us) service_pool.cc:224] Handling call
0709 13:16:04.124555 (+   179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:04.124723 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:04.238066 (+113343us) log.cc:844] Serialized 14 byte log entry
0709 13:16:05.185414 (+947348us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b18002ef1e0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff5323a 00007ff8303bda2a
0709 13:16:05.737485 (+552071us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:05.737549 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:05.737606 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.737684 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:05.737841 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":605748,"prepare.queue_time_us":120132,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":56,"raft.queue_time_us":601099,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"spinlock_wait_cycles":16208640,"thread_start_us":2461,"threads_started":1,"wal-append.queue_time_us":934870}
W20260709 13:16:05.738312  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:05.917204  3193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34728 (request call id 508) took 1912 ms (client timeout 1781 ms). Trace:
I20260709 13:16:06.001427  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:05.918856  3118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 1958) took 2052 ms (client timeout 1561 ms). Trace:
I20260709 13:16:05.918802  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:05.921437  6934 consensus_queue.cc:1059] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:16:05.920295  6920 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:05.912627  2948 catalog_manager.cc:5697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 6 to 8, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130), now has a pending config: VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129), VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130), VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131), VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 8 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:16:05.932762  3123 rpcz_store.cc:269] 0709 13:16:03.851404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.851511 (+   107us) service_pool.cc:224] Handling call
0709 13:16:05.787154 (+1935643us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b540011c1d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:05.787302 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":594312064}
I20260709 13:16:05.790594  3126 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:05.791599  3124 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:05.932955  6763 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:05.792125  6901 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:05.794657  6904 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.929503  3121 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:05.930835  3197 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:05.939589  3049 raft_consensus.cc:2410] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:16:05.924692  3042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.162s	user 0.011s	sys 0.032s
I20260709 13:16:05.940093  3051 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:16:05.933585  3200 rpcz_store.cc:269] 0709 13:16:03.981167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.981311 (+   144us) service_pool.cc:224] Handling call
0709 13:16:05.767921 (+1786610us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b5400177d54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:05.768067 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4064560896}
W20260709 13:16:05.925040  3760 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.169s	user 0.020s	sys 0.031s
I20260709 13:16:05.942993  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:05.946049  3048 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:05.958170  3125 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:05.948812  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2160) took 1968 ms. Trace:
I20260709 13:16:05.963395  6845 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:05.968097  6959 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:05.970079  6715 raft_consensus.cc:3055] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:05.970348  3090 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:05.940923  6966 raft_consensus.cc:697] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:05.963199  6589 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:05.980592  3050 raft_consensus.cc:1275] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:05.979331  6662 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:05.980811  3797 raft_consensus.cc:2410] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:16:05.979568  6848 consensus_queue.cc:1059] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
W20260709 13:16:05.973635  6930 consensus_queue.cc:1175] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aaf88538197a49adb8bcf3790309a67e" responder_term: 9 status { last_received { term: 9 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 9 index: 8 } }
I20260709 13:16:05.980674  6758 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:05.983999  6814 consensus_queue.cc:260] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:05.986155  6938 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:05.870360  6898 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.987978  6932 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:05.988463  6903 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:05.989374  6776 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:05.925664  6709 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:05.988612  3791 rpcz_store.cc:269] 0709 13:16:04.542698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.573585 (+ 30887us) service_pool.cc:224] Handling call
0709 13:16:05.874562 (+1300977us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540009fe54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:05.874709 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2941224192}
W20260709 13:16:05.995939  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet c0433e7a23a246a290c4170888e0d7ee: Illegal state: Replica aaf88538197a49adb8bcf3790309a67e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:05.939039  6720 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:05.997609  6754 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:06.105060  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.997959  3120 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:05.999159  6684 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.000176  6724 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:05.956735  6634 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.272322  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:06.272409  3123 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:16:06.274442  3120 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:16:06.265071  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 294777us
I20260709 13:16:06.276227  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:06.001063  3046 rpcz_store.cc:276] 0709 13:16:04.690134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.690269 (+   135us) service_pool.cc:224] Handling call
0709 13:16:06.000661 (+1310392us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:06.257613  3043 rpcz_store.cc:276] 0709 13:16:04.774269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.774399 (+   130us) service_pool.cc:224] Handling call
0709 13:16:05.914950 (+1140551us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:06.265939  3192 rpcz_store.cc:276] 0709 13:16:03.980116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.980267 (+   151us) service_pool.cc:224] Handling call
0709 13:16:05.768653 (+1788386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.943174 (+174521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.948526 (+  5352us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b5400177d50. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:05.948723 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4053477632}
I20260709 13:16:06.258585  3119 raft_consensus.cc:606] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:06.257308  3820 debug-util.cc:398] Leaking SignalData structure 0x7b08002e0aa0 after lost signal to thread 1937
I20260709 13:16:06.264449  6906 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.278481  6662 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:06.279299  3820 debug-util.cc:398] Leaking SignalData structure 0x7b08002e0220 after lost signal to thread 2983
W20260709 13:16:06.281611  3820 debug-util.cc:398] Leaking SignalData structure 0x7b08002e0ee0 after lost signal to thread 3075
W20260709 13:16:06.258005  3193 rpcz_store.cc:269] 0709 13:16:04.005208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.015041 (+  9833us) service_pool.cc:224] Handling call
0709 13:16:05.917022 (+1901981us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400036454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:05.917143 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2905250560}
W20260709 13:16:06.283063  3820 debug-util.cc:398] Leaking SignalData structure 0x7b08002c8ce0 after lost signal to thread 3150
W20260709 13:16:06.283473  3820 debug-util.cc:398] Leaking SignalData structure 0x7b0800326f40 after lost signal to thread 3151
W20260709 13:16:06.284816  3820 debug-util.cc:398] Leaking SignalData structure 0x7b0800395820 after lost signal to thread 3224
W20260709 13:16:06.285120  3820 debug-util.cc:398] Leaking SignalData structure 0x7b0800225b80 after lost signal to thread 3225
I20260709 13:16:06.285799  3119 raft_consensus.cc:614] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:06.287328  3820 debug-util.cc:398] Leaking SignalData structure 0x7b08003d04a0 after lost signal to thread 3823
W20260709 13:16:06.287810  3820 debug-util.cc:398] Leaking SignalData structure 0x7b080040d2c0 after lost signal to thread 3824
I20260709 13:16:06.266690  3045 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:16:06.290828  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:06.291652  3045 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
W20260709 13:16:06.294412  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:06.269032  3118 rpcz_store.cc:269] 0709 13:16:03.866312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.881466 (+ 15154us) service_pool.cc:224] Handling call
0709 13:16:05.918663 (+2037197us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b5400319a54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:05.918792 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4095187712}
W20260709 13:16:06.267596  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 348837us
I20260709 13:16:05.994603  6645 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:06.297853  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 1991) took 2316 ms. Trace:
I20260709 13:16:06.299286  3090 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:06.299638  2948 catalog_manager.cc:5697] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:06.296219  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:06.278563  6488 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:06.211488  6897 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:16:06.332049  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.309908  3164 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:06.165293  6935 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:06.246562  6513 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:06.052302  6941 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.193581  6908 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:06.051819  6794 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.265077  6971 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:06.001866  6925 raft_consensus.cc:2764] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:16:05.934986  6894 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:06.423478  6894 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:06.301012  3042 rpcz_store.cc:276] 0709 13:16:03.981204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.985166 (+  3962us) service_pool.cc:224] Handling call
0709 13:16:04.010854 (+ 25688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:04.011105 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:04.741115 (+730010us) log.cc:844] Serialized 14 byte log entry
0709 13:16:06.297419 (+1556304us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:06.297483 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:06.297529 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.297592 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:06.297794 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4648,"raft.queue_time_us":33075,"thread_start_us":1505877,"threads_started":1,"wal-append.queue_time_us":108626,"wal-append.run_cpu_time_us":1427,"wal-append.run_wall_time_us":1006577}
I20260709 13:16:06.425132  6794 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.293136  6898 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.316902  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:06.386231  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 73117.7us
I20260709 13:16:06.427762  6794 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:06.203225  6624 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:16:06.429701  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.435866  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.431530  3045 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:16:06.329216  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.442605  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:06.322299  3119 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:06.445467  3194 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:06.270669  6893 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:06.446487  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 129679us
I20260709 13:16:06.279774  6724 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:06.389930  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.314774  6709 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.278510  6631 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:06.164441  6462 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.268337  6715 raft_consensus.cc:740] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:06.296741  6830 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.472819  3192 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:06.155165  6899 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:06.398406  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 88553.6us
I20260709 13:16:06.396987  2948 catalog_manager.cc:5697] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 1 to 8, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 8 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:06.279156  6906 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.401809  6589 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:06.402242  6766 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:06.167551  6896 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.285s
I20260709 13:16:06.403936  6684 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:06.293919  6904 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.405279  6758 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:06.407250  6513 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.407563  6776 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:06.395835  6897 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.409637  6938 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:06.270478  6947 consensus_queue.cc:1175] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "501fdf2af2bc4b0c971ae880e98f466b" responder_term: 10 status { last_received { term: 9 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:06.397536  6934 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.494067  6766 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.193696  6914 consensus_queue.cc:1059] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.220s
I20260709 13:16:06.411897  6959 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:06.399066  6935 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:06.416185  6981 log.cc:927] Time spent T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.227s	user 0.002s	sys 0.000s
I20260709 13:16:06.416767  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:06.418740  3197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:16:06.280390  6588 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:06.551059  3197 raft_consensus.cc:606] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:06.275602  6920 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:06.311180  6892 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:06.315373  6720 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:06.462493  3797 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 491) took 3557 ms. Trace:
I20260709 13:16:06.464233  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.296861  6661 consensus_queue.cc:1059] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.171s
I20260709 13:16:06.468670  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:06.564193  3045 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:06.469570  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:06.471400  3198 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:16:06.429706  6932 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:06.491132  6899 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.480192  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.401073  6662 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:06.482424  3164 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:06.483532  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:06.487742  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:06.571141  3050 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
W20260709 13:16:06.571168  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 88859.7us
I20260709 13:16:06.571777  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:06.572105  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:06.489444  2948 catalog_manager.cc:5697] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 4 to 7, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 7 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:06.494760  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.493474  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.573583  3194 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:16:06.574203  3762 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:06.496290  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.432132  6624 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:06.574745  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:06.494922  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.575956  3192 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:16:06.430073  6966 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.498487  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:06.554183  6920 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:06.434702  6941 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:06.482332  6488 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:06.501243  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 64587.2us
I20260709 13:16:06.504979  3119 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:06.506798  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:06.580623  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.581125  3123 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 9: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:06.581174  3196 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:06.582664  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:06.470363  6709 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.584246  6938 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:06.154666  6725 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:06.585975  6488 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:06.587126  6725 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:06.513438  3791 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:06.588382  6488 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:06.588732  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:06.493465  6969 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.589582  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:06.590039  6969 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:06.590790  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:06.591114  6624 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:06.591436  3119 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:06.580369  6896 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:06.592113  6969 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:06.592192  6896 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:06.592365  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:06.592695  6896 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:06.593039  3119 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:16:06.594064  3044 raft_consensus.cc:2393] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:06.442629  6908 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.595790  2948 catalog_manager.cc:5697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 6 to 7, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 7 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:06.517382  6766 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:06.469554  6462 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.516754  6715 consensus_queue.cc:260] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:06.597625  6715 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:06.520972  3792 raft_consensus.cc:1240] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:06.598699  3165 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:06.521071  6909 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.599493  3165 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:06.599587  6909 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.524214  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:06.600258  6684 consensus_queue.cc:1059] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:06.525554  3794 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:06.601146  6982 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:06.601440  6684 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:06.608232  6684 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:06.608682  6684 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:06.608868  6763 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:06.609553  6914 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:06.527308  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:06.528434  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:06.612699  3790 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:16:06.613312  6899 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:06.580770  6959 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:06.614092  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:06.615334  3119 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
W20260709 13:16:06.534070  6984 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.345s	user 0.000s	sys 0.003s
I20260709 13:16:06.585585  6709 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:06.535482  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:06.619293  3798 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 9: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:06.620263  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:06.620823  3798 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:16:06.482622  6830 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:06.620882  6766 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:06.622989  6830 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:06.623227  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:06.542527  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:06.624349  3117 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:16:06.625227  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:06.625938  3117 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 9: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:06.449510  3199 raft_consensus.cc:2393] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:06.551590  3197 raft_consensus.cc:614] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:06.541899  6898 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:06.554978  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:06.628851  3048 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:06.628988  6906 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:06.629848  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.541282  6845 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:06.630436  3193 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:16:06.565358  3195 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 8: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:06.563262  6589 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.559459  3797 rpcz_store.cc:276] 0709 13:16:02.891980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.892119 (+   139us) service_pool.cc:224] Handling call
0709 13:16:06.433889 (+3541770us) spinlock_profiling.cc:243] Waited 3.08 s on lock 0x7b5400629654. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:06.449648 (+ 15759us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7085870336}
I20260709 13:16:06.631294  6589 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:06.489842  3015 connection.cc:256] RPC call timeout handler was delayed by -1.8334980059998998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
W20260709 13:16:06.632762  3015 connection.cc:256] RPC call timeout handler was delayed by -1.4104980059998979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
I20260709 13:16:06.633881  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:06.635052  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:06.635705  3042 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:06.577178  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:06.568107  3091 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:06.574775  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.578821  3043 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:06.559680  6892 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.578799  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:06.656488  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:06.663023  3045 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:06.665164  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:06.583431  3050 raft_consensus.cc:2410] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:06.583411  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:06.582173  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:06.669101  3123 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:06.585569  6989 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.579389  6932 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:06.521660  6934 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.601935  6776 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:06.602274  6918 raft_consensus.cc:3055] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:06.526674  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:06.523463  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:06.673233  3122 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 9: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:06.606570  6941 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:06.516036  6634 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:06.607091  6904 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:06.607594  6982 raft_consensus.cc:697] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:06.597213  2948 catalog_manager.cc:5697] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:06.629722  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:06.635960  6766 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:06.636200  3196 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:06.636535  6684 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.639536  6462 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:06.531906  6897 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:06.640774  6969 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:06.641695  6940 raft_consensus.cc:3055] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:16:06.577580  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 126993us
I20260709 13:16:06.710413  3090 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:06.711587  3090 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:06.708879  6940 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:06.698132  6624 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:06.646983  3799 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:06.650297  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:06.650822  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:06.716212  3042 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:16:06.660393  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:06.717592  3123 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:06.658023  3198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:16:06.719586  3198 raft_consensus.cc:606] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:06.658223  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:06.658406  3165 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:06.458256  6893 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:06.720446  3049 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:16:06.659797  3194 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:16:06.673264  3044 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:06.720837  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 62513.5us
W20260709 13:16:06.672094  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 108674us
I20260709 13:16:06.722115  3046 raft_consensus.cc:2393] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 10: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:06.672981  3796 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
W20260709 13:16:06.673693  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 90339us
I20260709 13:16:06.681929  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:06.730211  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 48490.2us
I20260709 13:16:06.731156  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:06.698378  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:06.633240  6896 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.700034  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:06.647531  6513 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:06.649503  6814 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:06.682646  6845 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:06.672708  6918 raft_consensus.cc:740] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:06.755191  6918 consensus_queue.cc:260] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:06.745682  6488 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:06.756491  6918 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:06.756793  6488 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.757206  6488 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:06.655344  6909 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:06.704665  2948 catalog_manager.cc:5697] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:06.763577  2948 catalog_manager.cc:5697] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 3 to 5, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 5 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:06.706853  3048 raft_consensus.cc:3055] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:06.576740  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:06.766607  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 189899us
I20260709 13:16:06.767642  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:06.768399  6898 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:06.768661  6709 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:06.769452  6709 raft_consensus.cc:697] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:06.769537  6938 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:06.770792  6959 raft_consensus.cc:3055] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:06.771212  6959 raft_consensus.cc:740] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:06.770846  6709 consensus_queue.cc:237] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:06.772197  3164 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:06.772111  6959 consensus_queue.cc:260] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:06.772995  6899 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:06.773319  6959 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:06.682760  6910 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:06.698000  6989 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.714569  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:06.774170  3164 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:06.733112  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:06.774530  3122 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:16:06.774962  3120 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:16:06.775507  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:06.775898  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:06.776180  3122 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:16:06.670261  6892 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:06.733711  6634 consensus_queue.cc:1048] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:06.708676  6969 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:06.781500  6969 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:06.782119  6754 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:06.752522  6845 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.783332  6845 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:06.787027  6896 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:06.797618  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:06.798362  3049 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:16:06.799295  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:06.800288  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:06.800100  6724 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.715220  6624 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:06.738090  6934 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:06.801967  3047 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:06.801988  6624 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:06.803857  3044 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:06.804747  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 587) took 1144 ms. Trace:
I20260709 13:16:06.806386  6914 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.806843  6914 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:06.738528  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:06.808445  3046 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:06.809516  3046 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:06.745553  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:06.811995  3119 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:06.738312  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:06.813017  3042 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:06.746639  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.748706  3050 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:06.749518  3165 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:16:06.815599  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 66154.2us
I20260709 13:16:06.817665  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:06.818580  3194 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:06.753607  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:06.639554  6589 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:06.745640  6941 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:06.825762  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 72162.1us
I20260709 13:16:06.774317  3048 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:06.775036  6899 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:06.733951  6908 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:06.835438  3194 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:06.719485  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:06.747563  6766 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:06.747958  6776 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:06.746143  6830 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:06.779434  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:06.714285  6940 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.841027  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:06.790341  6969 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.790705  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:06.761651  6513 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:16:06.829939  6934 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:06.793147  2948 catalog_manager.cc:5697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:06.734673  6982 consensus_queue.cc:237] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:06.794780  6462 consensus_queue.cc:1059] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:06.809906  6897 consensus_queue.cc:1059] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:06.745004  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:06.801412  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:06.822216  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.739869  6920 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:06.842674  6924 raft_consensus.cc:3055] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:06.824595  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:06.761458  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:06.777173  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:06.837271  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.839305  3761 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:06.839432  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:06.840224  3090 connection.cc:256] RPC call timeout handler was delayed by -1.6193503869999404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2791s for a response
I20260709 13:16:06.824576  3762 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:06.840539  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:06.838856  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.864827  3191 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:16:06.828683  3048 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:06.843122  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.782130  6684 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:06.846161  3123 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
W20260709 13:16:06.846381  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 66988.5us
I20260709 13:16:06.865759  3048 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:06.838827  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:06.788682  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:06.867449  3194 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 9: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:06.867532  3117 raft_consensus.cc:2376] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10. Re-sending same reply.
I20260709 13:16:06.868284  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.868523  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:06.849994  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.827220  6896 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:06.828002  6941 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:16:06.856956  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 112015us
I20260709 13:16:06.919811  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:06.842056  6589 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:06.805240  3047 rpcz_store.cc:276] 0709 13:16:05.660726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.669829 (+  9103us) service_pool.cc:224] Handling call
0709 13:16:05.670184 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:06.802582 (+1132398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.804456 (+  1874us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000c5654. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:06.804677 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2602343168}
I20260709 13:16:06.929894  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:06.848362  6725 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.862406  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:06.929647  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 60495.5us
I20260709 13:16:06.842299  6848 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:06.862669  2948 catalog_manager.cc:5697] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 6 to 7, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 7 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:06.880846  6947 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:06.916258  6896 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.864048  3120 raft_consensus.cc:2393] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:06.849967  3126 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:06.868440  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:06.847054  6776 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:06.835608  6898 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:16:06.899442  6920 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:06.850544  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.993615  3200 raft_consensus.cc:1275] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:06.850674  6985 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.873824  6987 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:06.869174  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 44709.7us
I20260709 13:16:06.855150  6934 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.991088  3196 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13. Ops: []
W20260709 13:16:06.944209  3164 connection.cc:256] RPC call timeout handler was delayed by -1.2269363450000128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 13:16:06.883625  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.897166  6932 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:16:06.901083  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.901182  6766 raft_consensus.cc:3055] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:06.864156  6966 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:06.904172  6989 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:06.904670  6588 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.852629  6661 consensus_queue.cc:1059] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:16:06.895776  6899 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:16:06.905931  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.907181  6969 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:06.856242  6935 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:06.908141  3193 raft_consensus.cc:1275] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:06.908896  6893 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:06.909981  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:06.856528  6980 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:06.911330  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:06.880986  6894 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:16:06.913110  3122 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:06.913439  3043 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:06.881402  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:06.917670  3119 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:06.918241  3199 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:06.863586  6924 raft_consensus.cc:740] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:06.930569  3125 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 6.
I20260709 13:16:06.935457  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:16:07.072036  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 136673us
I20260709 13:16:07.064692  2948 catalog_manager.cc:5697] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:06.934798  3090 connection.cc:256] RPC call timeout handler was delayed by -1.3602249770001436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
I20260709 13:16:06.990051  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:07.073076  3090 connection.cc:256] RPC call timeout handler was delayed by -1.2666249769999922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
I20260709 13:16:06.990537  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:07.073288  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:06.877570  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:06.896878  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.998350  6766 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:07.000515  6776 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:06.872412  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:07.075124  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 202803us
I20260709 13:16:07.007256  6588 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:06.996003  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:06.996073  3191 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:06.930341  6941 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:07.087966  3120 raft_consensus.cc:2410] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:16:07.089126  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:07.001873  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:06.938709  6725 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.090313  3790 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:06.895795  6684 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:16:06.997408  6987 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.091833  6725 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.092103  6987 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:06.938571  6589 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.093314  6766 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.094566  6766 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:07.095024  6589 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:07.099552  6794 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:07.101929  6906 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:07.102249  7002 log.cc:927] Time spent T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.171s	user 0.000s	sys 0.003s
I20260709 13:16:07.102484  6906 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.104035  6776 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.104696  6906 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.105911  6488 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.106293  6776 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:07.108381  3050 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:07.108445  6488 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.005856  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:07.005564  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:07.110697  3193 raft_consensus.cc:1240] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:07.005553  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:07.111533  3192 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:07.111956  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:07.112339  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:07.112640  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.112854  3051 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.113122  3192 raft_consensus.cc:2410] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:07.114056  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:07.114586  3192 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:07.115425  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:07.116149  3798 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 9: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:07.116421  3192 raft_consensus.cc:1240] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:07.117609  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:07.117810  6724 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:07.118234  3124 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:16:07.119243  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:07.120285  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:07.120846  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:07.120549  6845 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.122649  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:07.123395  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:07.124035  3194 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:07.124442  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:07.125665  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:07.062839  6513 consensus_queue.cc:1059] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:16:07.126309  3125 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:07.126643  6513 raft_consensus.cc:3055] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:07.127048  6513 raft_consensus.cc:740] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:07.127192  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:07.127825  3125 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:07.127998  6513 consensus_queue.cc:260] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.082095  6920 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:07.007045  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.130280  6920 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.130700  6920 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:07.131295  6940 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.052750  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.938297  6970 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:07.132102  3196 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:07.051712  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:07.055596  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:07.112587  3193 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 6.
I20260709 13:16:06.946689  6709 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
I20260709 13:16:06.938421  6897 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.134584  3047 raft_consensus.cc:1275] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:07.134176  2948 catalog_manager.cc:5697] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.135201  3761 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:06.991094  6971 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.075s
W20260709 13:16:07.073567  3090 connection.cc:256] RPC call timeout handler was delayed by -1.18652497700009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
W20260709 13:16:07.142993  3090 connection.cc:256] RPC call timeout handler was delayed by -1.1064249769999606s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
I20260709 13:16:07.008637  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:06.995172  3117 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 12: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:07.079157  3118 raft_consensus.cc:2410] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:07.080019  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:06.935231  6903 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 1, Time since last communication: 0.123s
I20260709 13:16:07.110800  3793 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:06.992638  6662 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 13:16:07.121063  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:07.151294  3122 raft_consensus.cc:2410] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:16:07.131389  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:07.120815  3124 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:07.125458  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:07.008266  6910 raft_consensus.cc:3055] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:07.158738  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:07.159350  3051 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:07.174160  3195 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.175154  3117 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:07.177026  3117 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:07.136495  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:07.008460  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:07.136929  3120 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:07.182618  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 46307.2us
I20260709 13:16:07.051333  6966 raft_consensus.cc:697] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:07.138599  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:06.990718  6848 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.129465  6513 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:07.002890  6985 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:06.989818  6896 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.141543  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:06.999043  6934 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:07.003628  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:07.008870  6986 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:06.938215  6947 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.144594  3090 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:07.205201  3794 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:07.150408  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 64087.4us
I20260709 13:16:07.153689  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:07.153961  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:07.155145  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:07.079151  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:07.184198  3125 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:07.209672  3193 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:16:07.096328  6924 consensus_queue.cc:260] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.185093  3792 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:07.186424  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:07.186465  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:07.133553  6969 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:07.193277  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:07.193986  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:07.196429  3196 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:07.199555  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:07.201174  3124 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:07.203177  3118 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:07.147064  2948 catalog_manager.cc:5697] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 3 to 7, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 7 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.145978  6935 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:07.206333  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:16:07.215473  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 60449.1us
I20260709 13:16:07.230695  3120 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:07.231220  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:07.231761  3122 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 11. Ops: [9.5-9.5]
I20260709 13:16:07.159125  6910 raft_consensus.cc:740] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:07.266561  3125 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:07.268174  6982 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:07.219280  3191 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
W20260709 13:16:07.226497  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.232333  3164 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:07.272320  3164 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:07.215745  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:07.233176  6969 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:07.274070  6969 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:07.274422  6959 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:07.221865  6947 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:07.274981  6959 raft_consensus.cc:697] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:07.276051  6959 consensus_queue.cc:237] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.227969  3797 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:07.274073  3051 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:07.234429  6916 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.234975  6938 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:07.235630  3124 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:07.236330  2948 catalog_manager.cc:5697] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:07.228580  6814 consensus_queue.cc:1059] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:16:07.228368  6909 consensus_queue.cc:1059] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:16:07.216300  6634 raft_consensus.cc:2764] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:16:07.150250  6897 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.191145  6624 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.228777  6990 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:07.252081  6966 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.200400  6725 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:07.265610  3047 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:07.268260  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 123768us
I20260709 13:16:07.273413  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:07.265370  3200 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
W20260709 13:16:07.281708  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 66070.1us
I20260709 13:16:07.140574  3043 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:07.289672  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:07.297339  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 224100us
I20260709 13:16:07.194550  6918 consensus_queue.cc:1059] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:16:07.318132  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:07.318617  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 45266.4us
I20260709 13:16:07.321178  3164 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:07.201340  6908 consensus_queue.cc:1059] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:16:07.265978  6935 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.324318  6935 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:07.288633  6830 consensus_queue.cc:1059] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:16:07.326452  6848 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.323609  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:07.327054  6848 raft_consensus.cc:3055] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:07.327477  6848 raft_consensus.cc:740] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:07.327987  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:07.328236  6488 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:07.328697  6488 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:07.328855  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:07.329149  6488 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:07.330611  6971 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:07.330847  6985 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:07.331354  6971 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:07.331802  6971 raft_consensus.cc:697] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:07.332518  6662 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:07.332983  6662 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:07.332683  6971 consensus_queue.cc:237] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.333396  6662 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:07.334579  6932 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:07.335003  6932 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.335327  6932 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:07.338377  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.338748  6969 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.339936  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:07.340550  3191 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:07.278519  6709 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:07.345639  6897 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:07.345772  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:07.350666  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:07.351006  6892 consensus_meta.cc:287] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.561s	user 0.006s	sys 0.003s
I20260709 13:16:07.351359  3199 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:07.351464  6892 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.352664  3121 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:16:07.353854  6845 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.356683  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:07.358083  6918 raft_consensus.cc:3055] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:07.357965  6910 consensus_queue.cc:260] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.358517  6918 raft_consensus.cc:740] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:07.358760  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:07.359064  6910 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:07.359375  6918 consensus_queue.cc:260] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.351866  3191 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:07.360644  6918 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:07.360378  6935 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.362421  3125 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:07.362598  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:07.363225  3118 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:07.289055  6904 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:16:07.364315  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:07.364457  6935 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.364627  6990 raft_consensus.cc:697] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:16:07.365779  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 44659.1us
I20260709 13:16:07.366144  6725 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.366730  3164 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:07.366812  6908 raft_consensus.cc:3055] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:07.367481  6908 raft_consensus.cc:740] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:16:07.368585  3048 consensus_meta.cc:287] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.000s
I20260709 13:16:07.368301  6908 consensus_queue.cc:260] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.368758  7009 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:07.368444  6725 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.369232  7009 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.369518  6908 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:07.369699  7009 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.371011  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:07.365887  6684 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:07.372392  6894 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:07.372774  6894 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.373095  6894 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.373636  3794 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:07.294363  6916 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.375241  3126 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:07.375854  6916 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:07.376818  3195 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:07.377908  3791 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:07.378847  6969 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.377549  3193 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: [8.4-10.5]
W20260709 13:16:07.381019  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 66631.1us
I20260709 13:16:07.381567  3793 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:07.283470  6899 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:16:07.383910  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:07.385470  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:07.385969  3042 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:07.387017  6624 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.369232  3048 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
W20260709 13:16:07.388353  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 71805.3us
I20260709 13:16:07.388970  3048 pending_rounds.cc:85] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 9
I20260709 13:16:07.390071  3048 pending_rounds.cc:107] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 13:16:07.390501  3761 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:07.390784  3048 raft_consensus.cc:2889] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:07.390172  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:07.389551  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:07.393553  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:07.392169  3761 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:07.405253  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:07.407889  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:07.419381  3046 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.014s	sys 0.037s
W20260709 13:16:07.419953  3046 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.014s	sys 0.037s
I20260709 13:16:07.357223  6588 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.424975  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:07.222530  6986 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.317975  6938 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:16:07.405164  6914 consensus_meta.cc:287] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.000s
I20260709 13:16:07.428736  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:07.353627  6892 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:07.433826  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:07.404492  6724 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:16:07.435763  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 120122us
I20260709 13:16:07.419145  6589 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.423748  6754 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:07.437021  3121 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:07.452405  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:07.453150  3121 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:07.421446  6916 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:07.419665  6909 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:07.415868  6969 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:07.442334  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 208387us
I20260709 13:16:07.421103  6624 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:07.369515  6941 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.445007  3090 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:07.449029  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:07.449774  3122 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:07.426895  6725 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:07.404706  6906 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:16:07.431916  6814 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:07.436478  3164 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:07.498932  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 63765.7us
I20260709 13:16:07.474925  6904 consensus_queue.cc:1059] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:16:07.444098  6914 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.455084  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:07.462532  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:07.494095  6898 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:07.437922  6662 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:07.462553  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:07.472870  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.501286  3790 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:07.375896  6920 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.451071  6754 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:07.482758  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:07.530468  3797 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:07.442242  6940 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:07.427733  6488 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.494467  3121 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:07.493697  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:07.538158  3193 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:07.507527  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:07.515317  3120 raft_consensus.cc:2410] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:16:07.516310  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 71375.1us
I20260709 13:16:07.500075  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:07.478014  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:07.456907  6916 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.500727  3199 raft_consensus.cc:2410] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:16:07.544457  3090 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:07.523619  3198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.004s	sys 0.081s
W20260709 13:16:07.547143  3198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.005s	sys 0.081s
I20260709 13:16:07.480554  6969 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.539489  3049 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:07.450810  6589 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.490264  6624 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.543004  3124 raft_consensus.cc:2410] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:16:07.528483  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:07.557152  3042 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:07.500499  6918 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:07.365644  6990 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:07.550817  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 50881.5us
I20260709 13:16:07.592032  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:07.593003  6959 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:07.594502  3164 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:07.550526  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:07.502285  6904 raft_consensus.cc:3055] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:07.502569  6845 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:16:07.576417  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 171247us
I20260709 13:16:07.536270  6754 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:07.581861  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:07.509835  7009 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:07.595584  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 45150.3us
I20260709 13:16:07.544520  6462 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.549937  6916 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.607350  6904 raft_consensus.cc:740] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:07.549229  6969 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:07.551781  6814 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:16:07.613044  3042 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:07.503877  6987 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.579264  6624 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:07.618423  3164 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:07.667290  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 48984.2us
I20260709 13:16:07.668432  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:07.556439  6766 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:07.624019  3090 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:07.578508  6684 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:07.543869  6985 consensus_queue.cc:1059] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:16:07.590378  6897 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.625649  6918 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:07.643548  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:07.613528  6989 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:07.672777  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 49002.1us
W20260709 13:16:07.642843  7008 log.cc:927] Time spent T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:16:07.616366  6662 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.684166  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:07.672955  3042 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:07.676537  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:07.685339  3164 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:07.677328  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:07.611485  6935 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:16:07.683065  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:07.685515  3200 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:07.688339  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:07.676888  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:07.650983  6488 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.651320  6588 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.557446  6938 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.700871  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:07.681591  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:07.672091  6959 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:07.706830  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:07.706312  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:07.752728  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:07.674108  6989 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.755074  6989 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:07.700922  6894 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.757120  6894 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:07.719112  3791 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:07.682395  6845 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:07.673929  6899 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:16:07.753810  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 68558.5us
W20260709 13:16:07.752821  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 44711.8us
I20260709 13:16:07.641585  6947 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:07.771409  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 89916.4us
I20260709 13:16:07.682624  6914 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.781325  3200 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:07.633271  6462 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:07.761906  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.784255  6893 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:07.693285  6982 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 13:16:07.690233  7024 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:07.810534  7024 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:07.810935  7024 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:07.814934  6462 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.816018  7009 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:07.827914  6940 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:07.701188  6971 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:07.790350  3164 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:07.829200  3795 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:07.758447  6985 raft_consensus.cc:2764] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:16:07.813535  3792 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:07.801765  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:07.781603  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:07.785984  6488 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:07.807896  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2032) took 1075 ms. Trace:
I20260709 13:16:07.810058  6987 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.786027  6986 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:07.682595  6897 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.830565  3164 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:07.834108  3044 rpcz_store.cc:276] 0709 13:16:06.732374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.858097 (+125723us) service_pool.cc:224] Handling call
0709 13:16:06.858363 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.859481 (+  1118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.859527 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:06.869782 (+ 10255us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.078409 (+208627us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:07.078447 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.078516 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.807581 (+729065us) raft_consensus.cc:1685] finished
0709 13:16:07.807612 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.807803 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":792,"raft.queue_time_us":911,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":32928,"thread_start_us":144269,"threads_started":1,"wal-append.queue_time_us":516139}
I20260709 13:16:07.840938  3193 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:07.837312  6588 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:07.795570  6894 consensus_queue.cc:1059] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:16:07.843631  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:07.826308  6920 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:07.831609  7009 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:07.836078  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:07.813522  6896 consensus_meta.cc:287] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.000s
W20260709 13:16:07.834623  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 53125.5us
W20260709 13:16:07.850428  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet bbb23f9b807d45969a33e8f37691eff6: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:07.825212  6754 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.852092  3090 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:07.853020  6631 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:07.853802  6631 consensus_queue.cc:1048] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:07.854279  3090 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:07.844481  6986 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:07.817365  6932 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.799858  6709 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:16:07.837637  6971 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:07.894466  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:07.786887  6845 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:07.753494  6904 consensus_queue.cc:260] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.899778  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:07.901140  3792 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:07.848958  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:07.869180  6916 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.855154  6896 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:07.863703  7017 log.cc:927] Time spent T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:16:07.864636  7014 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 13:16:07.855607  6488 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:16:07.867542  6932 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:07.837498  6634 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.014s
W20260709 13:16:07.868175  7011 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
W20260709 13:16:07.868959  6934 consensus_meta.cc:287] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.002s
I20260709 13:16:07.871691  6754 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.859699  6662 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:16:07.872409  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.857676  6966 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:16:07.873538  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:07.874786  3797 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:07.878047  6897 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.924988  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:07.881867  7021 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.385s	user 0.000s	sys 0.003s
I20260709 13:16:07.881937  6986 raft_consensus.cc:697] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:07.923292  6989 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:07.884327  6910 consensus_meta.cc:287] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.525s	user 0.006s	sys 0.001s
I20260709 13:16:07.884145  6969 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:07.876001  6970 consensus_meta.cc:287] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.744s	user 0.008s	sys 0.002s
I20260709 13:16:07.886044  6947 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.890519  6589 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.857313  3090 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:07.825965  7024 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.855275  7040 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:07.858755  6920 consensus_queue.cc:1059] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:16:07.903569  6845 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:07.920101  3197 raft_consensus.cc:2368] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11.
I20260709 13:16:07.920428  3791 raft_consensus.cc:2393] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:07.922461  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:07.878830  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:07.974105  3050 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.931533  6916 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.937291  6969 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:07.979017  7040 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.979530  7024 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.979595  7040 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.919782  6725 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:07.981244  6725 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.923542  6934 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.981668  6725 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.982308  7040 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.982406  3794 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:16:07.978091  6845 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.983518  6934 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:07.926090  6662 consensus_queue.cc:1243] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 9.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:07.930265  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2027) took 1310 ms. Trace:
I20260709 13:16:07.928777  3792 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:07.931284  3044 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:07.985419  6845 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:07.936625  3797 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:07.986244  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:07.986979  3044 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.990183  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:07.930370  6624 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.991433  6985 raft_consensus.cc:3055] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:07.991989  6985 raft_consensus.cc:740] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:16:07.993027  7015 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.347s	user 0.000s	sys 0.002s
I20260709 13:16:07.993506  3048 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:07.994061  7025 log.cc:927] Time spent T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.352s	user 0.000s	sys 0.002s
I20260709 13:16:07.994522  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1884) took 1457 ms. Trace:
W20260709 13:16:07.933722  7026 log.cc:927] Time spent T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:16:07.965461  6899 raft_consensus.cc:697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:07.994911  3119 rpcz_store.cc:276] 0709 13:16:06.537228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.160059 (+622831us) service_pool.cc:224] Handling call
0709 13:16:07.175440 (+ 15381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.176521 (+  1081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.176552 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.191188 (+ 14636us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.491306 (+300118us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:07.491352 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.491422 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.992329 (+500907us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:07.994229 (+  1900us) raft_consensus.cc:1685] finished
0709 13:16:07.994250 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.994464 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90,"raft.queue_time_us":178,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":7456,"spinlock_wait_cycles":40728192,"thread_start_us":202529,"threads_started":1,"wal-append.queue_time_us":390963}
I20260709 13:16:07.997022  6899 consensus_queue.cc:237] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:07.984539  3046 rpcz_store.cc:276] 0709 13:16:06.619593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.813037 (+193444us) service_pool.cc:224] Handling call
0709 13:16:06.813309 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.827012 (+ 13703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.827054 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:06.836501 (+  9447us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.422044 (+585543us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:07.427093 (+  5049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.427189 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.930084 (+502895us) raft_consensus.cc:1685] finished
0709 13:16:07.930102 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.930210 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11184,"raft.queue_time_us":19073,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":5763,"thread_start_us":565495,"threads_started":1,"wal-append.queue_time_us":644777}
I20260709 13:16:07.936959  6589 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:08.002861  6589 raft_consensus.cc:697] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:08.003823  6589 consensus_queue.cc:237] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:08.004841  3044 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:08.006667  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:08.007778  3043 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:07.933646  6989 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:07.992956  6624 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:08.013311  3050 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:07.934052  3042 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:07.934994  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 77761us
I20260709 13:16:07.907644  7010 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:16:07.997690  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1891) took 1458 ms. Trace:
W20260709 13:16:07.939836  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 45456.2us
I20260709 13:16:08.017424  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:08.017681  3117 rpcz_store.cc:276] 0709 13:16:06.539316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.178490 (+639174us) service_pool.cc:224] Handling call
0709 13:16:07.178837 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.224399 (+ 45562us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:07.541204 (+316805us) log.cc:844] Serialized 14 byte log entry
0709 13:16:07.629425 (+ 88221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:07.630460 (+  1035us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:07.630520 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.997469 (+366949us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b54003e7954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:07.997511 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.997635 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":404877,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":259,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":14655,"spinlock_wait_cycles":233642752,"thread_start_us":343893,"threads_started":2,"wal-append.queue_time_us":141593}
I20260709 13:16:08.021008  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:08.000841  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 569) took 1492 ms. Trace:
I20260709 13:16:08.001871  6513 raft_consensus.cc:3055] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:08.021766  3762 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:08.025882  3762 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:08.001502  6848 consensus_queue.cc:260] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:07.932926  6970 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:07.991513  6894 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:08.032752  3199 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:08.027324  3090 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:07.908123  6971 raft_consensus.cc:697] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:08.023190  3123 rpcz_store.cc:276] 0709 13:16:06.508563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.160677 (+652114us) service_pool.cc:224] Handling call
0709 13:16:07.174895 (+ 14218us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.175923 (+  1028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.175949 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.176393 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.565132 (+388739us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:07.794018 (+228886us) log.cc:844] Serialized 14 byte log entry
0709 13:16:07.799095 (+  5077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.799573 (+   478us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.933153 (+133580us) spinlock_profiling.cc:243] Waited 6.55 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:07.998083 (+ 64930us) raft_consensus.cc:1685] finished
0709 13:16:08.000567 (+  2484us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.000754 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70416,"prepare.queue_time_us":83617,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":8493,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":9241,"spinlock_wait_cycles":16604672,"thread_start_us":439995,"threads_started":2,"wal-append.queue_time_us":627028}
I20260709 13:16:08.027611  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:08.030158  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:08.037159  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:08.037725  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:07.990701  6896 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:08.034307  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:08.030813  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:08.035449  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:08.036347  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:08.037840  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:08.034309  3090 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:08.034217  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:08.076098  6932 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.042773  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:08.080051  6932 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:08.060256  3090 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:08.029250  6766 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:08.076424  3198 raft_consensus.cc:2393] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 12: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:08.078342  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:08.087076  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:08.081365  7040 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:08.088464  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:08.029232  6989 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:07.992890  6709 consensus_queue.cc:1059] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:16:08.024638  6513 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:07.932288  6986 consensus_queue.cc:237] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:08.031872  6947 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:08.032208  6990 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:08.117416  3124 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:08.126170  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.120240  6588 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:08.128477  6932 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:08.130117  6624 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:16:08.131758  6513 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:08.133055  6513 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:08.133883  6589 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.134455  6589 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:08.135782  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2179) took 1294 ms. Trace:
I20260709 13:16:08.136186  3197 rpcz_store.cc:276] 0709 13:16:06.841788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.876619 (+ 34831us) service_pool.cc:224] Handling call
0709 13:16:08.135583 (+1258964us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b5400035054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:08.135717 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1951910144}
I20260709 13:16:08.136961  6589 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:08.090592  6848 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:08.140547  6776 raft_consensus.cc:3055] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:08.141009  6776 raft_consensus.cc:740] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:08.141949  6941 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:08.142108  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:08.143005  3791 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 8: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:08.142882  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:08.143728  7018 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.451s	user 0.001s	sys 0.001s
I20260709 13:16:08.145044  3791 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:08.145804  6709 raft_consensus.cc:3055] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:08.146291  6709 raft_consensus.cc:740] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:08.147178  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:08.147511  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:08.148453  3791 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 7: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:08.149145  3126 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:08.150585  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:08.114065  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:08.137512  6901 raft_consensus.cc:3055] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:08.151394  6901 raft_consensus.cc:740] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:08.152012  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:08.152328  6901 consensus_queue.cc:260] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:08.153235  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:08.153913  3120 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:08.154383  6896 consensus_queue.cc:1059] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:16:08.037992  7012 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.235s	user 0.002s	sys 0.000s
I20260709 13:16:08.039098  6845 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:08.152726  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:08.091225  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:08.150808  7044 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.156837  3791 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:08.143671  3122 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:16:08.157478  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:08.173142  3794 raft_consensus.cc:2368] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10.
I20260709 13:16:08.175923  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:08.176410  3120 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:08.115934  6631 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:08.182278  3046 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:08.170534  3090 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:08.108448  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:08.167482  3121 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:08.077184  6894 raft_consensus.cc:697] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:08.187480  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:08.188184  3790 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:08.153509  6901 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:08.176935  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:08.178472  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:08.189381  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:08.178712  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 51802us
I20260709 13:16:08.190171  3044 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:08.191205  3195 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:08.179008  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:08.137504  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:07.992894  6985 consensus_queue.cc:260] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:08.179627  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:08.198181  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:08.123631  6766 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.181098  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:08.121351  6970 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:08.210209  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:08.206808  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:08.186288  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:08.189254  3048 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:08.212127  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:08.212275  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:08.212785  3048 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:08.213090  3194 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
W20260709 13:16:08.149175  7030 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.321s	user 0.002s	sys 0.000s
I20260709 13:16:08.201714  3047 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:08.204399  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:08.205147  3046 raft_consensus.cc:2393] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:08.206043  3198 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:08.206811  3199 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:08.223526  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:08.155347  6896 raft_consensus.cc:3055] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:08.147218  6709 consensus_queue.cc:260] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:08.208473  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:08.209262  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:08.211055  3796 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:08.163023  6845 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.223984  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:08.233071  3199 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:08.234431  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:08.192495  6985 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:08.238386  3165 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:08.186288  3761 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:08.216696  3791 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:08.217365  3124 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:16:08.217829  3049 raft_consensus.cc:1240] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:08.243258  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 57069.2us
I20260709 13:16:08.218549  3050 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:08.244015  3761 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:08.212209  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:08.225594  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:08.245826  3194 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:08.176949  6990 raft_consensus.cc:697] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:08.181681  6631 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.190948  6924 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:08.201117  7022 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
I20260709 13:16:08.208586  6766 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:08.272056  3048 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:08.222281  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:08.227615  3045 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
W20260709 13:16:08.273272  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 51075.1us
W20260709 13:16:08.199215  6903 consensus_queue.cc:1175] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aaf88538197a49adb8bcf3790309a67e" responder_term: 7 status { last_received { term: 7 index: 5 } last_committed_idx: 4 last_received_current_leader { term: 7 index: 5 } }
I20260709 13:16:08.180863  7044 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:08.251219  3199 raft_consensus.cc:2393] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:08.255883  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:08.262665  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:08.181023  6947 raft_consensus.cc:697] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:08.323060  3194 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:16:08.323537  3796 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:16:08.237704  6970 raft_consensus.cc:697] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:08.336176  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:08.259618  6661 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:08.208529  6898 consensus_queue.cc:1059] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:16:08.238410  6845 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:08.299006  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:08.226699  6896 raft_consensus.cc:740] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:16:08.331472  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 68886.3us
W20260709 13:16:08.332530  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.231419  6624 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:08.178635  6776 consensus_queue.cc:260] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:08.253121  6940 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:08.272337  6631 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:08.355832  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 185386us
I20260709 13:16:08.324875  6932 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:08.277027  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:08.226296  6684 consensus_queue.cc:1059] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.097s
W20260709 13:16:08.355875  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 155067us
I20260709 13:16:08.295274  6920 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:08.343786  3194 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:08.344264  3199 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 7: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:08.290890  6588 raft_consensus.cc:2764] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:16:08.325685  6709 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:08.342628  3193 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:16:08.370887  3195 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:08.295468  7010 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:16:08.342896  7031 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:08.372841  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:08.375084  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:08.371181  3091 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:08.345934  7040 raft_consensus.cc:697] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:08.297837  6969 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:16:08.382786  3124 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:08.249444  6971 consensus_queue.cc:237] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:08.391373  3090 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:08.366044  6776 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:08.402335  3090 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:08.398504  3121 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:08.405541  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:08.406895  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:16:08.362802  6938 consensus_queue.cc:1175] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f20672b2852447a6bc1e137c4dd40904" responder_term: 12 status { last_received { term: 12 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 12 index: 6 } }
W20260709 13:16:08.418108  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:08.422103  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:08.422403  7046 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:16:08.423682  6989 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:08.401818  6588 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:08.424680  6588 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.425169  6588 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:08.429188  7040 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:08.383104  6684 consensus_queue.cc:1243] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 5.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:08.381879  6920 raft_consensus.cc:697] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:08.449802  3794 raft_consensus.cc:2410] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 13:16:08.449832  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:08.410472  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 172187us
W20260709 13:16:08.399478  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 122580us
I20260709 13:16:08.403656  6896 consensus_queue.cc:260] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:08.390010  7031 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.382711  6897 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:08.409825  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1998) took 1008 ms. Trace:
I20260709 13:16:08.451042  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:08.409220  3090 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:08.404196  7024 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:08.374356  7045 consensus_queue.cc:1059] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:16:08.452746  3125 rpcz_store.cc:276] 0709 13:16:07.401644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.401905 (+   261us) service_pool.cc:224] Handling call
0709 13:16:07.405775 (+  3870us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.425592 (+ 19817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.425638 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.439782 (+ 14144us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.558828 (+119046us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:07.558888 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.558986 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:08.154822 (+595836us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:08.395995 (+241173us) raft_consensus.cc:1685] finished
0709 13:16:08.396025 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.409759 (+ 13734us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12350,"raft.queue_time_us":12680,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":15843,"spinlock_wait_cycles":6043008,"thread_start_us":75956,"threads_started":1,"wal-append.queue_time_us":332304}
I20260709 13:16:08.447410  7009 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:16:08.474272  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 65173.9us
I20260709 13:16:08.360052  6894 consensus_queue.cc:237] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:08.483264  6985 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:08.484344  6985 consensus_queue.cc:1059] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:08.405349  6947 consensus_queue.cc:237] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:08.487668  6899 raft_consensus.cc:3055] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:08.488108  6899 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:16:08.486044  7034 log.cc:927] Time spent T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.655s	user 0.003s	sys 0.000s
I20260709 13:16:08.491629  3122 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:08.498353  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:08.499517  3125 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:08.371053  6990 consensus_queue.cc:237] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:08.454241  7031 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:08.501065  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 150576us
I20260709 13:16:08.471393  6896 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:08.453997  7056 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:08.452520  7055 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:08.581105  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 66296us
W20260709 13:16:08.600502  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.590657  6969 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:16:08.620832  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 169877us
I20260709 13:16:08.589926  6661 raft_consensus.cc:697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:08.448165  6970 consensus_queue.cc:237] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:08.639662  7024 raft_consensus.cc:697] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:08.640801  7024 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:08.489076  6899 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:08.642438  6899 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:08.471349  6897 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:08.607966  7047 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.371s	user 0.003s	sys 0.000s
W20260709 13:16:08.625272  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 124695us
I20260709 13:16:08.501012  7009 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:08.650401  7009 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:08.649286  6897 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:08.614745  7034 log.cc:927] Time spent T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:16:08.653915  3090 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:08.601091  7045 raft_consensus.cc:3055] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:08.691128  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:08.697877  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 44821.1us
I20260709 13:16:08.598219  7054 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:08.704226  3198 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:16:08.618320  6959 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:08.715444  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.635942  6982 raft_consensus.cc:3055] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:08.735821  3090 leader_election.cc:400] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11.
I20260709 13:16:08.748927  3090 leader_election.cc:403] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:16:08.710532  7014 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:16:08.752717  3090 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:08.755990  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:08.702852  7045 raft_consensus.cc:740] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:08.696995  6969 raft_consensus.cc:697] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:08.716216  7056 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:08.658525  6662 consensus_queue.cc:1059] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:16:08.739297  6982 raft_consensus.cc:740] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:16:08.792173  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:08.822378  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.707813  6624 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:16:08.873898  3090 leader_election.cc:400] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10.
I20260709 13:16:08.874660  3090 leader_election.cc:403] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:08.876606  3090 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:08.631317  6920 consensus_queue.cc:237] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:08.826539  3164 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:08.882388  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 55965.1us
I20260709 13:16:08.750764  6894 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.783615  7034 log.cc:927] Time spent T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:16:08.894994  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 204137us
I20260709 13:16:08.895961  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:08.738802  6959 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:08.824535  7040 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:08.822747  7054 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:08.895117  7009 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:08.906327  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:08.923796  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:08.925036  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:08.930318  7038 raft_consensus.cc:993] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b: : Instructing follower aaf88538197a49adb8bcf3790309a67e to start an election
W20260709 13:16:08.930604  6725 consensus_meta.cc:287] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.948s	user 0.010s	sys 0.001s
I20260709 13:16:08.930924  7038 raft_consensus.cc:1081] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Signalling peer aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:16:08.931124  6725 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:08.932480  6970 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:08.932744  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:08.933387  6725 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:08.933991  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:08.938755  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:08.937314  3120 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.000s	sys 0.008s
W20260709 13:16:08.908252  6631 consensus_meta.cc:287] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.542s	user 0.013s	sys 0.000s
W20260709 13:16:08.940001  3120 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.001s	sys 0.008s
I20260709 13:16:08.929215  6662 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:16:08.955472  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.934393  7059 consensus_queue.cc:1059] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:16:08.898152  6894 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:08.939241  7010 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:08.940022  6970 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:08.949014  6725 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:08.951036  6631 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:08.979434  6662 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.980070  6662 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:08.980656  7074 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.224s
W20260709 13:16:08.980989  6776 consensus_meta.cc:287] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.563s	user 0.006s	sys 0.002s
I20260709 13:16:08.981194  6631 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:08.981829  6631 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10.
I20260709 13:16:08.982546  7069 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.127s
I20260709 13:16:08.983485  6662 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:08.984071  7043 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:08.984876  7052 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:08.985570  7052 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:08.986644  3165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.000s	sys 0.016s
W20260709 13:16:08.987383  3165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.000s	sys 0.016s
W20260709 13:16:08.966589  6848 consensus_meta.cc:287] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.824s	user 0.006s	sys 0.006s
W20260709 13:16:08.988152  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 534832us
W20260709 13:16:08.998293  6766 consensus_meta.cc:287] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.002s
I20260709 13:16:08.998795  6766 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:08.999171  6894 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:08.999963  3121 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:08.893880  6661 consensus_queue.cc:237] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:08.996306  3165 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:16:09.011966  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.017369  3047 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:09.018285  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:09.026783  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:09.028564  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 1997) took 1627 ms. Trace:
I20260709 13:16:08.982565  6631 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:09.029162  3118 rpcz_store.cc:276] 0709 13:16:07.401303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.401793 (+   490us) service_pool.cc:224] Handling call
0709 13:16:07.474453 (+ 72660us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b5800003398. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff83538cfc0 00007ff835377929 00007ff8353773d2 00007ff82e8eebd4
0709 13:16:07.474873 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.475290 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:07.595651 (+120361us) log.cc:844] Serialized 14 byte log entry
0709 13:16:07.662361 (+ 66710us) log.cc:844] Serialized 14 byte log entry
0709 13:16:07.662558 (+   197us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.672410 (+  9852us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.672551 (+   141us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:07.672799 (+   248us) log.cc:844] Serialized 14 byte log entry
0709 13:16:07.682664 (+  9865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.689466 (+  6802us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.867143 (+177677us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b18001f6300. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c6522 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:16:08.018539 (+151396us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b18001f6300. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c6522 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:16:08.485250 (+466711us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:09.028285 (+543035us) raft_consensus.cc:1685] finished
0709 13:16:09.028315 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.028487 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8261,"prepare.queue_time_us":372034,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":91,"raft.queue_time_us":19642,"raft.run_cpu_time_us":420,"raft.run_wall_time_us":22876,"spinlock_wait_cycles":58951680,"thread_start_us":128368,"threads_started":2,"wal-append.queue_time_us":217754}
I20260709 13:16:08.993220  6724 raft_consensus.cc:3055] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:09.041360  3045 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:09.042600  3200 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:08.998313  7033 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 1.217s	user 0.004s	sys 0.039s
I20260709 13:16:09.046763  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:09.047165  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:09.047475  3043 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
W20260709 13:16:09.048427  7073 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:16:08.938930  7045 consensus_queue.cc:260] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.049691  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:08.951562  6969 consensus_queue.cc:237] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.002017  7083 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:09.034011  3047 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:35726
W20260709 13:16:09.081063  3199 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.028s	sys 0.017s
W20260709 13:16:09.086297  3199 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.028s	sys 0.018s
I20260709 13:16:09.011632  6776 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:09.032640  6631 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:09.103820  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47488 (request call id 623) took 1217 ms. Trace:
W20260709 13:16:09.100986  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 162386us
I20260709 13:16:09.104245  3042 rpcz_store.cc:276] 0709 13:16:07.886331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.924741 (+ 38410us) service_pool.cc:224] Handling call
0709 13:16:09.103594 (+1178853us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b540028c654. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:09.103753 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15696128}
I20260709 13:16:09.106429  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2000) took 1703 ms. Trace:
I20260709 13:16:09.106820  3126 rpcz_store.cc:276] 0709 13:16:07.402552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.536855 (+134303us) service_pool.cc:224] Handling call
0709 13:16:08.148895 (+612040us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.149591 (+   696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.106222 (+956631us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b54003e8850. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:09.106371 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1406776192}
I20260709 13:16:09.041158  6724 raft_consensus.cc:740] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:08.967689  6982 consensus_queue.cc:260] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.045006  7009 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:09.107969  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:09.108714  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:09.105669  7032 log.cc:927] Time spent T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 1.214s	user 0.010s	sys 0.015s
I20260709 13:16:09.109262  6631 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:09.127805  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 251244us
W20260709 13:16:09.134194  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 84658.1us
I20260709 13:16:09.136409  3164 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:09.125236  7083 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:09.142807  3198 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: [8.4-10.5]
I20260709 13:16:09.141451  7085 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:09.122891  7070 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:16:09.145008  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.114682  7010 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:16:09.129810  6893 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.156312  7071 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:09.157033  7088 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:09.141495  7072 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:16:09.161871  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 79096.3us
I20260709 13:16:09.133185  3090 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:09.163535  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:09.177003  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 43916us
I20260709 13:16:09.168869  3165 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:09.168177  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:09.180351  3198 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:09.180548  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:09.181300  3042 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 9: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:09.165947  7067 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
W20260709 13:16:09.173825  7061 log.cc:927] Time spent T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
W20260709 13:16:09.191016  6845 consensus_meta.cc:287] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.836s	user 0.010s	sys 0.002s
I20260709 13:16:09.158552  6724 consensus_queue.cc:260] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.174449  7076 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.191946  6724 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:09.191991  7076 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:09.193778  6896 consensus_meta.cc:287] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.604s	user 0.012s	sys 0.000s
I20260709 13:16:09.196815  6896 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:09.124763  7009 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.170118  7088 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.200945  7009 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:09.186671  7082 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:16:09.201282  7088 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:09.188748  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:09.164714  7071 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.202283  3197 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:09.203140  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:09.203598  7071 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:09.203809  3197 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 9: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:09.204157  7071 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:09.204561  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:09.205116  3197 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:09.163584  6959 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:09.206147  6959 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.206634  6959 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:09.208345  7062 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 13:16:09.208842  6959 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:09.209241  7068 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
W20260709 13:16:09.174832  7053 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 13:16:09.211781  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:09.162111  6935 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.216378  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:09.158327  7083 raft_consensus.cc:697] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:09.219548  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2407) took 1823 ms. Trace:
I20260709 13:16:09.205526  7071 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:09.222100  7084 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:09.221025  3051 rpcz_store.cc:276] 0709 13:16:07.396069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.569115 (+173046us) service_pool.cc:224] Handling call
0709 13:16:07.570134 (+  1019us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.571913 (+  1779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.572049 (+   136us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.573528 (+  1479us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.667089 (+ 93561us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:07.667128 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.667203 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:08.916192 (+1248989us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:09.219288 (+303096us) raft_consensus.cc:1685] finished
0709 13:16:09.219310 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.219490 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":292,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":210,"spinlock_wait_cycles":40855424,"thread_start_us":82824,"threads_started":1,"wal-append.queue_time_us":254425}
W20260709 13:16:09.198494  6924 consensus_meta.cc:287] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.926s	user 0.012s	sys 0.000s
W20260709 13:16:09.197196  6899 consensus_meta.cc:287] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.001s
I20260709 13:16:09.247635  3198 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:09.259487  7093 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.260063  7093 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.266244  6947 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.266834  6947 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.255266  7092 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:09.268213  7074 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:09.268173  7092 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.150743  6986 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:16:09.270567  7092 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:09.165186  6766 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:09.268996  7074 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.250124  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:09.275075  3197 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:09.294373  7096 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:09.237984  7071 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.165647  6893 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.271158  6894 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:09.281461  6901 consensus_meta.cc:287] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.068s	user 0.011s	sys 0.002s
I20260709 13:16:09.191530  6845 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:09.295861  6588 consensus_meta.cc:287] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.870s	user 0.011s	sys 0.001s
I20260709 13:16:09.311688  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2203) took 1227 ms. Trace:
I20260709 13:16:09.158816  7085 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.275645  6776 raft_consensus.cc:697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:16:09.311436  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 284403us
I20260709 13:16:09.278743  7070 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:09.288600  7043 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:09.295466  7092 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:09.375891  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 239592us
I20260709 13:16:09.298445  7052 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:09.355984  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2207) took 1229 ms. Trace:
I20260709 13:16:09.361567  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:09.379791  3121 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:09.363574  7063 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.364658  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 549) took 1154 ms. Trace:
I20260709 13:16:09.366022  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:09.301535  7071 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:09.383267  3761 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:09.383124  3194 rpcz_store.cc:276] 0709 13:16:08.210228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.335472 (+125244us) service_pool.cc:224] Handling call
0709 13:16:08.343581 (+  8109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.366703 (+ 23122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.364350 (+997647us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b540013ced0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:09.364557 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17857920}
I20260709 13:16:09.321849  7088 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:09.369309  6709 consensus_meta.cc:287] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.980s	user 0.009s	sys 0.001s
I20260709 13:16:09.369585  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2205) took 1258 ms. Trace:
I20260709 13:16:09.373823  3117 raft_consensus.cc:2368] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13.
I20260709 13:16:09.301990  6488 raft_consensus.cc:3055] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:09.295318  6971 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:09.299134  6896 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:09.252768  6935 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.376173  3047 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:09.397449  3047 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:09.377281  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:09.378600  3191 rpcz_store.cc:276] 0709 13:16:08.126349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.127087 (+   738us) service_pool.cc:224] Handling call
0709 13:16:09.355638 (+1228551us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b54003bae54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:09.355889 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1358088448}
I20260709 13:16:09.313531  6894 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.368324  7083 consensus_queue.cc:237] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:09.386937  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.386260  7074 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:09.295123  7096 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.390793  3193 rpcz_store.cc:276] 0709 13:16:08.107812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.108063 (+   251us) service_pool.cc:224] Handling call
0709 13:16:09.365580 (+1257517us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540002add4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:09.365696 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366402432}
I20260709 13:16:09.395993  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:09.396500  3192 raft_consensus.cc:2410] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:09.312418  7076 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:09.381352  7078 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.401453  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:09.402194  3121 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:09.319707  6588 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.401032  3090 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:09.386976  7064 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:09.393697  6488 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:09.392194  6724 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:09.426939  7099 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:09.423575  7078 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.427380  6724 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.427636  7099 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.429214  7078 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:09.429858  6980 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.400038  6971 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.397979  6924 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:09.426360  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.422209  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:09.406462  6985 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:09.430032  3123 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:09.438879  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1918) took 1406 ms. Trace:
I20260709 13:16:09.439450  3120 rpcz_store.cc:276] 0709 13:16:08.032562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.177329 (+144767us) service_pool.cc:224] Handling call
0709 13:16:08.207175 (+ 29846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.942080 (+734905us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:16:08.942108 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:08.962483 (+ 20375us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.123840 (+161357us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:09.123889 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.123964 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.438577 (+314613us) raft_consensus.cc:1685] finished
0709 13:16:09.438605 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.438799 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10521,"raft.queue_time_us":138313,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":7615,"thread_start_us":867587,"threads_started":2,"wal-append.queue_time_us":299245}
W20260709 13:16:09.441509  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.415469  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1844) took 1009 ms. Trace:
I20260709 13:16:09.452950  3199 rpcz_store.cc:276] 0709 13:16:08.405595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.407550 (+  1955us) service_pool.cc:224] Handling call
0709 13:16:08.407844 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.408061 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:09.087178 (+679117us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.391552 (+304374us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.396832 (+  5280us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:09.396881 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:09.396927 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.396990 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.415381 (+ 18391us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6845,"prepare.queue_time_us":103358,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":8790,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":8886,"spinlock_wait_cycles":15549056,"thread_start_us":940687,"threads_started":2}
I20260709 13:16:09.433493  3090 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:09.399932  6896 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:09.458310  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.383539  7092 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.458969  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:09.399989  7093 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:09.389562  7063 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.377483  7070 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.466468  6661 consensus_queue.cc:1059] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:09.432811  6766 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:09.430439  6980 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.457870  7078 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:09.475294  7077 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:16:09.475672  6971 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:09.475862  7099 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:09.434255  7091 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:09.476588  7064 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.477254  7096 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:09.483942  7044 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:09.485469  7054 consensus_meta.cc:287] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.000s
I20260709 13:16:09.395517  7088 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.491879  6588 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:09.492148  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:09.492364  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:09.492972  3791 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:09.384447  7043 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.493832  3090 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:09.495651  6634 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:09.493598  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:09.497126  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:09.579224  3795 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:09.579309  3799 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:09.496960  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:09.580420  3792 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:09.424407  6990 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:09.429672  6724 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:09.506624  6898 raft_consensus.cc:3055] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:09.506788  6488 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.508428  6896 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:09.589421  7092 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:09.585754  6898 raft_consensus.cc:740] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:09.590976  6904 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:09.591099  6898 consensus_queue.cc:260] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 8.2, Last appended by leader: 2, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.592442  6898 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:09.574961  7054 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11.
W20260709 13:16:09.514076  3762 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.129:44609 timed out after 1.636s (SENT) [suppressed 13 similar messages]
I20260709 13:16:09.499877  6947 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:09.537817  3047 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.517050  3123 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:09.496734  6845 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:09.559789  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1921) took 1481 ms. Trace:
I20260709 13:16:09.615855  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:09.643633  3119 rpcz_store.cc:276] 0709 13:16:08.078742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.182379 (+103637us) service_pool.cc:224] Handling call
0709 13:16:08.182674 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.336262 (+153588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.336304 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:08.454080 (+117776us) log.cc:844] Serialized 26 byte log entry
0709 13:16:08.897618 (+443538us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:08.897678 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.897793 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.559566 (+661773us) raft_consensus.cc:1685] finished
0709 13:16:09.559585 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.559722 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34438,"raft.queue_time_us":156884,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":11465,"thread_start_us":504889,"threads_started":2,"wal-append.queue_time_us":824067}
I20260709 13:16:09.646109  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:09.498591  7056 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:16:09.563643  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 140796us
I20260709 13:16:09.464699  6924 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.459509  6776 consensus_queue.cc:237] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.493579  7038 raft_consensus.cc:3055] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:16:09.557799  6920 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.025s	sys 0.040s
W20260709 13:16:09.576856  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 83122.3us
W20260709 13:16:09.557480  7100 log.cc:927] Time spent T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:16:09.540762  6766 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.539108  6631 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.555826  7070 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:09.586580  3164 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:09.582710  7104 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:09.589133  6488 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:09.598019  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:09.603266  7088 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:09.603726  3794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 510) took 1429 ms. Trace:
I20260709 13:16:09.606323  7043 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:09.607272  7085 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:09.607622  6906 raft_consensus.cc:3055] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:09.610549  2938 maintenance_manager.cc:419] P fc4fb08aba024155968fdc88910f61d7: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033342
I20260709 13:16:09.570312  7064 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.613404  7063 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:09.615671  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.510347  3798 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:09.627038  6935 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:09.628116  6894 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:09.580766  7044 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:16:09.613883  6893 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:09.633922  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2010) took 1197 ms. Trace:
I20260709 13:16:09.731568  7088 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.642124  6896 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:09.731442  6971 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.678372  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:09.766858  3797 raft_consensus.cc:2393] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:09.659534  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:09.767804  3200 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:16:09.772261  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:09.773377  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.661867  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:09.686988  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:09.657264  7056 raft_consensus.cc:697] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:09.647655  7083 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:09.687737  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:16:09.688373  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 174344us
I20260709 13:16:09.776847  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:09.777954  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:09.691360  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:09.689947  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 103448us
I20260709 13:16:09.692955  7104 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:09.653872  6684 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.694619  3796 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:09.694994  3197 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:16:09.696062  6924 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:09.701185  3121 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
W20260709 13:16:09.769289  7031 consensus_meta.cc:287] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.181s	user 0.007s	sys 0.008s
I20260709 13:16:09.706369  3794 rpcz_store.cc:276] 0709 13:16:08.174570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.178786 (+  4216us) service_pool.cc:224] Handling call
0709 13:16:09.603439 (+1424653us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54005a5354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:09.603629 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592178944}
I20260709 13:16:09.709425  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:09.786198  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:09.659370  7038 raft_consensus.cc:740] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:09.659245  7054 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.785511  6684 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.790553  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:09.790860  7054 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.792457  6684 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:09.794092  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:09.718686  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:09.719799  3118 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:09.689069  6766 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:09.721269  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:09.709400  7047 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:16:09.705698  6920 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.025s	sys 0.049s
I20260709 13:16:09.698596  7096 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:09.698617  6634 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:09.698444  6970 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:09.706540  6941 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:09.807615  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:09.808547  3790 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:09.808849  3045 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 8. Current term is 9. Ops: [8.2-8.2]
I20260709 13:16:09.718565  6906 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:09.731096  6966 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:09.738750  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:09.750415  3125 rpcz_store.cc:276] 0709 13:16:08.436478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.507497 (+ 71019us) service_pool.cc:224] Handling call
0709 13:16:08.512652 (+  5155us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.748868 (+236216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.748907 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:08.815743 (+ 66836us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.301963 (+486220us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:09.302002 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.302050 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.633642 (+331592us) raft_consensus.cc:1685] finished
0709 13:16:09.633670 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.633850 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":121353,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":37616,"thread_start_us":623398,"threads_started":2,"wal-append.queue_time_us":730745}
I20260709 13:16:09.558079  7091 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.678570  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:09.767856  7088 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.778577  3797 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
W20260709 13:16:09.781917  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.778367  3199 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:09.706745  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:09.760900  7093 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.828402  3191 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:16:09.785195  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:09.786715  3195 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:09.788154  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:09.764863  6918 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.798411  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:09.775980  7052 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.795301  3200 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:09.807825  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:09.831784  3193 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:09.812459  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:09.784021  7104 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:09.785873  7092 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:16:09.846571  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 58482.1us
I20260709 13:16:09.822021  3793 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:09.775504  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:09.846948  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:09.847577  3194 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:09.823040  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:09.847929  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:09.849102  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:09.767254  6896 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.775674  6971 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.825083  6724 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:09.825332  6966 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.833348  6941 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.834209  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:09.794420  7038 consensus_queue.cc:260] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.835723  6918 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:09.843592  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 53159us
I20260709 13:16:09.805269  6894 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.785127  7071 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.853897  3797 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:09.854040  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:09.850006  3125 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:16:09.855583  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:09.868892  3194 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:09.869678  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:09.871147  7064 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:09.871726  6935 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:09.872218  6935 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.872561  6935 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:09.872720  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:09.856336  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:09.875034  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:16:09.875764  7119 log.cc:927] Time spent T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:16:09.876176  6893 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:09.877012  6893 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:09.857489  6906 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.877367  6893 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:09.877785  6893 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:09.878108  7088 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:09.878942  7038 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:09.879118  6941 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:09.858541  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:09.880155  3193 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:16:09.834414  3798 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:16:09.859874  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.797070  7031 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.808221  6634 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.852813  6904 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:09.810949  6970 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.860328  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:09.887151  3121 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:09.853173  6724 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:09.852969  6845 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:09.859100  7084 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:09.901796  3790 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:09.888621  6966 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:09.890012  3761 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:09.906554  6990 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:09.906960  6990 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.890275  3197 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:09.907613  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:09.908483  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.908720  7088 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:09.909216  7088 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.913180  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:09.892748  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:09.862282  7083 raft_consensus.cc:697] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:09.893858  3194 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:09.914552  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:09.914796  7083 consensus_queue.cc:237] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.898833  3198 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:09.850952  7052 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.869486  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:09.904135  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:09.907337  6990 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:09.899026  6724 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:09.845885  7093 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.885198  6906 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:09.853319  7092 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.891742  6631 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:09.915704  3798 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:09.892247  7064 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.925020  3125 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:16:09.928344  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:09.931108  6634 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:09.932109  3047 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:09.933267  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet 7480597af1f341178e465e8723f7320e: Illegal state: Replica 501fdf2af2bc4b0c971ae880e98f466b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:09.935009  7031 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:09.937813  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:09.880303  7056 consensus_queue.cc:237] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.881539  6894 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.940428  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:09.942413  3042 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:09.943919  3046 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:09.950106  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:09.950306  3798 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:10.000136  3125 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:09.950911  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:09.951597  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:09.952322  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:10.001034  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:10.001298  3050 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:10.001624  3125 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:16:10.002624  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:10.003193  3125 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:09.956391  7064 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.942354  6488 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:09.958580  6918 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:09.961236  6971 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:10.053956  7124 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:10.054548  7124 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:16:10.054834  7123 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:16:10.054941  7124 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:09.963550  7093 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:09.967424  6896 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:09.916186  7084 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:09.941581  7044 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.095569  7044 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:09.970945  6970 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:09.938444  3197 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:09.945232  7024 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:10.105562  7024 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:10.106109  7024 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:09.985641  3120 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:09.905575  6845 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:10.009238  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:09.940425  6966 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:10.027191  7071 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:09.953941  6982 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:10.029106  3048 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:16:10.042625  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 91103.2us
W20260709 13:16:10.047183  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.052449  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:09.999136  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:10.056789  3117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 1908) took 2032 ms (client timeout 2247 ms). Trace:
I20260709 13:16:10.092950  7075 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:10.057621  6488 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:10.032486  6589 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:10.122851  3123 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:10.143106  6989 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.121677  7104 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:10.143252  7092 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:10.053961  6935 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:10.160810  7044 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:10.165041  3050 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:10.173939  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:10.174849  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 165730us
I20260709 13:16:10.179073  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:10.192591  3117 rpcz_store.cc:269] 0709 13:16:08.024777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.030594 (+  5817us) service_pool.cc:224] Handling call
0709 13:16:10.056503 (+2025909us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400319a54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:10.056711 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3009947392}
I20260709 13:16:10.208420  3762 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:10.194485  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:10.212740  3042 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 7: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:10.194950  3795 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:10.199255  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:10.200340  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1922) took 1924 ms. Trace:
I20260709 13:16:10.176733  6970 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.184734  6932 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.145298  6724 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:10.232594  6932 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:10.233501  7052 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:10.234458  6724 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:10.191453  6947 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.184335  6934 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:10.165920  6894 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:10.195559  6904 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:10.204247  6989 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:10.219518  7104 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:10.211553  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:10.221920  7064 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:10.816449  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 604915us
I20260709 13:16:10.818739  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:10.820163  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:10.820943  3199 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:10.203807  6589 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:10.216105  7075 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:10.143591  6990 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:10.217633  7112 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:10.649091  3796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 674) took 1158 ms. Trace:
I20260709 13:16:10.217581  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:10.909857  3051 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:16:10.209369  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:10.914750  3050 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:16:10.915899  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:10.916755  3050 raft_consensus.cc:2393] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:10.263495  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:10.270932  3118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2013) took 1690 ms (client timeout 2133 ms). Trace:
W20260709 13:16:10.922010  3118 rpcz_store.cc:269] 0709 13:16:08.580854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.046931 (+466077us) service_pool.cc:224] Handling call
0709 13:16:10.270736 (+1223805us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b5400148cd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:10.270865 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1371188480}
I20260709 13:16:10.923339  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:10.924013  3118 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:10.287827  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:10.926275  3046 raft_consensus.cc:2368] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10.
I20260709 13:16:10.927205  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:10.928534  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:10.573364  3192 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34728 (request call id 544) took 2366 ms (client timeout 1521 ms). Trace:
W20260709 13:16:10.584401  7133 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.367s	user 0.004s	sys 0.000s
I20260709 13:16:10.630106  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:10.929916  3192 rpcz_store.cc:269] 0709 13:16:08.207186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.208206 (+  1020us) service_pool.cc:224] Handling call
0709 13:16:10.573097 (+2364891us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54003ba454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:10.573274 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2679926528}
I20260709 13:16:10.676486  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2012) took 2203 ms. Trace:
I20260709 13:16:10.689549  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2063) took 1509 ms. Trace:
I20260709 13:16:10.931267  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:10.931440  3045 rpcz_store.cc:276] 0709 13:16:09.180150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.180272 (+   122us) service_pool.cc:224] Handling call
0709 13:16:09.180748 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.809402 (+628654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.689121 (+879719us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b54003d59d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:10.689459 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1443605248}
I20260709 13:16:10.932155  3192 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:16:10.693959  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2007) took 2294 ms. Trace:
I20260709 13:16:10.696846  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:10.933857  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.934067  3119 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:10.935115  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:10.698405  3125 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:10.936124  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 585) took 2202 ms. Trace:
I20260709 13:16:10.936481  3125 rpcz_store.cc:276] 0709 13:16:08.733871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.697900 (+1964029us) service_pool.cc:224] Handling call
0709 13:16:10.698212 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.935856 (+237644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.936068 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.937671  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:10.938491  3125 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:10.938858  6634 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:10.939405  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:10.940096  3125 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:10.940992  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:10.719177  3193 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.010s	sys 0.044s
W20260709 13:16:10.942656  3193 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.011s	sys 0.044s
I20260709 13:16:09.312249  3196 rpcz_store.cc:276] 0709 13:16:08.084810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.085018 (+   208us) service_pool.cc:224] Handling call
0709 13:16:08.085516 (+   498us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:08.120040 (+ 34524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.120064 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:08.159991 (+ 39927us) log.cc:844] Serialized 52 byte log entry
0709 13:16:08.383483 (+223492us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:08.603945 (+220462us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.262875 (+658930us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b18001c1b60. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d240c0a 00007ff836980219 00007ff82d2c8a40 00007ff82d2c34e4 00007ff82d2c3455 00007ff833dab3c7 00007ff8303bd9a7 00007ff8303cd0bf 00007ff8303cd038
0709 13:16:09.263175 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.302850 (+ 39675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.302947 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.310666 (+  7719us) raft_consensus.cc:1685] finished
0709 13:16:09.310698 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.311003 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43484,"prepare.queue_time_us":757416,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":84,"raft.queue_time_us":106313,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":13726,"spinlock_wait_cycles":10041472,"thread_start_us":370291,"threads_started":2,"wal-append.queue_time_us":398921}
I20260709 13:16:10.944238  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:10.723668  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.757790  2937 maintenance_manager.cc:643] P fc4fb08aba024155968fdc88910f61d7: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.912s	user 0.113s	sys 0.056s Metrics: {"bytes_written":29764,"cfile_init":1,"dirs.queue_time_us":17076,"dirs.run_cpu_time_us":423,"dirs.run_wall_time_us":986,"drs_written":1,"lbm_read_time_us":390,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3698,"lbm_writes_lt_1ms":30,"peak_mem_usage":0,"rows_written":63,"thread_start_us":16583,"threads_started":1}
I20260709 13:16:10.767160  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:10.768352  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:10.947564  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:10.948048  3197 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:16:10.948175  3200 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:10.948462  3197 pending_rounds.cc:85] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 8
I20260709 13:16:10.948782  3197 pending_rounds.cc:107] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:16:10.949028  3197 raft_consensus.cc:2889] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:10.769409  3195 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:10.782405  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:10.793939  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:10.951005  3194 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:10.951054  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:10.956480  2938 maintenance_manager.cc:419] P fc4fb08aba024155968fdc88910f61d7: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9142 bytes on disk
I20260709 13:16:10.956914  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:10.798751  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:10.814903  3117 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: [8.4-10.5]
I20260709 13:16:10.959457  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1926) took 2225 ms. Trace:
I20260709 13:16:10.959856  3117 rpcz_store.cc:276] 0709 13:16:08.733594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.814163 (+2080569us) service_pool.cc:224] Handling call
0709 13:16:10.814592 (+   429us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:10.959161 (+144569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.959397 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.960971  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:10.213600  3124 rpcz_store.cc:276] 0709 13:16:08.276020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.276818 (+   798us) service_pool.cc:224] Handling call
0709 13:16:08.277216 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.394694 (+117478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.200086 (+1805392us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400216954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:10.200273 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241945088}
I20260709 13:16:11.040243  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:10.794683  3790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 516) took 1033 ms. Trace:
I20260709 13:16:10.260058  6488 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.091213  6488 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.725468  6662 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:11.116775  6662 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:10.229785  6845 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:10.271642  6893 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:10.248071  6904 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.142146  2947 catalog_manager.cc:5697] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 6 to 7, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 7 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:16:11.144476  6904 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.145134  3121 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:11.147310  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2025) took 1657 ms. Trace:
I20260709 13:16:10.793678  6920 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:10.767824  6932 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:10.238189  6934 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.151520  6934 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:10.253392  6935 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.154321  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:10.762243  6969 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:11.156569  3090 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:11.156132  6969 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:10.190701  6966 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:10.230499  6970 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:10.274477  6980 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:10.265297  6989 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.168076  6989 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.168952  6989 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:10.296506  7024 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.172039  7024 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.172689  7024 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.780864  7040 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.174780  7040 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:10.812012  7054 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:10.812259  7074 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.178400  7074 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:10.772720  7078 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.180812  7078 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:10.218941  7084 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:10.285728  7088 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:10.651847  7091 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:10.268110  7103 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.711s	user 0.002s	sys 0.000s
I20260709 13:16:10.764740  7105 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.189113  7105 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:10.297549  7124 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.193147  7124 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:10.821709  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:11.194123  3199 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:10.850657  3043 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:16:11.195387  3043 pending_rounds.cc:85] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 4
I20260709 13:16:11.195704  3043 pending_rounds.cc:107] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:16:11.196007  3043 raft_consensus.cc:2889] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:11.196851  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2421) took 1211 ms. Trace:
I20260709 13:16:10.852417  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2067) took 1641 ms. Trace:
I20260709 13:16:10.857358  7140 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:11.198204  7140 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.197921  3049 rpcz_store.cc:276] 0709 13:16:09.211387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.212343 (+   956us) service_pool.cc:224] Handling call
0709 13:16:09.212637 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.212976 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.213002 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.237089 (+ 24087us) log.cc:844] Serialized 26 byte log entry
0709 13:16:10.119407 (+882318us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b18001053a0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:16:10.209433 (+ 90026us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:10.209484 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.210907 (+  1423us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:10.852054 (+641147us) raft_consensus.cc:1685] finished
0709 13:16:10.852079 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.852346 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31978,"raft.queue_time_us":3071,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":22698,"spinlock_wait_cycles":4040448,"thread_start_us":89836,"threads_started":1,"wal-append.queue_time_us":1035073}
I20260709 13:16:10.858978  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2050) took 2658 ms. Trace:
I20260709 13:16:10.874861  3796 rpcz_store.cc:276] 0709 13:16:09.490624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.491899 (+  1275us) service_pool.cc:224] Handling call
0709 13:16:09.492172 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.780614 (+288442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.648745 (+868131us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54004af1d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:10.648984 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464695168}
I20260709 13:16:10.879298  7144 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:11.200665  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.201088  7144 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:10.874804  7143 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.203514  7143 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.205179  3119 raft_consensus.cc:2393] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 8: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:10.884718  7142 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.206104  7142 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:10.885397  7141 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.893813  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2020) took 1404 ms. Trace:
I20260709 13:16:10.962889  2937 maintenance_manager.cc:643] P fc4fb08aba024155968fdc88910f61d7: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":355,"lbm_reads_lt_1ms":4}
I20260709 13:16:10.930980  3126 rpcz_store.cc:276] 0709 13:16:08.473388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.120160 (+646772us) service_pool.cc:224] Handling call
0709 13:16:09.120475 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.378031 (+257556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.378075 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:09.378129 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:09.378176 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.676040 (+1297864us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b540010e354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:10.676114 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.676318 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591812480}
I20260709 13:16:11.208140  7141 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:10.933137  3122 rpcz_store.cc:276] 0709 13:16:08.399915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.492746 (+ 92831us) service_pool.cc:224] Handling call
0709 13:16:08.493095 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.650066 (+156971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.650116 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:08.650180 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:08.650231 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.693673 (+2043442us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54004777d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:10.693726 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.693895 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360241408}
I20260709 13:16:11.210400  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:11.210587  6941 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.211266  6941 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.211786  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:11.212545  3122 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:10.945457  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:10.968580  3191 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:11.214046  3196 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:11.214808  3191 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:10.968580  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:10.941550  3125 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:11.215958  6893 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:11.216172  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:11.216804  3125 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:11.209280  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:10.969815  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 586) took 2235 ms. Trace:
I20260709 13:16:11.217706  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:11.217640  3126 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:16:11.218571  3119 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:11.218156  3123 rpcz_store.cc:276] 0709 13:16:08.734164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.772128 (+2037964us) service_pool.cc:224] Handling call
0709 13:16:10.772448 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.833579 (+ 61131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.833612 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.833653 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:10.833674 (+    21us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.969565 (+135891us) spinlock_profiling.cc:243] Waited 60.9 ms on lock 0x7b5400477cd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:10.969604 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.969717 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140025216}
I20260709 13:16:10.972905  3194 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:10.973929  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.219645  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:10.975313  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:10.976537  3197 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:11.221385  3126 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:10.976696  7146 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.213642  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:11.222465  7146 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.223460  3122 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:10.977909  3192 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:10.827250  6589 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:10.980883  3091 connection.cc:256] RPC call timeout handler was delayed by -1.0541829619999135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
I20260709 13:16:10.939560  6634 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:10.833101  6990 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:10.982702  3118 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:10.984022  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:10.796613  3165 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:10.999269  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2214) took 1814 ms. Trace:
I20260709 13:16:10.989653  3051 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:11.007933  6661 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:11.009203  6724 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:11.010993  3200 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:11.238077  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2424) took 1181 ms. Trace:
I20260709 13:16:11.010639  6971 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.014384  7147 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:11.022535  7145 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.023674  7149 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.251215  7145 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.251595  7141 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:11.038018  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.252955  7142 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:11.253345  7145 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:11.041464  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:11.051514  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2227) took 1240 ms. Trace:
I20260709 13:16:11.254056  3124 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:11.254256  3196 raft_consensus.cc:1275] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 8 index: 2. Preceding OpId from leader: term: 9 index: 3. (index mismatch)
I20260709 13:16:11.254688  7074 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.255425  3124 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:11.253998  3193 rpcz_store.cc:276] 0709 13:16:09.811291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.893310 (+ 82019us) service_pool.cc:224] Handling call
0709 13:16:09.916690 (+ 23380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.916929 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:10.133476 (+216547us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.050708 (+917232us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.050952 (+   244us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.051018 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:11.051071 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.051254 (+   183us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.051434 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51060,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":30398,"raft.queue_time_us":79139,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":295,"thread_start_us":1132545,"threads_started":4,"wal-append.queue_time_us":154354}
I20260709 13:16:11.256019  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2018) took 1767 ms. Trace:
I20260709 13:16:11.256366  3124 rpcz_store.cc:276] 0709 13:16:09.488390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.254841 (+1766451us) service_pool.cc:224] Handling call
0709 13:16:11.255139 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.255781 (+   642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.255963 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.053514  7055 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.828887  7075 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:11.073046  7045 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:11.078441  6848 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.099170  7151 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.273862  7151 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.274610  7144 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:11.092025  6488 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.101655  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.282980  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:11.283478  6488 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:11.283648  3045 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:11.102946  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.286813  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.287495  3047 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:16:11.288436  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.289254  3047 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:11.255950  6966 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.105638  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:10.821961  7070 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:11.109594  7152 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:11.247619  7088 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:11.114207  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.301275  3048 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:10.270373  6766 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.126039  6892 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:11.310004  6892 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.311995  6892 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:11.128217  3164 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.003s	user 0.021s	sys 0.041s
I20260709 13:16:11.133457  6662 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.151438  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:10.235497  6947 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.315490  6947 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:11.290086  6904 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:16:11.268146  7055 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.153409  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:11.156348  7153 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:11.157511  3090 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:10.765865  6982 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:11.319129  6982 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.319526  7055 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.164604  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:11.272527  7054 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:16:11.147663  3121 rpcz_store.cc:276] 0709 13:16:09.490277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.889286 (+399009us) service_pool.cc:224] Handling call
0709 13:16:11.147114 (+1257828us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54003020d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:11.147244 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2805790464}
I20260709 13:16:11.298795  6848 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.184960  6935 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:16:10.880323  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.917572  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.220472  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1929) took 2055 ms. Trace:
I20260709 13:16:11.149209  6920 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.200253  3044 rpcz_store.cc:276] 0709 13:16:08.200534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.200993 (+   459us) service_pool.cc:224] Handling call
0709 13:16:08.214306 (+ 13313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.214655 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.214684 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:08.225137 (+ 10453us) log.cc:844] Serialized 26 byte log entry
0709 13:16:08.510148 (+285011us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:08.510196 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.510291 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.197815 (+687524us) raft_consensus.cc:1685] finished
0709 13:16:09.197846 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.858598 (+1660752us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b540028df50. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:10.858914 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17574,"raft.queue_time_us":488,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":8589,"spinlock_wait_cycles":29872384,"thread_start_us":186771,"threads_started":1,"wal-append.queue_time_us":369826,"wal-append.run_cpu_time_us":3489,"wal-append.run_wall_time_us":1553331}
I20260709 13:16:11.239104  3051 rpcz_store.cc:276] 0709 13:16:10.056272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.217300 (+161028us) service_pool.cc:224] Handling call
0709 13:16:11.238009 (+1020709us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.197234  3043 rpcz_store.cc:276] 0709 13:16:09.985406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.031130 (+ 45724us) service_pool.cc:224] Handling call
0709 13:16:10.850017 (+818887us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b5800000f98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff83538cfc0 00007ff835377929 00007ff8353773d2 00007ff82e8eebd4
0709 13:16:10.850251 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.196515 (+346264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.196771 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9210752}
I20260709 13:16:11.227867  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1932) took 1806 ms. Trace:
I20260709 13:16:11.208168  3120 rpcz_store.cc:276] 0709 13:16:09.488914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.802089 (+313175us) service_pool.cc:224] Handling call
0709 13:16:10.893519 (+1091430us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400478bd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:10.893681 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351858048}
I20260709 13:16:11.224151  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1931) took 1812 ms. Trace:
I20260709 13:16:11.219669  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:11.233688  3198 rpcz_store.cc:276] 0709 13:16:09.185100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.257601 (+ 72501us) service_pool.cc:224] Handling call
0709 13:16:09.293479 (+ 35878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.920942 (+627463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.997479 (+1076537us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b540013bfd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:10.999153 (+  1674us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1391713536}
I20260709 13:16:11.319168  6941 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:11.244526  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 447987us
I20260709 13:16:11.319571  6969 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.244818  3195 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:11.247541  6634 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.230387  6589 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:11.226549  6893 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.247975  7084 consensus_queue.cc:1059] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:11.248440  6724 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.249280  6971 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.321184  3045 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:11.337809  6971 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:11.250018  7147 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.339951  7147 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.250463  7140 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:11.341615  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.238646  6661 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.342374  3045 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:11.342648  6661 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:11.344668  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.251355  7149 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.044714  3790 rpcz_store.cc:276] 0709 13:16:09.761382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.819933 (+ 58551us) service_pool.cc:224] Handling call
0709 13:16:10.794469 (+974536us) spinlock_profiling.cc:243] Waited 53.7 ms on lock 0x7b54005c1a54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:10.794620 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123519872}
I20260709 13:16:11.055730  6910 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.347680  6910 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.348510  3045 raft_consensus.cc:2410] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:16:11.348966  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47488 (request call id 635) took 1183 ms. Trace:
I20260709 13:16:11.257586  3124 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:11.349252  3045 rpcz_store.cc:276] 0709 13:16:10.165641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.344395 (+1178754us) service_pool.cc:224] Handling call
0709 13:16:11.348906 (+  4511us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.349762  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2019) took 1861 ms. Trace:
I20260709 13:16:11.144479  2947 catalog_manager.cc:5697] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.321966  7143 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.260648  3125 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:11.353761  3125 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:16:11.354379  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2022) took 1865 ms. Trace:
I20260709 13:16:11.354691  3125 rpcz_store.cc:276] 0709 13:16:09.489371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.353148 (+1863777us) service_pool.cc:224] Handling call
0709 13:16:11.353496 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:11.354129 (+   633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.354317 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.356081  3125 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:11.356649  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2027) took 1813 ms. Trace:
I20260709 13:16:11.356961  3125 rpcz_store.cc:276] 0709 13:16:09.543169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.355468 (+1812299us) service_pool.cc:224] Handling call
0709 13:16:11.355775 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.356417 (+   642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.356598 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.173166  7024 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.268353  3126 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:11.350200  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:11.358470  2948 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57750 (request call id 228) took 18286 ms (client timeout 15000 ms). Trace:
I20260709 13:16:11.270539  3199 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:11.359153  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.254065  6970 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:11.361104  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 203652us
I20260709 13:16:11.361991  7153 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:11.362620  7153 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:11.363364  7153 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:11.359854  3045 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:11.365384  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:11.321214  3797 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:11.366663  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.367533  3794 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:11.323068  6935 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.325212  7105 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:11.359061  3126 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:11.326107  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.374573  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 587) took 1657 ms. Trace:
I20260709 13:16:11.375077  3044 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:11.376164  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.376782  3044 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:16:11.322795  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:11.327505  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2021) took 1838 ms. Trace:
I20260709 13:16:11.294364  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:11.328059  3119 raft_consensus.cc:2393] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:11.110513  3762 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:11.380831  7054 raft_consensus.cc:3055] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:11.381271  7054 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:11.381547  6990 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:11.279522  7146 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:11.250514  7078 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.382412  7064 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:11.382241  7054 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.302315  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.331771  6766 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.281112  7040 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:11.300727  7070 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:11.384958  3048 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:11.385412  7070 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:11.385793  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 636) took 1207 ms. Trace:
I20260709 13:16:11.304394  7152 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.295660  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.387636  3047 raft_consensus.cc:2410] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 12 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:16:11.325299  6920 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:11.290333  3046 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:11.332933  6893 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.336104  6724 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:11.389204  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47488 (request call id 639) took 1195 ms. Trace:
I20260709 13:16:11.383842  7054 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:11.336725  3049 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:11.374984  3126 rpcz_store.cc:276] 0709 13:16:09.717503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.358623 (+1641120us) service_pool.cc:224] Handling call
0709 13:16:11.358906 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.374280 (+ 15374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.374517 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:11.337212  3164 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.212s	user 0.022s	sys 0.041s
W20260709 13:16:11.393169  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 1.26812e+06us
I20260709 13:16:11.393715  3126 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:11.330785  3165 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:11.350067  3124 rpcz_store.cc:276] 0709 13:16:09.488637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.257043 (+1768406us) service_pool.cc:224] Handling call
0709 13:16:11.257317 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.349487 (+ 92170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.349682 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:11.395341  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 64611.8us
I20260709 13:16:11.396250  3124 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:11.396839  3165 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:11.397812  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:11.323436  3050 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:11.397373  3124 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:11.399838  3124 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:11.400957  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:11.402062  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:11.379407  3044 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:11.378526  3121 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:11.402882  3792 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:16:11.403312  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 632) took 1238 ms. Trace:
I20260709 13:16:11.403997  3121 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:11.403815  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:11.322062  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 65352.7us
I20260709 13:16:11.326244  3118 rpcz_store.cc:276] 0709 13:16:09.421276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.226849 (+1805573us) service_pool.cc:224] Handling call
0709 13:16:11.227233 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.227470 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.227507 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.227562 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:11.227609 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.227679 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.227804 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.327662  3122 rpcz_store.cc:276] 0709 13:16:09.412036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.222970 (+1810934us) service_pool.cc:224] Handling call
0709 13:16:11.223273 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.223910 (+   637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.224091 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.406286  3118 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:11.332696  6589 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.408008  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:55310 (request call id 11) took 1376 ms. Trace:
I20260709 13:16:11.408351  3118 rpcz_store.cc:276] 0709 13:16:10.031780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.406995 (+1375215us) service_pool.cc:224] Handling call
0709 13:16:11.407924 (+   929us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.326339  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:11.382256  6990 raft_consensus.cc:697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:11.323557  3123 rpcz_store.cc:276] 0709 13:16:09.164721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.219613 (+2054892us) service_pool.cc:224] Handling call
0709 13:16:11.219882 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.220167 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.220192 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.220230 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:11.220258 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.220325 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.220422 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":260,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78}
I20260709 13:16:11.379094  3120 rpcz_store.cc:276] 0709 13:16:09.489149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.326496 (+1837347us) service_pool.cc:224] Handling call
0709 13:16:11.326801 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.327080 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.327105 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.327150 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:11.327196 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.327265 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.327438 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.403707  3044 rpcz_store.cc:276] 0709 13:16:10.164723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.378819 (+1214096us) service_pool.cc:224] Handling call
0709 13:16:11.379222 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.403053 (+ 23831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.403255 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.410600  6990 consensus_queue.cc:237] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.326247  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:11.411656  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet 22edd8baac97497aad3f2c9971868c48: Illegal state: Replica f20672b2852447a6bc1e137c4dd40904 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:11.412794  3051 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:11.333597  7084 raft_consensus.cc:3055] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:11.414183  7084 raft_consensus.cc:740] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:11.415001  7084 consensus_queue.cc:260] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.416509  7084 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:11.418489  7064 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:11.419215  7064 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.337468  6934 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:11.358948  2948 rpcz_store.cc:269] 0709 13:15:53.071897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.072154 (+   257us) service_pool.cc:224] Handling call
0709 13:16:11.358379 (+18286225us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:07.907205 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:07.970022 (+ 62817us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:07.970088 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:16:07.970111 (+    23us) tablet.cc:662] Decoding operations
0709 13:16:07.971993 (+  1882us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:07.972087 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:07.972122 (+    35us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:16:08.006061 (+ 33939us) tablet.cc:701] Row locks acquired
0709 13:16:08.006118 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:16:08.006306 (+   188us) write_op.cc:270] Start()
0709 13:16:08.006481 (+   175us) write_op.cc:276] Timestamp: P: 1783602968006244 usec, L: 0
0709 13:16:08.006509 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:16:08.007301 (+   792us) log.cc:844] Serialized 7419 byte log entry
0709 13:16:08.992809 (+985508us) op_driver.cc:464] REPLICATION: finished
0709 13:16:09.502799 (+509990us) write_op.cc:301] APPLY: starting
0709 13:16:09.542712 (+ 39913us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:09.595641 (+ 52929us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:09.595785 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:09.631367 (+ 35582us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:09.631827 (+   460us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:16:09.631883 (+    56us) write_op.cc:312] APPLY: finished
0709 13:16:09.632379 (+   496us) log.cc:844] Serialized 125 byte log entry
0709 13:16:09.632591 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:09.632774 (+   183us) write_op.cc:454] Released schema lock
0709 13:16:09.632863 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:09.690671 (+ 57808us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:09.693287 (+  2616us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3498215,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":405608,"apply.run_cpu_time_us":5972,"apply.run_wall_time_us":192606,"num_ops":18,"prepare.queue_time_us":347797,"prepare.run_cpu_time_us":33995,"prepare.run_wall_time_us":275931,"raft.queue_time_us":287733,"raft.run_cpu_time_us":11303,"raft.run_wall_time_us":363526,"replication_time_us":951893,"thread_start_us":627085,"threads_started":4,"wal-append.queue_time_us":192038}]]}
I20260709 13:16:11.324839  6848 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:11.424952  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.426792  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.389678  3046 rpcz_store.cc:276] 0709 13:16:10.193503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.929522 (+736019us) service_pool.cc:224] Handling call
0709 13:16:11.389027 (+459505us) spinlock_profiling.cc:243] Waited 70 ms on lock 0x7b54001ae5d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:11.389147 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160955136}
I20260709 13:16:11.429104  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 593) took 1217 ms. Trace:
W20260709 13:16:11.429404  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 318955us
I20260709 13:16:11.429543  3119 rpcz_store.cc:276] 0709 13:16:10.212218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.380192 (+1167974us) service_pool.cc:224] Handling call
0709 13:16:11.428603 (+ 48411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.428789 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.428818 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.428862 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:11.428896 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.428950 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.429051 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.431175  3762 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:11.431993  3125 raft_consensus.cc:1275] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:16:11.432121  3762 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:11.432941  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1936) took 1740 ms. Trace:
I20260709 13:16:11.421351  3042 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:11.435005  3091 leader_election.cc:400] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10.
I20260709 13:16:11.435406  3091 leader_election.cc:403] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:11.435649  3047 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:11.436241  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 637) took 1256 ms. Trace:
I20260709 13:16:11.436528  3047 rpcz_store.cc:276] 0709 13:16:10.180326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.388400 (+1208074us) service_pool.cc:224] Handling call
0709 13:16:11.435342 (+ 46942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.436010 (+   668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.436188 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.386281  3048 rpcz_store.cc:276] 0709 13:16:10.178387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.384172 (+1205785us) service_pool.cc:224] Handling call
0709 13:16:11.384535 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.385522 (+   987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.385715 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.277403  7151 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.439877  3090 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:11.443682  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.433411  3125 rpcz_store.cc:276] 0709 13:16:09.692665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.431103 (+1738438us) service_pool.cc:224] Handling call
0709 13:16:11.431507 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.432620 (+  1113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.432873 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.367568  3045 raft_consensus.cc:2393] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:11.447903  3165 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:11.448513  3043 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 8. Current term is 10. Ops: []
I20260709 13:16:11.447131  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 634) took 1281 ms. Trace:
I20260709 13:16:11.452659  3042 rpcz_store.cc:276] 0709 13:16:10.165328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.380166 (+1214838us) service_pool.cc:224] Handling call
0709 13:16:11.420918 (+ 40752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.433666 (+ 12748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.446911 (+ 13245us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b540028c150. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:11.447071 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92816640}
I20260709 13:16:11.454046  3762 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:11.452090  3124 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:11.462805  3091 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:11.470611  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.470793  3051 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:11.472544  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 640) took 1274 ms. Trace:
I20260709 13:16:11.472960  3049 rpcz_store.cc:276] 0709 13:16:10.197978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.391435 (+1193457us) service_pool.cc:224] Handling call
0709 13:16:11.391848 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.392113 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:11.392478 (+   365us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.472137 (+ 79659us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.472188 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:11.472243 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.472337 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.472491 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37771,"raft.queue_time_us":86,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":79072,"threads_started":1,"wal-append.queue_time_us":79358}
W20260709 13:16:11.473991  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 150497us
I20260709 13:16:11.476697  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:11.475903  3091 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:11.352401  2947 catalog_manager.cc:5697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 5 to 8, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 8 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.487254  3091 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:11.488895  3091 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:11.324421  6982 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:11.493382  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:11.448674  6947 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:11.452060  7063 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:11.452204  7088 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:11.493022  2947 catalog_manager.cc:5697] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.486316  7140 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:11.490016  6634 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:11.487835  7151 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:11.512363  2947 catalog_manager.cc:5697] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.520732  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.491914  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:11.501055  6935 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:11.501849  6910 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:11.469565  7040 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10.
I20260709 13:16:11.527673  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.469497  6980 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:11.474901  6848 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:11.495352  3090 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:11.534950  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.535635  3050 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:11.535748  3090 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:11.502964  7063 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.539517  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:11.525143  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.522976  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:11.526747  2947 catalog_manager.cc:5697] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:11.525938  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 78116.8us
I20260709 13:16:11.492645  6766 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:11.531037  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:11.531898  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:11.531829  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:11.532793  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.533090  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.533771  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:11.496174  6892 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:11.530915  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:11.510229  7140 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.574687  3119 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:16:11.535761  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:11.538630  3048 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:16:11.538829  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:11.579720  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 56826.2us
I20260709 13:16:11.579988  3120 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:11.580482  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:11.508293  7088 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.538971  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:11.510043  7055 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:11.509558  6845 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:11.540283  3122 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:11.574070  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.572377  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.574810  3121 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 7.
I20260709 13:16:11.575531  3051 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:11.587321  3044 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:11.581362  3118 raft_consensus.cc:2376] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11. Re-sending same reply.
I20260709 13:16:11.590400  3047 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:11.575887  3049 raft_consensus.cc:2393] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:11.498375  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 44435.3us
I20260709 13:16:11.524138  6947 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:11.592007  3045 raft_consensus.cc:2410] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:11.509868  7152 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.596081  2947 catalog_manager.cc:5697] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.578275  3091 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:11.578583  3165 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:11.512439  6982 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:11.526849  6920 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:11.541435  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:11.573103  7063 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:11.524991  7151 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:11.495992  7078 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:16:11.598977  3123 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:11.593937  7146 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:11.572372  7075 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:11.494392  6724 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:16:11.607507  3050 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:16:11.616922  3051 raft_consensus.cc:2410] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:16:11.534890  6848 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:11.581664  6892 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:16:11.635061  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet 006a17784d3e4b139686bca788cab915: Illegal state: Replica aaf88538197a49adb8bcf3790309a67e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:11.534336  6935 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:16:11.599061  7010 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:11.597390  6766 raft_consensus.cc:697] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:11.589164  7140 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:11.578327  6634 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:11.606976  6920 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:11.589659  7088 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:11.600981  7149 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.606630  6970 consensus_queue.cc:1059] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:16:11.533402  6934 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:11.652419  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 177233us
I20260709 13:16:11.539939  6980 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.653612  2947 catalog_manager.cc:5697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 5 to 8, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 8 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:11.626164  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 90490.4us
I20260709 13:16:11.618346  7055 raft_consensus.cc:697] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:11.631747  7151 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:11.689126  3090 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:11.645990  7143 consensus_queue.cc:1059] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:16:11.656649  7162 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:11.633790  7075 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.658285  6932 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:11.658874  7172 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.662195  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:11.662492  6589 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:11.620096  6904 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:11.759162  6904 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.759662  6904 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:11.620496  6631 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.666405  6920 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:11.631397  7078 consensus_queue.cc:1243] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:11.651855  6848 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:11.695696  2947 catalog_manager.cc:5697] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:11.697052  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 161346us
I20260709 13:16:11.652899  6892 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:11.698156  3761 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:11.782572  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 84491.5us
I20260709 13:16:11.634402  7064 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.651973  7146 raft_consensus.cc:697] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:11.703226  3050 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:11.667701  7163 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:11.714483  6932 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.798115  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:11.688596  7010 raft_consensus.cc:697] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:11.618999  6982 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.695426  6893 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:11.694748  6941 raft_consensus.cc:3055] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:11.679066  7164 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.668969  6910 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:16:11.669303  7161 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:16:11.715003  7149 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:16:11.654773  6971 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:16:11.726630  7055 consensus_queue.cc:237] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.704131  6845 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:11.811417  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:11.743573  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.786998  6634 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.745371  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:11.739187  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 137776us
I20260709 13:16:11.750349  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1930) took 2471 ms. Trace:
W20260709 13:16:11.751417  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 56529.1us
I20260709 13:16:11.737191  3124 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:11.687340  6947 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:11.758378  7045 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:11.792277  7170 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:11.775874  7169 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:11.776801  7145 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.750996  7172 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.704814  7075 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:11.785817  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 207279us
I20260709 13:16:11.738173  7162 raft_consensus.cc:697] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:11.839588  7162 consensus_queue.cc:237] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.811580  7164 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.802335  6766 consensus_queue.cc:237] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:11.841913  3221 debug-util.cc:398] Leaking SignalData structure 0x7b0800287c40 after lost signal to thread 1937
I20260709 13:16:11.842145  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:16:11.842991  3221 debug-util.cc:398] Leaking SignalData structure 0x7b08002bc2a0 after lost signal to thread 2983
I20260709 13:16:11.843051  7164 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:11.843675  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:11.844319  3221 debug-util.cc:398] Leaking SignalData structure 0x7b08002b4e40 after lost signal to thread 3075
I20260709 13:16:11.845052  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:11.845453  3221 debug-util.cc:398] Leaking SignalData structure 0x7b08000e6700 after lost signal to thread 3150
I20260709 13:16:11.797021  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:11.845633  3792 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 7.
I20260709 13:16:11.845779  7172 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:11.846133  3125 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
W20260709 13:16:11.847772  6661 consensus_meta.cc:287] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.003s
I20260709 13:16:11.848224  6661 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.848656  7024 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.849471  3795 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:11.797776  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:11.850363  7165 log.cc:927] Time spent T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:16:11.851588  6966 raft_consensus.cc:3055] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:11.852082  6966 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:11.852298  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:11.853050  3050 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:11.836995  7145 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.852880  6966 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.834726  6947 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.856389  6947 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:11.786477  3091 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:11.802309  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:11.759205  7040 consensus_queue.cc:1059] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:16:11.784404  7152 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.832626  6634 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.858062  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:11.862507  6661 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:11.824507  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:11.866089  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:11.826879  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:11.889313  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 54758.2us
I20260709 13:16:11.827343  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:11.830052  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 47483.9us
I20260709 13:16:11.891381  3125 raft_consensus.cc:2393] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 11: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:11.891844  3164 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:11.835980  3165 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:11.782902  6631 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.837884  6980 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:11.817461  6990 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:16:11.837598  7146 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.852447  7142 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.798717  3121 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:11.862427  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:11.900259  3792 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:11.858981  7145 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:11.822139  3117 rpcz_store.cc:276] 0709 13:16:09.279382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.221836 (+1942454us) service_pool.cc:224] Handling call
0709 13:16:11.222142 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.387568 (+165426us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:11.511922 (+124354us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.730598 (+218676us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.730834 (+   236us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.730885 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:11.730930 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.750004 (+ 19074us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54001c39d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:11.750068 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.750268 (+   200us) inbound_call.cc:177] Queueing success response
0709 13:16:11.760989 (+ 10721us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b18003fdba0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c6522 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
Metrics: {"prepare.queue_time_us":197325,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":2293,"raft.queue_time_us":6560,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":36653,"spinlock_wait_cycles":414770304,"thread_start_us":299817,"threads_started":2,"wal-append.queue_time_us":268753}
I20260709 13:16:11.803661  6941 raft_consensus.cc:740] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:11.823848  6935 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:16:11.830760  7170 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:11.877442  3221 debug-util.cc:398] Leaking SignalData structure 0x7b0800219aa0 after lost signal to thread 3151
W20260709 13:16:11.878865  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.858783  6893 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:11.879914  3761 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:11.881168  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:11.908321  3124 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:11.859192  7040 raft_consensus.cc:3055] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:11.859443  7152 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.860006  7171 raft_consensus.cc:3055] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:11.860021  3123 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:11.914045  3090 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:11.861248  6634 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:11.861949  6724 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
W20260709 13:16:11.858347  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 71986.8us
I20260709 13:16:11.885025  6966 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:11.824432  7155 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:16:11.873847  7143 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:11.889201  3790 raft_consensus.cc:2410] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:16:11.824347  6845 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:11.901684  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 65802us
I20260709 13:16:11.832221  7169 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.904151  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:11.876269  7156 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:16:11.857262  7151 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:11.898388  7054 consensus_meta.cc:287] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.002s
I20260709 13:16:11.911118  7170 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:11.912237  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:11.833287  6934 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:16:11.905913  7140 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.904639  6980 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:11.906090  7172 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:11.936318  6845 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:11.898622  7024 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:16:11.911610  7040 raft_consensus.cc:740] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:11.936887  6932 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:11.936551  7169 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:11.900521  7088 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.910984  6941 consensus_queue.cc:260] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.913446  7171 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:11.921929  6893 raft_consensus.cc:697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:16:11.964280  7084 consensus_meta.cc:287] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.545s	user 0.012s	sys 0.000s
I20260709 13:16:11.942799  6982 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:11.906124  7063 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.983928  6631 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:11.947844  3761 leader_election.cc:336] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 1.521s (SENT)
I20260709 13:16:11.987537  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:11.934105  7112 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:11.931767  6904 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.990607  6904 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.954608  7140 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:11.990859  6920 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:11.949424  6910 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:11.946794  7162 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:11.957422  6848 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.993702  6910 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:11.994657  6910 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:11.995604  6848 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.993960  7162 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.998538  7162 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:11.957847  7181 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.000206  7181 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:11.907559  3221 debug-util.cc:398] Leaking SignalData structure 0x7b08000e27e0 after lost signal to thread 3224
I20260709 13:16:11.909999  7010 consensus_queue.cc:237] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:11.973259  6941 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:12.004243  7112 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:12.004895  7112 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:11.905890  7142 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.006470  7151 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:11.960415  7180 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:16:12.011701  7040 consensus_queue.cc:260] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:12.013119  7040 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:12.015141  7153 consensus_meta.cc:287] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.651s	user 0.013s	sys 0.000s
I20260709 13:16:12.015671  7153 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:12.020107  7070 consensus_meta.cc:287] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.634s	user 0.015s	sys 0.005s
I20260709 13:16:12.020681  7070 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.022818  7181 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:12.024896  6893 consensus_queue.cc:237] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:12.027542  7142 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:12.028509  7064 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:12.028713  7088 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:12.030282  7152 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:12.031745  7173 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:12.032918  6990 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:12.003823  7171 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.034654  7171 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:11.949209  6980 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:12.038002  6980 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:12.041319  7064 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:12.044051  7163 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:11.993263  6920 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:12.049584  7173 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.050587  7173 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.052681  7153 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:12.054637  3221 debug-util.cc:398] Leaking SignalData structure 0x7b0800404360 after lost signal to thread 3823
W20260709 13:16:12.055194  3221 debug-util.cc:398] Leaking SignalData structure 0x7b08002c90c0 after lost signal to thread 3824
I20260709 13:16:12.023036  7070 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:12.046892  7075 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:12.058916  7063 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:12.059228  7173 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:12.060554  7075 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:12.049655  7169 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.033361  6892 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:12.064414  7187 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:16:12.057224  6990 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.061450  6845 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.076817  6990 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.073844  7112 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.075107  6980 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:12.075848  7172 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:12.081795  7162 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.083545  7169 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:12.084014  7162 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:12.086393  7170 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.088296  7170 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:11.792696  2947 catalog_manager.cc:5697] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:12.118731  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:12.126529  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 236096us
I20260709 13:16:12.131676  3049 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:11.886061  3050 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:11.941506  3124 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:11.930905  3123 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:11.938943  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:12.137563  3126 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:12.075977  6892 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:12.076771  6910 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.152669  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:12.153489  6845 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:12.152724  3797 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:12.158986  6910 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:12.160019  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:12.160346  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:12.161278  3046 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:12.143616  3118 raft_consensus.cc:2393] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:12.163327  3043 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:12.166679  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:12.159979  6910 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.175403  6910 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.176447  7112 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:12.172086  7078 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:12.179062  6910 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:12.148588  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1941) took 1297 ms. Trace:
I20260709 13:16:12.179905  3126 rpcz_store.cc:276] 0709 13:16:10.850644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.394579 (+543935us) service_pool.cc:224] Handling call
0709 13:16:11.394861 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.146738 (+751877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.147987 (+  1249us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b540045a1d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:12.148453 (+   466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1706336000}
I20260709 13:16:12.180783  7170 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.168727  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:12.170087  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:12.170549  7070 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:12.171427  6934 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.183009  7170 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.186288  7145 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.187364  7145 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.188671  6990 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:12.158515  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:12.183112  6934 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.146872  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:12.194585  6982 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:12.197767  6980 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:12.199152  3048 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
W20260709 13:16:12.189571  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 250568us
I20260709 13:16:12.203510  3047 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:16:12.204015  7145 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:12.207089  6934 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:12.212689  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:12.215126  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.216033  3199 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:12.216897  3045 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:12.218595  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:12.221982  3050 raft_consensus.cc:2393] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 9: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:12.213929  3048 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:12.214071  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:12.236008  3042 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:12.242627  3043 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:12.121582  2947 catalog_manager.cc:5697] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 6 to 7, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 7 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:12.245306  6892 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.249962  6892 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:12.252616  6892 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:12.248307  3126 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:12.253883  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:12.254771  3048 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:12.258921  3090 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:12.259714  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:12.259841  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:12.259744  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:12.260762  3123 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:12.260984  3124 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:12.246492  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 116832us
I20260709 13:16:12.246017  2947 catalog_manager.cc:5697] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 3 to 10. New cstate: current_term: 10 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:12.266132  7170 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:12.274582  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:12.282843  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:12.284636  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:12.285703  3117 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:12.276041  7166 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:12.285497  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:12.291000  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.291430  3797 raft_consensus.cc:2410] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:16:12.291797  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.291945  3090 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:12.293637  6941 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:12.286866  2947 catalog_manager.cc:5697] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 8 to 9, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 9 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:12.295461  7010 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:12.298080  3199 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:16:12.297143  3090 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:12.297082  2947 catalog_manager.cc:5697] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 4 to 7, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 7 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:12.303292  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:12.305075  6845 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:12.305799  6845 raft_consensus.cc:697] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:12.307051  6845 consensus_queue.cc:237] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:12.313310  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:12.315220  7145 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:12.315726  7145 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.316088  7145 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:12.316704  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:12.317304  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:12.317561  3042 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:12.321996  6893 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:12.322121  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.333529  3192 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:16:12.334113  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.336011  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:12.343070  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.344097  3200 raft_consensus.cc:2393] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 9: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:12.345808  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:12.347270  7171 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:12.348119  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.348282  7171 raft_consensus.cc:697] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:12.348430  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.348850  3195 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:16:12.349509  7171 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.350417  2947 catalog_manager.cc:5697] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:12.352064  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:12.352643  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:12.342393  3124 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:12.337726  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:12.360996  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.373500  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:12.374972  3121 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:12.375644  2947 catalog_manager.cc:5697] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:12.377210  2947 catalog_manager.cc:5697] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 7 to 8, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 8 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:12.378724  7188 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:12.381412  7188 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.381937  7188 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:12.382141  3193 raft_consensus.cc:2368] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10.
W20260709 13:16:12.386775  7192 log.cc:927] Time spent T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:16:12.390179  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.379662  3164 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:12.391155  3193 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:12.391036  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.391392  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.391773  3198 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:12.392302  3192 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:12.392725  3191 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:12.393122  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:12.393260  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.390339  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.394115  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.394930  3195 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:12.395236  3191 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:16:12.394358  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.395835  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:12.396291  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:12.396536  3195 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:12.396544  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.397920  3194 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:12.392753  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.399463  3198 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:12.394809  3192 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:12.393859  3196 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:12.408766  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:12.409777  3123 raft_consensus.cc:2393] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 11: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:12.361068  6892 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:12.403610  7188 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.398075  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:12.413125  3191 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:16:12.414369  3048 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:12.414631  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:12.415851  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:12.416702  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:12.425594  3042 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:12.417423  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:12.418278  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:12.419091  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:12.427464  3196 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:12.428546  3117 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
W20260709 13:16:12.429426  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 77563.4us
I20260709 13:16:12.428534  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:12.430873  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:12.432073  3046 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:12.432701  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:12.436146  3199 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
W20260709 13:16:12.442297  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 44386.2us
I20260709 13:16:12.446784  3051 raft_consensus.cc:2393] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:12.449889  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:12.452487  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:12.457885  3122 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 11: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:12.459646  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:12.459100  3196 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:12.464159  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.465179  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:12.465269  3191 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:16:12.454622  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:12.451431  7166 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:12.464174  3126 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:12.462213  7163 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:16:12.462258  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:12.466486  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:12.461691  7105 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:12.466611  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:12.473470  3121 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:12.457885  7170 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:12.474694  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:12.479583  3120 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:16:12.478188  3123 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:12.482861  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:12.483320  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.493355  3117 raft_consensus.cc:2410] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:16:12.461571  7145 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:12.494760  6934 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:12.476775  7105 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.492071  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:12.486676  7170 raft_consensus.cc:697] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:12.500331  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:12.501093  3045 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:12.510473  3125 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:12.511109  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:12.513633  3199 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:12.503542  7105 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:12.546351  3044 raft_consensus.cc:1217] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Deduplicated request from leader. Original: 4.2->[7.3-11.5]   Dedup: 7.3->[9.4-11.5]
I20260709 13:16:12.546428  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.550981  3044 pending_rounds.cc:85] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 3
I20260709 13:16:12.545958  7166 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:16:12.556296  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 118381us
I20260709 13:16:12.551311  3044 pending_rounds.cc:107] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:16:12.554143  3196 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:12.554869  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.557577  3044 raft_consensus.cc:2889] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:12.562074  3118 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:16:12.568702  3200 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:16:12.569661  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 60642.1us
I20260709 13:16:12.571974  3762 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:12.575763  7194 log.cc:927] Time spent T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:16:12.598217  3042 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:12.599925  7064 consensus_queue.cc:1059] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:16:12.601265  7064 raft_consensus.cc:3055] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:12.547825  7170 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.601682  7064 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:12.602777  7064 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.604091  7064 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:12.604256  3050 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:12.604796  3164 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:12.610561  3762 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:12.612471  6990 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:12.613108  6990 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:12.613303  7145 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:12.613646  6990 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:12.564361  7188 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:12.622401  3126 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:12.594940  7163 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.626111  6845 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.649816  7148 raft_consensus.cc:2764] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:16:12.632284  6910 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:12.658315  6910 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.638509  7145 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:12.658958  6910 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:12.659204  7145 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:12.659971  7145 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:12.641696  7112 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:16:12.662882  3091 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:12.666733  6892 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:12.667220  6892 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.667673  6892 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:12.632434  7163 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:12.674279  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.674858  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.674959  3196 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:12.675544  3192 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:12.676612  7163 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:12.676743  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.680181  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.680547  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.634065  6845 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:12.681514  3193 raft_consensus.cc:2393] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 12: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:12.684151  3191 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:16:12.686347  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 136324us
I20260709 13:16:12.689471  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.691638  7148 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:12.692111  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.693979  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.695000  3200 raft_consensus.cc:2368] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11.
I20260709 13:16:12.695051  7164 raft_consensus.cc:3055] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:12.695716  7164 raft_consensus.cc:740] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:12.696364  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.697160  3198 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:12.696898  7164 consensus_queue.cc:260] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:12.698594  7164 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:12.700001  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:12.706120  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 63187.2us
W20260709 13:16:12.706822  7197 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:16:12.712008  6845 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:12.714850  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:12.718492  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:12.719455  3121 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:16:12.693042  7148 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:12.689357  3164 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:12.733080  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:12.665548  3091 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:12.736666  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:12.738803  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:12.740572  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.742491  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:12.743230  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:12.743940  3126 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:12.744112  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:12.741425  3198 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:16:12.746892  6934 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:12.746132  3121 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 13: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:12.748284  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:12.748356  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:12.627410  7166 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:12.755136  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 89645.2us
I20260709 13:16:12.755743  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.767339  3117 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
W20260709 13:16:12.785779  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.766408  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:12.754714  7188 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:12.786586  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:12.787257  3091 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:12.752168  6845 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.786720  3194 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:12.792969  7075 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:12.793532  7075 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.793956  7075 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:12.801390  3123 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:12.763815  7078 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:16:12.812057  3015 connection.cc:256] RPC call timeout handler was delayed by -1.194854161999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
W20260709 13:16:12.812932  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.813840  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:12.814757  3198 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:12.816320  3124 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:12.816893  3121 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:16:12.817960  3118 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:16:12.819531  3193 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:12.820874  3193 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:16:12.822268  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:12.822456  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.822763  3197 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:12.823590  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:12.824635  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:12.826354  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.808604  3122 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
W20260709 13:16:12.807696  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 118555us
W20260709 13:16:12.813508  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0380555879999065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
I20260709 13:16:12.833169  3199 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:16:12.832996  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 171140us
W20260709 13:16:12.833439  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 72975.7us
I20260709 13:16:12.834807  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.835837  3199 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:12.837270  3120 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:16:12.841068  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:12.843410  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:12.852339  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:12.852507  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:12.857451  3123 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:12.860944  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:12.863070  3042 raft_consensus.cc:2410] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:16:12.864080  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.869410  3045 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:12.866568  3194 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:16:12.807046  6845 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:12.876638  3761 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:12.867092  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:12.882972  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 176006us
I20260709 13:16:12.884863  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.877581  7170 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:12.890487  3119 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:12.896203  3192 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:12.897969  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.898615  3194 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:12.866743  7163 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:16:12.852815  7078 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.892714  7170 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.910202  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:12.898231  6941 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:12.909294  7170 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:12.935766  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 61364us
I20260709 13:16:12.934458  3762 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:12.914877  6941 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:12.940486  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 94652.8us
W20260709 13:16:12.938503  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 66887.2us
I20260709 13:16:12.916302  7040 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:12.942281  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:12.926478  7105 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.944715  7202 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:12.933514  7054 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 13:16:12.949534  7055 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:12.951593  7078 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:12.940037  6941 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:12.995222  3051 raft_consensus.cc:1240] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:16:12.956770  6910 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:12.959465  7145 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:12.962359  7112 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:12.983505  3164 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:12.986785  7055 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:12.996416  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:12.996081  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:13.010958  3042 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:13.005080  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:13.014361  3194 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:13.015408  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:13.019316  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 85333.3us
I20260709 13:16:13.022557  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:13.023566  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:12.996063  7166 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:13.031319  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 121027us
I20260709 13:16:13.038002  3043 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:16:13.039027  7055 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:13.039714  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.041467  3046 raft_consensus.cc:1240] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:13.042630  3048 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:13.027040  7040 raft_consensus.cc:697] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:13.041011  7055 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:13.044260  7040 consensus_queue.cc:237] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:13.047230  6934 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:13.047902  6934 raft_consensus.cc:697] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:13.033324  7148 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:13.049655  7148 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.050050  7148 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:13.095965  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:13.097258  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 152850us
W20260709 13:16:13.098570  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 53279.9us
W20260709 13:16:13.099165  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 86997.3us
I20260709 13:16:13.095135  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:13.101022  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:13.103288  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:13.103639  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:13.104748  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:13.106866  3051 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:13.108487  6910 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:13.109601  7206 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 13:16:13.111516  7201 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.297s	user 0.000s	sys 0.003s
I20260709 13:16:13.112888  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:13.113160  7199 log.cc:927] Time spent T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.320s	user 0.002s	sys 0.000s
W20260709 13:16:13.120615  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 88864.9us
I20260709 13:16:13.091729  7166 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.100203  7202 raft_consensus.cc:697] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:13.138116  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:13.138945  7202 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:13.139840  7070 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:13.141831  7163 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:13.126799  6845 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:13.142464  7163 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.142957  7163 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:13.144166  6990 consensus_meta.cc:287] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.014s
I20260709 13:16:13.144588  6990 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:13.127980  7208 log.cc:927] Time spent T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:16:13.145844  3164 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:13.147269  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:13.148108  7164 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:13.147727  6941 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:13.048866  6934 consensus_queue.cc:237] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:13.122540  6893 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:13.149852  6893 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:13.150411  6893 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:13.135893  7145 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:13.136818  7105 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:13.154114  6990 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:13.148876  7164 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:16:13.158201  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 83731.1us
I20260709 13:16:13.165069  3043 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:13.172145  3164 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:13.174540  3164 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:13.175582  7105 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:13.176029  7105 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.175829  3164 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:13.176534  7105 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:13.180732  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 144707us
I20260709 13:16:13.183154  7145 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:13.178386  6892 consensus_meta.cc:287] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.510s	user 0.005s	sys 0.009s
I20260709 13:16:13.170922  7164 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.124321  7112 raft_consensus.cc:697] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:13.181959  7188 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:13.183776  7145 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:13.167150  7166 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:13.185781  7040 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.237775  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:13.192425  7164 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:13.235921  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 134958us
I20260709 13:16:13.237396  7145 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:13.242616  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 143361us
I20260709 13:16:13.243924  3761 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:13.245286  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 101616us
I20260709 13:16:13.192162  6892 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:13.214756  7188 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:13.250013  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:13.251034  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:13.244058  6910 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:13.249696  7064 consensus_meta.cc:287] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.645s	user 0.016s	sys 0.000s
I20260709 13:16:13.251927  6910 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.252425  6910 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:13.254964  7166 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:13.256269  7225 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:13.191529  7148 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:13.257678  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 154592us
I20260709 13:16:13.249768  7040 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:13.259498  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.251662  3049 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:13.260020  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:13.266476  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 66341.8us
I20260709 13:16:13.276283  3125 raft_consensus.cc:2393] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:13.248917  7188 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:13.279237  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:13.259326  7148 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:13.276793  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:13.261360  7171 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:16:13.286360  7222 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:16:13.287312  6892 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:13.298617  3164 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:13.286998  7164 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:13.288141  6941 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:13.245671  7075 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:13.294958  7170 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:13.281404  7225 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.260879  6845 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 13:16:13.310809  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 119863us
I20260709 13:16:13.315440  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:13.318984  3119 raft_consensus.cc:2393] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 11: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:13.319510  3044 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:13.310142  7164 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:13.321806  3049 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:13.338835  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:13.313272  6910 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:13.341028  7229 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:16:13.341214  6892 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:13.342602  6910 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:13.343211  3044 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:13.343314  7225 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:13.344007  7070 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.340847  3090 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:13.344641  7070 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:13.338232  6893 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:13.319792  7112 consensus_queue.cc:237] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:13.382273  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 122936us
I20260709 13:16:13.383756  3797 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:13.385778  3047 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:13.337546  7171 raft_consensus.cc:697] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 12 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:13.386327  3797 raft_consensus.cc:606] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:13.389894  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:13.390347  3797 raft_consensus.cc:614] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:13.390527  3044 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:13.346789  7166 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:13.320851  7148 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:16:13.391391  7166 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.377242  6892 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:13.436264  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 51960.6us
I20260709 13:16:13.436472  3090 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:13.437093  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 44978.3us
W20260709 13:16:13.439625  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 189673us
I20260709 13:16:13.440461  3048 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:13.384344  6941 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:13.442938  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:13.438326  3762 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:13.449725  3091 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:13.488317  3762 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:13.436028  7166 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:13.437175  7040 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:13.490609  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 46810.2us
I20260709 13:16:13.436404  6892 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:13.491159  7055 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:13.494002  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 63563.9us
I20260709 13:16:13.495122  3049 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:13.502888  7040 consensus_queue.cc:1059] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:16:13.493367  7070 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:13.509943  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 61005.4us
I20260709 13:16:13.517521  3165 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:13.494776  6892 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:13.494254  7202 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:13.521080  3044 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:13.518771  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:13.522214  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 223681us
I20260709 13:16:13.524868  3051 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:13.516892  7216 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:13.495406  6845 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:13.523394  7202 raft_consensus.cc:697] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:13.531793  7237 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:13.523442  7209 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.510469  7075 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:13.532027  7145 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:13.547345  7170 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:13.545620  7148 consensus_queue.cc:1059] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:16:13.515060  6910 consensus_queue.cc:1059] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:16:13.538206  7239 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:13.541918  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:13.506461  6893 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:13.548389  7225 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:13.551872  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 166635us
I20260709 13:16:13.533811  7228 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:13.519656  7229 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:16:13.555604  3761 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:13.544777  6845 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.546015  7237 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.556721  7209 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:13.561460  7221 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:13.547363  7202 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:13.562032  7221 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.562608  7221 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:13.565295  7237 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:13.571785  7209 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:13.572544  3090 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:13.574137  7209 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:13.572626  7188 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:13.574404  3090 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:13.575035  7145 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:13.549901  7216 raft_consensus.cc:697] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:13.513592  7171 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:13.591717  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:13.559780  6845 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:13.545037  7163 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:13.598639  6893 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:13.603304  3090 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:13.603464  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 81965.2us
I20260709 13:16:13.611141  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:13.617482  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:13.618517  3051 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:13.620277  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:13.616608  3091 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:13.622314  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:13.626065  3048 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:13.615984  7209 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:13.600530  7105 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:13.575160  7228 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:13.617942  7070 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:13.633554  7231 raft_consensus.cc:2764] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:16:13.633890  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:13.630064  7241 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.054s	user 0.003s	sys 0.000s
I20260709 13:16:13.633724  7216 consensus_queue.cc:237] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:13.634321  7248 consensus_queue.cc:1059] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:13.633422  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:13.640401  7164 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:13.644236  7221 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:13.684409  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:13.645187  7055 raft_consensus.cc:3055] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:13.632138  3047 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:13.634022  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:13.686633  3123 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:13.686854  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:13.651582  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 52475.7us
I20260709 13:16:13.688640  3090 leader_election.cc:400] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10.
I20260709 13:16:13.689055  3090 leader_election.cc:403] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:16:13.689121  3792 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:16:13.652313  7212 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:13.652395  7105 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:13.691411  3792 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:13.631747  7209 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:13.658697  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:13.659715  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:13.692229  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 47528.2us
I20260709 13:16:13.660732  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:13.662196  3799 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:16:13.662366  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:13.663048  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:13.664361  3798 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:16:13.665868  7163 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:13.666028  7237 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:13.690052  7253 consensus_queue.cc:1059] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:13.680322  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:16:13.681211  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 67401us
I20260709 13:16:13.655643  3797 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 7.
I20260709 13:16:13.692111  7209 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:13.707270  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:13.692850  3795 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:13.718125  3118 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:13.708102  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:13.669772  3051 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:13.693809  7055 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:13.717033  7166 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:13.720197  7055 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:13.721210  7055 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:13.714912  7228 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:13.711613  7212 raft_consensus.cc:697] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:13.718735  3119 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:13.722347  7188 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:13.684556  7164 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:13.729879  3165 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:13.718894  7231 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:13.721571  7166 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:13.717255  7171 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.742214  3791 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 12 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:13.736575  3051 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:13.727327  7145 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:16:13.749682  3794 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:13.752521  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:13.754017  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:13.754730  3047 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:13.757398  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 69042.5us
I20260709 13:16:13.758589  3045 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:16:13.759711  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:13.760876  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:13.761482  3122 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:13.761870  7163 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.762523  7163 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:13.763650  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:13.764768  7252 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:13.761085  7253 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:16:13.765226  7163 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:13.766920  3122 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:13.767374  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:13.769395  3191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:16:13.770092  3191 raft_consensus.cc:606] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:13.770418  3191 raft_consensus.cc:614] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:13.770928  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:13.771514  7243 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10.
I20260709 13:16:13.757009  6893 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:13.772753  7164 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:13.774050  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:13.774245  7164 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:13.774688  3042 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:13.770938  3051 raft_consensus.cc:3055] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:13.770336  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:13.776028  3051 raft_consensus.cc:740] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:13.771631  3120 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:16:13.780268  3123 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:13.780730  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:13.781417  3045 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:13.733976  7231 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:13.788241  7231 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:13.783077  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:13.789302  3044 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:13.789793  7223 raft_consensus.cc:3055] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:13.790232  7223 raft_consensus.cc:740] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:13.791074  7223 consensus_queue.cc:260] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:13.792429  7223 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:13.744237  7188 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:13.757081  7070 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:16:13.794250  7188 raft_consensus.cc:697] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:13.729902  6892 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:13.795343  7188 consensus_queue.cc:237] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:13.797613  6892 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:13.786767  7211 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.661s	user 0.009s	sys 0.003s
I20260709 13:16:13.787046  7212 consensus_queue.cc:237] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:13.799013  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:13.783550  6941 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:16:13.801072  6941 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:13.801896  6941 consensus_queue.cc:1243] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 8.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:13.802646  7221 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:13.757565  7171 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:13.771698  7170 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:13.815018  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:13.815631  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:13.816296  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:13.817063  3194 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:13.818372  3090 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:13.752701  7228 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:16:13.820178  7171 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:13.820556  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:13.821218  3192 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:13.799719  3043 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:13.808885  3044 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:13.825142  6845 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:13.744925  7237 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:13.810758  3051 consensus_queue.cc:260] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:13.827486  3051 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:13.828860  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:13.829010  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:13.829833  3048 raft_consensus.cc:2368] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10.
I20260709 13:16:13.830145  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:13.809088  3790 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:13.814813  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:13.830749  3121 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:16:13.815851  3193 raft_consensus.cc:2368] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11.
W20260709 13:16:13.831630  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.820117  3090 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:13.833173  3043 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:13.843235  3195 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:13.844739  3200 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:13.846115  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:13.847375  3044 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:13.848465  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:13.846186  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:13.852559  3119 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:13.810827  3126 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:13.857801  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:13.858901  3165 leader_election.cc:400] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10.
I20260709 13:16:13.859447  3165 leader_election.cc:403] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:16:13.861791  3192 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
W20260709 13:16:13.820037  7218 log.cc:927] Time spent T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.709s	user 0.009s	sys 0.002s
I20260709 13:16:13.865209  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:13.865931  3196 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:13.867022  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:13.868170  3048 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:13.876618  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:13.880110  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:16:13.882398  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 121595us
I20260709 13:16:13.860172  6892 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:13.882746  3091 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:13.886196  3165 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:13.887815  3047 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:16:13.889632  3042 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:13.890293  3118 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:13.887372  7248 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:13.895502  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 1969) took 1131 ms. Trace:
I20260709 13:16:13.899251  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1970) took 1109 ms. Trace:
I20260709 13:16:13.862231  7075 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:16:13.910737  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:13.909464  3125 rpcz_store.cc:276] 0709 13:16:12.763652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.764143 (+   491us) service_pool.cc:224] Handling call
0709 13:16:13.895255 (+1131112us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54003e7e54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:13.895413 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1098255232}
I20260709 13:16:13.872764  7237 consensus_queue.cc:1059] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:16:13.872730  7064 consensus_queue.cc:1059] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:16:13.886998  7055 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:13.918249  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.919121  3051 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:16:13.918867  3761 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:13.885591  6892 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:13.916134  3165 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:13.919543  3051 pending_rounds.cc:85] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 8
I20260709 13:16:13.919963  3051 pending_rounds.cc:107] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:16:13.920250  3051 raft_consensus.cc:2889] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:13.921418  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 101450us
I20260709 13:16:13.894062  7225 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:13.906296  6941 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:13.909504  3117 rpcz_store.cc:276] 0709 13:16:12.789508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.797831 (+  8323us) service_pool.cc:224] Handling call
0709 13:16:12.798210 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:12.915519 (+117309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:12.915565 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:12.916248 (+   683us) log.cc:844] Serialized 26 byte log entry
0709 13:16:13.023550 (+107302us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:13.023604 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.145485 (+121881us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400216e54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:13.145532 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.819261 (+673729us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:13.899010 (+ 79749us) raft_consensus.cc:1685] finished
0709 13:16:13.899031 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.899175 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276443264,"thread_start_us":49572,"threads_started":1,"wal-append.queue_time_us":166469}
I20260709 13:16:13.909379  7166 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:13.927911  3196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:16:13.928521  3196 raft_consensus.cc:606] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:13.928817  3196 raft_consensus.cc:614] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:13.931967  3042 raft_consensus.cc:1240] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:16:13.920810  7055 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:13.935348  7055 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:13.933517  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:13.938004  3196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:16:13.921638  6892 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:13.924297  7225 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.941864  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:13.942569  3194 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:13.943724  3015 leader_election.cc:400] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11.
I20260709 13:16:13.944252  3015 leader_election.cc:403] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:13.924280  7145 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:13.930002  6941 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:13.951840  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.952455  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:13.952750  3192 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:13.934005  7064 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:13.941530  7225 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:13.956617  3191 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 8: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:13.942103  7253 raft_consensus.cc:3055] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:13.945484  7166 raft_consensus.cc:697] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:13.966704  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:13.947644  7229 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:13.941804  7223 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:16:13.953531  6941 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:13.979414  3761 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:13.950222  7112 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:16:13.961166  6845 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:13.964063  7145 raft_consensus.cc:697] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:13.992542  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:13.994833  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:13.971331  7253 raft_consensus.cc:740] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:13.974772  6893 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:13.992748  7226 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.649s	user 0.003s	sys 0.000s
I20260709 13:16:13.991842  7229 raft_consensus.cc:697] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 12 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:14.028236  6893 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:14.035436  3117 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 7.
I20260709 13:16:14.037400  6893 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:14.017912  7064 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:14.016948  7040 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.039634  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:14.028371  7070 raft_consensus.cc:2764] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:16:14.069569  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46426.7us
W20260709 13:16:14.073392  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 97997.7us
I20260709 13:16:14.026031  6990 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:16:14.076294  7237 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:14.079182  7205 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.010s	sys 0.036s
I20260709 13:16:14.079602  7236 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:14.079663  7145 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.080396  7268 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.080622  7253 consensus_queue.cc:260] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.088546  7055 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.096930  7105 raft_consensus.cc:3055] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:14.097405  3164 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:14.097719  7239 raft_consensus.cc:3055] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:14.097981  7229 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:14.098631  3194 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:16:14.104405  7252 consensus_queue.cc:1059] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:14.105757  3042 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:14.047399  7260 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.045347  7240 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11.
I20260709 13:16:14.069796  7238 raft_consensus.cc:2764] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:16:14.125567  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 47561.4us
W20260709 13:16:14.118048  7205 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.010s	sys 0.036s
I20260709 13:16:14.050594  7040 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:14.116876  7236 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.118613  7170 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:14.146023  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 69653.8us
I20260709 13:16:14.132302  7105 raft_consensus.cc:740] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:14.153029  3045 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:14.117878  7237 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.131896  7239 raft_consensus.cc:740] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:16:14.157756  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 60446.9us
I20260709 13:16:14.163044  3197 raft_consensus.cc:3055] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:14.166910  3197 raft_consensus.cc:740] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:14.161536  3165 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:14.105898  7166 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.133116  7163 consensus_queue.cc:1059] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:16:14.162660  7261 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:14.206218  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:14.156143  7236 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:14.208707  3119 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:14.209112  3192 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:14.172075  3197 consensus_queue.cc:260] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:14.172835  7265 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:16:14.163247  7010 raft_consensus.cc:2764] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:16:14.173241  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:14.173849  7188 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:14.177449  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:14.220479  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.158595  7252 consensus_queue.cc:1059] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:16:14.178417  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:14.179088  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:14.179173  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:14.222115  3795 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:14.180600  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:14.183269  7040 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:14.189909  3051 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:14.190200  7105 consensus_queue.cc:260] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.142977  7260 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:14.203230  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:14.204264  3045 raft_consensus.cc:3055] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:14.228458  3045 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:14.225804  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:14.201400  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:14.141805  7209 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.209112  3118 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:14.209991  3197 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:14.132072  7268 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:14.219807  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.178148  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:14.178352  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:16:14.222532  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 342835us
I20260709 13:16:14.223690  3191 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:14.229216  3045 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:14.248425  7216 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:14.275081  3045 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:14.274417  3091 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:14.252724  7209 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:14.244225  6893 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:14.210542  7202 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 13:16:14.246905  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 79758.3us
I20260709 13:16:14.230247  7239 consensus_queue.cc:260] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:14.205099  7240 consensus_queue.cc:1059] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:16:14.251540  7064 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:14.290851  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:14.291539  7240 raft_consensus.cc:3055] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:14.291910  7240 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:14.292629  3794 raft_consensus.cc:1240] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:16:14.243778  7248 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10.
I20260709 13:16:14.281294  7251 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:14.229771  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.294147  7251 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.292775  7240 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.245458  7231 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.277566  3791 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 9: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:14.277623  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:14.277935  6892 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:14.287531  7105 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:14.287993  7277 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:14.268460  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:14.246179  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 44853us
I20260709 13:16:14.281946  6845 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:14.304543  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:14.308111  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:14.308825  3798 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:14.310534  7055 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:14.298327  3793 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:14.314227  3792 raft_consensus.cc:2955] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Committing config change with OpId 8.5: config changed from index 2 to 5, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:14.406126  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:14.315804  7148 raft_consensus.cc:3055] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:14.316752  3043 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:14.317683  7236 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.319981  7279 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.320441  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:14.321377  7268 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:14.321890  7239 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:14.322227  7253 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:14.322542  3799 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:16:14.322907  7260 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:14.323469  3049 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:14.420295  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 99911.9us
I20260709 13:16:14.324293  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:14.421526  3797 raft_consensus.cc:2410] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:14.324991  7231 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:14.331257  7164 consensus_meta.cc:287] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.557s	user 0.012s	sys 0.001s
I20260709 13:16:14.320016  7220 raft_consensus.cc:3055] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:14.277818  7216 raft_consensus.cc:697] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:16:14.347626  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.369393  3197 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:14.300755  3045 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:14.410916  7148 raft_consensus.cc:740] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:14.382625  7224 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:14.383592  7221 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:14.384400  7064 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:14.399830  3048 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:14.378860  3761 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:14.500823  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 122057us
I20260709 13:16:14.407864  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:14.317078  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:14.370447  7010 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:14.412845  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 144546us
I20260709 13:16:14.414930  3125 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:14.414636  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:14.399631  7240 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:14.414404  7238 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:14.423072  7055 raft_consensus.cc:2764] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:16:14.414682  6845 raft_consensus.cc:697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:14.497192  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:14.503273  3044 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:14.506028  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:14.507637  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.509284  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:14.419826  7188 raft_consensus.cc:697] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:14.426537  7220 raft_consensus.cc:740] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:14.519830  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:14.520143  3164 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:14.511946  3046 raft_consensus.cc:2368] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9.
I20260709 13:16:14.494647  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:14.522104  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:14.514026  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:14.511262  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.513026  3119 raft_consensus.cc:2393] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:14.503793  7251 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:14.513490  7268 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:14.530328  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:14.420876  7279 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.540212  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:14.540231  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:14.521921  6893 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.522555  6934 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.543831  3164 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:14.513723  7010 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.516007  7219 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:16:14.549417  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:14.555605  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:14.525353  7231 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:14.517503  6990 consensus_queue.cc:1059] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
W20260709 13:16:14.560109  7287 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:16:14.560222  7281 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:14.549017  6934 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:14.561062  6941 consensus_meta.cc:287] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.000s
I20260709 13:16:14.561168  7188 consensus_queue.cc:237] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.562654  6934 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:14.549081  7148 consensus_queue.cc:260] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.563724  7148 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:14.546432  7268 raft_consensus.cc:697] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:16:14.557063  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 58160.6us
I20260709 13:16:14.549018  6893 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:14.568533  3164 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:14.579702  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:14.580327  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.580606  3119 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 12: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
W20260709 13:16:14.558019  7225 consensus_meta.cc:287] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.001s
I20260709 13:16:14.555053  7070 raft_consensus.cc:2764] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:16:14.583374  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:14.554822  7251 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:14.588361  3164 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:14.561591  6941 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.585801  6845 consensus_queue.cc:237] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.594072  6941 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:14.594846  3050 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 14: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:14.592095  7010 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:14.601281  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 45763.6us
I20260709 13:16:14.605953  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:14.607311  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:14.602474  3122 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:14.581331  7252 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.581529  7281 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:14.646181  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:14.647908  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 48550.9us
I20260709 13:16:14.565594  7268 consensus_queue.cc:237] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:14.647601  3045 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:14.644846  7251 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:14.652137  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 46289.7us
I20260709 13:16:14.649271  3048 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:14.653036  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:14.654237  3122 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 13:16:14.648186  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:14.656044  3191 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:14.609023  7166 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:14.586302  7225 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.592155  7279 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:14.662969  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 74700.2us
I20260709 13:16:14.668289  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:14.650641  7212 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:14.660132  7240 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:14.659732  7236 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:14.582774  7216 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:14.671067  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 104873us
I20260709 13:16:14.673609  3119 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:14.673787  3090 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:14.671844  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:14.660605  7070 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:14.674639  3122 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:14.657558  7164 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
W20260709 13:16:14.677832  7289 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 13:16:14.678737  7286 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:16:14.679566  7273 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.549s	user 0.005s	sys 0.000s
I20260709 13:16:14.686583  7274 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:14.687112  7280 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:16:14.687789  7257 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.769s	user 0.004s	sys 0.000s
I20260709 13:16:14.690531  6893 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:14.736343  3047 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:16:14.694087  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.694504  6892 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:14.665614  7166 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:14.739691  7166 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:14.742399  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2489) took 1059 ms. Trace:
I20260709 13:16:14.742781  3049 rpcz_store.cc:276] 0709 13:16:13.682573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.707045 (+ 24472us) service_pool.cc:224] Handling call
0709 13:16:13.715013 (+  7968us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.420810 (+705797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.742163 (+321353us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54003c2dd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:14.742314 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1398890368}
I20260709 13:16:14.695936  7237 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:14.671945  6941 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:14.652385  7252 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.716017  3120 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:14.717469  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:16:14.722289  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 54040.8us
I20260709 13:16:14.681495  7220 consensus_queue.cc:260] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:14.710263  7240 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:14.729243  7225 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:14.718257  7274 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:14.718385  7261 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:14.731246  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:14.806653  3118 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:14.731302  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:14.732416  3790 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:14.807358  3122 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:14.733515  3194 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:16:14.671167  7212 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:14.735292  3165 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:16:14.810549  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 75360.7us
I20260709 13:16:14.751505  3090 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:14.769424  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 52052.6us
I20260709 13:16:14.769821  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:14.812911  3120 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
W20260709 13:16:14.775628  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.779735  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:14.734058  6845 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:14.802467  7240 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.808169  3194 pending_rounds.cc:85] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 9
I20260709 13:16:14.815429  3194 pending_rounds.cc:107] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:16:14.815766  3194 raft_consensus.cc:2889] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:14.815788  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 64431.6us
I20260709 13:16:14.818411  3090 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:14.763942  7239 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:16:14.781559  7205 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:14.814987  7166 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:14.811000  7274 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:14.813476  7212 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:14.831420  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 51809.3us
I20260709 13:16:14.821978  7055 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:14.854265  3090 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:14.816457  7163 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:16:14.827553  6941 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:14.833240  7225 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:14.864610  7243 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:14.866767  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:14.918259  3049 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 10: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:14.867611  7293 log.cc:927] Time spent T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:16:14.856953  6892 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:16:14.859120  7075 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:14.817008  7261 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:14.879241  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.830245  7166 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.830498  6845 raft_consensus.cc:697] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:14.883549  3118 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:14.826956  7205 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:14.940279  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.851006  7220 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:14.897154  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.902944  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 48727.1us
I20260709 13:16:14.919811  3196 raft_consensus.cc:606] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:14.941318  3196 raft_consensus.cc:614] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:14.927031  7252 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:14.928109  7166 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:14.934425  7291 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:16:14.936792  3120 raft_consensus.cc:1217] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 8.8->[10.9-10.9]   Dedup: 10.9->[]
W20260709 13:16:14.950037  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.921504  7225 raft_consensus.cc:697] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:14.983976  3164 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:14.983994  3120 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:16:14.975395  7205 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:14.995405  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.919991  7010 consensus_queue.cc:1059] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:16:14.975930  7148 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.998224  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:14.999603  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:14.999521  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:14.997241  7164 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:14.985692  6893 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:16:15.007835  3164 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:15.008909  7040 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:16:15.015460  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:15.017417  7010 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:15.005535  7237 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:15.022516  7237 raft_consensus.cc:697] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:15.026230  6845 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:14.998678  7240 consensus_queue.cc:1059] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:16:15.005393  7054 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:15.041594  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:15.041831  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:15.042379  3118 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:15.042958  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:15.033914  7237 consensus_queue.cc:237] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:15.046625  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:15.047271  3119 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:16:15.050136  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 589) took 1239 ms. Trace:
I20260709 13:16:15.050629  3197 rpcz_store.cc:276] 0709 13:16:13.811092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.811236 (+   144us) service_pool.cc:224] Handling call
0709 13:16:13.826108 (+ 14872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.424710 (+598602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.049867 (+625157us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54003bae54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:15.050038 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":774540032}
I20260709 13:16:15.003690  7148 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:15.039005  7225 consensus_queue.cc:237] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:15.060170  3118 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:16:15.066956  7261 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:15.075490  6941 raft_consensus.cc:3055] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:15.076145  6941 raft_consensus.cc:740] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:15.076927  7148 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:15.078963  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:15.077304  6941 consensus_queue.cc:260] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:15.082401  6941 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:15.080906  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34718 (request call id 17) took 1011 ms. Trace:
I20260709 13:16:15.086383  3200 rpcz_store.cc:276] 0709 13:16:14.069986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.070152 (+   166us) service_pool.cc:224] Handling call
0709 13:16:15.080657 (+1010505us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b5400178254. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b9735 00007ff835379d29 00007ff82e8f81d4 00007ff82e8f8162 00007ff82e8f8091 00007ff82e8f800c 00007ff82e8f72c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:15.080814 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1451630976}
I20260709 13:16:15.090451  7205 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:15.092765  7205 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:15.094098  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 91354.2us
I20260709 13:16:15.094885  3090 leader_election.cc:400] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11.
I20260709 13:16:15.095278  3090 leader_election.cc:403] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:15.096400  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 43787.5us
I20260709 13:16:15.096784  3119 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:15.021548  7253 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:15.099913  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:15.098502  3761 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:15.104993  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:15.105661  3194 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:15.057859  7240 raft_consensus.cc:3055] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:15.114048  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:15.114764  3125 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:15.122077  3194 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:15.123669  3117 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:15.124785  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:15.129194  3164 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:15.129694  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:15.100490  7170 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:16:15.133371  3047 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
W20260709 13:16:15.138741  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 43984.3us
I20260709 13:16:15.139484  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:15.136765  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:15.139891  3090 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:15.135674  3193 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:15.108222  7054 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11.
I20260709 13:16:15.108893  7240 raft_consensus.cc:740] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:15.141422  3165 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:15.128679  7164 raft_consensus.cc:2764] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:16:15.142851  3199 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:15.146915  3118 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:15.148458  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:15.149916  3195 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:15.100369  7166 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:15.155223  3199 raft_consensus.cc:1240] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: [6.7-8.8]
W20260709 13:16:15.143220  7310 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:16:15.157459  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:15.161005  3117 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:15.158187  3192 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:15.161057  3198 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:15.158257  3200 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:15.146879  7145 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:15.132025  7217 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:15.164851  3118 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:15.148207  7075 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:15.146590  6893 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:16:15.171311  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:15.177439  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:15.154587  7274 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:15.178273  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:15.178614  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:15.178897  3192 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:15.179746  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:15.179944  7274 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:15.180804  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:15.167121  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:15.181917  3049 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:15.182482  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:15.183022  3198 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:15.188041  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.188153  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:15.188607  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:15.188189  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:15.189363  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:15.187772  3047 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:15.190613  3164 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:15.191341  3198 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:15.172955  3195 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:15.168099  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:15.187711  7240 consensus_queue.cc:260] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:15.194126  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:15.195668  3042 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:16:15.158267  3090 connection.cc:256] RPC call timeout handler was delayed by -1.2537284789998466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
I20260709 13:16:15.165060  7285 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:15.296869  3192 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:15.195035  3118 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
W20260709 13:16:15.301923  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 111387us
I20260709 13:16:15.165603  7261 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:15.319474  3015 connection.cc:256] RPC call timeout handler was delayed by -1.3723546450000867s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
I20260709 13:16:15.320053  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:15.320916  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:15.328271  3015 connection.cc:256] RPC call timeout handler was delayed by -1.3534546450000562s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
I20260709 13:16:15.191380  7217 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.330240  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:15.331073  3118 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:15.331396  3193 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:15.331686  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:15.329926  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:15.329231  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0195546450001984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
I20260709 13:16:15.331084  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:15.335544  3199 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:15.335510  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:15.337164  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:15.329380  3117 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:15.338974  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:15.328225  3090 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:15.346684  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:15.348150  3199 raft_consensus.cc:2410] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:16:15.353050  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:15.356307  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:15.357878  3195 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:15.337144  7054 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:16:15.360255  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet 1d72320f324f482bb7e1e27290040a3d: Illegal state: Replica 501fdf2af2bc4b0c971ae880e98f466b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:15.360658  7054 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:15.361665  6892 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:15.363204  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:15.364240  7054 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:15.364317  7212 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:15.364521  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:15.365486  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:15.365813  3124 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 12: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:15.366338  3192 raft_consensus.cc:2410] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:16:15.333429  7217 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:15.367835  3199 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:15.368314  7303 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.428s	user 0.001s	sys 0.000s
I20260709 13:16:15.368551  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:15.369599  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:15.370136  3118 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:15.360760  7055 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:15.384254  3200 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:15.301432  7285 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:15.389132  3125 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:15.392000  3200 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 10. Ops: [5.2-9.3]
W20260709 13:16:15.393682  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 260949us
I20260709 13:16:15.397257  3199 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:15.398926  3045 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:15.331539  7308 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:15.410112  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:15.411062  3125 raft_consensus.cc:2410] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:16:15.404381  3199 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:16:15.404671  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 74207.3us
I20260709 13:16:15.414943  3164 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:15.387496  7274 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:15.333097  7261 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:15.408329  7212 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:15.329897  7164 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:15.414943  3047 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:15.416798  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:15.417863  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:15.420518  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:15.442576  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:15.421214  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 85770.5us
I20260709 13:16:15.443775  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:15.407332  7166 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:15.405485  7285 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:15.403620  7281 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:15.387923  7237 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:15.450385  3125 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:16:15.446873  3118 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:15.454221  3118 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:15.455911  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:15.434150  7240 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:15.459251  3125 raft_consensus.cc:3055] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:15.460235  3118 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:15.482061  3125 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:15.485153  3118 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:15.483283  3125 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:15.496099  3164 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:15.455672  7306 log.cc:927] Time spent T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.350s	user 0.001s	sys 0.001s
W20260709 13:16:15.495635  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 152993us
I20260709 13:16:15.448886  7163 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:15.506153  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 62465.5us
I20260709 13:16:15.508827  3121 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:15.509126  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:15.511516  3091 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:15.512809  3200 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:16:15.419552  7308 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:15.459733  7274 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:15.525146  3091 leader_election.cc:400] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9.
I20260709 13:16:15.551681  3091 leader_election.cc:403] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:16:15.527668  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:15.513201  3200 pending_rounds.cc:85] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 5
I20260709 13:16:15.552524  3200 pending_rounds.cc:107] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:16:15.552868  3200 raft_consensus.cc:2889] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:15.498354  7166 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:16:15.584823  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 75809.2us
I20260709 13:16:15.513022  7145 raft_consensus.cc:697] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:15.590873  7145 consensus_queue.cc:237] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:15.600225  3122 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:15.518401  6941 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:15.465472  7237 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:15.606168  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 78612.3us
I20260709 13:16:15.581468  7054 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:15.664304  3164 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:15.659418  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 53611us
W20260709 13:16:15.654825  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 52285.2us
W20260709 13:16:15.673720  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 259542us
I20260709 13:16:15.517299  7064 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.140s
I20260709 13:16:15.599826  7105 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:15.677346  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:15.771976  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 107777us
W20260709 13:16:15.675901  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 316869us
I20260709 13:16:15.782291  3090 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:15.653297  7212 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9.
I20260709 13:16:15.783974  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:15.784907  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 382469us
W20260709 13:16:15.840880  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 57025.2us
W20260709 13:16:15.785452  7229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.262s	user 0.005s	sys 0.024s
I20260709 13:16:15.662226  7054 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:16:15.868028  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 63950.2us
W20260709 13:16:15.868665  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 89706.1us
I20260709 13:16:15.874928  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:15.660954  7274 consensus_queue.cc:1059] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.186s
I20260709 13:16:15.878971  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:15.793190  7163 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:15.884402  7319 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:16:15.885684  7309 log.cc:927] Time spent T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.367s	user 0.001s	sys 0.000s
W20260709 13:16:15.885829  7300 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.952s	user 0.004s	sys 0.000s
W20260709 13:16:15.864146  7229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.342s	user 0.005s	sys 0.024s
I20260709 13:16:15.846143  7164 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:16:15.901612  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 224309us
I20260709 13:16:15.865681  7212 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.863674  6941 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:15.881371  7054 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:15.927101  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:15.887216  7281 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:15.903074  7105 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:15.859982  6893 consensus_queue.cc:1059] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:16:15.918196  7274 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.932993  7212 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:15.945818  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:16:15.946712  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 280769us
I20260709 13:16:15.867730  7320 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
W20260709 13:16:15.947204  3016 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.010s	sys 0.024s
W20260709 13:16:15.972081  3016 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.011s	sys 0.024s
W20260709 13:16:15.972239  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 81052.8us
W20260709 13:16:15.973106  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:15.947942  3760 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.010s	sys 0.024s
W20260709 13:16:15.973623  3760 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.011s	sys 0.024s
I20260709 13:16:15.974231  3164 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:15.967092  3122 raft_consensus.cc:2410] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 10 because replica has last-logged OpId of term: 9 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 2.
W20260709 13:16:15.966061  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 183785us
I20260709 13:16:15.981688  7319 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.981798  7145 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:16:15.982545  7315 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:16:15.982367  7319 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:15.982641  7145 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.940723  7105 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.938709  7163 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:15.946278  7010 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:15.991045  7312 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.394s	user 0.000s	sys 0.001s
I20260709 13:16:15.971509  7274 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:15.995283  7319 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:15.998215  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 52614.8us
I20260709 13:16:15.997329  7240 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:15.938881  7321 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:16:16.036517  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:15.938510  7166 consensus_queue.cc:1059] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:16:15.983027  7336 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:16.038237  7166 consensus_queue.cc:1243] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:16:16.038535  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 165924us
I20260709 13:16:16.038371  7336 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:16.039707  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 167944us
I20260709 13:16:16.039625  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:16.041527  7336 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:15.983525  6941 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:16.044129  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 630) took 2056 ms. Trace:
I20260709 13:16:15.980523  7205 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:16:15.983976  7261 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:16.053069  7261 raft_consensus.cc:3055] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:16.001462  7105 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:16.054836  3193 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:16:16.058614  7330 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:16:16.060448  7212 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:16.001588  7145 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:16.064205  7145 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:16.065714  7237 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:16.067124  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2146) took 1013 ms. Trace:
I20260709 13:16:16.053491  7261 raft_consensus.cc:740] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:16.070525  7261 consensus_queue.cc:260] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:16.071872  7261 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:16.067595  3044 rpcz_store.cc:276] 0709 13:16:15.053521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.053668 (+   147us) service_pool.cc:224] Handling call
0709 13:16:15.054013 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:15.108077 (+ 54064us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:15.108120 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:15.108620 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:16:15.387988 (+279368us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:15.388048 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.388147 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:16.066897 (+678750us) raft_consensus.cc:1685] finished
0709 13:16:16.066917 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.067061 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46268,"raft.queue_time_us":40177,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":5819,"thread_start_us":277276,"threads_started":1,"wal-append.queue_time_us":445626}
I20260709 13:16:16.075615  7274 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:16.076597  7274 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:16.077112  7274 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:16.030725  7216 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:16.077988  7216 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:16.078624  7163 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:16.081210  7216 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:16.048118  3123 rpcz_store.cc:276] 0709 13:16:13.987899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.988012 (+   113us) service_pool.cc:224] Handling call
0709 13:16:14.242745 (+254733us) spinlock_profiling.cc:243] Waited 998 us on lock 0x7b5800003398. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff83538cfc0 00007ff835377929 00007ff8353773d2 00007ff82e8eebd4
0709 13:16:14.242956 (+   211us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:14.279064 (+ 36108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.279095 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:14.309941 (+ 30846us) log.cc:844] Serialized 26 byte log entry
0709 13:16:14.728663 (+418722us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b180022bb20. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:16:14.857469 (+128806us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:14.857496 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.857584 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:15.885100 (+1027516us) spinlock_profiling.cc:243] Waited 9.31 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:16.043806 (+158706us) raft_consensus.cc:1685] finished
0709 13:16:16.043853 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.044048 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75087,"raft.queue_time_us":35967,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":18144,"spinlock_wait_cycles":65091456,"thread_start_us":128634,"threads_started":1,"wal-append.queue_time_us":623842}
I20260709 13:16:15.983723  7342 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:16.086495  7229 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:16.050307  6941 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:16.090067  7342 raft_consensus.cc:697] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:16.032582  7243 raft_consensus.cc:3055] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:16.096632  3090 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:16.102847  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:16.101931  3090 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:16.042857  7319 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.043485  7336 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:16.095839  6941 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:16.077587  7274 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:16.111683  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 61508.2us
I20260709 13:16:16.108677  6892 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:16.128115  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2069) took 1185 ms. Trace:
I20260709 13:16:16.127326  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:16.128608  3124 rpcz_store.cc:276] 0709 13:16:14.942364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.042704 (+100340us) service_pool.cc:224] Handling call
0709 13:16:16.127828 (+1085124us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b5400478bd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:16.128037 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740600192}
I20260709 13:16:16.042825  7240 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:16.110775  3164 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:16.130915  3119 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:16.131275  7240 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:16.131549  7145 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:16.131947  7240 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:16.132929  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:16.133616  7010 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:16.118716  7322 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:16.135973  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2148) took 1067 ms. Trace:
I20260709 13:16:16.136281  7145 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:16.136420  3049 rpcz_store.cc:276] 0709 13:16:15.068160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.068377 (+   217us) service_pool.cc:224] Handling call
0709 13:16:15.068700 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.182273 (+113573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.135633 (+953360us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b5400074c54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:16.135888 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259974400}
I20260709 13:16:16.137948  7336 raft_consensus.cc:697] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:16.144800  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:16.130246  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55558 (request call id 18) took 2192 ms. Trace:
I20260709 13:16:16.136904  7342 consensus_queue.cc:237] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:16.142668  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.147804  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:16.148442  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.100885  7243 raft_consensus.cc:740] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:16.145913  3196 rpcz_store.cc:276] 0709 13:16:13.937627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.937863 (+   236us) service_pool.cc:224] Handling call
0709 13:16:16.129998 (+2192135us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b5400035054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303ad853 00007ff83537b60a 00007ff82e9017d4 00007ff82e901762 00007ff82e901691 00007ff82e90160c 00007ff82e9008c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:16.130141 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2256543104}
I20260709 13:16:16.154073  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:16.154884  7145 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.154672  7336 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:16.159063  7308 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:16.147156  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:16.164279  7010 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:16.165668  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2066) took 1348 ms. Trace:
I20260709 13:16:16.111910  7237 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:16.166903  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:16.146572  3164 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:16.167611  3117 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 10: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:16.168049  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:16.176378  3120 rpcz_store.cc:276] 0709 13:16:14.816890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.817021 (+   131us) service_pool.cc:224] Handling call
0709 13:16:14.936650 (+119629us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:14.990418 (+ 53768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.165502 (+1175084us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400189cd0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:16.165611 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269257088}
W20260709 13:16:16.145522  7075 consensus_meta.cc:287] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.971s	user 0.010s	sys 0.001s
I20260709 13:16:16.185950  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2086) took 1005 ms. Trace:
I20260709 13:16:16.186537  3117 rpcz_store.cc:276] 0709 13:16:15.176924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.415196 (+238272us) service_pool.cc:224] Handling call
0709 13:16:16.182021 (+766825us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:16.146188  7240 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:16.120766  7319 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:16.185237  7075 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:16.180208  7145 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:16.189785  7351 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:16.182935  7010 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:16.193178  7240 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:16.214186  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:16.194625  7105 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:16.210216  7243 consensus_queue.cc:260] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:16.210664  7277 raft_consensus.cc:3055] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:16:16.214551  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 173904us
I20260709 13:16:16.225638  3195 raft_consensus.cc:2393] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:16.232563  3090 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:16.232604  3047 raft_consensus.cc:3055] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:16.245636  3047 raft_consensus.cc:740] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:16.244463  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:16.246165  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:16.248018  3090 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:16.214224  7217 consensus_meta.cc:287] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.847s	user 0.005s	sys 0.005s
I20260709 13:16:16.249645  7348 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:16.250204  7348 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:16.252235  7348 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:16.249120  7217 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:16.225773  7285 consensus_meta.cc:287] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.766s	user 0.003s	sys 0.005s
I20260709 13:16:16.283114  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:16.233932  7240 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:16.255769  3090 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:16.228194  7243 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:16.223161  7319 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:16.226662  7105 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:16.278111  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 152979us
W20260709 13:16:16.258873  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.280911  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:16.301397  3049 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:16.265007  3047 consensus_queue.cc:260] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:16.282487  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:16.264500  7353 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:16.243906  3762 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:16.243165  7277 raft_consensus.cc:740] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:16.255163  7350 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:16.286015  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:16.288403  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:16.293843  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:16.344671  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:16.253962  7055 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:16.224680  7010 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:16.298683  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:16.255270  7349 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.255405  7075 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:16.302721  3045 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:16.290058  7221 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.229759  7054 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:16.217036  7320 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:16:16.339673  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:16.403627  3196 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 12: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:16.402035  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:16.404948  3193 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:16.365670  7353 raft_consensus.cc:697] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:16.298506  7338 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:16:16.343261  3043 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:16.366189  3192 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:16.434517  3049 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:16.369390  3199 raft_consensus.cc:2410] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 12 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 13:16:16.369401  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 70792us
W20260709 13:16:16.370062  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 187402us
I20260709 13:16:16.341888  7348 consensus_queue.cc:1059] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:16:16.337502  7319 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.406606  3165 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:16:16.340072  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 96297.7us
I20260709 13:16:16.293725  7308 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:16.365211  7355 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:16.458209  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:16.458859  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.438236  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:16.439349  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 138835us
I20260709 13:16:16.443706  3117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:16:16.449033  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:16.452121  7356 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.304909  7322 consensus_queue.cc:1059] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 13:16:16.403411  7221 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:16.378824  7010 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:16:16.456638  7054 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:16.367988  7105 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:16:16.439592  7350 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:16.460598  7212 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:16.495914  7356 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:16.400414  7163 consensus_queue.cc:1059] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:16:16.519950  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:16.439556  7075 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.525061  3191 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:16.297714  7285 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:16.497299  7352 log.cc:927] Time spent T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:16:16.468233  7217 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:16.506562  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:16.497190  7322 raft_consensus.cc:3055] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:16.521000  3792 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:16.522697  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:16.524690  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:16.542436  3799 raft_consensus.cc:2393] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
W20260709 13:16:16.541060  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 134505us
I20260709 13:16:16.499039  7145 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:16:16.378400  7349 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:16.533125  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:16.548560  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:16.549382  3797 raft_consensus.cc:2393] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 12: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:16.536300  3120 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:16.537322  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 99181.9us
I20260709 13:16:16.537422  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:16.538731  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:16.469105  7319 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:16.545382  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.545871  3198 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:16.549305  3044 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:16.535959  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:16.555311  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:16.516193  7350 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:16.557382  3797 raft_consensus.cc:1240] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:16:16.557554  7359 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:16:16.559325  7350 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:16.540553  7322 raft_consensus.cc:740] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:16.520174  7212 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:16.576139  3797 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: []
W20260709 13:16:16.579337  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.534373  7075 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:16.552881  7343 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.553292  7327 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:16.587219  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 124133us
I20260709 13:16:16.566700  7339 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:16.574190  7354 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.574050  7217 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.596395  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:16.591950  7055 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:16.601478  3797 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:16:16.604602  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.607933  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:16.612186  3120 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:16:16.618608  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:16.619491  3196 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:16.624711  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:16.628795  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:16.632812  3761 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:16.543581  7353 consensus_queue.cc:237] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:16.659533  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:16.660180  3124 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:16.662753  7376 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:16.658129  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2276) took 1501 ms. Trace:
I20260709 13:16:16.599066  7348 consensus_queue.cc:1059] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 13:16:16.637310  7362 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.103s	user 0.001s	sys 0.001s
W20260709 13:16:16.638095  7360 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:16:16.638396  7356 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:16.638496  7367 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:16.638473  7212 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:16.623915  7322 consensus_queue.cc:260] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:16.681727  3124 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:16.640789  7374 raft_consensus.cc:3055] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:16.604375  7354 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:16.649020  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:16.652185  7370 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:16.654362  7170 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:16.656721  7349 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:16.657055  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1982) took 1498 ms. Trace:
I20260709 13:16:16.658205  7075 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:16.659358  7364 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:16:16.593988  7240 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:16.664913  3200 rpcz_store.cc:276] 0709 13:16:15.157001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.393068 (+236067us) service_pool.cc:224] Handling call
0709 13:16:15.393393 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.598837 (+205444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.657897 (+1059060us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54001df454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:16.658067 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255497088}
I20260709 13:16:16.636513  3196 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:16.688815  7322 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:16.595525  7327 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:16.722302  6941 consensus_meta.cc:287] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.000s
I20260709 13:16:16.722760  6941 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:16.723344  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:16.724004  7240 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:16.724215  3043 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:16:16.724637  7240 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:16.725153  7240 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:16.665573  7221 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:16.677114  7010 consensus_queue.cc:1059] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:16.592905  7343 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:16.695785  3124 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:16:16.785287  3042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.009s	sys 0.008s
I20260709 13:16:16.785761  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:16.785665  3042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.012s	sys 0.008s
I20260709 13:16:16.786413  3124 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:16.787168  3117 raft_consensus.cc:606] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:16.711866  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:16.698658  3123 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:16.713127  3119 rpcz_store.cc:276] 0709 13:16:15.158814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.158988 (+   174us) service_pool.cc:224] Handling call
0709 13:16:16.130725 (+971737us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:16.131444 (+   719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.656832 (+525388us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b5400478bd0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:16.656988 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2233964800}
W20260709 13:16:16.727432  7371 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.128s	user 0.000s	sys 0.003s
W20260709 13:16:16.790752  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 239846us
I20260709 13:16:16.687465  7367 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:16.686164  7055 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:16.718382  7349 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:16.682945  7319 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:16.732738  7354 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:16.608176  7217 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:16.740337  3200 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:16.686707  7285 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:16.783000  3761 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:16.710981  7374 raft_consensus.cc:740] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:16.789599  3119 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:16.725616  6941 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:16.800081  3791 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:16:16.801285  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 179174us
I20260709 13:16:16.786435  7010 consensus_queue.cc:1243] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 8.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:16.801141  7376 raft_consensus.cc:697] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:16.781930  7320 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:16:16.814700  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:16.801357  7075 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.796402  7367 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:16.812994  7274 consensus_meta.cc:287] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.634s	user 0.015s	sys 0.000s
I20260709 13:16:16.818615  7274 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:16.821632  7274 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:16.822309  3044 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:16.824853  7374 consensus_queue.cc:260] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:16.827265  7217 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:16.814128  7354 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:16.810369  7349 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:16.813637  7353 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:16:16.829638  7336 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:16:16.848917  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2274) took 1692 ms. Trace:
I20260709 13:16:16.849593  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:16.838578  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:16.835975  3049 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:16.894171  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 55695.7us
I20260709 13:16:16.860472  3195 rpcz_store.cc:276] 0709 13:16:15.156406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.360512 (+204106us) service_pool.cc:224] Handling call
0709 13:16:16.848645 (+1488133us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b54003bb854. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:16.848819 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114388224}
I20260709 13:16:16.816359  6845 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.896955  3796 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:16.940591  3049 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:16.828128  6941 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:16.848758  7374 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:16.835829  7349 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:16.853781  7240 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:16.932981  7274 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.833783  7354 raft_consensus.cc:697] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:16.953215  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:16.831384  7010 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.120s
W20260709 13:16:16.956202  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.831188  7075 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:16.950284  7236 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:16.953238  6941 raft_consensus.cc:697] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:16.953801  7348 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:16.970521  3126 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:16:16.961809  7351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.006s	sys 0.012s
I20260709 13:16:16.952817  7070 consensus_queue.cc:1059] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
W20260709 13:16:16.977098  3122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2076) took 1814 ms (client timeout 1701 ms). Trace:
I20260709 13:16:16.978119  3121 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:16.966631  7236 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:16.981245  7391 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:16.981827  7391 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:16.983129  7236 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:16.984004  7391 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:16.984822  7381 log.cc:927] Time spent T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.135s	user 0.001s	sys 0.006s
I20260709 13:16:16.957640  6845 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:16.837481  7376 consensus_queue.cc:237] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:16.988133  6845 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:16.956883  7392 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:16:16.990370  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.979493  3122 rpcz_store.cc:269] 0709 13:16:15.162602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.162776 (+   174us) service_pool.cc:224] Handling call
0709 13:16:16.976786 (+1814010us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b540018a1d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:16.976998 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":623719808}
I20260709 13:16:16.964962  7349 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:16.992300  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:16.955848  7240 consensus_queue.cc:1059] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:16:16.993927  3120 raft_consensus.cc:2410] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:16:16.955188  7274 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:16.977990  7351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.007s	sys 0.012s
I20260709 13:16:17.005877  7327 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:17.005957  7354 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:17.007885  7386 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:16:17.010105  7343 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:17.010807  7277 consensus_queue.cc:260] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:17.012050  7277 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:17.012506  7075 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:17.021623  7391 raft_consensus.cc:3055] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:17.024093  7391 raft_consensus.cc:740] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:16:17.024205  7387 log.cc:927] Time spent T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:16:16.989603  7336 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:16:17.034479  6941 consensus_queue.cc:237] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:17.035352  7274 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:16.978157  7348 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:17.053336  3124 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:17.055930  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 91996.1us
I20260709 13:16:17.069103  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:17.073850  3047 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:17.074047  7367 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:17.077538  7367 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:17.082432  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:17.083490  3797 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:17.086078  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:17.087146  3797 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:17.093602  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:17.094529  7274 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:17.096074  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:17.096935  7274 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:17.097344  7274 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.097491  7356 raft_consensus.cc:3055] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:17.097724  7274 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:17.097977  7356 raft_consensus.cc:740] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:17.100401  7391 consensus_queue.cc:260] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:17.064828  7348 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:17.105609  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:17.110635  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:17.111328  3799 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:17.116386  3047 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:16:17.117172  3047 pending_rounds.cc:85] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 7
I20260709 13:16:17.117509  3047 pending_rounds.cc:107] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:16:17.117733  3047 raft_consensus.cc:2889] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:17.102486  7367 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
W20260709 13:16:17.126107  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.135172  3799 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:16:17.119884  7349 raft_consensus.cc:697] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:17.112639  7394 consensus_queue.cc:1059] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.165s
I20260709 13:16:17.150398  7349 consensus_queue.cc:237] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:17.158986  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.159871  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.141817  7403 raft_consensus.cc:3055] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:17.167430  7403 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:17.165489  3050 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:17.168371  7403 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:17.169377  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:17.174431  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 1991) took 1989 ms. Trace:
I20260709 13:16:17.175016  3121 rpcz_store.cc:276] 0709 13:16:15.185324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.551131 (+365807us) service_pool.cc:224] Handling call
0709 13:16:16.977875 (+1426744us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:16.980581 (+  2706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.174240 (+193659us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540018a1d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:17.174374 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3169712384}
I20260709 13:16:17.179773  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:17.175266  3797 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:17.182794  3047 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:17.187577  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:17.189788  3050 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:17.199083  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:17.169697  7403 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:17.217976  3799 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:17.211905  3091 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:17.219434  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:17.210500  7322 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.224059  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:17.226572  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:17.228552  3045 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:17.205850  7355 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:16:17.333854  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:17.334719  3051 raft_consensus.cc:2393] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 12: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:17.334913  6892 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:16:17.337909  7317 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 1.891s	user 0.005s	sys 0.000s
I20260709 13:16:17.338995  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:17.346441  3126 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 1983) took 2186 ms (client timeout 1970 ms). Trace:
I20260709 13:16:17.347774  7231 raft_consensus.cc:3055] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:17.348249  7231 raft_consensus.cc:740] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:16:17.344163  3015 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 1.970s (SENT) [suppressed 5 similar messages]
I20260709 13:16:17.349200  7231 consensus_queue.cc:260] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.3, Last appended by leader: 3, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:17.351505  7231 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:17.346990  3126 rpcz_store.cc:269] 0709 13:16:15.160101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.160437 (+   336us) service_pool.cc:224] Handling call
0709 13:16:16.849412 (+1688975us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b5800003398. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff8353790a0 00007ff835378984 00007ff82e8f36d4 00007ff82e8f3662
0709 13:16:17.346148 (+496736us) spinlock_profiling.cc:243] Waited 73.1 ms on lock 0x7b5400302ad4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:17.346326 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177244288}
I20260709 13:16:17.207450  6845 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.213815  7367 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.202250  7274 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:17.218446  7376 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:17.214007  7075 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:16:17.356319  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 85152.8us
I20260709 13:16:17.335716  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:17.363205  3051 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:17.363375  3762 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:17.372712  3762 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:17.378161  3047 raft_consensus.cc:2393] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 11: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:17.225399  7322 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:17.369799  7040 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.388433  7040 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:17.365247  6845 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:17.390693  7040 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:17.392216  6845 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:17.381713  7355 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:17.394407  7355 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.394897  7355 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:17.394829  7356 consensus_queue.cc:260] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:17.396512  7356 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:17.382993  7334 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:17.398227  7334 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.398677  7334 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:17.371085  7164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.002s	sys 0.008s
W20260709 13:16:17.400053  7164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.002s	sys 0.008s
I20260709 13:16:17.382992  7376 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:17.404361  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:17.415369  7040 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.423166  7055 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.423266  7040 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:17.423852  7055 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:17.425827  7055 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:17.427906  7390 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.463s	user 0.002s	sys 0.000s
I20260709 13:16:17.429100  3125 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:17.442354  7274 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:17.362586  7367 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:17.444456  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:17.447455  3125 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:16:17.425508  7040 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:17.450277  3125 pending_rounds.cc:85] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 5
I20260709 13:16:17.450343  3090 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:17.372956  7075 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:17.455808  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 98803.7us
I20260709 13:16:17.452803  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:17.471093  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.471872  3125 pending_rounds.cc:107] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:16:17.472371  3125 raft_consensus.cc:2889] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:17.525369  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 181603us
W20260709 13:16:17.525712  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 72989.3us
W20260709 13:16:17.527195  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.527685  3090 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:17.536255  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 79491.7us
I20260709 13:16:17.448518  7212 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:17.540658  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 650) took 1077 ms. Trace:
I20260709 13:16:17.542738  7040 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:17.546407  7376 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:17.546677  7040 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:17.548553  7040 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:17.455123  6845 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:17.452813  7055 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:17.538506  7277 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:17.550783  7277 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:17.553154  7277 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:17.553674  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.556576  3091 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:17.528689  6893 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:17.562338  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.562712  3091 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:17.564628  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:17.565405  3124 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:17.549244  7355 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:17.570309  3049 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:17.554999  7367 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:17.574895  3049 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:16:17.573173  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:17.576231  3117 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:17.545423  3118 rpcz_store.cc:276] 0709 13:16:16.463680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.463860 (+   180us) service_pool.cc:224] Handling call
0709 13:16:16.464277 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:16.596252 (+131975us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:16.605802 (+  9550us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.786203 (+180401us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:16.786262 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:16.786307 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.540321 (+754014us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54000ba4d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:17.540387 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.540576 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1297,"prepare.queue_time_us":9349,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":8444,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":4905,"spinlock_wait_cycles":302939520,"thread_start_us":180044,"threads_started":1,"wal-append.queue_time_us":231896}
I20260709 13:16:17.561930  7055 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:17.582878  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:17.566232  7322 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:17.595923  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:17.597599  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:17.598590  3049 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:17.606423  7358 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:17.607543  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2290) took 1268 ms. Trace:
I20260709 13:16:17.608006  3197 rpcz_store.cc:276] 0709 13:16:16.339294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.343066 (+  3772us) service_pool.cc:224] Handling call
0709 13:16:16.377977 (+ 34911us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:16.472329 (+ 94352us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:16.552284 (+ 79955us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.622735 (+ 70451us) log.cc:844] Serialized 14 byte log entry
0709 13:16:17.602111 (+979376us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b1800063160. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d240c0a 00007ff836980219 00007ff82d2c8a40 00007ff82d2c34e4 00007ff82d2c3455 00007ff8303ab060 00007ff8303bd716 00007ff8303ce287 00007ff8303ce208
0709 13:16:17.602315 (+   204us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:17.602871 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:16:17.603032 (+   161us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:17.603260 (+   228us) log.cc:844] Serialized 14 byte log entry
0709 13:16:17.603421 (+   161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.603586 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:17.607281 (+  3695us) raft_consensus.cc:1685] finished
0709 13:16:17.607302 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.607478 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27104,"prepare.queue_time_us":34883,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":2436,"raft.queue_time_us":158966,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":13420,"spinlock_wait_cycles":3743616,"thread_start_us":176299,"threads_started":3,"wal-append.queue_time_us":211546}
I20260709 13:16:17.566278  6893 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:17.601454  3124 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:17.627691  3042 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:17.563138  6845 consensus_queue.cc:1059] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:16:17.558930  7212 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:17.633586  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 106020us
I20260709 13:16:17.634485  3090 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:17.635705  3090 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:17.624786  7322 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:17.636400  3049 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:17.640861  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 849293us
I20260709 13:16:17.641940  7423 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:17.645319  7369 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:17.650254  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 608) took 1246 ms. Trace:
I20260709 13:16:17.636023  7055 raft_consensus.cc:3055] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:17.635985  6845 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:17.656164  7040 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:17.638607  7419 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:17.664126  3045 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:17.650717  3193 rpcz_store.cc:276] 0709 13:16:16.403697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.459425 (+ 55728us) service_pool.cc:224] Handling call
0709 13:16:16.459862 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:16.460141 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:16.460522 (+   381us) log.cc:844] Serialized 14 byte log entry
0709 13:16:17.649903 (+1189381us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:17.649955 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:17.650010 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.650080 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.650194 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":841393,"prepare.queue_time_us":1160,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":4721,"thread_start_us":347573,"threads_started":1,"wal-append.queue_time_us":395346}
I20260709 13:16:17.638173  7322 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.674225  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:17.674659  7322 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:17.675618  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:17.680356  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2088) took 2502 ms. Trace:
W20260709 13:16:17.680611  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.680855  3125 rpcz_store.cc:276] 0709 13:16:15.177602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.451568 (+273966us) service_pool.cc:224] Handling call
0709 13:16:15.451941 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.428833 (+1976892us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b580089b7d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83030f0aa 00007ff830391447 00007ff8303a9fe7 00007ff8303ab7de 00007ff8303b5b49 00007ff8303b6416 00007ff8303b2d8f 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4
0709 13:16:17.473075 (+ 44242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.680056 (+206981us) spinlock_profiling.cc:243] Waited 7.17 ms on lock 0x7b540010e354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:17.680258 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2646081664}
I20260709 13:16:17.681496  7392 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:17.665844  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:17.682729  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:17.683990  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:17.684580  3117 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:17.656761  7285 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:16:17.690147  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:17.649886  7319 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:17.659451  7239 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.661180  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:17.691433  3198 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:17.692487  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:17.693464  3198 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 12: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:17.662161  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:17.672468  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:17.686662  3195 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:17.687469  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:17.689592  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 47899.7us
I20260709 13:16:17.695823  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:17.695941  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:17.697094  3198 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:16:17.699221  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:17.699520  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:17.700126  3799 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:17.700752  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:17.699239  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:17.655184  7055 raft_consensus.cc:740] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:17.709193  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:17.708519  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:17.710938  3798 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:17.711404  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:17.706748  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:17.707998  3198 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:16:17.712894  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:17.664557  7419 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:17.717852  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:17.731195  3124 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:17.731729  3047 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:16:17.716255  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:17.734148  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 95604.3us
I20260709 13:16:17.734392  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:17.716991  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:17.715389  3193 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:17.715612  7064 consensus_queue.cc:1059] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:16:17.704952  7382 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:16:17.701085  7319 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:17.719046  7040 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:17.719398  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.709029  7316 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:16:17.700331  7075 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:17.720873  7412 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.354s	user 0.004s	sys 0.003s
I20260709 13:16:17.721845  3164 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:17.722460  7389 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:17.723088  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:17.723590  3046 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:17.724231  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:17.765136  3119 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:17.725136  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:17.725761  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:17.726503  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:17.728224  7281 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:17.728765  7243 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:17.727159  3091 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:17.722509  7236 raft_consensus.cc:3055] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:16:17.782661  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 55564.3us
I20260709 13:16:17.752841  3090 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:17.754554  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:17.787000  3197 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:17.789676  3124 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:17.755730  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:17.790669  3195 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:17.757100  3198 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 10. Ops: [5.2-9.3]
I20260709 13:16:17.760140  7277 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:16:17.770632  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 48926.5us
I20260709 13:16:17.816519  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:17.807618  3119 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:16:17.776738  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:17.775014  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:17.795547  7064 raft_consensus.cc:3055] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:17.751425  7419 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:17.703372  7239 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:17.755141  3799 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:17.758111  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:17.817490  3124 raft_consensus.cc:2393] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 12: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:16:17.828477  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 70431.6us
I20260709 13:16:17.818665  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:17.747608  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:17.766903  7040 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:17.829192  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:17.821065  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:17.800148  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:17.853513  3126 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 11: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:17.799396  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:17.818173  3118 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:17.761181  7423 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:16:17.829324  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:17.845786  3193 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:17.858930  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:17.862707  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:17.863394  7379 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.891335  3194 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
W20260709 13:16:17.870446  7421 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.186s	user 0.000s	sys 0.002s
W20260709 13:16:17.872396  7402 log.cc:927] Time spent T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.737s	user 0.000s	sys 0.005s
I20260709 13:16:17.829125  7355 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:17.879077  6845 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:17.878865  6892 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:17.882997  7319 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:17.775161  7055 consensus_queue.cc:260] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:17.825258  7064 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:17.888826  7365 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:17.846278  7243 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:17.848673  3165 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:17.783912  7236 raft_consensus.cc:740] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:16:17.906191  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 47360.2us
I20260709 13:16:17.907608  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:17.907769  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 78648.1us
W20260709 13:16:17.914599  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.926084  3164 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:17.795042  7212 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:17.749900  7424 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:16:17.911209  3195 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:17.779479  7401 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:17.912762  7356 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:17.914721  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:17.873032  7334 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:17.934999  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 150803us
I20260709 13:16:17.783265  7281 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:17.924762  6893 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:17.904615  7285 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:17.928062  3164 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:17.928081  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:17.911875  7417 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:17.831239  7277 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:17.915766  7354 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.008s	sys 0.008s
W20260709 13:16:17.974040  7354 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.008s	sys 0.008s
I20260709 13:16:17.881505  7239 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:17.933842  3126 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:17.975885  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:17.976588  3126 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:17.932914  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:17.936379  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:17.936666  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 183872us
I20260709 13:16:17.978753  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:17.979955  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:17.980541  3197 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
W20260709 13:16:17.924795  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 76258.6us
I20260709 13:16:17.923835  7231 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:17.926081  7243 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.926126  7365 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:17.929421  7055 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:17.929050  7389 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:16:17.968677  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.970629  7374 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:18.004637  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:18.007009  3790 raft_consensus.cc:2368] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 11. Current term is 12.
I20260709 13:16:17.959079  7163 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.932577  7382 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:17.912441  7379 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.038187  3791 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:17.991454  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:18.039155  3799 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 8: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:17.967489  7319 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:17.995007  7365 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:17.967965  7253 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.977630  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:17.983819  3165 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:16:18.053218  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 69472.3us
W20260709 13:16:18.037127  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 109085us
I20260709 13:16:17.981415  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:18.022713  7374 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.001542  7389 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.001096  7243 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:17.969067  7358 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:16:18.054318  3165 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:17.958356  7212 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:16:18.021229  7382 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.067993  3193 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:17.994776  7423 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:16:18.077520  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:18.115413  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 619) took 1405 ms. Trace:
I20260709 13:16:18.115834  3196 rpcz_store.cc:276] 0709 13:16:16.710323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.721634 (+ 11311us) service_pool.cc:224] Handling call
0709 13:16:16.739167 (+ 17533us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:17.640833 (+901666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.640867 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:17.650644 (+  9777us) log.cc:844] Serialized 26 byte log entry
0709 13:16:17.817310 (+166666us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b180038ec60. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:16:17.923993 (+106683us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:17.924293 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 13:16:17.924498 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.924587 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.115043 (+190456us) raft_consensus.cc:1685] finished
0709 13:16:18.115174 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.115341 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":938623,"prepare.queue_time_us":124,"prepare.run_wall_time_us":42,"raft.queue_time_us":910100,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":7558,"spinlock_wait_cycles":10180736,"thread_start_us":106498,"threads_started":1,"wal-append.queue_time_us":462280}
I20260709 13:16:18.118201  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:18.038971  7163 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.066605  7145 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:18.066960  7401 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:18.082008  7392 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:18.083794  7336 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:18.135577  7336 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.084471  7261 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:18.138010  7261 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.138206  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 611) took 1733 ms. Trace:
I20260709 13:16:18.138448  7261 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:18.138624  3191 rpcz_store.cc:276] 0709 13:16:16.404462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.532541 (+128079us) service_pool.cc:224] Handling call
0709 13:16:16.547808 (+ 15267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:16.553013 (+  5205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:16.553048 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:16.553527 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:16:17.605957 (+1052430us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b180048dfc0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:16:17.645003 (+ 39046us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:17.645057 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.646738 (+  1681us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.137926 (+491188us) raft_consensus.cc:1685] finished
0709 13:16:18.137946 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.138144 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":949,"raft.queue_time_us":33215,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":9038,"spinlock_wait_cycles":11457280,"thread_start_us":38791,"threads_started":1,"wal-append.queue_time_us":1066959}
I20260709 13:16:18.140586  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:18.141215  3191 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:18.095337  7281 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:18.067199  7389 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:18.142068  7281 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:18.142360  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:18.142607  7281 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.143532  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:18.144475  7163 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:18.144886  7281 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:18.098341  7379 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:17.988338  7236 consensus_queue.cc:260] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.147819  7236 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:18.103598  7277 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:18.150223  7277 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:18.062067  7319 raft_consensus.cc:697] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:18.151002  7389 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.152007  7319 consensus_queue.cc:237] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.104259  7334 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:18.153560  7389 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:18.046425  6893 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:16:18.074563  7356 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:16:18.154079  7145 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.155630  7356 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.156661  7145 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:18.156424  7356 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.106495  7374 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:18.106225  7322 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.043447  7010 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:18.163955  3119 raft_consensus.cc:2368] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11.
I20260709 13:16:18.004609  7231 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.107920  7382 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:18.021941  7064 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.109649  7040 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:18.064071  7253 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.114555  3125 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:18.124145  3118 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:18.125058  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:18.123585  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 165581us
I20260709 13:16:18.128575  7401 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.134454  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:18.168211  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.187234  3197 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:18.166770  7010 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:18.216035  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 91086.5us
I20260709 13:16:18.217367  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:18.224956  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 158737us
W20260709 13:16:18.227680  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 150292us
I20260709 13:16:18.228670  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:18.229511  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:18.229640  3165 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:18.230759  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:18.231596  3197 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:16:18.189966  7401 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:18.213675  7064 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:18.215000  7336 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:18.220402  7010 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:18.228859  7334 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:18.227366  7333 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:18.253350  3197 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:18.254709  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:18.255409  3197 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:18.256312  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:18.256933  3197 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
W20260709 13:16:18.257805  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.214310  7243 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.262601  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:18.268263  3049 raft_consensus.cc:2410] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:18.265007  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:18.243876  7145 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:18.251157  7336 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.251543  7334 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:18.295418  7441 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:18.296088  7441 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:18.296416  7243 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:18.296496  7441 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:18.288908  7440 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:18.298029  7440 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:18.298411  7440 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:18.300693  7405 log.cc:927] Time spent T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 1.158s	user 0.004s	sys 0.002s
I20260709 13:16:18.300740  7438 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.301614  7438 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.303927  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 703) took 1092 ms. Trace:
I20260709 13:16:18.304306  7438 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:18.314718  7253 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:18.318182  7236 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:18.318727  7236 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.319197  7236 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:18.325095  7322 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:18.327229  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 96536.1us
I20260709 13:16:18.291198  7334 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:18.304436  3043 rpcz_store.cc:276] 0709 13:16:17.213504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.213654 (+   150us) service_pool.cc:224] Handling call
0709 13:16:17.222274 (+  8620us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:17.456147 (+233873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.469149 (+ 13002us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:17.554550 (+ 85401us) log.cc:844] Serialized 26 byte log entry
0709 13:16:17.889340 (+334790us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b1800382f60. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:16:18.018758 (+129418us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:18.060698 (+ 41940us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.077110 (+ 16412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.303470 (+226360us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b5400075154. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:18.303548 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.303625 (+    77us) raft_consensus.cc:1685] finished
0709 13:16:18.303641 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.303842 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11898,"prepare.queue_time_us":29033,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":6305,"raft.queue_time_us":18651,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":18254,"spinlock_wait_cycles":540281984,"thread_start_us":129161,"threads_started":1,"wal-append.queue_time_us":535403}
I20260709 13:16:18.328920  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:18.328387  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:18.293918  7145 raft_consensus.cc:697] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:18.342607  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:18.350046  3090 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:18.359323  3043 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:18.290851  7336 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.304399  7365 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.347466  7356 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:18.377604  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 656) took 1710 ms. Trace:
I20260709 13:16:18.380021  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:18.380219  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 51903.3us
I20260709 13:16:18.357148  7243 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:18.381322  3046 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:18.348315  7443 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:18.360136  7212 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:18.391731  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:18.361914  7438 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:16:18.363456  6845 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:18.373404  7322 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.380962  3123 rpcz_store.cc:276] 0709 13:16:16.667189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.815471 (+148282us) service_pool.cc:224] Handling call
0709 13:16:16.830182 (+ 14711us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:16.893598 (+ 63416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:16.893632 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:16.894270 (+   638us) log.cc:844] Serialized 52 byte log entry
0709 13:16:17.079196 (+184926us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:17.079269 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.079513 (+   244us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.299875 (+1220362us) spinlock_profiling.cc:243] Waited 9.65 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:18.377292 (+ 77417us) raft_consensus.cc:1685] finished
0709 13:16:18.377312 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.377537 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26842,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":6504,"spinlock_wait_cycles":22186240,"thread_start_us":125400,"threads_started":1,"wal-append.queue_time_us":167899}
I20260709 13:16:18.392037  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:18.392479  3797 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:18.406778  7444 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:18.393286  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:18.407619  7444 raft_consensus.cc:697] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:18.407756  3046 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:18.396288  3047 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:18.408581  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:18.406869  7356 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:18.408659  7444 consensus_queue.cc:237] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.409931  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:18.408759  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:18.411679  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:18.383262  7243 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:18.410545  3118 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
I20260709 13:16:18.412552  3120 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:18.418820  3090 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:18.418694  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:18.414069  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:18.376916  7231 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:18.423120  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:18.423862  3193 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:18.424813  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:18.421475  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:18.422789  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 704) took 1200 ms. Trace:
I20260709 13:16:18.425997  3050 rpcz_store.cc:276] 0709 13:16:17.222325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.222821 (+   496us) service_pool.cc:224] Handling call
0709 13:16:17.336264 (+113443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.401145 (+ 64881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.401182 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:17.401228 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:17.401268 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.422502 (+1021234us) spinlock_profiling.cc:243] Waited 64.7 ms on lock 0x7b540029de54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:18.422557 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.422727 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148705152}
I20260709 13:16:18.425189  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:18.391697  7212 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.430213  3126 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:16:18.430572  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:18.425987  3090 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:18.432669  3193 raft_consensus.cc:2410] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:16:18.436784  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:18.437860  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:18.438930  3048 raft_consensus.cc:2410] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:18.417462  7243 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:18.447088  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:18.451225  7438 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.451699  3165 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:18.451843  7438 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.452716  7105 consensus_queue.cc:1059] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:18.453649  7105 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:18.454083  7105 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.454522  7105 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:18.456152  7075 raft_consensus.cc:3055] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:18.456599  7075 raft_consensus.cc:740] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:18.458107  7417 raft_consensus.cc:3055] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:18.458578  7417 raft_consensus.cc:740] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:18.460085  7274 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:18.460651  7274 raft_consensus.cc:697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:18.452247  7369 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:18.466347  7369 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:18.466159  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:18.468137  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.467460  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:18.468978  3165 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:18.431037  7443 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:18.473237  3047 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:18.473338  7443 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.473878  7443 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:18.443805  7145 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.474406  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:18.476584  3197 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:18.457512  7075 consensus_queue.cc:260] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.478745  7438 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:18.480553  7449 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.480660  7447 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:18.442797  6845 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:18.481585  7447 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.481895  6845 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:18.472244  7419 consensus_meta.cc:287] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.002s
I20260709 13:16:18.482347  6845 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:18.482791  7419 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.484077  3117 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:18.482455  7391 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:18.487848  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:18.487577  7440 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.487155  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:18.438076  7212 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:18.432714  7356 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:18.495415  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:18.496031  3048 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:18.469058  3123 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:18.496677  6892 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:18.491910  3117 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:18.497344  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:18.497298  6892 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.472888  7010 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.498596  7333 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:18.499818  6892 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:18.500013  7010 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:18.501166  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:18.504715  7351 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:18.505726  6892 consensus_queue.cc:1059] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:18.506402  7438 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:18.417224  7322 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.511089  3048 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:18.516042  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:18.516986  3047 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:18.506529  6892 consensus_queue.cc:1243] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:16:18.481240  7449 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.493620  7389 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:18.519359  7431 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260709 13:16:18.461658  7274 consensus_queue.cc:237] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.589046  7369 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.596783  3047 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:18.585568  7105 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.508296  7188 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 13:16:18.607177  7336 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:18.599272  6892 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.609040  6892 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.614008  7440 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:18.570428  7389 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:18.482389  7447 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.507311  7382 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.561303  7438 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:18.634326  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.596549  7239 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.628592  7389 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:18.627563  7419 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:18.655429  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:18.656491  3199 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:18.652822  3191 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:18.597337  7236 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.660145  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:18.650019  7327 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.672513  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:18.651571  7365 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:18.674854  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:18.674883  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 253468us
I20260709 13:16:18.677208  3050 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:18.676244  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.677842  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:16:18.670017  7261 consensus_meta.cc:287] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.001s
I20260709 13:16:18.681082  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:18.649905  7239 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.683763  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:18.689595  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:18.689188  7010 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:18.676811  7105 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:18.701396  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.702735  7463 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.703722  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:18.704082  7452 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:16:18.681592  6892 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:18.708238  3046 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:18.712539  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2160) took 2157 ms. Trace:
I20260709 13:16:18.713166  7440 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.713944  7440 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.691218  7365 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:18.714927  7236 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:18.715869  7322 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:18.717813  7239 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:18.687270  7261 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.681819  7327 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.722438  7261 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:18.722186  7243 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.724226  7327 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:18.724732  7243 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:18.726414  7449 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:18.726238  7443 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.717911  7369 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:18.727703  6845 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.736353  3117 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:18.712988  3044 rpcz_store.cc:276] 0709 13:16:16.555586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.555731 (+   145us) service_pool.cc:224] Handling call
0709 13:16:16.555997 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:16.831453 (+275456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.712196 (+1880743us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54003a8ed4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:18.712431 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611949952}
I20260709 13:16:18.738003  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:18.738737  3044 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:18.740106  7447 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:18.701102  7010 raft_consensus.cc:697] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:18.729346  7382 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:18.734227  3796 raft_consensus.cc:2410] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 9 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:16:18.742841  7382 consensus_queue.cc:1059] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:18.707985  7336 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:18.735981  7401 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.747817  7336 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:18.748423  7336 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:18.748569  3196 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:18.741925  7010 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.734529  3050 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:18.745996  3123 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:18.731283  7334 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.752122  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:18.752635  3165 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:18.745035  6845 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:18.759153  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:16:18.760344  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 97424.2us
I20260709 13:16:18.764688  3044 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:18.766273  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:18.766561  3165 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:18.767026  3044 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:18.769595  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:18.742009  7212 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:18.772769  7392 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.011s	sys 0.000s
I20260709 13:16:18.753264  7401 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
W20260709 13:16:18.777456  7392 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.011s	sys 0.000s
I20260709 13:16:18.759536  7419 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:18.774843  3762 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:18.703362  7463 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.784884  3044 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:18.771618  7369 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.773401  7261 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:18.792048  7261 raft_consensus.cc:697] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:18.793414  7261 consensus_queue.cc:237] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.794206  7369 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.796893  7369 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:18.799350  7463 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:18.802070  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:18.802752  7423 raft_consensus.cc:3055] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:18.803153  7423 raft_consensus.cc:740] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:18.780721  7239 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:18.782251  7105 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:16:18.810621  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 106991us
I20260709 13:16:18.789088  3165 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:18.809305  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 1913) took 1149 ms. Trace:
I20260709 13:16:18.812547  3200 rpcz_store.cc:276] 0709 13:16:17.660284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.700106 (+ 39822us) service_pool.cc:224] Handling call
0709 13:16:17.700411 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.789061 (+ 88650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.789110 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:17.789173 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:17.789225 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.809069 (+1019844us) spinlock_profiling.cc:243] Waited 88.4 ms on lock 0x7b5400043dd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:18.809133 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.809256 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203224960}
I20260709 13:16:18.782925  7419 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.816669  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:18.817649  3200 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:18.817866  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:18.788412  7458 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:16:18.810822  7441 consensus_meta.cc:287] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.002s
I20260709 13:16:18.814232  7443 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:18.822693  7379 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:18.837020  7379 raft_consensus.cc:697] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:18.837287  7458 raft_consensus.cc:697] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:18.838243  7379 consensus_queue.cc:237] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.824752  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:18.816344  7239 raft_consensus.cc:697] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:18.819051  7419 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:18.844129  7427 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.709s	user 0.001s	sys 0.009s
I20260709 13:16:18.844709  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2009) took 1118 ms. Trace:
I20260709 13:16:18.845141  3126 rpcz_store.cc:276] 0709 13:16:17.725956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.068183 (+342227us) service_pool.cc:224] Handling call
0709 13:16:18.077373 (+  9190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.434419 (+357046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.844419 (+410000us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54000a9954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:18.844636 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":810814208}
I20260709 13:16:18.846414  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:18.847239  3126 raft_consensus.cc:2393] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 9: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:18.840938  7239 consensus_queue.cc:237] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.826721  7389 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.817785  7105 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.831233  7212 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:18.833104  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 2001) took 1122 ms. Trace:
I20260709 13:16:18.835249  3200 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:18.856101  3125 rpcz_store.cc:276] 0709 13:16:17.710928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.711143 (+   215us) service_pool.cc:224] Handling call
0709 13:16:18.832888 (+1121745us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54000a8554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:18.833030 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":898787712}
I20260709 13:16:18.835045  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:18.838284  7458 consensus_queue.cc:237] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.836376  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1912) took 1176 ms. Trace:
I20260709 13:16:18.828634  7356 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:18.857465  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:18.859481  3194 rpcz_store.cc:276] 0709 13:16:17.660033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.675385 (+ 15352us) service_pool.cc:224] Handling call
0709 13:16:18.836154 (+1160769us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54001b80d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:18.836300 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":494634368}
I20260709 13:16:18.862986  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:18.863752  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:18.848198  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:18.857867  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:18.865617  3125 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:18.863880  3194 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:18.867211  3200 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:18.871833  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2294) took 2309 ms. Trace:
I20260709 13:16:18.872404  3192 rpcz_store.cc:276] 0709 13:16:16.552208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.663590 (+111382us) service_pool.cc:224] Handling call
0709 13:16:16.667119 (+  3529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:17.620431 (+953312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.620968 (+   537us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:17.631569 (+ 10601us) log.cc:844] Serialized 26 byte log entry
0709 13:16:17.992209 (+360640us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:17.992263 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.992354 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.843423 (+851069us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:18.848991 (+  5568us) raft_consensus.cc:1685] finished
0709 13:16:18.849012 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.859219 (+ 10207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":995282,"raft.queue_time_us":964765,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":5838,"spinlock_wait_cycles":57628032,"thread_start_us":345477,"threads_started":1,"wal-append.queue_time_us":498646}
I20260709 13:16:18.886725  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:18.888182  3125 raft_consensus.cc:2410] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:16:18.848407  7441 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.893564  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:18.894431  3192 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:18.895445  7441 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:18.895578  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:18.897235  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:18.885663  7212 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:18.904588  3192 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:18.904791  7212 raft_consensus.cc:697] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:18.898903  3090 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:18.897372  7419 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:18.903851  7105 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:18.909217  3126 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:18.892894  3194 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:18.907856  3200 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:18.908825  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:18.911772  3090 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:18.871927  7356 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:18.912412  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:18.918347  3125 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 11: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:18.919399  6845 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.920020  6845 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:18.922188  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet 0940cf459a7741b58bd85191d095a404: Illegal state: Replica aaf88538197a49adb8bcf3790309a67e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:18.923656  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:18.925078  3192 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:18.886209  7443 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.926795  3090 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:18.928941  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:18.929705  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:18.930389  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:18.933012  3200 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 13:16:18.912055  7463 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:18.940374  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:18.941061  3192 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:18.942520  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:18.922820  7308 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:18.914558  7464 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:18.928593  7322 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:18.909950  7336 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.926913  7432 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.957383  3192 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:18.958431  3200 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:16:18.945773  7468 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.945497  7463 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.973129  3192 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:18.953495  7365 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:18.976621  3197 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:18.946663  7316 consensus_queue.cc:1059] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:16:18.912029  7212 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:18.978307  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 47374.2us
I20260709 13:16:19.497174  3091 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:18.960839  7334 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:18.971942  7419 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:18.974632  7463 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:19.008998  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 82285.2us
W20260709 13:16:19.015434  7471 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:16:19.015509  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet 5278ab37d43548b39aed98352e8b9e31: Illegal state: Replica aaf88538197a49adb8bcf3790309a67e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:19.544389  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:19.545091  3200 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:18.960647  7308 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:19.033874  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.935463  7417 consensus_queue.cc:260] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:19.012326  6845 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:19.032029  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 76325us
I20260709 13:16:18.971248  7432 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:18.965829  7464 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:19.557881  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:16:19.269191  7427 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:16:19.264942  7285 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.270018  6892 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:18.976828  7468 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:19.276242  7368 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.281658  7389 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:19.555064  7336 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:19.492172  7243 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.938659  7443 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:19.532006  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 441822us
I20260709 13:16:19.533967  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:19.587884  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:19.588332  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 54496.7us
W20260709 13:16:19.494031  7322 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.004s	sys 0.017s
W20260709 13:16:19.592252  7322 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.005s	sys 0.018s
I20260709 13:16:19.592574  7322 raft_consensus.cc:697] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:19.592891  7336 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.593374  7336 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:19.593497  7322 consensus_queue.cc:237] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:19.549784  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:19.531404  7220 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.020s	sys 0.041s
I20260709 13:16:19.567605  3125 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:19.547073  7465 raft_consensus.cc:3055] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:19.564224  7419 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:19.599166  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:19.601087  3042 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:19.601579  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2528) took 1969 ms. Trace:
I20260709 13:16:19.576515  6892 raft_consensus.cc:697] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:19.602018  3042 rpcz_store.cc:276] 0709 13:16:17.632295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.633219 (+   924us) service_pool.cc:224] Handling call
0709 13:16:19.587689 (+1954470us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b5800000f98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff8353790a0 00007ff835378984 00007ff82e8f36d4 00007ff82e8f3662
0709 13:16:19.601499 (+ 13810us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6201728}
W20260709 13:16:19.600459  7220 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.020s	sys 0.042s
I20260709 13:16:19.600557  7382 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:19.600399  7465 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:19.596940  7389 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.601879  7369 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:16:19.611975  7474 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.627s	user 0.002s	sys 0.000s
I20260709 13:16:19.569478  7285 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:19.624184  7382 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:19.579171  7368 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:19.602240  7477 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:19.630668  3194 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.019s	sys 0.050s
I20260709 13:16:19.600509  7243 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:19.642179  3194 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.019s	sys 0.050s
I20260709 13:16:19.626164  7440 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:19.656896  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet 1247b6af0f274b8c9d99b6be2d7fbc6b: Illegal state: Replica 501fdf2af2bc4b0c971ae880e98f466b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:19.640372  7382 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:19.639647  7369 raft_consensus.cc:697] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:19.635200  7389 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:19.663748  7308 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:19.689455  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2021) took 1959 ms. Trace:
I20260709 13:16:19.690631  3117 rpcz_store.cc:276] 0709 13:16:17.729982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.497972 (+767990us) service_pool.cc:224] Handling call
0709 13:16:18.498290 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.736861 (+238571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.689112 (+952251us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b5400459cd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:19.689370 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":547024128}
W20260709 13:16:19.679332  7356 consensus_meta.cc:287] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.760s	user 0.007s	sys 0.010s
I20260709 13:16:19.694527  3090 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:19.696820  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:19.658123  7477 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:19.662428  6892 consensus_queue.cc:237] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:19.730199  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:19.731165  3117 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:19.731346  7368 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:19.731665  7488 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:19.732075  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:19.732257  7336 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:19.732584  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 622) took 1468 ms. Trace:
I20260709 13:16:19.734021  7145 raft_consensus.cc:3055] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:19.734532  7145 raft_consensus.cc:740] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:19.719803  7480 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:19.735855  7477 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:19.735466  7145 consensus_queue.cc:260] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:19.696056  7308 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:19.736444  7477 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:19.736773  7308 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:19.737867  7243 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:19.701478  7356 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:19.738406  7243 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:19.738868  7308 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:19.686993  7369 consensus_queue.cc:237] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:19.739763  7356 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:19.740010  7464 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:19.740439  7389 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:19.669523  7465 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:19.738562  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:19.732964  3194 rpcz_store.cc:276] 0709 13:16:18.264670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.929072 (+664402us) service_pool.cc:224] Handling call
0709 13:16:18.930728 (+  1656us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:18.931162 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.931194 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:18.942208 (+ 11014us) log.cc:844] Serialized 52 byte log entry
0709 13:16:19.646451 (+704243us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:19.646511 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.646609 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.732258 (+ 85649us) raft_consensus.cc:1685] finished
0709 13:16:19.732283 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.732506 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":10163,"thread_start_us":671714,"threads_started":1,"wal-append.queue_time_us":715099}
I20260709 13:16:19.733958  7336 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:19.741925  3125 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
W20260709 13:16:19.744215  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.723718  7440 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:19.696112  7040 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.717533  7432 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:19.745255  7468 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:19.747798  7440 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:19.747979  7336 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:19.751447  7285 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:19.747969  7443 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:19.755401  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 717) took 1266 ms. Trace:
I20260709 13:16:19.736785  7145 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:19.756378  3195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2299) took 1983 ms (client timeout 1703 ms). Trace:
W20260709 13:16:19.756801  3195 rpcz_store.cc:269] 0709 13:16:17.772530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.932571 (+160041us) service_pool.cc:224] Handling call
0709 13:16:19.756170 (+1823599us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b54001de554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:19.756312 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1546575616}
I20260709 13:16:19.758205  3796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 552) took 1055 ms. Trace:
I20260709 13:16:19.758607  3796 rpcz_store.cc:276] 0709 13:16:18.703214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.703431 (+   217us) service_pool.cc:224] Handling call
0709 13:16:19.757993 (+1054562us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b5400629654. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:19.758125 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67755904}
I20260709 13:16:19.760428  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2020) took 2030 ms. Trace:
I20260709 13:16:19.760886  3123 rpcz_store.cc:276] 0709 13:16:17.729641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.496997 (+767356us) service_pool.cc:224] Handling call
0709 13:16:18.497391 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.751484 (+254093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.760205 (+1008721us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b540011b7d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:19.760371 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571210112}
I20260709 13:16:19.762061  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:19.762773  7382 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:19.763855  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:19.766669  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:19.766559  7040 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:19.767593  3122 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
W20260709 13:16:19.768540  3119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 2019) took 2039 ms (client timeout 1970 ms). Trace:
W20260709 13:16:19.769011  3119 rpcz_store.cc:269] 0709 13:16:17.729346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.820825 (+ 91479us) service_pool.cc:224] Handling call
0709 13:16:19.768357 (+1947532us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b5400302ad4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:19.768472 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":706883328}
I20260709 13:16:19.770123  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:19.771462  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:19.772769  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:19.773907  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.774420  7440 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:19.775467  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:19.778106  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:19.778345  7382 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:19.778767  3044 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:19.782373  3050 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:19.780036  3044 raft_consensus.cc:1275] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:16:19.791810  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 122882us
I20260709 13:16:19.768543  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:19.794019  3122 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:19.755846  3048 rpcz_store.cc:276] 0709 13:16:18.486934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.561984 (+ 75050us) service_pool.cc:224] Handling call
0709 13:16:18.562338 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.595692 (+ 33354us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:18.595721 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:18.595770 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:18.595801 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.753443 (+1157642us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b54000c6f54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:19.753502 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.753666 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":443,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":9927,"spinlock_wait_cycles":75925888}
I20260709 13:16:19.774375  7465 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:19.802779  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:19.804663  3125 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:19.805876  3165 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:19.807257  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:19.807317  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:19.808985  3120 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:16:19.809188  3042 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:19.811838  3043 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:19.812062  3123 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 11: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:19.815937  3165 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:19.798575  7145 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:19.813278  7285 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:19.813391  7040 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:19.828756  3796 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:19.829221  3122 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:19.814862  7164 consensus_queue.cc:1059] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:16:19.830440  7164 raft_consensus.cc:3055] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:19.830921  7164 raft_consensus.cc:740] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:19.831980  7164 consensus_queue.cc:260] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:19.823092  7401 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:19.834991  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:19.854482  3122 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:19.833534  7164 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:19.827008  7285 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.819288  7389 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:16:19.834671  7494 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:19.866734  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:19.824244  7145 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:19.853605  7336 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:19.899155  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.876672  3790 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:19.871871  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:19.861909  3015 leader_election.cc:336] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 1.970s (SENT)
W20260709 13:16:19.864212  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 164848us
I20260709 13:16:19.905668  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:19.942785  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:19.943480  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:19.942088  3122 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:19.944420  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 82573.9us
I20260709 13:16:19.945397  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:19.946612  3799 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:19.947134  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:19.942836  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:19.859987  7401 raft_consensus.cc:697] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:19.949178  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:19.948868  7401 consensus_queue.cc:237] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:19.949976  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:19.950380  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:19.864235  7320 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.952418  3090 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:19.954872  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:19.953709  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:19.864398  7480 raft_consensus.cc:697] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:19.956449  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:19.964955  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:19.951831  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:19.879197  7488 raft_consensus.cc:697] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:19.868537  7285 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:20.021886  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:20.024139  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 74675.7us
I20260709 13:16:20.037170  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:19.967258  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:20.025655  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:20.030517  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:20.032232  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:20.038358  3793 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:19.966421  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:20.033215  3122 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:20.039158  3200 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:20.038506  3195 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:20.039925  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:20.040518  3122 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:20.034824  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2306) took 2257 ms. Trace:
I20260709 13:16:20.041270  3197 rpcz_store.cc:276] 0709 13:16:17.777278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.483118 (+705840us) service_pool.cc:224] Handling call
0709 13:16:18.836322 (+353204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.502564 (+666242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.033882 (+531318us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54001b80d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:20.034630 (+   748us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54001b80d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:20.034765 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1133653632}
I20260709 13:16:20.042501  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:20.043394  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:20.043943  3197 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:20.044543  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:20.035212  7145 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:19.998153  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.024396  7506 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:20.032815  7442 raft_consensus.cc:3055] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:20.047467  3192 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:16:20.048658  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:20.063519  3199 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:16:20.065200  3199 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:19.966228  7336 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:20.059625  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:20.062620  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:20.072242  3048 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 12: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:20.020970  7320 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:20.022944  7440 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:20.072934  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:20.073206  7440 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:20.074261  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:20.075465  7440 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:20.075862  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:20.076045  7440 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:20.076483  7440 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:20.076870  7440 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:20.077034  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:20.078186  3791 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:20.078265  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:20.045332  7492 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:16:20.079828  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:20.036149  7010 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:20.080835  7010 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:20.081350  7010 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:20.081010  7285 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:20.084551  7285 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:20.086442  7493 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:20.080276  7492 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:20.035614  7490 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:20.088740  7490 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:20.091935  7490 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:20.088598  7492 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:20.095160  7010 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:20.096006  7492 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:20.097441  7497 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:20.098161  7497 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:20.098634  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:20.068548  3199 raft_consensus.cc:1240] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:20.058147  3195 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:19.940662  7494 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:20.036007  7468 consensus_queue.cc:1059] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:16:20.148094  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2307) took 2370 ms. Trace:
W20260709 13:16:20.168774  3196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2308) took 2387 ms (client timeout 2393 ms). Trace:
I20260709 13:16:20.147331  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:20.114331  3200 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
W20260709 13:16:20.169490  3196 rpcz_store.cc:269] 0709 13:16:17.794834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.117936 (+323102us) service_pool.cc:224] Handling call
0709 13:16:20.168522 (+2050586us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b540033e5d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:20.168710 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1447699200}
I20260709 13:16:20.102087  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:20.137424  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 170218us
I20260709 13:16:20.101282  3192 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:20.107016  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 53432us
I20260709 13:16:20.020970  7496 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:20.172695  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:20.041997  7356 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:20.169718  3118 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:16:20.167518  3191 rpcz_store.cc:276] 0709 13:16:17.777604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.143248 (+365644us) service_pool.cc:224] Handling call
0709 13:16:20.147878 (+2004630us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b540013bad4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:20.148030 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1169259264}
W20260709 13:16:20.175464  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.175899  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.176225  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 665) took 2424 ms. Trace:
I20260709 13:16:20.165172  7480 consensus_queue.cc:237] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:20.179046  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.179497  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.181035  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:20.150760  7448 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 1.680s	user 0.005s	sys 0.009s
I20260709 13:16:20.182451  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:20.187192  3118 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:20.173481  7356 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:20.190481  7356 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:19.967041  7498 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:20.133646  3122 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:20.185367  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2518) took 2958 ms. Trace:
I20260709 13:16:20.173565  7492 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:20.191525  7492 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.191260  3045 rpcz_store.cc:276] 0709 13:16:17.226471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.229533 (+  3062us) service_pool.cc:224] Handling call
0709 13:16:17.663965 (+434432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.685581 (+ 21616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.185036 (+2499455us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b54001f5750. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:20.185283 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":996045056}
I20260709 13:16:20.192029  7492 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:20.148123  7320 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:20.192838  7498 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.193320  7498 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:20.194078  3793 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:20.195613  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:20.196198  3122 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:18.692965  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:20.196978  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:20.197571  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.197501  3122 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
W20260709 13:16:20.190619  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.204123  3199 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:20.204452  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:20.205283  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:20.205623  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:20.206718  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:20.206940  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:20.207754  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:20.184582  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:20.208159  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:20.100956  7497 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:20.068128  7442 raft_consensus.cc:740] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:20.213204  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:20.214083  3200 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:20.215103  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:20.137005  7010 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:20.208786  3198 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:20.216787  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:20.218039  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:20.220465  3196 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 11: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:20.222039  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:20.222945  3122 raft_consensus.cc:2376] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10. Re-sending same reply.
I20260709 13:16:20.224577  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:20.225560  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:20.222095  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 171580us
I20260709 13:16:20.222012  3191 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:16:20.226774  3090 leader_election.cc:336] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Timed out: RequestConsensusVote RPC to 127.1.227.132:43109 timed out after 1.708s (SENT)
I20260709 13:16:20.221547  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:20.228057  3196 raft_consensus.cc:2368] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12.
I20260709 13:16:20.229089  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:20.230660  3198 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:20.239315  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:20.250162  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:20.225497  7463 consensus_meta.cc:287] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.662s	user 0.008s	sys 0.010s
I20260709 13:16:20.182204  7490 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:16:20.187040  7468 consensus_queue.cc:1059] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:16:20.212739  7369 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:20.256467  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:20.264155  3198 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:20.218361  3118 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:20.141641  7488 consensus_queue.cc:237] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:20.237382  7438 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:20.271582  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:20.252398  7010 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:20.235404  7356 consensus_queue.cc:1059] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:16:20.251139  7508 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:20.176652  3125 rpcz_store.cc:276] 0709 13:16:17.751663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.822601 (+2070938us) service_pool.cc:224] Handling call
0709 13:16:19.828751 (+  6150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.829010 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:19.952649 (+123639us) log.cc:844] Serialized 14 byte log entry
0709 13:16:20.175571 (+222922us) log.cc:844] Serialized 14 byte log entry
0709 13:16:20.175879 (+   308us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:20.175926 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:20.175974 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.176043 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:20.176167 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":126153,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":5042,"thread_start_us":320102,"threads_started":2}
I20260709 13:16:20.275915  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2539) took 2005 ms. Trace:
I20260709 13:16:20.270081  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:20.291146  3118 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:16:20.289269  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:20.287865  3049 rpcz_store.cc:276] 0709 13:16:18.270315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.270849 (+   534us) service_pool.cc:224] Handling call
0709 13:16:18.271256 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.290048 (+ 18792us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.290100 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:18.297234 (+  7134us) log.cc:844] Serialized 26 byte log entry
0709 13:16:18.353331 (+ 56097us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:18.353395 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.353522 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:20.150071 (+1796549us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:20.268968 (+118897us) raft_consensus.cc:1685] finished
0709 13:16:20.268998 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:20.275822 (+  6824us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11997,"raft.queue_time_us":117967,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":14663,"spinlock_wait_cycles":49391488,"thread_start_us":55672,"threads_started":1,"wal-append.queue_time_us":173186}
I20260709 13:16:20.284859  3200 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:20.281181  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:20.306099  3045 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:20.261437  7378 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:20.296054  3048 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:20.307253  3044 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:16:20.313882  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 666) took 2547 ms. Trace:
I20260709 13:16:20.313943  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:20.310141  7322 consensus_queue.cc:1059] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:16:20.315867  3090 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:20.316000  7040 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:20.272891  7490 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:20.277804  6892 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:20.347882  3118 rpcz_store.cc:276] 0709 13:16:17.766179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.310931 (+2544752us) service_pool.cc:224] Handling call
0709 13:16:20.311208 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.311371 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:20.311397 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:20.311438 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:20.313624 (+  2186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.313700 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:20.313822 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:20.352061  3051 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:20.266197  7369 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:20.260154  7463 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:20.355489  3045 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:20.355696  3048 raft_consensus.cc:1240] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:20.287881  7438 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:20.294100  7508 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.363749  3044 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:20.279112  7468 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:20.379617  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:20.380673  3044 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 12: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:20.382525  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:20.311642  7505 consensus_queue.cc:1059] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:16:20.364463  6892 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.269338  7442 consensus_queue.cc:260] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:20.387321  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:20.288798  7010 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:20.321715  7378 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:20.423465  3117 raft_consensus.cc:2368] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13.
I20260709 13:16:20.425552  3165 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:20.429643  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:20.435096  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:20.375005  7509 raft_consensus.cc:3055] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:20.438803  3192 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
W20260709 13:16:20.426003  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 252471us
I20260709 13:16:20.440834  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:20.443435  3044 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:20.377657  7508 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:20.377864  7468 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:20.423110  6892 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:20.368557  7490 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:20.451594  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 266348us
I20260709 13:16:20.428946  7040 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:16:20.458258  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 96179.4us
I20260709 13:16:20.451264  3051 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:20.460585  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:20.461184  3200 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:20.445816  7285 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:20.463219  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:20.475092  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.469458  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:20.476176  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:20.465801  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:20.477746  3200 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
I20260709 13:16:20.455065  7356 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.479311  7356 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:20.486680  7356 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:20.466982  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 151190us
I20260709 13:16:20.461198  3121 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:16:20.467598  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:20.469218  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:20.492134  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2007) took 2766 ms. Trace:
I20260709 13:16:20.470527  3044 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:20.442170  7509 raft_consensus.cc:740] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:20.492523  3121 rpcz_store.cc:276] 0709 13:16:17.725292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.725408 (+   116us) service_pool.cc:224] Handling call
0709 13:16:20.460826 (+2735418us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b5800003398. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28eeee 0000000000375939 00007ff8353021e0 00007ff8353cb0c4 00007ff8353cb131 00007ff83538cfc0 00007ff835377929 00007ff8353773d2 00007ff82e8eebd4
0709 13:16:20.460968 (+   142us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.491862 (+ 30894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.492076 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3415040}
I20260709 13:16:20.505686  3198 raft_consensus.cc:2393] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 12: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:20.425402  7164 consensus_queue.cc:1059] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:16:20.454329  7442 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:20.451330  7468 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:20.450426  7494 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:20.540858  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:20.457237  7040 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.464452  7505 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:20.549968  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:20.550611  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:20.539764  7523 raft_consensus.cc:3055] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:20.546458  7040 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:20.546133  7494 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.586529  7494 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:20.589555  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:20.493767  7509 consensus_queue.cc:260] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:20.578181  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:20.593015  3049 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:20.590883  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:20.594511  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:20.588307  7463 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:20.599220  7513 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
W20260709 13:16:20.603847  7476 log.cc:927] Time spent T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.999s	user 0.007s	sys 0.000s
I20260709 13:16:20.606877  7336 raft_consensus.cc:3055] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:20.607363  7336 raft_consensus.cc:740] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:20.608369  7336 consensus_queue.cc:260] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:20.610723  7423 consensus_queue.cc:260] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:20.611881  7423 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:20.613453  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.612907  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 70954.6us
I20260709 13:16:20.556191  7523 raft_consensus.cc:740] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:20.577116  7498 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:20.555377  7505 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:20.850440  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 305640us
W20260709 13:16:20.673992  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 59577.1us
W20260709 13:16:21.558224  7423 consensus_meta.cc:287] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.946s	user 0.009s	sys 0.004s
I20260709 13:16:21.558665  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:21.558768  7497 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.559477  7497 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:21.502800  7492 consensus_meta.cc:287] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.310s	user 0.010s	sys 0.004s
I20260709 13:16:20.907169  7224 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.560494  7492 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:20.779325  7463 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.561203  7224 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:21.562297  7463 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:20.745419  7145 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:21.565027  7224 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:21.564730  7145 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:20.784806  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:16:20.794116  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.682636  7164 raft_consensus.cc:3055] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:20.663555  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:21.596053  3044 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:20.989631  7468 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:20.916520  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:21.560027  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:21.599740  3124 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:21.568670  7423 consensus_queue.cc:1059] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:20.620428  3761 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:20.853677  7523 consensus_queue.cc:260] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:20.619007  7522 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.976s
I20260709 13:16:20.868088  7378 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:21.054602  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.563759  7492 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:21.578758  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:20.783321  7473 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 1.805s	user 0.002s	sys 0.000s
W20260709 13:16:21.587170  3762 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.012s	sys 0.016s
W20260709 13:16:20.675580  7510 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.204s	user 0.000s	sys 0.003s
W20260709 13:16:21.502105  7040 consensus_meta.cc:287] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.921s	user 0.009s	sys 0.002s
W20260709 13:16:20.678577  7440 consensus_meta.cc:287] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.004s
I20260709 13:16:21.591635  3122 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:16:20.686558  7514 log.cc:927] Time spent T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:16:20.878618  7322 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.000s	sys 0.012s
W20260709 13:16:21.215942  7488 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.007s	sys 0.037s
I20260709 13:16:20.786089  7519 raft_consensus.cc:3055] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:20.710413  7529 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:21.594784  3123 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:21.596674  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2555) took 1022 ms. Trace:
I20260709 13:16:21.644276  3044 rpcz_store.cc:276] 0709 13:16:20.574543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.613709 (+ 39166us) service_pool.cc:224] Handling call
0709 13:16:21.596589 (+982880us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:20.620846  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:21.586617  7333 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.010s	sys 0.005s
I20260709 13:16:20.768865  7526 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.565267  7463 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:20.853987  7010 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:20.953308  7490 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:20.664367  7494 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:21.604441  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 984027us
I20260709 13:16:20.772569  7285 raft_consensus.cc:697] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:21.610210  3191 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 8.
W20260709 13:16:21.626030  3166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.035s	sys 0.068s
W20260709 13:16:21.627971  3762 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.013s	sys 0.017s
I20260709 13:16:21.628760  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2176) took 3116 ms. Trace:
I20260709 13:16:21.629930  7505 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:21.630208  7468 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:21.595506  7164 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:16:21.635603  3046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 2170) took 3226 ms (client timeout 2084 ms). Trace:
I20260709 13:16:21.639009  3124 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:21.616043  7224 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:16:21.642479  3042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.008s	sys 0.028s
W20260709 13:16:21.642385  3165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.013s	sys 0.040s
W20260709 13:16:21.645920  3163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.013s	sys 0.018s
I20260709 13:16:21.645699  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47488 (request call id 723) took 1068 ms. Trace:
I20260709 13:16:21.647317  7423 consensus_queue.cc:1243] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:16:21.648213  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 88252.9us
I20260709 13:16:21.684209  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2310) took 3867 ms. Trace:
W20260709 13:16:21.696417  3165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.014s	sys 0.045s
W20260709 13:16:21.631165  7374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.002s	sys 0.025s
W20260709 13:16:21.658660  7442 consensus_meta.cc:287] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.115s	user 0.012s	sys 0.000s
W20260709 13:16:21.640487  7488 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.013s	sys 0.037s
W20260709 13:16:21.697762  3166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.086s	user 0.036s	sys 0.069s
W20260709 13:16:21.697901  3042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.024s	user 0.009s	sys 0.029s
I20260709 13:16:21.685400  3044 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 13:16:21.696417  3046 rpcz_store.cc:269] 0709 13:16:18.405204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.408500 (+  3296us) service_pool.cc:224] Handling call
0709 13:16:21.631107 (+3222607us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b540032ffd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:21.631236 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":682677632}
W20260709 13:16:21.697482  3163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.015s	sys 0.018s
W20260709 13:16:21.696532  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 1.0739e+06us
I20260709 13:16:21.704365  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:21.697134  3047 rpcz_store.cc:276] 0709 13:16:18.512023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.616845 (+104822us) service_pool.cc:224] Handling call
0709 13:16:18.639835 (+ 22990us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.640292 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.640336 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:18.640915 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:16:18.805052 (+164137us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b1800453940. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:16:18.913916 (+108864us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:18.914002 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.922071 (+  8069us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:20.782495 (+1860424us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:21.628519 (+846024us) raft_consensus.cc:1685] finished
0709 13:16:21.628546 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.628699 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":8217,"spinlock_wait_cycles":20025344,"thread_start_us":108493,"threads_started":1,"wal-append.queue_time_us":311280}
I20260709 13:16:21.697305  3193 rpcz_store.cc:276] 0709 13:16:17.816682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.491660 (+674978us) service_pool.cc:224] Handling call
0709 13:16:18.491963 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.492577 (+   614us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:20.280066 (+1787489us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b18003a44a0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c3455 00007ff833dab3c7 00007ff8303bd9a7 00007ff8303cd0bf 00007ff8303cd038
0709 13:16:20.457120 (+177054us) log.cc:844] Serialized 14 byte log entry
0709 13:16:20.727536 (+270416us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:20.727994 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:16:20.728153 (+   159us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:20.744929 (+ 16776us) log.cc:844] Serialized 14 byte log entry
0709 13:16:20.745235 (+   306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.745578 (+   343us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:21.683923 (+938345us) raft_consensus.cc:1685] finished
0709 13:16:21.683952 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.684133 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":312970,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":92,"raft.queue_time_us":1740127,"raft.run_cpu_time_us":427,"raft.run_wall_time_us":33278,"spinlock_wait_cycles":9657088,"thread_start_us":352486,"threads_started":2,"wal-append.queue_time_us":1135675}
I20260709 13:16:21.705704  3124 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:16:21.707646  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 56997.3us
W20260709 13:16:21.697890  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 1.07115e+06us
I20260709 13:16:21.709286  3091 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:21.696708  3049 rpcz_store.cc:276] 0709 13:16:20.577004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.593679 (+ 16675us) service_pool.cc:224] Handling call
0709 13:16:21.645610 (+1051931us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.699257  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:21.710906  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:21.711947  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2120) took 1013 ms. Trace:
W20260709 13:16:21.659660  7333 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.010s	sys 0.005s
I20260709 13:16:21.712317  3124 rpcz_store.cc:276] 0709 13:16:20.698676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.704048 (+1005372us) service_pool.cc:224] Handling call
0709 13:16:21.711895 (+  7847us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.673110  7535 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:21.700937  7374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.002s	sys 0.026s
W20260709 13:16:21.727763  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.641968  7519 raft_consensus.cc:740] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:21.714996  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 721) took 1138 ms. Trace:
I20260709 13:16:21.750589  3042 rpcz_store.cc:276] 0709 13:16:20.576452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.616918 (+ 40466us) service_pool.cc:224] Handling call
0709 13:16:20.617287 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.617542 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:20.673116 (+ 55574us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.714541 (+1041425us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:21.714620 (+    79us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:21.714680 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.714769 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.714921 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12939,"prepare.queue_time_us":55332,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":56,"thread_start_us":1027977,"threads_started":1}
I20260709 13:16:21.716321  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:21.753566  3124 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:21.754438  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2125) took 1054 ms. Trace:
I20260709 13:16:21.674572  7322 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:21.768178  7322 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:21.749696  7488 consensus_queue.cc:1059] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:16:21.769590  3123 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
W20260709 13:16:21.778513  3123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 2047) took 1230 ms (client timeout 1619 ms). Trace:
W20260709 13:16:21.780297  3123 rpcz_store.cc:269] 0709 13:16:20.549195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.784242 (+235047us) service_pool.cc:224] Handling call
0709 13:16:21.778423 (+994181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.730254  7442 consensus_queue.cc:1059] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:21.730283  7533 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.731158  7423 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:21.784340  7480 raft_consensus.cc:3055] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:21.784494  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:21.784822  7423 raft_consensus.cc:3055] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:21.784982  7480 raft_consensus.cc:740] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:21.785238  7423 raft_consensus.cc:740] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:21.786399  7423 consensus_queue.cc:260] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:21.744158  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.635742  7040 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:21.789285  7040 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:21.746372  6892 consensus_meta.cc:287] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.281s	user 0.012s	sys 0.000s
I20260709 13:16:21.790045  6892 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:21.784349  7533 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:21.792584  7508 consensus_meta.cc:287] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.337s	user 0.013s	sys 0.000s
I20260709 13:16:21.793115  7508 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:21.795033  7533 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:21.785255  3123 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:16:21.796483  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2121) took 1097 ms. Trace:
I20260709 13:16:21.796877  3123 rpcz_store.cc:276] 0709 13:16:20.698967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.784194 (+1085227us) service_pool.cc:224] Handling call
0709 13:16:21.796418 (+ 12224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.748194  7537 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:21.748430  7277 raft_consensus.cc:3055] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:21.636348  7440 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:21.754814  3124 rpcz_store.cc:276] 0709 13:16:20.700124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.716075 (+1015951us) service_pool.cc:224] Handling call
0709 13:16:21.754361 (+ 38286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.728204  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:21.752974  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:21.645215  7492 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:16:21.713752  7463 consensus_queue.cc:1059] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:16:21.711100  7494 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:21.762568  7285 consensus_queue.cc:237] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:21.728933  7505 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:21.767422  7538 raft_consensus.cc:3055] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:21.771890  7369 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:21.661510  7529 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:21.674571  7526 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:21.773515  7320 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:21.774763  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.775667  7519 consensus_queue.cc:260] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:21.782861  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2189) took 2015 ms. Trace:
W20260709 13:16:21.789561  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.943260  3043 rpcz_store.cc:276] 0709 13:16:19.767322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.767467 (+   145us) service_pool.cc:224] Handling call
0709 13:16:19.767757 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.812311 (+ 44554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.782483 (+1970172us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b54003a8ed4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:21.782774 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100812160}
I20260709 13:16:21.800153  7468 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:21.756050  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:21.948438  3044 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 10: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:21.806351  7322 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:21.808750  3049 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:21.815768  7553 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:21.729352  7535 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:21.822364  7498 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:21.809989  7508 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:21.833112  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:21.712821  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.746362  7164 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:21.931712  6892 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:21.881170  7236 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:21.910393  3050 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:16:21.911628  3117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2107) took 3067 ms (client timeout 2084 ms). Trace:
I20260709 13:16:21.916553  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:21.920157  3051 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2548) took 1505 ms (client timeout 1904 ms). Trace:
I20260709 13:16:21.906605  7277 raft_consensus.cc:740] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:21.910033  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:22.010746  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:22.022301  3051 rpcz_store.cc:269] 0709 13:16:20.414749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.429293 (+ 14544us) service_pool.cc:224] Handling call
0709 13:16:21.919971 (+1490678us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b54001ae5d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:21.920100 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47597824}
I20260709 13:16:22.029222  3123 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:22.029443  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2342) took 1485 ms. Trace:
I20260709 13:16:22.029688  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:22.015010  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 456472us
I20260709 13:16:22.029681  3121 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:22.031965  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2022) took 3649 ms. Trace:
W20260709 13:16:21.997867  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 51804us
I20260709 13:16:22.023478  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2122) took 1324 ms. Trace:
I20260709 13:16:22.033917  3124 rpcz_store.cc:276] 0709 13:16:20.699263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.916198 (+1216935us) service_pool.cc:224] Handling call
0709 13:16:22.023408 (+107210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.032804  3121 rpcz_store.cc:276] 0709 13:16:18.382879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.009108 (+3626229us) service_pool.cc:224] Handling call
0709 13:16:22.009577 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.031572 (+ 21995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.031869 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:22.022917  3117 rpcz_store.cc:269] 0709 13:16:18.843730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.731784 (+888054us) service_pool.cc:224] Handling call
0709 13:16:21.911328 (+2179544us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b54001c39d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:21.911529 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1572809600}
I20260709 13:16:22.024163  3042 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:16:21.917980  7333 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.012148  3196 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:21.922369  7490 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:22.030874  3051 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
W20260709 13:16:21.980923  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 252779us
W20260709 13:16:22.020519  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 66811.5us
I20260709 13:16:22.038689  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2343) took 1494 ms. Trace:
I20260709 13:16:22.039222  3164 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:22.039250  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:22.030192  3198 rpcz_store.cc:276] 0709 13:16:20.543652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.010399 (+1466747us) service_pool.cc:224] Handling call
0709 13:16:22.029382 (+ 18983us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.922201  7463 consensus_queue.cc:1243] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:22.037943  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:22.047415  3124 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:22.002653  7497 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:22.014484  7164 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:21.941949  7538 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:16:22.053102  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 342675us
W20260709 13:16:22.040012  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.002485  7529 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:22.062534  3091 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:22.025590  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 324546us
I20260709 13:16:22.006678  7523 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:22.083104  3091 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:22.014671  7535 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:21.995982  7519 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:22.039079  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:22.084862  3091 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:22.087298  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:22.041175  3164 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:22.054749  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.056236  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:22.088305  3120 raft_consensus.cc:2393] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 9: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:22.061645  3762 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:22.040977  3090 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:22.082584  3123 raft_consensus.cc:2410] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:16:22.081396  3124 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:22.018011  7551 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:22.082830  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:22.089566  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2119) took 1391 ms. Trace:
I20260709 13:16:22.089895  3047 raft_consensus.cc:2368] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 11. Current term is 12.
I20260709 13:16:22.089815  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2127) took 1389 ms. Trace:
I20260709 13:16:22.039065  3196 rpcz_store.cc:276] 0709 13:16:20.543985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.011364 (+1467379us) service_pool.cc:224] Handling call
0709 13:16:22.011720 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.038454 (+ 26734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.038635 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:22.087962  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 48955.8us
I20260709 13:16:22.090191  3123 rpcz_store.cc:276] 0709 13:16:20.698382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.862311 (+1163929us) service_pool.cc:224] Handling call
0709 13:16:22.089485 (+227174us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:22.089267  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 48409us
I20260709 13:16:22.091670  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:22.091512  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:22.092301  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:21.936964  7505 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.094086  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:22.090512  3124 rpcz_store.cc:276] 0709 13:16:20.700671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.037619 (+1336948us) service_pool.cc:224] Handling call
0709 13:16:22.089705 (+ 52086us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:22.094874  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 53795.4us
I20260709 13:16:22.049124  7506 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:22.099862  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:22.088901  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:22.092857  3123 raft_consensus.cc:2410] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
W20260709 13:16:22.167868  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 83128us
I20260709 13:16:22.051532  7148 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.081660  7224 raft_consensus.cc:697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 12 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:16:22.177663  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 116123us
I20260709 13:16:21.907362  7537 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:22.166966  3124 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:22.183506  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2096) took 3342 ms. Trace:
I20260709 13:16:22.184073  3124 rpcz_store.cc:276] 0709 13:16:18.840886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.166309 (+3325423us) service_pool.cc:224] Handling call
0709 13:16:22.166727 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.183177 (+ 16450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.183434 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.185611  3124 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:16:22.186483  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2101) took 3344 ms. Trace:
I20260709 13:16:22.094338  7498 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:22.051075  7490 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:22.171712  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 71936.3us
I20260709 13:16:22.099862  7322 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:22.174441  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 80458.3us
I20260709 13:16:22.035655  7236 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.176712  7440 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:21.993851  7320 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:22.167240  7237 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.169489  3091 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:22.097940  7445 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:22.176115  7148 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:22.206560  7537 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:22.206935  7148 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:22.113714  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2123) took 1414 ms. Trace:
I20260709 13:16:22.207515  3120 rpcz_store.cc:276] 0709 13:16:20.699553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.049103 (+1349550us) service_pool.cc:224] Handling call
0709 13:16:22.113611 (+ 64508us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.100106  6892 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:22.093348  7010 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:22.103683  7239 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:22.191334  3164 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:22.214556  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 143589us
I20260709 13:16:22.191958  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:22.218531  3047 raft_consensus.cc:2393] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 14: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:22.218663  3091 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:22.219499  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:22.219683  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:22.093439  7529 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:22.220609  7529 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:22.221094  3091 leader_election.cc:400] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 11. Current term is 12.
I20260709 13:16:22.221872  3091 leader_election.cc:403] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:22.223068  7529 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:22.224920  7529 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:16:22.226758  3196 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:22.227007  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:22.227757  7554 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:22.227844  3193 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:22.228255  7554 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:22.228549  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:22.174415  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2126) took 1474 ms. Trace:
I20260709 13:16:22.199849  7322 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.194300  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:22.166395  7378 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.172797  7243 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:16:22.029405  7553 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:22.167526  7374 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:22.178885  7488 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:22.098694  7552 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:22.185046  7277 consensus_queue.cc:260] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.204672  7548 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:22.049430  7333 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:22.177320  7285 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:22.086856  7497 consensus_queue.cc:1059] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:16:22.177635  7231 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:22.093348  7551 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.231577  3123 rpcz_store.cc:276] 0709 13:16:20.700440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.091407 (+1390967us) service_pool.cc:224] Handling call
0709 13:16:22.174355 (+ 82948us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.233636  3761 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:22.176981  7557 consensus_queue.cc:1059] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 13:16:22.284451  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 63706.3us
I20260709 13:16:22.186961  3124 rpcz_store.cc:276] 0709 13:16:18.842273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.184905 (+3342632us) service_pool.cc:224] Handling call
0709 13:16:22.185327 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.186163 (+   836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.186421 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.201651  7366 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:22.256989  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 78625.6us
I20260709 13:16:22.228719  7554 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:22.229655  7537 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:22.243973  7322 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:22.244334  6892 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:16:22.276605  7562 consensus_queue.cc:1059] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:16:22.302394  7236 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:22.304191  7423 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:22.243350  7010 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:22.212980  7237 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.278638  7320 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:22.310228  7526 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:22.310448  7237 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:22.294806  7497 raft_consensus.cc:3055] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:22.310823  7509 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:22.311167  7497 raft_consensus.cc:740] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:22.312170  7497 consensus_queue.cc:260] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:22.282007  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 48472.2us
I20260709 13:16:22.314877  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:22.278437  7224 consensus_queue.cc:237] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:22.287693  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 638) took 2263 ms. Trace:
I20260709 13:16:22.315995  3195 rpcz_store.cc:276] 0709 13:16:20.024380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.169087 (+144707us) service_pool.cc:224] Handling call
0709 13:16:20.169449 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.169860 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:20.169888 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:20.170349 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.997502 (+1827153us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b48001b0258. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff8352dcaa1 00007ff8352d3b37 00007ff8352d39ca 00007ff8353cb26f 00007ff8353caf37 00007ff8353df55c 00007ff8353df508 00007ff8353df488 00007ff8353df443 00007ff8353de6ec 00007ff834308a96
0709 13:16:22.045827 (+ 48325us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b1800407920. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:16:22.168561 (+122734us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:22.287000 (+118439us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.287349 (+   349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.287451 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.287496 (+    45us) raft_consensus.cc:1685] finished
0709 13:16:22.287509 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.287632 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32194,"prepare.queue_time_us":45160,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":6539,"raft.queue_time_us":4926,"raft.run_cpu_time_us":21584,"raft.run_wall_time_us":1822468,"spinlock_wait_cycles":23079680,"thread_start_us":224634,"threads_started":2,"wal-append.queue_time_us":2011994}
W20260709 13:16:22.319859  3119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2113) took 3468 ms (client timeout 3348 ms). Trace:
W20260709 13:16:22.320372  3119 rpcz_store.cc:269] 0709 13:16:18.851053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.772493 (+921440us) service_pool.cc:224] Handling call
0709 13:16:22.319624 (+2547131us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54004781d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:22.319780 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4463874304}
I20260709 13:16:22.267408  7374 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.321722  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:22.323992  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.313436  7497 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:22.326062  3118 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:22.331229  3119 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:22.332111  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2103) took 3489 ms. Trace:
I20260709 13:16:22.332542  3119 rpcz_store.cc:276] 0709 13:16:18.842765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.321284 (+3478519us) service_pool.cc:224] Handling call
0709 13:16:22.321652 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.331847 (+ 10195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.332053 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.326030  7570 raft_consensus.cc:3055] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:22.273150  7548 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.294354  7568 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:22.350457  7562 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:22.351011  7568 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.351248  7562 consensus_queue.cc:1243] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:22.351485  7568 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:22.351801  7562 raft_consensus.cc:3055] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:22.352212  7562 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:16:22.352934  3090 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.132:43109 timed out after 1.540s (SENT) [suppressed 20 similar messages]
I20260709 13:16:22.192724  7538 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.354475  7538 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:22.355875  3117 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
W20260709 13:16:22.355962  3090 leader_election.cc:336] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Timed out: RequestConsensusVote RPC to 127.1.227.132:43109 timed out after 1.559s (SENT)
I20260709 13:16:22.296352  7505 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:22.268345  7550 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:16:22.362051  7550 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:22.362562  7550 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:22.363775  7550 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.340078  7570 raft_consensus.cc:740] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:22.265393  7378 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.367671  7277 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:22.367890  7378 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:22.298933  7490 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:22.299018  7333 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:22.284039  7551 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:22.299981  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:22.286254  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:22.372174  3124 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:22.373081  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:22.339521  3119 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:16:22.301805  7553 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:22.341588  7557 raft_consensus.cc:3055] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:22.378610  7557 raft_consensus.cc:740] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:22.343108  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:22.343369  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.365664  7550 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:22.381225  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:22.382422  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:22.343726  7327 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:22.383433  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:22.384367  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:22.384543  7374 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:22.384735  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:22.343798  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:22.344698  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:22.344852  3794 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:22.345211  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:22.345398  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:22.346284  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:22.347470  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:22.349807  7548 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:22.358922  3761 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:22.374115  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2106) took 3530 ms. Trace:
I20260709 13:16:22.395020  3119 rpcz_store.cc:276] 0709 13:16:18.843478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.333376 (+3489898us) service_pool.cc:224] Handling call
0709 13:16:22.339256 (+  5880us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:22.373899 (+ 34643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.374074 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.353039  7562 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:22.377970  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:22.398592  3123 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 12: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:22.379559  7557 consensus_queue.cc:260] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:22.396333  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:22.385632  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:22.399798  3792 raft_consensus.cc:2410] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:16:22.399878  3196 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:16:22.400368  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 164941us
I20260709 13:16:22.386327  3192 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:22.401065  3164 connection.cc:256] RPC call timeout handler was delayed by -2.0916878110001562s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
I20260709 13:16:22.387907  3200 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:22.403834  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:22.385864  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:22.395918  3795 raft_consensus.cc:2393] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:22.397130  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:22.386734  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:22.406893  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:22.407058  3197 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
W20260709 13:16:22.410159  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 51387us
I20260709 13:16:22.411183  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:22.411296  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:22.412038  3164 connection.cc:256] RPC call timeout handler was delayed by -1.9785519190002105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
I20260709 13:16:22.394791  3793 raft_consensus.cc:2376] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11. Re-sending same reply.
I20260709 13:16:22.415931  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:22.414368  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:22.416729  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:22.417250  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.417202  3195 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:16:22.418540  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:22.419106  3197 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:22.409148  7382 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.422529  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:22.423070  3198 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:22.423197  3195 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:22.424520  7344 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:22.420629  7562 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:22.427497  7417 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:22.427858  7535 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:22.430223  7145 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:22.430528  7336 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:22.430274  7557 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:22.398353  7327 raft_consensus.cc:697] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:22.424391  7382 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.433821  7320 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:22.434499  7320 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.434995  7320 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:22.435379  7382 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:22.387907  7480 consensus_queue.cc:260] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:22.436929  7480 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:22.438647  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:22.439991  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:22.440304  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:22.434798  7498 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:22.441860  7535 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:22.415153  7316 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:22.446717  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:22.447628  3792 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:22.450690  7327 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:22.292062  3047 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:22.246048  3015 leader_election.cc:400] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12.
I20260709 13:16:22.628926  3015 leader_election.cc:403] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:16:22.299911  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 719) took 1724 ms. Trace:
W20260709 13:16:22.629997  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 391567us
I20260709 13:16:22.630177  3048 rpcz_store.cc:276] 0709 13:16:20.575903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.614185 (+ 38282us) service_pool.cc:224] Handling call
0709 13:16:21.920737 (+1306552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.921004 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.921042 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:21.921104 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:21.921151 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.921228 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.299709 (+378481us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54001ae5d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:22.299842 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3004000128}
I20260709 13:16:22.631886  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:22.632378  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:22.634147  7489 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12.
I20260709 13:16:22.635006  7489 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:22.397543  3119 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:22.499548  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2102) took 3656 ms. Trace:
I20260709 13:16:22.636943  3046 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:22.370299  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2128) took 1669 ms. Trace:
I20260709 13:16:22.637884  7555 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.638389  3117 rpcz_store.cc:276] 0709 13:16:20.700953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.046331 (+1345378us) service_pool.cc:224] Handling call
0709 13:16:22.370103 (+323772us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54001c3ed4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:22.370233 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":614539008}
I20260709 13:16:22.638736  7555 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.636987  7336 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:22.638012  3796 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:22.501817  3123 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:22.640729  7336 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.641243  7336 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:22.641335  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2114) took 3790 ms. Trace:
I20260709 13:16:22.641799  3123 rpcz_store.cc:276] 0709 13:16:18.851393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.409879 (+3558486us) service_pool.cc:224] Handling call
0709 13:16:22.501182 (+ 91303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.641065 (+139883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.641279 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.643595  3123 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:22.644183  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2116) took 3792 ms. Trace:
I20260709 13:16:22.644490  3123 rpcz_store.cc:276] 0709 13:16:18.851980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.642758 (+3790778us) service_pool.cc:224] Handling call
0709 13:16:22.643239 (+   481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.643909 (+   670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.644105 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.390146  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 668) took 4606 ms. Trace:
W20260709 13:16:22.503878  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 149951us
I20260709 13:16:22.646066  3118 rpcz_store.cc:276] 0709 13:16:17.784132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.365386 (+2581254us) service_pool.cc:224] Handling call
0709 13:16:22.325851 (+1960465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.327405 (+  1554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.389630 (+ 62225us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54004781d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:22.390066 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4460386688}
I20260709 13:16:22.648236  3118 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:22.648816  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2038) took 2822 ms. Trace:
I20260709 13:16:22.514597  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:22.651114  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2110) took 3787 ms. Trace:
W20260709 13:16:22.517256  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:22.518579  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 102303us
I20260709 13:16:22.637091  3120 rpcz_store.cc:276] 0709 13:16:18.842532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.208233 (+3365701us) service_pool.cc:224] Handling call
0709 13:16:22.208584 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.208894 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.208921 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:22.209430 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:16:22.267969 (+ 58539us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:22.268026 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.268130 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.498597 (+230467us) raft_consensus.cc:1685] finished
0709 13:16:22.498647 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.499175 (+   528us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6500,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":12570,"thread_start_us":58132,"threads_started":1,"wal-append.queue_time_us":129297}
I20260709 13:16:22.500844  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:22.654138  3164 connection.cc:256] RPC call timeout handler was delayed by -1.8570519190002415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
I20260709 13:16:22.654244  3044 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
W20260709 13:16:22.655026  3164 connection.cc:256] RPC call timeout handler was delayed by -1.7562519190000785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
I20260709 13:16:22.655357  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:22.650573  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:22.656179  3044 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:22.656877  7425 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:22.547854  7322 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.658113  7535 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:22.658245  7320 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:22.660761  7322 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:22.660882  3090 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:22.549324  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.549592  7530 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.661954  7322 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:22.662185  7530 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:22.550523  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:22.667186  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:22.555472  3122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 2042) took 2706 ms (client timeout 2194 ms). Trace:
W20260709 13:16:22.668192  3122 rpcz_store.cc:269] 0709 13:16:19.849414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.223610 (+374196us) service_pool.cc:224] Handling call
0709 13:16:22.554915 (+2331305us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400478bd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:22.555229 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3131188480}
I20260709 13:16:22.670819  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 669) took 2711 ms. Trace:
I20260709 13:16:22.671314  3122 rpcz_store.cc:276] 0709 13:16:19.959335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.669389 (+2710054us) service_pool.cc:224] Handling call
0709 13:16:22.669941 (+   552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.670389 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.670427 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.670481 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:22.670540 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.670613 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.670752 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:22.557125  3191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1953) took 2088 ms (client timeout 1768 ms). Trace:
W20260709 13:16:22.673934  3191 rpcz_store.cc:269] 0709 13:16:20.468668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.469163 (+   495us) service_pool.cc:224] Handling call
0709 13:16:22.556537 (+2087374us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540002b7d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:22.556766 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2608042880}
I20260709 13:16:22.560215  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2341) took 2017 ms. Trace:
I20260709 13:16:22.572751  3045 raft_consensus.cc:2410] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:16:22.584257  7554 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:22.675500  7336 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.676015  7494 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.676636  7494 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.586867  7570 consensus_queue.cc:260] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:22.678128  3196 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:22.679015  7570 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:22.679459  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 387880us
W20260709 13:16:22.602097  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.633224  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:22.610615  6892 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 11. Current term is 12.
W20260709 13:16:22.618917  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 49916us
W20260709 13:16:22.683189  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 50108.5us
I20260709 13:16:22.684286  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:22.685407  7467 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:22.686108  7553 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:22.686159  7467 raft_consensus.cc:697] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:22.688120  7467 consensus_queue.cc:237] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.651549  3119 rpcz_store.cc:276] 0709 13:16:18.850130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.395775 (+3545645us) service_pool.cc:224] Handling call
0709 13:16:22.397120 (+  1345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.637211 (+240091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.637639 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:22.655382  3164 connection.cc:256] RPC call timeout handler was delayed by -1.6113519190000716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 13:16:22.552063  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.623668  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:22.690908  3047 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:22.691835  3119 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:22.693311  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 672) took 2733 ms. Trace:
I20260709 13:16:22.686663  7553 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:22.675091  3199 rpcz_store.cc:276] 0709 13:16:20.542952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.791725 (+248773us) service_pool.cc:224] Handling call
0709 13:16:20.792184 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.007277 (+1215093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.007326 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.007401 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:22.007450 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.559640 (+552190us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54001dea54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:22.559723 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.559985 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2793689856}
I20260709 13:16:22.693666  3119 rpcz_store.cc:276] 0709 13:16:19.960174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.690995 (+2730821us) service_pool.cc:224] Handling call
0709 13:16:22.691488 (+   493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.693041 (+  1553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.693229 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.698060  3046 raft_consensus.cc:1240] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:22.691797  3164 connection.cc:256] RPC call timeout handler was delayed by -1.523110122999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2883s for a response
I20260709 13:16:22.693570  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:22.640599  3117 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:22.706506  3051 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:22.694121  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 667) took 4925 ms. Trace:
W20260709 13:16:22.696794  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.649161  3118 rpcz_store.cc:276] 0709 13:16:19.826530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.647402 (+2820872us) service_pool.cc:224] Handling call
0709 13:16:22.647793 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.648580 (+   787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.648759 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.711483  3043 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:22.714382  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.711966  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 670) took 2746 ms. Trace:
I20260709 13:16:22.716329  3122 rpcz_store.cc:276] 0709 13:16:19.959606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.672453 (+2712847us) service_pool.cc:224] Handling call
0709 13:16:22.672991 (+   538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.673393 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.673424 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.673490 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:22.673528 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.673595 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.673728 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:22.716936  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.710924  7553 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:22.718063  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2115) took 3866 ms. Trace:
I20260709 13:16:22.710680  3125 rpcz_store.cc:276] 0709 13:16:17.769126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.349640 (+2580514us) service_pool.cc:224] Handling call
0709 13:16:20.366159 (+ 16519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.390925 (+2024766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.390956 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.390998 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:22.391032 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.693668 (+302636us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b5400477cd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:22.693751 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.693933 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4655985920}
I20260709 13:16:22.718500  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:22.719226  3123 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:22.720062  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2034) took 3827 ms. Trace:
I20260709 13:16:22.720404  7494 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:22.720830  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:22.721187  7494 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:22.722072  7568 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:22.722800  7554 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:22.723273  3045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2552) took 2184 ms (client timeout 1664 ms). Trace:
W20260709 13:16:22.723739  3045 rpcz_store.cc:269] 0709 13:16:20.539426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.540581 (+  1155us) service_pool.cc:224] Handling call
0709 13:16:22.722989 (+2182408us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b54003c37d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:22.723159 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4667053440}
I20260709 13:16:22.723850  7548 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:22.715662  3164 connection.cc:256] RPC call timeout handler was delayed by -1.3472036440000466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
I20260709 13:16:22.720414  3123 rpcz_store.cc:276] 0709 13:16:18.892912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.645250 (+3752338us) service_pool.cc:224] Handling call
0709 13:16:22.645726 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.719692 (+ 73966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.719991 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.718519  3117 rpcz_store.cc:276] 0709 13:16:18.851683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.639801 (+3788118us) service_pool.cc:224] Handling call
0709 13:16:22.640227 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.711016 (+ 70789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.717977 (+  6961us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.725226  3042 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:22.731434  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:22.660909  7320 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:22.721630  7494 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:16:22.739606  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.737114  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:22.699369  7506 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.725459  7568 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:22.747069  3048 raft_consensus.cc:2393] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:22.736686  7509 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:16:22.751317  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.749375  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:22.696256  7551 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.744031  7494 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:22.759079  3120 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:22.759783  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2044) took 2906 ms. Trace:
I20260709 13:16:22.760166  3120 rpcz_store.cc:276] 0709 13:16:19.853490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.653537 (+2800047us) service_pool.cc:224] Handling call
0709 13:16:22.741403 (+ 87866us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.759516 (+ 18113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.759725 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.763034  3196 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:22.763691  3051 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:16:22.764139  3051 pending_rounds.cc:85] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 5
I20260709 13:16:22.764427  3051 pending_rounds.cc:107] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:16:22.764746  3051 raft_consensus.cc:2889] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:22.766093  7445 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.766767  7445 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.767725  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 678) took 2704 ms. Trace:
I20260709 13:16:22.768234  3117 rpcz_store.cc:276] 0709 13:16:20.063629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.766345 (+2702716us) service_pool.cc:224] Handling call
0709 13:16:22.766912 (+   567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.767287 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.767321 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.767424 (+   103us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:22.767469 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.767547 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.767669 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:22.774255  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 43722.2us
I20260709 13:16:22.774637  7522 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:22.775223  7522 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:22.775693  7522 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:22.778393  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.778234  7506 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.780823  3124 raft_consensus.cc:2410] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:16:22.781338  7509 raft_consensus.cc:697] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:22.782729  7509 consensus_queue.cc:237] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.783404  7075 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:22.739406  7530 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:22.790850  3047 raft_consensus.cc:2410] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 12 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:16:22.746986  7489 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.781383  7506 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:22.795603  7489 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.797878  3799 raft_consensus.cc:2368] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 8. Current term is 9.
I20260709 13:16:22.795660  7336 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:22.803316  7548 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:22.804920  7554 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.805600  7554 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.807776  7554 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:22.808254  7554 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.808776  7554 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:22.785965  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:22.816577  3050 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:16:22.817073  3050 pending_rounds.cc:85] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 5
I20260709 13:16:22.817354  3050 pending_rounds.cc:107] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:16:22.817608  3050 raft_consensus.cc:2889] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:22.826530  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:22.831693  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:22.835503  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 673) took 2875 ms. Trace:
I20260709 13:16:22.836119  3047 raft_consensus.cc:2393] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:22.841482  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:22.794981  7445 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:22.836321  3119 rpcz_store.cc:276] 0709 13:16:19.960414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.730856 (+2770442us) service_pool.cc:224] Handling call
0709 13:16:22.801357 (+ 70501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.834927 (+ 33570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.834976 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.835040 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:22.835097 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.835216 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.835415 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9765}
I20260709 13:16:22.849840  3051 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:16:22.855155  3117 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:16:22.855511  7506 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.855913  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2046) took 2377 ms. Trace:
I20260709 13:16:22.856381  3117 rpcz_store.cc:276] 0709 13:16:20.478626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.791074 (+2312448us) service_pool.cc:224] Handling call
0709 13:16:22.854750 (+ 63676us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.855646 (+   896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.855858 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.857146  3164 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:22.859268  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:22.856179  7506 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:22.863103  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:22.864012  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.857563  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:22.864938  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:22.865547  3117 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:22.868726  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:22.866109  7506 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:22.868907  7320 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.869541  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:22.871960  7445 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:22.872006  7555 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:22.873942  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:22.877403  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:22.878019  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 100365us
I20260709 13:16:22.878419  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:22.879280  3043 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:22.880316  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:22.880226  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:22.881719  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:22.882095  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:22.878418  3117 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:22.872968  7320 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:22.888283  7555 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:22.889111  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:22.866385  3045 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:22.892908  3044 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
W20260709 13:16:22.898808  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 192032us
I20260709 13:16:22.900046  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:22.889277  7519 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:22.902462  3796 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:16:22.895802  3117 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 8.
I20260709 13:16:22.904430  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:22.910843  7489 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:22.914842  7550 consensus_meta.cc:287] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.534s	user 0.015s	sys 0.003s
I20260709 13:16:22.905514  3117 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 10: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:22.888731  7505 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:22.913040  7445 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:16:22.924985  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.917501  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:22.925520  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:22.930963  3043 raft_consensus.cc:2410] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:16:22.927605  3051 raft_consensus.cc:1275] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:22.924046  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:22.898286  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:22.932655  3048 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:22.931324  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:22.931257  3091 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:22.939097  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 58985.4us
W20260709 13:16:22.940418  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 81422.6us
I20260709 13:16:22.948490  3118 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:22.954834  3792 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:22.958067  7437 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:16:22.959913  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 48324.9us
I20260709 13:16:22.960712  7344 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:22.928681  7522 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:22.972811  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.979288  3119 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 12: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:22.981856  3117 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:22.945814  7553 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:22.984119  3048 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:22.975096  7437 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:22.993834  3197 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:23.002826  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:23.003999  3119 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:22.983736  7554 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:22.987032  7551 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:23.003862  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:23.009867  3042 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:23.008059  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 106875us
I20260709 13:16:22.994572  7320 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:23.015858  3090 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:23.042423  3117 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:16:23.047796  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.053697  3048 raft_consensus.cc:2393] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 12: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:23.054793  7224 consensus_queue.cc:1059] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:23.055330  3091 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:23.056022  7224 raft_consensus.cc:3055] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:23.056408  3048 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:23.056432  7224 raft_consensus.cc:740] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:23.056833  3091 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:23.058908  7320 consensus_queue.cc:1059] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:23.059136  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:23.044752  3118 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:23.060379  7558 raft_consensus.cc:3055] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:23.060810  7558 raft_consensus.cc:740] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:23.061858  7558 consensus_queue.cc:260] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:23.063026  7558 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:23.063681  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:23.064644  3124 raft_consensus.cc:2410] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:16:23.064733  7551 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:23.065526  7551 raft_consensus.cc:697] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:23.065940  7212 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.066485  7212 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:23.066668  7224 consensus_queue.cc:260] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:23.066821  7551 consensus_queue.cc:237] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:23.068419  7224 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:23.071198  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:23.071830  7562 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:23.073015  3122 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:16:23.077936  7417 consensus_meta.cc:287] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.547s	user 0.018s	sys 0.004s
I20260709 13:16:23.078964  7494 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:23.080394  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:23.082326  3117 raft_consensus.cc:1275] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:23.083201  3047 raft_consensus.cc:1240] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:23.092607  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:23.096016  3124 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:23.092762  7075 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:23.099512  7075 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:23.108013  3761 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:23.099969  7075 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:23.097064  7554 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:23.111690  3044 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:23.113246  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 142009us
I20260709 13:16:23.114156  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2206) took 1193 ms. Trace:
I20260709 13:16:23.117074  7557 consensus_queue.cc:1059] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:23.118415  7557 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:23.121294  7515 consensus_queue.cc:1059] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:23.121886  7320 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:23.122916  7515 raft_consensus.cc:3055] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:23.123445  7515 raft_consensus.cc:740] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:23.126164  7243 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:23.126094  7568 raft_consensus.cc:3055] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:23.127164  7568 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:23.127869  3194 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:23.128777  7379 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.128291  7568 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:23.129626  7344 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:23.129297  7379 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:23.106971  7445 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:23.130311  7568 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:23.124780  7515 consensus_queue.cc:260] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:23.116117  7570 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:23.138572  7515 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:23.139477  7538 consensus_meta.cc:287] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.784s	user 0.006s	sys 0.011s
I20260709 13:16:23.140466  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:23.141130  7553 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:23.141917  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:23.110343  7437 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:23.142719  3196 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:23.143280  7437 raft_consensus.cc:697] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:23.142045  7522 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:23.149154  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 68909.2us
I20260709 13:16:23.101054  7212 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:23.162904  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:23.168920  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 70634.2us
I20260709 13:16:23.114023  7554 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.114684  3049 rpcz_store.cc:276] 0709 13:16:21.790852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.325540 (+534688us) service_pool.cc:224] Handling call
0709 13:16:22.325920 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.326126 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:22.609584 (+283458us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.936934 (+327350us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.939895 (+  2961us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:22.968200 (+ 28305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.973617 (+  5417us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.984180 (+ 10563us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":383792,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":94,"raft.queue_time_us":6086,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":15633,"thread_start_us":313732,"threads_started":2,"wal-append.queue_time_us":323679}
I20260709 13:16:23.144821  7437 consensus_queue.cc:237] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:23.181457  3196 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:16:23.184629  3126 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:23.194185  7417 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.195127  7417 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:23.198199  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.204408  3119 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:16:23.207146  3090 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:23.177476  7554 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:23.216969  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 145885us
I20260709 13:16:23.211858  7417 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:23.229357  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:23.203620  7212 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:16:23.221000  7538 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:23.250833  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.215263  7344 consensus_queue.cc:1059] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:16:23.256616  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:23.264595  3121 raft_consensus.cc:2410] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:16:23.266346  7344 raft_consensus.cc:3055] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:23.266949  7344 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:23.268388  7344 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:23.273391  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:23.276067  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 101829us
I20260709 13:16:23.278446  7548 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:23.248517  7538 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:23.283536  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 54289.8us
I20260709 13:16:23.227566  7243 consensus_queue.cc:1059] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:16:23.287061  7538 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:23.302497  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 55800.4us
I20260709 13:16:23.290174  7522 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:23.295248  7494 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:23.310477  3198 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:16:23.315312  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.315420  3164 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:23.323385  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:23.323815  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2207) took 1532 ms. Trace:
I20260709 13:16:23.324297  3795 raft_consensus.cc:2410] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:16:23.324189  3050 rpcz_store.cc:276] 0709 13:16:21.791109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.328375 (+537266us) service_pool.cc:224] Handling call
0709 13:16:22.328607 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.821985 (+493378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.315941 (+493956us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b540004a1d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:23.323755 (+  7814us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1111896320}
I20260709 13:16:23.326524  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:23.319466  7480 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:23.328127  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.298189  7320 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:23.304634  7522 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:23.335132  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:23.348234  3792 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:23.349387  3796 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
W20260709 13:16:23.351948  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.353699  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:23.347977  7522 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:23.364639  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:23.370576  3799 raft_consensus.cc:2368] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 11. Current term is 12.
I20260709 13:16:23.363487  7417 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:23.373365  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:23.364187  7480 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.378490  7417 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:23.390666  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 49563.1us
W20260709 13:16:23.377490  7490 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.030s	sys 0.068s
I20260709 13:16:23.389326  7417 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:23.402343  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:23.403474  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:23.396883  7490 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.031s	sys 0.068s
I20260709 13:16:23.416353  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:23.387900  7480 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:23.434381  3125 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:23.441545  3090 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:23.446880  3048 raft_consensus.cc:3055] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:23.452907  3048 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:23.455695  3797 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:23.457425  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 134634us
I20260709 13:16:23.448105  7505 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:23.470760  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:23.463812  7212 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:23.479508  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 75267.4us
I20260709 13:16:23.471786  3048 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:23.491381  3048 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:23.478063  7505 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.481370  7515 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:23.506767  3791 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
W20260709 13:16:23.510402  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.511770  3761 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:23.513159  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.507429  7505 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:23.509004  7599 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:23.515396  7480 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:23.480513  7243 consensus_queue.cc:1059] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
W20260709 13:16:23.519606  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.525413  3164 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:23.528885  3123 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:16:23.529366  3123 pending_rounds.cc:85] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 8
I20260709 13:16:23.529682  3123 pending_rounds.cc:107] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:16:23.529984  3123 raft_consensus.cc:2889] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:23.530607  7243 raft_consensus.cc:3055] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:23.531080  7243 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:23.531685  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2124) took 2831 ms. Trace:
W20260709 13:16:23.529399  3121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2117) took 2831 ms (client timeout 2709 ms). Trace:
W20260709 13:16:23.532788  3121 rpcz_store.cc:269] 0709 13:16:20.697677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.052239 (+1354562us) service_pool.cc:224] Handling call
0709 13:16:23.523894 (+1471655us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540045a1d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:23.529260 (+  5366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2404438400}
I20260709 13:16:23.533241  3118 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:16:23.532177  7243 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:23.535842  7243 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:23.537405  7592 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:16:23.539389  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:23.540125  7379 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:23.539434  7075 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:23.544450  7327 consensus_queue.cc:1059] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:16:23.544651  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 131003us
I20260709 13:16:23.530125  3199 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:23.546190  3194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2340) took 3583 ms (client timeout 1600 ms). Trace:
I20260709 13:16:23.551740  7599 raft_consensus.cc:697] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:23.552194  7515 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:16:23.552557  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:23.570477  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.570950  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:23.571194  7327 raft_consensus.cc:3055] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:23.571624  7327 raft_consensus.cc:740] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:23.530961  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:55310 (request call id 12) took 3844 ms. Trace:
I20260709 13:16:23.572439  3090 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:23.551267  2947 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49738 (request call id 148) took 26632 ms (client timeout 15000 ms). Trace:
I20260709 13:16:23.573246  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 675) took 3549 ms. Trace:
I20260709 13:16:23.572546  3117 rpcz_store.cc:276] 0709 13:16:19.686823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.107163 (+3420340us) service_pool.cc:224] Handling call
0709 13:16:23.530662 (+423499us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b540045a1d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b9735 00007ff835379d29 00007ff82e8f81d4 00007ff82e8f8162 00007ff82e8f8091 00007ff82e8f800c 00007ff82e8f72c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:23.530844 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355728128}
I20260709 13:16:23.532157  3123 rpcz_store.cc:276] 0709 13:16:20.699836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.930262 (+2230426us) service_pool.cc:224] Handling call
0709 13:16:23.528503 (+598241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.530545 (+  2042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.531430 (+   885us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b540045a1d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:23.531589 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1275793792}
W20260709 13:16:23.558766  3194 rpcz_store.cc:269] 0709 13:16:19.962929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.964793 (+  1864us) service_pool.cc:224] Handling call
0709 13:16:23.545937 (+3581144us) spinlock_profiling.cc:243] Waited 3.07 s on lock 0x7b54003bb354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:23.546077 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7052071808}
I20260709 13:16:23.559243  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:23.564589  7379 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:16:23.565907  3126 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2100) took 4715 ms (client timeout 1996 ms). Trace:
I20260709 13:16:23.567672  3196 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:23.575951  3048 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:16:23.576606  3126 rpcz_store.cc:269] 0709 13:16:18.842008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.942300 (+100292us) service_pool.cc:224] Handling call
0709 13:16:23.523783 (+4581483us) spinlock_profiling.cc:243] Waited 4.13 s on lock 0x7b54000a8a54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:23.557432 (+ 33649us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9499593088}
I20260709 13:16:23.576704  7212 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:23.579979  3044 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:23.580268  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:23.567822  7548 raft_consensus.cc:3055] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:23.581435  7515 raft_consensus.cc:697] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:23.581772  7548 raft_consensus.cc:740] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:23.582022  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:23.582805  3045 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:23.582769  7548 consensus_queue.cc:260] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:23.583425  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 83995.4us
I20260709 13:16:23.584201  7548 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:23.584282  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:23.586819  7599 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:23.589231  7379 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:23.591728  3192 raft_consensus.cc:2393] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 13: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:23.589875  7379 raft_consensus.cc:697] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:23.573920  3120 rpcz_store.cc:276] 0709 13:16:20.023540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.760990 (+2737450us) service_pool.cc:224] Handling call
0709 13:16:22.761450 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.790809 (+ 29359us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:16:23.221484 (+430675us) log.cc:844] Serialized 14 byte log entry
0709 13:16:23.572920 (+351436us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:23.572969 (+    49us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:23.573016 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.573076 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.573194 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7947,"prepare.queue_time_us":544966,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":3664,"raft.queue_time_us":53120,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":2048,"thread_start_us":616533,"threads_started":3,"wal-append.queue_time_us":244912}
I20260709 13:16:23.597416  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:23.595230  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:23.599327  3126 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:23.579133  7554 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:23.600591  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:23.601440  3118 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:23.602281  7554 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:23.603052  7075 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:23.582933  7515 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:23.573098  2947 rpcz_store.cc:269] 0709 13:15:56.918388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.919964 (+  1576us) service_pool.cc:224] Handling call
0709 13:16:23.550924 (+26630960us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:12.834835 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:12.982924 (+148089us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:13.002060 (+ 19136us) write_op.cc:435] Acquired schema lock
0709 13:16:13.019834 (+ 17774us) tablet.cc:662] Decoding operations
0709 13:16:13.249098 (+229264us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:13.273965 (+ 24867us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:13.276483 (+  2518us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:16:13.295425 (+ 18942us) tablet.cc:701] Row locks acquired
0709 13:16:13.295487 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:16:13.295719 (+   232us) write_op.cc:270] Start()
0709 13:16:13.295992 (+   273us) write_op.cc:276] Timestamp: P: 1783602973295626 usec, L: 0
0709 13:16:13.296033 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:16:13.344946 (+ 48913us) log.cc:844] Serialized 6791 byte log entry
0709 13:16:13.804532 (+459586us) op_driver.cc:464] REPLICATION: finished
0709 13:16:13.941609 (+137077us) write_op.cc:301] APPLY: starting
0709 13:16:13.949666 (+  8057us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:15.045398 (+1095732us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:15.045552 (+   154us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:15.992871 (+947319us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b5c00226d0c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff8365a5331 00007ff8365a5221 00007ff83659ff6c 00007ff833d0030b 00007ff833cfffd3 00007ff833dfee34 00007ff833dea97c 00007ff833deed61 00007ff833deed19 00007ff833deeca9 00007ff833deec71
0709 13:16:16.241455 (+248584us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:16.241961 (+   506us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 13:16:16.242022 (+    61us) write_op.cc:312] APPLY: finished
0709 13:16:16.242493 (+   471us) log.cc:844] Serialized 156 byte log entry
0709 13:16:16.466570 (+224077us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:16.501411 (+ 34841us) write_op.cc:454] Released schema lock
0709 13:16:16.517979 (+ 16568us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:16.550062 (+ 32083us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:16.550094 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":242,"mutex_wait_us":1364994,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":136774,"apply.run_cpu_time_us":139384,"apply.run_wall_time_us":2599363,"cfile_cache_hit":66,"cfile_cache_hit_bytes":69003,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6218,"cfile_init":1,"lbm_read_time_us":48653,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":6,"num_ops":17,"prepare.queue_time_us":285793,"prepare.run_cpu_time_us":24308,"prepare.run_wall_time_us":735275,"raft.queue_time_us":148969,"raft.run_cpu_time_us":17821,"raft.run_wall_time_us":90426,"replication_time_us":508322,"spinlock_wait_cycles":10323712,"thread_start_us":607795,"threads_started":5,"wal-append.queue_time_us":514016,"wal-append.run_cpu_time_us":25211,"wal-append.run_wall_time_us":2363761}]]}
I20260709 13:16:23.602295  7505 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:23.528154  7538 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:23.609440  3045 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:16:23.603524  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:23.623848  3121 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:23.626401  3117 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:16:23.581362  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet f12375b5613c4d08b52a1a44ccb82294: Illegal state: Replica f20672b2852447a6bc1e137c4dd40904 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:23.631309  7610 consensus_queue.cc:1059] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:23.616715  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:23.634222  3196 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:23.633378  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:23.623116  3045 pending_rounds.cc:85] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 4
I20260709 13:16:23.636521  3045 pending_rounds.cc:107] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:16:23.636941  3045 raft_consensus.cc:2889] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:23.641152  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:23.641834  3015 connection.cc:256] RPC call timeout handler was delayed by -2.4946107230000507s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
I20260709 13:16:23.642026  3791 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:16:23.642283  3015 connection.cc:256] RPC call timeout handler was delayed by -2.1766422069999862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
W20260709 13:16:23.642668  3015 connection.cc:256] RPC call timeout handler was delayed by -2.0050832899999023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 13:16:23.643265  3015 connection.cc:256] RPC call timeout handler was delayed by -1.8880832899997131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
W20260709 13:16:23.644011  3015 connection.cc:256] RPC call timeout handler was delayed by -1.8268832899998415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
W20260709 13:16:23.644418  3015 connection.cc:256] RPC call timeout handler was delayed by -1.766583289999744s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
W20260709 13:16:23.644801  3015 connection.cc:256] RPC call timeout handler was delayed by -1.6108832899997196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
W20260709 13:16:23.645175  3015 connection.cc:256] RPC call timeout handler was delayed by -1.5190832899997986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
W20260709 13:16:23.651244  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 65360.9us
W20260709 13:16:23.652644  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 49533.4us
I20260709 13:16:23.652704  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:23.597944  7320 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:16:23.658514  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:23.657913  2949 catalog_manager.cc:5697] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 7 to 9, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 9 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:23.659994  7505 raft_consensus.cc:3055] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:23.660420  7505 raft_consensus.cc:740] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:23.661217  3797 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:23.625625  7494 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.663281  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:23.669051  3015 connection.cc:256] RPC call timeout handler was delayed by -1.4026550329997463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
I20260709 13:16:23.672538  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:23.673420  3090 leader_election.cc:400] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 11. Current term is 12.
I20260709 13:16:23.677954  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:23.679077  3799 raft_consensus.cc:2410] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:16:23.679826  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:23.687639  3796 raft_consensus.cc:2393] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:23.660804  2949 catalog_manager.cc:5697] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:23.689320  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:23.693056  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:16:23.693830  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 56707.4us
I20260709 13:16:23.695451  3090 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:23.698329  7379 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:23.699855  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:23.701000  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:23.702374  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:23.703713  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:23.703424  7494 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:23.704391  3117 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:23.705451  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:23.706075  3122 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:23.706220  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:23.618096  7437 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:16:23.707424  7437 consensus_queue.cc:1243] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer e9165fe61ab04bfb9a48889156d5c161 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:23.710120  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:23.711689  3118 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:23.712867  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:23.713276  7212 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:23.713537  3120 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:23.686192  7604 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.714574  7604 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:23.716005  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:23.716894  7604 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:23.717286  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:23.718052  3118 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:23.718075  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:23.719940  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:23.720709  3117 raft_consensus.cc:2393] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:23.721637  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:23.698602  7327 consensus_queue.cc:260] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:23.689563  2949 catalog_manager.cc:5697] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 7 to 8, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 8 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:23.726188  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 135686us
I20260709 13:16:23.736577  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:23.746685  3125 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:23.748970  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:23.750505  3044 raft_consensus.cc:1275] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:16:23.750970  3044 pending_rounds.cc:85] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 5
I20260709 13:16:23.751223  3044 pending_rounds.cc:107] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:16:23.751493  3044 raft_consensus.cc:2889] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:23.754467  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 59147.1us
I20260709 13:16:23.753638  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:23.763460  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:23.752969  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:23.763825  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:23.752295  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:23.765110  3196 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:23.765436  3193 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:23.766848  3090 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:23.705324  7522 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:23.770017  3792 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:23.765161  3194 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:23.769295  3045 raft_consensus.cc:2410] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:23.769255  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:23.779273  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:23.774379  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:23.776183  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:23.791383  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:23.782215  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.795374  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:23.796775  3046 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:23.796924  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 54441.5us
W20260709 13:16:23.798400  7612 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:16:23.661389  7505 consensus_queue.cc:260] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:23.799343  7505 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:23.799877  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 47956us
I20260709 13:16:23.799973  7609 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:23.800879  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:23.799036  7601 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:23.798527  3165 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:23.807965  3197 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:16:23.809983  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:23.802035  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:23.721571  7417 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:23.778498  2949 catalog_manager.cc:5697] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 2 to 8, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 8 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:23.777989  3192 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:23.824806  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:23.770118  7437 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.794203  3191 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:23.831665  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:23.827770  3049 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:23.806639  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:23.769649  7548 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:23.834407  3125 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:23.778798  7075 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:23.836923  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 108522us
W20260709 13:16:23.837687  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 77149us
I20260709 13:16:23.848708  3199 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:23.850471  3122 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:23.851475  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:23.855247  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:23.824987  7494 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:23.865104  3197 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:23.839838  7599 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:23.846171  7609 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:23.896013  3048 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:23.900125  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:23.911705  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 110930us
W20260709 13:16:23.892716  7591 log.cc:927] Time spent T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:16:23.924599  3118 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:23.926647  3796 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
W20260709 13:16:23.927496  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 160745us
W20260709 13:16:23.934120  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:23.947669  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.922391  3125 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:23.948474  2949 catalog_manager.cc:5697] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 7 to 8, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 8 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:23.918919  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.918989  3043 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:23.859967  7548 raft_consensus.cc:697] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:23.840061  7611 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:16:23.949146  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:23.850373  7075 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:23.951687  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 153255us
I20260709 13:16:23.929623  3091 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:23.979321  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 49783.7us
I20260709 13:16:23.980592  3091 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:23.981634  7212 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:23.982267  7212 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:23.982404  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.982702  7212 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:23.983270  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.871903  7437 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:23.901602  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:23.898090  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:23.956892  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.986078  7437 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:23.925864  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:23.987581  3792 pending_rounds.cc:85] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Aborting all ops after (but not including) 8
I20260709 13:16:23.947877  7557 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.988238  3120 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:23.979416  7604 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:23.988969  7604 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.929967  7603 consensus_queue.cc:1048] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:16:23.987983  3792 pending_rounds.cc:107] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:16:23.988436  7557 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:23.974857  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:23.860313  7515 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:16:23.927315  7601 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:23.922901  7417 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:23.988603  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:23.930641  7614 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:16:23.931644  7613 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:16:24.021957  3045 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:24.022925  3199 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:16:24.024505  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 68753us
I20260709 13:16:23.997792  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:24.000104  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 148732us
I20260709 13:16:23.916602  7494 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.895484  7551 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:23.997097  3792 raft_consensus.cc:2889] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:24.008934  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:24.034054  3048 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:24.011602  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.989411  7604 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:23.926775  7522 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:23.927965  7467 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.018769  3191 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:24.029820  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:23.929296  7554 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:16:24.044618  3197 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:24.012462  7601 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:24.022768  7538 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:24.057091  3796 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
W20260709 13:16:24.051539  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.060904  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.068277  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.056133  7601 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:24.074009  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:24.061647  7522 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.038514  7494 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.061479  7611 consensus_queue.cc:1059] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:16:24.071667  7548 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:24.087563  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.091267  3165 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:24.103024  3191 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:24.087087  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:24.104255  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 47404.8us
I20260709 13:16:24.058404  7467 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.080245  7417 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:24.089267  7615 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:16:24.108321  3046 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:24.108500  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:24.111219  3050 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:24.113523  3091 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:24.114578  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.086340  7075 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:24.118651  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:24.085490  7551 raft_consensus.cc:697] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:24.082345  2949 catalog_manager.cc:5697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: config changed from index 2 to 5, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129), VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130), VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131), VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 8 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:24.104185  7379 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:24.092985  7538 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:16:24.123739  7417 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.108121  7627 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.135689  7620 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:24.153672  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:24.146317  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 84798.3us
I20260709 13:16:24.117168  7554 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.125301  7621 raft_consensus.cc:3055] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:24.169489  7551 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:24.171033  2934 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0ee6c4dbcb7b45729d4e2bdcc3a09297 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:24.170893  7627 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.172299  2949 catalog_manager.cc:5697] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 4 to 6, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 6 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:24.129002  7603 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:24.182145  3043 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:24.109329  7522 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.196774  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:24.198014  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 64223.7us
W20260709 13:16:24.199453  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.158926  7620 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:24.208593  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 65460.2us
I20260709 13:16:24.158789  7621 raft_consensus.cc:740] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:24.216300  2949 catalog_manager.cc:5697] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 4 to 6, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 6 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:24.223135  7243 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.223927  7243 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.226625  7243 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:24.210310  7603 raft_consensus.cc:697] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:24.227308  7636 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:24.227907  7636 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:24.228386  7636 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:24.228487  7603 consensus_queue.cc:237] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.230973  7417 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:24.236796  3120 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:24.186574  7554 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.184525  7467 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:24.211349  7620 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:24.210013  7557 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:24.207238  3043 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
W20260709 13:16:24.204945  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 86379.1us
I20260709 13:16:24.226671  7494 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:24.257620  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 57692.9us
I20260709 13:16:24.196065  7212 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.251194  7628 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:24.251339  3165 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:24.193558  7379 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:16:24.264983  7538 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:16:24.265997  7624 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 13:16:24.282492  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.278246  3164 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:24.278873  2949 catalog_manager.cc:5697] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 3 to 6, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 6 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:24.268199  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:24.282030  3090 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:24.289551  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 50172.2us
I20260709 13:16:24.288821  7243 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:24.294806  7627 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:24.290076  7629 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.300460  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:24.302866  2949 catalog_manager.cc:5697] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 7 to 10, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 10 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:24.306978  7611 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:24.306862  7604 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.267110  7621 consensus_queue.cc:260] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.305091  2949 catalog_manager.cc:5697] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 2 to 4, now has a pending config: VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129), VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130), VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131), VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 4 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:24.296048  7628 raft_consensus.cc:697] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:24.314965  7479 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.314226  7610 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:24.287185  7538 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:24.330360  7538 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:24.335569  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.313630  7467 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:24.325464  7417 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:24.325385  7479 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:24.326941  7554 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:24.324159  7610 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:24.356652  7610 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:24.360093  7625 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:16:24.362056  7628 consensus_queue.cc:237] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:24.362988  7623 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.296s	user 0.002s	sys 0.000s
I20260709 13:16:24.365962  7558 consensus_queue.cc:1059] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:24.367813  7558 raft_consensus.cc:3055] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:24.368264  7558 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:24.368650  7621 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:24.340094  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 71210.3us
I20260709 13:16:24.369875  7064 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:16:24.346604  7327 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:24.350358  7212 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:24.351755  3046 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:24.352380  2949 catalog_manager.cc:5697] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:24.353830  7522 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:24.367703  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:24.388659  3126 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:16:24.314600  7640 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.396842  7640 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.397879  7601 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.399180  7640 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:24.338908  7467 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:24.400007  7467 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:24.372583  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:24.377310  3091 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:24.380869  3048 raft_consensus.cc:3055] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:24.403460  3048 raft_consensus.cc:740] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:24.382426  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:24.404366  3050 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:16:24.404920  3091 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:24.372140  7505 consensus_queue.cc:1059] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:16:24.389568  7379 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:24.340482  7417 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:24.316002  7629 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.390431  3164 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:24.391062  7479 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:24.391486  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:24.394830  3792 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:24.396236  7604 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:24.395730  2949 catalog_manager.cc:5697] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 3 to 7, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 7 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:24.377678  3762 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:16:24.425210  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 100542us
W20260709 13:16:24.425490  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 47882.7us
W20260709 13:16:24.422617  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.369204  7558 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:24.444919  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:24.447465  7505 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:24.449582  7505 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:24.419620  7640 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:24.450588  3048 consensus_queue.cc:260] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:24.454800  3090 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:24.399986  7601 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:24.419813  7627 raft_consensus.cc:2764] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:16:24.422015  7554 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:24.448076  7480 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.422402  7417 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:24.455521  7635 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:24.455677  7479 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:24.468811  2949 catalog_manager.cc:5697] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 2 to 5, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 5 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:24.472839  3090 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:24.475039  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.475245  3048 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:24.459451  7640 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.459441  7505 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:24.477581  2949 catalog_manager.cc:5697] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 4 to 7, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 7 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:24.501008  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.472165  7479 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.486562  7554 raft_consensus.cc:697] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:24.538779  7368 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:24.539274  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 52101.8us
I20260709 13:16:24.486416  7640 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:24.529538  7599 consensus_meta.cc:287] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.003s
W20260709 13:16:24.507483  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.562461  7479 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:24.491775  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 119724us
I20260709 13:16:24.486367  7635 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.512322  7467 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:24.513411  7609 raft_consensus.cc:3055] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:24.476824  7480 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:24.522959  7644 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:16:24.538990  7437 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.605775  7437 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.554735  3048 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:16:24.513417  7627 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:24.487139  7548 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:24.524927  7620 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:24.527865  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.610110  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 219775us
I20260709 13:16:24.559725  3050 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:24.538682  7212 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:24.550757  3120 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:24.521883  3799 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:24.489686  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:24.586856  7599 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:24.561987  7554 consensus_queue.cc:237] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.533483  7629 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:24.590937  3165 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:24.592419  7635 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:24.592283  7653 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:24.561648  7368 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:24.556844  7417 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.530246  7344 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:24.534839  7617 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.604375  7480 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:24.607261  3048 pending_rounds.cc:85] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 8
I20260709 13:16:24.605187  7640 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.595520  7609 raft_consensus.cc:740] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:16:24.614200  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.614423  7627 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:24.695012  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 128584us
W20260709 13:16:24.695418  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.695875  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:24.511018  7610 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.525554  7636 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:24.618023  7212 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.674108  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:24.703577  3051 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:24.675484  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:24.682542  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:24.704232  3047 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:24.704445  3049 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:24.682542  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:24.705613  3191 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:24.682577  3048 pending_rounds.cc:107] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:16:24.706349  3048 raft_consensus.cc:2889] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:24.706559  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:24.691864  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.694398  3197 raft_consensus.cc:1275] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:24.707455  3194 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
W20260709 13:16:24.707896  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.702701  3195 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 9: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:16:24.708541  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 218954us
I20260709 13:16:24.711112  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:24.697875  7629 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:24.717841  3199 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:24.715891  3193 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:24.691861  7611 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:24.717023  3050 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:24.710063  7212 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:24.728525  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:24.723457  3198 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:24.729238  3196 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:24.695443  7617 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:24.730839  3191 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:24.732263  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:24.721143  7611 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.746430  7619 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.747187  7368 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:24.747044  7619 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:24.748744  7522 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:24.749265  7619 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:24.750046  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:24.750811  7437 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:24.734614  7648 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.171s
I20260709 13:16:24.753062  7538 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:24.753541  7627 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:24.755386  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.758179  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:24.736639  7640 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:24.751037  7609 consensus_queue.cc:260] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.760020  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:24.758920  3199 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:24.731065  7629 raft_consensus.cc:697] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:16:24.763549  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.721359  7479 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:24.768468  3196 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:16:24.742075  7379 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:24.759438  7558 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:24.745870  7611 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:24.771363  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:24.772778  7417 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:24.775708  3199 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:24.760579  7075 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:24.781692  7075 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.784098  7075 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:24.776523  7467 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:24.776919  3797 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:24.790444  7479 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:24.790885  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.779933  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:24.773123  7610 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:24.798054  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 56143.9us
I20260709 13:16:24.794824  3797 raft_consensus.cc:606] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:24.773797  7609 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:24.803381  7629 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.806347  7636 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:24.810576  3762 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:16:24.799824  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 223415us
I20260709 13:16:24.815999  3196 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:24.817410  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:24.818971  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.825093  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:24.826416  3051 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:24.822666  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:24.826033  3120 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:24.768096  7619 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:16:24.798846  7653 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:24.830070  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:24.836201  3118 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:24.785425  7505 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.832677  3091 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:24.835261  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:24.837113  3125 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:24.841717  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:24.821167  7621 raft_consensus.cc:3055] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:24.802335  7635 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:16:24.827847  7568 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:24.825693  7620 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:24.792788  7379 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:24.850647  3196 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:24.847855  7618 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:24.852829  7639 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.848310  7568 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.853724  7568 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:24.834857  7515 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:16:24.853590  7639 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:24.854696  7654 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.268s	user 0.003s	sys 0.000s
I20260709 13:16:24.855818  7639 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:24.857273  7379 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:24.857528  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:24.843895  3091 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:24.846259  7656 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 13:16:24.829362  7660 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:16:24.852892  7618 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.848783  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:24.859899  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:24.861472  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:24.847222  7075 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:24.844806  7621 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:24.882517  3797 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:24.882920  3198 raft_consensus.cc:2410] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:24.883172  3797 raft_consensus.cc:606] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:24.883595  3797 raft_consensus.cc:614] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:24.884841  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:24.885692  3196 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:24.887429  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:24.888144  3048 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:24.883801  3091 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:24.889330  7635 raft_consensus.cc:2764] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:16:24.895900  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:24.896471  3046 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:24.864991  7379 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:24.849370  7636 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:16:24.904474  3117 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:24.882539  7618 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:24.841392  7653 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:24.909704  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:24.917443  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:24.892342  7599 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:24.894963  7075 raft_consensus.cc:697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:24.918139  3198 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:24.920989  3796 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:24.904270  7243 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.939967  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:24.919123  3090 leader_election.cc:336] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 1.600s (SENT)
I20260709 13:16:24.943617  3090 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:24.941388  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:24.894357  7647 consensus_queue.cc:1059] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:16:24.966681  7617 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:24.972363  7610 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:24.973295  3762 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:24.973059  7379 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:24.974423  7505 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:24.920285  7554 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:24.995939  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:24.961199  7075 consensus_queue.cc:237] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:24.937274  7629 raft_consensus.cc:2764] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:16:24.961074  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:24.998445  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:24.977723  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 94016.4us
I20260709 13:16:24.909606  7646 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.965962  7467 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:25.015622  7467 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:24.921669  7599 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.984961  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:24.989914  3118 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:16:24.988502  3791 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:24.993831  3046 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:16:25.000290  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:25.002995  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:25.006007  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.186446  3050 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
W20260709 13:16:25.186717  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.948702  7243 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:25.189819  7505 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:25.190557  3196 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:25.191578  7243 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:25.185524  7643 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.192441  7505 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:25.192597  7643 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:25.193465  7327 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:25.194068  7327 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:25.013608  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:24.998111  7617 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:25.014490  7646 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:25.195745  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:25.195892  7617 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:25.196352  7617 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:25.196501  3796 raft_consensus.cc:2393] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 9: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:25.167701  7224 raft_consensus.cc:3055] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:25.197512  7224 raft_consensus.cc:740] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:25.198345  7643 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:25.198436  7224 consensus_queue.cc:260] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:25.199635  7224 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:25.195884  3049 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:25.168416  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:25.181963  7554 raft_consensus.cc:697] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:25.204056  7327 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:25.206678  7646 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:25.207581  7554 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:25.045302  7599 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:25.169584  7551 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:25.169507  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:25.215207  3049 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:25.215847  3192 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:25.169405  7212 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:25.170081  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:25.156898  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.170830  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:25.171154  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:25.217514  3197 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 9: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:25.172102  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:25.173362  7611 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:25.226763  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:25.227727  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.173620  3198 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:25.042259  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:24.949786  7621 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:25.175933  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 256817us
I20260709 13:16:25.176201  7647 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.162333  7653 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:25.179818  3045 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:16:24.995143  7548 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:25.182978  3044 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:25.185901  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 201027us
I20260709 13:16:25.188656  7619 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:25.189127  7379 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.255931  3042 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:25.256088  3051 raft_consensus.cc:1275] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:25.217993  3193 raft_consensus.cc:2376] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12. Re-sending same reply.
I20260709 13:16:25.016057  7467 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:25.259152  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:25.043296  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 54756.7us
I20260709 13:16:25.229045  3048 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:25.253279  3091 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:25.259838  3125 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
W20260709 13:16:25.235327  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.235180  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:25.237780  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.216616  7617 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:25.240657  3762 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:25.240809  7621 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:25.241456  7212 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:25.187678  7568 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:25.270773  3194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:16:25.271493  3194 raft_consensus.cc:606] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:25.271528  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:25.245002  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:25.213292  7618 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:25.254400  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:25.254969  3791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 587) took 1565 ms. Trace:
I20260709 13:16:25.257229  3042 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:16:25.226866  7437 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.261962  3200 raft_consensus.cc:2393] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:25.265654  3050 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:25.266466  3091 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:25.261582  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:25.243733  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:25.234067  7551 raft_consensus.cc:697] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:16:25.310217  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 43847.1us
W20260709 13:16:25.310451  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 56129.2us
I20260709 13:16:25.265218  7480 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:16:25.311470  3791 rpcz_store.cc:276] 0709 13:16:23.686658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.686816 (+   158us) service_pool.cc:224] Handling call
0709 13:16:25.252070 (+1565254us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540009fe54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:25.252186 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2868715904}
W20260709 13:16:25.314119  2934 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0ee6c4dbcb7b45729d4e2bdcc3a09297 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:25.253880  7619 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.314805  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:25.314949  3091 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:25.315449  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:25.319015  3042 raft_consensus.cc:2410] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:16:25.319298  3091 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:25.320710  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:25.321036  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:25.267900  7604 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:25.324275  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:25.326730  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:25.273118  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:25.327636  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.327912  3043 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:25.258524  7243 consensus_queue.cc:1048] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:16:25.328847  3090 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:25.330531  3091 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:25.334510  3126 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:16:25.262315  7663 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.339277  3117 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:25.314368  7648 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:25.314383  7558 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:25.322678  7619 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:25.342113  3193 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:25.344892  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.254038  7647 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:25.328717  7604 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.324470  7538 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:25.261173  7379 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:25.345243  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:25.352133  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:25.325999  7641 log.cc:927] Time spent T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:16:25.351346  7229 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:25.340932  7603 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:25.338286  7548 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:25.354066  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:25.354838  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:25.323207  7075 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:16:25.351804  7538 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:25.357987  3050 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:25.352384  7604 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:25.343384  7558 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.314181  7675 consensus_queue.cc:1059] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:16:25.358961  7676 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:25.365537  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:25.361513  3051 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:25.328814  7212 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:16:25.371965  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:25.328927  7437 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:25.370922  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:25.362453  7538 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:25.369889  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:25.372623  3193 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
W20260709 13:16:25.377111  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 116982us
I20260709 13:16:25.378295  3120 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:25.354254  7648 raft_consensus.cc:697] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:25.341878  7663 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:25.380686  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:25.382159  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:25.359966  7548 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.386101  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:25.388530  7379 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:25.392956  7599 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:25.373064  7558 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:25.364367  7229 raft_consensus.cc:697] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:25.394338  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:25.394527  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:25.364459  7515 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.394797  7568 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:25.395339  7611 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:25.395224  7551 consensus_queue.cc:237] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:25.396683  7618 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:25.384794  7636 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:25.397526  7664 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:25.407894  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:25.409960  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:25.410910  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:25.429780  3197 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:25.373183  7676 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.410820  7548 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:25.418645  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:25.419998  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:25.420091  3044 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:25.420850  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:25.435752  3121 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:25.436050  3122 raft_consensus.cc:2368] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16.
I20260709 13:16:25.421015  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:25.421634  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:25.437178  3192 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:25.437297  3196 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:25.422109  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:25.422746  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:25.438181  3191 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:25.438268  3126 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:25.424333  3799 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:25.425108  3123 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:25.425653  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:25.426136  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:25.439952  3199 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:25.440245  3791 raft_consensus.cc:2410] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:16:25.414700  3194 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:25.417363  3051 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:16:25.432123  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 103351us
I20260709 13:16:25.432307  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:25.442440  3124 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:25.442857  3090 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:25.443367  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:25.444430  3164 connection.cc:256] RPC call timeout handler was delayed by -1.3935347529998126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
W20260709 13:16:25.444823  3164 connection.cc:256] RPC call timeout handler was delayed by -1.3188347529999191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1844s for a response
W20260709 13:16:25.445108  3164 connection.cc:256] RPC call timeout handler was delayed by -1.3098347529999046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
I20260709 13:16:25.444988  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:25.445513  3164 connection.cc:256] RPC call timeout handler was delayed by -1.3053347529998973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
W20260709 13:16:25.445873  3164 connection.cc:256] RPC call timeout handler was delayed by -1.0515347529999417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
I20260709 13:16:25.445971  3044 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 12: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:25.447465  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:25.448791  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:25.448068  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:25.449923  3197 raft_consensus.cc:3055] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:25.450412  3197 raft_consensus.cc:740] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:25.450520  3051 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:25.446903  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:25.451947  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:25.427588  7636 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.453375  3090 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:25.454281  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:25.454404  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:25.457993  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:25.431610  7676 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:25.471649  3191 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:25.477517  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:25.464687  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:25.465907  3123 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 9: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:25.469455  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:25.481339  3122 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:25.423512  7515 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:25.482419  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:25.483960  7515 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:25.485374  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:25.486330  3118 raft_consensus.cc:2410] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:16:25.490331  7599 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:25.484990  7648 consensus_queue.cc:237] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:25.447173  7629 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:25.497200  3195 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:25.467455  3124 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 12: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:25.511938  7619 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:25.514559  3120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:16:25.462085  3197 consensus_queue.cc:260] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:25.457496  7636 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:25.519809  3762 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:16:25.518371  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 65083.6us
I20260709 13:16:25.515283  3120 raft_consensus.cc:606] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:25.456485  7664 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:25.457653  7075 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:25.518366  3121 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:25.521759  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:25.527176  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:25.523450  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:25.528158  3051 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:25.523845  3197 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:25.504598  7678 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:16:25.520782  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:25.526278  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 68311.4us
I20260709 13:16:25.533995  3048 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:16:25.497219  7327 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.497133  7379 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.532526  3200 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:16:25.533823  3044 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:16:25.515872  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:25.534924  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:25.455286  7658 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:16:25.506574  7617 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:25.539646  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 92464.2us
I20260709 13:16:25.539595  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:25.535567  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 108673us
I20260709 13:16:25.542248  3122 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 12: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:25.524235  7647 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:25.526856  7640 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:25.547427  3164 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:25.526818  7075 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:25.549360  3090 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:25.532568  7224 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:25.526729  7629 raft_consensus.cc:697] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:25.519855  7684 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:25.544327  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:25.550581  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:25.562996  7075 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:25.567029  7681 log.cc:927] Time spent T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:16:25.572296  7480 raft_consensus.cc:3055] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:25.572870  7480 raft_consensus.cc:740] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:25.563427  7224 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.574193  7224 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:25.573719  7480 consensus_queue.cc:260] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:25.574323  7437 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:25.575201  7480 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:25.578083  7467 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:25.578433  7629 consensus_queue.cc:237] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:25.579028  7611 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:25.580531  7467 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:25.584583  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.586486  3122 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:16:25.587744  3197 raft_consensus.cc:1275] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:16:25.588454  3197 pending_rounds.cc:85] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 5
I20260709 13:16:25.588771  3197 pending_rounds.cc:107] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:16:25.589087  3197 raft_consensus.cc:2889] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:25.590409  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:25.595737  3051 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:25.596071  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:25.540161  7327 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:25.601258  7327 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:25.526307  7229 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:25.601893  7212 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:25.606391  3122 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:16:25.617483  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:25.563110  7663 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:25.627437  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 80125.6us
W20260709 13:16:25.629914  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 88755.8us
I20260709 13:16:25.622648  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:25.619071  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 74876.9us
I20260709 13:16:25.554095  7379 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:25.595795  7684 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:25.644161  7684 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:25.644618  7379 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:25.646199  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:25.670945  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 145417us
I20260709 13:16:25.669209  3761 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:25.673887  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:25.677217  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:25.678145  3197 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:25.682331  3164 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:25.628669  7467 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:25.684821  3761 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:25.626674  7619 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:25.694953  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 104611us
I20260709 13:16:25.697650  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:25.698557  3090 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:25.701365  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:25.702134  3193 raft_consensus.cc:2368] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13.
I20260709 13:16:25.695706  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:25.704066  3195 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
W20260709 13:16:25.710125  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.701411  3199 raft_consensus.cc:1275] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:25.712352  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:25.680076  7379 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 13:16:25.720871  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 45565us
I20260709 13:16:25.727977  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:25.728848  3799 raft_consensus.cc:2368] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13.
I20260709 13:16:25.730321  7554 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:25.732582  3762 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:16:25.733662  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 63465.5us
W20260709 13:16:25.733989  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.659118  7611 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:16:25.737522  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:25.689805  7646 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:25.739665  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:25.740114  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:25.694379  7663 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:25.742197  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:25.749719  3200 raft_consensus.cc:2410] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:16:25.750237  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:25.751922  3193 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:25.743638  3796 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:25.745182  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:16:25.748669  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 50242.1us
I20260709 13:16:25.709218  7467 raft_consensus.cc:697] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:25.761446  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:25.762125  3164 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:25.759799  3199 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:16:25.765038  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:25.765883  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:25.768374  3761 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:25.737015  7620 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:25.772591  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:25.774947  3048 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:16:25.780344  3121 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:16:25.781776  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:25.749876  7320 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:25.708200  7692 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:16:25.766443  7344 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:25.746001  7243 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:16:25.774780  7619 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:25.769668  7658 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:25.820945  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 55810us
W20260709 13:16:25.821640  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 79697.2us
I20260709 13:16:25.782101  7327 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:25.766263  7684 consensus_queue.cc:1059] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 13:16:25.827809  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 62717.3us
I20260709 13:16:25.827946  3797 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:25.837095  3792 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:25.772238  7604 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:25.777113  7664 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:16:25.816259  7344 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.853667  3164 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:25.777046  7538 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:25.814926  7379 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:25.785575  7640 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:16:25.855129  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:25.846367  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:25.837984  7327 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.908739  7327 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:25.910437  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:25.912510  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:25.913264  3196 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:25.908270  3123 raft_consensus.cc:2368] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13.
W20260709 13:16:25.878738  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.914736  3197 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:25.915880  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:25.916953  3196 raft_consensus.cc:2410] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:16:25.920850  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:25.922228  3196 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:25.949200  3125 raft_consensus.cc:2368] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10.
I20260709 13:16:25.954496  3090 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:25.858831  7344 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:25.956275  3792 consensus_queue.cc:237] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:26.028277  3191 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
W20260709 13:16:26.030136  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 75766.8us
I20260709 13:16:25.907461  7229 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:26.036230  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 182670us
I20260709 13:16:25.884531  7663 raft_consensus.cc:697] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:25.949156  7620 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:26.041226  7538 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:26.042551  7702 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:16:25.857430  7554 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.165s
I20260709 13:16:25.956369  7551 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:26.050436  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:26.062402  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:26.035879  7666 log.cc:927] Time spent T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:16:26.017799  7320 raft_consensus.cc:697] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:26.039434  7619 raft_consensus.cc:697] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 12 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:16:26.083741  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.870404  7467 consensus_queue.cc:237] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.3, Last appended by leader: 3, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:26.048111  7505 raft_consensus.cc:3055] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:26.096086  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:26.021175  7636 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:26.097707  3090 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:26.048484  7704 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:16:26.131196  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.094934  7505 raft_consensus.cc:740] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:26.088822  7685 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:16:26.139250  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 292986us
I20260709 13:16:26.143287  3049 raft_consensus.cc:2368] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13.
I20260709 13:16:26.143913  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:26.119252  7648 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:26.147599  3797 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:26.148734  3797 raft_consensus.cc:606] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:26.149225  3797 raft_consensus.cc:614] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:26.149880  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 112647us
W20260709 13:16:26.150910  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 53271.2us
W20260709 13:16:26.153306  7703 log.cc:927] Time spent T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:16:26.153398  7212 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:26.154121  7212 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:26.154660  7212 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:26.125131  7480 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:26.172894  3193 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:26.148429  7648 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:26.196440  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 52623.4us
I20260709 13:16:26.125196  7705 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:16:26.162530  7709 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.203099  3797 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:26.206921  3797 raft_consensus.cc:606] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:26.207592  3797 raft_consensus.cc:614] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:26.207646  3164 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:26.206984  3043 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:16:26.205078  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:26.197701  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:26.175485  7620 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:26.199352  7713 log.cc:927] Time spent T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:26.239220  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:26.191998  7648 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:26.255414  7327 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:26.198619  7696 log.cc:927] Time spent T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:16:26.255178  7717 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:26.189618  7686 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:26.260440  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:26.208355  7604 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:26.261382  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 53827.1us
I20260709 13:16:26.260982  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:26.273464  3164 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:26.274905  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:26.165621  7320 consensus_queue.cc:237] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:26.270911  7715 log.cc:927] Time spent T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:16:26.271417  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 664) took 1020 ms. Trace:
W20260709 13:16:26.270918  7708 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
W20260709 13:16:26.271878  7700 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:16:26.162259  7663 consensus_queue.cc:237] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:26.247537  7629 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:26.263592  7692 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.240021  7617 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:16:26.275647  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:26.165448  7619 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:26.279811  3164 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:26.257725  7327 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:26.290498  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 508783us
I20260709 13:16:26.278976  3198 rpcz_store.cc:276] 0709 13:16:25.251122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.255093 (+  3971us) service_pool.cc:224] Handling call
0709 13:16:25.255398 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.262882 (+  7484us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:25.410051 (+147169us) log.cc:844] Serialized 14 byte log entry
0709 13:16:26.073617 (+663566us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b1800379960. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff5323a 00007ff8303bda2a
0709 13:16:26.150852 (+ 77235us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:26.166101 (+ 15249us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.166336 (+   235us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:26.166387 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.166502 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:26.271086 (+104584us) raft_consensus.cc:1685] finished
0709 13:16:26.271178 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.271346 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11501,"prepare.queue_time_us":180374,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":14010,"raft.queue_time_us":47642,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":24913,"spinlock_wait_cycles":6908800,"thread_start_us":157451,"threads_started":2,"wal-append.queue_time_us":826790}
I20260709 13:16:26.305660  7724 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:26.306656  7724 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:26.307443  7724 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.307952  7724 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:26.259768  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:26.200850  7505 consensus_queue.cc:260] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:26.316720  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 57321.8us
I20260709 13:16:26.239017  7709 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:26.324615  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.325778  3761 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:26.325367  3015 leader_election.cc:400] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13.
I20260709 13:16:26.327437  3015 leader_election.cc:403] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:16:26.331589  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.334100  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:26.334734  3792 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:26.299279  7617 consensus_queue.cc:1243] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:26.334612  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:16:26.343413  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 63743.8us
I20260709 13:16:26.345700  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:26.310194  7629 raft_consensus.cc:697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:16:26.330435  7701 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:16:26.347822  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:26.328416  7685 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:26.327093  7604 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:26.367929  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:26.370759  3796 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:26.371085  7725 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13.
I20260709 13:16:26.371500  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:26.371887  7719 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:16:26.370046  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.372831  7714 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:26.373253  3164 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:26.379856  7709 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:26.380769  7709 consensus_queue.cc:1059] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:26.310165  7692 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:26.341581  7327 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:26.368789  7538 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:26.368963  7684 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:26.404565  3046 pending_rounds.cc:85] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 9
I20260709 13:16:26.410146  3046 pending_rounds.cc:107] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:16:26.410481  3046 raft_consensus.cc:2889] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:26.367219  3792 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:26.414284  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:26.416080  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:26.416484  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:16:26.385648  7548 consensus_meta.cc:287] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.942s	user 0.008s	sys 0.001s
I20260709 13:16:26.420017  7548 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:26.420583  7224 consensus_meta.cc:287] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.846s	user 0.008s	sys 0.004s
I20260709 13:16:26.421021  7224 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:26.422263  7548 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:26.422586  3047 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:26.423317  7224 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:26.423481  7724 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:26.424224  7724 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:26.424579  7724 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:26.424923  7724 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:26.426004  7075 consensus_meta.cc:287] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.859s	user 0.010s	sys 0.002s
I20260709 13:16:26.426453  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:26.426414  7075 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:26.427309  3761 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:26.427773  7691 raft_consensus.cc:993] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: : Instructing follower 501fdf2af2bc4b0c971ae880e98f466b to start an election
W20260709 13:16:26.427870  7715 log.cc:927] Time spent T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:26.428488  7691 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:26.428769  7712 raft_consensus.cc:1081] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Signalling peer 501fdf2af2bc4b0c971ae880e98f466b to start an election
I20260709 13:16:26.431105  7075 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:26.388240  7692 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:26.394755  7538 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:26.435913  7676 consensus_meta.cc:287] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.931s	user 0.007s	sys 0.006s
I20260709 13:16:26.437044  7621 raft_consensus.cc:3055] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:26.436594  7676 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:26.437433  7621 raft_consensus.cc:740] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:26.441550  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:26.436527  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:26.449398  3121 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:26.446254  3126 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:26.436132  7538 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:26.401906  7558 consensus_meta.cc:287] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.978s	user 0.011s	sys 0.002s
I20260709 13:16:26.361939  7722 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:26.445317  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:26.390940  7629 consensus_queue.cc:237] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:26.395419  7684 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:26.394052  7327 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:16:26.457213  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 84075.9us
I20260709 13:16:26.468842  7327 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:26.469220  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:26.461458  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:26.461822  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:26.406219  7636 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:26.470445  3191 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:26.411262  7714 raft_consensus.cc:697] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:26.462404  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:26.459187  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:26.439324  7725 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:26.476665  3120 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:26.350306  7686 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.106s
I20260709 13:16:26.498667  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:26.505596  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:26.506397  3192 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:26.509423  3164 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:26.500689  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:26.502167  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:26.511566  3120 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 11: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:26.518121  7709 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:26.519496  7379 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:26.519937  3164 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:26.413576  7604 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:26.521379  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 173704us
W20260709 13:16:26.523910  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.520433  7626 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:16:26.502625  7636 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.536592  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:26.536845  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:26.471798  7344 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:26.538283  3118 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:26.472474  7558 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:26.532780  7716 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:26.536020  7735 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:26.522703  7725 raft_consensus.cc:697] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:26.544723  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2163) took 1078 ms. Trace:
I20260709 13:16:26.547036  7684 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:26.534073  7621 consensus_queue.cc:260] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:26.548866  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:26.551275  3165 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:26.594918  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 43731.7us
I20260709 13:16:26.558292  7379 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:26.562243  7327 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:26.598589  3797 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:26.601621  3042 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:16:26.602607  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:26.568085  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:26.604393  3121 raft_consensus.cc:2393] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:26.541457  7604 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:26.529704  3193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:34728
I20260709 13:16:26.575439  3164 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:26.607993  3193 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:26.608496  3193 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:26.574973  3122 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:26.581259  3123 rpcz_store.cc:276] 0709 13:16:25.466145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.480538 (+ 14393us) service_pool.cc:224] Handling call
0709 13:16:26.544512 (+1063974us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54001c3ed4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:26.544658 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":846602624}
I20260709 13:16:26.550698  7636 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:26.603224  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:26.607010  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:26.611304  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:26.614578  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:26.615638  3123 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:26.617235  3191 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:26.618376  3122 raft_consensus.cc:2393] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 16: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:26.620894  3048 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:26.622706  3044 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:26.624714  7736 raft_consensus.cc:3055] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:26.625223  7736 raft_consensus.cc:740] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:26.625490  3122 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:26.626196  7736 consensus_queue.cc:260] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:26.627477  7676 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:26.627656  7736 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:26.630332  7734 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:26.598286  7722 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:26.593189  7716 raft_consensus.cc:697] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:16:26.630965  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 94694us
I20260709 13:16:26.633863  3123 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:26.585853  7685 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:26.651053  3120 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:16:26.652349  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2229) took 1406 ms. Trace:
W20260709 13:16:26.666334  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 117536us
W20260709 13:16:26.656872  7740 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.074s	user 0.001s	sys 0.001s
I20260709 13:16:26.670677  3121 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:26.621963  7467 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.631731  7621 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:26.666697  3045 rpcz_store.cc:276] 0709 13:16:25.245928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.254436 (+  8508us) service_pool.cc:224] Handling call
0709 13:16:25.258913 (+  4477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.259168 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.259198 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:25.314187 (+ 54989us) log.cc:844] Serialized 26 byte log entry
0709 13:16:25.475883 (+161696us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:25.475918 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.475987 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.582503 (+106516us) raft_consensus.cc:1685] finished
0709 13:16:25.582524 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.652011 (+1069487us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b54000c6050. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:26.652252 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9555200,"thread_start_us":134235,"threads_started":1,"wal-append.queue_time_us":192259,"wal-append.run_cpu_time_us":1992,"wal-append.run_wall_time_us":1045457}
I20260709 13:16:26.691123  3044 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:16:26.678198  3193 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:26.669955  7658 consensus_meta.cc:287] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.832s	user 0.007s	sys 0.002s
I20260709 13:16:26.653154  7648 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:26.698064  3193 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:26.713932  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:26.719794  3045 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:16:26.727710  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 47460us
I20260709 13:16:26.730088  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:26.732055  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:26.733045  3045 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:26.728826  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:26.736965  3120 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:26.688562  7722 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:26.711915  7604 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.577579  7714 consensus_queue.cc:237] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:26.717475  7658 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:26.753912  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:26.794355  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:26.715494  7467 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:26.875633  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 300322us
I20260709 13:16:26.875823  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:26.885667  3164 leader_election.cc:400] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16.
W20260709 13:16:26.884742  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.745648  7686 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.144s
W20260709 13:16:26.904335  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 110055us
I20260709 13:16:26.905401  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:26.876138  7742 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:26.875627  7635 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:26.750835  7604 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:26.919862  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:26.890363  7629 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:26.923028  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:26.931595  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 46040.2us
I20260709 13:16:26.934803  3164 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:26.936021  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.729475  7725 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:26.890244  7676 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:16:26.889988  7684 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:16:26.943876  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:26.945678  3164 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:26.916808  7636 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:26.959036  3192 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:26.941190  7738 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:16:26.970531  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 65250.4us
I20260709 13:16:26.971556  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:26.972920  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:26.943679  7558 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:26.951567  7635 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:26.884011  7716 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:26.954936  7653 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:26.960084  7636 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:27.031108  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:27.031410  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:27.031800  3196 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:27.032845  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:27.010002  7746 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:16:27.010466  7750 log.cc:927] Time spent T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:16:26.891626  7685 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:27.015842  7379 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:27.017591  7738 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:27.018280  7611 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:27.009318  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:27.019134  7467 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:27.022159  3125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2148) took 1652 ms (client timeout 2122 ms). Trace:
I20260709 13:16:27.024789  7742 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:27.105726  7742 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:27.106238  7742 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:27.106957  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:27.107329  7611 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.108162  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:27.108065  7611 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:27.108827  3042 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:27.026413  7741 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.355s	user 0.000s	sys 0.001s
W20260709 13:16:27.002929  7724 consensus_meta.cc:287] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.002s
I20260709 13:16:27.111380  7724 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:27.112111  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:27.112705  3118 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:27.113495  7724 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:27.029241  3121 raft_consensus.cc:1240] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:16:27.054100  3196 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:27.124727  3121 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:27.121860  7742 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:27.126030  3122 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:16:27.030629  7636 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:27.127929  7636 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:27.130740  7344 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:27.054272  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:26.955588  7629 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:27.135207  3044 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:16:27.133972  7742 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:27.007037  7653 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:27.138682  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 193098us
W20260709 13:16:27.142549  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 103625us
I20260709 13:16:27.058184  7676 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.139739  3193 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:16:27.143327  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:27.143519  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:27.144665  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:27.064558  7480 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.064165  7554 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:27.149041  3164 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:27.150673  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:27.070926  3125 rpcz_store.cc:269] 0709 13:16:25.369771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.370599 (+   828us) service_pool.cc:224] Handling call
0709 13:16:27.021940 (+1651341us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b5400319f54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:27.022091 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320088448}
I20260709 13:16:27.169121  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:27.008556  7635 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:27.101178  7648 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:27.168216  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet d5f05b490add4820b03ca7600e7539ff: Illegal state: Replica f20672b2852447a6bc1e137c4dd40904 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:27.163856  3050 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:27.147017  7653 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:27.220508  3118 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:27.169040  7738 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:27.236788  7728 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:27.238145  7611 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:27.214845  7538 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.238838  7538 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:27.241113  7538 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:27.151322  7676 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:27.243402  7676 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:27.168148  7480 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:27.168666  7327 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:27.247946  7480 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:27.223621  7724 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:27.232694  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 63638.6us
I20260709 13:16:27.191195  7675 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.245942  3050 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:27.254344  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:27.256989  3045 consensus_meta.cc:287] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.000s
I20260709 13:16:27.162073  7767 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:27.258884  3045 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:27.147500  7664 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.159044  7379 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:27.226962  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:27.271030  3164 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:27.268239  3042 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:27.231977  7635 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:27.261390  7717 consensus_meta.cc:287] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.978s	user 0.008s	sys 0.006s
W20260709 13:16:27.282636  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 57412.7us
I20260709 13:16:27.286335  3015 leader_election.cc:400] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13.
I20260709 13:16:27.194368  7554 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:27.288316  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.289641  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:27.261358  7686 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.234356  7742 consensus_queue.cc:1059] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:16:27.261143  7767 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:27.294814  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:16:27.281085  7212 consensus_meta.cc:287] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.120s	user 0.011s	sys 0.003s
I20260709 13:16:27.271492  7379 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.232432  7467 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 13:16:27.282757  7736 consensus_meta.cc:287] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.003s
I20260709 13:16:27.299266  3164 leader_election.cc:400] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13.
I20260709 13:16:27.279776  7724 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:27.308538  3164 leader_election.cc:403] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:16:27.300278  3123 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:27.283928  7738 raft_consensus.cc:2764] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:16:27.298730  7717 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:27.312980  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet f12375b5613c4d08b52a1a44ccb82294: Illegal state: Replica f20672b2852447a6bc1e137c4dd40904 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:27.293246  7604 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:27.253659  7636 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:27.269452  7675 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:27.287819  7769 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:27.288893  7676 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:27.327334  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:27.328787  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:27.306317  7635 raft_consensus.cc:2764] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:16:27.375063  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46325.9us
I20260709 13:16:27.302418  7767 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:27.290654  7728 consensus_queue.cc:1059] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:16:27.324401  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:27.403941  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 79626.9us
I20260709 13:16:27.404640  7611 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:27.405239  7611 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.309275  7379 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:27.405686  7611 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:27.278916  7664 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:27.407554  7728 consensus_queue.cc:1059] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:27.409060  7728 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:27.384486  7635 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:27.420184  7728 consensus_queue.cc:1243] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:16:27.390916  7684 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.390229  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:27.379454  7738 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:27.423223  7768 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:16:27.392474  7742 consensus_queue.cc:1059] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:27.421586  3193 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:27.424141  7742 raft_consensus.cc:3055] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:27.424636  7742 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:27.425668  7742 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:27.427516  7742 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:27.394428  7604 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.429850  7604 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:27.433334  7604 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:27.395915  3090 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:27.400139  7629 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:27.326128  7736 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:27.399000  7772 log.cc:927] Time spent T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:16:27.416085  7769 raft_consensus.cc:3055] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:27.437099  7769 raft_consensus.cc:740] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:27.310925  7212 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:27.438354  7769 consensus_queue.cc:260] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:27.439666  3119 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:27.352522  7603 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.440994  7212 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:27.440599  7603 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:27.443889  7603 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:27.419746  7676 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:27.420957  7684 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:27.400542  7765 raft_consensus.cc:3055] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:27.384392  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:27.582957  3118 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:27.419277  7763 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:16:27.415107  7554 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:27.452064  3164 leader_election.cc:400] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 9 pre-election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 9. Current term is 10.
I20260709 13:16:27.349339  7716 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:27.309795  7725 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:16:27.298998  7686 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:27.464350  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:27.470016  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:27.611096  3195 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:27.612327  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:27.613057  3195 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:27.483454  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:27.498652  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:27.599313  7604 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.615206  3198 raft_consensus.cc:1240] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:27.598997  7467 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:27.616689  3198 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:27.578341  3042 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:16:27.617050  7467 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:27.620223  7467 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:27.409994  7664 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:27.588215  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:27.623235  7738 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:16:27.589358  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 193525us
I20260709 13:16:27.624125  3121 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:16:27.624682  3090 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:27.607196  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.614856  7604 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:27.473670  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:27.491544  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:27.659178  7675 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:27.660173  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:27.668853  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:27.582335  7765 raft_consensus.cc:740] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:27.678454  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:27.606590  7769 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:27.680155  3198 raft_consensus.cc:1275] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 8 index: 2. Preceding OpId from leader: term: 11 index: 4. (index mismatch)
I20260709 13:16:27.599489  7716 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:27.685597  3120 raft_consensus.cc:1275] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 9 index: 3. Preceding OpId from leader: term: 11 index: 4. (index mismatch)
I20260709 13:16:27.574716  7212 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:27.662165  7554 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:27.680682  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:27.708884  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 257043us
I20260709 13:16:27.679407  7738 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:27.679903  7603 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:27.733723  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:27.734632  3792 raft_consensus.cc:3055] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:27.735049  3792 raft_consensus.cc:740] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:27.781956  3118 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:27.690112  7716 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:27.795799  3193 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:27.799485  3799 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: [9.10-11.11]
I20260709 13:16:27.708295  7692 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:27.810544  3791 raft_consensus.cc:1240] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:27.810951  3796 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:27.811430  3795 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:16:27.811578  7621 consensus_meta.cc:287] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.099s	user 0.013s	sys 0.000s
I20260709 13:16:27.812577  3196 raft_consensus.cc:2410] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:16:27.813023  3790 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:27.813299  7765 consensus_queue.cc:260] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:27.813966  7770 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.814666  7765 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:27.814530  7770 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:27.810448  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:27.850134  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2172) took 1157 ms. Trace:
I20260709 13:16:27.850772  3123 rpcz_store.cc:276] 0709 13:16:26.692907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.693071 (+   164us) service_pool.cc:224] Handling call
0709 13:16:27.849868 (+1156797us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b540010e354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:27.850045 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350638464}
I20260709 13:16:27.861725  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 723) took 1445 ms. Trace:
I20260709 13:16:27.862191  3124 rpcz_store.cc:276] 0709 13:16:26.416485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.416608 (+   123us) service_pool.cc:224] Handling call
0709 13:16:27.111586 (+694978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.111794 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:27.112085 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.259238 (+147153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.259324 (+    86us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:27.259389 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.259481 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.861495 (+602014us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b54000a8f50. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:27.861624 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1095,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":94,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8635,"spinlock_wait_cycles":1510910720,"thread_start_us":145775,"threads_started":1,"wal-append.queue_time_us":298125}
I20260709 13:16:27.737299  7212 raft_consensus.cc:697] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:27.885490  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:27.886019  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:27.886508  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:27.886866  3796 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:27.816747  7725 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:27.872449  3792 consensus_queue.cc:260] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:27.898346  3792 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:27.900472  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.871840  7738 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:27.803949  7603 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:27.912920  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:27.890255  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:27.898726  3090 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 1.721s (SENT) [suppressed 11 similar messages]
I20260709 13:16:27.884388  7728 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.918650  7675 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:27.919317  7675 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:27.896842  7725 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:16:27.907258  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 226627us
W20260709 13:16:27.906910  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.810621  7692 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:27.923599  3792 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:27.924685  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:27.911878  3796 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
W20260709 13:16:27.930812  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet cf28784fe3e74ad5b9c56f1d28247222: Illegal state: Replica 501fdf2af2bc4b0c971ae880e98f466b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:27.931744  3795 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 12: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:27.887053  7771 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.016s	sys 0.033s
I20260709 13:16:27.932706  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:27.935786  7621 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:27.936273  7621 raft_consensus.cc:697] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:27.937178  7621 consensus_queue.cc:237] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:27.938720  7787 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.939380  7787 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:27.927503  7725 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:27.930575  7684 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:27.943418  7771 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.017s	sys 0.033s
I20260709 13:16:27.962898  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:27.964426  3795 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:27.965181  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:16:27.971657  7699 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 2.065s	user 0.013s	sys 0.027s
I20260709 13:16:27.979102  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:27.984587  7711 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:27.989463  7658 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.990103  7658 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:27.991771  7676 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:27.992370  7676 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:27.993024  7676 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:27.995023  7686 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:27.997040  7739 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 1.391s	user 0.005s	sys 0.014s
I20260709 13:16:27.997347  7692 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:27.998867  7603 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:27.953819  7327 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.007109  7327 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:28.009382  7327 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:27.922358  7728 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:28.016788  3797 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43926 (request call id 742) took 1646 ms (client timeout 1639 ms). Trace:
I20260709 13:16:27.992416  7658 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:27.993486  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:16:28.022486  3049 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 2236) took 2660 ms (client timeout 1738 ms). Trace:
W20260709 13:16:28.013464  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 114759us
I20260709 13:16:28.013501  3123 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:16:28.003809  7742 consensus_meta.cc:287] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.576s	user 0.011s	sys 0.000s
I20260709 13:16:28.019884  3045 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:16:28.017249  3797 rpcz_store.cc:269] 0709 13:16:26.370856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.371225 (+   369us) service_pool.cc:224] Handling call
0709 13:16:28.016550 (+1645325us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54006540d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:28.016716 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519996672}
W20260709 13:16:28.022998  3049 rpcz_store.cc:269] 0709 13:16:25.362435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.367104 (+  4669us) service_pool.cc:224] Handling call
0709 13:16:28.022294 (+2655190us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b5400474fd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:28.022417 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673930112}
W20260709 13:16:28.030673  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.031239  3165 connection.cc:256] RPC call timeout handler was delayed by -1.2805201520000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
I20260709 13:16:28.036285  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:28.037220  3045 raft_consensus.cc:2368] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15.
I20260709 13:16:28.041330  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:27.958197  7770 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:27.958726  7675 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:27.961082  7738 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:27.985241  7711 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:28.049683  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:28.056210  3798 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:28.062590  7224 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:28.066442  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:28.053375  3044 raft_consensus.cc:2955] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:16:28.057912  7653 consensus_meta.cc:287] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.803s	user 0.009s	sys 0.001s
I20260709 13:16:28.075804  7568 raft_consensus.cc:3055] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:28.093194  7786 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.093276  7568 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:28.093956  7786 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:28.094432  7568 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:28.095899  7568 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:28.096917  7786 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:28.083438  7722 raft_consensus.cc:3055] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:27.934265  7212 consensus_queue.cc:237] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:28.098097  7722 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:28.098991  7722 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:28.100208  7722 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:28.086083  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:28.087939  7711 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:28.088084  7643 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:28.102437  7643 raft_consensus.cc:697] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:28.103615  7643 consensus_queue.cc:237] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:28.106570  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:28.107673  3049 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:28.056293  7787 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:28.059921  7770 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:28.091584  7611 consensus_meta.cc:287] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.685s	user 0.005s	sys 0.006s
I20260709 13:16:28.115460  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 692) took 1671 ms. Trace:
W20260709 13:16:28.091827  7379 consensus_meta.cc:287] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.001s
I20260709 13:16:28.056111  7692 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:16:28.119884  7628 raft_consensus.cc:3055] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:28.141080  7628 raft_consensus.cc:740] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:28.141875  7379 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:28.142069  7628 consensus_queue.cc:260] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:28.143298  7628 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:28.144274  7379 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:28.061331  7327 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:16:28.074482  7784 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:16:28.147188  7737 raft_consensus.cc:2955] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:28.043026  7686 consensus_queue.cc:1059] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:16:28.150074  7686 consensus_queue.cc:1243] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:28.150641  7742 raft_consensus.cc:3055] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:28.120164  3194 rpcz_store.cc:276] 0709 13:16:26.443989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.444066 (+    77us) service_pool.cc:224] Handling call
0709 13:16:26.444315 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.504643 (+ 60328us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:26.668990 (+164347us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.146266 (+477276us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.146339 (+    73us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:27.146410 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.115223 (+968813us) spinlock_profiling.cc:243] Waited 60 ms on lock 0x7b54003ba454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:28.115266 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:28.115392 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96089,"prepare.queue_time_us":213491,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":132180,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":7252,"spinlock_wait_cycles":138073856,"thread_start_us":466829,"threads_started":3,"wal-append.queue_time_us":281125,"wal-append.run_cpu_time_us":1394,"wal-append.run_wall_time_us":1085044}
I20260709 13:16:28.151054  7742 raft_consensus.cc:740] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:28.151376  7611 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:28.152161  7742 consensus_queue.cc:260] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:28.154013  7676 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:28.153470  7742 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:28.157902  7736 consensus_meta.cc:287] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.722s	user 0.007s	sys 0.004s
I20260709 13:16:28.090585  7636 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:28.162461  7788 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:16:28.164242  7767 consensus_meta.cc:287] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.743s	user 0.010s	sys 0.000s
I20260709 13:16:28.165033  7620 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:28.166939  7728 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:28.168970  7716 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:28.058207  7766 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:28.165601  7769 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.192773  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:28.195206  3193 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:28.196547  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:28.197158  3193 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:28.196971  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:28.151057  7770 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:28.133160  7653 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:28.177103  7738 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:28.236276  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.264468  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.199864  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.205317  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 276263us
I20260709 13:16:28.288738  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:28.178577  7736 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13.
I20260709 13:16:28.190879  7611 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:28.303762  3193 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:28.308967  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:28.311542  3193 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
W20260709 13:16:28.382493  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 71843.1us
I20260709 13:16:28.192119  7728 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:28.216606  7722 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.387624  3049 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:28.389325  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:28.178658  7725 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:28.285106  7212 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.183713  7788 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:28.198596  7769 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:28.190357  7767 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:28.191079  7620 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:28.415771  7728 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:28.531097  3193 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:28.385782  7790 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:28.198694  7766 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:28.296242  7636 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.170s
W20260709 13:16:28.472445  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 404414us
W20260709 13:16:28.548743  3164 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.019s	sys 0.053s
I20260709 13:16:28.383105  7765 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.145s
W20260709 13:16:28.553264  3164 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.019s	sys 0.053s
I20260709 13:16:28.432475  7771 raft_consensus.cc:3055] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:16:28.553696  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 543378us
W20260709 13:16:28.556134  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.565919  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet 7480597af1f341178e465e8723f7320e: Illegal state: Replica 501fdf2af2bc4b0c971ae880e98f466b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:28.560591  3761 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:28.575237  3195 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:28.575032  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:28.576658  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:28.573117  3761 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:28.582360  3090 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:28.583272  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:28.416430  7722 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:28.583207  7618 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:28.571838  7790 raft_consensus.cc:697] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:28.596751  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:28.568156  7771 raft_consensus.cc:740] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:28.468564  7212 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:28.599196  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:28.611661  3799 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:16:28.612848  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:28.600283  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:28.614322  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:28.593698  3090 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:28.607681  7643 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:28.630071  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:28.631004  3799 raft_consensus.cc:2393] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:28.636178  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:28.636240  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:28.640563  3792 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:28.590997  7765 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:28.573057  7675 consensus_queue.cc:1059] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
W20260709 13:16:28.644037  3225 heartbeater.cc:646] Failed to heartbeat to 127.1.227.190:44821 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.1.227.190:44821 timed out after 15.000s (SENT)
I20260709 13:16:28.644403  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:28.644688  7790 consensus_queue.cc:237] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:28.598156  7710 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:28.585035  7684 consensus_queue.cc:1059] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.058s
W20260709 13:16:28.661113  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 84555.4us
I20260709 13:16:28.661546  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:28.663913  3791 raft_consensus.cc:2376] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15. Re-sending same reply.
I20260709 13:16:28.664031  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:28.629235  7618 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:16:28.677165  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.651959  7686 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:28.660316  7643 raft_consensus.cc:697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:28.659051  7716 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:28.658020  7710 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.679961  7636 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:28.707455  7663 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:28.703532  7686 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:28.725662  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:28.727977  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 173616us
I20260709 13:16:28.663199  7765 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:28.722649  7710 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:28.725383  7568 consensus_meta.cc:287] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.002s
I20260709 13:16:28.720522  7802 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:28.722595  7636 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:28.725600  7770 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:28.729255  7663 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.732777  7686 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:28.763562  3194 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:28.762017  7663 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:28.768189  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 174534us
I20260709 13:16:28.771158  3792 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:28.725543  7742 consensus_queue.cc:1059] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:16:28.746563  7769 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:28.750207  7725 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:28.767814  7628 consensus_meta.cc:287] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.621s	user 0.011s	sys 0.005s
I20260709 13:16:28.761037  7788 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:28.759161  7636 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:28.725383  7643 consensus_queue.cc:237] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:28.723392  7771 consensus_queue.cc:260] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:28.787781  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 69006.7us
I20260709 13:16:28.763967  7767 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:28.793186  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:28.788004  7675 raft_consensus.cc:3055] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:28.796069  7675 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:28.797124  7628 raft_consensus.cc:3055] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:28.796922  7675 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:28.788830  7742 raft_consensus.cc:3055] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:28.797595  7628 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:28.797967  7742 raft_consensus.cc:740] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:28.798681  7628 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:28.800405  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.749974  7618 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:28.786476  7719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.324s	user 0.039s	sys 0.034s
I20260709 13:16:28.804549  3195 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:28.776294  7802 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:16:28.807861  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:28.790407  7722 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:28.789414  7805 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:28.816905  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.821238  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.807083  7719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.351s	user 0.040s	sys 0.035s
I20260709 13:16:28.798906  7742 consensus_queue.cc:260] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:28.889536  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.789572  7716 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:16:28.806495  7767 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:28.806592  7809 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.801721  7212 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:28.808287  7802 consensus_queue.cc:1243] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 8.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:28.907826  7814 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.908448  7814 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:28.910341  7800 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 13:16:28.911885  7801 log.cc:927] Time spent T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:16:28.888375  7719 raft_consensus.cc:697] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:28.913566  7811 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:28.851619  7675 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:28.887029  7628 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:29.061522  7811 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.063688  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:28.901633  7767 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:28.902488  7722 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.973830  7742 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:28.888538  7805 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.107933  7805 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:29.108471  7805 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:29.109011  7805 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.110327  7814 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:29.111100  7814 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.111407  7685 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:29.111521  7814 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.111940  7685 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.087388  7767 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:28.915179  7809 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.108471  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 728) took 2689 ms. Trace:
I20260709 13:16:29.089634  7765 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:29.120165  3117 rpcz_store.cc:276] 0709 13:16:26.419146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.419277 (+   131us) service_pool.cc:224] Handling call
0709 13:16:26.419607 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.434827 (+ 15220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.434867 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:26.434914 (+    47us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:26.434957 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.108238 (+2673281us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b5400319054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:29.108284 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.108412 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34529024}
I20260709 13:16:29.113806  7685 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:29.113590  7814 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:29.125090  7685 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:29.125913  7685 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.126304  7809 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:29.127983  7805 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:29.128147  7685 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:29.099632  7722 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.131263  7788 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:29.146436  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.149611  3197 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:16:29.156692  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.160625  7809 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.164043  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.186267  3194 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:29.186766  3119 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:29.164832  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.188030  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:29.188882  3119 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:29.144539  7788 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.189966  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:29.189980  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.190778  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:29.191316  3124 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:29.191461  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:29.192283  3121 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:29.177317  7735 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:29.181342  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:29.193828  7769 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:29.194059  7809 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:29.194777  3047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47488 (request call id 797) took 2752 ms (client timeout 2031 ms). Trace:
I20260709 13:16:29.194845  7769 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.184667  7744 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.193842  3118 raft_consensus.cc:2368] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15.
I20260709 13:16:29.196983  7744 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.197609  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.196215  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:29.198388  3118 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:29.187934  3117 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:29.193898  7770 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:29.190266  3123 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:29.199091  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.199348  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.199653  3118 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:29.197609  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:29.183861  3126 pending_rounds.cc:85] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 5
I20260709 13:16:29.200376  3126 pending_rounds.cc:107] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:16:29.200618  3126 raft_consensus.cc:2889] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:29.173609  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.191424  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:29.193061  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.202955  3792 raft_consensus.cc:2955] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:29.182205  3122 raft_consensus.cc:2955] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:29.208781  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:29.193444  7735 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.213326  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.214474  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.215176  3117 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 12: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:29.215257  7769 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:29.214468  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.216382  3121 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:29.131577  7719 consensus_queue.cc:237] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.217604  7735 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:29.210225  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.222062  3194 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:29.222980  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.223542  3194 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:29.224756  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:29.224655  7636 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.226749  7722 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:29.229776  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:29.230199  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.229948  7718 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:29.232394  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.233155  3199 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
W20260709 13:16:29.233844  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.233911  7640 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:29.234256  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.234572  7640 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.235605  7744 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:29.236153  7744 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:29.236389  7769 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:29.236649  7744 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.237102  7769 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:29.195312  3047 rpcz_store.cc:269] 0709 13:16:26.442553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.447157 (+  4604us) service_pool.cc:224] Handling call
0709 13:16:29.194587 (+2747430us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b540029de54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:29.194703 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1858508032}
I20260709 13:16:29.240666  3793 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:43458
W20260709 13:16:29.264724  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.266412  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.238679  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 1995) took 1755 ms. Trace:
I20260709 13:16:29.248620  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:29.268530  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.267184  3121 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:29.266489  3091 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:29.269948  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.264765  3793 raft_consensus.cc:606] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:29.270996  3798 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 12: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:29.271750  3793 raft_consensus.cc:614] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:29.267143  3196 rpcz_store.cc:276] 0709 13:16:27.482874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.483091 (+   217us) service_pool.cc:224] Handling call
0709 13:16:29.238482 (+1755391us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54001def54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:29.238621 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455887104}
I20260709 13:16:29.240415  3192 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:16:29.274726  3192 pending_rounds.cc:85] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 5
I20260709 13:16:29.275153  3192 pending_rounds.cc:107] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:16:29.275715  3192 raft_consensus.cc:2889] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:29.272858  3124 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:29.263525  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2650) took 2391 ms. Trace:
W20260709 13:16:29.242763  7737 consensus_meta.cc:287] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.093s	user 0.010s	sys 0.003s
I20260709 13:16:29.278530  7786 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:29.278793  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.279455  3121 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:29.280407  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.276626  3050 rpcz_store.cc:276] 0709 13:16:26.871864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.258504 (+386640us) service_pool.cc:224] Handling call
0709 13:16:27.258840 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.272308 (+ 13468us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:27.467268 (+194960us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.702857 (+235589us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.702921 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:27.702989 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.263197 (+1560208us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b540028bc54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:29.263269 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.263455 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5979,"prepare.queue_time_us":54478,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":227887,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":9686,"spinlock_wait_cycles":30442752,"thread_start_us":412945,"threads_started":2,"wal-append.queue_time_us":433529,"wal-append.run_cpu_time_us":1435,"wal-append.run_wall_time_us":1043311}
I20260709 13:16:29.287112  3194 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:29.288749  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.290349  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.294425  3091 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:29.180727  7723 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:29.200553  7771 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:29.301453  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:29.303709  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:29.198189  7717 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.237658  7640 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:29.197192  7788 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:29.302541  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.238122  7212 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.323352  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:29.324324  3196 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:29.238675  7809 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:29.310201  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.311388  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.315174  3795 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:29.248199  7728 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:29.179548  7663 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.329572  3119 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:16:29.279328  7764 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:29.335371  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:29.305370  7790 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.305720  7810 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:29.305011  7629 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:16:29.343902  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.345089  3194 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:29.345988  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:29.380739  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:29.340158  3761 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:29.347402  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:29.257910  7770 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:29.359788  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.279120  7786 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.368153  3794 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:29.369650  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.373075  3124 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 11: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:29.318790  7716 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:29.381713  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:29.337385  7685 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:29.374644  7710 consensus_meta.cc:287] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.617s	user 0.009s	sys 0.002s
W20260709 13:16:29.383801  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 43761.9us
I20260709 13:16:29.350029  7802 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:29.383127  7686 consensus_meta.cc:287] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.605s	user 0.005s	sys 0.005s
I20260709 13:16:29.392524  3194 raft_consensus.cc:2376] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13. Re-sending same reply.
W20260709 13:16:29.403424  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.391917  3119 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:16:29.308495  7723 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.338591  7212 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.395275  3117 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:29.406615  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:29.387655  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.396706  3799 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:29.339028  7640 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:16:29.391888  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:29.392690  7618 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:29.424017  3164 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:29.378958  7813 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.382241  7805 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:29.403640  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:29.406503  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:29.423687  3048 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:29.437688  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:29.399434  3196 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:29.322582  7717 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.439610  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:29.440868  7717 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:29.441010  7728 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:29.441967  7728 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.442559  3199 raft_consensus.cc:2410] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:16:29.443743  3793 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:29.429296  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:29.371229  7814 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 13:16:29.432760  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 126261us
I20260709 13:16:29.434098  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:29.446640  3164 leader_election.cc:400] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15.
I20260709 13:16:29.446683  3091 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:29.447361  3164 leader_election.cc:403] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:16:29.448581  3091 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:29.449218  3164 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:29.386029  7765 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:16:29.452736  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.458676  3194 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:29.452227  3091 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:29.452171  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:29.452221  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:29.454452  3196 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:16:29.423724  7675 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:29.386268  7629 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.455564  7722 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:29.453181  3118 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:29.384120  7790 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.431308  7618 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.467532  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:29.401463  7710 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:29.473232  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.509189  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2415) took 1285 ms. Trace:
I20260709 13:16:29.476119  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:29.511097  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 800) took 2594 ms. Trace:
I20260709 13:16:29.402657  7685 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.485069  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:29.512579  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:29.467623  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:29.511492  3042 rpcz_store.cc:276] 0709 13:16:26.886533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.273512 (+386979us) service_pool.cc:224] Handling call
0709 13:16:27.274348 (+   836us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:27.617632 (+343284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.480216 (+1862584us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b540027d8d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:29.480583 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":697962880}
I20260709 13:16:29.517237  3194 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:29.457240  7684 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:29.493809  3794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 600) took 1566 ms. Trace:
I20260709 13:16:29.495384  7663 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:29.443893  7813 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.524853  3794 rpcz_store.cc:276] 0709 13:16:27.927069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.927712 (+   643us) service_pool.cc:224] Handling call
0709 13:16:27.935822 (+  8110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.391420 (+1455598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.493388 (+101968us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400521554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:29.493672 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3293537536}
I20260709 13:16:29.450922  7717 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:29.479931  7722 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:29.501981  7816 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:16:29.505909  7618 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:29.506347  7770 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:29.541465  7710 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:29.444025  7824 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:29.407143  7686 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.513062  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:29.478260  3196 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:29.516750  3048 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 12: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:29.509915  3193 rpcz_store.cc:276] 0709 13:16:28.224136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.388966 (+164830us) service_pool.cc:224] Handling call
0709 13:16:29.508953 (+1119987us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400037854. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:29.509107 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310319872}
I20260709 13:16:29.517820  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:29.402453  7716 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.452945  7788 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15.
I20260709 13:16:29.489531  7769 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:29.519707  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.464206  7810 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:29.525593  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.605973  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:29.497026  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.607571  3794 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:29.527937  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:29.482991  7806 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:29.529342  3118 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:29.531666  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:29.604826  7825 log.cc:927] Time spent T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:16:29.394831  7764 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.535544  7212 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:29.481647  7815 consensus_queue.cc:1059] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:16:29.536932  7744 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:29.450851  7805 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.538049  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:29.404508  7802 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.539175  7685 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:29.542567  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:29.544081  7786 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:29.536924  3165 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:29.549014  3194 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:29.485414  7636 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:29.452670  7718 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.596681  3050 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:29.524224  7822 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:29.601387  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:29.601287  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:29.602399  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 138870us
I20260709 13:16:29.630118  3799 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 12: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:29.544382  7629 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:29.551083  7722 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:29.607093  3121 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:29.559572  7684 raft_consensus.cc:697] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:29.593798  7742 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.596007  7817 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:29.500532  7790 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:29.567452  7831 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:29.596208  7824 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.611423  3200 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:29.600437  7714 consensus_queue.cc:1059] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:16:29.622267  3791 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:29.627923  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.630066  3193 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:29.670396  3799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12725e4e41614e1292b974e17635f758"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
W20260709 13:16:29.595690  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 110680us
I20260709 13:16:29.672465  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:29.615406  7810 raft_consensus.cc:697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:29.673976  7810 consensus_queue.cc:237] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:29.634959  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 98132.5us
I20260709 13:16:29.677162  7764 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:29.677443  3165 leader_election.cc:400] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13.
I20260709 13:16:29.631402  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:29.678087  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 46756.2us
I20260709 13:16:29.680423  7822 consensus_queue.cc:1059] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:29.682044  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.683198  7744 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.683511  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.684208  3200 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
I20260709 13:16:29.683868  7744 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.685253  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.685990  7837 raft_consensus.cc:3055] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:29.686546  7837 raft_consensus.cc:740] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:29.687687  7837 consensus_queue.cc:260] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.689280  7837 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:29.634914  7788 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:29.652979  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:29.622802  7551 raft_consensus.cc:3055] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:29.618997  7806 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:29.690847  7551 raft_consensus.cc:740] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:29.691573  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.691751  7551 consensus_queue.cc:260] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.692202  3121 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:29.691606  7806 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.632903  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.693095  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.693323  3194 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:29.694178  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.694785  3194 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:29.695566  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:29.696123  3194 raft_consensus.cc:2376] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15. Re-sending same reply.
I20260709 13:16:29.696934  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.690111  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.682140  7822 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:29.698084  3124 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:29.698292  7822 raft_consensus.cc:697] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:29.699131  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.700031  7822 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.700904  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.701581  3124 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
W20260709 13:16:29.697558  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.702574  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.702907  7788 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:16:29.703367  7821 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:16:29.692713  7551 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:29.703540  7788 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.703569  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:29.707175  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:29.708559  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:29.709792  3044 raft_consensus.cc:2410] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:16:29.703301  3124 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:29.710247  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:29.710909  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.712021  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.714236  3124 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:29.714951  7788 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:29.711038  3165 leader_election.cc:403] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:16:29.717227  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.712517  7744 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:29.725723  7811 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:29.726878  7686 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:29.670835  7728 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:29.727571  3124 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:29.638278  7718 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.729852  3797 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:29.730170  7718 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:29.731274  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:29.731984  3124 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:29.732143  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2089) took 2248 ms. Trace:
I20260709 13:16:29.732295  7802 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:29.732581  3120 rpcz_store.cc:276] 0709 13:16:27.483782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.483965 (+   183us) service_pool.cc:224] Handling call
0709 13:16:27.624263 (+140298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.686118 (+ 61855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.731926 (+2045808us) spinlock_profiling.cc:243] Waited 60.9 ms on lock 0x7b540018a1d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:29.732087 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140046720}
I20260709 13:16:29.733093  7723 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:29.734768  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:29.735908  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:29.736850  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:29.737367  3048 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 8.
I20260709 13:16:29.712986  7805 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:29.717658  3165 leader_election.cc:400] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15.
I20260709 13:16:29.718204  7684 consensus_queue.cc:237] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.697484  3194 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
I20260709 13:16:29.721400  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.744966  3121 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:29.745117  3199 raft_consensus.cc:2393] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:29.746006  3794 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:29.746539  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:29.747001  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.747330  3199 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:29.653564  7817 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:29.749882  3165 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:29.750234  3120 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:29.751556  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 79155.8us
I20260709 13:16:29.753058  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:29.723448  7620 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:29.725059  7813 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:29.758544  3795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 600) took 1163 ms. Trace:
I20260709 13:16:29.759096  3795 rpcz_store.cc:276] 0709 13:16:28.595417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.595631 (+   214us) service_pool.cc:224] Handling call
0709 13:16:28.599485 (+  3854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.344791 (+745306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.758232 (+413441us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b540009fe54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:29.758467 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1645343616}
I20260709 13:16:29.761379  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2409) took 1567 ms. Trace:
I20260709 13:16:29.733179  3124 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:29.761958  3192 rpcz_store.cc:276] 0709 13:16:28.194180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.194314 (+   134us) service_pool.cc:224] Handling call
0709 13:16:29.240047 (+1045733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.292381 (+ 52334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.761085 (+468704us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001def50. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:29.761298 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2376163712}
I20260709 13:16:29.763233  3124 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:16:29.764258  7716 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:29.664446  7824 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:29.739110  3200 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:29.784945  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:29.786432  3194 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 13: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:29.787495  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.661767  7742 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.742383  3791 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:29.671057  3799 raft_consensus.cc:606] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:29.666733  7628 consensus_meta.cc:287] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.604s	user 0.009s	sys 0.001s
I20260709 13:16:29.792394  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:29.748431  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.755112  7817 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:29.755383  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:29.755831  3043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47488 (request call id 793) took 3496 ms (client timeout 1924 ms). Trace:
I20260709 13:16:29.748625  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:29.721967  7788 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13.
W20260709 13:16:29.717486  7767 consensus_meta.cc:287] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.593s	user 0.008s	sys 0.000s
I20260709 13:16:29.805963  3164 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:29.790064  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:29.790434  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:29.794016  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:29.810551  7212 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:29.811111  7742 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:29.813213  3042 raft_consensus.cc:2410] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:29.814332  3164 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:29.815008  7620 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:29.815753  7620 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.815850  7628 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:29.816183  7620 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:29.816524  7628 raft_consensus.cc:697] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:29.817538  7628 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.818655  7505 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:29.802492  7551 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:29.820290  7551 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:29.820695  7551 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:29.826015  7663 consensus_queue.cc:1059] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:29.826882  7663 consensus_queue.cc:1243] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer e9165fe61ab04bfb9a48889156d5c161 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:16:29.827858  3090 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:29.829829  7839 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:29.830459  7839 raft_consensus.cc:697] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:29.831424  7839 consensus_queue.cc:237] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.832602  3125 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:29.835917  3090 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:29.723038  3045 raft_consensus.cc:2410] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:16:29.837576  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 86192.1us
W20260709 13:16:29.838995  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 45092.5us
I20260709 13:16:29.793285  7738 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:29.791447  7718 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:29.795511  3043 rpcz_store.cc:269] 0709 13:16:26.259840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.260061 (+   221us) service_pool.cc:224] Handling call
0709 13:16:29.755618 (+3495557us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54003c4bd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:29.755753 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1096505216}
I20260709 13:16:29.802096  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:29.761979  7783 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:29.802911  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.802775  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:29.739851  3193 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:29.800737  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.763700  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.867496  3120 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:29.867674  3192 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:29.813688  7767 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.797420  3048 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
W20260709 13:16:29.844429  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.868989  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:29.846838  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:29.842540  7728 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:29.850720  7749 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.843273  7735 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:29.851372  7212 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:29.855409  7551 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.857487  7724 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.881803  7724 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.883396  7551 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:29.885206  7771 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:29.885815  7771 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:29.886322  7771 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:29.886359  3198 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:16:29.887059  3198 pending_rounds.cc:85] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 5
I20260709 13:16:29.887416  3198 pending_rounds.cc:107] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:16:29.887732  3198 raft_consensus.cc:2889] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:29.894053  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:29.896787  3195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2413) took 1700 ms (client timeout 1749 ms). Trace:
W20260709 13:16:29.897375  3195 rpcz_store.cc:269] 0709 13:16:28.196504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.196665 (+   161us) service_pool.cc:224] Handling call
0709 13:16:29.896566 (+1699901us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b540013ced4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:29.896713 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":866866560}
I20260709 13:16:29.898823  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:29.900597  3051 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47488 (request call id 795) took 3497 ms (client timeout 1535 ms). Trace:
W20260709 13:16:29.901173  3051 rpcz_store.cc:269] 0709 13:16:26.402972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.406363 (+  3391us) service_pool.cc:224] Handling call
0709 13:16:29.900325 (+3493962us) spinlock_profiling.cc:243] Waited 2.96 s on lock 0x7b5400074754. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:29.900500 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6809570688}
I20260709 13:16:29.902899  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:29.904418  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:29.860049  7620 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:29.825110  7817 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.866631  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2427) took 1119 ms. Trace:
I20260709 13:16:29.910983  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:29.952692  3193 rpcz_store.cc:276] 0709 13:16:28.747731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.601035 (+853304us) service_pool.cc:224] Handling call
0709 13:16:29.866539 (+265504us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:29.953773  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:29.908466  3119 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: [7.5-10.7]
I20260709 13:16:29.955320  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.956147  3193 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:29.776408  7723 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:29.957346  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.959327  3193 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:29.960021  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2008) took 1664 ms. Trace:
I20260709 13:16:29.960510  3193 rpcz_store.cc:276] 0709 13:16:28.295223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.957023 (+1661800us) service_pool.cc:224] Handling call
0709 13:16:29.959950 (+  2927us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:29.961719  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:29.962596  3193 raft_consensus.cc:2376] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14. Re-sending same reply.
I20260709 13:16:29.963855  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.871997  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:29.873306  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:29.965236  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 92008.3us
I20260709 13:16:29.873317  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:29.970978  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 97719.5us
I20260709 13:16:29.875641  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2421) took 1221 ms. Trace:
I20260709 13:16:29.973940  3192 rpcz_store.cc:276] 0709 13:16:28.654762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.763337 (+1108575us) service_pool.cc:224] Handling call
0709 13:16:29.875568 (+112231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:29.876981  7813 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:29.871551  7735 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.879809  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.030519  3044 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:16:29.880467  7749 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:29.947430  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:29.949889  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.916281  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2410) took 1721 ms. Trace:
I20260709 13:16:29.925441  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:29.870289  3194 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:29.983348  3193 raft_consensus.cc:2410] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:16:29.861783  7738 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.994557  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:29.996539  3048 raft_consensus.cc:2410] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:16:29.868172  7783 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:30.044816  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:30.051729  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.051833  3195 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:29.997228  3091 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:29.998379  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.006017  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:30.052582  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2433) took 1259 ms. Trace:
I20260709 13:16:30.027901  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:30.045352  3051 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:30.046013  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:30.046132  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:30.055980  3194 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 12: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:16:30.056038  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 50160.9us
I20260709 13:16:30.052356  3046 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:30.053110  3195 rpcz_store.cc:276] 0709 13:16:28.792953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.044585 (+1251632us) service_pool.cc:224] Handling call
0709 13:16:30.052502 (+  7917us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.044015  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:30.044962  3198 rpcz_store.cc:276] 0709 13:16:28.194467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.194576 (+   109us) service_pool.cc:224] Handling call
0709 13:16:28.194845 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.888543 (+1693698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.889514 (+   971us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54003bb854. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:29.916178 (+ 26664us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3888843136}
I20260709 13:16:30.059193  3791 raft_consensus.cc:2368] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15.
I20260709 13:16:30.054559  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.060196  3048 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:30.060421  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:30.057125  3090 leader_election.cc:336] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Timed out: RequestConsensusVote RPC to 127.1.227.132:43109 timed out after 1.749s (SENT)
W20260709 13:16:30.050022  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 55595.1us
I20260709 13:16:30.062585  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2426) took 1325 ms. Trace:
I20260709 13:16:30.062641  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:30.061261  3192 raft_consensus.cc:2410] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 13:16:30.063122  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 66024.6us
I20260709 13:16:30.061595  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:30.063194  3194 rpcz_store.cc:276] 0709 13:16:28.737055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.045789 (+1308734us) service_pool.cc:224] Handling call
0709 13:16:30.062524 (+ 16735us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.048614  3047 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 15: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:30.046751  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:30.067210  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:29.994875  7212 raft_consensus.cc:697] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:30.074998  7817 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:30.075994  7212 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:30.060074  7842 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:30.053650  7742 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.078291  7742 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.072383  3164 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:30.027650  7551 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:30.068351  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2423) took 1352 ms. Trace:
I20260709 13:16:30.068718  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.070259  3198 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:16:30.070684  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.084152  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2002) took 1792 ms. Trace:
I20260709 13:16:30.084678  3048 raft_consensus.cc:2410] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:16:30.084622  3198 rpcz_store.cc:276] 0709 13:16:28.291630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.067553 (+1775923us) service_pool.cc:224] Handling call
0709 13:16:30.067897 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.083801 (+ 15904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.084079 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.068126  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:30.073894  7717 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.074059  7770 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:30.082852  3192 rpcz_store.cc:276] 0709 13:16:28.716230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.027893 (+1311663us) service_pool.cc:224] Handling call
0709 13:16:30.068279 (+ 40386us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.070755  3195 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:16:30.089545  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2414) took 1892 ms. Trace:
I20260709 13:16:30.089593  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:30.089989  3195 rpcz_store.cc:276] 0709 13:16:28.196804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.068305 (+1871501us) service_pool.cc:224] Handling call
0709 13:16:30.068661 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.089308 (+ 20647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.089492 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.090476  3192 raft_consensus.cc:2410] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:16:30.074615  7790 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:30.067484  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:29.872412  7718 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:30.086908  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:30.043519  7723 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:30.088264  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.091452  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.110064  7822 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:30.090970  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:30.094810  3044 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:30.094913  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:30.111557  7822 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.049185  7784 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.046931  7735 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:30.112917  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:30.112993  7784 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.054523  7783 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:30.114173  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:30.115159  7784 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:30.115242  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.115934  3044 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:30.055481  7738 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:30.104966  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.117133  3046 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:30.087054  3194 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:16:30.118477  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.118799  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.119710  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.119959  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.120458  3046 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:30.120594  3044 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:30.121493  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.103259  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:30.112957  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:30.121572  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.123337  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.123409  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:30.123881  7738 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.124742  3044 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:30.125006  7744 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:30.125969  3044 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:30.125582  7744 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.126505  7738 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:29.995694  7618 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:30.103319  7824 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.127408  3044 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:30.129531  7618 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:30.130398  7824 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:30.131268  3048 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:30.066963  7827 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:30.065652  7732 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:30.132176  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 45389.5us
I20260709 13:16:30.132930  3048 raft_consensus.cc:3055] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:30.136057  3048 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:30.136792  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:30.137033  3048 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:30.138286  3048 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:30.144094  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 78959.3us
I20260709 13:16:30.088985  7770 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.145314  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:30.048929  7788 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:16:30.132742  7809 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:30.105357  7817 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:30.163579  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:30.163293  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:30.171584  3118 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:16:30.164949  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:30.146639  3198 raft_consensus.cc:2393] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:30.172705  3120 raft_consensus.cc:2376] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11. Re-sending same reply.
I20260709 13:16:30.173183  3048 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:16:30.173590  3048 pending_rounds.cc:85] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 10
I20260709 13:16:30.173802  3048 pending_rounds.cc:107] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:16:30.107137  7551 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:30.106667  7749 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:30.142750  7732 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:30.166167  3199 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:30.138425  7805 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:30.174670  3048 raft_consensus.cc:2889] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:30.144613  7822 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:30.175933  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 118832us
I20260709 13:16:30.095467  7717 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.178586  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:30.160948  7742 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:30.180017  7744 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:30.181206  7724 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:30.183807  7767 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:30.165104  7770 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:30.197613  7764 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.193956  3164 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:30.197013  3117 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:30.159977  7838 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:30.199985  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.219202  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.220268  3048 raft_consensus.cc:2410] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:16:30.221269  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.203131  7717 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:30.204236  3165 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:30.206099  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:30.196547  7765 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.188716  7732 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:30.195902  7722 consensus_meta.cc:287] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.001s
I20260709 13:16:30.192340  3090 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:30.187657  7805 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:30.217350  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:30.224689  3164 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:30.227088  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2418) took 1659 ms. Trace:
I20260709 13:16:30.227293  3164 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:30.227527  3196 rpcz_store.cc:276] 0709 13:16:28.567815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.439360 (+871545us) service_pool.cc:224] Handling call
0709 13:16:30.226927 (+787567us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b54002bcad4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:30.227032 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31933696}
I20260709 13:16:30.229017  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:30.229724  3196 raft_consensus.cc:2376] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12. Re-sending same reply.
I20260709 13:16:30.231271  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:30.212288  3118 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:16:30.212249  7784 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.235574  3196 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 13: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:30.191390  7817 raft_consensus.cc:697] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:30.233783  3165 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:30.218113  7838 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.225035  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.239269  3165 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:30.240089  7824 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:30.240669  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:30.232721  7722 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.242883  7718 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:30.243018  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:30.259891  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:30.260610  3196 raft_consensus.cc:2376] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10. Re-sending same reply.
I20260709 13:16:30.260934  3090 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:30.232380  7765 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.244650  7551 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.237557  7749 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:30.212966  7467 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:16:30.246308  7744 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:30.235631  7858 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:30.245313  7735 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:30.246783  7837 consensus_meta.cc:287] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.529s	user 0.006s	sys 0.003s
I20260709 13:16:30.246861  7788 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:30.222520  7764 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:30.199122  7737 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:16:30.232537  7805 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:30.254153  3125 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:30.256587  3117 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:30.256702  3165 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:30.254648  7838 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:30.264289  3090 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:30.232708  7724 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:30.266076  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:30.267329  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:30.274852  3193 raft_consensus.cc:2393] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 14: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:30.265729  7717 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:30.278820  3195 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:30.260128  7620 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:30.268205  7827 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:30.282323  3192 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:30.267803  7749 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.266887  7824 raft_consensus.cc:697] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:30.285434  3165 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:30.270680  7505 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.256115  7839 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:16:30.250718  7784 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.274729  7858 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.274441  7744 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:30.289283  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:30.291257  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.279896  7788 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.279518  7212 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:30.295800  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.295753  3165 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:30.303010  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.288482  7837 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:30.287966  7710 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:30.294003  7724 raft_consensus.cc:697] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:30.308115  3165 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:30.308459  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.309278  3048 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 12: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:30.294806  7749 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:30.314380  3165 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:30.303798  7744 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:30.306150  7788 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:30.304898  7620 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:30.314522  7827 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:16:30.317508  3165 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:30.314198  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:30.297078  7505 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.323309  7765 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:30.324301  7769 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:30.311281  7723 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:30.301617  7858 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:30.318060  7709 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:30.310613  7837 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:30.335897  3165 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:30.296494  7817 consensus_queue.cc:237] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.336158  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.337985  3044 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:16:30.345166  3044 pending_rounds.cc:85] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 8
I20260709 13:16:30.345588  3044 pending_rounds.cc:107] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:16:30.340176  7769 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.345929  3044 raft_consensus.cc:2889] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:30.346066  7769 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:30.345328  7653 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:30.331265  7620 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:30.307474  7628 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:30.325358  7783 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.329902  7604 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:30.351078  3048 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 12: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:30.328765  7803 log.cc:927] Time spent T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 1.568s	user 0.006s	sys 0.002s
I20260709 13:16:30.347447  3044 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:30.342782  7710 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:30.340725  7737 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:30.341632  7723 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:30.344908  7837 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:30.374711  3046 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:30.357806  7620 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:30.358034  7628 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.358433  7862 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:16:30.371084  7723 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:30.373274  7709 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:30.377573  7735 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:30.380887  7628 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:30.391793  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:30.391810  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 55985.2us
I20260709 13:16:30.384052  7862 consensus_queue.cc:1243] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:16:30.394515  3165 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:30.396142  7735 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:30.403208  7783 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:30.407756  7771 consensus_meta.cc:287] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.000s
W20260709 13:16:30.409602  3197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34728 (request call id 693) took 3965 ms (client timeout 1535 ms). Trace:
I20260709 13:16:30.376303  7724 consensus_queue.cc:237] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.410169  7771 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.419540  7771 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:30.410983  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2408) took 2217 ms. Trace:
I20260709 13:16:30.399397  7764 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:30.410303  3197 rpcz_store.cc:269] 0709 13:16:26.444221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.445026 (+   805us) service_pool.cc:224] Handling call
0709 13:16:30.409380 (+3964354us) spinlock_profiling.cc:243] Waited 2.68 s on lock 0x7b54003b9054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:30.409522 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6171198336}
W20260709 13:16:30.421041  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.388978  7722 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:30.432075  3197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:16:30.367772  7824 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.424428  3191 rpcz_store.cc:276] 0709 13:16:28.193620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.193759 (+   139us) service_pool.cc:224] Handling call
0709 13:16:28.216053 (+ 22294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:28.287942 (+ 71889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:28.287989 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:28.381944 (+ 93955us) log.cc:844] Serialized 26 byte log entry
0709 13:16:28.594573 (+212629us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:28.594655 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.594751 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:30.249687 (+1654936us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:30.392536 (+142849us) raft_consensus.cc:1685] finished
0709 13:16:30.392560 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.410887 (+ 18327us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":67324,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":10214,"spinlock_wait_cycles":24899328,"thread_start_us":205654,"threads_started":1,"wal-append.queue_time_us":329384}
W20260709 13:16:30.393651  7861 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:16:30.442473  3191 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:30.443331  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2005) took 2149 ms. Trace:
I20260709 13:16:30.443671  3191 rpcz_store.cc:276] 0709 13:16:28.293618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.441837 (+2148219us) service_pool.cc:224] Handling call
0709 13:16:30.442238 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.443002 (+   764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.443267 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.450608  7838 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.456565  7805 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.412595  7732 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:30.465013  7732 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:30.435559  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 2108) took 1078 ms. Trace:
I20260709 13:16:30.465821  3126 rpcz_store.cc:276] 0709 13:16:29.356968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.519493 (+162525us) service_pool.cc:224] Handling call
0709 13:16:30.435324 (+915831us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b54003917d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:30.435499 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1132419840}
I20260709 13:16:30.438380  3048 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:16:30.467011  3048 pending_rounds.cc:85] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 10
I20260709 13:16:30.467269  3048 pending_rounds.cc:107] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:16:30.467571  3048 raft_consensus.cc:2889] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:30.468406  7749 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.469901  3048 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:30.470741  7749 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:30.472158  7723 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:30.440589  7769 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:30.432876  7818 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.474741  7818 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:30.475929  7723 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:30.476892  7818 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:30.477820  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:30.478130  7769 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:30.478034  7770 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:30.461066  7784 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:30.462126  7822 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.480484  7858 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.462594  7838 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:30.492702  7770 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:30.493139  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2658) took 1149 ms. Trace:
I20260709 13:16:30.495095  3050 rpcz_store.cc:276] 0709 13:16:29.343258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.347011 (+  3753us) service_pool.cc:224] Handling call
0709 13:16:30.492921 (+1145910us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54000f32d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:30.493030 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493526784}
I20260709 13:16:30.495846  3199 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:30.460577  7788 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.411142  7744 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:30.481184  7822 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:30.432791  3197 raft_consensus.cc:606] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:30.484277  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2424) took 1760 ms. Trace:
I20260709 13:16:30.504316  3197 raft_consensus.cc:614] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:30.504441  3193 rpcz_store.cc:276] 0709 13:16:28.724105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.066847 (+1342742us) service_pool.cc:224] Handling call
0709 13:16:30.484031 (+417184us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54001de554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:30.484202 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458422656}
I20260709 13:16:30.485055  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2256) took 2451 ms. Trace:
I20260709 13:16:30.478135  3195 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:30.496619  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2009) took 1695 ms. Trace:
I20260709 13:16:30.502353  3165 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:30.506358  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2420) took 1875 ms. Trace:
I20260709 13:16:30.507285  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2436) took 1614 ms. Trace:
I20260709 13:16:30.508960  3195 rpcz_store.cc:276] 0709 13:16:28.631367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.477578 (+1846211us) service_pool.cc:224] Handling call
0709 13:16:30.477942 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.506080 (+ 28138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.506302 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.506497  3199 rpcz_store.cc:276] 0709 13:16:28.801582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.495408 (+1693826us) service_pool.cc:224] Handling call
0709 13:16:30.495712 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.496344 (+   632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.496554 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.510986  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2440) took 1422 ms. Trace:
I20260709 13:16:30.511286  3199 rpcz_store.cc:276] 0709 13:16:29.088386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.510443 (+1422057us) service_pool.cc:224] Handling call
0709 13:16:30.510663 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.510786 (+   123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.510801 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:30.510827 (+    26us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:30.510844 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.510880 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.510948 (+    68us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.512491  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2447) took 1257 ms. Trace:
I20260709 13:16:30.512741  3199 rpcz_store.cc:276] 0709 13:16:29.255381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.511927 (+1256546us) service_pool.cc:224] Handling call
0709 13:16:30.512177 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.512297 (+   120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.512311 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:30.512335 (+    24us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:30.512359 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.512389 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.512457 (+    68us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.513962  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2450) took 1200 ms. Trace:
I20260709 13:16:30.505944  3049 rpcz_store.cc:276] 0709 13:16:28.033398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.146460 (+113062us) service_pool.cc:224] Handling call
0709 13:16:28.146802 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:28.395853 (+249051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.484804 (+2088951us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54003c3cd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:30.484993 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553255296}
I20260709 13:16:30.509132  3193 rpcz_store.cc:276] 0709 13:16:28.892713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.506431 (+1613718us) service_pool.cc:224] Handling call
0709 13:16:30.506795 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.506967 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.506992 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:30.507033 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:30.507064 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.507120 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.507228 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.514511  3199 rpcz_store.cc:276] 0709 13:16:29.314163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.513315 (+1199152us) service_pool.cc:224] Handling call
0709 13:16:30.513518 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.513633 (+   115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.513646 (+    13us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:30.513671 (+    25us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:30.513690 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.513719 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.513916 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.516009  3193 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:30.516639  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2019) took 1134 ms. Trace:
I20260709 13:16:30.516944  3193 rpcz_store.cc:276] 0709 13:16:29.381943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.515554 (+1133611us) service_pool.cc:224] Handling call
0709 13:16:30.515828 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.516398 (+   570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.516581 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.486073  7805 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:30.518237  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 696) took 1124 ms. Trace:
I20260709 13:16:30.419929  7628 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:30.520860  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.520746  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:30.523839  3197 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:30.494172  7766 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:30.516244  3199 pending_rounds.cc:85] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 1
I20260709 13:16:30.521884  3195 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:30.526490  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2439) took 1572 ms. Trace:
I20260709 13:16:30.526774  3195 rpcz_store.cc:276] 0709 13:16:28.953899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.521364 (+1567465us) service_pool.cc:224] Handling call
0709 13:16:30.521670 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.526258 (+  4588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.526442 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.527776  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 700) took 1064 ms. Trace:
I20260709 13:16:30.528048  3195 rpcz_store.cc:276] 0709 13:16:29.462957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.527238 (+1064281us) service_pool.cc:224] Handling call
0709 13:16:30.527454 (+   216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.527581 (+   127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.527596 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:30.527622 (+    26us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:30.527645 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.527674 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.527740 (+    66us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.528738  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:30.521574  3193 rpcz_store.cc:276] 0709 13:16:29.393628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.517497 (+1123869us) service_pool.cc:224] Handling call
0709 13:16:30.517708 (+   211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.517955 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.517982 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:30.518021 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:30.518047 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.518100 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.518201 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.497574  7717 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:30.524439  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 697) took 1130 ms. Trace:
I20260709 13:16:30.524679  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:30.529556  3090 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:30.530067  3199 pending_rounds.cc:107] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 8.2
I20260709 13:16:30.530138  3193 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:30.533178  3197 rpcz_store.cc:276] 0709 13:16:29.394045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.523421 (+1129376us) service_pool.cc:224] Handling call
0709 13:16:30.523678 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.524214 (+   536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.524390 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.533831  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 701) took 1061 ms. Trace:
I20260709 13:16:30.506222  7676 raft_consensus.cc:3055] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:30.522904  7870 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:30.548861  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:30.549202  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:30.525334  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.534271  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:30.555133  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.555780  3050 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:30.556605  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:30.557140  3050 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:30.534185  3193 rpcz_store.cc:276] 0709 13:16:29.472778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.529650 (+1056872us) service_pool.cc:224] Handling call
0709 13:16:30.529960 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.533547 (+  3587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.533776 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.558300  3200 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 12: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:30.558673  3193 raft_consensus.cc:1240] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:30.559131  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2181) took 1377 ms. Trace:
I20260709 13:16:30.537184  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:30.536300  7769 consensus_queue.cc:1059] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:16:30.539742  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:30.540288  7732 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:30.540484  7628 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:30.543592  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:30.567139  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:30.567842  3044 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:30.509493  7722 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.545445  7858 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:30.576701  7620 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.545450  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 703) took 1010 ms. Trace:
I20260709 13:16:30.548017  7744 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:30.535844  7676 raft_consensus.cc:740] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:30.581166  7676 consensus_queue.cc:260] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:30.582197  7676 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:30.582247  3198 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:30.583745  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2671) took 1178 ms. Trace:
I20260709 13:16:30.584075  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:30.584220  3042 rpcz_store.cc:276] 0709 13:16:29.405764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.517480 (+111716us) service_pool.cc:224] Handling call
0709 13:16:30.583536 (+1066056us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b5400074c54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:30.583680 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":485201152}
I20260709 13:16:30.585315  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.586421  7732 raft_consensus.cc:697] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:30.587682  7732 consensus_queue.cc:237] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.589064  7620 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:30.534554  3090 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:30.559302  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 706) took 1023 ms. Trace:
I20260709 13:16:30.560143  3799 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
W20260709 13:16:30.591179  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 56671us
I20260709 13:16:30.593969  7827 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:30.591195  3193 rpcz_store.cc:276] 0709 13:16:29.536062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.558231 (+1022169us) service_pool.cc:224] Handling call
0709 13:16:30.558511 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.559059 (+   548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.559247 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.598137  7862 consensus_queue.cc:1059] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:30.534791  3199 raft_consensus.cc:2889] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:30.599551  7862 raft_consensus.cc:3055] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:30.600024  7862 raft_consensus.cc:740] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:30.600693  3164 leader_election.cc:400] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15.
I20260709 13:16:30.601086  3164 leader_election.cc:403] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:30.602159  7805 consensus_queue.cc:1059] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:30.602348  3164 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:30.602653  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.603094  7805 raft_consensus.cc:3055] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:30.603487  7805 raft_consensus.cc:740] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:30.603875  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:30.604616  7766 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15.
I20260709 13:16:30.604377  7805 consensus_queue.cc:260] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:30.605064  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.605414  7766 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:30.608127  3796 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 606) took 2008 ms (client timeout 1749 ms). Trace:
W20260709 13:16:30.608592  3796 rpcz_store.cc:269] 0709 13:16:28.599883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.607917 (+2008034us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:30.608033 (+   116us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:16:30.609774  7875 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:16:30.611256  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:30.561561  3165 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:30.562760  3762 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:30.611930  3043 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:30.612318  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 49647.8us
I20260709 13:16:30.563498  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2017) took 1195 ms. Trace:
I20260709 13:16:30.563874  3195 raft_consensus.cc:1240] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:30.585461  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:30.614602  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 702) took 1084 ms. Trace:
I20260709 13:16:30.614696  3042 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:30.615094  3195 rpcz_store.cc:276] 0709 13:16:29.530141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.554475 (+1024334us) service_pool.cc:224] Handling call
0709 13:16:30.559085 (+  4610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.614343 (+ 55258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.614547 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.598850  3193 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:30.615923  3042 raft_consensus.cc:3055] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:30.575251  7722 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:30.613852  3047 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:30.616808  3193 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:30.618074  3050 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:30.618427  3761 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:30.618552  3044 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:16:30.619733  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:30.620885  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:30.614156  3200 rpcz_store.cc:276] 0709 13:16:29.367894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.776352 (+408458us) service_pool.cc:224] Handling call
0709 13:16:30.548695 (+772343us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b5800136e98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff8353790a0 00007ff835378984 00007ff82e8f36d4 00007ff82e8f3662
0709 13:16:30.563444 (+ 14749us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8633088}
I20260709 13:16:30.622525  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:30.637185  3044 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:30.508823  7837 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:30.623349  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 61840.5us
I20260709 13:16:30.623281  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:30.566957  7859 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.619019  3048 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:30.629534  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:30.629829  3042 raft_consensus.cc:740] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:30.637600  3117 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:30.622462  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:30.642350  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:30.586027  3197 rpcz_store.cc:276] 0709 13:16:29.535051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.541360 (+1006309us) service_pool.cc:224] Handling call
0709 13:16:30.541753 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.545159 (+  3406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.545182 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:30.545218 (+    36us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:30.545248 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.545298 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.545393 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.644649  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:30.649205  3123 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:30.619073  7805 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:30.642697  3125 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:30.677460  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:30.677256  3124 raft_consensus.cc:2393] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:30.678261  3125 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:30.679224  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:30.676936  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:30.681420  3117 raft_consensus.cc:2368] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13.
I20260709 13:16:30.682474  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:30.682919  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:30.683562  3197 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:30.683876  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:30.684664  3117 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:30.685959  3195 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:30.621616  7714 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:30.689658  3043 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:30.694852  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:30.600966  7862 consensus_queue.cc:260] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.637272  7770 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:30.708627  7770 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.709059  7770 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:30.699343  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:30.710449  3120 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 9.
I20260709 13:16:30.699738  3047 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:30.622424  7817 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:16:30.711160  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:30.655006  7212 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:30.703259  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 80285.3us
I20260709 13:16:30.676903  7859 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:30.759624  3126 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
I20260709 13:16:30.707261  7837 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:30.710348  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:30.700134  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:30.763450  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:30.764989  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:30.710798  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:30.642510  7818 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.701272  3200 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:16:30.629251  7718 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:16:30.633924  7551 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:16:30.717509  7688 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:30.777909  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:30.719802  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:30.722719  3090 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:30.723522  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2428) took 1965 ms. Trace:
I20260709 13:16:30.789196  3198 rpcz_store.cc:276] 0709 13:16:28.758707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.478990 (+1720283us) service_pool.cc:224] Handling call
0709 13:16:30.479293 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.582844 (+103551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.723214 (+140370us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400043dd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:30.723449 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236279040}
I20260709 13:16:30.635753  7643 consensus_queue.cc:1059] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:16:30.629015  7838 consensus_queue.cc:1059] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:16:30.676800  7620 raft_consensus.cc:2764] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:16:30.771526  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:30.793349  3120 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:16:30.794997  3121 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:16:30.780022  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:30.783629  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 165278us
W20260709 13:16:30.784096  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 73023.3us
I20260709 13:16:30.786010  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:30.797147  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:30.798910  3164 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:30.717569  7714 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:30.733860  7766 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:30.784574  7862 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:30.801431  7859 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:30.802091  7809 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.804405  7212 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:30.803887  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 81267.6us
I20260709 13:16:30.805727  7735 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:30.806703  3164 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:30.808882  3091 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:30.818513  3117 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:30.787969  7818 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:30.822979  7788 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:30.847887  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.886103  3197 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:31.124439  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:30.892622  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:30.895893  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:30.898995  3121 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: [11.4-11.4]
W20260709 13:16:31.126765  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.820387  7837 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:30.928478  3118 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:30.878925  3198 pending_rounds.cc:85] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 5
I20260709 13:16:31.152335  3198 pending_rounds.cc:107] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:16:30.999058  7870 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:30.999853  7770 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:31.003295  7809 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:31.005364  7783 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:31.006891  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.173683  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:31.174405  3047 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:31.176819  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:31.078127  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 271477us
I20260709 13:16:31.079151  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:31.182960  3043 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:31.079499  3117 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:31.185628  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:31.186973  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:31.187698  3117 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:31.188700  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:31.095479  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2003) took 2803 ms. Trace:
W20260709 13:16:31.192726  3045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2665) took 1825 ms (client timeout 2148 ms). Trace:
I20260709 13:16:31.193078  3194 rpcz_store.cc:276] 0709 13:16:28.291971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.068815 (+1776844us) service_pool.cc:224] Handling call
0709 13:16:30.069180 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.118007 (+ 48827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.095117 (+977110us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b54002bc0d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:31.095400 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40303872}
W20260709 13:16:31.193346  3045 rpcz_store.cc:269] 0709 13:16:29.367729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.709866 (+342137us) service_pool.cc:224] Handling call
0709 13:16:31.192471 (+1482605us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b54001d74d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:31.192651 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26399616}
I20260709 13:16:31.101675  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:30.918638  3200 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:16:31.141871  3165 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:31.195504  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2661) took 1851 ms. Trace:
I20260709 13:16:31.152637  3198 raft_consensus.cc:2889] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:31.015266  7855 log.cc:927] Time spent T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.848s	user 0.011s	sys 0.016s
I20260709 13:16:31.156599  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:31.201473  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:31.157002  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 348183us
I20260709 13:16:31.203469  3091 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:31.162613  3121 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:31.203974  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:31.205755  3121 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:16:31.206278  3121 pending_rounds.cc:85] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 10
I20260709 13:16:31.206558  3121 pending_rounds.cc:107] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:16:31.206853  3121 raft_consensus.cc:2889] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:31.208039  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 709) took 1117 ms. Trace:
I20260709 13:16:31.163585  3125 raft_consensus.cc:1240] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:31.208441  3195 rpcz_store.cc:276] 0709 13:16:30.090605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.615930 (+525325us) service_pool.cc:224] Handling call
0709 13:16:30.635849 (+ 19919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.686478 (+ 50629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.207757 (+521279us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b5400040bd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:31.207966 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114192128}
W20260709 13:16:31.143890  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.011070  7735 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.985579  7212 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:31.134967  7769 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:31.196050  3046 rpcz_store.cc:276] 0709 13:16:29.344065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.126225 (+782160us) service_pool.cc:224] Handling call
0709 13:16:30.126497 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.376657 (+250160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.195187 (+818530us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54001d7ed4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:31.195432 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570353408}
I20260709 13:16:31.205327  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:31.227345  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.227511  3091 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:16:31.228034  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:31.223901  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 426970us
I20260709 13:16:31.228739  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:31.216370  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:31.230388  3194 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:31.231581  3791 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 13:16:31.231668  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:31.233251  3194 raft_consensus.cc:2393] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:31.235466  3091 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:31.239138  3791 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:16:31.239769  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:31.240181  3797 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:31.241333  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:31.241569  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:31.242230  3793 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:31.244447  3197 raft_consensus.cc:2368] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11.
I20260709 13:16:31.244262  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:31.244890  3049 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:31.151693  7813 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:31.219642  3117 raft_consensus.cc:2955] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 5 to 9, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:31.253301  3049 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:31.256876  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:31.257230  3798 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:31.257694  3799 raft_consensus.cc:2393] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:31.257543  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:31.258448  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:31.174867  7868 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:31.213914  7842 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:31.223181  7817 raft_consensus.cc:2764] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:16:31.226322  7735 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:31.279875  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:31.283470  3049 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:16:31.249383  7724 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.067s	sys 0.122s
I20260709 13:16:31.234972  7212 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:31.243592  7806 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:31.251655  7829 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:31.213725  7551 consensus_queue.cc:1059] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:16:31.252041  7813 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:31.318442  3195 raft_consensus.cc:2368] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13.
I20260709 13:16:31.281984  7859 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:31.306967  3795 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:16:31.273125  7620 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:31.217657  7783 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:31.338929  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:31.348141  3792 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:31.234308  7738 consensus_queue.cc:1059] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:16:31.275538  7769 raft_consensus.cc:697] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:31.339331  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:31.289441  7842 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:31.235160  7882 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
W20260709 13:16:31.326844  7724 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.067s	sys 0.124s
I20260709 13:16:31.259853  7810 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:16:31.363353  3761 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:31.375118  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:31.304862  7858 consensus_queue.cc:1059] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 13:16:31.346462  7558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.036s	sys 0.084s
I20260709 13:16:31.325695  7742 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.326457  7806 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:31.325218  7829 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:31.399554  3761 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:31.399417  3199 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.011s	sys 0.059s
I20260709 13:16:31.411087  7783 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:31.411139  7738 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.411722  7770 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:31.405201  7558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.036s	sys 0.084s
I20260709 13:16:31.375204  7643 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:31.379043  7842 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:31.370132  7551 consensus_queue.cc:1243] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:16:31.426175  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 190775us
W20260709 13:16:31.433180  3191 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.002s	sys 0.022s
I20260709 13:16:31.326009  7719 consensus_queue.cc:1059] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.075s
W20260709 13:16:31.422562  3199 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.011s	sys 0.060s
I20260709 13:16:31.423858  7829 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:31.399546  7744 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:31.456496  3047 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:31.413225  7725 raft_consensus.cc:3055] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:31.446698  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:31.417614  7806 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:31.482329  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2020) took 2095 ms. Trace:
I20260709 13:16:31.455788  7714 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:31.509922  3191 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.002s	sys 0.024s
I20260709 13:16:31.537789  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2419) took 2945 ms. Trace:
W20260709 13:16:31.510376  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 293754us
I20260709 13:16:31.424244  7742 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:31.459570  7643 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:31.454351  7827 consensus_meta.cc:287] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.860s	user 0.000s	sys 0.019s
I20260709 13:16:31.481232  3091 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:31.542848  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:31.514019  7837 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.481382  7887 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:31.547669  3195 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 13: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:31.455027  7738 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:31.487660  7725 raft_consensus.cc:740] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:31.486523  7769 consensus_queue.cc:237] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:31.460227  7809 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:31.561451  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 80330.8us
I20260709 13:16:31.513510  7620 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:31.559589  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 417748us
I20260709 13:16:31.578042  3165 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:31.575019  7837 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:31.579826  3091 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:31.580870  7837 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:31.581589  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2460) took 1183 ms. Trace:
I20260709 13:16:31.581982  7817 raft_consensus.cc:3055] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:31.582352  7717 raft_consensus.cc:3055] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:31.582499  7817 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:31.582909  7717 raft_consensus.cc:740] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:31.583508  7817 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:31.583772  7717 consensus_queue.cc:260] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:31.585089  7717 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:31.558972  7879 log.cc:927] Time spent T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:16:31.585274  7868 raft_consensus.cc:3055] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:31.585772  7868 raft_consensus.cc:740] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:31.585639  7620 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:31.586653  7868 consensus_queue.cc:260] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:31.587342  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.587889  7620 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:31.584734  7817 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:31.595046  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:31.559046  7643 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:31.584687  7725 consensus_queue.cc:260] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:31.595585  3165 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:31.563359  7732 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:31.530396  7558 consensus_queue.cc:1059] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:16:31.485612  3199 rpcz_store.cc:276] 0709 13:16:29.387305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.515738 (+1128433us) service_pool.cc:224] Handling call
0709 13:16:30.516033 (+   295us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:30.600050 (+ 84017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.600088 (+    38us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:16:30.600719 (+   631us) log.cc:844] Serialized 78 byte log entry
0709 13:16:30.646614 (+ 45895us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:31.478858 (+832244us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.479660 (+   802us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.481906 (+  2246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.481987 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.482040 (+    53us) raft_consensus.cc:1685] finished
0709 13:16:31.482053 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.482245 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2315,"prepare.queue_time_us":713920,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":3131,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":5964,"spinlock_wait_cycles":13704320,"thread_start_us":877292,"threads_started":2,"wal-append.queue_time_us":104111}
I20260709 13:16:31.597134  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:31.563500  7827 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:31.598969  3165 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:31.538339  3191 rpcz_store.cc:276] 0709 13:16:28.592592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.444426 (+1851834us) service_pool.cc:224] Handling call
0709 13:16:30.444773 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.493534 (+ 48761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.493569 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:30.494120 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:16:30.712948 (+218828us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:31.537062 (+824114us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.537358 (+   296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.537458 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.537508 (+    50us) raft_consensus.cc:1685] finished
0709 13:16:31.537526 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.537693 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54754,"prepare.queue_time_us":722121,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":61283,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":10411,"thread_start_us":955181,"threads_started":2,"wal-append.queue_time_us":762414}
I20260709 13:16:31.599864  7809 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:31.599882  7822 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:31.600011  7896 consensus_queue.cc:1059] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:31.629292  7770 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:31.587890  7868 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:31.599381  3091 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:31.600999  7725 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:31.602506  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:31.568411  7818 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:31.574065  7719 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:31.611891  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:31.581993  3193 rpcz_store.cc:276] 0709 13:16:30.398520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.651564 (+253044us) service_pool.cc:224] Handling call
0709 13:16:30.651996 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.652486 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.652533 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:30.653121 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:16:30.984311 (+331190us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:31.391411 (+407100us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.391673 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.391774 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.581375 (+189601us) raft_consensus.cc:1685] finished
0709 13:16:31.581396 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.581534 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":502405,"prepare.run_cpu_time_us":7562,"prepare.run_wall_time_us":17096,"raft.queue_time_us":9478,"raft.run_cpu_time_us":375,"raft.run_wall_time_us":39729,"thread_start_us":657406,"threads_started":2,"wal-append.queue_time_us":752135}
W20260709 13:16:31.626312  7886 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:16:31.631086  7770 raft_consensus.cc:697] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:31.632496  3123 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 13. Current term is 14. Ops: []
W20260709 13:16:31.609723  7805 consensus_meta.cc:287] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.932s	user 0.017s	sys 0.000s
I20260709 13:16:31.633891  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:31.598255  7837 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:31.634008  3165 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:31.643877  3091 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:31.637884  3199 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:31.610968  7742 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:31.611402  7558 consensus_queue.cc:1243] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:16:31.643389  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.628563  3015 leader_election.cc:400] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13.
I20260709 13:16:31.645496  3091 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:31.645505  3165 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:31.647809  3015 leader_election.cc:403] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:16:31.642235  7827 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:31.646260  7684 consensus_queue.cc:1059] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:16:31.650142  7640 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:31.611436  7783 consensus_queue.cc:1059] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 13:16:31.638361  7862 consensus_meta.cc:287] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.652s	user 0.011s	sys 0.000s
I20260709 13:16:31.657143  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:31.636832  7822 raft_consensus.cc:697] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:31.660986  3091 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:31.664131  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2102) took 2348 ms. Trace:
I20260709 13:16:31.664489  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:31.664635  3119 rpcz_store.cc:276] 0709 13:16:29.315560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.830920 (+515360us) service_pool.cc:224] Handling call
0709 13:16:29.908070 (+ 77150us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:29.954523 (+ 46453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.663920 (+1709397us) spinlock_profiling.cc:243] Waited 76.7 ms on lock 0x7b540031ae50. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:31.664075 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176449920}
I20260709 13:16:31.647785  7818 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:31.650378  7788 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:31.654642  7827 raft_consensus.cc:2764] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:16:31.652509  7653 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.653218  7719 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13.
I20260709 13:16:31.651149  7724 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:16:31.679587  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 442528us
I20260709 13:16:31.654135  7837 raft_consensus.cc:697] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:31.650106  7663 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:16:31.658358  7684 raft_consensus.cc:3055] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:31.646534  7810 consensus_queue.cc:1059] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:16:31.663698  7783 consensus_queue.cc:1243] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:31.669468  7742 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:30.559978  3122 rpcz_store.cc:276] 0709 13:16:29.181491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.181599 (+   108us) service_pool.cc:224] Handling call
0709 13:16:29.181891 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.182094 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:29.276789 (+ 94695us) log.cc:844] Serialized 14 byte log entry
0709 13:16:30.476049 (+1199260us) spinlock_profiling.cc:243] Waited 7.86 ms on lock 0x7b18004b5e60. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c3455 00007ff833dab3c7 00007ff8303bd9a7 00007ff8303cd0bf 00007ff8303cd038
0709 13:16:30.520310 (+ 44261us) log.cc:844] Serialized 14 byte log entry
0709 13:16:30.532100 (+ 11790us) log.cc:844] Serialized 14 byte log entry
0709 13:16:30.532643 (+   543us) log.cc:844] Serialized 14 byte log entry
0709 13:16:30.532834 (+   191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:30.532879 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:30.532927 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.558953 (+ 26026us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.559077 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25801,"prepare.queue_time_us":209992,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":3740,"raft.queue_time_us":6083,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":10586,"spinlock_wait_cycles":27667200,"thread_start_us":171086,"threads_started":3,"wal-append.queue_time_us":207644,"wal-append.run_cpu_time_us":1423,"wal-append.run_wall_time_us":1005449}
W20260709 13:16:31.683880  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 261773us
I20260709 13:16:31.702041  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:31.709941  7883 consensus_queue.cc:1059] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:31.711071  7883 raft_consensus.cc:3055] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:31.711474  7883 raft_consensus.cc:740] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:31.712371  7883 consensus_queue.cc:260] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:31.633245  7693 raft_consensus.cc:2955] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 5 to 9, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:31.714193  7883 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:31.715759  7877 log.cc:927] Time spent T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 1.025s	user 0.003s	sys 0.000s
I20260709 13:16:31.685564  7684 raft_consensus.cc:740] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:31.717821  7684 consensus_queue.cc:260] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:31.719013  7684 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:31.689772  7896 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:16:31.681872  7895 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.685564  7663 consensus_queue.cc:1243] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:31.685801  7742 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:31.722436  7742 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:31.724007  7719 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:31.724545  7719 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:31.725885  7895 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:31.691825  7827 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:31.727098  7827 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.727449  7827 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:31.728223  7895 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:31.725919  7770 consensus_queue.cc:237] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:31.729359  7822 consensus_queue.cc:237] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:31.684934  7653 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:31.730132  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:31.730746  3195 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:31.731606  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:31.731704  7653 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:31.743425  3199 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:31.744733  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:31.721829  7714 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:16:31.751962  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:31.760979  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:31.737787  7894 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.765677  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:31.769680  3195 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:31.779506  7813 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:31.782128  7719 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:31.785086  7813 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:31.786793  7212 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:31.788242  3051 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 2266) took 1724 ms (client timeout 1858 ms). Trace:
W20260709 13:16:31.788646  3051 rpcz_store.cc:269] 0709 13:16:30.064089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.065048 (+   959us) service_pool.cc:224] Handling call
0709 13:16:31.788058 (+1723010us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b54001aead4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:31.788184 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":912883456}
I20260709 13:16:31.791416  7722 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:31.795555  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:31.795783  3792 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:16:31.796414  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:31.796921  3794 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:31.797030  3790 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:31.795863  3793 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:16:31.797835  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.799019  3797 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:31.767968  7904 raft_consensus.cc:2764] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:16:31.763547  7902 raft_consensus.cc:3055] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:31.802513  7902 raft_consensus.cc:740] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:31.732527  7224 consensus_queue.cc:1059] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:16:31.803673  7902 consensus_queue.cc:260] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:31.805117  7224 raft_consensus.cc:3055] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:31.705526  7888 consensus_queue.cc:1059] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:16:31.789254  7212 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:31.810488  3090 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:31.818149  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:31.812171  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:31.816180  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:31.887249  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:31.888036  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.888494  3048 raft_consensus.cc:2410] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:16:31.817087  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:31.891536  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:31.891037  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 80640.5us
W20260709 13:16:31.902690  3762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.125s	user 0.019s	sys 0.012s
W20260709 13:16:31.910027  3762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.152s	user 0.020s	sys 0.012s
I20260709 13:16:31.908617  3051 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:31.909359  3049 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:16:31.913584  3195 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:16:31.915014  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:31.910480  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 1.15283e+06us
W20260709 13:16:31.919493  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 258584us
W20260709 13:16:31.927140  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:31.924815  3117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.009s	sys 0.025s
W20260709 13:16:31.927800  3117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.009s	sys 0.025s
I20260709 13:16:31.927588  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:31.929080  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:31.932564  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:16:31.935307  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 270885us
I20260709 13:16:31.805598  7902 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:31.747044  7837 consensus_queue.cc:237] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:31.936277  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:31.938549  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:31.947171  3125 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:31.948523  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:31.949259  3125 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:31.963805  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.939855  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:31.940958  3015 leader_election.cc:400] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13.
I20260709 13:16:31.892867  7868 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.805632  7224 raft_consensus.cc:740] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:31.919241  7862 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:16:31.988984  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 48167.5us
W20260709 13:16:31.995981  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 288645us
I20260709 13:16:32.024420  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:31.918938  7901 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:32.028501  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:32.029981  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:32.030414  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:32.033047  3199 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:31.935914  7813 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.042740  3090 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:32.044137  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:32.045217  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:32.050275  3049 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:31.772389  7894 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.054337  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:32.054868  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:32.058044  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.058609  3199 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:32.059991  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:32.062013  3125 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:16:32.062269  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:32.065095  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:32.098541  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 55900.4us
I20260709 13:16:32.053973  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:32.035153  7788 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:32.039987  7738 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:32.059533  7901 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.058025  7813 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.103912  7717 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:32.104926  7714 raft_consensus.cc:3055] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:16:32.105669  7903 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:16:32.146981  7910 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.098241  7722 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:32.106348  7898 log.cc:927] Time spent T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:16:32.099072  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:32.064397  7908 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:32.110575  7640 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:31.936134  7212 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 13:16:32.113978  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:32.338188  3123 raft_consensus.cc:2410] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:16:32.339111  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:32.119025  3049 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:16:32.339798  3049 pending_rounds.cc:85] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 10
I20260709 13:16:32.340066  3049 pending_rounds.cc:107] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:16:32.340332  3049 raft_consensus.cc:2889] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:32.341677  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:32.342307  3049 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:32.343431  3049 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:32.336139  7908 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:32.128749  3193 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:32.034782  7620 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:32.345072  7908 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:32.345376  7620 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:32.346316  7907 log.cc:927] Time spent T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:16:32.346973  7744 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:32.347616  7744 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.348207  7620 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:32.061897  7904 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:32.348948  7904 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.349380  7904 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:32.350739  7643 consensus_meta.cc:287] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.726s	user 0.007s	sys 0.003s
I20260709 13:16:32.351190  7643 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.352373  3798 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:31.941577  7842 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.353387  7643 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:32.023209  7827 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.126331  7906 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.026635  7868 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:32.150502  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 225029us
I20260709 13:16:32.062893  3117 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:32.161535  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 345383us
W20260709 13:16:32.164517  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.132395  7897 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:16:32.168466  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 114532us
I20260709 13:16:32.106308  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:32.147009  7693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60218 (request call id 6) took 6261 ms. Trace:
I20260709 13:16:32.148357  7653 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.378713  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:32.379124  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2036) took 1018 ms. Trace:
I20260709 13:16:32.217809  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:32.273566  7883 consensus_meta.cc:287] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.001s
I20260709 13:16:32.171662  7788 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.219604  7722 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:32.228081  7809 consensus_meta.cc:287] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.000s
W20260709 13:16:32.225538  7766 consensus_meta.cc:287] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.236s	user 0.007s	sys 0.005s
I20260709 13:16:32.153762  7810 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.206079  7505 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:32.232059  7735 consensus_meta.cc:287] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.896s	user 0.011s	sys 0.000s
W20260709 13:16:32.276544  7684 consensus_meta.cc:287] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
I20260709 13:16:32.205492  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2139) took 1049 ms. Trace:
I20260709 13:16:32.395884  3118 rpcz_store.cc:276] 0709 13:16:31.160675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.160866 (+   191us) service_pool.cc:224] Handling call
0709 13:16:31.161266 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.225183 (+ 63917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.225227 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.243477 (+ 18250us) log.cc:844] Serialized 26 byte log entry
0709 13:16:31.646592 (+403115us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:31.647061 (+   469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.647148 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.205226 (+558078us) raft_consensus.cc:1685] finished
0709 13:16:32.205249 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.205423 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63498,"raft.queue_time_us":63971,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":15400,"thread_start_us":316192,"threads_started":1,"wal-append.queue_time_us":476485}
I20260709 13:16:32.389415  7722 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:32.224202  7725 consensus_meta.cc:287] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.588s	user 0.007s	sys 0.000s
I20260709 13:16:32.149513  7224 consensus_queue.cc:260] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.251137  3046 pending_rounds.cc:85] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 9
I20260709 13:16:32.416106  3046 pending_rounds.cc:107] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:16:32.416427  3046 raft_consensus.cc:2889] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:32.278456  7770 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:32.298434  7817 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.706s	user 0.003s	sys 0.007s
I20260709 13:16:32.173198  7738 raft_consensus.cc:2764] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:16:32.234995  3124 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:32.425597  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2133) took 1691 ms. Trace:
I20260709 13:16:32.390064  7897 raft_consensus.cc:697] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:32.270079  7724 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:32.199470  7900 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:16:32.177596  3125 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:32.384511  7906 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.175028  7717 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.177752  7910 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.211416  7901 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:32.222925  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2691) took 1650 ms. Trace:
W20260709 13:16:32.215736  7818 consensus_meta.cc:287] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.542s	user 0.004s	sys 0.004s
I20260709 13:16:32.169970  7714 raft_consensus.cc:740] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:32.397975  7922 consensus_queue.cc:1059] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:16:32.319226  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2453) took 2247 ms. Trace:
W20260709 13:16:32.331692  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.311801  7902 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.205840  7887 raft_consensus.cc:3055] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:32.216172  7859 raft_consensus.cc:3055] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:32.485850  7906 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:32.486294  7859 raft_consensus.cc:740] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:32.384153  7693 rpcz_store.cc:276] 0709 13:16:25.880279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.880453 (+   174us) service_pool.cc:224] Handling call
0709 13:16:26.100946 (+220493us) log.cc:844] Serialized 501 byte log entry
0709 13:16:32.141502 (+6040556us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58237,"raft.queue_time_us":42268,"raft.run_cpu_time_us":1648,"raft.run_wall_time_us":54317,"thread_start_us":169291,"threads_started":2,"wal-append.queue_time_us":206335,"wal-append.run_cpu_time_us":3197,"wal-append.run_wall_time_us":1056431}
I20260709 13:16:32.487289  7859 consensus_queue.cc:260] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.488726  7859 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:32.289572  7894 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:32.489352  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0ee6c4dbcb7b45729d4e2bdcc3a09297 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 7)
I20260709 13:16:32.151316  7742 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.424918  7770 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.491638  7742 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:32.207333  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:32.196811  7663 raft_consensus.cc:3055] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:32.492669  7770 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:32.492820  7663 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:32.208572  3042 consensus_queue.cc:260] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.200167  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:32.493868  7897 consensus_queue.cc:237] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.492667  3045 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 12: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:32.233096  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:32.498059  7663 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.498610  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:32.499312  3119 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:32.499461  7663 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:32.499908  7827 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:32.500254  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:32.236469  7618 raft_consensus.cc:993] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: : Instructing follower aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:16:32.501212  7618 raft_consensus.cc:1081] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Signalling peer aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:16:32.501227  7714 consensus_queue.cc:260] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.298760  7916 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:32.502759  7714 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:32.502662  7916 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.503928  3042 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:32.504936  7916 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:32.471220  7887 raft_consensus.cc:740] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:16:32.292580  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.216001  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:32.506207  3048 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:32.293159  7551 raft_consensus.cc:3055] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:32.506930  7551 raft_consensus.cc:740] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:32.506052  7887 consensus_queue.cc:260] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.508181  7887 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:32.507855  7551 consensus_queue.cc:260] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.509016  7551 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:32.277386  7890 log.cc:927] Time spent T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.743s	user 0.002s	sys 0.009s
I20260709 13:16:32.290707  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:32.510990  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2027) took 1339 ms. Trace:
I20260709 13:16:32.511320  3194 rpcz_store.cc:276] 0709 13:16:31.179884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.242008 (+ 62124us) service_pool.cc:224] Handling call
0709 13:16:32.290560 (+1048552us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5800136e98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28eeee 0000000000375939 00007ff8353021e0 00007ff8353cb0c4 00007ff8353cb131 00007ff8353790a0 00007ff835378984 00007ff82e8f36d4 00007ff82e8f3662
0709 13:16:32.510930 (+220370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27907840}
I20260709 13:16:32.512528  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:32.216810  3091 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:32.513615  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 296873us
I20260709 13:16:32.488727  7693 raft_consensus.cc:3055] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:32.514679  7693 raft_consensus.cc:740] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:32.515074  7212 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:32.515676  7212 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:32.515862  7693 consensus_queue.cc:260] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.291076  7896 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.333328  3165 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:16:32.518246  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 185001us
I20260709 13:16:32.519021  7927 consensus_queue.cc:1059] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:32.519640  3165 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:32.520360  7212 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:32.520649  3165 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:32.344466  3049 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:32.521581  3091 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:32.522432  7858 raft_consensus.cc:3055] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:32.522486  7640 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:32.522946  7858 raft_consensus.cc:740] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:32.523847  7858 consensus_queue.cc:260] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.525130  7858 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:32.205690  7806 consensus_meta.cc:287] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.670s	user 0.004s	sys 0.007s
I20260709 13:16:32.354656  7842 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:32.037956  7895 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.354305  7908 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.518266  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:32.526321  7895 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.527259  3795 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:32.527786  7908 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:32.355614  7620 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.528064  7902 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:32.311391  7829 consensus_meta.cc:287] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.823s	user 0.011s	sys 0.000s
I20260709 13:16:32.380098  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:32.526084  7806 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.438745  7224 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:32.379714  3192 rpcz_store.cc:276] 0709 13:16:31.361182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.106031 (+744849us) service_pool.cc:224] Handling call
0709 13:16:32.379031 (+273000us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.531025  3192 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:32.378214  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.388458  7868 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:32.388531  7788 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:32.389079  7718 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:32.362655  7862 raft_consensus.cc:697] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:32.390810  3200 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:32.370487  7744 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:32.386318  7719 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:32.390086  7653 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.379020  7904 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.215409  7813 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:32.398648  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:32.529023  7829 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.415092  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2039) took 1039 ms. Trace:
I20260709 13:16:32.587627  3193 rpcz_store.cc:276] 0709 13:16:31.375359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.642856 (+267497us) service_pool.cc:224] Handling call
0709 13:16:32.414850 (+771994us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b5400036e54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:32.415012 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":979326336}
W20260709 13:16:32.418035  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.426005  3124 rpcz_store.cc:276] 0709 13:16:30.733851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.767273 (+ 33422us) service_pool.cc:224] Handling call
0709 13:16:32.234491 (+1467218us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b5800003398. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff83538cfc0 00007ff835377929 00007ff8353773d2 00007ff82e8eebd4
0709 13:16:32.234672 (+   181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.425302 (+190630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.425538 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3911552}
I20260709 13:16:32.226886  7732 raft_consensus.cc:3055] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:32.395521  7809 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:32.398322  7766 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:32.430382  3051 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:16:32.632565  3051 pending_rounds.cc:85] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 10
I20260709 13:16:32.579869  7693 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:32.207091  7899 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:16:32.389997  7643 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:16:32.416011  7505 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.330016  7925 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:32.443188  3043 rpcz_store.cc:276] 0709 13:16:30.572045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.234410 (+662365us) service_pool.cc:224] Handling call
0709 13:16:31.257163 (+ 22753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.377669 (+120506us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:31.544637 (+166968us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.906072 (+361435us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:31.906160 (+    88us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:31.906229 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.221900 (+315671us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b18003f9d00. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2942a6 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419
0709 13:16:32.222649 (+   749us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540004a1d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:32.222694 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.222855 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":220771,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":119,"raft.run_cpu_time_us":749,"raft.run_wall_time_us":11696,"spinlock_wait_cycles":306893952,"thread_start_us":527207,"threads_started":2,"wal-append.queue_time_us":600431}
I20260709 13:16:32.585114  7827 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:16:32.449574  3196 rpcz_store.cc:276] 0709 13:16:30.072228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.267030 (+194802us) service_pool.cc:224] Handling call
0709 13:16:32.318889 (+2051859us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002bc5d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:32.319125 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2573419776}
I20260709 13:16:32.663951  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:32.400621  7810 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.400293  7735 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.422243  7558 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:16:32.475379  2944 catalog_manager.cc:5697] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 8 to 11, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 11 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.476701  7922 raft_consensus.cc:3055] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:32.449168  7818 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:32.689548  3119 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:32.482337  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 744) took 1320 ms. Trace:
I20260709 13:16:32.482329  3199 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:32.483708  7717 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:32.494397  3191 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:32.238022  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 2114) took 1617 ms. Trace:
I20260709 13:16:32.693671  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2022) took 1576 ms. Trace:
I20260709 13:16:32.693768  3126 rpcz_store.cc:276] 0709 13:16:30.620515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.620649 (+   134us) service_pool.cc:224] Handling call
0709 13:16:32.237849 (+1617200us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400301bd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:32.237962 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281906048}
I20260709 13:16:32.694308  3191 rpcz_store.cc:276] 0709 13:16:31.117310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.199840 (+1082530us) service_pool.cc:224] Handling call
0709 13:16:32.693599 (+493759us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.237406  7743 raft_consensus.cc:3055] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:32.198282  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2025) took 1076 ms. Trace:
I20260709 13:16:32.520781  7212 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:32.528448  7895 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:32.144512  3044 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:16:32.528586  7620 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.674576  7922 raft_consensus.cc:740] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:32.381196  3762 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:32.532979  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 197799us
I20260709 13:16:32.538512  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2464) took 1894 ms. Trace:
I20260709 13:16:32.517045  7896 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:32.573904  3200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2030) took 1393 ms (client timeout 1736 ms). Trace:
I20260709 13:16:32.575320  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:32.576256  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:32.498637  7910 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:32.579949  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:32.715080  3200 rpcz_store.cc:269] 0709 13:16:31.180825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.202402 (+ 21577us) service_pool.cc:224] Handling call
0709 13:16:32.217618 (+1015216us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b5800136e98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff8353790a0 00007ff835378984 00007ff82e8f36d4 00007ff82e8f3662
0709 13:16:32.573710 (+356092us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b540002b2d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:32.573845 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77706880}
I20260709 13:16:32.718284  3796 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:32.580176  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:32.412475  3117 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:32.581457  7927 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:32.583671  7868 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:32.721036  3117 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:32.590461  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:32.549897  7894 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:32.549541  7842 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:32.696704  7717 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.567804  7722 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:32.616638  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:32.622534  3194 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:16:32.625995  7897 consensus_queue.cc:1059] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:32.626200  7862 consensus_queue.cc:237] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.550356  7926 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:32.399585  7783 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.438318  7724 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.634119  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:32.520310  7915 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:16:32.574721  7770 consensus_queue.cc:1059] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:16:32.585259  7719 raft_consensus.cc:697] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:32.741005  7926 raft_consensus.cc:697] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:32.741641  7719 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.743320  7724 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:32.651296  7902 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:32.667961  7505 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.743937  7770 consensus_queue.cc:1243] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:32.650259  7925 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.744959  7770 raft_consensus.cc:3055] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:32.746147  7505 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:32.746552  7925 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:32.685242  7735 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:32.686126  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:32.747336  7922 consensus_queue.cc:260] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.748747  7922 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:32.683187  7653 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:32.637437  7732 raft_consensus.cc:740] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:32.699496  7212 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.754953  7212 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:32.713267  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 332177us
I20260709 13:16:32.756631  3762 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:32.758488  3762 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:32.715970  3798 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:32.698654  7743 raft_consensus.cc:740] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:32.714902  7908 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:32.728689  7722 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.736766  7620 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:32.732792  7842 raft_consensus.cc:697] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:32.725843  7894 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.739732  7783 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.742494  7926 consensus_queue.cc:237] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.687323  7810 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:32.764232  7732 consensus_queue.cc:260] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.745492  7770 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:32.774250  7829 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:32.774382  7743 consensus_queue.cc:260] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.776698  7896 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:32.722361  7895 consensus_queue.cc:1059] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:16:32.797163  7806 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:32.797978  7904 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:32.674536  2944 catalog_manager.cc:5697] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 2 to 8, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:32.911947  7769 raft_consensus.cc:3055] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:32.912638  7769 raft_consensus.cc:740] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:16:32.914183  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.614004  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.915848  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.529527  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 149503us
W20260709 13:16:32.586753  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.565637  3042 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:16:32.921777  3042 pending_rounds.cc:85] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 7
I20260709 13:16:32.922210  3042 pending_rounds.cc:107] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:16:32.922646  3042 raft_consensus.cc:2889] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:32.924062  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2285) took 2398 ms. Trace:
I20260709 13:16:32.924418  3042 rpcz_store.cc:276] 0709 13:16:30.526175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.615475 (+ 89300us) service_pool.cc:224] Handling call
0709 13:16:30.615800 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.208230 (+1592430us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b540016d8a0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83033106f 00007ff8303a9f60 00007ff8303ab7de 00007ff8303b5b49 00007ff8303b6416 00007ff8303b2d8f 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62
0709 13:16:32.503470 (+295240us) spinlock_profiling.cc:243] Waited 7.93 ms on lock 0x7b58003b63d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83030f0aa 00007ff830391447 00007ff8303a9fe7 00007ff8303ab7de 00007ff8303b5b49 00007ff8303b6416 00007ff8303b2d8f 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4
0709 13:16:32.923576 (+420106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.923983 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409128192}
I20260709 13:16:32.920926  7719 consensus_queue.cc:1059] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 9.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:32.676752  3090 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:32.840337  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.550901  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:32.928220  3045 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
W20260709 13:16:32.928411  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 251569us
I20260709 13:16:32.620527  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:32.930967  3046 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 15: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:32.932277  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:32.932394  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:32.546593  3048 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:16:32.840919  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:32.932709  2944 catalog_manager.cc:5697] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.557817  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:32.935269  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:32.936331  3044 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:32.935835  3047 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:32.698124  3050 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:32.938045  7838 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:16:32.632905  3051 pending_rounds.cc:107] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:16:32.724290  3118 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16. Ops: [14.7-15.8]
I20260709 13:16:32.723289  3119 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:32.690457  3120 rpcz_store.cc:276] 0709 13:16:31.162340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.164217 (+  1877us) service_pool.cc:224] Handling call
0709 13:16:31.164585 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.225469 (+ 60884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.225498 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.243706 (+ 18208us) log.cc:844] Serialized 26 byte log entry
0709 13:16:31.620870 (+377164us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:31.620932 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.621035 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.482097 (+861062us) raft_consensus.cc:1685] finished
0709 13:16:32.482119 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.482271 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60512,"raft.queue_time_us":61174,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":38782,"thread_start_us":306364,"threads_started":1,"wal-append.queue_time_us":660459}
I20260709 13:16:32.950600  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:32.716662  3122 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:32.344466  3121 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:32.843751  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:32.954346  7663 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:32.955497  3049 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 12: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:32.844101  3123 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:32.448587  3125 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:32.956600  7926 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:32.958318  7640 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:32.600256  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.960244  3048 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:32.960951  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2213) took 1033 ms. Trace:
W20260709 13:16:32.643296  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 121771us
I20260709 13:16:32.961467  3122 rpcz_store.cc:276] 0709 13:16:31.927184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.927312 (+   128us) service_pool.cc:224] Handling call
0709 13:16:32.960562 (+1033250us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b5400302ad4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:32.960763 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1687169920}
I20260709 13:16:32.964406  3126 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:16:32.964882  7822 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.724803  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:32.966540  3191 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:32.967499  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2215) took 1036 ms. Trace:
I20260709 13:16:32.968031  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:32.967979  3121 rpcz_store.cc:276] 0709 13:16:31.931084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.932247 (+  1163us) service_pool.cc:224] Handling call
0709 13:16:32.967074 (+1034827us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54003921d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:32.967284 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927203584}
I20260709 13:16:32.969197  3191 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:32.717769  3164 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:32.862836  3193 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:32.970084  7806 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:32.970969  7806 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:32.971549  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 253769us
I20260709 13:16:32.972759  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:32.862703  3200 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:32.974318  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2467) took 2328 ms. Trace:
I20260709 13:16:32.732416  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2042) took 1356 ms. Trace:
I20260709 13:16:32.974965  7806 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:32.975449  3194 rpcz_store.cc:276] 0709 13:16:31.376143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.512269 (+1136126us) service_pool.cc:224] Handling call
0709 13:16:32.732282 (+220013us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b540013c4d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:32.732370 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251732224}
W20260709 13:16:32.976656  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.698812  3197 rpcz_store.cc:276] 0709 13:16:31.121536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.156297 (+ 34761us) service_pool.cc:224] Handling call
0709 13:16:32.198075 (+1041778us) spinlock_profiling.cc:243] Waited 42.9 ms on lock 0x7b5400178254. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:32.198223 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98616576}
W20260709 13:16:32.863677  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.770478  3797 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:32.865104  3798 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:32.713052  3192 rpcz_store.cc:276] 0709 13:16:30.644328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.530579 (+1886251us) service_pool.cc:224] Handling call
0709 13:16:32.530860 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.538242 (+  7382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.538454 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.685366  3195 raft_consensus.cc:2368] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12.
I20260709 13:16:32.667131  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:32.868031  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2462) took 2446 ms. Trace:
I20260709 13:16:32.723387  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2049) took 1063 ms. Trace:
I20260709 13:16:32.982101  7558 raft_consensus.cc:2764] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:16:32.982568  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:32.982679  3199 rpcz_store.cc:276] 0709 13:16:31.660514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.059271 (+398757us) service_pool.cc:224] Handling call
0709 13:16:32.723224 (+663953us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b540013b0d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:32.723331 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":729627520}
I20260709 13:16:32.984119  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:32.984901  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.892093  7620 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.986073  3197 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:32.987010  3191 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:32.974694  3200 rpcz_store.cc:276] 0709 13:16:30.645477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.726420 (+2080943us) service_pool.cc:224] Handling call
0709 13:16:32.735302 (+  8882us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.973957 (+238655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.974241 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.987970  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 715) took 2341 ms. Trace:
W20260709 13:16:32.988832  3195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2040) took 1613 ms (client timeout 2102 ms). Trace:
I20260709 13:16:32.766433  7643 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:16:32.894833  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.731339  7717 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.902872  7732 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:32.903785  7743 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:32.904923  7783 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:32.989691  7709 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:32.995396  7709 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:32.977221  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:32.990785  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.904995  7714 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.770829  7722 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:32.786257  7894 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:32.794432  7842 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.996317  7620 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.794885  7770 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:32.685855  2949 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57744 (request call id 242) took 34668 ms (client timeout 15000 ms). Trace:
I20260709 13:16:32.914559  7769 consensus_queue.cc:260] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:32.651372  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:33.027140  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:33.016538  7806 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.996539  7822 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:33.029345  7806 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:32.926728  7719 raft_consensus.cc:3055] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:32.926833  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:32.938577  3047 pending_rounds.cc:85] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 6
I20260709 13:16:32.943512  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:32.948203  3051 raft_consensus.cc:2889] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:32.979552  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.984371  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:32.870820  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 112290us
I20260709 13:16:32.984000  3050 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:16:32.987059  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 714) took 2341 ms. Trace:
W20260709 13:16:33.000097  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 79393.9us
I20260709 13:16:32.988413  3191 rpcz_store.cc:276] 0709 13:16:30.646353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.985729 (+2339376us) service_pool.cc:224] Handling call
0709 13:16:32.986248 (+   519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.987703 (+  1455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.987880 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:32.989423  3195 rpcz_store.cc:269] 0709 13:16:31.375620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.914658 (+539038us) service_pool.cc:224] Handling call
0709 13:16:32.988425 (+1073767us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b54001dea54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:32.988617 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1769201536}
I20260709 13:16:33.004798  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:33.014007  3194 raft_consensus.cc:2410] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 14 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:32.988312  7684 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.090268  7684 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:33.009616  7620 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:33.024746  7770 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:33.093940  3199 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
W20260709 13:16:33.094599  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 84351.1us
I20260709 13:16:33.095955  3199 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:33.095361  2944 catalog_manager.cc:5697] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.096747  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2046) took 1442 ms. Trace:
I20260709 13:16:33.097877  7684 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:33.098039  3165 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:33.098842  3195 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:33.099040  7620 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:33.099606  7620 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:33.068456  3047 pending_rounds.cc:107] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:16:33.068598  3197 rpcz_store.cc:276] 0709 13:16:30.646034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.978479 (+2332445us) service_pool.cc:224] Handling call
0709 13:16:32.985362 (+  6883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.986680 (+  1318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.986963 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.100472  3165 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:33.101686  3197 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:16:33.102139  7895 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:33.102449  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2047) took 1447 ms. Trace:
I20260709 13:16:33.102608  7895 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:32.982221  3198 rpcz_store.cc:276] 0709 13:16:30.421394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.823997 (+402603us) service_pool.cc:224] Handling call
0709 13:16:30.878610 (+ 54613us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:31.218081 (+339471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.218129 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:31.218917 (+   788us) log.cc:844] Serialized 52 byte log entry
0709 13:16:31.667394 (+448477us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:31.680713 (+ 13319us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.698697 (+ 17984us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.700539 (+  1842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.700662 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.225152 (+524490us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b18004586e0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:16:32.230300 (+  5148us) spinlock_profiling.cc:243] Waited 9.02 ms on lock 0x7b18004586e0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:16:32.867193 (+636893us) raft_consensus.cc:1685] finished
0709 13:16:32.867268 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.867710 (+   442us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53009,"prepare.queue_time_us":48413,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":89,"raft.queue_time_us":92028,"raft.run_cpu_time_us":411,"raft.run_wall_time_us":36587,"spinlock_wait_cycles":75583104,"thread_start_us":380641,"threads_started":1,"wal-append.queue_time_us":666371}
I20260709 13:16:33.077338  7838 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:33.102891  3197 rpcz_store.cc:276] 0709 13:16:31.654861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.100870 (+1446009us) service_pool.cc:224] Handling call
0709 13:16:33.101254 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.102179 (+   925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.102393 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.100270  7926 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:16:33.100461  3047 raft_consensus.cc:2889] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:33.103060  7895 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:33.107008  7717 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:33.108347  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2471) took 1420 ms. Trace:
W20260709 13:16:33.108618  7858 consensus_meta.cc:287] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.583s	user 0.005s	sys 0.012s
I20260709 13:16:33.108856  3198 rpcz_store.cc:276] 0709 13:16:31.688075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.107156 (+1419081us) service_pool.cc:224] Handling call
0709 13:16:33.107608 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.107939 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.107968 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:33.108040 (+    72us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:33.108091 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.108149 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.108287 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.115034  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2470) took 2123 ms. Trace:
I20260709 13:16:33.115234  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:33.115482  3196 rpcz_store.cc:276] 0709 13:16:30.991029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.019518 (+2028489us) service_pool.cc:224] Handling call
0709 13:16:33.114125 (+ 94607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.114572 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.114598 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:33.114657 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:33.114698 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.114750 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.114854 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.079375  3191 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:33.116569  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:33.116997  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2023) took 1999 ms. Trace:
I20260709 13:16:33.117357  3191 rpcz_store.cc:276] 0709 13:16:31.120931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.078200 (+1957269us) service_pool.cc:224] Handling call
0709 13:16:33.078775 (+   575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.116708 (+ 37933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.116911 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.071878  7719 raft_consensus.cc:740] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:33.119169  3191 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:33.030346  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:33.082499  7922 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:16:33.119834  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 107052us
W20260709 13:16:33.120121  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.083513  3194 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:33.031886  7827 raft_consensus.cc:3055] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:33.083369  3045 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:33.121133  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2038) took 1746 ms. Trace:
W20260709 13:16:33.121896  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.086108  7769 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:33.123593  7822 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:33.121634  3194 rpcz_store.cc:276] 0709 13:16:31.375088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.082561 (+1707473us) service_pool.cc:224] Handling call
0709 13:16:33.083143 (+   582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.120896 (+ 37753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.121085 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.125875  3194 raft_consensus.cc:1275] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:16:33.081087  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 103547us
W20260709 13:16:33.126206  7551 consensus_meta.cc:287] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.015s
I20260709 13:16:33.126482  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2477) took 1244 ms. Trace:
W20260709 13:16:33.104799  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.128618  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:33.104403  7558 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:33.129778  3126 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:16:33.130275  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:33.131847  7640 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:33.128672  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:33.130067  7558 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:33.136773  3797 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:33.120687  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:33.137988  7558 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:33.100175  7620 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:33.139992  3164 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:33.140590  7838 raft_consensus.cc:3055] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:33.141078  7838 raft_consensus.cc:740] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:16:33.141474  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 43854.4us
W20260709 13:16:33.142204  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.103008  7709 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:33.142469  3164 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:33.119835  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2475) took 1331 ms. Trace:
I20260709 13:16:33.143667  3191 rpcz_store.cc:276] 0709 13:16:31.788352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.118495 (+1330143us) service_pool.cc:224] Handling call
0709 13:16:33.118894 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.119562 (+   668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.119764 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.142241  7838 consensus_queue.cc:260] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:33.146713  7838 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:33.119372  7719 consensus_queue.cc:260] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:33.126979  3046 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:33.138074  7212 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:33.097146  3199 rpcz_store.cc:276] 0709 13:16:31.654539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.095010 (+1440471us) service_pool.cc:224] Handling call
0709 13:16:33.095620 (+   610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.096416 (+   796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.096650 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.086993  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:33.152382  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:33.153046  3042 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:33.033372  7714 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:33.085557  7806 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:33.155753  7714 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:33.088191  3049 pending_rounds.cc:85] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 5
I20260709 13:16:33.099637  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2032) took 1913 ms. Trace:
W20260709 13:16:33.078119  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.156572  3195 rpcz_store.cc:276] 0709 13:16:31.185974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.079933 (+1893959us) service_pool.cc:224] Handling call
0709 13:16:33.098369 (+ 18436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.099325 (+   956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.099560 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.157166  3044 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:33.121001  7827 raft_consensus.cc:740] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:33.157704  7783 raft_consensus.cc:2764] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:16:33.157730  7859 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.159823  7859 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:33.156297  3049 pending_rounds.cc:107] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:16:33.160774  3049 raft_consensus.cc:2889] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:33.153054  7812 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:33.161914  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:33.162731  3195 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:33.163741  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:33.164502  3195 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:33.166404  3197 raft_consensus.cc:1240] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:33.158743  7827 consensus_queue.cc:260] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:33.111344  2944 catalog_manager.cc:5697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.117357  3196 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:16:33.165642  3798 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:33.126925  3194 rpcz_store.cc:276] 0709 13:16:31.881949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.124939 (+1242990us) service_pool.cc:224] Handling call
0709 13:16:33.125393 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.126251 (+   858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.126434 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.029611  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:33.178598  3797 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:33.167647  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2472) took 1479 ms. Trace:
I20260709 13:16:33.182550  3198 rpcz_store.cc:276] 0709 13:16:31.688420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.115478 (+1427058us) service_pool.cc:224] Handling call
0709 13:16:33.115842 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.116097 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.116126 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:33.167407 (+ 51281us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:33.167444 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.167506 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.167601 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.184513  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:33.186180  3193 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
W20260709 13:16:33.105461  7224 consensus_meta.cc:287] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.012s
I20260709 13:16:33.183908  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2473) took 1495 ms. Trace:
I20260709 13:16:33.130002  7663 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:33.152467  7212 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:16:33.191604  3196 rpcz_store.cc:276] 0709 13:16:31.688716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.116572 (+1427856us) service_pool.cc:224] Handling call
0709 13:16:33.116909 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.170999 (+ 54090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.183847 (+ 12848us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.184939  7709 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:33.201563  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.228235  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:33.235662  3122 raft_consensus.cc:2410] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:16:33.238986  3121 raft_consensus.cc:1240] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:33.241703  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:33.242339  3195 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 13:16:33.242780  3125 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:33.243877  3195 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:33.251987  3798 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:33.252900  3798 raft_consensus.cc:606] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:33.253297  3798 raft_consensus.cc:614] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:33.254877  3043 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:33.255879  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:33.256930  3043 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:33.257315  7894 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:33.258175  3197 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:33.259541  7894 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:33.265789  7859 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:33.033964  2949 rpcz_store.cc:269] 0709 13:15:58.007252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.024363 (+ 17111us) service_pool.cc:224] Handling call
0709 13:16:32.675431 (+34651068us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:24.970073 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:24.970884 (+   811us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:24.970932 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:16:24.970951 (+    19us) tablet.cc:662] Decoding operations
0709 13:16:25.013534 (+ 42583us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:25.213811 (+200277us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:25.213852 (+    41us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:16:25.418214 (+204362us) tablet.cc:701] Row locks acquired
0709 13:16:25.436635 (+ 18421us) write_op.cc:260] PREPARE: finished
0709 13:16:25.476265 (+ 39630us) write_op.cc:270] Start()
0709 13:16:25.523091 (+ 46826us) write_op.cc:276] Timestamp: P: 1783602985453952 usec, L: 0
0709 13:16:25.536257 (+ 13166us) op_driver.cc:348] REPLICATION: starting
0709 13:16:25.649829 (+113572us) log.cc:844] Serialized 6331 byte log entry
0709 13:16:27.816400 (+2166571us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:28.532483 (+716083us) op_driver.cc:464] REPLICATION: finished
0709 13:16:28.799098 (+266615us) write_op.cc:301] APPLY: starting
0709 13:16:28.799203 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:29.394676 (+595473us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:29.404302 (+  9626us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:30.079549 (+675247us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:30.079973 (+   424us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 13:16:30.080048 (+    75us) write_op.cc:312] APPLY: finished
0709 13:16:30.080517 (+   469us) log.cc:844] Serialized 139 byte log entry
0709 13:16:30.290861 (+210344us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:30.301212 (+ 10351us) write_op.cc:454] Released schema lock
0709 13:16:30.309353 (+  8141us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:30.342051 (+ 32698us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:30.343012 (+   961us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3381609,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":232200,"apply.run_cpu_time_us":53292,"apply.run_wall_time_us":1535422,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66857,"num_ops":15,"prepare.queue_time_us":97981,"prepare.run_cpu_time_us":39259,"prepare.run_wall_time_us":819461,"raft.queue_time_us":441206,"raft.run_cpu_time_us":16029,"raft.run_wall_time_us":334807,"replication_time_us":2878140,"spinlock_wait_cycles":10076416,"thread_start_us":647737,"threads_started":5,"wal-append.queue_time_us":345797,"wal-append.run_cpu_time_us":57130,"wal-append.run_wall_time_us":4421156}]]}
I20260709 13:16:33.230013  7822 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:33.270054  7859 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.270762  7859 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:33.273080  7859 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:33.272868  7895 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:33.274338  7719 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:33.279871  7558 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:16:33.282791  3015 connection.cc:256] RPC call timeout handler was delayed by -1.4464251659999263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1736s for a response
W20260709 13:16:33.283380  3015 connection.cc:256] RPC call timeout handler was delayed by -1.4059251659998608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
W20260709 13:16:33.284330  3015 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.132:43109 timed out after 1.589s (SENT) [suppressed 34 similar messages]
I20260709 13:16:33.285112  3192 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:33.301251  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2469) took 2310 ms. Trace:
I20260709 13:16:33.302047  7640 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.302639  7640 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:33.301658  3192 rpcz_store.cc:276] 0709 13:16:30.990739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.006411 (+2015672us) service_pool.cc:224] Handling call
0709 13:16:33.284935 (+278524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.300260 (+ 15325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.301001 (+   741us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b5400036950. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:33.301154 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":639459712}
I20260709 13:16:33.304628  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:33.305392  3192 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:33.290141  7858 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:33.293162  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:33.324309  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:33.195323  7926 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:33.293550  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:33.294797  3122 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:33.295619  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:33.296371  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:33.305449  3051 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
W20260709 13:16:33.305946  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.307777  3198 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:16:33.289904  7859 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:33.336443  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.337148  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:33.198913  7663 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.337998  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:33.338194  7743 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:33.338809  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:33.338933  7640 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:33.331097  3125 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
I20260709 13:16:33.339877  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:33.367324  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:33.368129  3192 raft_consensus.cc:2393] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:33.337067  7858 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:33.341720  3124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:42960
W20260709 13:16:33.349918  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.350521  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:33.337384  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 83008.2us
I20260709 13:16:33.304960  2944 catalog_manager.cc:5697] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.359627  3197 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
W20260709 13:16:33.362090  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.364928  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.368745  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 226445us
I20260709 13:16:33.372633  3199 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
W20260709 13:16:33.379608  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.418812  3118 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:33.423626  3050 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:33.425781  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34718 (request call id 21) took 3330 ms. Trace:
I20260709 13:16:33.426364  3195 rpcz_store.cc:276] 0709 13:16:30.046151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.244940 (+3198789us) service_pool.cc:224] Handling call
0709 13:16:33.376289 (+131349us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.427531  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:33.433995  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.366528  7663 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:33.438045  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.368252  7827 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:33.443173  3120 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:33.433710  3043 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:33.451201  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:33.451557  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.451620  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:33.435305  3124 raft_consensus.cc:606] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:33.462599  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:33.463150  3124 raft_consensus.cc:614] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:33.463164  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.463606  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:33.341542  7722 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:33.466444  3051 raft_consensus.cc:2393] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 12: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:16:33.470687  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.470990  3798 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:33.472481  7212 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:33.486748  3194 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:33.490172  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:33.491149  3043 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:33.496388  3200 raft_consensus.cc:1240] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:33.466071  7551 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.498533  7551 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:33.501401  7551 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:33.367110  7709 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:33.509930  7212 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:33.511433  7709 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:33.502641  7620 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:33.512228  7212 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:33.505637  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:33.514786  3051 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
W20260709 13:16:33.516661  7732 consensus_meta.cc:287] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.524s	user 0.012s	sys 0.002s
I20260709 13:16:33.518703  3196 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:33.519904  3164 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:33.520884  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:33.521525  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 71952.2us
I20260709 13:16:33.521721  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:33.522660  7620 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:33.523587  7620 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:33.523976  7620 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.524158  3045 raft_consensus.cc:1240] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:16:33.524411  7620 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:33.524677  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:33.530189  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 55815.7us
W20260709 13:16:33.535981  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 63334.6us
I20260709 13:16:33.538791  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:33.477552  7904 raft_consensus.cc:2764] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:16:33.474718  7224 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.549557  3119 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 9: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:33.550904  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:33.551817  3797 raft_consensus.cc:2410] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:16:33.484613  7722 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:33.554028  3045 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:16:33.555922  3050 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:33.544932  3762 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:33.558715  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:33.559851  3798 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:33.540060  3043 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:16:33.561929  3051 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:33.563808  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:33.565706  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.561388  3091 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:33.569003  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.485517  7859 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:33.573001  7859 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:33.573894  3796 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:33.574038  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:33.577860  7224 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:33.581027  7224 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:33.582715  3045 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:33.586095  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 61586.8us
I20260709 13:16:33.589098  3164 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:33.599062  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2226) took 1536 ms. Trace:
I20260709 13:16:33.602514  7895 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:33.603834  7709 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:33.618048  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 73950.1us
I20260709 13:16:33.618969  3091 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:33.619146  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:33.620193  7640 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:33.620970  7640 raft_consensus.cc:697] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:33.621048  3091 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:33.622323  7732 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:16:33.622547  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 88173us
I20260709 13:16:33.664773  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:33.665295  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.623713  7212 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:33.625770  7640 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:33.667950  3050 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:33.626744  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:33.669360  3199 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:33.628760  7818 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:33.629592  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 118448us
I20260709 13:16:33.630318  7859 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:33.631708  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2468) took 2641 ms. Trace:
W20260709 13:16:33.636193  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.637717  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:33.641063  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:33.648291  3048 raft_consensus.cc:1275] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:33.599710  3117 rpcz_store.cc:276] 0709 13:16:32.062336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.721881 (+659545us) service_pool.cc:224] Handling call
0709 13:16:32.948939 (+227058us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:32.949862 (+   923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.949910 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:32.951315 (+  1405us) log.cc:844] Serialized 52 byte log entry
0709 13:16:33.171758 (+220443us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:33.227861 (+ 56103us) log.cc:844] Serialized 14 byte log entry
0709 13:16:33.254221 (+ 26360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.254310 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:33.528535 (+274225us) raft_consensus.cc:1685] finished
0709 13:16:33.528555 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.598568 (+ 70013us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b540031a450. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:33.598805 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26549,"prepare.queue_time_us":57656,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":29255,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":1224,"spinlock_wait_cycles":520940800,"thread_start_us":219955,"threads_started":1,"wal-append.queue_time_us":574468}
I20260709 13:16:33.650043  2944 catalog_manager.cc:5697] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.673530  3200 rpcz_store.cc:276] 0709 13:16:30.990416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.988314 (+1997898us) service_pool.cc:224] Handling call
0709 13:16:32.988894 (+   580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.513612 (+524718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.631329 (+117717us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b5400036e54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:33.631592 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1141600640}
W20260709 13:16:33.677486  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 56530.7us
I20260709 13:16:33.655367  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:33.662735  3120 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
I20260709 13:16:33.671181  7212 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:33.652448  7858 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:33.687172  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.664685  7732 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.705255  3796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:33.654412  7895 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.698989  7806 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:33.706204  3796 raft_consensus.cc:606] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:33.717828  3796 raft_consensus.cc:614] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:33.707568  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:33.710980  3165 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:33.712227  3194 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:33.718551  3195 raft_consensus.cc:2393] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 12: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:33.727720  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:33.733011  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 73849.7us
W20260709 13:16:33.737639  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.710515  7732 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:33.710273  7709 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:33.745846  7212 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:33.717657  7806 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.749706  3165 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:33.752573  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:33.746148  7926 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:33.758425  7926 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.758947  7926 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:33.768258  7806 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:33.772110  7859 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:33.730752  7818 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:33.776619  7818 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:33.753543  3051 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
W20260709 13:16:33.786975  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 47524.8us
W20260709 13:16:33.793802  7949 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:16:33.800999  2944 catalog_manager.cc:5697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.804450  7620 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:33.806209  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:33.746483  7895 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:33.808051  7620 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:33.810140  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:33.810371  7895 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:33.810868  3050 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:33.811153  3165 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:33.737841  7858 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:16:33.748056  7551 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.803929  2944 catalog_manager.cc:5697] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.816205  7709 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:33.817301  7894 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:33.821038  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:33.827719  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 238741us
W20260709 13:16:33.832890  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.833496  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.847205  3118 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
W20260709 13:16:33.849771  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 565402us
I20260709 13:16:33.852317  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:33.857229  3015 connection.cc:256] RPC call timeout handler was delayed by -1.3213251659999514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
I20260709 13:16:33.815848  7224 consensus_queue.cc:1059] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:16:33.828495  7894 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.857600  3165 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:16:33.857993  3015 connection.cc:256] RPC call timeout handler was delayed by -1.2901929320000818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
I20260709 13:16:33.867231  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:33.870115  3015 connection.cc:256] RPC call timeout handler was delayed by -1.2142251660000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
W20260709 13:16:33.870517  3015 connection.cc:256] RPC call timeout handler was delayed by -1.1909064569999828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
I20260709 13:16:33.870357  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:33.871069  3015 connection.cc:256] RPC call timeout handler was delayed by -1.1584251659999154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
I20260709 13:16:33.851807  7895 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:33.818261  7663 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:33.885154  3165 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:16:33.896929  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.897512  3015 connection.cc:256] RPC call timeout handler was delayed by -1.1182580959998631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
W20260709 13:16:33.898152  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0909251660000336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
W20260709 13:16:33.899058  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.837218  7551 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:33.898630  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0810251660000176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2142s for a response
I20260709 13:16:33.867293  7827 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:33.902452  7827 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:33.901552  3015 connection.cc:256] RPC call timeout handler was delayed by -1.067743142999916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1879s for a response
W20260709 13:16:33.905097  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0527794480001376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
W20260709 13:16:33.911702  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0345983629999864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
W20260709 13:16:33.914974  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0345983629999864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
W20260709 13:16:33.917876  3015 connection.cc:256] RPC call timeout handler was delayed by -1.034225165999942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
W20260709 13:16:33.920632  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0198251659999187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 13:16:33.923825  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0198251659999187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
I20260709 13:16:33.928020  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:33.910173  2944 catalog_manager.cc:5697] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:33.918720  7954 log.cc:927] Time spent T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:16:33.936329  7663 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:33.872570  7894 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:33.908053  7766 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:16:33.954872  3799 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.011s	sys 0.037s
W20260709 13:16:33.972313  3799 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.011s	sys 0.037s
I20260709 13:16:33.905381  7827 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:33.885187  7859 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:33.992439  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 64607.3us
W20260709 13:16:33.993134  3126 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.010s	sys 0.016s
W20260709 13:16:33.995548  3126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.011s	sys 0.017s
W20260709 13:16:34.003047  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.958556  7766 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.981632  7620 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:34.012734  3050 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:34.012145  7766 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:34.015494  7806 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:33.860010  7709 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:34.023167  3049 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:34.032595  3050 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:16:34.020973  7620 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.041781  7904 consensus_queue.cc:1059] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:34.042285  7719 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:16:34.046447  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.050515  7769 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:34.050908  7663 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:16:34.057895  7859 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:34.061156  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:34.063818  7859 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:34.065244  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:34.074673  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:34.051592  7620 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:34.084436  3043 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:34.051700  7769 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.086913  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:34.128854  3091 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:34.058915  7827 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:16:34.134460  3048 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:34.057988  7732 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:34.114593  7769 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:34.149243  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:34.150250  3043 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
W20260709 13:16:34.151943  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 333655us
W20260709 13:16:34.154595  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 447109us
I20260709 13:16:34.133347  7859 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.137488  7663 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.171315  3762 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:34.168419  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:34.176554  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.186780  3049 raft_consensus.cc:2393] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 14: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:34.189383  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:34.166004  7640 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:34.174278  7551 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:34.247650  3042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.019s	sys 0.027s
W20260709 13:16:34.251147  3042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.019s	sys 0.028s
I20260709 13:16:34.212119  7640 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.185714  7859 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:34.175181  7684 consensus_queue.cc:1059] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 13:16:34.260301  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.221973  3043 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12725e4e41614e1292b974e17635f758"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:47488
I20260709 13:16:34.266508  3043 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:34.266934  3043 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:34.257565  3045 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.021s	sys 0.018s
I20260709 13:16:34.259359  7640 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:34.274597  3049 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:34.250643  7663 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:34.288652  3799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 633) took 1337 ms. Trace:
I20260709 13:16:34.265875  7806 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:34.303691  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 430888us
I20260709 13:16:34.286092  7743 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:34.314998  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.291184  3799 rpcz_store.cc:276] 0709 13:16:32.950225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.953565 (+  3340us) service_pool.cc:224] Handling call
0709 13:16:32.962334 (+  8769us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:32.963239 (+   905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.963282 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:32.964193 (+   911us) log.cc:844] Serialized 52 byte log entry
0709 13:16:33.361642 (+397449us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:33.972885 (+611243us) log.cc:844] Serialized 14 byte log entry
0709 13:16:34.284320 (+311435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.284446 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.284504 (+    58us) raft_consensus.cc:1685] finished
0709 13:16:34.284518 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.284675 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":773602,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":2818,"raft.queue_time_us":8399,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":162,"thread_start_us":1232132,"threads_started":3,"wal-append.queue_time_us":561922}
I20260709 13:16:34.325340  3049 raft_consensus.cc:1275] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:34.293493  7895 raft_consensus.cc:697] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:16:34.328948  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 522907us
I20260709 13:16:34.321765  7806 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:34.331350  7732 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:34.340642  7224 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:34.339269  7770 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:16:34.374028  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 533016us
I20260709 13:16:34.376216  7212 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:34.381929  7958 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:16:34.390913  7895 consensus_queue.cc:237] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:34.393826  7955 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.482s	user 0.000s	sys 0.003s
I20260709 13:16:34.394198  3165 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:16:34.398346  7959 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:16:34.398501  7980 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.372991  7709 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.399832  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 756) took 1241 ms. Trace:
I20260709 13:16:34.400089  7709 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:34.400328  3126 rpcz_store.cc:276] 0709 13:16:33.158346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.184101 (+ 25755us) service_pool.cc:224] Handling call
0709 13:16:33.198492 (+ 14391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:33.415030 (+216538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.415062 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:33.477273 (+ 62211us) log.cc:844] Serialized 26 byte log entry
0709 13:16:33.997109 (+519836us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:33.997175 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.997285 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.399520 (+402235us) raft_consensus.cc:1685] finished
0709 13:16:34.399541 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.399742 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52479,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":14828,"thread_start_us":519302,"threads_started":1,"wal-append.queue_time_us":689792}
I20260709 13:16:34.402727  7709 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:34.402763  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2722) took 1056 ms. Trace:
I20260709 13:16:34.403429  3047 rpcz_store.cc:276] 0709 13:16:33.346611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.954195 (+607584us) service_pool.cc:224] Handling call
0709 13:16:33.984494 (+ 30299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.017964 (+ 33470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.017997 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.018594 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 13:16:34.331753 (+313159us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:34.331803 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.331893 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.402462 (+ 70569us) raft_consensus.cc:1685] finished
0709 13:16:34.402489 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.402683 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6161,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":144,"thread_start_us":312608,"threads_started":1,"wal-append.queue_time_us":381196}
I20260709 13:16:34.404819  7709 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.399200  7980 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:34.376793  7212 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:34.411166  3043 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:34.437871  3043 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:34.441670  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 289182us
W20260709 13:16:34.412254  7946 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.478s	user 0.005s	sys 0.000s
I20260709 13:16:34.434643  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 824) took 1297 ms. Trace:
W20260709 13:16:34.456434  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.447631  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 823) took 1310 ms. Trace:
W20260709 13:16:34.462723  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 68717.3us
W20260709 13:16:34.464291  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 74002.8us
I20260709 13:16:34.465134  3761 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:34.432344  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 261371us
I20260709 13:16:34.451171  7212 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:34.373677  7818 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:34.463208  3044 rpcz_store.cc:276] 0709 13:16:33.122693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.185183 (+ 62490us) service_pool.cc:224] Handling call
0709 13:16:33.277943 (+ 92760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.278400 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:16:33.278786 (+   386us) log.cc:844] Serialized 14 byte log entry
0709 13:16:33.775918 (+497132us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b180001d2c0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:16:34.148567 (+372649us) log.cc:844] Serialized 14 byte log entry
0709 13:16:34.285884 (+137317us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:34.369975 (+ 84091us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:34.370032 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:34.370088 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.432790 (+ 62702us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.432963 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":59194,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":14582,"raft.queue_time_us":15153,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":140,"spinlock_wait_cycles":118403200,"thread_start_us":1065163,"threads_started":3,"wal-append.queue_time_us":632734}
I20260709 13:16:34.469274  3091 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:34.405401  7709 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:34.426813  7970 raft_consensus.cc:3055] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:16:34.480904  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 315706us
I20260709 13:16:34.485582  7709 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:34.491123  7926 consensus_meta.cc:287] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.732s	user 0.011s	sys 0.003s
I20260709 13:16:34.498018  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2055) took 1203 ms. Trace:
I20260709 13:16:34.482203  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:47488 (request call id 833) took 1090 ms. Trace:
W20260709 13:16:34.501883  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 436705us
I20260709 13:16:34.502118  7212 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:34.511392  7212 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.511883  7212 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:34.434317  7904 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:34.452189  3046 rpcz_store.cc:276] 0709 13:16:33.122981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.185525 (+ 62544us) service_pool.cc:224] Handling call
0709 13:16:33.311808 (+126283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:33.464547 (+152739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.464572 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:33.513067 (+ 48495us) log.cc:844] Serialized 26 byte log entry
0709 13:16:33.606481 (+ 93414us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b18003fa0c0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:16:34.028283 (+421802us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:34.028342 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.028460 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.407836 (+379376us) raft_consensus.cc:1685] finished
0709 13:16:34.407856 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.420479 (+ 12623us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45358,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":30920,"spinlock_wait_cycles":38624640,"thread_start_us":421538,"threads_started":1,"wal-append.queue_time_us":825905}
I20260709 13:16:34.510550  3043 rpcz_store.cc:276] 0709 13:16:33.349014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.174795 (+825781us) service_pool.cc:224] Handling call
0709 13:16:34.438905 (+264110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:34.527415  7722 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:34.528131  7722 raft_consensus.cc:697] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:34.515293  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:34.530200  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:34.541580  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:34.542062  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:34.542560  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:34.546806  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.509684  7743 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.558959  3044 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:34.497997  7970 raft_consensus.cc:740] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:16:34.550956  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.554528  3192 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:16:34.554976  3046 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:34.560883  3090 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:34.564929  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.515614  7904 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:34.516057  7926 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:34.630035  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:34.584522  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 86980.2us
I20260709 13:16:34.656826  3044 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:34.593662  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 158815us
I20260709 13:16:34.658047  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:34.547725  7827 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.659139  3165 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:34.739581  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:34.744622  3047 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
W20260709 13:16:34.744746  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.554979  7224 raft_consensus.cc:697] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:16:34.749883  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 234198us
W20260709 13:16:34.635107  7972 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:16:34.557138  7859 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:34.624922  7948 log.cc:927] Time spent T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:16:34.636739  7973 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:16:34.772717  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2721) took 1426 ms. Trace:
W20260709 13:16:34.765843  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.634210  7971 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:34.791312  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:34.792870  3047 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:34.638878  8011 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:34.633059  7766 consensus_meta.cc:287] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.582s	user 0.007s	sys 0.005s
I20260709 13:16:34.637050  7989 consensus_queue.cc:1059] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.146s
W20260709 13:16:34.635860  7974 log.cc:927] Time spent T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:16:34.574978  7743 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:34.628901  7894 consensus_meta.cc:287] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.646s	user 0.010s	sys 0.005s
W20260709 13:16:34.832015  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 271224us
I20260709 13:16:34.584899  7663 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:34.785519  3051 rpcz_store.cc:276] 0709 13:16:33.346308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.906153 (+559845us) service_pool.cc:224] Handling call
0709 13:16:33.906637 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.907015 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:16:33.907422 (+   407us) log.cc:844] Serialized 14 byte log entry
0709 13:16:34.551579 (+644157us) log.cc:844] Serialized 14 byte log entry
0709 13:16:34.772046 (+220467us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:34.772161 (+   115us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:34.772252 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.772385 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.772587 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33320,"prepare.queue_time_us":23650,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":69,"raft.queue_time_us":309141,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":17630,"thread_start_us":842282,"threads_started":4,"wal-append.queue_time_us":452372}
I20260709 13:16:34.782356  7551 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:34.634048  7979 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:34.851946  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:16:34.625348  7968 log.cc:927] Time spent T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:16:34.617348  7732 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:34.841869  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:34.582410  7904 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:34.778326  7806 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:34.815225  7212 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:34.856420  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 270778us
I20260709 13:16:34.749153  7827 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:34.800628  7971 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:34.631731  7769 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:34.873929  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:34.891739  3051 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:16:34.876660  3044 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:34.629017  7620 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:34.887358  7977 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.896471  7978 consensus_queue.cc:1059] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.137s
I20260709 13:16:34.897429  7990 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.898135  7990 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:34.899972  7212 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:34.877022  7973 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.054s	user 0.001s	sys 0.001s
I20260709 13:16:34.895871  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:34.617719  7722 consensus_queue.cc:237] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:34.902578  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:34.839632  7766 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:34.905277  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 725) took 1248 ms. Trace:
I20260709 13:16:34.635365  7980 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:16:34.891227  7971 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:34.864993  7894 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:34.921896  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:34.922400  7719 raft_consensus.cc:3055] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:34.922902  7719 raft_consensus.cc:740] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:34.923206  8005 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:34.904004  7979 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:34.923813  8005 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:34.923995  7719 consensus_queue.cc:260] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:34.926352  7999 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:34.921411  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2729) took 1447 ms. Trace:
I20260709 13:16:34.909766  7806 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:34.927022  3048 rpcz_store.cc:276] 0709 13:16:33.473855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.274500 (+800645us) service_pool.cc:224] Handling call
0709 13:16:34.286686 (+ 12186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.446683 (+159997us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.446760 (+    77us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.447901 (+  1141us) log.cc:844] Serialized 26 byte log entry
0709 13:16:34.784880 (+336979us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:34.784934 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.785071 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.921126 (+136055us) raft_consensus.cc:1685] finished
0709 13:16:34.921164 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.921343 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52116,"raft.queue_time_us":321804,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":100549,"thread_start_us":426795,"threads_started":2,"wal-append.queue_time_us":398867}
I20260709 13:16:34.928763  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 716) took 2381 ms. Trace:
I20260709 13:16:34.930107  7979 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:34.929142  3191 rpcz_store.cc:276] 0709 13:16:32.547449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.144613 (+597164us) service_pool.cc:224] Handling call
0709 13:16:33.145138 (+   525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:33.216277 (+ 71139us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:33.895179 (+678902us) log.cc:844] Serialized 14 byte log entry
0709 13:16:34.291076 (+395897us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.323785 (+ 32709us) log.cc:844] Serialized 26 byte log entry
0709 13:16:34.333279 (+  9494us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:34.333305 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.333395 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.928549 (+595154us) raft_consensus.cc:1685] finished
0709 13:16:34.928569 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.928707 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38160,"prepare.queue_time_us":924085,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":226228,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":179,"thread_start_us":823004,"threads_started":2,"wal-append.queue_time_us":596161}
I20260709 13:16:34.932240  7743 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:34.910643  7640 consensus_meta.cc:287] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.620s	user 0.008s	sys 0.003s
I20260709 13:16:34.894271  7984 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.933056  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2322) took 1772 ms. Trace:
I20260709 13:16:34.898437  7769 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:34.925259  7719 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:34.790278  7970 consensus_queue.cc:260] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:34.968286  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 65824.9us
I20260709 13:16:34.974153  7990 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:34.914407  3197 rpcz_store.cc:276] 0709 13:16:33.656457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.657842 (+  1385us) service_pool.cc:224] Handling call
0709 13:16:33.658289 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:33.708890 (+ 50601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.708943 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:33.779065 (+ 70122us) log.cc:844] Serialized 26 byte log entry
0709 13:16:34.277148 (+498083us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:34.277197 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.277270 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.904944 (+627674us) raft_consensus.cc:1685] finished
0709 13:16:34.904978 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.905192 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21931,"raft.queue_time_us":38212,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":22642,"thread_start_us":440937,"threads_started":1,"wal-append.queue_time_us":629106}
W20260709 13:16:34.975744  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 221910us
W20260709 13:16:34.980434  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 321349us
I20260709 13:16:34.981263  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 830) took 1856 ms. Trace:
I20260709 13:16:34.981701  3045 rpcz_store.cc:276] 0709 13:16:33.124660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.584194 (+459534us) service_pool.cc:224] Handling call
0709 13:16:33.584734 (+   540us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:33.585304 (+   570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.585339 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:33.729946 (+144607us) log.cc:844] Serialized 26 byte log entry
0709 13:16:34.272743 (+542797us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:34.272803 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.272902 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.981022 (+708120us) raft_consensus.cc:1685] finished
0709 13:16:34.981046 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.981198 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":143,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":144,"thread_start_us":524679,"threads_started":1,"wal-append.queue_time_us":626119}
I20260709 13:16:34.982900  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:34.983608  3049 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:34.987540  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.988333  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:34.937201  8019 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.935534  3042 rpcz_store.cc:276] 0709 13:16:33.160825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.635928 (+475103us) service_pool.cc:224] Handling call
0709 13:16:33.636391 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:33.637026 (+   635us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:33.701643 (+ 64617us) log.cc:844] Serialized 14 byte log entry
0709 13:16:34.251764 (+550121us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.269435 (+ 17671us) log.cc:844] Serialized 26 byte log entry
0709 13:16:34.269618 (+   183us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:34.269669 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.269788 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.932857 (+663069us) raft_consensus.cc:1685] finished
0709 13:16:34.932879 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.932999 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11327,"prepare.queue_time_us":60550,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":11234,"raft.queue_time_us":305355,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":29394,"thread_start_us":512385,"threads_started":1,"wal-append.queue_time_us":1211141}
I20260709 13:16:34.992689  3165 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:34.937239  7818 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:35.019665  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:34.899601  7224 consensus_queue.cc:237] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:35.032048  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 53137.7us
I20260709 13:16:35.019608  7770 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:34.906772  7977 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:34.507891  3193 rpcz_store.cc:276] 0709 13:16:33.294775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.336769 (+ 41994us) service_pool.cc:224] Handling call
0709 13:16:33.337201 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.337591 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:33.956472 (+618881us) log.cc:844] Serialized 14 byte log entry
0709 13:16:34.483720 (+527248us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:34.497133 (+ 13413us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:34.497203 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.497773 (+   570us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.497935 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95850,"prepare.queue_time_us":853623,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":4506,"raft.queue_time_us":134291,"raft.run_cpu_time_us":447,"raft.run_wall_time_us":25794,"thread_start_us":863236,"threads_started":3,"wal-append.queue_time_us":371968}
I20260709 13:16:34.954843  7640 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:35.050088  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:35.019805  7769 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.048929  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:35.035553  7926 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:35.054384  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:35.058527  3042 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:35.065219  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.020061  7684 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:35.010913  7994 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:34.976827  8011 consensus_queue.cc:1059] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:16:35.034420  7999 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:35.055088  7770 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:35.050859  8002 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.058748  8000 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.967500  7984 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:35.019884  7975 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.280s
I20260709 13:16:35.062369  7620 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:35.099514  8017 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:35.088529  7994 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.095319  7990 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:35.121104  3091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.002s	sys 0.011s
W20260709 13:16:35.127717  3091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.003s	sys 0.011s
I20260709 13:16:35.043745  8019 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.094475  8027 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:16:35.132557  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 112964us
I20260709 13:16:35.085356  7769 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:35.118080  7989 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.119506  8017 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.097833  7684 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.127792  7994 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:35.127646  7990 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:35.154171  7212 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.138535  8027 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.154700  7989 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.165886  7997 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:16:35.167672  8032 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:35.168409  7997 consensus_queue.cc:1059] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:35.165221  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:35.170135  8020 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.170771  8020 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.173903  7993 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.174508  7993 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.175796  7620 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.176306  7620 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:35.176848  7993 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:35.177551  8016 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.178115  8016 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.169170  3090 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:35.149940  7992 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.181527  7212 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:35.180325  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:35.150605  8017 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:35.115480  8000 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:35.114651  8002 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.232709  3049 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
W20260709 13:16:35.233791  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 64694.7us
I20260709 13:16:35.162799  7990 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:35.160772  7979 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:35.195788  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:35.236102  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:35.169256  7997 consensus_queue.cc:1059] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:16:35.162523  7806 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:35.181039  8027 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:35.235680  3165 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:35.135984  7999 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.251796  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:35.252632  7212 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:35.252796  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:35.257264  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:35.258177  3197 raft_consensus.cc:2410] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:35.258220  3192 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:35.173671  8020 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:35.257391  3125 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:35.162227  8004 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.215s
I20260709 13:16:35.264449  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:35.266975  3193 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:35.241247  7859 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:35.240869  7993 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.272009  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:35.246510  8005 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:35.244951  7975 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:35.277350  3195 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:35.249372  7989 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:35.280361  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.274967  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:35.281433  3118 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:35.281730  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:35.281565  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:35.282430  3194 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:35.282752  3196 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:35.283082  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:35.283854  3799 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 9.
I20260709 13:16:35.279827  3191 raft_consensus.cc:1275] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:16:35.288949  7965 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.810s	user 0.004s	sys 0.000s
I20260709 13:16:35.290700  7620 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:35.291772  7984 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:35.293366  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:35.294442  3125 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 12: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:35.296720  7894 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:35.288975  8014 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:35.298558  8014 raft_consensus.cc:697] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:35.289022  7967 raft_consensus.cc:3055] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:35.299494  7967 raft_consensus.cc:740] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:35.299572  8014 consensus_queue.cc:237] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:35.300441  7967 consensus_queue.cc:260] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:35.306912  7967 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:35.310061  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:35.312165  8029 log.cc:927] Time spent T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 13:16:35.312465  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.281524  7640 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:35.315012  3091 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:35.316346  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:35.316931  3049 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:35.318368  3047 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:35.266717  8016 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:35.276473  7709 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:35.320889  3091 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:35.321130  3042 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:35.196753  7992 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.261363  7979 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.323276  7212 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:35.323761  3761 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:35.326249  7212 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.326833  7212 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:35.326560  3091 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:35.332842  3049 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:35.322412  7640 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:35.335883  7640 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.336299  7640 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:35.338559  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:35.339241  3191 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:35.338956  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:35.340126  3042 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:35.327536  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:35.347985  7991 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.326823  7224 consensus_queue.cc:1059] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:16:35.362856  7224 raft_consensus.cc:3055] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:35.363323  7224 raft_consensus.cc:740] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:35.364205  7827 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:35.364298  7224 consensus_queue.cc:260] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.366063  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:35.366796  3195 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:35.365038  7827 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:35.372164  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:35.372534  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.373988  3051 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:35.343293  7709 raft_consensus.cc:697] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:35.379123  7709 consensus_queue.cc:237] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:35.383725  3091 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:35.301998  7993 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.328511  7977 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:35.396147  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:35.396878  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:35.393378  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:35.408486  3195 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:35.408608  3165 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:35.350068  8020 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:35.412509  3118 raft_consensus.cc:2410] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:16:35.375736  7895 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.433142  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:35.394527  8007 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.348821  7991 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.437242  3046 raft_consensus.cc:3055] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:35.399573  7858 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:35.400684  7224 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:35.435712  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:35.439585  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:35.400367  7769 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:35.439610  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:35.436996  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:35.443689  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:35.341037  7975 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:35.445194  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 288961us
I20260709 13:16:35.447674  3046 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:35.457901  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:35.463531  3198 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 14: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:35.458104  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:35.460177  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:35.421047  8020 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.411163  7827 raft_consensus.cc:697] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:35.463408  3200 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:35.469666  3796 raft_consensus.cc:2410] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:16:35.446373  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:35.463438  3194 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:35.468132  3191 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:35.471436  3123 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:35.468004  3118 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:35.408946  7770 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.504787  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:35.506009  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:35.507632  3195 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:35.451272  7684 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:35.508011  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 98065.8us
I20260709 13:16:35.505277  3046 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:35.509057  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:35.469499  8020 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:35.512072  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:35.513413  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:35.505195  7988 log.cc:927] Time spent T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260709 13:16:35.520557  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:35.523494  3797 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:16:35.524626  7212 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:35.521533  3796 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:35.470310  7858 raft_consensus.cc:697] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:35.457959  8026 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:35.495466  8019 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:35.449520  7895 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:35.524098  3797 pending_rounds.cc:85] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: Aborting all ops after (but not including) 10
I20260709 13:16:35.517928  3795 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:35.530876  3046 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:35.529870  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.532444  7212 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:35.561280  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 49648.6us
I20260709 13:16:35.510561  7977 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:35.527935  7719 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:35.561421  3797 pending_rounds.cc:107] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:16:35.573930  3797 raft_consensus.cc:2889] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:35.574311  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:35.575452  3796 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:35.569429  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:35.569357  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 63426.6us
I20260709 13:16:35.577383  3195 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:35.521896  7894 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:35.578751  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:35.579823  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:35.581234  3791 raft_consensus.cc:2393] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 12: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:35.581686  3195 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:35.583298  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:35.583580  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:35.584199  3122 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:35.560959  8002 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:35.587513  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:35.478480  8007 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.567392  8026 raft_consensus.cc:697] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:35.529109  7640 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:35.574602  8000 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:35.576333  8019 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.622710  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:35.612232  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:35.627683  3195 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
W20260709 13:16:35.592419  8021 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 13:16:35.655653  3791 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:35.579638  7999 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:35.659412  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:35.663981  3795 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:35.664341  3122 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:35.574280  7977 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:35.661324  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:35.666584  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:35.659480  3798 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:35.668304  3195 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:35.669981  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:35.670503  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:35.671388  3793 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:35.671581  8026 consensus_queue.cc:237] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:35.674114  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet 7480597af1f341178e465e8723f7320e: Illegal state: Replica 501fdf2af2bc4b0c971ae880e98f466b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:35.674471  8055 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.675223  8055 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.667536  7858 consensus_queue.cc:237] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:35.679260  8055 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:35.688344  7977 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:35.689465  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:35.690269  3122 raft_consensus.cc:2376] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10. Re-sending same reply.
W20260709 13:16:35.690748  8052 log.cc:927] Time spent T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:16:35.691340  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:35.692000  3122 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:35.666810  7994 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:35.695441  7994 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:35.690766  8041 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.700227  8041 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.702121  7684 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.702760  7684 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:35.705202  7684 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:35.699014  3793 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:35.709293  8041 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:35.710430  7212 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.710996  7212 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.711459  7895 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:35.712055  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:35.713188  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 99310.3us
I20260709 13:16:35.714035  7212 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:35.718088  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:35.719664  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:35.720407  3122 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:16:35.722926  7991 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:35.724272  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.724810  7640 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:35.725505  7904 consensus_meta.cc:287] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.831s	user 0.010s	sys 0.001s
I20260709 13:16:35.727725  7904 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.728188  7990 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.730378  7770 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:35.622959  7827 consensus_queue.cc:237] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:35.731681  8019 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.733014  3796 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:35.734483  7999 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:16:35.736325  8053 log.cc:927] Time spent T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:16:35.737666  3091 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:35.738520  7991 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:35.738593  8007 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:35.739040  7991 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:35.739464  7991 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:35.742827  7975 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:35.583647  7894 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:35.745187  7894 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:35.746110  7993 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:35.747748  8017 consensus_meta.cc:287] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.003s
I20260709 13:16:35.748003  7991 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.748230  8017 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:35.750073  3046 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:16:35.750468  3046 pending_rounds.cc:85] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 7
I20260709 13:16:35.750718  3046 pending_rounds.cc:107] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:16:35.750974  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:35.751791  3798 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:35.751914  3793 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:35.753376  7904 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:35.753528  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:35.750990  3046 raft_consensus.cc:2889] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:35.591008  8027 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.755878  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:35.756318  8027 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:35.757349  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:35.757567  3199 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:35.769814  3200 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:16:35.771315  3046 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:35.734521  8019 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:35.759913  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:35.754112  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:35.774255  3799 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:35.761704  7806 raft_consensus.cc:3055] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:35.763028  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:35.796037  3195 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:35.764822  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 762) took 1010 ms. Trace:
I20260709 13:16:35.765479  3795 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:35.714039  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:35.799834  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.801563  3122 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:35.758219  3091 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:35.778587  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:35.808585  3046 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 13: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:16:35.808492  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 50378.2us
I20260709 13:16:35.823385  3194 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:35.828588  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:35.829020  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:35.796892  3126 rpcz_store.cc:276] 0709 13:16:34.754626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.754768 (+   142us) service_pool.cc:224] Handling call
0709 13:16:34.771198 (+ 16430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:34.884250 (+113052us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:35.098474 (+214224us) log.cc:844] Serialized 14 byte log entry
0709 13:16:35.241314 (+142840us) log.cc:844] Serialized 14 byte log entry
0709 13:16:35.241903 (+   589us) log.cc:844] Serialized 14 byte log entry
0709 13:16:35.242063 (+   160us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:35.242103 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:35.242147 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.367806 (+125659us) spinlock_profiling.cc:243] Waited 7.92 ms on lock 0x7b4800002dd8. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff8352dcaa1 00007ff8352d3b37 00007ff8352d39ca 00007ff8353cb26f 00007ff8353caf37 00007ff8353df55c 00007ff8353df508 00007ff8353df488 00007ff8353df443 00007ff8353de6ec 00007ff834308a96
0709 13:16:35.368604 (+   798us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b1800060b80. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c6522 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:16:35.763442 (+394838us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b1800060b80. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2942a6 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419
0709 13:16:35.764592 (+  1150us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540010d954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:35.764628 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.764761 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":234901,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":55,"raft.queue_time_us":509,"raft.run_cpu_time_us":2884,"raft.run_wall_time_us":145048,"spinlock_wait_cycles":344070912,"thread_start_us":334702,"threads_started":2,"wal-append.queue_time_us":189897}
I20260709 13:16:35.848513  3046 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:35.852795  3117 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:35.795574  7806 raft_consensus.cc:740] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:35.826524  7967 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:35.881145  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:35.883852  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:35.884629  3046 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:35.886986  3195 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
W20260709 13:16:35.892961  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 178991us
I20260709 13:16:35.898734  3126 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:35.901729  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:35.904038  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.908118  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:35.892766  7859 consensus_meta.cc:287] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.605s	user 0.007s	sys 0.003s
I20260709 13:16:35.910384  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:35.912559  3046 raft_consensus.cc:2410] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:16:35.852893  7999 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:35.914119  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:35.914934  3126 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:35.914870  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:35.910064  3117 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:35.916919  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:35.916107  3046 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:35.907986  8014 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:35.927745  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.046798  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.990660  3122 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
W20260709 13:16:35.964263  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 45525.8us
I20260709 13:16:35.919494  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:35.930434  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.049216  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:35.915607  7978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.004s	sys 0.016s
I20260709 13:16:36.022114  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:36.051119  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:35.914819  7859 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:36.053036  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:35.919494  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.053831  3122 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
W20260709 13:16:36.042176  8059 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.077s	user 0.000s	sys 0.002s
I20260709 13:16:35.911697  7967 raft_consensus.cc:697] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:36.049949  3117 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
W20260709 13:16:36.039259  8058 log.cc:927] Time spent T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:16:36.040597  7992 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:35.919845  7990 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:36.055598  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:35.920014  7971 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.994s	user 0.013s	sys 0.000s
I20260709 13:16:35.946779  7551 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:36.044006  7979 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:36.049778  8032 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.013s	sys 0.013s
I20260709 13:16:35.922281  8017 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:36.052273  7978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.083s	user 0.004s	sys 0.030s
W20260709 13:16:35.947059  8015 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.000s	sys 0.015s
I20260709 13:16:35.931329  7991 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:36.067507  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:16:36.057010  8020 consensus_meta.cc:287] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.000s
I20260709 13:16:36.068456  7999 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:36.068852  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:36.065891  7551 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:36.057952  8063 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:16:36.074252  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:36.067015  8032 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.014s	sys 0.013s
I20260709 13:16:36.075959  3121 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:36.080323  3117 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:36.082918  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.082347  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.083892  3124 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:36.083540  3117 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
W20260709 13:16:36.076304  8015 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.002s	sys 0.025s
I20260709 13:16:36.087055  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.052371  8014 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:35.951632  7806 consensus_queue.cc:260] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:36.090521  7999 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:36.090883  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:36.091064  7967 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:36.095268  3117 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:16:36.099478  8057 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.366s	user 0.006s	sys 0.000s
I20260709 13:16:36.100612  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.088302  8006 consensus_queue.cc:1059] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:16:36.104439  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.104617  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2324) took 2448 ms. Trace:
I20260709 13:16:36.105072  3050 rpcz_store.cc:276] 0709 13:16:33.656055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.277774 (+621719us) service_pool.cc:224] Handling call
0709 13:16:34.291613 (+ 13839us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.525427 (+233814us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.525477 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.583754 (+ 58277us) log.cc:844] Serialized 26 byte log entry
0709 13:16:35.462136 (+878382us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b18002e5160. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:16:35.572795 (+110659us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:35.572833 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.572901 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:36.098807 (+525906us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:36.104416 (+  5609us) raft_consensus.cc:1685] finished
0709 13:16:36.104438 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.104567 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28337,"raft.queue_time_us":342410,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":18243,"spinlock_wait_cycles":63046784,"thread_start_us":334166,"threads_started":2,"wal-append.queue_time_us":1045614}
I20260709 13:16:36.067166  7971 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.112386  3046 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:16:36.111747  7999 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:36.113447  7743 raft_consensus.cc:3055] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:36.114415  8014 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:36.111364  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.115120  7970 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:36.122181  3124 raft_consensus.cc:2410] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:16:36.080657  8020 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.119737  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:36.124424  3193 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:36.125438  3122 raft_consensus.cc:2410] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:16:36.111346  7806 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:36.123497  3125 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:16:36.126453  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:36.122982  7743 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:36.126689  7999 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:36.128973  8020 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:36.131445  8051 log.cc:927] Time spent T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.458s	user 0.001s	sys 0.004s
W20260709 13:16:36.133230  8071 log.cc:927] Time spent T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.093s	user 0.000s	sys 0.002s
I20260709 13:16:36.154453  3126 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:36.138873  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:36.140991  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:36.146811  8017 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.147668  7978 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.151109  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:36.151587  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:36.168488  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:36.168855  3795 raft_consensus.cc:2410] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:16:36.151840  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:36.169919  3796 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:36.151713  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:36.153350  3117 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:36.154487  3051 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:36.158595  3044 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:36.152470  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:36.164461  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:16:36.122684  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 53927.9us
I20260709 13:16:36.173753  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:36.174468  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:36.176252  3799 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:36.176550  3124 raft_consensus.cc:1275] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:36.179337  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.179466  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:36.180002  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:36.180616  3045 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:36.180119  3043 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:36.182395  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.183116  3126 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:36.178004  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:36.165383  7986 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.193315  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:36.189360  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:36.193955  3051 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:36.171433  8017 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.196187  3164 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:36.180631  8020 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:36.199381  3761 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:36.202373  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:36.204658  3043 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
W20260709 13:16:36.191423  7980 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.108s	user 0.011s	sys 0.009s
I20260709 13:16:36.208434  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.211403  3117 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:36.210536  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:36.193849  8006 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:36.220783  3044 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:36.198783  7986 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.221750  8014 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:36.221819  7992 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:16:36.222823  8061 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:16:36.223649  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:36.224412  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:16:36.228853  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.228850  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:36.174117  7978 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.233844  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:36.210268  7980 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.129s	user 0.011s	sys 0.009s
I20260709 13:16:36.236884  3796 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:36.237880  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:36.207567  8020 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.216952  7977 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:36.216928  8060 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:36.231952  8006 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.242156  8014 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:36.252163  3117 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:36.245057  7992 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.280463  3051 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:16:36.281306  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:36.250590  3043 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 8.
I20260709 13:16:36.268179  7551 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.268575  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.269773  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.246752  7990 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:36.253298  8020 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:36.307775  3126 raft_consensus.cc:2410] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:16:36.253815  7977 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.306530  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:36.319430  3051 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:36.292346  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.257280  8060 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:36.318552  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 65603.3us
I20260709 13:16:36.314495  3790 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:36.260553  8006 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:36.323736  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:36.324685  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:36.325126  8072 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:16:36.324931  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.334748  3126 raft_consensus.cc:2410] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:16:36.335261  3122 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:36.335858  3126 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:36.336576  3122 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:36.337033  3126 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:36.326249  8000 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:36.338152  8000 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:36.338559  8000 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:36.338785  3051 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:16:36.339855  7978 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:36.317902  7991 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.340646  7991 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:36.326181  8068 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.342308  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:36.342761  7991 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:36.342557  8068 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.342931  3051 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
W20260709 13:16:36.325472  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 101917us
I20260709 13:16:36.344856  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:36.345407  7980 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:36.323613  8060 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:36.345890  7990 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:36.322540  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.346485  7990 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:36.346848  3117 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:36.347007  7990 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:36.326931  3043 raft_consensus.cc:1240] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:36.347147  7970 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:36.323328  7977 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:36.348829  7970 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:36.346280  7980 consensus_queue.cc:1059] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:36.273797  8002 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:36.352336  8002 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.352771  8002 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:36.287076  7992 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:36.354086  7979 consensus_queue.cc:1059] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:36.355579  7989 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:36.356161  7989 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.358562  7989 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:36.361331  7990 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:36.367381  7990 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:36.364076  8000 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.346441  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:36.362025  7971 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:36.307928  3045 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:16:36.283341  7766 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:36.282341  8014 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:36.374472  8017 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:36.375872  8056 log.cc:927] Time spent T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.682s	user 0.005s	sys 0.000s
I20260709 13:16:36.379599  3051 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:36.333141  7620 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:16:36.385313  8017 raft_consensus.cc:3055] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:36.385725  8017 raft_consensus.cc:740] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:36.386484  8000 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:36.386586  8017 consensus_queue.cc:260] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.389107  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.388901  7992 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.391717  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:36.392203  8060 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.392639  7986 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:36.395578  8069 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.353s	user 0.000s	sys 0.002s
I20260709 13:16:36.396555  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:36.401554  3045 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:36.421212  3045 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:36.427306  3047 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:36.433362  3045 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13. Ops: []
W20260709 13:16:36.465541  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.467672  8060 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:36.468464  8068 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:36.469305  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:36.470125  3044 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:16:36.470613  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:36.471268  3119 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:16:36.474268  8078 log.cc:927] Time spent T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:16:36.474872  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 128581us
I20260709 13:16:36.475729  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:36.477068  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:36.477988  7999 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:36.478389  7999 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:36.478757  7999 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:36.481952  7904 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:36.482467  7904 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:36.482851  7904 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:36.487785  8022 raft_consensus.cc:3055] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:36.488250  8022 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:36.489207  8022 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.490754  8022 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:36.381088  8002 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.502767  3015 leader_election.cc:400] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11.
I20260709 13:16:36.503096  3015 leader_election.cc:403] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:36.507741  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 162726us
I20260709 13:16:36.508554  3164 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:36.509668  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:36.510669  3164 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:36.502298  7551 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:36.504757  7990 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11.
I20260709 13:16:36.510195  7719 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:36.529403  3126 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:36.529896  7766 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:16:36.530251  8018 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 1.442s	user 0.000s	sys 0.006s
I20260709 13:16:36.514808  7986 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:36.514489  7991 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:36.532917  3118 raft_consensus.cc:2410] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:16:36.530548  7766 raft_consensus.cc:697] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:36.511272  7709 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:36.533870  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.538133  3164 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:36.536401  8068 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:16:36.542730  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:36.545006  3043 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:36.534205  7986 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.547170  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:36.521943  8020 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.538039  7709 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.547887  7986 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:36.552973  3119 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:16:36.557212  3164 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:36.558311  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:36.540653  7766 consensus_queue.cc:237] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.560865  8080 raft_consensus.cc:2764] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:16:36.563099  8032 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.563685  8032 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:36.564132  3090 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:36.550163  7709 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:36.539077  7991 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.550304  8084 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:36.570446  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:36.571125  3123 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:16:36.572997  7926 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:36.573473  7926 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:36.573900  7926 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:36.575229  3762 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:36.577206  3762 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:36.580075  3090 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:36.560333  7992 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:36.560779  7971 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:36.581950  3762 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:36.582954  7224 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:36.570326  8014 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:36.592885  7719 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:36.593497  7719 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:36.593165  8014 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:36.595058  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2498) took 1293 ms. Trace:
I20260709 13:16:36.595448  3196 rpcz_store.cc:276] 0709 13:16:35.301918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.302071 (+   153us) service_pool.cc:224] Handling call
0709 13:16:36.594878 (+1292807us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540013bfd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:36.595001 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2578560768}
I20260709 13:16:36.585469  7224 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.597985  7224 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:36.599025  7709 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:36.600345  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.600737  7743 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.601380  3043 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
W20260709 13:16:36.602433  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 45319.1us
I20260709 13:16:36.553990  7977 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.603195  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:36.603705  3762 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:36.577817  7806 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:16:36.607442  3120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2241) took 1217 ms (client timeout 1508 ms). Trace:
I20260709 13:16:36.610476  3762 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:36.613611  3761 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:36.608982  3120 rpcz_store.cc:269] 0709 13:16:35.387934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.388141 (+   207us) service_pool.cc:224] Handling call
0709 13:16:36.605404 (+1217263us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b540038fed4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:36.605542 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1094734592}
I20260709 13:16:36.581096  8068 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:36.615211  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:36.617930  3015 leader_election.cc:400] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12.
I20260709 13:16:36.581869  8032 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:36.623210  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:36.605688  7970 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:36.624987  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:36.610985  8014 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:36.609095  7743 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:36.630394  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:36.630731  3043 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:36.608866  7806 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.608409  7971 raft_consensus.cc:697] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:36.634897  8062 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:36.655716  8062 raft_consensus.cc:697] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:36.655934  7971 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.656771  8062 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.623745  8015 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:36.648633  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet 4b91597ece9742ebad558605a654e02a: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:36.636747  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:36.620157  7992 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:36.620304  8068 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:36.660928  7806 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:36.660530  3048 raft_consensus.cc:2393] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 15: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:36.660961  8068 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:36.622485  8084 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:36.681074  3042 raft_consensus.cc:2393] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:36.677510  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.671906  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 68580.6us
I20260709 13:16:36.665385  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:36.673069  3123 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
W20260709 13:16:36.662298  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.661873  7979 raft_consensus.cc:3055] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:36.684849  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:36.684944  3046 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:36.685925  3761 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:36.690855  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:36.690708  8026 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:36.691553  3124 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:36.692451  7979 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:36.646624  7991 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:36.693512  7979 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.694063  7663 raft_consensus.cc:2764] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:16:36.694916  7979 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:36.649302  7978 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:36.696211  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.696316  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.692487  8065 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.650s	user 0.000s	sys 0.003s
I20260709 13:16:36.696405  7978 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:36.697676  8085 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:16:36.651232  8020 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:36.698258  8084 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:36.648288  7977 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:36.698773  8084 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:36.700875  7977 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:36.684451  3165 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:16:36.712888  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.710175  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:36.720425  3049 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:16:36.712448  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 77475.2us
I20260709 13:16:36.725059  3124 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
W20260709 13:16:36.722069  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 111640us
I20260709 13:16:36.726966  3762 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:36.727854  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:36.729261  8080 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:16:36.640174  8014 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:36.738148  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.728538  3762 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:36.725572  8026 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:36.740322  8026 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.740736  8026 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:36.648957  8002 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:36.710709  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:36.748845  3043 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:36.736698  8020 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:36.736142  8015 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:36.750922  3046 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:36.640007  8006 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.738920  7970 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:36.752907  3762 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:16:36.753633  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 137721us
I20260709 13:16:36.756728  3762 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:36.757539  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:36.711135  7999 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:36.761561  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:36.762641  3090 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:36.736308  7992 consensus_queue.cc:1059] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:16:36.709663  7224 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.764765  3046 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:36.766860  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:36.752807  8015 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.767589  3090 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:36.757037  8002 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:36.748965  8080 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:16:36.768234  8011 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:36.754910  8091 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:36.789368  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:36.795024  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:36.795835  3043 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 10.
I20260709 13:16:36.764611  7970 raft_consensus.cc:697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 12 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:16:36.798965  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 72236.1us
I20260709 13:16:36.767277  8068 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.770457  8015 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:36.758882  7719 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:36.816689  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:36.792580  7551 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:36.794929  8011 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.768708  7990 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:16:36.797688  7991 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:36.765451  8084 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:36.824944  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:36.825843  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 848) took 1065 ms. Trace:
I20260709 13:16:36.826570  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:36.842970  3043 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:36.842744  3051 rpcz_store.cc:276] 0709 13:16:35.760380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.343593 (+583213us) service_pool.cc:224] Handling call
0709 13:16:36.379439 (+ 35846us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.384388 (+  4949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.825568 (+441180us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b54000c6f50. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:36.825717 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81638784}
I20260709 13:16:36.794739  8091 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:36.846764  7551 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:36.848017  7986 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.852128  7999 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:36.820523  8022 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:36.854882  3049 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:36.814702  8089 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:36.859877  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:36.861056  3046 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:16:36.867858  3165 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:36.827801  8011 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:36.816038  8020 raft_consensus.cc:697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:36.856909  7224 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:36.823051  8002 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:36.799185  7904 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:36.842330  7991 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.853572  8091 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:36.888231  8093 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:16:36.866112  8022 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.901208  3043 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:36.913609  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.915102  3120 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
W20260709 13:16:36.915289  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 147796us
I20260709 13:16:36.892472  7991 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:36.903350  8022 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:36.899168  8096 raft_consensus.cc:2764] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:16:36.917106  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:36.928249  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 111634us
I20260709 13:16:36.914125  7977 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:36.903523  7709 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:36.930267  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2243) took 1506 ms. Trace:
I20260709 13:16:36.893044  7926 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:36.930922  3122 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:16:36.934783  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 67026.4us
I20260709 13:16:36.919790  7904 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:36.936482  3121 rpcz_store.cc:276] 0709 13:16:35.424795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.424975 (+   180us) service_pool.cc:224] Handling call
0709 13:16:36.930088 (+1505113us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b54003e7e54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:36.930206 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1403480448}
I20260709 13:16:36.914438  7766 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:36.921027  7986 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:36.940038  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:36.938493  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:36.942687  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 153433us
I20260709 13:16:36.947211  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:36.949786  3043 raft_consensus.cc:2393] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 13: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:36.950340  7904 raft_consensus.cc:2764] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:16:36.950309  7967 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:36.951490  7967 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.953596  7967 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:36.954278  7967 raft_consensus.cc:2764] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:16:36.957352  3121 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:16:36.958254  8017 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:36.965448  3192 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:36.916801  7970 consensus_queue.cc:237] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:36.946478  8070 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.905s	user 0.004s	sys 0.000s
I20260709 13:16:36.967239  3164 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:36.970711  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.971171  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:36.971942  3798 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
I20260709 13:16:36.973551  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.974040  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.974718  3117 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:36.967522  3165 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:36.969242  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:36.942135  7978 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:36.975337  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.975930  3125 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:36.977056  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:36.978216  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:36.978878  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:36.980904  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:36.983139  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.982402  3165 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:36.983964  3123 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:36.985917  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:36.986370  3793 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:36.986930  3193 raft_consensus.cc:2393] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 12: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:36.946702  8110 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:36.987687  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:36.990222  3790 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:16:36.990623  3791 raft_consensus.cc:2393] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 12: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:36.991734  3798 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:16:36.992803  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:36.994135  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:36.944857  8020 consensus_queue.cc:237] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:36.999907  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:36.948176  7663 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:16:37.005787  8107 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:36.962345  7977 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:16:36.987191  7719 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:37.015435  8006 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:36.987506  8068 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:37.026733  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:37.030041  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:36.970741  7986 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:16:37.032370  8060 raft_consensus.cc:3055] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:36.987385  8096 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:37.026041  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:37.039600  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:37.040642  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 58314.5us
I20260709 13:16:37.052405  8096 raft_consensus.cc:697] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:37.053179  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:37.054512  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:37.055097  3199 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:37.055881  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:37.056548  3199 raft_consensus.cc:2393] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 10: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:37.057305  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:37.016885  8110 raft_consensus.cc:697] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:37.044473  3192 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:37.044546  7926 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:37.060510  8084 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:37.060590  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:37.061359  3199 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 13: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:37.062250  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:37.063411  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:37.066033  8107 raft_consensus.cc:697] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:37.066656  8026 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:37.046594  7709 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:37.067162  8107 consensus_queue.cc:237] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:37.067831  7709 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.068288  7709 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:37.069976  3199 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:16:37.070981  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:37.071487  3199 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:37.047587  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:37.003420  8109 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.048372  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:37.050182  3194 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:16:37.053719  8096 consensus_queue.cc:237] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:37.058653  8110 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:37.092214  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:37.061508  3192 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:37.079254  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:37.070019  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 107848us
I20260709 13:16:37.100270  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:37.101090  3164 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:37.083256  3126 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
W20260709 13:16:37.041851  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.085127  3799 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:37.088220  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:37.096148  3047 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:16:37.089851  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:37.045225  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:37.103598  3191 raft_consensus.cc:2393] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 12: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:37.103837  3196 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:37.096313  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:37.104413  3198 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:37.095642  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:37.089471  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:16:37.105026  3015 connection.cc:256] RPC call timeout handler was delayed by -2.4068342030000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
I20260709 13:16:37.090654  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:37.105482  3125 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:16:37.105540  3015 connection.cc:256] RPC call timeout handler was delayed by -2.3888342029999876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
W20260709 13:16:37.107303  3015 connection.cc:256] RPC call timeout handler was delayed by -2.2817342030000418s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
I20260709 13:16:37.108119  3042 raft_consensus.cc:2410] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:16:37.108069  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:37.109141  3049 raft_consensus.cc:2368] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16.
W20260709 13:16:37.109231  3015 connection.cc:256] RPC call timeout handler was delayed by -2.2817342030000418s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 13:16:37.109797  3015 connection.cc:256] RPC call timeout handler was delayed by -2.1530342030000611s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
W20260709 13:16:37.110212  3015 connection.cc:256] RPC call timeout handler was delayed by -2.1530342030000611s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
W20260709 13:16:37.110697  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:37.110800  3015 connection.cc:256] RPC call timeout handler was delayed by -2.105334202999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
W20260709 13:16:37.114169  3015 connection.cc:256] RPC call timeout handler was delayed by -1.930734202999929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
W20260709 13:16:37.114497  3015 connection.cc:256] RPC call timeout handler was delayed by -1.7759342029999061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2251s for a response
I20260709 13:16:37.110411  3165 leader_election.cc:400] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16.
I20260709 13:16:37.115163  3165 leader_election.cc:403] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:16:37.115430  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:37.116312  3044 raft_consensus.cc:2368] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13.
I20260709 13:16:37.116617  3164 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:37.112295  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:37.112671  3126 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:37.113569  3761 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:37.120712  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:37.123565  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:37.124763  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:37.125567  3051 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:37.128307  3793 raft_consensus.cc:2393] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 13: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:37.129640  3197 raft_consensus.cc:2393] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 12: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:37.131560  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:37.130960  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 192521us
I20260709 13:16:37.077793  8060 raft_consensus.cc:740] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:37.139649  3761 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:37.142201  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:37.142596  3047 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260709 13:16:37.143534  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.150228  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:37.151047  3198 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:37.152565  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:37.152359  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:37.145972  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:37.155823  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:37.156544  3123 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:37.122918  7977 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:37.139518  8097 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:37.134439  8084 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:16:37.120422  7926 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:37.132085  7743 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:37.144201  8062 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:37.157452  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:37.188787  3051 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
W20260709 13:16:37.166009  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.172773  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:37.190184  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:37.144676  7766 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:37.175316  3164 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:37.173429  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:37.192271  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:37.192569  3191 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:37.162585  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:37.188740  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:37.147380  7719 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:37.172986  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:37.200812  3795 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 9.
I20260709 13:16:37.190543  3797 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:37.187072  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:37.144400  7978 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:37.195160  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:37.118362  7980 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:16:37.131655  7904 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:16:37.197166  3791 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:37.199023  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:37.202569  3198 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:37.202576  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:37.203768  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:37.204095  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:37.205628  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:37.207443  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 73859.9us
I20260709 13:16:37.212540  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:37.206420  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:37.210891  3091 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:37.096176  8109 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:37.156997  8103 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:37.211141  3192 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:37.214972  3091 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:37.186920  8000 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:16:37.217335  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.223246  8026 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:37.223868  8115 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:37.226532  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:37.227241  7970 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:37.229415  8014 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:37.265102  3191 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:37.230007  7766 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:37.241488  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 51371.5us
I20260709 13:16:37.241928  3126 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:16:37.268393  3126 pending_rounds.cc:85] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 7
I20260709 13:16:37.189220  8022 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:37.250941  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:37.240134  8103 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:37.242354  3091 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:37.252573  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:37.165637  7709 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:37.258735  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:37.259114  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:37.286597  3046 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:37.216497  7986 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:37.268661  3126 pending_rounds.cc:107] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:16:37.162814  8015 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:37.262633  8115 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:37.268710  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:37.239869  7743 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:37.241851  8104 raft_consensus.cc:2764] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:16:37.275115  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:37.249382  3794 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:16:37.280750  3165 leader_election.cc:400] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13.
I20260709 13:16:37.282588  8119 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.285164  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:37.286911  3198 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:37.251050  8117 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:37.290212  3125 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:37.290329  3126 raft_consensus.cc:2889] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:37.290717  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 48444.1us
I20260709 13:16:37.323877  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:37.307518  7806 consensus_meta.cc:287] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.635s	user 0.006s	sys 0.006s
I20260709 13:16:37.248229  3199 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:16:37.264925  8002 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:37.305992  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:37.335222  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:37.307757  3790 raft_consensus.cc:2393] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 16: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
W20260709 13:16:37.307906  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 49252.9us
I20260709 13:16:37.335899  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:37.336617  3197 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:37.336813  3164 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:37.312054  3165 leader_election.cc:403] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:16:37.313506  3200 raft_consensus.cc:2368] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11.
I20260709 13:16:37.313930  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:37.338721  3193 raft_consensus.cc:2393] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 13: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:37.314081  3195 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:37.286020  8094 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:37.322438  3796 raft_consensus.cc:2368] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11.
I20260709 13:16:37.324744  3198 raft_consensus.cc:2393] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 16: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:37.324878  3091 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:37.240773  7977 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:16:37.249257  8060 consensus_queue.cc:260] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:37.344923  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 64313.7us
I20260709 13:16:37.316653  8084 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:37.327431  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:37.327817  3090 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:37.316919  8106 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:37.351372  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:37.323230  8117 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.287566  8103 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:37.311712  7986 raft_consensus.cc:697] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:37.330596  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:37.348167  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:37.308457  8115 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:37.344125  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:37.347317  3046 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:37.348138  3091 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:37.425060  3197 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:37.353093  3191 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:16:37.358366  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 89740.1us
I20260709 13:16:37.359712  3195 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
I20260709 13:16:37.424561  3196 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 14: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:16:37.426851  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.427847  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:37.428164  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:37.428987  3193 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:16:37.428928  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 84912.5us
I20260709 13:16:37.430517  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:37.315799  7991 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:37.342736  7806 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:37.441951  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:37.482939  3124 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:37.482210  3121 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:37.350194  7620 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:16:37.482466  3051 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:37.351327  7926 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:37.351173  7766 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13.
I20260709 13:16:37.380438  8117 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:16:37.503532  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 73138us
I20260709 13:16:37.508575  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:37.506003  3197 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:37.520509  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:37.437579  7743 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:37.527614  3164 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:37.532750  3193 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:16:37.345894  8011 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:37.487620  8084 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:37.556157  8020 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:16:37.559190  8091 consensus_meta.cc:287] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.671s	user 0.009s	sys 0.000s
I20260709 13:16:37.559690  8091 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:37.561028  3792 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:37.559731  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:37.561946  7743 raft_consensus.cc:697] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:37.562224  3051 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:37.563052  7743 consensus_queue.cc:237] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:37.563995  7806 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:37.494483  7926 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:37.569715  3051 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:16:37.570149  7926 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:37.570704  8121 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.084s	user 0.002s	sys 0.000s
I20260709 13:16:37.571112  3762 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:37.572158  7970 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:37.572326  7709 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:37.572856  7970 raft_consensus.cc:697] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:37.503898  8113 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:37.574046  7970 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:37.498291  8017 consensus_meta.cc:287] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.009s
I20260709 13:16:37.487368  8106 raft_consensus.cc:697] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:37.544257  8131 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:37.545882  8090 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:37.545444  7986 consensus_queue.cc:237] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:37.547434  7991 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:37.547605  8107 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:37.550359  3119 raft_consensus.cc:3055] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:37.609928  3119 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:37.554637  8022 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:37.612811  8091 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:37.614719  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:37.615667  8106 consensus_queue.cc:237] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:37.618927  8097 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16.
I20260709 13:16:37.525022  7980 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:37.622493  8131 raft_consensus.cc:697] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:37.623706  8131 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:37.597265  3197 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:16:37.627007  3192 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:16:37.628024  3197 raft_consensus.cc:1240] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:37.598187  3194 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 9.
I20260709 13:16:37.360813  8119 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:37.490494  8110 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:37.619073  3196 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:16:37.605849  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 278103us
I20260709 13:16:37.638486  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:37.631841  3165 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:37.634765  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:37.640000  3051 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:37.489619  8060 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:37.645493  3197 raft_consensus.cc:1240] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:16:37.682320  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 43966.1us
I20260709 13:16:37.677354  3119 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:37.685263  3119 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:37.650449  8022 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.705065  3090 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:37.706727  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 179189us
I20260709 13:16:37.695442  3196 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:37.677066  8090 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:37.707801  3164 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:37.707556  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 359476us
I20260709 13:16:37.707391  3051 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:37.684772  8089 raft_consensus.cc:2764] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:16:37.638743  8091 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:16:37.651055  7978 consensus_queue.cc:1059] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.058s
W20260709 13:16:37.754099  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 49103.3us
I20260709 13:16:37.686316  8110 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:16:37.755306  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 45191.4us
I20260709 13:16:37.760579  3119 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:37.760715  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:37.694689  7991 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:16:37.769186  3164 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:37.775779  7806 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:37.776348  7806 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:16:37.776453  8128 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:16:37.776787  7806 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:37.778342  8132 consensus_queue.cc:1059] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
W20260709 13:16:37.780095  8130 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:16:37.784610  8109 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:37.785985  8089 consensus_queue.cc:1059] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:37.786451  8011 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:37.786303  8133 consensus_queue.cc:1059] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:37.789995  7967 raft_consensus.cc:3055] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:37.790450  7967 raft_consensus.cc:740] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:37.794457  3090 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:37.800007  3090 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:37.759208  8097 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:37.766124  8015 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:37.761435  8090 raft_consensus.cc:697] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:37.757015  8134 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:37.836359  8134 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:37.837066  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:16:37.815264  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 46213.2us
I20260709 13:16:37.708503  8022 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:37.702567  8125 consensus_queue.cc:1059] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:16:37.781327  7926 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:37.820734  8017 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:37.826613  8110 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:37.827237  8032 raft_consensus.cc:3055] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:37.830351  8090 consensus_queue.cc:237] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:37.832850  8127 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:16:37.832581  8115 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:37.848483  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:37.837126  8134 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:37.755636  7977 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:16:37.801364  7967 consensus_queue.cc:260] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:37.874750  8119 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:37.874866  7967 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:37.859575  8032 raft_consensus.cc:740] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:37.877117  8032 consensus_queue.cc:260] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:37.878232  8032 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:37.854033  3164 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:37.856454  3119 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:37.860267  3126 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:16:37.849182  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 84024.7us
I20260709 13:16:37.865290  3199 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:37.867754  3761 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:37.868109  7926 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:37.869931  8115 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:37.886526  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 459776us
W20260709 13:16:37.896174  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.897006  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:37.888485  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:37.898103  3124 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:16:37.889869  8015 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:37.891517  7743 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:37.853556  8020 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:16:37.877629  8014 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:37.895255  8104 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.900636  7551 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:37.919919  3046 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:16:37.920440  3046 pending_rounds.cc:85] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 4
I20260709 13:16:37.920738  3046 pending_rounds.cc:107] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:16:37.921047  3046 raft_consensus.cc:2889] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:37.904361  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:37.926626  3051 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:37.900943  7977 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:37.902432  7904 raft_consensus.cc:2764] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:16:37.902283  8114 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:37.917829  8103 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:37.900902  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:37.911327  8138 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:16:37.902294  7990 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:37.897678  8135 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 13:16:37.949855  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 106014us
I20260709 13:16:37.900964  8119 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:16:37.945359  7551 raft_consensus.cc:697] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 14 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:16:37.954988  8122 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.410s	user 0.003s	sys 0.001s
I20260709 13:16:37.954851  7551 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:37.904840  7719 consensus_queue.cc:1059] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:16:37.947584  8114 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:37.966720  8022 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:37.968585  8114 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:37.939488  8014 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:37.944097  8129 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.184s	user 0.002s	sys 0.000s
I20260709 13:16:37.940606  7732 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.951870  7990 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:37.987321  3793 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:37.990264  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:38.012809  3051 raft_consensus.cc:2393] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 15: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:37.993113  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:37.996395  3191 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:37.998262  3195 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
W20260709 13:16:38.000365  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 49506.5us
I20260709 13:16:38.015326  3192 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 11: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:38.015473  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:38.138923  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:38.149158  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:38.149593  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:38.150405  3123 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:38.157862  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:38.158897  3798 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:38.161900  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:38.172076  3118 raft_consensus.cc:2393] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:37.987243  8114 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:37.919209  8104 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:37.905064  7806 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:38.175243  7986 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.022s	sys 0.040s
I20260709 13:16:38.206223  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:38.200672  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:38.209072  3122 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:38.188894  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:38.189189  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:38.211619  3790 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:38.212246  3118 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:16:38.182875  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:38.193642  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:38.213517  3125 raft_consensus.cc:1813] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Handling vote request from an unknown peer 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:38.272423  3125 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:38.194303  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:38.193589  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:38.273155  3123 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:38.194798  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.198721  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:38.201390  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:38.188015  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:38.193567  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:38.275556  3797 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:38.214033  3794 raft_consensus.cc:2393] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 10: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:38.000973  7743 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.195s
I20260709 13:16:38.185953  7978 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:38.192598  8114 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.277115  3792 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:16:38.206038  7986 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.022s	sys 0.040s
I20260709 13:16:38.280867  3121 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:38.011284  7732 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:38.010107  8014 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:38.300180  3123 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:38.203300  8107 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:16:38.173240  8011 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.126s
I20260709 13:16:38.293653  3193 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:16:38.283531  7978 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.335480  3119 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:16:38.295746  8114 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:38.342715  7978 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:38.371549  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 472321us
I20260709 13:16:38.374002  3051 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:38.379338  3042 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:38.383275  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2371) took 1288 ms. Trace:
I20260709 13:16:38.383740  3049 rpcz_store.cc:276] 0709 13:16:37.094452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.109710 (+ 15258us) service_pool.cc:224] Handling call
0709 13:16:37.122160 (+ 12450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:37.144072 (+ 21912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:37.144100 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:37.166707 (+ 22607us) log.cc:844] Serialized 26 byte log entry
0709 13:16:37.342613 (+175906us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:37.342643 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.342700 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.793300 (+450600us) raft_consensus.cc:1685] finished
0709 13:16:37.793331 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.372883 (+579552us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b540029cf50. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:38.383178 (+ 10295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5032,"raft.queue_time_us":5671,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":13893,"spinlock_wait_cycles":27790592,"thread_start_us":103583,"threads_started":1,"wal-append.queue_time_us":403657}
I20260709 13:16:38.385502  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:38.426507  3042 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:38.384794  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:38.428982  3044 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:16:38.433350  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 55507.7us
W20260709 13:16:38.433851  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.434381  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:38.280900  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 480977us
I20260709 13:16:38.436848  3090 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:38.443645  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:38.444350  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:38.445562  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:38.446580  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.448949  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:38.449577  3048 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:38.450543  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:38.451035  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:38.459331  3798 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:38.429447  8103 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:38.440289  7990 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:38.462944  3090 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:38.465289  7970 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.481397  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:38.489645  3048 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:38.490126  3794 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:38.482746  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:38.462678  8094 raft_consensus.cc:3055] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:38.494969  3122 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:38.495168  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:38.511942  3042 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
W20260709 13:16:38.523388  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.524822  3794 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:16:38.476151  8154 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:38.528725  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 94402.3us
W20260709 13:16:38.488554  7719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.006s	sys 0.006s
I20260709 13:16:38.530306  8111 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:38.534061  3050 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.001s	sys 0.012s
W20260709 13:16:38.538105  3050 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.001s	sys 0.012s
I20260709 13:16:38.539628  8119 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:38.540221  8119 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:38.540717  8119 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:38.529238  3090 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:38.551817  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:38.496306  8094 raft_consensus.cc:740] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:16:38.575454  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46292.9us
W20260709 13:16:38.533823  7719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.006s	sys 0.007s
I20260709 13:16:38.528366  7990 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.497704  8150 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:38.584004  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:38.587548  3194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34728 (request call id 747) took 1496 ms (client timeout 1716 ms). Trace:
W20260709 13:16:38.591518  3194 rpcz_store.cc:269] 0709 13:16:37.090824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.132244 (+ 41420us) service_pool.cc:224] Handling call
0709 13:16:38.587331 (+1455087us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b540013c9d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:38.587477 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":938105600}
I20260709 13:16:38.523500  7806 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:38.592224  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:38.523942  8155 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:38.526240  8104 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:38.594797  3090 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:38.594676  3762 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:38.537185  8157 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:38.581875  8146 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.615993  8146 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:38.618265  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 87823.6us
I20260709 13:16:38.582144  8020 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.581704  7732 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:38.498271  7970 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:38.599560  8155 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:38.555778  8111 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:38.598421  8133 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:38.644532  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:38.614300  8011 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:38.597713  8014 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:38.681962  3164 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:38.620241  8110 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:38.599120  7719 consensus_queue.cc:1059] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:16:38.643782  7806 consensus_queue.cc:1059] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:16:38.599387  8132 consensus_queue.cc:1059] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:16:38.683947  3798 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:38.537521  8154 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:38.644378  8149 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 13:16:38.612057  8131 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:16:38.637930  8157 raft_consensus.cc:697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 14 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:16:38.710815  8117 consensus_meta.cc:287] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.136s	user 0.012s	sys 0.001s
I20260709 13:16:38.598320  7990 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:38.713532  8060 consensus_meta.cc:287] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.032s	user 0.012s	sys 0.002s
I20260709 13:16:38.668893  7551 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:38.710597  8144 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:38.684489  8133 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:38.723208  8145 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.293s	user 0.001s	sys 0.001s
W20260709 13:16:38.747049  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 152314us
I20260709 13:16:38.682358  8155 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:38.681917  7977 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:16:38.733012  8106 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:38.750622  7986 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.673059  8162 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.115s
I20260709 13:16:38.748955  8150 raft_consensus.cc:3055] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:38.757067  8133 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:38.747489  8011 raft_consensus.cc:697] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:38.753952  7926 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:38.637363  8020 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:38.723445  8159 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:16:38.755138  8090 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:38.753332  8148 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.729451  8014 consensus_queue.cc:1059] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:16:38.710191  8094 consensus_queue.cc:260] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:38.811869  8094 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:38.757207  8166 raft_consensus.cc:3055] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:38.829708  8166 raft_consensus.cc:740] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:38.831837  8159 raft_consensus.cc:3055] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:38.832298  8159 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:16:38.834568  8164 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:16:38.838443  8114 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:38.840819  8114 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:38.843151  8158 log.cc:927] Time spent T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:16:38.750622  8117 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:38.808431  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 861) took 1247 ms. Trace:
W20260709 13:16:38.809052  8151 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.304s	user 0.001s	sys 0.001s
I20260709 13:16:38.809950  8148 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:38.836829  8011 consensus_queue.cc:237] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:38.830826  8166 consensus_queue.cc:260] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:38.852847  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:38.882056  3047 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:38.880615  3045 rpcz_store.cc:276] 0709 13:16:37.560621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.560774 (+   153us) service_pool.cc:224] Handling call
0709 13:16:37.561105 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.430245 (+869140us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:38.430293 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.430820 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:16:38.595091 (+164271us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:38.595124 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.595220 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:38.808158 (+212938us) raft_consensus.cc:1685] finished
0709 13:16:38.808187 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.808364 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":339707,"raft.queue_time_us":407931,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":653199,"threads_started":2,"wal-append.queue_time_us":317723}
I20260709 13:16:38.883967  3762 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:38.850469  3121 raft_consensus.cc:2368] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16.
I20260709 13:16:38.865819  3793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 652) took 1685 ms. Trace:
I20260709 13:16:38.886539  3793 rpcz_store.cc:276] 0709 13:16:37.180560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.180766 (+   206us) service_pool.cc:224] Handling call
0709 13:16:37.197964 (+ 17198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:38.010967 (+813003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.865442 (+854475us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54004bb254. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:38.865706 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814843776}
I20260709 13:16:38.787896  8150 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:38.898602  8150 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:38.899226  7732 raft_consensus.cc:3055] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:38.899731  7732 raft_consensus.cc:740] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:38.900007  8150 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:38.900614  7732 consensus_queue.cc:260] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:38.849915  8153 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
I20260709 13:16:38.789260  7986 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:38.904580  7986 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:38.849613  7978 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:38.850912  7970 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:38.853318  8159 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:38.758976  7551 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:38.854429  8032 consensus_meta.cc:287] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.976s	user 0.013s	sys 0.000s
I20260709 13:16:38.893563  8060 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:38.849815  8117 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:38.775132  8146 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:38.861567  8089 raft_consensus.cc:3055] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:38.919942  3045 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:38.859123  8090 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:38.916275  3047 raft_consensus.cc:1275] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:38.928292  8148 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:38.895174  8107 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.906944  7978 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:38.979760  3045 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:38.922297  8166 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:38.919045  7977 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:38.980790  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 57360.5us
W20260709 13:16:38.981408  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 345662us
W20260709 13:16:38.981299  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 382569us
I20260709 13:16:38.929925  8060 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:38.992396  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.952066  8089 raft_consensus.cc:740] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:38.995486  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:38.959038  8104 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:38.998157  8172 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:39.000003  8172 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.000479  8172 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:38.999727  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:39.002265  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:38.993865  7977 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.004541  7551 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:38.989809  7926 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.006283  7926 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.008671  7926 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:39.013863  8104 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.015945  8089 consensus_queue.cc:260] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.017241  8089 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:39.021690  7978 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.022367  7978 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.024711  7978 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:38.996343  8060 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:39.032788  8174 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:39.033815  7719 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:39.034243  7719 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:39.034658  7719 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:39.005391  7977 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
W20260709 13:16:39.045140  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 363240us
I20260709 13:16:39.047633  3164 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:39.050829  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 48628.5us
I20260709 13:16:39.055414  3164 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:38.913599  8157 consensus_queue.cc:237] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.060325  7926 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:39.064184  8111 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:39.088459  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet 1247b6af0f274b8c9d99b6be2d7fbc6b: Illegal state: Replica 501fdf2af2bc4b0c971ae880e98f466b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:39.060922  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:38.986394  8107 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.047119  8174 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.082329  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:39.053753  8114 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:39.098131  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:39.064694  7977 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:16:39.106571  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 114920us
I20260709 13:16:39.108198  3793 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:39.105981  8190 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:39.110108  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:39.112124  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:39.114041  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:39.117448  3164 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:39.119031  3015 leader_election.cc:400] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11.
I20260709 13:16:39.123121  3015 leader_election.cc:403] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:16:39.086772  8154 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:39.125985  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet aef26e81d3be4bc0883542eb71924948: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:39.126760  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:39.115341  8111 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:39.119628  7551 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:39.123682  8090 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:16:39.138816  8143 log.cc:927] Time spent T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.784s	user 0.005s	sys 0.004s
W20260709 13:16:39.141081  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 147832us
W20260709 13:16:39.143144  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 382689us
I20260709 13:16:39.148213  3091 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:39.149930  8148 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:39.150460  8148 raft_consensus.cc:697] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:39.151081  8133 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.151367  8148 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.152060  8159 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:39.153366  8133 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:39.163694  7719 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:39.171036  8123 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 1.673s	user 0.005s	sys 0.002s
I20260709 13:16:39.172227  7719 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:39.174453  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:39.175101  3050 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:16:39.176400  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.179484  8107 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:39.179738  8176 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.369s	user 0.002s	sys 0.000s
I20260709 13:16:39.157117  7904 raft_consensus.cc:3055] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:39.157634  8162 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.180181  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:39.180959  3043 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:39.180670  8162 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:39.181460  8170 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.362s	user 0.000s	sys 0.001s
I20260709 13:16:39.182914  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2293) took 1002 ms. Trace:
I20260709 13:16:39.183138  8162 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:39.119661  8172 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:39.159250  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:39.183275  3126 rpcz_store.cc:276] 0709 13:16:38.180119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.283716 (+103597us) service_pool.cc:224] Handling call
0709 13:16:38.325459 (+ 41743us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:38.353269 (+ 27810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.353316 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:38.380800 (+ 27484us) log.cc:844] Serialized 52 byte log entry
0709 13:16:38.615776 (+234976us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:38.615820 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.615889 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:39.180722 (+564833us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:39.182610 (+  1888us) raft_consensus.cc:1685] finished
0709 13:16:39.182632 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.182859 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67414,"raft.queue_time_us":18835,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":17657,"spinlock_wait_cycles":50671360,"thread_start_us":167663,"threads_started":1,"wal-append.queue_time_us":389164}
I20260709 13:16:39.159952  8109 raft_consensus.cc:3055] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:39.124898  7977 raft_consensus.cc:697] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:39.118453  8000 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:16:39.136694  8189 consensus_queue.cc:1059] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
W20260709 13:16:39.162465  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.164142  7978 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.131693  8114 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:39.166508  3042 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:39.203612  3793 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: []
W20260709 13:16:39.167018  8184 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
W20260709 13:16:39.169648  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.205438  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:39.122418  8178 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:39.207634  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.187248  3795 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13. Ops: []
W20260709 13:16:39.208102  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.208328  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:39.209339  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:39.211010  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:39.191318  3050 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:16:39.192651  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:39.127483  8154 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11.
I20260709 13:16:39.145340  7990 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:39.219314  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:39.217154  3091 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:39.216320  3790 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:16:39.220414  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:39.220883  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:39.216670  8133 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.218608  7663 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:39.223642  8133 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.225097  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:39.215318  7719 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:16:39.226301  7719 consensus_queue.cc:1243] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:39.226440  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:39.226815  3799 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:16:39.227159  3790 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:39.228287  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:39.230159  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:39.230942  3793 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:39.231653  8104 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:39.232158  3795 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:39.223747  7663 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.237558  3761 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:39.180302  7904 raft_consensus.cc:740] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:39.233795  3125 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:39.234696  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:39.235388  3124 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:16:39.206638  8119 consensus_meta.cc:287] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.665s	user 0.009s	sys 0.006s
I20260709 13:16:39.240191  3117 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:16:39.189296  8109 raft_consensus.cc:740] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:39.188977  8106 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:39.244688  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:39.241443  3123 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:16:39.243889  3126 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:39.243937  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:39.232731  8189 raft_consensus.cc:3055] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:39.246165  8189 raft_consensus.cc:740] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:39.247252  8189 consensus_queue.cc:260] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.247699  8162 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:39.248345  8162 consensus_queue.cc:1243] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:39.248600  8189 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:39.249099  3761 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:39.210075  8014 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.250991  3122 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:16:39.244360  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:39.252415  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:39.253103  3044 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:39.252431  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:39.254276  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:39.255795  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:39.215472  8094 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.217353  8178 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:39.260804  3124 raft_consensus.cc:1275] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:39.249922  8162 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:39.262816  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:39.115257  8174 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.241118  8125 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:39.245347  8146 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:39.257308  8110 raft_consensus.cc:2764] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:16:39.257682  8132 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:39.219458  7978 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.262486  8015 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:39.259526  8133 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:39.258255  8104 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:39.260353  8114 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:39.260465  8178 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:39.322639  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:39.262202  8014 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.275918  7990 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:39.258006  8106 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.277429  8125 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.264319  8091 consensus_queue.cc:1059] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:16:39.256054  8119 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.323397  3795 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:39.323004  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:39.267554  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:39.263650  8094 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.325060  3796 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 14. Current term is 15. Ops: []
W20260709 13:16:39.325870  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.266554  7719 consensus_queue.cc:1059] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:16:39.329852  3798 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:39.267544  8032 consensus_queue.cc:1059] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:16:39.314945  3790 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:16:38.208531  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:39.290920  8132 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.275918  8131 consensus_queue.cc:1059] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:16:39.342087  8192 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:39.346416  8188 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
W20260709 13:16:39.347187  8196 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:16:39.353816  8125 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:39.354657  8174 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:39.356096  8110 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.295141  7904 consensus_queue.cc:260] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.316016  8015 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.298731  8117 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
W20260709 13:16:39.467176  8150 consensus_meta.cc:287] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.004s
I20260709 13:16:39.372493  8020 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:39.445226  8110 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.379278  8206 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.469039  8206 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.330752  7977 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.471185  8206 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:39.384066  7663 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:39.295625  8109 consensus_queue.cc:260] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.473800  8109 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:39.393812  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:39.479212  3051 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:16:39.394435  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:39.483595  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:39.484220  3125 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:39.435767  8106 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:39.395720  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 128227us
I20260709 13:16:39.488095  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:39.397982  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:39.488896  3047 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
W20260709 13:16:39.410144  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.492954  8119 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:39.428243  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 138749us
I20260709 13:16:39.428893  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:39.494547  3044 raft_consensus.cc:2410] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 13:16:39.495412  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 366271us
I20260709 13:16:39.495733  3090 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:39.397221  7990 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:39.498777  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:39.499053  8096 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:39.499456  3121 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:39.499969  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:39.492942  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 753) took 1498 ms. Trace:
I20260709 13:16:39.415179  8132 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:39.433504  8114 raft_consensus.cc:3055] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:39.456929  8181 raft_consensus.cc:3055] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:39.462260  7904 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:39.462670  8015 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:39.493075  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2076) took 2418 ms. Trace:
I20260709 13:16:39.527446  3193 rpcz_store.cc:276] 0709 13:16:37.075048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.582073 (+507025us) service_pool.cc:224] Handling call
0709 13:16:37.604668 (+ 22595us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.335931 (+731263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.492843 (+1156912us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b540013abd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:39.493017 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1583652736}
I20260709 13:16:39.394971  8103 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.493096  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:39.532068  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2784) took 1065 ms. Trace:
I20260709 13:16:39.532480  3048 rpcz_store.cc:276] 0709 13:16:38.466717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.517244 (+ 50527us) service_pool.cc:224] Handling call
0709 13:16:38.535154 (+ 17910us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.676586 (+141432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.676659 (+    73us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.738300 (+ 61641us) log.cc:844] Serialized 26 byte log entry
0709 13:16:38.958772 (+220472us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:38.958827 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.958966 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:39.531854 (+572888us) raft_consensus.cc:1685] finished
0709 13:16:39.531874 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.532009 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20748,"raft.queue_time_us":78973,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":8861,"thread_start_us":269026,"threads_started":2,"wal-append.queue_time_us":327011}
I20260709 13:16:39.493609  8017 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:39.506950  3795 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
W20260709 13:16:39.437223  8155 consensus_meta.cc:287] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.004s
I20260709 13:16:39.454979  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:39.514604  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:39.424419  8192 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.430989  8104 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:39.510561  3762 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:39.522894  8135 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.501200  3200 rpcz_store.cc:276] 0709 13:16:37.994711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.994851 (+   140us) service_pool.cc:224] Handling call
0709 13:16:38.140328 (+145477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.190064 (+ 49736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.190138 (+    74us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.190730 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:16:39.028087 (+837357us) spinlock_profiling.cc:243] Waited 6.63 ms on lock 0x7b180037c840. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:16:39.113333 (+ 85246us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:39.126497 (+ 13164us) log.cc:844] Serialized 14 byte log entry
0709 13:16:39.492440 (+365943us) spinlock_profiling.cc:243] Waited 961 us on lock 0x7b180037c840. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d240c0a 00007ff836980219 00007ff82d2c8a40 00007ff82d2c34e4 00007ff82d2c3455 00007ff8303ab060 00007ff8303bd716 00007ff8303ce287 00007ff8303ce208
0709 13:16:39.492608 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.492678 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:39.492725 (+    47us) raft_consensus.cc:1685] finished
0709 13:16:39.492736 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.492847 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69381,"prepare.queue_time_us":13724,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":656459,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":9120,"spinlock_wait_cycles":17453184,"thread_start_us":84594,"threads_started":1,"wal-append.queue_time_us":931305}
I20260709 13:16:39.485496  8146 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:39.529476  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.451961  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:39.534672  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:39.558661  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.558988  3044 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
W20260709 13:16:39.559294  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.514976  8172 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:39.540524  3119 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:16:39.560141  3119 pending_rounds.cc:85] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 12
I20260709 13:16:39.560407  3119 pending_rounds.cc:107] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:16:39.560644  3119 raft_consensus.cc:2889] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:39.560149  8172 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.562990  8172 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:39.522379  8181 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:39.567842  3761 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:39.540741  8089 consensus_meta.cc:287] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
I20260709 13:16:39.516607  8114 raft_consensus.cc:740] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:39.522159  8106 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:39.540028  3042 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:39.508424  3091 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:39.550235  8155 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.555830  7970 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:39.583037  8162 raft_consensus.cc:3055] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:39.584975  7978 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:39.586742  7732 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:39.591104  8179 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:16:39.591316  8154 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.621234  7719 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:39.630690  8154 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.632894  8154 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:39.627156  7806 consensus_queue.cc:1059] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:16:39.624409  7663 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:39.639307  8165 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:39.640137  8161 log.cc:927] Time spent T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.829s	user 0.005s	sys 0.000s
W20260709 13:16:39.641031  8147 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 1.286s	user 0.004s	sys 0.004s
I20260709 13:16:39.613884  8162 raft_consensus.cc:740] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:39.642190  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2292) took 1462 ms. Trace:
I20260709 13:16:39.544641  3125 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:16:39.591475  8104 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.608016  3042 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:39.642720  3118 rpcz_store.cc:276] 0709 13:16:38.179809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.278558 (+ 98749us) service_pool.cc:224] Handling call
0709 13:16:38.278966 (+   408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:38.279376 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.279407 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:38.308227 (+ 28820us) log.cc:844] Serialized 52 byte log entry
0709 13:16:38.620681 (+312454us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:38.757598 (+136917us) log.cc:844] Serialized 14 byte log entry
0709 13:16:39.132569 (+374971us) log.cc:844] Serialized 14 byte log entry
0709 13:16:39.146848 (+ 14279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.146935 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:39.639287 (+492352us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:39.641877 (+  2590us) raft_consensus.cc:1685] finished
0709 13:16:39.641909 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.642115 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":390684,"prepare.queue_time_us":136975,"prepare.run_cpu_time_us":147,"prepare.run_wall_time_us":2738,"raft.queue_time_us":396629,"raft.run_cpu_time_us":414,"raft.run_wall_time_us":37735,"spinlock_wait_cycles":46502656,"thread_start_us":412246,"threads_started":2,"wal-append.queue_time_us":502653}
I20260709 13:16:39.647558  8154 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.648218  3118 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:39.648053  8154 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.649435  3118 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:39.650215  8154 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:39.654296  8133 raft_consensus.cc:3055] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:39.654747  8133 raft_consensus.cc:740] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:39.655696  8133 consensus_queue.cc:260] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.657226  8133 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:39.616194  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 128148us
I20260709 13:16:39.662955  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:39.664239  3015 leader_election.cc:400] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 10 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 10. Current term is 11.
I20260709 13:16:39.664731  8097 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.665267  8097 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.666154  8017 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.666657  8017 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.667307  8097 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:39.668716  8017 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:39.629494  8106 raft_consensus.cc:697] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:39.669477  8172 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.669975  8172 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.670307  8106 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.672361  8172 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:39.673753  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:39.674440  3200 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:39.674844  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:39.675642  3193 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:39.570261  8135 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.678073  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:39.678606  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:39.678910  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:39.679260  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:39.679594  3199 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:16:39.680416  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:39.680591  8155 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:39.680938  3192 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:39.614434  7970 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.681597  7970 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:39.681669  8135 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:39.617673  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 109314us
I20260709 13:16:39.683544  3200 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:39.685149  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:39.685289  3046 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:16:39.689909  8192 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:39.619165  3120 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:39.690773  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:39.523231  8206 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:16:39.547318  7926 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.521651  8060 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.613780  7990 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.516181  8178 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.644485  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:39.558984  8110 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:39.536924  8103 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.677454  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:39.715627  3195 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:39.715756  7990 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.699138  7926 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.718266  7990 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:39.718400  7926 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:39.720391  8060 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:39.653643  8094 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:39.702821  8206 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:39.722388  3793 raft_consensus.cc:2393] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 13: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:39.722656  8206 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.723474  8103 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:39.685830  3045 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:39.725030  8206 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:39.725698  8154 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:39.726297  8154 raft_consensus.cc:697] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 14 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:39.518038  8119 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:16:39.687687  8104 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:39.688277  8014 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:39.695667  3192 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:39.695979  3090 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:39.696808  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:39.745464  3118 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:39.696914  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:39.605937  3762 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:39.698105  8020 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:16:39.702353  3120 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:39.703647  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:39.697968  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 567850us
W20260709 13:16:39.712756  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 216354us
W20260709 13:16:39.737468  8159 consensus_meta.cc:287] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.585s	user 0.013s	sys 0.000s
W20260709 13:16:39.752825  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 146961us
W20260709 13:16:39.754905  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 58059.1us
I20260709 13:16:39.738232  7970 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.770022  8154 consensus_queue.cc:237] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.770776  8103 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:39.772086  7970 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:39.772214  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 70537.8us
I20260709 13:16:39.713620  8015 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.713135  7663 raft_consensus.cc:697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:16:39.748235  8166 consensus_meta.cc:287] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.760s	user 0.009s	sys 0.002s
I20260709 13:16:39.820221  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:39.789835  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:39.792613  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:39.822429  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:39.822696  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:39.795322  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:39.796020  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:39.801569  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:39.814951  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:39.817099  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 121200us
I20260709 13:16:39.712033  8155 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:16:39.825802  3191 pending_rounds.cc:85] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 8
I20260709 13:16:39.775136  3164 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:39.826323  3191 pending_rounds.cc:107] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 11.9
W20260709 13:16:39.817876  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.826627  3191 raft_consensus.cc:2889] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:39.827181  3046 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:16:39.827564  3046 pending_rounds.cc:85] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 8
I20260709 13:16:39.823743  3047 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:39.827814  3046 pending_rounds.cc:107] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:16:39.824132  3049 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:16:39.824208  3192 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:39.828588  3091 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:39.828792  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:39.642932  8162 consensus_queue.cc:260] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.839468  3192 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:16:39.748437  8115 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:39.826571  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 51547.2us
I20260709 13:16:39.823488  3044 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:39.863607  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:39.829703  3046 raft_consensus.cc:2889] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:39.823424  3042 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:39.864764  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:39.865342  3044 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:39.834563  3197 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:16:39.866482  3044 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:39.867166  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:39.868711  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:39.834731  3762 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:39.870967  3762 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:39.825536  3045 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:39.745568  8135 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.774121  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:16:39.873955  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 99935.7us
I20260709 13:16:39.874596  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:39.875907  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:39.876668  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:39.877945  7719 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:39.842288  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:39.824757  3124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.053s	sys 0.120s
I20260709 13:16:39.846714  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:39.847204  3193 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:39.823585  7732 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:16:39.845155  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 88512.6us
W20260709 13:16:39.822918  8161 log.cc:927] Time spent T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:16:39.818280  8014 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:39.818944  8094 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:39.848263  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:39.818423  8103 raft_consensus.cc:697] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:39.855413  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:39.858788  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:39.878002  7904 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:39.878518  8104 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:39.852483  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:39.886266  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:39.878088  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:39.878537  7990 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:39.893276  3200 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
W20260709 13:16:39.893213  3124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.056s	sys 0.122s
I20260709 13:16:39.894559  7990 raft_consensus.cc:697] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:39.894742  3200 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:39.893307  8094 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.895629  7990 consensus_queue.cc:237] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.896525  3051 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:39.896243  3192 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:16:39.898011  7904 raft_consensus.cc:697] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:39.899060  7904 consensus_queue.cc:237] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.900058  8104 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:39.900471  8104 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:39.891134  7719 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:39.896270  8094 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:39.902503  7719 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:39.893208  3196 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:39.879415  3049 raft_consensus.cc:2410] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:16:39.907346  3049 raft_consensus.cc:1240] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:39.891986  8103 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.914155  8022 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:39.914804  8022 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.915221  8022 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:39.916132  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 45224.8us
I20260709 13:16:39.892712  3198 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:16:39.919870  7978 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:39.869625  3197 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:39.932796  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:39.934525  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:39.934674  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:39.936651  3121 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:39.932979  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:39.938908  3196 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:39.939181  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:39.940809  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.943897  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:39.947165  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:39.947785  3117 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:39.948998  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:39.823087  8187 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.959318  3051 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:16:39.971201  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:39.966509  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:39.819923  8017 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:16:39.971797  3762 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:39.963143  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:39.983878  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:39.984457  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:39.984754  3192 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:39.985697  3049 raft_consensus.cc:2410] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:16:39.990957  3193 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:16:39.972239  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:39.820088  8172 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:16:39.820194  8097 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:16:39.998507  3044 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:39.999397  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:16:40.012794  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 165309us
I20260709 13:16:39.769572  8125 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:39.859635  8162 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:40.035355  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:40.036716  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:40.036827  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:39.873214  8135 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.852305  8091 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.853065  8089 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:39.828665  7743 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.131s
I20260709 13:16:39.850337  8111 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:40.041903  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:40.095548  3793 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:40.097362  3793 raft_consensus.cc:606] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:40.097498  3123 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:16:40.097885  3793 raft_consensus.cc:614] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:40.042761  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:40.045984  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 126926us
W20260709 13:16:40.048076  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 185296us
I20260709 13:16:40.110599  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:40.048288  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:40.111869  3196 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:40.051061  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:39.951757  7980 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.057044  3043 raft_consensus.cc:2955] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 5 to 9, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:40.003824  8187 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:39.816425  8114 consensus_queue.cc:260] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.035861  8166 raft_consensus.cc:2764] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:16:40.013491  8011 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:16:40.067041  8212 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:16:40.067466  7663 consensus_queue.cc:237] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.124589  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:39.853643  7970 consensus_queue.cc:1059] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.184s
I20260709 13:16:40.078047  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:40.134056  3045 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:40.134083  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:40.079383  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.058390  8084 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:16:40.050880  7990 consensus_queue.cc:1059] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:16:40.081125  8015 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:40.082602  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:40.100685  8165 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:40.095217  8089 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.112829  3192 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:16:40.144726  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:40.102653  3049 raft_consensus.cc:2410] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 13:16:40.114797  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 72162.9us
I20260709 13:16:39.997360  8115 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:40.118115  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 104427us
I20260709 13:16:40.147387  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:40.147805  3091 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:40.148056  3791 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:40.148303  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:40.124265  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:40.039502  3198 pending_rounds.cc:85] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 6
I20260709 13:16:40.150882  3198 pending_rounds.cc:107] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:16:40.151196  3198 raft_consensus.cc:2889] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:40.152037  8214 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:16:40.153529  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:40.154367  3192 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:40.155223  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:40.155792  3192 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:40.157989  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:40.158631  3799 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
W20260709 13:16:40.159757  8211 log.cc:927] Time spent T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:16:40.163058  8135 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:40.163313  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:40.163686  8135 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:40.164039  8135 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.164367  8135 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:40.166332  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:40.129609  3200 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:40.168874  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:40.169785  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:40.173489  3090 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:40.169646  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:40.178525  3119 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:40.165203  7719 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.135615  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:40.190570  3795 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:40.092161  3047 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:40.135083  3792 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:40.121830  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:40.179898  3042 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:16:40.192029  3196 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:40.181568  3090 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:40.182690  3049 raft_consensus.cc:1275] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:16:40.194299  8146 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:40.194540  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:40.195029  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:40.195103  3126 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:40.195719  3049 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:16:40.187247  8110 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:40.193243  3762 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:40.100911  8111 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.197990  8111 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:40.198804  3795 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:40.199398  3795 raft_consensus.cc:606] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:40.199730  8103 consensus_queue.cc:1059] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:40.200611  8103 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:16:40.201081  2944 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49738 (request call id 149) took 26376 ms (client timeout 15000 ms). Trace:
I20260709 13:16:40.201421  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:40.201920  8174 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:40.202231  7991 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:40.202128  8146 consensus_queue.cc:1048] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:40.202466  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:40.203215  8210 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:16:39.859779  8060 consensus_queue.cc:1175] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f20672b2852447a6bc1e137c4dd40904" responder_term: 14 status { last_received { term: 13 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:40.191923  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:40.205804  3047 raft_consensus.cc:2410] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:16:40.094825  8091 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:40.187911  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:40.187438  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:40.192963  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:40.166193  8178 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:40.202186  3123 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:40.278614  3045 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:40.149430  8089 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:40.205237  7986 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.285153  3798 raft_consensus.cc:2410] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:16:40.158051  7990 raft_consensus.cc:3055] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:16:40.197557  8229 log.cc:927] Time spent T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:16:40.292246  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:40.193280  3042 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:16:40.188711  8213 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:16:40.261466  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 79977.5us
I20260709 13:16:40.265431  3799 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:40.265956  3192 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:16:40.126232  8144 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:16:40.121263  7980 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:40.189939  8107 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.206449  8114 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:40.201490  2944 rpcz_store.cc:269] 0709 13:16:13.824520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.824751 (+   231us) service_pool.cc:224] Handling call
0709 13:16:13.898990 (+ 74239us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b54000d98d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031d090 00007ff8303bbf3a 00007ff8361721cc 00007ff83627037e 00007ff8347312a4 00007ff834731232 00007ff834731161 00007ff8347310dc 00007ff834730392 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:40.200990 (+26302000us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:34.494345 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:34.495374 (+  1029us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:34.495494 (+   120us) write_op.cc:435] Acquired schema lock
0709 13:16:34.495519 (+    25us) tablet.cc:662] Decoding operations
0709 13:16:34.904633 (+409114us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:34.937268 (+ 32635us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:34.937321 (+    53us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:16:35.190514 (+253193us) tablet.cc:701] Row locks acquired
0709 13:16:35.240913 (+ 50399us) write_op.cc:260] PREPARE: finished
0709 13:16:35.272318 (+ 31405us) write_op.cc:270] Start()
0709 13:16:35.301730 (+ 29412us) write_op.cc:276] Timestamp: P: 1783602995266082 usec, L: 0
0709 13:16:35.314364 (+ 12634us) op_driver.cc:348] REPLICATION: starting
0709 13:16:35.470430 (+156066us) log.cc:844] Serialized 4110 byte log entry
0709 13:16:36.350063 (+879633us) op_driver.cc:464] REPLICATION: finished
0709 13:16:36.584193 (+234130us) write_op.cc:301] APPLY: starting
0709 13:16:36.608636 (+ 24443us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:36.703336 (+ 94700us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:36.703472 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:36.908260 (+204788us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:36.908709 (+   449us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 13:16:36.908801 (+    92us) write_op.cc:312] APPLY: finished
0709 13:16:36.909294 (+   493us) log.cc:844] Serialized 97 byte log entry
0709 13:16:36.921102 (+ 11808us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:36.933456 (+ 12354us) write_op.cc:454] Released schema lock
0709 13:16:36.938899 (+  5443us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:36.970677 (+ 31778us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:36.979955 (+  9278us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34760,"reported_tablets":28,"spinlock_wait_cycles":116634496,"child_traces":[["op",{"apply.queue_time_us":203285,"apply.run_cpu_time_us":19938,"apply.run_wall_time_us":378368,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45947,"num_ops":10,"prepare.queue_time_us":476974,"prepare.run_cpu_time_us":58196,"prepare.run_wall_time_us":1361162,"raft.queue_time_us":232215,"raft.run_cpu_time_us":21653,"raft.run_wall_time_us":181256,"replication_time_us":1035520,"thread_start_us":773478,"threads_started":4,"wal-append.queue_time_us":397340,"wal-append.run_cpu_time_us":19517,"wal-append.run_wall_time_us":2008248}]]}
I20260709 13:16:40.289508  3200 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:16:40.258441  3051 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:40.201105  8103 raft_consensus.cc:697] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:40.232326  8090 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:40.259387  8190 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.259744  8172 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.312753  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:40.310468  8234 raft_consensus.cc:3055] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:40.292100  7990 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:40.189267  8155 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.102s
W20260709 13:16:40.290148  8132 consensus_meta.cc:287] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.763s	user 0.010s	sys 0.000s
I20260709 13:16:40.331287  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:40.372291  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:40.376852  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:40.377750  3192 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:16:40.205529  8032 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:16:40.189559  8166 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:16:40.228662  8159 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:16:40.346719  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:40.278510  8154 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:40.309172  8189 consensus_meta.cc:287] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.060s	user 0.009s	sys 0.005s
I20260709 13:16:40.293517  8210 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:40.311919  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 124577us
I20260709 13:16:40.359944  3193 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:40.349905  8146 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.384581  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:40.400292  3194 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:40.326499  7986 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:40.404155  3791 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:16:40.380097  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:40.404563  3050 raft_consensus.cc:2410] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:16:40.400638  3761 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:40.345429  8113 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:16:40.367096  8234 raft_consensus.cc:740] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:40.378017  8119 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:40.375783  7991 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:40.414311  8119 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:40.398468  3192 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:40.351886  8107 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.411931  8189 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:40.440510  8189 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.442545  3200 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:16:40.442955  8189 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:40.363602  8090 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.364573  8172 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.399488  8210 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:40.412052  8015 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:40.413419  8125 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:40.367241  8190 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:40.412309  8011 raft_consensus.cc:697] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:40.467073  3196 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
W20260709 13:16:40.465469  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 292877us
I20260709 13:16:40.380846  8132 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:40.453250  8110 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:40.410499  8146 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.409689  8154 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:40.460033  8210 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:40.451892  8103 consensus_queue.cc:237] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:40.472810  8225 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:16:40.467465  8015 raft_consensus.cc:697] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:40.490602  3120 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:40.467262  8187 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:40.467465  8091 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:40.486747  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:40.473825  8110 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.477666  7719 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:40.472931  8096 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:16:40.547607  3197 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:16:40.502760  8014 consensus_meta.cc:287] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.601s	user 0.005s	sys 0.005s
I20260709 13:16:40.584817  3197 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:16:40.532655  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 46004.1us
I20260709 13:16:40.522634  3165 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:40.570731  8226 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:16:40.497112  7986 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:40.564952  8232 log.cc:927] Time spent T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 13:16:40.596571  3164 leader_election.cc:400] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16.
I20260709 13:16:40.559053  7904 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:16:40.597307  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 428437us
W20260709 13:16:40.597929  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:40.569429  8104 consensus_meta.cc:287] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.668s	user 0.006s	sys 0.003s
I20260709 13:16:40.599905  3164 leader_election.cc:403] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:16:40.537546  8091 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:40.567237  8146 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:40.614889  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:40.605340  3118 raft_consensus.cc:3055] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:16:40.596668  8022 consensus_meta.cc:287] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.001s
I20260709 13:16:40.595335  8014 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:40.633770  3118 raft_consensus.cc:740] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:40.641569  8110 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:40.643332  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:40.536233  8187 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
W20260709 13:16:40.596575  8162 consensus_meta.cc:287] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.509s	user 0.004s	sys 0.007s
I20260709 13:16:40.647214  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:40.551538  2947 catalog_manager.cc:5697] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:40.539801  7926 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:16:40.638715  3119 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:16:40.642776  8094 consensus_meta.cc:287] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.740s	user 0.010s	sys 0.006s
I20260709 13:16:40.554255  8239 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
W20260709 13:16:40.634420  8235 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:16:40.548484  8111 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:40.623485  8091 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.651530  3795 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:40.626734  8119 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:40.475618  8234 consensus_queue.cc:260] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:40.623976  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 101440us
I20260709 13:16:40.601307  7904 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:40.644243  8159 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:40.645148  3118 consensus_queue.cc:260] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.657816  8172 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:40.790697  3118 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:40.686285  8014 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:40.693161  8094 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:40.804190  8094 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:40.700136  8190 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:40.700606  8090 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:40.658090  8242 raft_consensus.cc:2764] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:16:40.644805  8022 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:40.807941  8022 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:40.664530  8245 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16.
I20260709 13:16:40.710399  8154 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:40.712239  8089 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.809954  3122 raft_consensus.cc:2393] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 17: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:40.810918  8089 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:40.810513  7904 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.714774  8155 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:40.620630  8015 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:40.811805  7904 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:40.811650  8155 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.705323  7980 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:40.719444  8146 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.814261  8146 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.815313  8111 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:40.816263  8146 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:40.719494  8238 log.cc:927] Time spent T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:16:40.789407  8091 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:40.817718  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 878) took 1023 ms. Trace:
I20260709 13:16:40.818137  3048 rpcz_store.cc:276] 0709 13:16:39.793976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.819871 (+ 25895us) service_pool.cc:224] Handling call
0709 13:16:39.841390 (+ 21519us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:39.841820 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:39.841863 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:39.970158 (+128295us) log.cc:844] Serialized 26 byte log entry
0709 13:16:40.122265 (+152107us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:40.122307 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.122366 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:40.817509 (+695143us) raft_consensus.cc:1685] finished
0709 13:16:40.817529 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.817661 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5902,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":117509,"thread_start_us":40576,"threads_started":1,"wal-append.queue_time_us":307667}
W20260709 13:16:40.720227  8231 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.449s	user 0.000s	sys 0.001s
I20260709 13:16:40.819533  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 757) took 1018 ms. Trace:
I20260709 13:16:40.819936  3195 rpcz_store.cc:276] 0709 13:16:39.801492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.802098 (+   606us) service_pool.cc:224] Handling call
0709 13:16:39.802414 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:39.826127 (+ 23713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:39.826162 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:39.826612 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:16:40.385290 (+558678us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:40.385352 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.385446 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:40.819333 (+433887us) raft_consensus.cc:1685] finished
0709 13:16:40.819353 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.819477 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":168538,"raft.queue_time_us":34153,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":8935,"thread_start_us":413413,"threads_started":1,"wal-append.queue_time_us":674922}
I20260709 13:16:40.720340  8132 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:40.583712  8011 consensus_queue.cc:237] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:40.826121  8247 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:40.827617  8247 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:40.828290  3165 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:40.828301  8017 consensus_queue.cc:1059] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:40.830196  8245 raft_consensus.cc:3055] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:40.830595  8245 raft_consensus.cc:740] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:40.831461  8245 consensus_queue.cc:260] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:40.832772  8245 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:40.833562  2947 catalog_manager.cc:5697] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:40.799998  8159 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:40.837412  8159 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:40.839466  8243 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:40.841780  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 762) took 1016 ms. Trace:
W20260709 13:16:40.844533  8135 consensus_meta.cc:287] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.680s	user 0.009s	sys 0.003s
I20260709 13:16:40.845023  8135 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.846860  3123 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:40.751348  8133 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:40.850549  8133 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.851016  7926 raft_consensus.cc:3055] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:40.851469  7926 raft_consensus.cc:740] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:40.852358  7926 consensus_queue.cc:260] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.852988  8133 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:40.835611  2947 catalog_manager.cc:5697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 5 to 14, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 14 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:40.750866  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 343438us
I20260709 13:16:40.882539  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:40.882917  2947 catalog_manager.cc:5697] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:40.633113  8104 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.670517  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:40.886395  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 215987us
I20260709 13:16:40.887221  8022 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:40.887754  8022 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:40.888129  8022 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:40.654551  8216 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:40.781351  8110 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.794550  8210 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.789963  8109 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:40.697290  8181 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:40.920006  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:40.868135  8236 log.cc:927] Time spent T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.085s	user 0.002s	sys 0.000s
I20260709 13:16:40.888010  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:40.920745  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:40.785506  3795 raft_consensus.cc:606] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:16:40.748358  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 368358us
I20260709 13:16:40.921713  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:40.921993  3795 raft_consensus.cc:614] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:40.922152  8114 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:40.922930  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:40.923185  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:40.923803  3199 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:40.924230  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:40.924991  8154 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:40.842234  3191 rpcz_store.cc:276] 0709 13:16:39.825162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.825276 (+   114us) service_pool.cc:224] Handling call
0709 13:16:39.825582 (+   306us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:40.037327 (+211745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:40.037459 (+   132us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:40.165433 (+127974us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b2c000fc108. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:16:40.166003 (+   570us) log.cc:844] Serialized 52 byte log entry
0709 13:16:40.408533 (+242530us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:40.660624 (+252091us) log.cc:844] Serialized 14 byte log entry
0709 13:16:40.751096 (+ 90472us) log.cc:844] Serialized 14 byte log entry
0709 13:16:40.751296 (+   200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.751375 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:40.841472 (+ 90097us) raft_consensus.cc:1685] finished
0709 13:16:40.841514 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.841694 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":279780,"prepare.queue_time_us":72227,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":899,"raft.queue_time_us":357694,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":26251,"spinlock_wait_cycles":8488448,"thread_start_us":461202,"threads_started":2,"wal-append.queue_time_us":530153}
I20260709 13:16:40.893937  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:40.925794  8174 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:40.896302  3195 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:40.926106  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:40.898126  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:40.926734  3191 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:40.927026  3197 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:40.927275  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:40.927883  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:40.928052  8014 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:40.928586  8014 raft_consensus.cc:697] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:40.928671  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:40.904681  7551 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:40.929508  8014 consensus_queue.cc:237] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:40.930140  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:40.930290  7551 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:40.930770  7551 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:40.930907  3048 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:40.931484  8089 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.931988  8089 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:40.853659  7926 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:40.934505  8125 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:40.935005  8125 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.935149  8255 consensus_queue.cc:1059] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:40.864373  8172 consensus_queue.cc:1059] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:16:40.919312  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:40.941031  3047 raft_consensus.cc:2410] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:16:40.920162  8181 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:40.782321  8144 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:40.921415  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:40.945493  3194 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:40.925379  8154 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.926244  8174 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:40.936442  3014 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.010s	sys 0.038s
I20260709 13:16:40.937827  3798 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:40.918596  3120 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:40.862751  7980 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:40.959489  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:40.942920  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:40.906095  7978 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.894002  8155 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:40.947093  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:40.947423  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:40.947115  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:40.866035  8135 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:40.965003  3121 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:40.916790  8110 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.950160  3191 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:16:40.967240  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:40.958961  3199 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 10.
I20260709 13:16:40.968039  3795 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:16:40.965548  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:40.968362  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.020620  3051 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:16:40.884727  2947 catalog_manager.cc:5697] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 4 to 11, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 11 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.087368  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:40.949007  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:41.109457  3047 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:40.987073  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:41.116004  3796 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:16:41.064131  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:16:41.116844  3014 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.015s	sys 0.042s
W20260709 13:16:41.001694  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:41.055214  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 76727.7us
I20260709 13:16:41.117005  3799 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
W20260709 13:16:41.034776  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:41.119748  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.118561  3124 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:41.088263  3118 raft_consensus.cc:1275] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:40.972895  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:40.971159  3046 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:41.121618  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:41.121222  2947 catalog_manager.cc:5697] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 9 to 10, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 10 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:41.122539  3199 raft_consensus.cc:2393] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 12: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:40.968689  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:41.109862  3125 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:40.977478  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:41.127892  3197 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:41.129170  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:41.053460  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 64272.8us
I20260709 13:16:41.065106  8107 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:41.071198  8089 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:40.939929  8109 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:40.922932  8114 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:40.968168  7719 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:41.138374  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:41.139810  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:41.140450  3049 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 10: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:40.960837  8154 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:40.946781  7991 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:40.977003  8032 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.223s
I20260709 13:16:40.966606  8144 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:40.967396  8174 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:41.065338  8253 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.064296  8165 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:41.164553  8091 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:41.169425  8125 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:41.150723  8239 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:16:40.947301  8146 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:40.969244  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:40.966300  7980 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:41.056439  8255 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.179986  3197 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:41.184083  3761 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:40.966754  7970 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:41.134608  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.197917  3124 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
W20260709 13:16:41.198487  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.198294  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:41.065730  8210 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:41.202291  2947 catalog_manager.cc:5697] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 3 to 14. New cstate: current_term: 14 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.263243  2947 catalog_manager.cc:5697] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.203971  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:41.206311  3047 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:41.255666  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:41.209331  3793 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:41.210566  3191 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:41.195075  8258 log.cc:927] Time spent T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:16:41.244693  7743 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.244544  8165 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:41.277331  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.212001  3125 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
W20260709 13:16:41.151839  3164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.015s	sys 0.011s
I20260709 13:16:41.277628  3191 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
W20260709 13:16:41.278035  3164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.015s	sys 0.011s
W20260709 13:16:41.142088  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 169258us
W20260709 13:16:41.278918  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 682417us
I20260709 13:16:41.278872  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:41.215749  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:41.216152  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2548) took 1089 ms. Trace:
I20260709 13:16:41.281857  3196 rpcz_store.cc:276] 0709 13:16:40.126983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.284140 (+157157us) service_pool.cc:224] Handling call
0709 13:16:41.215960 (+931820us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b540002b2d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:41.216083 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":400134400}
I20260709 13:16:41.206744  8206 raft_consensus.cc:3055] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:41.219524  8119 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:16:41.137846  7978 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:41.199252  8162 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:16:41.258090  3199 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:41.256261  7980 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:41.272131  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 88155.1us
I20260709 13:16:41.274139  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:41.289544  3196 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:41.161223  8155 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:41.216887  7991 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:41.290848  3790 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:16:41.291687  3123 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:41.300535  3164 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:41.300988  8091 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:41.245872  8253 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:41.305486  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:41.255263  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 286137us
I20260709 13:16:41.323913  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:41.262434  8125 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:41.338557  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:41.339339  3196 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:41.321300  3761 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:41.325476  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.319022  3197 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 10.
I20260709 13:16:41.335140  3799 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:16:41.337685  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:41.343319  3197 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16. Ops: [12.7-15.8]
I20260709 13:16:41.345517  3197 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:41.348811  8132 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:41.349375  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:41.349830  8132 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.350912  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:41.350534  8132 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:41.355688  3090 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:41.286731  8206 raft_consensus.cc:740] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:41.363803  2947 catalog_manager.cc:5697] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.366870  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:41.304039  8256 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:41.373764  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:41.368459  3090 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:41.369532  3199 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:16:41.377602  3196 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:41.326673  8155 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.322356  8015 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.270735  8255 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:41.257035  8146 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:41.387414  3164 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:41.276500  7970 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:41.353044  7719 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.353021  8210 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:16:41.370462  8103 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.020s	sys 0.047s
W20260709 13:16:41.390107  7663 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.002s	sys 0.030s
I20260709 13:16:41.365777  8131 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:41.413619  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2311) took 1251 ms. Trace:
I20260709 13:16:41.425073  3122 rpcz_store.cc:276] 0709 13:16:40.171552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.171693 (+   141us) service_pool.cc:224] Handling call
0709 13:16:41.413389 (+1241696us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b5400319a54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:41.413560 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1394933120}
I20260709 13:16:41.367610  8091 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:41.396330  8190 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:41.308734  7743 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:41.366003  7967 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:41.364869  8125 raft_consensus.cc:697] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:16:41.384245  7904 consensus_meta.cc:287] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.000s
I20260709 13:16:41.418308  3196 raft_consensus.cc:3055] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:41.511785  3196 raft_consensus.cc:740] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:41.372285  8256 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.516752  8256 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:41.443461  8084 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.517470  8084 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:41.518901  8261 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 13:16:41.495524  8190 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.519750  8190 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:41.520015  8084 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:41.404793  8089 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 13:16:41.524170  8089 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:41.524885  8125 consensus_queue.cc:237] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:41.382578  8262 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:41.393484  8113 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:41.443329  8114 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.396852  8181 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:41.413276  2947 catalog_manager.cc:5697] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 6 to 8, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 8 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.495431  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:41.556913  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 61579.9us
I20260709 13:16:41.359190  8250 consensus_queue.cc:1059] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
W20260709 13:16:41.417711  8103 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.021s	sys 0.047s
I20260709 13:16:41.414611  8107 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:41.512825  3196 consensus_queue.cc:260] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:41.422442  8210 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:41.421847  8263 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:41.390949  8155 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:41.447211  8110 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:41.402935  8015 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:41.559113  8181 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.637426  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:41.516973  8260 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:41.550522  8159 consensus_meta.cc:287] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.713s	user 0.011s	sys 0.000s
I20260709 13:16:41.534286  8262 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.525348  8256 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:41.550635  8109 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:41.642858  8271 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:16:41.682252  3798 raft_consensus.cc:1240] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:41.684358  3798 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:41.684463  8015 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:41.558630  7663 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.002s	sys 0.030s
W20260709 13:16:41.685640  3091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.006s	sys 0.024s
W20260709 13:16:41.685985  3091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.006s	sys 0.024s
W20260709 13:16:41.686242  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 519647us
I20260709 13:16:41.688412  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:41.689024  3795 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:41.635020  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2533) took 1634 ms. Trace:
I20260709 13:16:41.689594  3164 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:41.689811  3193 rpcz_store.cc:276] 0709 13:16:40.000751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.002512 (+  1761us) service_pool.cc:224] Handling call
0709 13:16:40.002942 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:40.399813 (+396871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.634664 (+1234851us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54002bcad4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:41.634942 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820439424}
I20260709 13:16:41.690424  8017 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:41.692745  3193 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:16:41.650827  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:41.693989  3122 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:41.382925  8014 consensus_queue.cc:1059] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.118s
I20260709 13:16:41.661293  3117 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:41.698740  7663 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.698874  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 2192) took 1075 ms. Trace:
I20260709 13:16:41.699254  3117 rpcz_store.cc:276] 0709 13:16:40.623755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.624025 (+   270us) service_pool.cc:224] Handling call
0709 13:16:41.637304 (+1013279us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b5800003398. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28eeee 0000000000375939 00007ff8353021e0 00007ff8353cb0c4 00007ff8353cb131 00007ff8353790a0 00007ff835378984 00007ff82e8f36d4 00007ff82e8f3662
0709 13:16:41.698814 (+ 61510us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7529088}
I20260709 13:16:41.699321  7663 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:41.667129  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:41.700525  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:41.667410  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 359678us
I20260709 13:16:41.517045  7967 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:16:41.701778  7967 consensus_queue.cc:1243] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:16:41.592442  8265 log.cc:927] Time spent T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:16:41.703677  7904 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:41.704275  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:41.705058  7904 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:41.706368  7904 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:41.706739  7904 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:41.707077  7904 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:41.672708  2947 catalog_manager.cc:5697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 7 to 12, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 12 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.576277  8084 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:41.643751  8274 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:16:41.420311  7719 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:41.675307  8262 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:41.646548  7970 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:41.715530  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:41.647580  8255 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:41.650552  8146 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:41.597406  8144 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:41.668036  8181 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:41.658967  7990 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:41.714583  3122 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:41.726935  7990 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:41.645318  7743 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:41.729799  8245 consensus_meta.cc:287] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.897s	user 0.014s	sys 0.000s
I20260709 13:16:41.641839  8275 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:41.730413  8275 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:41.732801  8275 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:41.716295  3795 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 10: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
W20260709 13:16:41.734477  8276 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:41.735378  8210 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:41.736096  3200 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:16:41.726022  7991 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:41.738185  7978 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:41.737991  8181 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:41.738935  7719 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:41.739701  8256 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:41.719485  3799 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 13:16:41.679028  8266 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:16:41.741463  8181 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:41.725968  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:41.712462  2947 catalog_manager.cc:5697] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:41.746054  8253 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:41.747121  2947 catalog_manager.cc:5697] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.653435  8190 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:41.660437  3762 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:41.722962  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:41.749961  3797 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:41.730347  7926 consensus_meta.cc:287] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.797s	user 0.010s	sys 0.002s
W20260709 13:16:41.750049  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 89682.7us
I20260709 13:16:41.599397  8107 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.589527  8263 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:41.755127  2947 catalog_manager.cc:5697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 7 to 11, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 11 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.762240  3792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:41.561646  8114 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:41.706393  8014 raft_consensus.cc:3055] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:41.676070  8159 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:41.676301  8260 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:41.768616  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 351847us
I20260709 13:16:41.791774  3122 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:41.751415  8259 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:41.792447  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:41.794773  3090 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:41.755398  8256 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:41.802892  3090 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:41.804991  3090 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:41.807255  3090 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:41.815536  3124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.016s	sys 0.010s
W20260709 13:16:41.816797  3124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.017s	sys 0.011s
W20260709 13:16:41.793403  8135 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.037s	sys 0.073s
I20260709 13:16:41.854018  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:41.856566  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:41.830902  3762 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.129:44609 timed out after 1.861s (SENT)
I20260709 13:16:41.765755  8263 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:41.855981  3042 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:41.862067  3044 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:41.850873  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:41.815001  8022 consensus_meta.cc:287] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.926s	user 0.013s	sys 0.000s
I20260709 13:16:41.766047  8107 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:41.872457  8135 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.040s	sys 0.075s
W20260709 13:16:41.880069  8154 consensus_meta.cc:287] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.663s	user 0.010s	sys 0.000s
I20260709 13:16:41.879055  8022 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:41.870142  3122 raft_consensus.cc:2393] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 15: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:41.794287  7663 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:41.826891  7991 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:41.882280  7991 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.781951  8014 raft_consensus.cc:740] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:41.872493  2947 catalog_manager.cc:5697] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 1 to 11, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 11 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.883028  8234 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:41.883215  8014 consensus_queue.cc:260] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:41.883759  2947 catalog_manager.cc:5697] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 8 to 12, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 12 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:41.884516  8014 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:41.874984  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:41.886309  3043 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 10: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:41.875756  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:41.886615  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:41.814957  8181 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:41.890370  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:41.797336  8155 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:41.836630  7719 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:41.880525  8154 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:41.881040  8107 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:41.882182  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:41.826433  3797 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:41.885490  2947 catalog_manager.cc:5697] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:41.886950  3117 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 10: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:41.903816  3122 raft_consensus.cc:2410] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:16:41.881510  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:41.815236  7970 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.890573  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:41.885171  8262 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:41.859434  8146 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:41.857558  8144 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:41.827616  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:41.904367  8104 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:41.826925  8210 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:41.856020  8275 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:41.900893  3042 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:41.905249  3043 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:41.905259  3051 raft_consensus.cc:2410] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:16:41.934836  8190 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:41.906121  3792 raft_consensus.cc:606] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:42.009249  3792 raft_consensus.cc:614] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:41.876693  8256 raft_consensus.cc:697] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:41.934971  3049 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:16:41.935191  2947 catalog_manager.cc:5697] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 9 to 12, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 12 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:16:41.942521  3050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47488 (request call id 873) took 2514 ms (client timeout 1861 ms). Trace:
W20260709 13:16:42.014528  3050 rpcz_store.cc:269] 0709 13:16:39.416279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.451667 (+ 35388us) service_pool.cc:224] Handling call
0709 13:16:41.930371 (+2478704us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b5400074754. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:41.930581 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1943816064}
I20260709 13:16:41.943171  8115 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:41.943867  8022 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:41.944589  8174 consensus_meta.cc:287] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.699s	user 0.010s	sys 0.000s
I20260709 13:16:41.945317  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:42.031018  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.031929  3051 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:41.946128  8154 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:41.971405  8155 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:41.892256  8181 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.999023  3121 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 15: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:41.855247  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:42.039681  3124 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:16:41.892797  7991 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:41.848668  8131 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:41.903955  7719 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:42.011516  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 307276us
I20260709 13:16:42.045874  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:41.999940  8144 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:42.026681  3197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.000s	sys 0.035s
I20260709 13:16:41.929265  7663 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:42.036546  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:42.003506  8146 raft_consensus.cc:697] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:41.991667  8091 raft_consensus.cc:697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:16:42.049340  3197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.000s	sys 0.035s
I20260709 13:16:42.055948  3043 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:16:41.998318  7970 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:42.059369  3051 raft_consensus.cc:2410] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:16:42.067553  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.073143  8262 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:42.057092  8125 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:42.077083  3050 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 11.
I20260709 13:16:42.043982  8181 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:42.008114  8210 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:42.058012  8144 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:42.093776  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.010005  8275 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:42.069078  7551 consensus_meta.cc:287] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.138s	user 0.010s	sys 0.002s
I20260709 13:16:42.066830  8154 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:42.098001  3050 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:16:42.098450  3050 pending_rounds.cc:85] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 12
I20260709 13:16:42.098683  3050 pending_rounds.cc:107] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:16:42.098955  3050 raft_consensus.cc:2889] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:42.035107  8174 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:42.044970  8252 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.011s	sys 0.033s
W20260709 13:16:42.103756  8284 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:16:42.100800  8159 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:42.106727  8091 consensus_queue.cc:237] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:42.108140  8146 consensus_queue.cc:237] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.070236  8104 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:16:42.109773  7904 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.084508  8155 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.116190  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.195410  3050 raft_consensus.cc:2410] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
W20260709 13:16:42.121376  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 290490us
I20260709 13:16:42.084915  8253 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:42.145453  3047 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:42.185541  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:42.204717  3120 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
W20260709 13:16:42.144889  8252 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.011s	sys 0.033s
I20260709 13:16:42.193342  8260 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:42.186697  8290 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:42.200109  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:42.095009  8125 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.210362  3120 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:16:42.101575  7551 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.212366  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.238044  3051 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 14: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:42.241820  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:42.214651  3047 raft_consensus.cc:2410] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:16:42.218405  3045 raft_consensus.cc:2393] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 12: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:42.247818  8298 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:16:42.248909  8125 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:42.252130  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34728 (request call id 767) took 1358 ms. Trace:
I20260709 13:16:42.255520  3200 rpcz_store.cc:276] 0709 13:16:40.894572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.894742 (+   170us) service_pool.cc:224] Handling call
0709 13:16:42.251947 (+1357205us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b540013d3d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:42.252057 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1857164160}
I20260709 13:16:42.262494  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:42.263865  3790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 811) took 2153 ms. Trace:
I20260709 13:16:42.263814  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:42.264348  3790 rpcz_store.cc:276] 0709 13:16:40.110176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.111453 (+  1277us) service_pool.cc:224] Handling call
0709 13:16:40.111799 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:41.322789 (+1210990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.263613 (+940824us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54005a19d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:42.263785 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2710832000}
I20260709 13:16:42.265100  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:42.265650  3200 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:42.265908  8299 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:16:42.266580  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:42.267311  8294 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:16:42.267421  3195 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:42.268584  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:42.271937  3195 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:42.238312  8284 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:42.274785  7904 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:42.274921  3796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 673) took 1307 ms. Trace:
I20260709 13:16:42.291186  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:42.275748  7980 consensus_meta.cc:287] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.922s	user 0.010s	sys 0.000s
I20260709 13:16:42.276623  7551 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:42.278587  3200 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:42.291827  3197 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:42.291465  3796 rpcz_store.cc:276] 0709 13:16:40.967394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.967632 (+   238us) service_pool.cc:224] Handling call
0709 13:16:41.115668 (+148036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.116500 (+   832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.274718 (+1158218us) spinlock_profiling.cc:243] Waited 59.3 ms on lock 0x7b5400494150. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:42.274864 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136358272}
I20260709 13:16:42.296798  3197 raft_consensus.cc:1275] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:42.237025  8291 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:42.284333  8295 log.cc:927] Time spent T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:16:42.237103  8290 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.187162  8131 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.287859  8210 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:42.288627  7719 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:42.298571  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.324235  3051 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:42.299728  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.225520  8253 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.203883  8155 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.309240  3197 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:42.297540  8291 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:42.306180  7980 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.337142  7980 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:42.339515  3194 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:16:42.327126  3200 raft_consensus.cc:1275] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 4. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260709 13:16:42.328959  3195 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:16:42.194604  8256 consensus_queue.cc:237] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:42.360656  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.361538  3043 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:42.269776  8263 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.362967  3120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:16:42.332491  8174 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:42.386760  3050 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:16:42.389310  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.389668  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.390641  3043 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:42.316980  7991 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.382611  8290 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:42.370446  3120 raft_consensus.cc:606] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:42.412357  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.412607  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.413774  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:42.412297  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.368925  8155 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:42.419780  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.423482  3118 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:42.415634  3050 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:42.420680  3042 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:42.427160  8146 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.433456  3120 raft_consensus.cc:1275] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 9 index: 3. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260709 13:16:42.438156  3042 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:16:42.438589  3042 pending_rounds.cc:85] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 11
I20260709 13:16:42.438824  3042 pending_rounds.cc:107] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:16:42.439122  3042 raft_consensus.cc:2889] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:42.440150  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.467338  3051 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:42.415302  8275 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:42.515133  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:42.541808  3043 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:42.515829  3798 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:42.516513  7990 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.517067  8014 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:42.421885  7970 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:42.519146  8305 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:16:42.525875  8291 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:42.530920  8253 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:42.543102  3798 raft_consensus.cc:606] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:42.518169  8302 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:16:42.559053  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2561) took 1570 ms. Trace:
I20260709 13:16:42.562762  3191 rpcz_store.cc:276] 0709 13:16:40.988939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.280989 (+292050us) service_pool.cc:224] Handling call
0709 13:16:41.281437 (+   448us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:41.351880 (+ 70443us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:41.352237 (+   357us) log.cc:844] Serialized 14 byte log entry
0709 13:16:41.680707 (+328470us) log.cc:844] Serialized 14 byte log entry
0709 13:16:41.680914 (+   207us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:41.681699 (+   785us) log.cc:844] Serialized 52 byte log entry
0709 13:16:41.681852 (+   153us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:41.711170 (+ 29318us) log.cc:844] Serialized 14 byte log entry
0709 13:16:41.711511 (+   341us) log.cc:844] Serialized 14 byte log entry
0709 13:16:41.751214 (+ 39703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.751470 (+   256us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.558791 (+807321us) raft_consensus.cc:1685] finished
0709 13:16:42.558813 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.558985 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128071,"prepare.queue_time_us":861,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":72,"raft.queue_time_us":97943,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":84713,"spinlock_wait_cycles":58735488,"thread_start_us":327578,"threads_started":1,"wal-append.queue_time_us":517604}
W20260709 13:16:42.532231  8165 consensus_meta.cc:287] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.214s	user 0.008s	sys 0.006s
I20260709 13:16:42.570660  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:42.573426  3122 raft_consensus.cc:1240] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 13:16:42.566398  8234 consensus_meta.cc:287] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.683s	user 0.013s	sys 0.001s
I20260709 13:16:42.587011  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:42.587968  3050 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:42.591869  3791 raft_consensus.cc:2410] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:16:42.565248  7990 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:42.592370  8015 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.592882  8015 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:42.592903  8132 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:42.594219  8301 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 13:16:42.595613  7990 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:42.604036  3043 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:16:42.498391  8146 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:42.606537  3051 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:42.617687  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.618396  3048 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:42.619237  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.619949  3048 raft_consensus.cc:2410] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:16:42.607278  3043 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:16:42.627352  8272 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.985s	user 0.011s	sys 0.006s
I20260709 13:16:42.629904  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 828) took 1687 ms. Trace:
I20260709 13:16:42.630292  8132 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:42.630455  3119 rpcz_store.cc:276] 0709 13:16:40.942338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.942556 (+   218us) service_pool.cc:224] Handling call
0709 13:16:40.968889 (+ 26333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:40.969223 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:40.969260 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:40.974176 (+  4916us) log.cc:844] Serialized 26 byte log entry
0709 13:16:41.395717 (+421541us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:41.395781 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.395888 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.626772 (+1230884us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:42.629444 (+  2672us) raft_consensus.cc:1685] finished
0709 13:16:42.629475 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.629824 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10542,"raft.queue_time_us":8099,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":36691,"spinlock_wait_cycles":59467648,"thread_start_us":421147,"threads_started":1,"wal-append.queue_time_us":618966}
I20260709 13:16:42.635558  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:42.635946  3049 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 13:16:42.630113  8297 log.cc:927] Time spent T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.411s	user 0.001s	sys 0.011s
I20260709 13:16:42.637270  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:42.638942  8288 log.cc:927] Time spent T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.402s	user 0.000s	sys 0.005s
I20260709 13:16:42.639564  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:42.640599  3798 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:42.644187  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.645026  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2552) took 1671 ms. Trace:
I20260709 13:16:42.645373  8155 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:42.646026  8155 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.648495  8206 consensus_queue.cc:260] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:42.652354  3791 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 672) took 1705 ms (client timeout 1847 ms). Trace:
W20260709 13:16:42.652855  3791 rpcz_store.cc:269] 0709 13:16:40.946553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.946929 (+   376us) service_pool.cc:224] Handling call
0709 13:16:42.652100 (+1705171us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54006ea0d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:42.652256 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3389059328}
I20260709 13:16:42.645596  3194 rpcz_store.cc:276] 0709 13:16:40.973703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.975063 (+  1360us) service_pool.cc:224] Handling call
0709 13:16:41.057604 (+ 82541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.347166 (+1289562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.644695 (+297529us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540013b0d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:42.644952 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2943871232}
W20260709 13:16:42.657078  8306 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.286s	user 0.005s	sys 0.007s
I20260709 13:16:42.659538  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:42.660004  3045 raft_consensus.cc:1240] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:42.660692  8015 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:42.660773  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:16:42.661772  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 938212us
I20260709 13:16:42.661906  8296 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:42.662520  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:42.662870  8296 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.664055  3164 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:42.664970  8296 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:42.665884  8210 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.564575  8014 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.682127  3126 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:16:42.683861  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:42.685525  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:42.686765  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:42.687003  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:42.674297  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:42.674480  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:42.689713  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:42.691169  3125 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:16:42.692186  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:42.690056  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.694401  3046 raft_consensus.cc:2393] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 12: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:42.692857  3125 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:16:42.695603  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:42.703114  3050 raft_consensus.cc:2410] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:16:42.703608  3125 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
W20260709 13:16:42.703845  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 206837us
I20260709 13:16:42.665445  8275 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:42.706300  3790 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:42.706995  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2553) took 1731 ms. Trace:
W20260709 13:16:42.709477  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:42.717382  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.665918  8090 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:42.666086  8017 consensus_queue.cc:1059] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:16:42.720431  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:42.711057  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:42.671542  8174 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.577669  8165 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:42.712085  3126 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:42.735702  3196 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:42.712172  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:42.738222  3121 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:42.665547  8296 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:42.722534  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:42.714794  3192 rpcz_store.cc:276] 0709 13:16:40.975457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.976426 (+   969us) service_pool.cc:224] Handling call
0709 13:16:41.064183 (+ 87757us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:41.067184 (+  3001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.067213 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:41.079999 (+ 12786us) log.cc:844] Serialized 26 byte log entry
0709 13:16:41.366344 (+286345us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:41.808295 (+441951us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.706596 (+898301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.706691 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.706746 (+    55us) raft_consensus.cc:1685] finished
0709 13:16:42.706765 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.706925 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":877618,"prepare.queue_time_us":127919,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":17088,"raft.queue_time_us":904411,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":16683,"thread_start_us":591094,"threads_started":2,"wal-append.queue_time_us":475348}
I20260709 13:16:42.724983  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.648540  8155 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:42.756481  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:42.705168  8104 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:42.690327  7926 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:42.697973  7719 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:42.751869  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.697664  7904 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:42.755434  3044 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 12: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:42.756542  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 774) took 1440 ms. Trace:
I20260709 13:16:42.783118  3199 rpcz_store.cc:276] 0709 13:16:41.316132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.376454 (+ 60322us) service_pool.cc:224] Handling call
0709 13:16:41.376741 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.376942 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:41.887412 (+510470us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.756222 (+868810us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.756282 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:42.756322 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.756377 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.756487 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":709927,"prepare.queue_time_us":179554,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":679766,"thread_start_us":627367,"threads_started":2,"wal-append.queue_time_us":393757}
I20260709 13:16:42.730322  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:16:42.785141  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.753904  3091 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:42.787576  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:42.788381  3048 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:42.705008  7990 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.714356  8206 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:42.706298  8260 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:42.762337  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.795202  3047 raft_consensus.cc:2410] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:16:42.696967  8210 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:42.764963  3798 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:42.766093  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:42.771129  8146 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:42.757104  8174 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:42.721312  8090 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.772679  8104 raft_consensus.cc:697] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:42.721652  7551 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:16:42.774499  3791 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:42.662523  8242 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:16:42.780082  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:42.789423  3045 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:42.763955  3797 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:42.794315  3051 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:16:42.793700  3196 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:16:42.798187  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:42.802225  8017 consensus_queue.cc:1243] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer e9165fe61ab04bfb9a48889156d5c161 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:42.804116  3796 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
W20260709 13:16:42.832500  8144 consensus_meta.cc:287] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.722s	user 0.010s	sys 0.001s
I20260709 13:16:42.778975  8155 consensus_queue.cc:1059] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:16:42.834245  8210 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:42.785861  7719 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.836062  7719 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:42.842515  8210 raft_consensus.cc:3055] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:42.845958  8259 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:42.763700  8263 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:42.846688  8210 raft_consensus.cc:740] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:42.846021  8171 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.846825  8259 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.847635  8171 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:42.723198  8275 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.805198  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:42.809145  8290 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:16:42.817512  3047 raft_consensus.cc:1813] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Handling vote request from an unknown peer 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:42.818027  3196 pending_rounds.cc:85] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 9
W20260709 13:16:42.822084  8312 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:16:42.822306  7551 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.827381  8104 consensus_queue.cc:237] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.817409  3091 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:42.759909  8132 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:16:42.762825  8106 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:16:42.815155  8090 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:42.830292  7991 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:42.802780  7732 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:16:42.795629  8187 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.818070  7926 raft_consensus.cc:697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:42.910558  8187 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.911335  7926 consensus_queue.cc:237] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:42.913166  8187 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:42.810670  7990 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:42.850935  8290 raft_consensus.cc:3055] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:42.914075  8290 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:42.914729  8165 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:42.914953  8290 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.915681  8014 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:42.916213  8290 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:42.916339  3049 raft_consensus.cc:2410] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:16:42.804688  7663 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:42.917120  7663 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:42.917650  7663 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:42.918550  8268 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 1.283s	user 0.000s	sys 0.015s
I20260709 13:16:42.919868  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2089) took 2988 ms. Trace:
I20260709 13:16:42.814878  8252 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.105s
I20260709 13:16:42.920225  3198 rpcz_store.cc:276] 0709 13:16:39.931677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.940201 (+  8524us) service_pool.cc:224] Handling call
0709 13:16:40.039219 (+ 99018us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:40.228604 (+189385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:40.228662 (+    58us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:40.229346 (+   684us) log.cc:844] Serialized 52 byte log entry
0709 13:16:40.872472 (+643126us) spinlock_profiling.cc:243] Waited 7.7 ms on lock 0x7b1800407c20. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:16:41.352863 (+480391us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:41.352923 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.353018 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.917914 (+1564896us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:42.919601 (+  1687us) raft_consensus.cc:1685] finished
0709 13:16:42.919630 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.919779 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76062,"raft.queue_time_us":119543,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":14193,"spinlock_wait_cycles":75051520,"thread_start_us":480162,"threads_started":1,"wal-append.queue_time_us":1362934}
I20260709 13:16:42.805923  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:42.807955  3762 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:16:42.922564  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 114697us
W20260709 13:16:42.922905  8181 consensus_meta.cc:287] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.821s	user 0.010s	sys 0.001s
I20260709 13:16:42.760972  8296 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.924994  8165 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:42.925462  8165 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.925865  8165 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:42.926267  8114 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:42.850263  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 45153.4us
I20260709 13:16:42.851365  3047 raft_consensus.cc:2410] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:16:42.851521  3196 pending_rounds.cc:107] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:16:42.927827  3196 raft_consensus.cc:2889] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:42.928511  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 775) took 1612 ms. Trace:
I20260709 13:16:42.928792  3196 rpcz_store.cc:276] 0709 13:16:41.316559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.393906 (+ 77347us) service_pool.cc:224] Handling call
0709 13:16:41.418133 (+ 24227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.735168 (+1317035us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b58003db8d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83030f0aa 00007ff830391447 00007ff8303a9fe7 00007ff8303ab7de 00007ff8303b5b49 00007ff8303b6416 00007ff8303b2d8f 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4
0709 13:16:42.928269 (+193101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.928461 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2522908032}
W20260709 13:16:42.864786  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 62904.3us
I20260709 13:16:42.858553  3048 raft_consensus.cc:2410] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:16:42.825314  8174 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:42.832949  8144 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.802790  8260 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:42.849695  8259 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:42.905769  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.852258  8171 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:42.847656  8210 consensus_queue.cc:260] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:42.852401  7551 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:42.909092  8313 log.cc:927] Time spent T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:16:42.851483  8275 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:42.851749  8015 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:42.900193  8253 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:42.930238  3091 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:42.900894  3121 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:42.934334  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:42.924284  8181 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:42.935022  8216 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
W20260709 13:16:42.938169  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 249803us
I20260709 13:16:42.926721  8296 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:42.960772  3117 raft_consensus.cc:2368] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12.
I20260709 13:16:42.976447  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:42.962733  3091 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:42.977679  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:42.979554  3125 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
I20260709 13:16:42.972680  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:42.937641  8260 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:42.973723  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:43.001000  3196 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:42.980770  3199 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
W20260709 13:16:43.017416  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.993186  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:42.987936  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:43.005573  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:42.937608  8094 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:16:43.021420  3126 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:43.022603  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:43.007299  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:42.998898  8015 raft_consensus.cc:697] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:43.008488  8131 consensus_queue.cc:1059] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:16:43.026691  8015 consensus_queue.cc:237] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:43.029000  8144 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:42.958407  8256 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:16:43.008131  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:43.038985  3198 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:43.009706  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:43.010869  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:43.011714  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:43.012485  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:43.013295  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:43.014081  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:43.014254  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 349238us
I20260709 13:16:43.043027  3200 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:16:42.961333  8253 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.015178  3118 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:43.051981  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:43.049396  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:42.968313  8210 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:43.042074  3194 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:43.053033  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:42.973122  8192 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:43.050076  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:43.052605  3119 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:43.046810  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:43.059031  3125 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:16:43.017541  8283 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:43.060281  3797 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:43.053056  3791 raft_consensus.cc:1813] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Handling vote request from an unknown peer 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:43.064376  3791 raft_consensus.cc:2410] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:16:43.054915  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:43.067276  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:43.068234  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:43.068920  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:43.083213  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:43.083468  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:43.046206  8132 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:43.045670  7991 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.072299  3792 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:16:43.091516  3164 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:43.092643  3799 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:16:43.057178  8253 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:43.057132  8259 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.070327  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:43.056959  8192 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:43.096748  8192 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:43.097754  7719 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:43.100262  7719 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:43.057344  8242 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.102035  8242 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:43.102646  7551 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:43.104533  8242 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:16:43.107432  3198 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
I20260709 13:16:43.070174  8190 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:43.109021  8190 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:43.122424  8190 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:43.059955  8172 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:43.123015  8315 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:16:43.123261  8172 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:43.126094  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2203) took 1065 ms. Trace:
I20260709 13:16:43.126529  3120 rpcz_store.cc:276] 0709 13:16:42.060705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.434219 (+373514us) service_pool.cc:224] Handling call
0709 13:16:42.434523 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.434847 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.434873 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:42.463327 (+ 28454us) log.cc:844] Serialized 26 byte log entry
0709 13:16:42.720663 (+257336us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:42.720717 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.720973 (+   256us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:43.125844 (+404871us) raft_consensus.cc:1685] finished
0709 13:16:43.125869 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.126029 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":71966,"thread_start_us":256883,"threads_started":1,"wal-append.queue_time_us":510069}
I20260709 13:16:43.109947  8259 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:43.130241  8259 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:43.120086  3798 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:43.094245  8132 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:43.131469  8132 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:43.132498  8260 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:43.079625  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:43.135664  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 65722us
I20260709 13:16:43.070432  8187 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:43.137210  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:43.138808  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:43.139827  3125 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:43.143700  3164 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:43.146314  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.149390  3797 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:43.085186  8017 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:16:43.125669  8172 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:43.163403  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:43.058012  8262 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:43.139504  8259 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:43.151037  8190 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:43.136847  8187 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:43.177785  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:43.178676  3049 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:16:43.180091  8187 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:43.134219  7991 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:43.156837  8283 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.183949  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:43.162017  7719 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.155846  8131 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:16:43.186612  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.189167  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:43.194932  3048 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:16:43.209707  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.241040  3762 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:43.241997  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:43.205492  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:43.173166  8172 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:16:43.253978  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.174324  8190 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.243112  3194 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:43.197181  8107 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.191713  8283 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:43.244874  3126 raft_consensus.cc:2393] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:43.163022  8090 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:43.170179  7904 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:43.303324  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:43.303205  7904 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:43.249838  3193 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:43.304802  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:43.305367  3192 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:43.305711  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:43.250866  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:43.191777  7986 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.171031  8262 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:43.296211  8107 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:43.316499  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:43.298091  8146 raft_consensus.cc:3055] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:16:43.298255  8318 log.cc:927] Time spent T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:43.298738  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:43.260962  8165 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:43.184770  8242 consensus_queue.cc:1059] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 13:16:43.309899  8260 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:43.260843  8172 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:43.255177  7970 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:43.239384  7719 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:43.324615  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:43.249517  8131 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:43.342818  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:43.343683  3197 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 10.
I20260709 13:16:43.344825  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:43.346858  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:43.320933  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 70220.2us
I20260709 13:16:43.350432  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:43.257220  7663 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:43.191897  8192 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:43.291181  8190 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:43.319056  8181 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:43.360204  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:43.372856  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:43.373632  3199 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:16:43.339638  7970 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.323138  8146 raft_consensus.cc:740] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:16:43.327415  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 393156us
I20260709 13:16:43.319299  7980 consensus_queue.cc:1059] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:16:43.366250  3197 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:43.292997  8291 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:16:43.325577  7986 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:43.377605  7970 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:43.369267  8245 consensus_queue.cc:1059] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:16:43.416455  8131 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:43.398082  8090 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:43.436689  8107 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:43.437707  8321 log.cc:927] Time spent T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:16:43.443526  8262 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:43.458797  8192 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:43.424345  8146 consensus_queue.cc:260] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:43.460455  8146 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:43.465299  8283 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:43.499253  3016 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.000s	sys 0.032s
W20260709 13:16:43.500216  3016 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.000s	sys 0.032s
W20260709 13:16:43.501428  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.502223  3015 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.010s	sys 0.009s
W20260709 13:16:43.502810  3015 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.010s	sys 0.009s
W20260709 13:16:43.503512  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 508074us
I20260709 13:16:43.510663  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:43.512495  3042 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:43.515839  3044 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:16:43.517571  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:43.529887  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:43.531235  3048 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:43.542115  3091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.006s	sys 0.022s
W20260709 13:16:43.542719  3091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.006s	sys 0.022s
W20260709 13:16:43.543386  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 580682us
W20260709 13:16:43.551059  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 201747us
I20260709 13:16:43.321247  3165 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:43.557621  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 180976us
I20260709 13:16:43.363055  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:43.561498  3761 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:43.564141  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:43.566396  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:43.567771  3194 raft_consensus.cc:2410] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
W20260709 13:16:43.571842  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.587917  8262 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:43.590452  8015 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:43.590839  7986 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:43.591308  8015 raft_consensus.cc:697] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:16:43.595691  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 50295.1us
I20260709 13:16:43.440622  8132 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:43.622783  7991 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:43.621280  7990 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:43.624076  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 302812us
W20260709 13:16:43.619395  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 312515us
I20260709 13:16:43.624125  8132 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:43.679054  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2205) took 1617 ms. Trace:
I20260709 13:16:43.682756  3194 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: [13.7-15.8]
I20260709 13:16:43.679798  3123 rpcz_store.cc:276] 0709 13:16:42.061441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.560104 (+498663us) service_pool.cc:224] Handling call
0709 13:16:42.578527 (+ 18423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.578823 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:42.589302 (+ 10479us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.541997 (+952695us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.664140 (+122143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:43.676075 (+ 11935us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:43.678257 (+  2182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.678464 (+   207us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.678743 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50914,"prepare.queue_time_us":601,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":53550,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"spinlock_wait_cycles":15415552,"thread_start_us":1011672,"threads_started":3,"wal-append.queue_time_us":800396}
I20260709 13:16:43.686450  7663 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:43.593221  8015 consensus_queue.cc:237] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:43.697137  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:43.698868  3048 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:43.699813  8192 consensus_queue.cc:1059] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:16:43.701538  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.692233  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 131122us
I20260709 13:16:43.702410  8337 raft_consensus.cc:3055] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:43.703042  8337 raft_consensus.cc:740] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:43.703538  3761 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:43.706131  8091 raft_consensus.cc:2764] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:16:43.706849  8290 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:43.707864  8290 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:43.702463  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.700280  8181 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:43.712143  8181 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:43.714808  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 43767.3us
I20260709 13:16:43.715519  8181 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:43.715716  8326 consensus_queue.cc:1059] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:43.716655  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:43.717681  8290 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:43.704658  8337 consensus_queue.cc:260] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:43.718282  3046 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:16:43.717098  8171 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:43.719492  8337 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:43.720211  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:43.720728  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.721263  3044 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:43.722249  7719 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:43.722385  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:43.723682  7926 raft_consensus.cc:3055] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:43.724210  7926 raft_consensus.cc:740] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:43.685385  3194 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:43.728678  3194 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:43.730484  3194 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:16:43.721263  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.715788  3091 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:43.760552  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:43.740548  8181 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:16:43.795251  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 79632us
I20260709 13:16:43.679052  8190 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:43.799220  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:43.800124  3042 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:16:43.802075  8181 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:43.725606  7926 consensus_queue.cc:260] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:43.812933  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 45547.3us
I20260709 13:16:43.828042  8190 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:43.813233  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:43.834543  3125 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:16:43.829445  3196 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:43.832345  3091 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:43.805727  8181 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:43.840808  8334 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:16:43.837931  8132 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:16:43.806747  3164 consensus_peers.cc:597] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1e1474206f8d49e58df15541f5a5725e. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:43.866570  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 60167.4us
I20260709 13:16:43.850616  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 2210) took 1176 ms. Trace:
I20260709 13:16:43.867456  3042 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:16:43.849702  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:43.858933  8096 raft_consensus.cc:3055] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:43.868335  3118 rpcz_store.cc:276] 0709 13:16:42.674121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.674243 (+   122us) service_pool.cc:224] Handling call
0709 13:16:43.850122 (+1175879us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54000a8554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:43.850422 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746489600}
I20260709 13:16:43.868125  8132 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.878424  8096 raft_consensus.cc:740] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:43.859441  8144 raft_consensus.cc:3055] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:43.888839  8144 raft_consensus.cc:740] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:43.889889  8096 consensus_queue.cc:260] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:43.891876  8096 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:43.891435  7977 consensus_queue.cc:1175] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e9165fe61ab04bfb9a48889156d5c161" responder_term: 13 status { last_received { term: 13 index: 10 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13. Ops: [12.10-12.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:43.895234  3165 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:43.887866  8181 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:43.898078  8107 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:43.898595  3192 consensus_meta.cc:287] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.592s	user 0.014s	sys 0.007s
I20260709 13:16:43.899070  3192 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
W20260709 13:16:43.904893  3199 consensus_meta.cc:287] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.020s
I20260709 13:16:43.888139  8132 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:43.911103  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.912385  8259 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:43.920874  7990 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:43.925115  7990 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.925582  7990 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:43.928376  3043 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:16:43.928637  7719 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:43.906200  8107 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.922621  3199 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:43.937440  7977 consensus_queue.cc:1059] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:16:43.945951  7904 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.946681  7977 raft_consensus.cc:3055] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:43.946723  7904 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:43.947602  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2319) took 2138 ms. Trace:
I20260709 13:16:43.947252  7977 raft_consensus.cc:740] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:43.948050  3117 rpcz_store.cc:276] 0709 13:16:41.808929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.945036 (+136107us) service_pool.cc:224] Handling call
0709 13:16:43.947184 (+2002148us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b5400319554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:43.947415 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142389120}
I20260709 13:16:43.949299  7904 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:43.950095  8358 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:43.950197  7977 consensus_queue.cc:260] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:43.951027  8358 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:43.952008  7977 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:43.946072  8253 consensus_meta.cc:287] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.835s	user 0.008s	sys 0.018s
I20260709 13:16:43.929574  7719 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:43.956522  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.954305  3165 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:43.957064  3798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 685) took 1152 ms. Trace:
I20260709 13:16:43.957104  8253 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:43.957919  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47488 (request call id 897) took 1247 ms. Trace:
I20260709 13:16:43.965209  3798 rpcz_store.cc:276] 0709 13:16:42.804844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.805573 (+   729us) service_pool.cc:224] Handling call
0709 13:16:43.956688 (+1151115us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400521554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:43.956854 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455190912}
W20260709 13:16:43.970732  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 138714us
I20260709 13:16:43.937440  8155 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:43.967658  3050 rpcz_store.cc:276] 0709 13:16:42.710701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.710832 (+   131us) service_pool.cc:224] Handling call
0709 13:16:43.957550 (+1246718us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b540029de54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:43.957707 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1966722816}
W20260709 13:16:43.971575  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 122040us
W20260709 13:16:43.973567  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.960577  8172 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:43.953713  8358 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:43.973390  8253 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:43.984968  7904 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:43.985208  8155 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:43.986107  7904 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:43.987892  8155 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:43.989132  7904 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:43.990140  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:43.992105  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:43.993333  7904 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:43.995097  7904 raft_consensus.cc:697] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:44.010841  8253 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:44.013513  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:44.015628  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 147677us
I20260709 13:16:44.003829  8172 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:43.973887  8107 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.019224  8155 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:44.022080  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:44.022307  8155 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:44.022933  8155 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:44.023313  8216 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:44.023947  8216 raft_consensus.cc:697] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:44.025169  8216 consensus_queue.cc:237] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.016446  8171 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:44.029417  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 111405us
I20260709 13:16:43.970436  8144 consensus_queue.cc:260] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.025198  8165 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:44.034639  8187 raft_consensus.cc:3055] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:44.035341  8187 raft_consensus.cc:740] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:44.036542  8187 consensus_queue.cc:260] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:44.038414  7732 raft_consensus.cc:3055] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:44.038939  7732 raft_consensus.cc:740] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:44.039690  8358 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.039287  7904 consensus_queue.cc:237] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:44.040205  7732 consensus_queue.cc:260] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:44.040488  8358 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.041965  8210 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:16:44.042992  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.043049  7926 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:44.043869  8210 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:44.044657  3090 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:44.050238  8253 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:44.050961  8337 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:44.055441  8357 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:44.056766  8337 raft_consensus.cc:3055] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:44.057217  8337 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:44.058313  8337 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.062184  8358 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:44.062520  7719 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:44.063735  8357 consensus_queue.cc:1059] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:44.065116  8146 raft_consensus.cc:3055] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:44.065544  8146 raft_consensus.cc:740] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:44.066572  8144 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:44.066617  8146 consensus_queue.cc:260] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:44.067629  8107 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:44.068328  8146 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:44.100070  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.072110  7732 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:44.095355  8187 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:44.110504  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 77009.4us
I20260709 13:16:44.050953  8253 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:44.113910  7977 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:44.114674  8262 consensus_meta.cc:287] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.525s	user 0.016s	sys 0.001s
I20260709 13:16:44.124059  7977 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.119272  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:44.110700  7719 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:44.126667  7970 consensus_meta.cc:287] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.686s	user 0.011s	sys 0.011s
I20260709 13:16:44.123018  3762 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:44.132090  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:44.133116  3798 raft_consensus.cc:2368] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 14. Current term is 15.
I20260709 13:16:44.134321  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:44.135475  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:44.138974  3165 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:44.140905  3165 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:44.160759  8171 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:44.161231  8171 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.142154  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:44.142484  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:44.161620  8171 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:44.162952  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:44.144219  8253 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:44.164072  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:44.144402  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:44.138974  8337 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:44.169766  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:44.170529  7977 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:44.127720  8262 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:44.145417  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:44.174584  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:44.174420  7990 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:44.175309  8319 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.761s	user 0.001s	sys 0.001s
I20260709 13:16:44.175681  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:44.176422  3051 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:44.178980  8262 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:44.179847  8262 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:44.174439  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.146338  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:44.182027  3050 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:16:44.116120  8107 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:16:44.182821  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:44.183091  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:44.183616  3799 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:44.184438  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:44.145881  8364 log.cc:927] Time spent T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:16:44.147365  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:44.134410  7719 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:44.186251  3047 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:16:44.146733  8341 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.731s	user 0.004s	sys 0.000s
I20260709 13:16:44.186769  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:44.187220  3121 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:44.187637  7719 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:44.174422  3794 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:44.188535  3795 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:44.189334  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2121) took 1205 ms. Trace:
I20260709 13:16:44.165637  7970 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.189723  3195 rpcz_store.cc:276] 0709 13:16:42.983319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.983964 (+   645us) service_pool.cc:224] Handling call
0709 13:16:42.984422 (+   458us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:42.984942 (+   520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.984983 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:42.985707 (+   724us) log.cc:844] Serialized 52 byte log entry
0709 13:16:43.344386 (+358679us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:43.713871 (+369485us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.714358 (+   487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.714511 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.145844 (+431333us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:44.188884 (+ 43040us) raft_consensus.cc:1685] finished
0709 13:16:44.188983 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.189112 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":386062,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":15202,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":1872,"spinlock_wait_cycles":9415040,"thread_start_us":438535,"threads_started":2,"wal-append.queue_time_us":404298}
I20260709 13:16:44.192860  7970 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:44.194229  3049 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 14: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:44.194751  3792 raft_consensus.cc:2368] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16.
I20260709 13:16:44.195775  7990 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:44.162075  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:44.143322  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:44.164913  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.166529  8132 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:44.185921  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 57282.4us
I20260709 13:16:44.198407  3164 leader_election.cc:400] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12.
I20260709 13:16:44.198789  3164 leader_election.cc:403] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:44.198889  3120 raft_consensus.cc:2393] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 15: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:44.200064  8132 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:44.200917  8253 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:44.202145  8357 raft_consensus.cc:3055] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:44.202641  8357 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:44.167131  3126 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:44.167977  3123 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:16:44.168643  3791 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:44.154552  7986 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:44.203912  8357 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.204844  7986 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:44.205349  7986 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:44.157498  3798 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:44.150684  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:44.180931  8172 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:44.205418  8357 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:44.219826  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.213641  3791 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:44.201517  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:44.208192  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:44.210736  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:44.184532  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:44.208420  8326 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.223304  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:44.224040  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:44.225474  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:44.226373  3120 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16. Ops: []
W20260709 13:16:44.228098  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 104445us
I20260709 13:16:44.230577  3042 raft_consensus.cc:2410] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:16:44.233493  3123 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:16:44.231154  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 110737us
I20260709 13:16:44.200914  8132 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:16:44.236335  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:44.232726  3796 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:44.239236  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:44.243381  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:44.210409  8181 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:44.250996  3043 raft_consensus.cc:2410] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:16:44.238757  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:44.210527  8283 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:44.256456  3126 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:16:44.255185  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:44.251798  3047 raft_consensus.cc:2376] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17. Re-sending same reply.
I20260709 13:16:44.258988  8107 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12.
I20260709 13:16:44.260926  7743 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:44.261761  8326 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.264776  8326 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:44.242355  7719 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:16:44.265878  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:44.266618  3044 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:44.259289  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:44.268290  3125 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:44.240054  8015 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:44.269359  8015 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.270191  8262 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:44.271509  8015 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:44.272425  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 74230.8us
I20260709 13:16:44.274704  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:44.275458  8334 raft_consensus.cc:993] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: : Instructing follower aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:16:44.276058  8206 raft_consensus.cc:1081] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Signalling peer aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:16:44.281909  7719 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.282080  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:44.282531  7719 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:44.206763  8155 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.261471  7743 raft_consensus.cc:697] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:44.293618  3051 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:44.294360  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:44.292979  3123 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:16:44.297302  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:44.299108  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:44.293902  8146 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:44.299604  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:44.311722  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:44.312520  3049 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:44.319839  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:44.318683  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:44.321256  3123 raft_consensus.cc:2410] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:16:44.326169  3050 raft_consensus.cc:2410] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:16:44.300778  8096 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.328207  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:44.329862  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.314298  8146 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.337387  3046 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:44.339696  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:44.338738  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:44.344286  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:44.343588  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:44.347613  8172 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.348217  8172 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.348613  8171 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:44.350564  8372 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:44.351313  8372 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.338366  8326 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:16:44.357175  3761 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:44.355727  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 71768us
I20260709 13:16:44.355795  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:44.360821  3051 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:44.362097  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:44.362334  3122 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:16:44.363443  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:44.363797  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:44.364194  3124 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:44.364661  3122 raft_consensus.cc:2410] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:16:44.365105  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:44.365432  3044 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:44.357537  8096 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:44.366519  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:44.367579  3044 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 14: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:44.368574  8096 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:44.370919  3044 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:44.372493  3044 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:16:44.373365  3049 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:44.375710  3126 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:16:44.377885  7990 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:44.385864  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:44.386161  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:44.378432  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:44.387346  3120 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:44.387421  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:44.388042  3198 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:44.388345  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:44.388513  3195 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:44.389864  3197 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:44.390121  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:44.390769  7990 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:44.391741  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:44.391882  7990 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:44.392472  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:44.392905  3191 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 15: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:44.393278  3200 raft_consensus.cc:2410] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:16:44.346055  8262 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:44.379233  3122 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:16:44.393987  3045 raft_consensus.cc:1240] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:44.346436  8146 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:44.399701  3043 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:44.402096  8155 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:44.404002  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:44.360255  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:44.378604  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:44.329890  7743 consensus_queue.cc:237] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.398499  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:44.394428  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:44.413689  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 76809.4us
I20260709 13:16:44.413832  8326 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:44.414363  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:44.414552  3164 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:44.414717  8326 raft_consensus.cc:697] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:44.415508  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:44.416294  3122 raft_consensus.cc:2410] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:16:44.415937  8326 consensus_queue.cc:237] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.418113  8107 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:44.418447  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:44.418673  8107 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.419281  8107 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:44.419552  3792 raft_consensus.cc:2393] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:44.422133  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:44.424156  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 68189.5us
I20260709 13:16:44.406391  8172 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:44.396800  8262 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:44.425244  8262 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:44.426134  7970 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:44.427325  3761 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:44.427332  7970 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:44.428378  8206 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:44.428848  7970 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:44.350593  7719 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:44.430011  8206 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:44.430637  8206 raft_consensus.cc:697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:44.410586  8372 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:44.395344  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:44.414101  3046 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:44.436813  3198 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:44.462042  3117 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:44.466180  3049 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
W20260709 13:16:44.467954  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 64066.9us
I20260709 13:16:44.466724  3049 pending_rounds.cc:85] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 8
I20260709 13:16:44.477244  3049 pending_rounds.cc:107] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:16:44.489446  3049 raft_consensus.cc:2889] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:44.489632  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:44.490633  3126 raft_consensus.cc:2410] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:16:44.483462  8146 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.476101  8372 raft_consensus.cc:2764] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:16:44.430004  8291 consensus_queue.cc:1059] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:16:44.494997  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:44.506259  3792 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:44.509007  3124 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:16:44.510423  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:44.516072  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:44.517110  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:44.526037  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:44.525919  8015 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:44.534281  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:44.536007  3791 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:16:44.539765  3120 raft_consensus.cc:2368] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15.
I20260709 13:16:44.540904  3761 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:44.542440  3117 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:44.545359  3122 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:44.486621  3050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:47488
I20260709 13:16:44.582638  3050 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:44.583282  3050 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:44.550324  8283 consensus_queue.cc:1059] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:16:44.488965  8206 consensus_queue.cc:237] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.591534  8146 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:44.594877  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 54070.8us
I20260709 13:16:44.594246  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:44.597054  3199 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:16:44.598076  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 50265.3us
I20260709 13:16:44.599956  3051 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
W20260709 13:16:44.599982  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 52529us
I20260709 13:16:44.605226  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:44.518368  7970 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:16:44.499779  7986 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:44.605655  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.606050  3125 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
W20260709 13:16:44.608501  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.615775  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:44.616598  3121 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
W20260709 13:16:44.610443  8378 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:16:44.629349  3046 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:16:44.630187  3200 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:16:44.607775  8291 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:44.635071  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:44.638216  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.593726  8096 consensus_queue.cc:1059] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:16:44.594300  8107 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.607334  8171 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:44.639222  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:44.631280  8146 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.653122  8234 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:44.666473  3121 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:16:44.626135  8283 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:16:44.668473  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:44.669471  3121 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:16:44.664800  8355 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:16:44.674368  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:44.676210  3118 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:44.665068  8165 raft_consensus.cc:3055] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:44.677920  8165 raft_consensus.cc:740] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:44.679059  8165 consensus_queue.cc:260] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.680493  8165 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:44.684475  8172 raft_consensus.cc:3055] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:44.684990  8172 raft_consensus.cc:740] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:44.685998  8172 consensus_queue.cc:260] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.687136  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:44.687470  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.688027  3049 raft_consensus.cc:2393] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 15: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:44.688562  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:44.689375  3048 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:44.689627  7986 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:44.691308  8334 raft_consensus.cc:3055] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:44.691795  8334 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:44.692881  8334 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.631980  8358 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:44.669816  8155 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:44.670493  8146 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:44.658224  3119 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:44.666391  8234 raft_consensus.cc:697] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:44.654932  8107 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:44.665158  8262 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.695715  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:44.726310  8155 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.733989  8155 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:44.692905  7719 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.739360  7719 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:44.637509  8291 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:44.712492  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:44.720642  3090 leader_election.cc:400] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16.
I20260709 13:16:44.755421  3090 leader_election.cc:403] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:16:44.698429  8387 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:16:44.728940  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:44.720911  8358 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:44.687515  8172 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:44.779734  3192 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:44.793289  3043 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:16:44.792362  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 96771.8us
I20260709 13:16:44.772676  8291 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:44.799397  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 78915.1us
I20260709 13:16:44.741703  7719 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:44.804164  3123 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:44.774704  3121 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:44.723802  3050 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.801906  8372 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:44.792348  8334 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:44.802774  3091 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:44.812182  8357 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.802136  8253 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16.
I20260709 13:16:44.780578  8181 consensus_queue.cc:1059] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:16:44.822760  3046 raft_consensus.cc:2410] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:16:44.796310  8337 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:16:44.830207  3050 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:44.814571  8372 raft_consensus.cc:697] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 14 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:44.829214  8253 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:44.826956  8326 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.839213  8132 raft_consensus.cc:3055] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:44.827688  8357 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:44.880877  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 80521.1us
I20260709 13:16:44.871860  3046 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:44.871471  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 248908us
I20260709 13:16:44.847718  8146 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:44.876776  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:44.871471  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:44.885859  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:44.886209  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 88218.7us
I20260709 13:16:44.895687  3045 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:44.896672  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:44.862620  8132 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:16:44.900360  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.904217  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.904570  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.900285  8262 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:44.901091  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:44.879578  8326 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:44.909551  8326 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:44.912426  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:44.913516  8245 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.914033  3199 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:16:44.914196  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:44.914475  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:44.915128  7719 raft_consensus.cc:2764] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:16:44.915923  3200 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:16:44.916846  8096 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.917454  8096 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:44.919791  8096 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:44.902952  8358 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:44.906052  3798 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:44.907150  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:44.941299  3046 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:44.915333  3193 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 14: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:44.915935  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:44.941567  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:44.916536  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:44.942828  3051 raft_consensus.cc:2410] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 18 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:16:44.863365  8234 consensus_queue.cc:237] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:44.922931  8390 log.cc:927] Time spent T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.089s	user 0.000s	sys 0.002s
I20260709 13:16:44.924304  8132 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.901940  8372 consensus_queue.cc:237] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:44.914090  8245 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:44.931861  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:44.961414  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:44.946125  8165 consensus_queue.cc:1059] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:16:44.962304  3192 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:44.963408  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:44.932236  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:44.966187  3199 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:44.967221  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:44.968911  3199 raft_consensus.cc:2393] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:44.969971  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:44.970582  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:44.971237  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:44.971643  3191 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:16:44.967877  8245 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:44.973039  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:44.973501  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:44.974272  3199 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:44.974459  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:44.976282  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:44.981276  8383 log.cc:927] Time spent T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:16:44.932658  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:44.929656  8391 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.130s	user 0.003s	sys 0.000s
I20260709 13:16:44.934206  3090 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:44.935077  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:44.934847  8291 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:44.990950  3196 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:44.992772  8291 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:44.936265  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:44.897157  8337 consensus_queue.cc:1059] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:16:44.993976  8357 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:44.994272  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:44.994465  8337 raft_consensus.cc:3055] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:44.995126  8337 raft_consensus.cc:740] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:44.937251  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:44.939455  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:44.920987  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:44.946805  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.936208  8155 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:44.931886  8393 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.081s	user 0.002s	sys 0.000s
I20260709 13:16:44.982316  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:45.012126  3194 raft_consensus.cc:2410] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:16:44.987427  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:44.988579  3046 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
W20260709 13:16:44.996188  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46654.7us
W20260709 13:16:45.000104  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 66044.4us
I20260709 13:16:44.998798  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:45.002481  3199 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:45.003127  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:44.997879  3197 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:45.019179  3047 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:45.020428  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:45.020833  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:45.021217  3049 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 14: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:45.020830  3044 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:45.021698  3192 raft_consensus.cc:2376] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14. Re-sending same reply.
I20260709 13:16:45.010216  8253 raft_consensus.cc:2764] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:16:45.017830  3200 raft_consensus.cc:2376] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13. Re-sending same reply.
I20260709 13:16:45.034848  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:45.036881  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 119146us
I20260709 13:16:45.041352  3090 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:45.043227  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:44.989521  7970 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 13:16:45.046025  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 158654us
I20260709 13:16:45.026609  7990 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:16:45.050622  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 109360us
I20260709 13:16:45.054041  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:45.055327  8253 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:45.055215  7743 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:45.048533  8165 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
W20260709 13:16:45.066493  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.045918  8337 consensus_queue.cc:260] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:45.071478  8337 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:45.075217  8155 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:45.045450  8245 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:16:45.078989  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 51536.8us
I20260709 13:16:45.047698  7986 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 13:16:45.081609  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.092833  3798 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:16:45.093935  8132 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:45.106590  3196 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:45.106746  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:45.106422  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:45.116943  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:45.117584  3165 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:45.119822  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:45.121048  3050 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:45.131894  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 84971.7us
I20260709 13:16:45.131412  3046 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:16:45.136579  3165 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:45.157914  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.160337  7926 consensus_queue.cc:1059] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:45.160604  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:45.161755  7926 raft_consensus.cc:3055] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:45.162206  7926 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:45.162349  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:45.163288  7926 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:45.164769  7926 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:45.168535  3165 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:45.172338  3165 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:45.120160  8171 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:45.188212  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 139959us
I20260709 13:16:45.135100  8155 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:45.195549  3091 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:45.185804  8187 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:45.189328  8107 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:45.202852  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 151675us
I20260709 13:16:45.130295  8245 consensus_queue.cc:1059] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
W20260709 13:16:45.199836  8399 log.cc:927] Time spent T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:45.195181  8326 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:45.209688  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:45.211934  3091 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:45.216246  8357 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:45.216988  8357 raft_consensus.cc:697] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:45.218164  8357 consensus_queue.cc:237] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:45.221925  3091 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:45.223285  8253 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:45.225126  3091 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:45.226251  8253 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:45.227227  8155 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:45.227782  8155 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:45.228297  8155 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:45.230067  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 45674.4us
I20260709 13:16:45.232556  8253 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:45.234542  8253 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:45.234666  3091 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:45.235800  8181 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:45.235740  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:45.203013  8146 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:45.237377  3091 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:45.233314  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:45.240792  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.264213  3091 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:45.252091  8326 raft_consensus.cc:697] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:45.267836  7970 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:16:45.236511  8181 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:45.236617  8372 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:45.258987  8146 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:16:45.284519  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 48930.7us
I20260709 13:16:45.285713  3191 raft_consensus.cc:2368] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16.
I20260709 13:16:45.278441  3090 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:45.296936  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 134687us
I20260709 13:16:45.311244  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:45.274152  8253 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:45.273859  8358 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:45.279788  8181 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:45.284808  8171 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:45.288259  8146 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:45.293814  8334 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:45.342039  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 169819us
W20260709 13:16:45.345846  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 136249us
I20260709 13:16:45.284113  8155 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:45.354862  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 90743.1us
W20260709 13:16:45.358031  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 60373.8us
I20260709 13:16:45.356011  3091 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:45.279507  8326 consensus_queue.cc:237] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:45.367774  3091 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:45.357092  8253 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:45.369004  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:45.370786  8358 raft_consensus.cc:697] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:45.372532  8420 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:45.377770  8420 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:45.376885  8357 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:16:45.378518  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 100202us
I20260709 13:16:45.379153  8358 consensus_queue.cc:237] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:45.379650  3090 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:45.361500  8410 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:45.374258  3091 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:45.387809  8408 log.cc:927] Time spent T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
W20260709 13:16:45.388967  8404 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:16:45.389779  7977 raft_consensus.cc:3055] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:45.390196  7977 raft_consensus.cc:740] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:45.391075  7977 consensus_queue.cc:260] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:45.392279  7977 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:45.400794  8406 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:16:45.373775  8094 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:16:45.406754  8155 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:45.385385  8410 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:45.408183  8410 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:45.409504  8414 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.410181  8414 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:45.413203  8414 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:45.414007  8411 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:45.381592  8262 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:16:45.417098  3047 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:45.419088  3164 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:45.420326  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:45.421053  3046 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:45.420778  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:45.422348  3043 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:45.427168  8094 consensus_queue.cc:1059] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:45.427253  7743 consensus_queue.cc:1059] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:45.428234  8094 raft_consensus.cc:3055] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:45.428606  8094 raft_consensus.cc:740] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:45.428707  7743 raft_consensus.cc:3055] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:45.429088  7743 raft_consensus.cc:740] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:45.429651  8094 consensus_queue.cc:260] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:45.449420  8094 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:45.429953  7743 consensus_queue.cc:260] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:45.451134  7743 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:45.433650  8262 raft_consensus.cc:2955] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Committing config change with OpId 16.9: config changed from index -1 to 9, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:16:45.445817  8171 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:45.457844  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.458703  8340 raft_consensus.cc:3055] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:45.459151  8340 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:45.460119  8340 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:45.461169  8340 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:45.460521  3051 raft_consensus.cc:2955] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Committing config change with OpId 16.9: config changed from index -1 to 9, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:16:45.380465  8357 raft_consensus.cc:697] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:45.466686  8357 consensus_queue.cc:237] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:45.441816  8172 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:45.468286  8146 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:45.438870  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:45.470983  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 96824.1us
W20260709 13:16:45.473958  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 101284us
W20260709 13:16:45.470973  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 102124us
I20260709 13:16:45.473201  8253 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:45.468420  8181 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:45.477285  8253 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:45.477695  8253 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:45.478909  8181 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:45.483134  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:45.484115  8171 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:45.485088  3164 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:45.485975  8171 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:45.487365  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:45.490859  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:45.502220  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:45.503670  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 124106us
I20260709 13:16:45.505483  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:45.514204  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:45.522277  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:45.526209  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:45.526590  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:45.490245  8414 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:45.527324  3122 raft_consensus.cc:2368] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15.
I20260709 13:16:45.527726  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:45.529250  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:45.532509  3042 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:45.525600  8181 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:16:45.536325  8253 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:45.537820  8094 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:45.539449  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:45.515604  8171 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:45.514104  8337 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.524899  8420 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:45.522725  7926 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.531889  8414 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:16:45.565867  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.566798  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:45.568152  8146 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:45.568709  7719 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:45.545641  8410 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:45.560197  7926 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:45.571022  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 80252.3us
I20260709 13:16:45.573160  3164 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:45.589864  3761 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:45.596366  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:45.556317  8326 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:45.582484  8414 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:45.560497  8337 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:45.599650  3761 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:45.589864  8358 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.602099  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:45.597385  8146 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:45.611321  8334 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:45.600783  8187 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:16:45.617599  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.618834  3761 leader_election.cc:400] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16.
W20260709 13:16:45.633882  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 129309us
I20260709 13:16:45.615159  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:16:45.639575  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.637362  3090 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:45.616571  8253 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:45.625627  8412 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:45.625512  8422 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.649418  8422 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:45.651857  8422 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:45.653280  7926 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:45.623176  8187 raft_consensus.cc:697] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:45.653693  8414 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:45.655613  8187 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:45.654758  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:45.612944  8416 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:45.667763  3197 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:45.668232  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:45.660368  3117 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:45.664101  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:45.670668  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.670665  3199 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:16:45.615291  8337 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:45.616214  8410 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:45.674288  3117 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:16:45.612759  8181 consensus_queue.cc:1243] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:45.676713  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:45.678512  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 63423.1us
I20260709 13:16:45.679996  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:45.680888  3196 raft_consensus.cc:2410] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:16:45.681649  3191 pending_rounds.cc:85] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 9
I20260709 13:16:45.681969  3191 pending_rounds.cc:107] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:16:45.682191  3191 raft_consensus.cc:2889] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:45.609368  8358 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:45.682377  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:45.687994  3117 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:16:45.675585  8412 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:45.688449  3050 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:45.689785  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:45.690428  3798 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:45.675632  8357 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:45.693500  8358 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:45.686272  8283 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
W20260709 13:16:45.698240  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.678128  8416 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:45.711918  3761 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:45.701463  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 66337.2us
I20260709 13:16:45.710381  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:45.713646  3042 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:16:45.713944  3090 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:45.711158  3124 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:16:45.715852  8206 consensus_queue.cc:1059] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:45.717321  7743 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:45.717414  8206 raft_consensus.cc:3055] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:45.719503  3091 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:45.727658  3798 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:45.718061  3761 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:45.727245  3091 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:45.730629  3090 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:45.732076  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 68836.2us
I20260709 13:16:45.690069  8412 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:45.717973  8206 raft_consensus.cc:740] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:45.736948  3164 leader_election.cc:400] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15.
I20260709 13:16:45.741292  3164 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:45.741387  8094 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:45.742779  8094 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:45.743072  8420 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:45.743528  8420 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:45.734920  8422 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:45.734804  8337 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:45.744437  8420 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:45.742921  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:45.743932  3761 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:45.746958  3090 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:45.745400  8165 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:16:45.750272  8172 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:16:45.760150  8430 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:16:45.760856  8420 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:45.762702  7743 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:45.736147  8253 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:45.734869  7926 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.763873  7926 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:45.765156  7743 raft_consensus.cc:697] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:45.766573  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:45.766216  7743 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:45.767277  3164 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:45.769403  8155 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:45.748518  8337 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:45.770543  8337 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:45.772352  8096 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:45.773065  8096 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:45.749439  8422 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.774191  8422 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:45.732805  8181 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:45.776953  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:45.775098  3164 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:45.782192  3164 leader_election.cc:400] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15.
I20260709 13:16:45.782774  3164 leader_election.cc:403] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:16:45.785341  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:45.788767  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:45.789441  3121 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:45.739200  8412 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:45.786217  3125 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:45.802449  3124 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:45.802922  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:45.791944  3121 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:45.801936  7977 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:45.792387  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:45.788607  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:45.803738  3125 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:45.796065  3119 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:45.796775  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:45.797987  3120 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:16:45.799156  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:45.809859  3120 pending_rounds.cc:85] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 11
I20260709 13:16:45.810283  3120 pending_rounds.cc:107] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:16:45.810837  3120 raft_consensus.cc:2889] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:45.810214  3126 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:45.794124  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:45.814491  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:45.815692  3042 raft_consensus.cc:2410] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 15 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:16:45.817935  3046 raft_consensus.cc:1275] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:45.819201  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:45.823135  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:45.824524  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 47640.1us
I20260709 13:16:45.826689  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:45.827885  3791 raft_consensus.cc:2410] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:16:45.828603  3799 raft_consensus.cc:2368] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15.
I20260709 13:16:45.781546  8181 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.836675  3796 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:45.813479  8187 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.791273  8171 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15.
I20260709 13:16:45.825611  3090 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:45.792045  7986 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.804422  8172 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:45.830619  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:45.843374  8181 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:45.801749  8253 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:45.861198  3199 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:45.868072  3792 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:45.869167  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:45.870452  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:45.873167  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:45.875070  3196 raft_consensus.cc:2376] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16. Re-sending same reply.
I20260709 13:16:45.877398  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:45.877655  3199 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:45.873051  3164 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:45.878108  3200 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:16:45.863152  7926 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:45.863478  8429 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.890722  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:45.891029  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:45.891139  8429 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:45.893424  8429 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:45.858146  8187 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:45.895961  8187 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:45.887462  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:45.868328  8132 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:45.888448  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:45.887362  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:45.888532  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:45.890390  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:45.891680  3197 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:45.866268  8253 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.884888  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:45.898250  3164 leader_election.cc:400] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15.
W20260709 13:16:45.901504  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 76009.5us
I20260709 13:16:45.902297  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:45.902563  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:45.902804  3796 raft_consensus.cc:2393] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 17: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:45.904310  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:45.904844  3194 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:16:45.906795  3196 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:45.914136  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:45.914795  3194 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:45.864975  7986 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:45.886060  8414 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:45.917419  8431 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:16:45.905395  8253 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:45.916196  3798 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:16:45.928236  7986 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:45.928354  8326 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:45.928355  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:45.928929  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:45.898214  8206 consensus_queue.cc:260] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:45.929905  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:45.930066  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:45.930552  3196 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:45.934280  8442 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:45.936158  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:45.937290  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:45.940313  3793 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
W20260709 13:16:45.942780  3015 connection.cc:256] RPC call timeout handler was delayed by -2.1094517259998611s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 13:16:45.943281  3015 connection.cc:256] RPC call timeout handler was delayed by -1.8817517259999477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
W20260709 13:16:45.943652  3015 connection.cc:256] RPC call timeout handler was delayed by -1.4004758139999467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260709 13:16:45.943931  3015 connection.cc:256] RPC call timeout handler was delayed by -1.3320758139998361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
W20260709 13:16:45.944211  3015 connection.cc:256] RPC call timeout handler was delayed by -1.2843758139999863s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260709 13:16:45.944509  3015 connection.cc:256] RPC call timeout handler was delayed by -1.1223758139999518s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
I20260709 13:16:45.944599  3799 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
W20260709 13:16:45.944836  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0395758140000453s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
I20260709 13:16:45.945550  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:45.946663  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 44259us
I20260709 13:16:45.947444  3164 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:16:45.949410  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.930603  3120 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:45.958627  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:45.959754  3120 raft_consensus.cc:2410] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:16:45.956149  3125 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:16:45.956887  8372 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:45.969590  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:45.916555  8429 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:45.884224  7743 consensus_queue.cc:1059] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:16:45.937366  3196 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
W20260709 13:16:45.970830  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 58721.3us
I20260709 13:16:45.973254  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:45.972556  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:45.977248  3125 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:45.975274  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:45.979079  3090 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:45.979890  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:45.980664  3120 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:16:45.984190  8358 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:45.984506  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:45.985482  8444 ts_tablet_manager.cc:933] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:45.986462  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:45.987354  3196 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:16:45.969837  7986 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:16:45.969918  8414 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:46.011438  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:46.012673  7986 raft_consensus.cc:2764] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:16:46.013582  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 44059.1us
I20260709 13:16:46.014433  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:46.014647  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:46.015231  3120 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:46.015609  7986 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:46.016052  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:46.016185  7986 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.016706  7986 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:46.020681  8181 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:46.016703  3120 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:16:46.022557  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:46.024159  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:46.017042  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:46.026358  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:46.027947  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:46.014560  3015 leader_election.cc:400] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 14. Current term is 15.
I20260709 13:16:46.030380  8422 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:46.030736  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:46.031556  8410 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:46.032636  8422 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:45.882593  8416 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:46.032895  3120 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:16:45.958081  8442 raft_consensus.cc:697] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:46.037492  3164 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:46.060446  3194 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:46.033491  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:46.068365  3090 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:45.981019  8372 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:46.071672  7926 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:46.079982  8372 raft_consensus.cc:697] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:46.080091  7926 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.080629  7926 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:46.081184  8372 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:46.078312  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 44912.5us
I20260709 13:16:46.066504  8412 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:46.082979  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:46.084157  8412 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:46.084303  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 44014us
I20260709 13:16:46.084856  8412 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:46.086932  8187 consensus_queue.cc:1059] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:46.088521  8187 raft_consensus.cc:3055] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:46.088905  8187 raft_consensus.cc:740] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:45.974352  8337 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:46.091939  8337 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:46.092118  8420 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:46.092760  8420 raft_consensus.cc:697] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:45.999496  8357 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:46.093462  3120 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:46.093933  8357 raft_consensus.cc:697] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:46.093672  8420 consensus_queue.cc:237] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:46.094933  8357 consensus_queue.cc:237] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:46.093506  8442 consensus_queue.cc:237] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:46.098023  3090 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:46.099378  3090 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:46.099864  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:46.076823  7986 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:46.037937  8414 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.078078  8410 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:46.078294  8438 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:16:46.078446  3123 raft_consensus.cc:2410] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:16:46.070576  8334 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:46.070960  8441 consensus_queue.cc:1059] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:16:46.103332  8132 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:46.103941  8337 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:46.103916  8107 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:46.104959  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:46.107741  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:46.127302  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:16:46.128521  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 44320.8us
I20260709 13:16:46.128728  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:46.179728  3798 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:46.183787  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:46.110862  8412 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:46.188508  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:46.184729  3796 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:46.189435  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:46.190416  3196 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:46.111225  8414 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:46.189540  3797 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:16:46.191442  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:46.202158  8181 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:46.203939  7986 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:46.204905  8443 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.220s	user 0.002s	sys 0.000s
I20260709 13:16:46.131888  8429 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:46.132125  8334 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:46.206009  8445 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:16:46.238067  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:46.238925  3045 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:16:46.114823  8187 consensus_queue.cc:260] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:46.249545  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:46.257002  3042 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:16:46.209110  8410 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:16:46.250459  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:46.267496  3196 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:16:46.267524  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:46.273450  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:46.274256  3121 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:46.275071  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:46.274057  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:46.275899  3197 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:46.276279  3046 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:46.277122  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:46.277760  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:46.284673  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:46.286216  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:46.287599  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:46.281395  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:46.289356  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:46.293830  3117 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:46.297609  3091 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:46.222229  8429 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:46.305075  3117 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:16:46.321696  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:46.371295  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:46.372290  3043 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:46.374300  3196 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:46.376401  3196 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:46.376919  3121 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:46.377539  3196 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:46.384696  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:46.307073  8181 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:16:46.392653  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 143219us
I20260709 13:16:46.383445  8155 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:46.406342  8155 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.406802  8155 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:46.400168  3090 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:46.391021  8422 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:16:46.409956  8422 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:46.401429  8452 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:46.418684  3196 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:16:46.420347  3196 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:16:46.424275  8460 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.424896  8460 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:46.426100  7977 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:46.426584  7977 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:46.427340  8460 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:46.390878  8424 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.022s	sys 0.035s
W20260709 13:16:46.429085  8424 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.023s	sys 0.035s
I20260709 13:16:46.435694  8429 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:46.440379  7926 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:46.442806  8334 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:46.391753  8181 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.402108  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:46.379562  8146 consensus_meta.cc:287] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.743s	user 0.011s	sys 0.016s
I20260709 13:16:46.412981  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:46.415905  3043 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:46.417054  8422 raft_consensus.cc:697] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:46.436113  3164 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:46.448443  3046 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:16:46.452014  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:46.472898  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 70961.4us
I20260709 13:16:46.474668  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:46.488787  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.449999  8181 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:46.517071  3191 raft_consensus.cc:1240] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:16:46.474504  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:46.455228  8460 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:46.522648  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:46.452744  8146 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:16:46.523835  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.456449  8452 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:16:46.525571  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 51189.6us
I20260709 13:16:46.518311  8091 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.528517  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:46.557341  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.532788  3797 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:46.516273  8431 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:46.518525  8412 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:46.562973  3122 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:46.561327  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:46.527837  8460 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.563972  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:46.529277  8452 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.565083  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:46.484639  8429 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:46.596131  3120 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:46.567677  8422 consensus_queue.cc:237] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:46.600136  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:46.600818  3191 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:46.601919  8453 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:16:46.602833  3194 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: [12.7-16.8]
I20260709 13:16:46.603507  8412 consensus_queue.cc:1059] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:46.604293  3194 raft_consensus.cc:1275] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:46.604395  3198 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:46.561873  8410 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:16:46.584276  8452 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:46.608210  8155 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:46.611454  3043 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:46.558737  8091 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:46.613425  3042 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:16:46.614955  8091 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:46.621639  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:46.577857  8460 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:46.558635  8464 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:46.560061  8411 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:46.627166  8410 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:46.627893  3046 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
W20260709 13:16:46.628674  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 63657.2us
W20260709 13:16:46.630261  8253 consensus_meta.cc:287] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.684s	user 0.012s	sys 0.000s
I20260709 13:16:46.654006  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:46.638684  3119 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:46.631274  8155 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:46.629630  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:46.658144  3191 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:46.604331  8412 raft_consensus.cc:3055] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:16:46.657867  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 356508us
I20260709 13:16:46.661398  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:46.662571  3091 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:46.666107  3046 raft_consensus.cc:3055] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:46.666671  3046 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:46.669312  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:46.643236  8464 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:46.654110  8411 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.694438  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:46.696612  3048 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:46.696955  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:46.662250  8412 raft_consensus.cc:740] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:46.701066  3042 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 11: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:46.670478  8410 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:46.674796  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:46.715340  3200 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:46.677340  8432 log.cc:927] Time spent T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.971s	user 0.003s	sys 0.000s
W20260709 13:16:46.683542  8454 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.566s	user 0.002s	sys 0.000s
I20260709 13:16:46.693125  7926 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:46.701124  3164 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:46.708496  8459 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:16:46.711314  8457 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:16:46.712874  3196 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:16:46.660097  8253 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:46.723740  8262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.005s	sys 0.031s
W20260709 13:16:46.717983  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 56671.1us
I20260709 13:16:46.786149  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:46.787437  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:46.667634  3046 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:46.692834  8464 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:46.696758  8357 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:46.701129  8372 raft_consensus.cc:2764] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
W20260709 13:16:46.768507  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 67514.7us
I20260709 13:16:46.771907  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:46.787027  3091 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:46.797307  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:46.773072  3120 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:46.774137  3126 raft_consensus.cc:2955] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Committing config change with OpId 16.9: config changed from index -1 to 9, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:16:46.702243  8146 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.689138  8470 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 13:16:46.719058  8444 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.013s	sys 0.031s
I20260709 13:16:46.696177  8411 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:46.816169  3118 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 18: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:46.791944  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:46.816921  3119 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:46.793107  3046 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:46.803169  3120 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:46.799095  3124 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:46.810355  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:46.779930  7986 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:16:46.790187  8262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.088s	user 0.005s	sys 0.031s
I20260709 13:16:46.815464  8422 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:46.833139  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:46.814744  3091 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:46.816605  3042 raft_consensus.cc:3055] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:46.836444  3042 raft_consensus.cc:740] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:46.836688  3124 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:46.837627  3042 consensus_queue.cc:260] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:46.812378  3165 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:46.830698  3046 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:16:46.817562  8444 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.013s	sys 0.031s
I20260709 13:16:46.838979  3042 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:46.839416  8444 tablet_copy_client.cc:323] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.131:38665
I20260709 13:16:46.838300  8165 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.840660  8165 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:46.790627  8459 raft_consensus.cc:697] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:46.842821  8459 consensus_queue.cc:237] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:46.848843  8337 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:46.857896  8165 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:46.814136  8171 raft_consensus.cc:3055] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:46.858959  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2865) took 1328 ms. Trace:
I20260709 13:16:46.868643  3090 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:46.878968  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:46.877951  8422 raft_consensus.cc:697] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:46.859592  3047 rpcz_store.cc:276] 0709 13:16:45.501697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.503534 (+  1837us) service_pool.cc:224] Handling call
0709 13:16:45.528921 (+ 25387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:45.549334 (+ 20413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:45.549382 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:45.560904 (+ 11522us) log.cc:844] Serialized 26 byte log entry
0709 13:16:45.647260 (+ 86356us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:45.647344 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.647424 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:46.676485 (+1029061us) spinlock_profiling.cc:243] Waited 6.33 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:46.822538 (+146053us) raft_consensus.cc:1685] finished
0709 13:16:46.822563 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.830192 (+  7629us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":166,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":6815,"spinlock_wait_cycles":14561024,"thread_start_us":56198,"threads_started":1,"wal-append.queue_time_us":118617}
I20260709 13:16:46.829898  7986 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.816144  8132 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:16:46.913220  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:46.894321  8468 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:46.894119  8458 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.177s
I20260709 13:16:46.895186  8431 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:46.897469  7986 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:46.919237  3195 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:16:46.898488  8472 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:16:46.886323  8337 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:46.890192  8443 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:16:46.898509  8452 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:46.902535  3042 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:16:46.902384  2942 catalog_manager.cc:5697] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:46.905777  8449 log.cc:927] Time spent T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.922s	user 0.009s	sys 0.003s
I20260709 13:16:46.770423  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:46.806348  8412 consensus_queue.cc:260] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:46.816416  8358 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:16:46.815964  8146 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:46.882920  8456 log.cc:927] Time spent T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:16:46.875705  8372 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:46.865157  8171 raft_consensus.cc:740] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:46.882442  8424 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:46.921672  3042 pending_rounds.cc:85] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 11
W20260709 13:16:46.910418  8473 log.cc:927] Time spent T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:16:46.922921  8357 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:16:46.924546  7743 raft_consensus.cc:3055] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:46.959757  7743 raft_consensus.cc:740] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:16:46.961330  8466 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.248s	user 0.000s	sys 0.002s
I20260709 13:16:46.960929  7743 consensus_queue.cc:260] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:46.924296  2942 catalog_manager.cc:5697] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:46.926738  8253 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:46.919282  8155 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:46.927539  8482 consensus_queue.cc:1059] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:46.928375  8470 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:16:46.929343  2947 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57744 (request call id 243) took 22876 ms (client timeout 15000 ms). Trace:
I20260709 13:16:46.926817  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 804) took 1261 ms. Trace:
I20260709 13:16:46.931823  8452 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:46.951166  8468 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:46.939457  7977 consensus_meta.cc:287] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.000s
I20260709 13:16:46.939978  8422 consensus_queue.cc:237] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:46.945240  3200 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:16:46.886744  8410 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:46.915112  8429 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:46.919585  8431 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:46.953157  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:47.007419  3791 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:46.954501  3042 pending_rounds.cc:107] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:16:47.008072  3042 raft_consensus.cc:2889] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:46.961124  8171 consensus_queue.cc:260] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:46.962391  7743 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:46.967115  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.978971  3797 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:46.981760  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2371) took 1188 ms. Trace:
W20260709 13:16:46.978091  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 145008us
I20260709 13:16:47.015859  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:47.017563  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:47.015447  3123 rpcz_store.cc:276] 0709 13:16:45.793515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.793844 (+   329us) service_pool.cc:224] Handling call
0709 13:16:46.981438 (+1187594us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54003917d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:46.981666 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":612559744}
I20260709 13:16:47.019253  3119 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:46.983294  3192 rpcz_store.cc:276] 0709 13:16:45.665375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.665539 (+   164us) service_pool.cc:224] Handling call
0709 13:16:45.775103 (+109564us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b5800136e98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28eeee 0000000000375939 00007ff8353021e0 00007ff8353cb0c4 00007ff8353cb131 00007ff83538cfc0 00007ff835377929 00007ff8353773d2 00007ff82e8eebd4
0709 13:16:45.775272 (+   169us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:45.873818 (+ 98546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:45.873864 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:45.900599 (+ 26735us) log.cc:844] Serialized 26 byte log entry
0709 13:16:46.068208 (+167609us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:46.068271 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.068374 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:46.904999 (+836625us) spinlock_profiling.cc:243] Waited 75.6 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:46.926604 (+ 21605us) raft_consensus.cc:1685] finished
0709 13:16:46.926628 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.926758 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":314,"raft.queue_time_us":13073,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":176625664,"thread_start_us":221951,"threads_started":2,"wal-append.queue_time_us":73033}
I20260709 13:16:46.938580  8187 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:46.976594  2942 catalog_manager.cc:5697] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:46.953269  8412 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:46.993167  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2150) took 1098 ms. Trace:
I20260709 13:16:46.950407  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2141) took 1052 ms. Trace:
I20260709 13:16:46.978255  7970 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.025177  3195 rpcz_store.cc:276] 0709 13:16:45.890493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.893861 (+  3368us) service_pool.cc:224] Handling call
0709 13:16:46.913083 (+1019222us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b5800136e98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28ee9c 00007ff82d28ea5b 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff8353790a0 00007ff835378984 00007ff82e8f36d4 00007ff82e8f3662
0709 13:16:46.942585 (+ 29502us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10770816}
I20260709 13:16:46.965456  8460 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:46.990125  8181 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.005549  7977 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.005007  8429 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.023379  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:47.053644  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:47.024437  3200 rpcz_store.cc:276] 0709 13:16:45.894742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.674401 (+779659us) service_pool.cc:224] Handling call
0709 13:16:46.993082 (+318681us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:47.035995  3791 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:47.033479  3042 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:47.056356  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:47.043052  3123 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:47.043735  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:47.058234  3124 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:16:47.044021  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:47.059763  3050 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:47.045970  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.046171  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:47.046984  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:47.047358  3043 raft_consensus.cc:3055] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:47.065106  3043 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:47.049180  3120 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:47.049683  3121 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:47.069015  3048 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:16:47.064386  3044 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:16:47.026672  8171 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:47.028796  8482 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:16:47.081514  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:47.032765  7970 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.038137  8358 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.056566  8429 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:47.088243  3043 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:46.995249  8468 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.057312  8488 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:47.086373  8424 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.113453  7970 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:47.113643  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.114543  3043 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:47.088485  8470 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:47.057526  8253 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:16:47.087656  8146 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:47.096187  8358 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.191064  8358 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:47.118566  8470 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:47.192010  8470 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:16:47.193377  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.118765  8424 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.129577  8460 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:47.131552  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.982781  2947 rpcz_store.cc:269] 0709 13:16:24.056892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.073827 (+ 16935us) service_pool.cc:224] Handling call
0709 13:16:46.929102 (+22855275us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:42.533090 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:42.533942 (+   852us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:42.533974 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:16:42.533991 (+    17us) tablet.cc:662] Decoding operations
0709 13:16:42.617257 (+ 83266us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:42.617343 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:42.617386 (+    43us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:16:42.619284 (+  1898us) tablet.cc:701] Row locks acquired
0709 13:16:42.619306 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:16:42.619511 (+   205us) write_op.cc:270] Start()
0709 13:16:42.619668 (+   157us) write_op.cc:276] Timestamp: P: 1783603002619444 usec, L: 0
0709 13:16:42.619693 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:16:42.620635 (+   942us) log.cc:844] Serialized 7108 byte log entry
0709 13:16:43.939775 (+1319140us) op_driver.cc:464] REPLICATION: finished
0709 13:16:44.050635 (+110860us) write_op.cc:301] APPLY: starting
0709 13:16:44.050778 (+   143us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:44.158953 (+108175us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:44.159112 (+   159us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:45.056147 (+897035us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:45.056567 (+   420us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=0,mrs_lookups=0
0709 13:16:45.056638 (+    71us) write_op.cc:312] APPLY: finished
0709 13:16:45.057186 (+   548us) log.cc:844] Serialized 164 byte log entry
0709 13:16:45.207720 (+150534us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:45.226895 (+ 19175us) write_op.cc:454] Released schema lock
0709 13:16:45.226998 (+   103us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:45.232601 (+  5603us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:45.232634 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":104,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":103994,"apply.run_cpu_time_us":71176,"apply.run_wall_time_us":1181984,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79403,"num_ops":18,"prepare.queue_time_us":237825,"prepare.run_cpu_time_us":33203,"prepare.run_wall_time_us":433189,"raft.queue_time_us":834740,"raft.run_cpu_time_us":27790,"raft.run_wall_time_us":214891,"replication_time_us":1286964,"thread_start_us":1053027,"threads_started":5,"wal-append.queue_time_us":672099,"wal-append.run_cpu_time_us":31300,"wal-append.run_wall_time_us":2417910}]]}
I20260709 13:16:47.118376  8491 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:47.144694  8488 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:47.148298  7986 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:47.150664  8414 consensus_meta.cc:287] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.938s	user 0.010s	sys 0.001s
I20260709 13:16:47.133710  8468 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:47.074822  2942 catalog_manager.cc:5697] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 8 to 13, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 13 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.168907  7977 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:47.170504  8181 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:47.194093  3117 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
W20260709 13:16:47.223519  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.232566  8491 raft_consensus.cc:697] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:47.236654  8491 consensus_queue.cc:237] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.236495  2942 catalog_manager.cc:5697] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.223611  3043 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:16:47.239681  3043 pending_rounds.cc:85] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 11
I20260709 13:16:47.240803  3043 pending_rounds.cc:107] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:16:47.241161  3043 raft_consensus.cc:2889] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:47.235014  8414 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.242388  3197 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:47.243597  8424 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:47.227977  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 151671us
I20260709 13:16:47.230688  8488 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.232079  7986 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:47.238559  8411 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:47.227144  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 173591us
I20260709 13:16:47.147181  8464 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.246692  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:47.215626  8358 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.249327  3049 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 16: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:47.254667  3762 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:16:47.250674  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.251513  8411 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:47.252216  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:47.238951  2942 catalog_manager.cc:5697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 5 to 9, term changed from 10 to 13, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to <none>, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New cstate: current_term: 13 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:16:47.253556  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 441306us
W20260709 13:16:47.252573  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 420654us
I20260709 13:16:47.272931  2942 catalog_manager.cc:5697] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.274549  8412 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:47.275230  8468 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:47.274822  2942 catalog_manager.cc:5697] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.276170  8468 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:47.277549  8468 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:47.278221  8424 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:47.278725  8155 raft_consensus.cc:3055] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:47.279215  8155 raft_consensus.cc:740] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:47.278818  8424 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.280375  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:47.280962  3123 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:47.281589  8411 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:47.282147  8411 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.278366  3126 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:47.284261  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:47.284449  8411 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:47.284969  3126 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:47.282176  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:47.286970  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:47.288352  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:47.281967  8424 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:47.295881  3123 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:47.301890  3799 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:47.301304  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:47.297245  3762 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:47.303894  3045 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:16:47.268635  8414 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:47.307091  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:47.307893  3044 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:47.269645  8181 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.290872  8409 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:47.318115  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:47.318117  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:47.318851  3123 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:47.320118  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:47.321369  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 44944.5us
I20260709 13:16:47.321501  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:47.322220  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:47.321058  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 47784.9us
I20260709 13:16:47.323257  3051 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 6. (term mismatch)
I20260709 13:16:47.321144  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:47.325289  3126 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:16:47.325531  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:47.300061  8459 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:47.329223  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:47.326798  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:47.329479  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:47.338477  3792 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:47.338625  3799 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:47.323670  3051 pending_rounds.cc:85] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 5
I20260709 13:16:47.269091  8283 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:16:47.303894  8458 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.329864  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:47.339412  3051 pending_rounds.cc:107] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:16:47.322160  3795 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:16:47.338195  3045 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:47.343438  3051 raft_consensus.cc:2889] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:47.344254  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:47.292109  8358 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.313055  8491 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:47.345760  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:47.344815  3091 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:47.347230  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:47.315387  8409 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:47.358450  8409 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:47.349584  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:47.338135  8410 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:47.366328  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:47.353623  8424 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:16:47.354189  8469 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.563s	user 0.004s	sys 0.007s
I20260709 13:16:47.280375  2942 catalog_manager.cc:5697] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 2 to 4, term changed from 4 to 9, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to <none>, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129), VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130), VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131), VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 9 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:47.354846  8461 consensus_queue.cc:1059] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:16:47.355937  3164 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:47.356513  8326 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:47.357131  8476 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:47.357630  8411 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.315358  8181 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.341111  8422 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:16:47.301930  8470 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.389257  3126 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:47.397969  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:47.404611  3195 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:47.361720  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2610) took 1254 ms. Trace:
I20260709 13:16:47.350195  3123 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:16:47.370165  8419 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:47.348678  8094 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:47.370759  8412 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:47.371858  8206 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:47.375559  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2609) took 1269 ms. Trace:
I20260709 13:16:47.377017  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:47.419723  3194 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 16: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:47.381012  3799 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:47.381012  3044 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:16:47.421660  3796 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:47.419214  3197 rpcz_store.cc:276] 0709 13:16:46.106521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.321324 (+214803us) service_pool.cc:224] Handling call
0709 13:16:47.375379 (+1054055us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54001b76d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:47.375503 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2114600320}
I20260709 13:16:47.410142  3199 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:47.362037  8488 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:47.406111  3196 rpcz_store.cc:276] 0709 13:16:46.107365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.421156 (+313791us) service_pool.cc:224] Handling call
0709 13:16:46.421462 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.781990 (+360528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.361443 (+579453us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b5400035054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:47.361659 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669548800}
W20260709 13:16:47.413763  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 57861.2us
I20260709 13:16:47.413686  3792 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:16:47.415444  3192 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:16:47.415808  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 118654us
I20260709 13:16:47.415804  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:47.378728  8424 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.458843  3191 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:47.392170  8468 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:47.462292  3120 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:47.463629  3164 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:47.383636  8459 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:47.361567  7970 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:16:47.412387  8419 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.349444  8458 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.470417  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:47.393205  8464 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:47.417716  8411 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.464692  8424 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:47.465915  8414 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:47.465260  7926 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.410983  8491 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:16:47.470393  8262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34718 (request call id 23) took 5916 ms. Trace:
I20260709 13:16:47.477175  8326 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:47.510102  3198 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:47.479725  8419 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:47.417184  8429 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.503585  8096 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.500488  3792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:47.525866  3792 raft_consensus.cc:606] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:47.525576  8096 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.529465  8096 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:47.500133  8146 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.506517  8460 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:47.506762  8477 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.499228  8468 raft_consensus.cc:697] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:47.488633  8165 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:16:47.539062  8505 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.173s
I20260709 13:16:47.540573  8496 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:16:47.543294  8504 log.cc:927] Time spent T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:16:47.548619  8477 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.553498  8094 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.554255  8094 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:47.536247  8146 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.560154  8146 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:47.561666  3125 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18. Ops: []
W20260709 13:16:47.560153  3118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2373) took 1765 ms (client timeout 2134 ms). Trace:
W20260709 13:16:47.565104  3118 rpcz_store.cc:269] 0709 13:16:45.795136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.796485 (+  1349us) service_pool.cc:224] Handling call
0709 13:16:47.559872 (+1763387us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540011c6d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:47.560069 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2301645056}
I20260709 13:16:47.567170  8461 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.567770  8461 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:47.569862  8502 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:16:47.571249  8509 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.571825  8509 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.576984  3124 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:47.582845  3195 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:16:47.480587  8459 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.532785  8476 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:16:47.607609  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 102595us
W20260709 13:16:47.548084  8480 log.cc:927] Time spent T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.570s	user 0.008s	sys 0.000s
I20260709 13:16:47.520114  8414 raft_consensus.cc:697] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:47.509583  7926 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:47.576282  8431 consensus_meta.cc:287] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.556s	user 0.007s	sys 0.004s
I20260709 13:16:47.541221  8496 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.610203  3164 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:47.602873  8505 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:47.611465  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 233897us
I20260709 13:16:47.613076  3794 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:47.617864  3794 raft_consensus.cc:606] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:47.619167  3164 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:47.618713  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:47.621124  8412 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:47.621676  8470 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:47.622867  8477 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:47.623342  8505 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.623884  8518 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.624488  8518 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.618393  8171 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:47.516199  8262 rpcz_store.cc:276] 0709 13:16:41.494356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.690745 (+196389us) service_pool.cc:224] Handling call
0709 13:16:41.753883 (+ 63138us) log.cc:844] Serialized 506 byte log entry
0709 13:16:43.031543 (+1277660us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b1800464380. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:16:47.382113 (+4350570us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":796078,"raft.queue_time_us":881277,"raft.run_cpu_time_us":1732,"raft.run_wall_time_us":134281,"spinlock_wait_cycles":6163840,"thread_start_us":589911,"threads_started":2,"wal-append.queue_time_us":315405,"wal-append.run_cpu_time_us":2468,"wal-append.run_wall_time_us":1192373}
I20260709 13:16:47.625707  8505 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:47.570775  2942 catalog_manager.cc:5697] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 10 to 13, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 13 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:47.632850  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:47.626681  8518 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:47.633718  3796 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:47.626541  8468 consensus_queue.cc:237] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.634646  8459 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:47.565865  8460 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.636785  8460 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:16:47.641237  8482 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:47.642006  8482 raft_consensus.cc:697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 16 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:47.616549  8334 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:47.642843  8334 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.643031  8482 consensus_queue.cc:237] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.645103  8334 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:47.645809  8414 consensus_queue.cc:237] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.616279  8431 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.649176  3790 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:47.646186  8358 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:47.653365  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:47.654270  3196 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
I20260709 13:16:47.655910  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:47.655809  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:47.656963  3120 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:47.657122  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:47.657909  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:47.628559  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 268777us
I20260709 13:16:47.630268  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2611) took 1521 ms. Trace:
I20260709 13:16:47.611186  8411 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:47.664839  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:47.625280  8094 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.616096  8476 raft_consensus.cc:697] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:47.659957  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:47.658957  3193 rpcz_store.cc:276] 0709 13:16:46.108804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.601798 (+492994us) service_pool.cc:224] Handling call
0709 13:16:46.602302 (+   504us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:46.666005 (+ 63703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.666054 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:46.686885 (+ 20831us) log.cc:844] Serialized 52 byte log entry
0709 13:16:46.789813 (+102928us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:46.809522 (+ 19709us) log.cc:844] Serialized 14 byte log entry
0709 13:16:46.977280 (+167758us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b18002c2960. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:16:47.245213 (+267933us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b18002c2960. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d240c0a 00007ff836980219 00007ff82d2c8a40 00007ff82d2c34e4 00007ff82d2c3455 00007ff8303ab060 00007ff8303bd716 00007ff8303ce287 00007ff8303ce208
0709 13:16:47.245480 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.245581 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:47.547364 (+301783us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:47.630048 (+ 82684us) raft_consensus.cc:1685] finished
0709 13:16:47.630079 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.630212 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74168,"prepare.queue_time_us":26333,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":445227,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":203,"spinlock_wait_cycles":18335616,"thread_start_us":161530,"threads_started":2,"wal-append.queue_time_us":171392}
W20260709 13:16:47.658489  3015 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 1.660s (SENT) [suppressed 26 similar messages]
I20260709 13:16:47.698813  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:47.701432  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:47.703898  3796 raft_consensus.cc:2368] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18.
I20260709 13:16:47.631919  8509 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:47.627167  8181 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:47.660650  8488 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:47.630409  8461 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:47.669929  8507 log.cc:927] Time spent T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:16:47.627233  8496 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:47.660985  8171 raft_consensus.cc:697] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:16:47.705933  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 46830.2us
I20260709 13:16:47.723291  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:47.724169  3049 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:47.724967  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:47.631690  8429 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:47.713088  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:47.729754  3123 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:47.731842  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:47.726784  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:47.726824  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:47.738523  3042 raft_consensus.cc:2410] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:16:47.748379  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:47.749501  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 48205us
I20260709 13:16:47.749514  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:47.748343  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:47.752085  3050 raft_consensus.cc:1240] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:47.752457  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:47.753095  3044 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:47.714011  8431 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:47.757618  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:47.759477  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:47.762445  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2240) took 1747 ms. Trace:
I20260709 13:16:47.763074  8094 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:47.762897  3125 rpcz_store.cc:276] 0709 13:16:46.015329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.029022 (+ 13693us) service_pool.cc:224] Handling call
0709 13:16:47.561390 (+1532368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.562319 (+   929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.762236 (+199917us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b540011c6d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:47.762386 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3523255040}
I20260709 13:16:47.764061  3796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:47.766535  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:47.633224  2942 catalog_manager.cc:5697] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.755440  8262 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:47.715562  8517 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:16:47.748878  8181 consensus_queue.cc:1059] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:16:47.764654  3796 raft_consensus.cc:606] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:47.766920  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:47.777367  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 118912us
I20260709 13:16:47.732486  8518 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:16:47.786513  3049 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:47.784849  3192 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:16:47.784760  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:47.787791  3193 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:47.793046  3192 pending_rounds.cc:85] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 10
I20260709 13:16:47.792425  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:47.764951  8458 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:47.793357  3192 pending_rounds.cc:107] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:16:47.768083  8442 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.793707  3192 raft_consensus.cc:2889] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:47.736904  8488 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.785481  8477 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:47.809685  8477 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.811321  2942 catalog_manager.cc:5697] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:47.812641  8477 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:47.813418  8464 consensus_queue.cc:1059] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:47.813685  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:47.815073  3125 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 11.
I20260709 13:16:47.815673  8488 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:47.801146  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:47.795959  8482 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:47.792670  8171 consensus_queue.cc:237] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.808799  3210 tablet_copy_service.cc:140] P 501fdf2af2bc4b0c971ae880e98f466b: Received BeginTabletCopySession request for tablet 1e1474206f8d49e58df15541f5a5725e from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:34728)
I20260709 13:16:47.814183  8464 consensus_queue.cc:1243] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:47.820546  8424 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.820740  3192 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:16:47.822682  8470 raft_consensus.cc:3055] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:47.822772  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:47.823006  3796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:47.823312  8470 raft_consensus.cc:740] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:47.823549  3192 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:47.817265  3051 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:47.823647  3796 raft_consensus.cc:606] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:47.807864  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:47.826915  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:47.819610  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:47.786232  8326 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:47.807523  3196 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:47.808506  8516 consensus_queue.cc:1059] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:16:47.835376  3195 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:16:47.831794  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:47.838063  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:47.838485  8485 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.015s	sys 0.001s
I20260709 13:16:47.821127  3210 tablet_copy_service.cc:161] P 501fdf2af2bc4b0c971ae880e98f466b: Beginning new tablet copy session on tablet 1e1474206f8d49e58df15541f5a5725e from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:34728: session id = e9165fe61ab04bfb9a48889156d5c161-1e1474206f8d49e58df15541f5a5725e
I20260709 13:16:47.838873  3194 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
W20260709 13:16:47.838873  8485 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.015s	sys 0.001s
I20260709 13:16:47.839308  8516 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:47.798414  8508 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:47.840572  8516 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.840814  8508 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.841084  8516 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:47.841280  8508 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:47.825182  8431 raft_consensus.cc:3055] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:47.848168  3123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:16:47.824350  8470 consensus_queue.cc:260] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.849690  8409 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.849583  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:47.856191  3123 raft_consensus.cc:606] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:47.857530  3123 raft_consensus.cc:614] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:47.839911  8482 raft_consensus.cc:3055] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:47.853685  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:47.859205  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.860211  3090 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:47.860772  3192 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:47.864318  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:47.834923  8464 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:47.866452  8470 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:47.866701  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:47.868472  3192 raft_consensus.cc:2376] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15. Re-sending same reply.
I20260709 13:16:47.870761  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:47.872373  3192 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:47.874487  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:47.875140  8424 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:47.875398  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:47.876649  3192 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:47.877671  3794 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:47.878401  3794 raft_consensus.cc:606] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:47.878823  3794 raft_consensus.cc:614] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:47.854293  8511 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.123s	user 0.002s	sys 0.000s
I20260709 13:16:47.855417  8431 raft_consensus.cc:740] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:47.876020  3198 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:16:47.884167  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:47.888346  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:47.890411  8431 consensus_queue.cc:260] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.890511  8155 consensus_queue.cc:260] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.884948  3051 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:47.891546  8431 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:47.885353  8181 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:47.896855  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:47.801961  8442 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:47.905277  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:47.918548  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:47.919196  3117 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:16:47.919677  3192 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 15: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:47.905985  3126 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:47.909909  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:47.910302  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:47.913098  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:16:47.884804  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.927374  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:47.928468  3049 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:47.858666  8482 raft_consensus.cc:740] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:47.930274  3119 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:47.930430  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:47.938823  3126 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
I20260709 13:16:47.915817  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:47.937073  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:47.922395  3193 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:16:47.888278  8091 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.901750  8485 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:47.945998  3198 raft_consensus.cc:1275] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:16:47.946457  3195 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:16:47.951977  3165 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:47.929390  8495 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.947103  3192 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:47.946805  3090 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:47.948539  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 132191us
I20260709 13:16:47.895387  8464 raft_consensus.cc:697] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 16 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:47.954569  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:47.955506  3117 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:16:47.955752  3042 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:47.804152  8476 consensus_queue.cc:237] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:47.966178  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:47.967377  3119 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:47.957492  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:47.929792  8155 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:47.997996  3123 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:16:47.938557  8181 raft_consensus.cc:697] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:16:48.009837  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 47054.6us
I20260709 13:16:47.951066  7743 consensus_queue.cc:1059] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:16:47.994932  8485 raft_consensus.cc:697] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:47.951853  8206 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:16:47.956736  8132 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:16:47.964489  8091 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.025703  8467 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:16:48.026954  3123 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:16:48.027730  8442 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:48.028470  8528 log.cc:927] Time spent T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:16:48.014292  8420 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.032894  8482 consensus_queue.cc:260] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.025326  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:48.035552  8409 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:48.042192  8525 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
W20260709 13:16:48.045708  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.046100  8464 consensus_queue.cc:237] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.048137  3117 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 11. Current term is 12. Ops: [10.5-11.6]
W20260709 13:16:48.049187  8419 consensus_meta.cc:287] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.000s
I20260709 13:16:48.048913  8508 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:48.058764  3199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2615) took 1939 ms (client timeout 1879 ms). Trace:
I20260709 13:16:48.060503  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:48.002725  3119 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:48.001444  8452 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:47.972028  3090 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:48.122376  3199 rpcz_store.cc:269] 0709 13:16:46.119496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.250106 (+130610us) service_pool.cc:224] Handling call
0709 13:16:48.058517 (+1808411us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540013bfd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:48.058677 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2598352640}
W20260709 13:16:48.124754  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 152817us
I20260709 13:16:48.126474  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:48.062068  8326 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:47.995469  8429 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:16:47.995107  8262 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:16:48.070504  3165 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:48.133060  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 62652.6us
I20260709 13:16:48.134037  8442 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:48.134162  3165 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:48.074227  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 116758us
I20260709 13:16:48.135529  8442 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:48.136829  3015 leader_election.cc:400] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18.
I20260709 13:16:48.137192  3015 leader_election.cc:403] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:16:48.138029  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:47.970089  8491 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 13:16:48.079236  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:47.964844  8496 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:16:47.969805  8495 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.082396  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:48.073038  8431 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:48.141054  8485 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.141407  8431 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.142102  3210 tablet_copy_source_session.cc:215] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:48.142191  8495 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:48.142830  8495 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:48.143330  8495 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.143707  8431 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:48.072158  8165 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:48.144407  8165 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.144562  8181 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.146534  8534 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18.
I20260709 13:16:48.146788  8165 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:48.090160  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:48.147320  8534 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:48.147835  3792 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 11: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:48.124073  3126 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 17: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:48.127103  8411 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:48.130101  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:48.088325  8420 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.150395  7926 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:48.149046  8495 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:48.091759  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 66526.5us
I20260709 13:16:48.077214  8516 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.158406  3165 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:48.124125  8094 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:48.156736  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:48.198554  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:48.131361  8424 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:16:48.204917  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 46624.5us
I20260709 13:16:48.206058  3165 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:48.207330  3165 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:48.209936  3165 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:48.158481  8514 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.162212  8431 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:48.159910  8411 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:48.163443  8482 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:48.201460  8469 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:16:48.217142  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:48.127758  8419 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.231875  8419 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:48.233397  3797 raft_consensus.cc:1240] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:48.235431  8091 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:48.211349  8424 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.236955  8424 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:48.238037  8420 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:48.201181  8094 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.211270  8442 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:48.164912  8467 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:16:48.221793  3165 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:48.215730  8461 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:48.239718  3793 raft_consensus.cc:1240] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 17. Ops: [15.12-15.12]
I20260709 13:16:48.219657  8411 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:48.210886  8165 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.201320  8234 consensus_queue.cc:1059] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:16:48.213071  8518 consensus_queue.cc:1059] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:16:48.214493  8477 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:48.223909  8508 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:48.250036  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:48.257870  3200 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:48.258136  3126 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:48.247018  8491 consensus_queue.cc:1243] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:48.216161  8096 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:48.218627  8514 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.272387  8187 raft_consensus.cc:3055] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:48.272881  8187 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:48.274463  8518 raft_consensus.cc:3055] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:48.274950  8518 raft_consensus.cc:740] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:48.275815  8518 consensus_queue.cc:260] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.277079  8518 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:48.278110  3120 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:48.279093  3164 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:48.256203  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:48.250649  8467 consensus_queue.cc:1243] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:48.281559  3192 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:16:48.284385  8431 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:48.235446  8516 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:48.241838  8094 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:48.255198  8262 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:48.215936  7926 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:48.290057  8481 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:48.292168  8459 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.292651  8459 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.294088  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:48.294898  3797 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
W20260709 13:16:48.246040  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 108090us
I20260709 13:16:48.260265  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:48.259147  8477 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:48.262794  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:48.299593  3195 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:16:48.301297  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:48.302873  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:48.303776  3124 raft_consensus.cc:2410] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:16:48.304896  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:48.305540  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:48.311614  3797 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:48.305807  3118 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:16:48.306530  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:48.307178  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:48.302232  8477 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:48.310581  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:48.285004  8431 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:16:48.311872  3126 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:48.312885  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:48.364629  3200 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:48.364753  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:48.362366  3119 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:48.250314  8171 consensus_queue.cc:1059] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:16:48.294874  8509 raft_consensus.cc:3055] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:48.326610  3090 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:48.367219  8509 raft_consensus.cc:740] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:48.367799  8358 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:48.367928  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:48.369170  3123 raft_consensus.cc:2410] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:16:48.312367  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:48.363457  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:48.379652  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:48.387514  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 72371.1us
I20260709 13:16:48.386978  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:48.390215  3197 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:16:48.391988  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:48.257463  8442 consensus_queue.cc:1059] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 13:16:48.386238  8409 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:48.397408  3164 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:48.298264  8514 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:48.256655  8165 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:48.401083  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.402132  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:48.410089  3794 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:16:48.410564  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.410770  8538 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:48.411306  8538 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.413892  8482 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:48.414014  8458 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:48.414709  8458 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.414543  8482 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.415305  8458 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:48.416812  8482 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:48.378162  8358 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:48.418083  8358 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.418501  8358 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:48.420765  8534 raft_consensus.cc:3055] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:48.421339  8534 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:48.422474  8534 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.408393  8414 raft_consensus.cc:3055] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:48.423952  8414 raft_consensus.cc:740] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:48.424068  8534 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:48.424855  8414 consensus_queue.cc:260] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.309955  8485 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:48.425992  8485 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.380853  8441 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:48.410081  3048 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:48.408033  3050 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:16:48.429593  3050 pending_rounds.cc:85] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 5
I20260709 13:16:48.429894  3050 pending_rounds.cc:107] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:16:48.430132  3050 raft_consensus.cc:2889] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:48.408855  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:48.431022  8444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e1474206f8d49e58df15541f5a5725e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.431378  3042 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 15: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:48.413417  8538 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:48.433863  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:48.436113  3790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43926 (request call id 849) took 2460 ms (client timeout 1624 ms). Trace:
I20260709 13:16:48.446054  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:48.399809  7743 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:48.450577  8146 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.454859  8431 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:48.456187  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet 717d128a6d6e4ec0b76d3993e4153a8a: Illegal state: Replica aaf88538197a49adb8bcf3790309a67e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:48.457159  8459 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:48.382398  8283 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:16:48.382403  8420 consensus_queue.cc:1048] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:16:48.403016  8409 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.462874  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:48.462924  3126 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
W20260709 13:16:48.474861  8532 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:16:48.479532  7743 raft_consensus.cc:697] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 17 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:16:48.480209  8520 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.640s	user 0.005s	sys 0.000s
I20260709 13:16:48.516925  3091 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:48.483294  8416 raft_consensus.cc:993] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: : Instructing follower 501fdf2af2bc4b0c971ae880e98f466b to start an election
I20260709 13:16:48.487080  8414 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:48.436700  8539 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.490981  8496 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:48.445896  3790 rpcz_store.cc:269] 0709 13:16:45.949618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.949849 (+   231us) service_pool.cc:224] Handling call
0709 13:16:48.409582 (+2459733us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b5400484c54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:48.409728 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3832284416}
W20260709 13:16:48.501715  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:48.465544  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:48.518414  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 55623us
I20260709 13:16:48.518852  8538 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:16:48.521944  8464 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.522552  8464 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.524372  8165 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:48.497967  8146 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.527875  8146 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:48.515439  8411 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.530953  8411 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:48.531817  8187 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.512897  8094 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:48.516052  8372 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:16:48.478482  8482 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:48.549146  3043 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:48.550944  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:48.551749  3118 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:16:48.551851  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:48.552887  8538 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:48.553658  8538 consensus_queue.cc:1243] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:16:48.560542  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:48.381886  8509 consensus_queue.cc:260] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.546463  8496 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.563066  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:48.499848  8424 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.516057  8409 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:48.538031  8539 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.565516  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:48.566705  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:48.576746  3042 raft_consensus.cc:2410] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:16:48.572974  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet cf28784fe3e74ad5b9c56f1d28247222: Illegal state: Replica f20672b2852447a6bc1e137c4dd40904 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:48.567804  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:48.574762  3799 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 18: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:48.573848  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:48.583348  8538 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:48.570956  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:48.584852  3045 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:16:48.579730  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:48.585796  3044 raft_consensus.cc:1275] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:16:48.586426  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:48.587126  3118 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:48.587002  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:48.579836  8495 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:48.595188  8495 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.566828  7743 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.597303  8495 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:48.605979  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:48.607299  3118 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:16:48.608742  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:48.608999  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:48.610867  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 61270.2us
I20260709 13:16:48.611476  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:48.614003  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:48.615628  3126 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:16:48.619002  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:48.541283  8540 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.546847  8146 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:48.625149  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:48.626008  3122 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:16:48.624119  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:48.563604  8094 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:48.628095  3043 raft_consensus.cc:2393] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 18: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:48.567562  8155 consensus_meta.cc:287] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.001s
I20260709 13:16:48.565215  8496 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:48.575672  8372 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:48.566907  8424 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:48.536201  8357 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:16:48.629395  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:48.698707  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:48.690467  8540 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.702721  8540 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:48.703804  3793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 667) took 1402 ms. Trace:
I20260709 13:16:48.551760  8416 raft_consensus.cc:1081] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Signalling peer 501fdf2af2bc4b0c971ae880e98f466b to start an election
I20260709 13:16:48.705163  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:48.631098  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:48.605696  8165 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:48.706039  8165 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.706543  8165 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:48.584084  8538 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.711635  8538 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:48.711771  8485 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:48.693933  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:48.712978  3042 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:48.713956  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:48.714685  3197 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:48.715652  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:48.716147  3197 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:48.719841  8409 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.722806  8538 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:48.656309  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:48.728528  8539 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:48.727069  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 95803us
I20260709 13:16:48.735035  8509 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:48.736958  8464 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:48.721027  3790 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:48.704288  3793 rpcz_store.cc:276] 0709 13:16:47.301410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.301532 (+   122us) service_pool.cc:224] Handling call
0709 13:16:48.239402 (+937870us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:48.250748 (+ 11346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.703529 (+452781us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b5400653450. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:48.703696 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2121979648}
I20260709 13:16:48.739583  3195 pending_rounds.cc:85] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 6
I20260709 13:16:48.742043  3195 pending_rounds.cc:107] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:16:48.704233  8540 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:48.742486  3195 raft_consensus.cc:2889] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:48.744272  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:48.588718  8420 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:48.571219  8262 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:48.752051  3045 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:16:48.572484  8358 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.690821  8516 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.758508  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:48.765849  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:48.623626  8283 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:48.770454  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:48.631279  8491 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:48.762951  8420 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.793177  3198 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
I20260709 13:16:48.775156  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2397) took 1498 ms. Trace:
I20260709 13:16:48.797875  8283 raft_consensus.cc:697] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:48.609872  8411 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.159s
I20260709 13:16:48.748993  8496 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.694204  8534 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:16:48.794469  3121 rpcz_store.cc:276] 0709 13:16:47.276712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.279625 (+  2913us) service_pool.cc:224] Handling call
0709 13:16:47.279930 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:47.384620 (+104690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:47.384655 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:47.412644 (+ 27989us) log.cc:844] Serialized 26 byte log entry
0709 13:16:47.614772 (+202128us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:47.614809 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.853698 (+238889us) spinlock_profiling.cc:243] Waited 885 us on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:48.774672 (+920974us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54003f1e54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:48.774754 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:48.774827 (+    73us) raft_consensus.cc:1685] finished
0709 13:16:48.774850 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.775067 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2631,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":241935616,"thread_start_us":147804,"threads_started":1,"wal-append.queue_time_us":309741}
W20260709 13:16:48.767833  8480 log.cc:927] Time spent T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:16:48.806843  3197 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:48.733546  8477 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.808779  3125 raft_consensus.cc:1217] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Deduplicated request from leader. Original: 9.5->[11.6-17.9]   Dedup: 12.7->[15.8-17.9]
I20260709 13:16:48.771646  8155 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:16:48.818959  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.818832  3125 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18. Ops: [11.6-17.9]
I20260709 13:16:48.697360  8372 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.825088  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:48.826035  3048 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:48.799093  8283 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.794835  8468 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:48.832754  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:48.834739  3193 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:48.764714  8539 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:16:48.840973  3045 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:48.817693  8491 raft_consensus.cc:697] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:48.771243  8516 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.820804  8155 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:48.759186  8458 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.762415  8540 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.815670  8496 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.860378  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:48.862298  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:48.862618  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:48.862959  3121 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:48.863504  3124 raft_consensus.cc:2410] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:16:48.863718  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:48.865417  8540 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:48.851971  8155 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:48.832579  8165 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.870424  3192 raft_consensus.cc:2368] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16.
I20260709 13:16:48.879240  8516 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:48.881006  8477 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:16:48.885511  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:48.885514  3120 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:16:48.887969  3120 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:16:48.888770  3122 raft_consensus.cc:2393] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:48.891546  8358 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:48.848547  8468 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:48.885859  8491 consensus_queue.cc:237] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.899173  8539 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:48.907612  8468 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:48.908335  8563 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:48.908789  8420 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:48.889101  8464 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:48.900382  8411 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:48.909916  8409 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:48.900974  8165 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:48.917654  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:48.923821  8372 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:48.925040  8482 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:48.925648  3042 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:48.926823  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:48.908962  8563 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:48.935685  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:48.937980  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:48.938768  3042 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 17: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:48.938668  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:48.939505  3117 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:48.941810  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:48.941912  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:48.957123  3047 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:48.960381  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:48.932850  8358 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.924244  3122 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:16:48.979074  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:48.981564  8187 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:48.984607  8563 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:48.990384  8458 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:48.992823  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:48.993566  3044 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:16:48.994164  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:48.994779  3048 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 11.
W20260709 13:16:48.994968  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.000289  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:49.000965  3126 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:49.004526  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:49.005204  3124 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:49.007405  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:49.027570  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:49.032379  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:49.033215  3117 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:49.033501  8496 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:49.033883  8431 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:16:49.038872  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.038089  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:49.041299  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:49.046265  8444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:43926 (request call id 846) took 3261 ms. Trace:
I20260709 13:16:49.041134  3794 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
W20260709 13:16:49.049728  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.059738  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:49.072144  3799 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:49.073992  3124 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:16:49.081010  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:49.062301  3762 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:49.059252  8414 consensus_meta.cc:287] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.000s
I20260709 13:16:49.086274  3762 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:49.084601  3091 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:49.085650  3126 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:16:49.084808  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:49.087680  3047 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:16:48.977305  8358 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:49.088526  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:49.040701  8431 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:49.091565  3091 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:49.095624  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:49.096134  3043 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:49.097062  3048 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:49.097167  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:49.098013  3043 raft_consensus.cc:2410] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 13 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:49.098421  3048 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:16:49.100251  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 492796us
I20260709 13:16:49.092965  3793 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:49.103996  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:49.106333  3792 raft_consensus.cc:2368] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16.
I20260709 13:16:49.101104  3762 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:49.083335  8491 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.121142  3762 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:49.122614  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:49.090762  8420 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:49.090967  7970 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:49.067521  8496 consensus_queue.cc:1059] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:16:49.092149  8165 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:49.115681  3091 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:49.107652  8411 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:49.124711  8416 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:49.123909  8452 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:49.154103  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:49.130398  8468 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:49.091025  8563 consensus_queue.cc:1059] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:16:49.161988  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:49.127571  8482 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:16:49.046727  8444 rpcz_store.cc:276] 0709 13:16:45.803157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.813857 (+ 10700us) service_pool.cc:224] Handling call
0709 13:16:45.985970 (+172113us) ts_tablet_manager.cc:934] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
0709 13:16:46.595779 (+609809us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82d2a90ac 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c2caa 00007ff82d2c2bd2 00007ff835327131
0709 13:16:48.356251 (+1760472us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:16:48.923745 (+567494us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:48.923875 (+   130us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:16:48.989351 (+ 65476us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:16:48.989668 (+   317us) tablet_replica.cc:206] Creating consensus instance
0709 13:16:49.045993 (+ 56325us) ts_tablet_manager.cc:989] Replica registered.
0709 13:16:49.046147 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":226,"spinlock_wait_cycles":28568448,"tablet-copy.queue_time_us":127335,"thread_start_us":923619,"threads_started":2}
I20260709 13:16:49.153842  8412 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:49.154887  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 49061.5us
I20260709 13:16:49.127369  8464 consensus_queue.cc:1059] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 13:16:49.165238  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 49689.6us
I20260709 13:16:49.176090  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:49.178115  3015 leader_election.cc:400] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16.
I20260709 13:16:49.130110  8539 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:16:49.149515  8420 raft_consensus.cc:3055] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:49.160094  8496 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:49.154103  7743 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:49.193774  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:49.128604  8491 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:49.217928  3015 leader_election.cc:403] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:49.192893  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:49.223311  3198 raft_consensus.cc:2393] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:49.194662  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:49.215654  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:49.219636  3091 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:49.214386  8572 log.cc:927] Time spent T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:16:49.213795  8568 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:16:49.224651  3192 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:16:49.229916  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 52003.6us
I20260709 13:16:49.168035  8357 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:49.226388  3091 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:49.153894  8155 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:49.225849  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 44427.7us
I20260709 13:16:49.180365  8372 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:49.219959  8420 raft_consensus.cc:740] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:49.237663  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:49.221946  7743 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.181771  8334 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:16:49.180953  8468 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:49.238672  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:49.239917  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 58448.2us
I20260709 13:16:49.245816  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:49.247857  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:49.248234  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:49.248799  3198 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:16:49.243098  3091 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:49.232111  8452 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:49.235180  8495 raft_consensus.cc:3055] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:49.220155  8412 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:49.234805  8372 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.173570  8566 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:16:49.258684  3126 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:16:49.232443  8539 consensus_queue.cc:1243] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:16:49.225212  8496 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:49.260953  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:49.262190  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 45425.2us
I20260709 13:16:49.221753  8424 consensus_queue.cc:1048] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:16:49.248625  3192 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:49.268664  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:49.288611  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:49.335575  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 67032.7us
I20260709 13:16:49.336372  8326 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:49.337033  3164 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:49.248770  7743 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:49.242834  8534 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:16:49.256631  8565 log.cc:927] Time spent T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:16:49.299808  3198 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:16:49.256119  8452 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:49.297791  8357 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:16:49.317598  8571 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 13:16:49.320132  8573 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:16:49.325557  8412 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:49.284134  8165 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:49.286401  8464 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.269573  8495 raft_consensus.cc:740] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:16:49.312153  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 51311us
I20260709 13:16:49.384780  8357 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.314644  3196 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:49.247618  8444 tablet_copy_client.cc:806] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:49.448661  8444 tablet_copy_client.cc:670] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:49.342556  8441 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:16:49.247143  8181 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:49.287598  8372 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:49.382692  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 139659us
I20260709 13:16:49.315857  8539 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:49.310005  8340 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:16:49.338094  8358 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:49.385790  3090 consensus_peers.cc:597] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b83202a913e45d5830d2ecdfb5354c2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:49.402009  3047 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
W20260709 13:16:49.463400  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 77747.6us
I20260709 13:16:49.402314  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:49.410420  8165 raft_consensus.cc:697] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:49.348434  8146 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:49.404853  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 61304.4us
I20260709 13:16:49.464103  8538 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16.
I20260709 13:16:49.348403  8187 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:49.471837  8187 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.472317  8187 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:49.465409  8181 raft_consensus.cc:697] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:49.474426  8181 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.410845  8464 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:49.384512  7970 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.314677  3165 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:49.477686  8464 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:49.478048  7970 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:49.478493  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 163955us
I20260709 13:16:49.478876  8459 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.479398  8459 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.480199  8476 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:49.480911  8476 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:49.411339  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:49.481676  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 823) took 1219 ms. Trace:
W20260709 13:16:49.482306  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 71099.4us
I20260709 13:16:49.434715  3794 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:16:49.482636  8165 consensus_queue.cc:237] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.483080  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:49.438547  8576 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:16:49.485530  8488 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:49.482123  3194 rpcz_store.cc:276] 0709 13:16:48.261878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.262010 (+   132us) service_pool.cc:224] Handling call
0709 13:16:48.262312 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:48.308894 (+ 46582us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:48.368551 (+ 59657us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.370967 (+  2416us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.371213 (+   246us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.995899 (+624686us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b18000f3a00. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d240c0a 00007ff836980219 00007ff82d2c8a40 00007ff82d2c34e4 00007ff82d2c3455 00007ff8303ab060 00007ff8303bd716 00007ff8303ce287 00007ff8303ce208
0709 13:16:48.996034 (+   135us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:49.029911 (+ 33877us) log.cc:844] Serialized 26 byte log entry
0709 13:16:49.036784 (+  6873us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:49.037021 (+   237us) log.cc:844] Serialized 14 byte log entry
0709 13:16:49.466668 (+429647us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b18000f3a00. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:16:49.480445 (+ 13777us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b18000f3a00. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2942a6 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83032e733 00007ff8303b3dbf 00007ff8303b283e
0709 13:16:49.481313 (+   868us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b54000bd720. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83032e733 00007ff8303b3dbf 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c
0709 13:16:49.481370 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.481444 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.481487 (+    43us) raft_consensus.cc:1685] finished
0709 13:16:49.481498 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.481622 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":481379,"prepare.queue_time_us":312816,"prepare.run_cpu_time_us":157,"prepare.run_wall_time_us":16533,"raft.queue_time_us":839775,"raft.run_cpu_time_us":482,"raft.run_wall_time_us":44062,"spinlock_wait_cycles":84956032,"thread_start_us":61255,"threads_started":2,"wal-append.queue_time_us":150323}
I20260709 13:16:49.486232  8488 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:49.442077  8431 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:49.487709  8091 raft_consensus.cc:993] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: : Instructing follower aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:16:49.487644  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:49.488291  8091 raft_consensus.cc:1081] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Signalling peer aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:16:49.488346  3194 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:49.487777  8459 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:49.388693  8516 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:49.407968  8575 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:16:49.449970  3196 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:16:49.336828  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:49.383188  8534 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:49.328231  8420 consensus_queue.cc:260] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:49.460175  3091 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:49.497285  3048 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:16:49.497649  3048 pending_rounds.cc:85] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 6
I20260709 13:16:49.497886  3048 pending_rounds.cc:107] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:16:49.498266  3048 raft_consensus.cc:2889] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:49.464196  3198 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:49.348721  8452 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:49.436564  8412 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:16:49.456674  8577 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:16:49.503748  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:49.504050  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:49.504676  3051 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:49.505586  8506 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:49.505834  8358 consensus_queue.cc:1059] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:49.506191  8506 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:49.506731  8358 raft_consensus.cc:3055] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:49.507107  8358 raft_consensus.cc:740] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:49.507967  8358 consensus_queue.cc:260] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:49.508584  8420 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:49.509162  8358 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:49.490154  8491 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:49.470024  8579 log.cc:927] Time spent T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 13:16:49.439513  8578 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:16:49.490824  3761 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:49.509078  8506 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:49.493471  3193 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:16:49.501381  3091 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:49.513280  8441 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.537580  8424 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:49.537909  8441 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.502817  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:49.545432  8132 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:49.545814  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:49.547451  8132 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:49.547566  3090 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:49.452191  8357 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:49.549819  8585 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:49.550560  8585 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:49.493431  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:49.529104  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:49.551694  8585 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:49.522701  3051 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:16:49.501866  3047 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:47488
I20260709 13:16:49.553490  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:49.554735  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.555006  3045 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:16:49.531266  3761 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:49.511861  8566 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:16:49.540220  3164 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:49.541196  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:49.543071  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:49.565493  3046 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:49.565544  8458 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:49.567842  8458 raft_consensus.cc:697] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:49.568900  8458 consensus_queue.cc:237] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:49.566066  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 83056.8us
I20260709 13:16:49.573400  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:49.543398  3042 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:49.553992  3047 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:49.574420  3047 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:49.557852  3045 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:49.511469  8431 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:49.558082  3090 leader_election.cc:400] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16.
I20260709 13:16:49.579330  3090 leader_election.cc:403] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:16:49.579407  8431 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.580307  8431 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:49.558982  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:49.582938  8555 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:49.500759  8155 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:49.489629  8146 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:49.595641  3165 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:49.518322  8481 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.493829  8516 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:49.589972  3047 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.603505  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:49.621711  3049 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:49.622421  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:49.562865  8234 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:49.625288  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:49.629027  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:49.619854  8581 log.cc:927] Time spent T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:16:49.636714  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:49.596962  8181 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16.
I20260709 13:16:49.598242  8409 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:49.563838  8476 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:16:49.620702  8245 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:49.520694  8412 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.640247  3047 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:49.611356  8482 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:49.645428  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:49.622995  8496 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:49.630831  8234 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:49.648613  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:49.490847  8495 consensus_queue.cc:260] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.626464  8165 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.626850  8491 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:49.629444  8424 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.628960  8464 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:49.683758  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 126251us
I20260709 13:16:49.642099  8155 raft_consensus.cc:2764] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:16:49.664806  3121 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:16:49.627087  8481 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:49.709967  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2650) took 1131 ms. Trace:
I20260709 13:16:49.666742  8234 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:49.738739  3121 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:49.690670  8245 raft_consensus.cc:697] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:49.740197  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:49.742157  3196 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:16:49.693975  8477 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.745184  3121 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:16:49.747968  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:49.710633  3195 rpcz_store.cc:276] 0709 13:16:48.578276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.727980 (+149704us) service_pool.cc:224] Handling call
0709 13:16:48.731604 (+  3624us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:49.122436 (+390832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.122464 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:16:49.123114 (+   650us) log.cc:844] Serialized 78 byte log entry
0709 13:16:49.176059 (+ 52945us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:49.343325 (+167266us) log.cc:844] Serialized 14 byte log entry
0709 13:16:49.396347 (+ 53022us) log.cc:844] Serialized 14 byte log entry
0709 13:16:49.408537 (+ 12190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.408614 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.504519 (+ 95905us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b48001b0258. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff8352dcaa1 00007ff8352d3b37 00007ff8352d39ca 00007ff8353cb26f 00007ff8353caf37 00007ff8353df55c 00007ff8353df508 00007ff8353df488 00007ff8353df443 00007ff8353de6ec 00007ff834308a96
0709 13:16:49.709705 (+205186us) raft_consensus.cc:1685] finished
0709 13:16:49.709727 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.709904 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":452228,"prepare.queue_time_us":432393,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":82,"raft.queue_time_us":386091,"raft.run_cpu_time_us":2384,"raft.run_wall_time_us":403655,"spinlock_wait_cycles":39563648,"thread_start_us":168837,"threads_started":2,"wal-append.queue_time_us":111230}
I20260709 13:16:49.726588  8412 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:49.732298  8146 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:49.762516  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:49.763546  8597 log.cc:927] Time spent T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:16:49.764178  8583 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.262s	user 0.000s	sys 0.002s
I20260709 13:16:49.764622  8604 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.765327  8604 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.725082  8187 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.769815  8593 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:49.770148  8245 consensus_queue.cc:237] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:49.770928  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:49.771589  8187 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:49.772596  3194 raft_consensus.cc:1240] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 13:16:49.778504  8598 log.cc:927] Time spent T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:16:49.779125  8516 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:49.780254  8481 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:49.708061  8424 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:49.782866  8424 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:49.743391  8155 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.698274  8562 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:16:49.784253  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2652) took 1205 ms. Trace:
I20260709 13:16:49.787933  3091 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:49.710562  8165 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.809509  3197 rpcz_store.cc:276] 0709 13:16:48.578830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.821234 (+242404us) service_pool.cc:224] Handling call
0709 13:16:48.821680 (+   446us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:49.129925 (+308245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.129954 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:49.138333 (+  8379us) log.cc:844] Serialized 52 byte log entry
0709 13:16:49.281954 (+143621us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:49.407801 (+125847us) log.cc:844] Serialized 14 byte log entry
0709 13:16:49.408081 (+   280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.408166 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.488802 (+ 80636us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b180002da00. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:16:49.505263 (+ 16461us) spinlock_profiling.cc:243] Waited 8.47 ms on lock 0x7b48001b0258. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff8352dcaa1 00007ff8352d3b37 00007ff8352d39ca 00007ff8353cb26f 00007ff8353caf37 00007ff8353df55c 00007ff8353df508 00007ff8353df488 00007ff8353df443 00007ff8353de6ec 00007ff834308a96
0709 13:16:49.783995 (+278732us) raft_consensus.cc:1685] finished
0709 13:16:49.784021 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.784188 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":339208,"prepare.queue_time_us":166868,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":311085,"raft.run_cpu_time_us":5493,"raft.run_wall_time_us":373076,"spinlock_wait_cycles":97437056,"thread_start_us":210390,"threads_started":2,"wal-append.queue_time_us":219083}
I20260709 13:16:49.777132  8452 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.820022  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:49.823077  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:49.824483  3091 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:49.711058  8464 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.754776  8477 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:49.826594  3197 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:49.824718  3042 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:49.829572  3091 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:49.835606  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 210399us
I20260709 13:16:49.823829  8534 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:49.825847  8566 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:49.838627  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 142334us
I20260709 13:16:49.841394  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:49.830542  8326 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:49.842280  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:49.831087  8420 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:49.799412  8372 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.856745  3091 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:49.860771  3799 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:49.820549  8155 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.839126  8424 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:49.855225  3197 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:16:49.865890  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:49.839020  8459 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:49.871593  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:49.829200  8146 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:16:49.853085  8516 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.875447  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:49.878608  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:49.880102  8420 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.877965  8459 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.882658  8420 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.877293  8496 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:49.884232  8496 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.884646  8496 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:49.885147  8420 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:49.890327  8563 raft_consensus.cc:3055] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:49.890508  8452 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:49.890931  8563 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:49.881578  3197 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:16:49.893172  8603 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:49.893563  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:49.893778  8603 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:49.897356  8601 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:16:49.897269  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:49.893513  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:49.899742  3197 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:16:49.903193  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2644) took 1328 ms. Trace:
I20260709 13:16:49.908368  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:49.909322  3049 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:16:49.912281  3091 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:49.913487  8566 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:49.914023  8566 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.914497  8566 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:49.915225  8477 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:49.885501  8562 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:49.918503  8562 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:49.918889  8459 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:49.919159  8562 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:49.903756  3191 rpcz_store.cc:276] 0709 13:16:48.575011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.575231 (+   220us) service_pool.cc:224] Handling call
0709 13:16:48.598244 (+ 23013us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:49.132006 (+533762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.132037 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:49.439121 (+307084us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b180044abe0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2942a6 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a
0709 13:16:49.440218 (+  1097us) spinlock_profiling.cc:243] Waited 7.54 ms on lock 0x7b2c000fc108. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:16:49.440924 (+   706us) log.cc:844] Serialized 52 byte log entry
0709 13:16:49.500447 (+ 59523us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:49.597259 (+ 96812us) log.cc:844] Serialized 14 byte log entry
0709 13:16:49.597808 (+   549us) log.cc:844] Serialized 14 byte log entry
0709 13:16:49.598022 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.598101 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.897455 (+299354us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b180044abe0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:16:49.898284 (+   829us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b180044abe0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:16:49.902928 (+  4644us) raft_consensus.cc:1685] finished
0709 13:16:49.902960 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.903125 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":634727,"prepare.queue_time_us":154819,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":562718,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":15888,"spinlock_wait_cycles":97116928,"thread_start_us":58760,"threads_started":1,"wal-append.queue_time_us":188189}
I20260709 13:16:49.909693  8496 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:49.922487  3191 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:34728
I20260709 13:16:49.923231  3191 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:49.853641  8593 consensus_queue.cc:1059] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:16:49.923658  3191 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:49.878575  8491 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:49.925982  8491 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:49.926023  8496 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:49.926594  8491 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:49.927876  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:49.928480  3043 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:49.936148  3043 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:49.865084  8534 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:49.937930  3091 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:49.873083  8424 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.896598  8603 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:49.960870  3192 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:16:49.839330  7743 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.967749  8566 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.945170  8593 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:49.974800  8593 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.977276  8593 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:49.872031  8132 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.092s
I20260709 13:16:49.951805  3191 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.980657  8461 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:49.982316  3191 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:49.981259  8461 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:49.986228  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:49.986819  3043 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:49.988085  8491 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:49.990648  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:49.984226  8587 log.cc:927] Time spent T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.512s	user 0.001s	sys 0.003s
I20260709 13:16:49.992295  3195 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:49.992873  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2648) took 1415 ms. Trace:
I20260709 13:16:49.990665  8461 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:49.983974  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:49.996529  3191 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:49.993337  3200 rpcz_store.cc:276] 0709 13:16:48.577668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.578452 (+   784us) service_pool.cc:224] Handling call
0709 13:16:48.578846 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.131806 (+552960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.131838 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:49.288064 (+156226us) spinlock_profiling.cc:243] Waited 7.62 ms on lock 0x7b2c000fc108. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:16:49.298582 (+ 10518us) log.cc:844] Serialized 26 byte log entry
0709 13:16:49.458534 (+159952us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:49.458574 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.458646 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.613465 (+154819us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b48001b0258. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff8352dcaa1 00007ff8352d3b37 00007ff8352d39ca 00007ff8353cb26f 00007ff8353caf37 00007ff8353df55c 00007ff8353df508 00007ff8353df488 00007ff8353df443 00007ff8353de6ec 00007ff834308a96
0709 13:16:49.983533 (+370068us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:49.992624 (+  9091us) raft_consensus.cc:1685] finished
0709 13:16:49.992655 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.992804 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":552371,"raft.queue_time_us":552473,"raft.run_cpu_time_us":2520,"raft.run_wall_time_us":474247,"spinlock_wait_cycles":64159744,"thread_start_us":76437,"threads_started":1,"wal-append.queue_time_us":133104}
I20260709 13:16:49.993624  3195 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:16:50.011687  8372 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:49.871865  8488 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 13:16:50.012954  8234 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:50.015461  8234 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:50.016894  8464 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:49.944579  8534 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.944308  8431 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.019938  8431 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:50.023572  8155 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:50.024201  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:50.024582  8165 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:49.941668  8357 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.026993  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:50.026628  8563 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.027856  8357 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:50.027976  3046 raft_consensus.cc:2410] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:16:50.028115  8563 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:49.934708  8516 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.029038  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:50.030892  8516 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:49.962416  8424 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:49.962669  8496 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:50.034077  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:50.034341  8496 raft_consensus.cc:697] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:50.034794  3046 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:50.035394  8496 consensus_queue.cc:237] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.017691  8534 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:50.036535  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:50.037129  3198 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:50.026656  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:50.038699  3045 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 12: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:50.042435  8411 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:50.042924  8411 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:50.043761  8411 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.044834  8411 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:50.046548  3045 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:16:50.047327  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:50.047811  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:50.048669  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:50.048969  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:50.049567  3045 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:16:50.050000  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:50.050432  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:50.051069  3045 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:50.050580  3118 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:50.051534  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:50.052174  3126 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:50.054077  8340 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.054150  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:50.054823  3124 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:16:50.054716  8340 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:50.054862  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:50.046448  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:50.057520  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:50.059267  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 183891us
I20260709 13:16:50.061725  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:50.065013  3043 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:16:50.065131  3165 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:50.072983  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:50.073987  3043 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:16:50.075569  3043 raft_consensus.cc:1240] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:16:49.989483  8468 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:50.085755  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:50.085819  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:50.086786  3794 raft_consensus.cc:3055] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:50.087342  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:49.994803  8605 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:16:50.070926  3091 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:50.080173  3090 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:49.994040  8491 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:50.095279  3198 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:16:50.106647  3090 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:50.087298  3794 raft_consensus.cc:740] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:50.095965  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:50.099491  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:50.078831  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.103832  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:50.106714  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:50.108985  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:49.980635  8566 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:50.100744  3046 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:50.109583  3198 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:50.111037  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:50.110602  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:50.112211  3198 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:50.122006  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:50.077895  8508 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:50.124418  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 59380us
I20260709 13:16:50.131621  3165 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:50.123337  3090 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:50.124583  3164 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:50.126969  3118 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:50.127202  3091 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:50.084909  8357 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:16:50.094795  8460 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:50.137080  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:50.149834  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:50.161703  3195 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:16:50.149462  3198 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:50.164366  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:50.165228  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:50.164912  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:50.168138  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 44912.9us
I20260709 13:16:50.167526  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:50.115044  8603 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:50.122435  8429 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:50.115103  8491 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:50.181581  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:50.182338  3199 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:16:50.135538  8146 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:50.194442  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:50.196123  3199 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:16:50.169802  8245 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:50.217356  3195 raft_consensus.cc:2393] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:50.176494  8464 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:50.167904  8096 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:50.125718  7926 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:16:50.180218  8420 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:50.223644  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 96535.6us
I20260709 13:16:50.185231  8476 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:50.136193  8477 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:16:50.135686  8171 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.075s
W20260709 13:16:50.233335  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:50.232761  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 119788us
I20260709 13:16:50.135419  8452 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 13:16:50.163291  8539 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:16:50.220261  8245 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.155117  8508 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:50.218159  8601 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:50.170531  8460 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:50.210286  8357 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:16:50.242667  8420 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:16:50.303040  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 132112us
I20260709 13:16:50.221511  8491 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:50.185074  8429 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.223062  8464 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:50.289574  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 120127us
I20260709 13:16:50.229049  8096 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.280156  3195 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:16:50.274814  8146 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:50.210237  8603 raft_consensus.cc:697] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:16:50.282274  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 157784us
I20260709 13:16:50.285581  8506 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:50.295017  8245 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:50.349874  3198 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:16:50.351859  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:50.347035  8416 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:16:50.307993  8420 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:50.376938  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:50.377569  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 86068.8us
I20260709 13:16:50.345608  8340 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:50.353783  8464 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:50.349134  8429 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:50.356331  8096 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:50.391352  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:50.392715  3051 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:16:50.305852  8517 consensus_queue.cc:1059] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:16:50.363035  8414 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:50.366817  8461 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:50.416066  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.373207  8481 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:50.373355  8146 raft_consensus.cc:697] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:50.425802  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:50.366865  8506 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.438217  8632 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.438853  8632 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.441385  8460 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:50.425519  8562 consensus_meta.cc:287] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.506s	user 0.015s	sys 0.000s
I20260709 13:16:50.437093  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:50.448650  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2188) took 1190 ms. Trace:
I20260709 13:16:50.449534  3194 rpcz_store.cc:276] 0709 13:16:49.258196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.489082 (+230886us) service_pool.cc:224] Handling call
0709 13:16:49.489386 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.773025 (+283639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.448271 (+675246us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b5400037354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:50.448551 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650690816}
I20260709 13:16:50.433954  8603 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:50.452005  8621 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:16:50.454825  8431 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:50.421041  8414 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.455510  8431 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:50.457355  8414 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:50.455225  8619 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:16:50.423449  8461 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.463037  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:50.468354  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:50.469235  3164 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:50.470137  8622 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
W20260709 13:16:50.470829  8620 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 13:16:50.471459  8636 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:50.472101  8636 raft_consensus.cc:697] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:50.472141  8146 consensus_queue.cc:237] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.458374  8107 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:16:50.477728  8626 log.cc:927] Time spent T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:16:50.478273  8508 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:50.441535  8632 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:50.422884  8609 consensus_queue.cc:1059] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.278s
I20260709 13:16:50.488125  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:50.457962  8635 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:50.448642  8618 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.262s
I20260709 13:16:50.448382  8562 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.491497  8635 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.493700  8508 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:50.473248  8636 consensus_queue.cc:237] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.544603  8637 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:50.543747  8357 raft_consensus.cc:2955] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:16:50.545923  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2528) took 1054 ms. Trace:
I20260709 13:16:50.581010  3124 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:16:50.580458  3050 rpcz_store.cc:276] 0709 13:16:49.491608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.491794 (+   186us) service_pool.cc:224] Handling call
0709 13:16:49.494198 (+  2404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:49.696806 (+202608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.696840 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:49.696883 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:49.696927 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.545626 (+848699us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b540028c154. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:50.545682 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.545858 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465472256}
I20260709 13:16:50.548748  8630 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:50.550518  8491 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:50.553042  8506 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:50.554207  8534 consensus_meta.cc:287] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.517s	user 0.012s	sys 0.000s
I20260709 13:16:50.491950  8424 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.557009  3049 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 17. Current term is 18. Ops: [16.13-17.14]
I20260709 13:16:50.530645  8635 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:50.559369  3051 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:50.559882  3042 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:50.571430  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:50.564911  3046 raft_consensus.cc:2955] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:16:50.578091  8096 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.587091  8515 raft_consensus.cc:3055] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:50.589121  8461 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:50.590607  8562 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:50.583444  8637 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:50.615849  3042 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:16:50.616755  3122 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:16:50.621393  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:50.623381  8563 consensus_meta.cc:287] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.595s	user 0.012s	sys 0.000s
I20260709 13:16:50.598977  8534 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.626242  8534 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:50.603530  8491 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.626861  8491 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.629489  3048 raft_consensus.cc:2368] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13.
I20260709 13:16:50.629874  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:50.632916  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:50.615950  8515 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:50.633523  8461 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:50.635635  8461 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.639642  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:50.644841  8245 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.645766  8495 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:50.584542  8630 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.645606  8637 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:50.648200  8633 consensus_queue.cc:1059] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:16:50.660414  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:50.661562  3117 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:16:50.593636  8420 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.618343  8557 consensus_queue.cc:1059] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:16:50.661582  3120 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:16:50.663331  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:50.668619  8491 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:50.664227  8637 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.669627  8637 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.671200  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:50.671671  8637 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:50.671885  8557 raft_consensus.cc:3055] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:50.669641  8630 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:50.672259  8557 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:50.673501  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:50.674238  3050 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:16:50.678270  3124 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:50.673920  8557 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:50.679778  8557 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:50.681159  8245 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:50.661952  8424 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:50.664433  8461 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:50.649425  8429 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.702647  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:50.726619  3117 raft_consensus.cc:1217] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Deduplicated request from leader. Original: 9.5->[11.6-17.9]   Dedup: 12.7->[15.8-17.9]
I20260709 13:16:50.727174  3117 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18. Ops: [11.6-17.9]
I20260709 13:16:50.730743  3125 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:16:50.746045  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:50.735617  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 222230us
I20260709 13:16:50.746897  3118 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17. Ops: [14.9-16.10]
W20260709 13:16:50.764179  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.775151  3195 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:50.779181  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:50.779927  3191 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:50.806727  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:50.807714  3122 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:50.822455  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:50.827026  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:50.827988  3117 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:50.779250  8424 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.791393  8107 raft_consensus.cc:697] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:16:50.832397  8622 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:16:50.884792  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 404285us
I20260709 13:16:50.886526  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:50.890606  3117 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
W20260709 13:16:50.836155  8610 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:16:50.725623  8635 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:50.835773  8583 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:16:50.890789  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:50.891510  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:50.892465  3126 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:16:50.895706  3120 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:16:50.749246  8464 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.904227  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:50.917958  8334 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.918655  8334 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:50.920998  8334 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:50.921973  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:50.922597  8420 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:50.927080  3122 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:16:50.932790  8515 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:50.922739  3045 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:16:50.884357  8424 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:50.935855  8635 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:50.943363  8515 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:50.944069  8429 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:50.955615  8464 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:50.956899  8357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:55310 (request call id 18) took 2039 ms. Trace:
I20260709 13:16:50.957290  8604 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:50.957480  8357 rpcz_store.cc:276] 0709 13:16:48.917281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.917420 (+   139us) service_pool.cc:224] Handling call
0709 13:16:49.058610 (+141190us) log.cc:844] Serialized 506 byte log entry
0709 13:16:49.460905 (+402295us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b18001969c0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:16:50.956797 (+1495892us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46843,"raft.queue_time_us":61166,"raft.run_cpu_time_us":2961,"raft.run_wall_time_us":209015,"spinlock_wait_cycles":7296256,"thread_start_us":85360,"threads_started":1,"wal-append.queue_time_us":165677,"wal-append.run_cpu_time_us":3414,"wal-append.run_wall_time_us":1252556}
I20260709 13:16:50.968271  7970 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:50.974658  3090 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:50.978722  8644 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:50.979360  8644 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:50.981390  8644 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:50.982352  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 91684.4us
I20260709 13:16:50.983167  8187 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:50.942626  8107 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:50.988829  8506 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:50.993026  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34728 (request call id 831) took 1473 ms. Trace:
I20260709 13:16:50.993407  3192 rpcz_store.cc:276] 0709 13:16:49.519760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.747704 (+227944us) service_pool.cc:224] Handling call
0709 13:16:50.992845 (+1245141us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54002bcad4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:50.992969 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263866112}
I20260709 13:16:50.987358  8357 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:50.995050  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2938) took 1098 ms. Trace:
I20260709 13:16:50.995932  3200 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:16:50.996544  8635 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:50.999897  8441 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:51.000401  8476 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:50.997417  3048 rpcz_store.cc:276] 0709 13:16:49.896833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.897000 (+   167us) service_pool.cc:224] Handling call
0709 13:16:50.993546 (+1096546us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b54000c6054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:50.994982 (+  1436us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1680196480}
I20260709 13:16:51.001309  8476 raft_consensus.cc:3055] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:51.001711  8476 raft_consensus.cc:740] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:16:51.002161  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.002815  8476 consensus_queue.cc:260] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.999648  8635 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:51.006220  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2530) took 1511 ms. Trace:
I20260709 13:16:51.006595  8476 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:51.006671  3044 rpcz_store.cc:276] 0709 13:16:49.495088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.495547 (+   459us) service_pool.cc:224] Handling call
0709 13:16:49.495795 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:49.527482 (+ 31687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.527512 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:49.527564 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:49.527613 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.005957 (+1478344us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b5400474fd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:51.006017 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.006164 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72222592}
I20260709 13:16:51.010684  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:51.012295  8635 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:51.014050  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:50.991143  8458 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.014840  3790 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:51.014889  8458 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:50.990257  8508 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:51.018775  8508 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:51.023272  3790 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:16:50.987697  8429 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:16:50.998785  8518 raft_consensus.cc:3055] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:51.017441  8458 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:51.035367  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:51.036649  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:51.043246  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:51.048063  3790 raft_consensus.cc:2376] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16. Re-sending same reply.
I20260709 13:16:50.996887  8357 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.050236  3799 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:16:50.996625  8506 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:51.034607  8508 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:51.034390  8518 raft_consensus.cc:740] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:51.049913  8424 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:51.054857  8357 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:51.076241  8506 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:51.073242  8518 consensus_queue.cc:260] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:51.081934  8482 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.082589  8482 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:51.088127  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:51.090827  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:51.085139  8482 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:51.099216  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:51.100129  3044 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:16:51.118773  8585 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:51.120645  8585 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:51.132571  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:51.144227  3762 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:51.146596  8091 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:51.147081  8091 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.147486  8091 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:16:51.148828  8616 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.931s	user 0.004s	sys 0.000s
I20260709 13:16:51.156344  3091 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:51.158236  8429 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:51.158735  8429 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.159382  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:51.159111  8429 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:51.160307  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 835) took 1303 ms. Trace:
I20260709 13:16:51.160808  3200 rpcz_store.cc:276] 0709 13:16:49.856915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.000183 (+143268us) service_pool.cc:224] Handling call
0709 13:16:50.993872 (+993689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.997002 (+  3130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.159969 (+162967us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b54002bcad0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:51.160240 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2284791168}
I20260709 13:16:51.161763  3042 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:16:51.162117  3042 pending_rounds.cc:85] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 8
I20260709 13:16:51.162336  3042 pending_rounds.cc:107] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:16:51.162431  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2202) took 1092 ms. Trace:
I20260709 13:16:51.162923  3198 rpcz_store.cc:276] 0709 13:16:50.069548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.164690 (+ 95142us) service_pool.cc:224] Handling call
0709 13:16:51.162270 (+997580us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b540013d3d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:51.162374 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417379584}
I20260709 13:16:51.162566  3042 raft_consensus.cc:2889] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:51.164060  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:51.164813  3194 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 13: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:51.165575  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:51.165800  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:51.166944  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:51.167696  3199 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 16: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:51.170061  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:51.171144  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:51.171849  3122 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 12: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:51.173146  3196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2656) took 1652 ms (client timeout 1589 ms). Trace:
W20260709 13:16:51.173632  3196 rpcz_store.cc:269] 0709 13:16:49.520649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.612780 (+ 92131us) service_pool.cc:224] Handling call
0709 13:16:51.172968 (+1560188us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54001b80d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:51.173082 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257168256}
I20260709 13:16:51.174397  3118 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:16:51.174886  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:51.175778  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:51.175973  8617 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.892s	user 0.001s	sys 0.001s
I20260709 13:16:51.176389  3122 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:16:51.177662  3043 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:16:50.121429  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:51.175973  3191 raft_consensus.cc:2410] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:16:51.177681  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2933) took 1394 ms. Trace:
I20260709 13:16:51.182353  3047 rpcz_store.cc:276] 0709 13:16:49.783308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.783472 (+   164us) service_pool.cc:224] Handling call
0709 13:16:49.783844 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.784238 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.784268 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:49.827885 (+ 43617us) log.cc:844] Serialized 26 byte log entry
0709 13:16:50.102257 (+274372us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:50.102300 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.102379 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:51.175345 (+1072966us) spinlock_profiling.cc:243] Waited 7.07 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:51.177353 (+  2008us) raft_consensus.cc:1685] finished
0709 13:16:51.177380 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.177614 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":510,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":19786,"spinlock_wait_cycles":16265600,"thread_start_us":252831,"threads_started":1,"wal-append.queue_time_us":343428}
I20260709 13:16:51.190514  3120 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:51.191989  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:51.192704  3794 consensus_queue.cc:260] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:51.193653  3794 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:51.196893  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:51.197551  3122 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:51.202982  8627 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:51.203550  8627 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:51.202666  3794 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:51.206831  3794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43926 (request call id 876) took 1123 ms. Trace:
I20260709 13:16:51.207147  3794 rpcz_store.cc:276] 0709 13:16:50.083963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.085444 (+  1481us) service_pool.cc:224] Handling call
0709 13:16:51.192353 (+1106909us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b54004bb020. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83033106f 00007ff8303a9f60 00007ff8303ab7de 00007ff8303b727c 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2
0709 13:16:51.206775 (+ 14422us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6106368}
W20260709 13:16:51.209954  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 51911.5us
I20260709 13:16:51.211145  3091 leader_election.cc:400] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 pre-election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13.
W20260709 13:16:51.212674  8628 log.cc:927] Time spent T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.781s	user 0.004s	sys 0.009s
I20260709 13:16:51.213354  8420 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:51.219055  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:51.230664  8518 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:51.231864  2942 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49738 (request call id 150) took 12190 ms (client timeout 15000 ms). Trace:
I20260709 13:16:51.234789  8096 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:51.236939  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:51.237859  8431 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:51.240639  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:51.241259  3124 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:51.241906  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:51.242467  3192 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:51.244007  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:51.244709  3196 raft_consensus.cc:2368] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16.
I20260709 13:16:51.245492  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:51.246773  3164 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:51.252934  3048 raft_consensus.cc:2393] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 18: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:51.254448  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:51.255489  3118 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:51.256767  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:51.257061  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:51.257208  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:51.257678  3197 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:16:51.258244  3199 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:16:51.259507  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:51.262799  3761 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:51.264998  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:51.156214  8357 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:51.269368  3192 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
W20260709 13:16:51.267722  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 54949.5us
W20260709 13:16:51.273351  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.273910  3196 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 19: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:51.274720  3124 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
W20260709 13:16:51.285816  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.287318  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:51.289291  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:51.290601  3121 raft_consensus.cc:2410] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:16:51.278939  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:51.292153  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:51.294116  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:51.294981  3126 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:16:51.303416  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:51.306596  3118 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
W20260709 13:16:51.308338  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 45646.9us
I20260709 13:16:51.301635  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:51.311509  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:51.276710  7743 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 12 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:51.269829  8442 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.315172  3164 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:51.324555  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:51.325528  3120 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:51.330892  3761 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:51.282493  8627 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:51.279927  8637 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:51.349234  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:51.348402  3126 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
W20260709 13:16:51.352352  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.339195  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:51.283185  8646 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:51.307937  8516 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:51.318221  8515 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:51.277793  8416 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:16:51.360689  8604 raft_consensus.cc:2764] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:16:51.371536  8637 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:51.380407  3126 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:16:51.337690  8442 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:51.386176  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:51.386433  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:51.386942  3043 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:51.387239  3044 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:51.388089  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.324308  8495 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:16:51.389974  8357 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:51.390367  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:51.390863  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:51.391053  3047 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:16:51.391625  3042 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:51.388254  8442 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:51.392740  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:51.393648  3046 raft_consensus.cc:2393] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:51.298380  8496 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 13:16:51.311024  8585 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:51.337422  8441 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:51.397195  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:51.232424  2942 rpcz_store.cc:269] 0709 13:16:39.040958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.041916 (+   958us) service_pool.cc:224] Handling call
0709 13:16:51.231737 (+12189821us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:48.158859 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:48.238461 (+ 79602us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:48.238506 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:16:48.238527 (+    21us) tablet.cc:662] Decoding operations
0709 13:16:48.268546 (+ 30019us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:48.268666 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:48.268699 (+    33us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:16:48.269798 (+  1099us) tablet.cc:701] Row locks acquired
0709 13:16:48.269866 (+    68us) write_op.cc:260] PREPARE: finished
0709 13:16:48.270123 (+   257us) write_op.cc:270] Start()
0709 13:16:48.270267 (+   144us) write_op.cc:276] Timestamp: P: 1783603008270027 usec, L: 0
0709 13:16:48.270287 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:16:48.271289 (+  1002us) log.cc:844] Serialized 4745 byte log entry
0709 13:16:48.532364 (+261075us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b18003e5840. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:16:48.838998 (+306634us) op_driver.cc:464] REPLICATION: finished
0709 13:16:48.891511 (+ 52513us) write_op.cc:301] APPLY: starting
0709 13:16:48.891602 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:48.971213 (+ 79611us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:48.971244 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:49.024783 (+ 53539us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:49.093471 (+ 68688us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0709 13:16:49.105243 (+ 11772us) write_op.cc:312] APPLY: finished
0709 13:16:49.174158 (+ 68915us) log.cc:844] Serialized 113 byte log entry
0709 13:16:49.195368 (+ 21210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:49.222829 (+ 27461us) write_op.cc:454] Released schema lock
0709 13:16:49.228358 (+  5529us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:49.265237 (+ 36879us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:49.283642 (+ 18405us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1768459,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":52191,"apply.run_cpu_time_us":18683,"apply.run_wall_time_us":351992,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54311,"num_ops":12,"prepare.queue_time_us":143597,"prepare.run_cpu_time_us":60199,"prepare.run_wall_time_us":373513,"raft.queue_time_us":281402,"raft.run_cpu_time_us":24945,"raft.run_wall_time_us":41260,"replication_time_us":568516,"spinlock_wait_cycles":43173760,"thread_start_us":574536,"threads_started":4,"wal-append.queue_time_us":214677,"wal-append.run_cpu_time_us":80619,"wal-append.run_wall_time_us":1687645}]]}
I20260709 13:16:51.386059  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:51.394315  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:51.318897  8464 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:51.399446  3046 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:51.361492  8636 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.390288  3051 raft_consensus.cc:1240] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:16:51.405930  3126 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 18: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:51.407644  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:51.410501  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:51.411548  3794 raft_consensus.cc:2393] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 17: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:51.417465  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:51.427476  3043 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:16:51.439484  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:51.440018  3790 raft_consensus.cc:1240] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:51.440321  3791 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 16: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:51.395249  8470 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:51.361819  8283 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:16:51.440120  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:51.460718  3794 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:51.452122  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:51.461995  3121 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:51.458387  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:51.462831  3790 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:16:51.400521  8441 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.463595  8441 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:51.458303  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:51.465969  8509 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:51.466622  8509 raft_consensus.cc:697] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:51.466703  8444 tablet_copy_client.cc:538] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:51.467953  8509 consensus_queue.cc:237] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:51.385201  8091 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:51.396602  8206 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:51.472653  8206 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:51.475157  8206 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:51.457721  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:51.482445  3761 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:51.484354  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:51.485563  7970 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:51.485255  8206 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:51.490078  8441 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:51.495512  8441 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:51.497080  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:51.451467  8516 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.546989  8516 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:51.414562  8464 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.550973  8464 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:51.551693  3120 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:16:51.419209  8096 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:51.554405  8096 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:51.555044  8637 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:51.534349  3791 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:51.502257  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:51.557771  8429 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:51.560583  3122 raft_consensus.cc:2393] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 19: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:51.562376  8516 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:51.420714  8636 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:51.580116  8636 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:51.562747  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:51.566051  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:51.581298  3121 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:51.568219  3124 raft_consensus.cc:1240] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:16:51.568974  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:51.583776  3117 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:51.575906  3799 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 12: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
W20260709 13:16:51.536147  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.557183  8096 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:51.592820  3791 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:16:51.594735  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:51.597908  3796 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
I20260709 13:16:51.601976  3164 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:51.603220  8518 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:51.604118  8441 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:51.604727  8441 raft_consensus.cc:697] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:51.604200  8518 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:51.605609  8441 consensus_queue.cc:237] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:51.607043  8518 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:51.607940  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.598316  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:51.608824  3117 raft_consensus.cc:2410] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:16:51.612470  8464 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:51.615123  8516 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:51.615850  8661 log.cc:927] Time spent T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:16:51.615942  8516 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:51.617771  8091 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:51.620005  8516 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:51.621553  3048 raft_consensus.cc:2393] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:51.623871  8464 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:51.624289  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:51.627911  8429 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:51.628365  3043 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:51.637210  3043 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:16:51.639916  3048 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:16:51.642308  3051 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:51.646019  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:51.647732  3762 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:51.648731  8283 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:51.649314  8283 raft_consensus.cc:697] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:51.650249  8283 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:51.650178  3046 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:16:51.668285  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:51.669214  3199 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:16:51.673067  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:51.674047  3199 raft_consensus.cc:2410] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:16:51.676314  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:51.677912  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:51.678687  3192 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:16:51.680634  3164 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:51.693302  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:51.697646  3195 raft_consensus.cc:2368] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19.
I20260709 13:16:51.700877  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:51.707201  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:51.710667  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:51.713294  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:51.715211  3192 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:16:51.716542  3195 raft_consensus.cc:2368] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13.
I20260709 13:16:51.720588  8096 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:51.722419  3051 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:16:51.731341  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:51.732316  3051 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:51.739761  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:51.742820  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:51.751085  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 250469us
I20260709 13:16:51.710109  8644 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:16:51.766957  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.767611  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:51.774976  3761 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:51.757575  8206 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:51.781024  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:51.781985  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:51.782486  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:51.784890  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:51.809993  3200 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:16:51.786224  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:51.786996  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:51.811764  3045 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:16:51.792157  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:51.794641  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:51.813479  3042 raft_consensus.cc:2393] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:51.754863  8555 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:16:51.766350  8644 raft_consensus.cc:697] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:51.814528  3043 raft_consensus.cc:2410] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
W20260709 13:16:51.830231  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 50640.7us
I20260709 13:16:51.813490  3051 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:16:51.766793  8515 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:16:51.818030  3047 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:51.839232  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.839284  3045 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:16:51.808573  7743 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:51.847584  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:51.851758  3200 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:16:51.852661  8096 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:51.816962  8429 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:16:51.820333  8358 consensus_queue.cc:1059] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
W20260709 13:16:52.050770  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 198789us
I20260709 13:16:52.057035  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:52.060938  3791 raft_consensus.cc:2410] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
W20260709 13:16:52.062995  3092 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.000s	sys 0.022s
W20260709 13:16:52.063422  3092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.000s	sys 0.023s
W20260709 13:16:52.066138  8660 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.304s	user 0.000s	sys 0.003s
I20260709 13:16:52.075814  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:52.057713  8096 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:52.062548  8518 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:16:52.090684  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.058907  8496 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:16:52.073056  8461 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:16:52.074193  8181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.020s	sys 0.030s
I20260709 13:16:52.082105  8096 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:52.097553  8358 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:52.129335  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:52.065161  8644 consensus_queue.cc:237] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:52.127331  8181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.021s	sys 0.030s
W20260709 13:16:52.110677  8441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.034s	sys 0.051s
I20260709 13:16:52.139168  3796 raft_consensus.cc:2410] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
W20260709 13:16:52.126010  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 423313us
I20260709 13:16:52.102349  8630 consensus_queue.cc:1059] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:16:52.098860  8518 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:52.129559  8444 tablet_bootstrap.cc:492] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:16:52.126720  8461 raft_consensus.cc:697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:16:52.153545  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.130481  8665 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:52.142954  8441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.035s	sys 0.051s
I20260709 13:16:52.197758  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:52.198545  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:52.160830  8482 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.057s	sys 0.095s
I20260709 13:16:52.151641  8358 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:52.184906  8424 raft_consensus.cc:3055] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:16:52.206002  8482 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.058s	sys 0.095s
I20260709 13:16:52.197170  8181 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:52.223408  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:52.222822  3165 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:52.162220  8665 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:52.213423  8663 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:16:52.240477  3794 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:16:52.242595  3794 pending_rounds.cc:85] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: Aborting all ops after (but not including) 13
I20260709 13:16:52.243189  3794 pending_rounds.cc:107] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:16:52.242403  3126 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:52.243451  3794 raft_consensus.cc:2889] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:52.208215  8424 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:52.247301  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:52.214505  8107 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.263484  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:52.266710  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:52.273978  8636 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.274451  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:52.274652  8636 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:52.275998  3117 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:52.276942  8636 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:52.279938  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:52.287202  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:52.291479  7743 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.297284  7743 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:52.299611  8673 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.110s	user 0.003s	sys 0.000s
I20260709 13:16:52.307130  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:52.308310  3047 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
W20260709 13:16:52.309473  3195 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.019s	sys 0.046s
W20260709 13:16:52.309974  3195 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.021s	sys 0.046s
I20260709 13:16:52.309901  3762 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:16:52.311349  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 241109us
I20260709 13:16:52.242549  8181 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:52.325438  3091 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:52.326463  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:16:52.332053  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 484528us
I20260709 13:16:52.333611  3796 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:52.264953  8107 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:52.326990  8206 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:52.352463  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:52.352671  3761 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:52.358217  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.331568  7743 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:52.323110  8636 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.288353  8461 consensus_queue.cc:237] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:52.345165  8518 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:52.353365  8283 consensus_queue.cc:1059] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.010s
W20260709 13:16:52.360531  8677 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:16:52.319470  8424 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:52.356789  8206 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.374384  8518 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:52.386402  8206 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:52.370275  8636 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:52.381119  8358 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:52.395560  8424 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:52.392517  8674 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:52.406733  8678 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
W20260709 13:16:52.431907  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 209158us
I20260709 13:16:52.451898  3165 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:52.455567  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 133002us
I20260709 13:16:52.459424  3165 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:52.462448  3165 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:52.430471  8690 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:16:52.472774  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 123875us
W20260709 13:16:52.474387  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 98863.2us
I20260709 13:16:52.481395  3047 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:16:52.475240  3164 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:52.460999  8687 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:52.462206  8665 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:52.492426  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 100176us
I20260709 13:16:52.453195  8674 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:52.508617  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 46251.9us
I20260709 13:16:52.509482  3165 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:52.490069  8690 raft_consensus.cc:697] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:52.510613  8091 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:52.507694  8691 ts_tablet_manager.cc:933] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:52.504974  8686 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:52.520020  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:52.502794  8181 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:52.576437  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 69540.6us
I20260709 13:16:52.517913  8644 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:16:52.588076  8688 log.cc:927] Time spent T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.097s	user 0.001s	sys 0.001s
W20260709 13:16:52.593274  3015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.260s	user 0.017s	sys 0.036s
W20260709 13:16:52.593640  3015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.017s	sys 0.036s
W20260709 13:16:52.594175  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 1.28267e+06us
I20260709 13:16:52.595192  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:52.602053  8691 tablet_copy_client.cc:323] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.130:38619
I20260709 13:16:52.539531  8441 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:52.605324  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:52.583616  2945 catalog_manager.cc:5697] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 5 to 7, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 7 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.583555  8686 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:52.609876  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 90094.2us
I20260709 13:16:52.611392  3165 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:52.543193  8181 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:16:52.606549  8441 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:52.618439  8441 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:52.603375  8690 consensus_queue.cc:237] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:52.626654  2945 catalog_manager.cc:5697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 8 to 10, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 10 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.606617  8495 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:52.638980  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:52.631620  8107 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:52.610471  8665 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:52.650298  8482 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:52.644665  2945 catalog_manager.cc:5697] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.630389  8701 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:52.633582  8699 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:52.702380  8699 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:52.702905  8699 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:52.673768  8644 consensus_queue.cc:1059] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:16:52.707060  8644 raft_consensus.cc:3055] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:52.707463  8644 raft_consensus.cc:740] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:52.708294  8644 consensus_queue.cc:260] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:52.658123  8665 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:52.673082  8697 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:16:52.680745  2945 catalog_manager.cc:5697] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 3 to 11. New cstate: current_term: 11 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:52.678890  8495 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:52.652853  8636 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:52.687175  8675 log.cc:927] Time spent T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.528s	user 0.002s	sys 0.000s
I20260709 13:16:52.669320  8706 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:52.668535  8603 raft_consensus.cc:3055] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:52.712035  8665 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:52.684973  8096 consensus_meta.cc:287] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.001s
W20260709 13:16:52.714169  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 239048us
I20260709 13:16:52.728684  3164 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:52.718317  2945 catalog_manager.cc:5697] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 5 to 8, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 8 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:52.709530  8644 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:52.740152  8713 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:16:52.743706  3121 raft_consensus.cc:2410] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:16:52.744285  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:52.744535  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:52.745569  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:52.746272  3051 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:16:52.750044  8206 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:52.752658  2945 catalog_manager.cc:5697] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 8 to 10, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 10 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:52.759419  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.723613  8706 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:52.761555  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:52.771539  3196 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 12: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:52.763363  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:52.763548  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:52.773403  3048 raft_consensus.cc:2410] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:16:52.764168  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:52.724737  8603 raft_consensus.cc:740] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:16:52.794544  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.761044  8665 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:52.730465  8096 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:52.714105  8701 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:52.813225  3165 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:52.821162  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 182263us
I20260709 13:16:52.789901  8687 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.790132  8706 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:52.827543  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 95903.2us
I20260709 13:16:52.827431  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:52.830353  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:52.832065  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:52.832454  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:52.833225  3119 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:52.837177  3123 raft_consensus.cc:2393] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 17: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:52.840471  3165 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:52.822690  8495 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:52.855921  3091 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:52.874845  2945 catalog_manager.cc:5697] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.826052  8665 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:52.877331  2945 catalog_manager.cc:5697] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:52.867291  8495 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:52.887253  3187 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ee6c4dbcb7b45729d4e2bdcc3a09297 with delete_type TABLET_DATA_TOMBSTONED (TS 501fdf2af2bc4b0c971ae880e98f466b not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:60578
I20260709 13:16:52.882731  2945 catalog_manager.cc:5697] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 10 to 11, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 11 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
W20260709 13:16:52.889009  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 48668.4us
I20260709 13:16:52.892087  3165 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:52.835815  8603 consensus_queue.cc:260] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:52.888480  8717 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:52.893335  8518 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:52.900763  8442 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:52.899082  8482 raft_consensus.cc:697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:52.921973  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:52.927932  3791 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:52.872705  8441 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:52.922636  8636 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:52.920042  8692 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:52.935920  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 105672us
I20260709 13:16:52.937299  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:52.914446  2945 catalog_manager.cc:5697] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 9 to 10, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 10 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.931737  8636 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:52.921536  8701 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:52.864554  8706 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:52.924738  8603 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:52.957763  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:52.834504  8687 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:52.959064  8723 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:52.965437  8729 raft_consensus.cc:2764] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:16:52.965848  8723 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:52.966629  8723 raft_consensus.cc:697] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:52.957883  8724 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:52.993696  8441 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:53.030045  8724 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.030520  8724 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:53.032001  8441 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.032859  8441 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:53.003779  8687 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:53.006454  8727 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:16:53.033437  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:53.009961  8482 consensus_queue.cc:237] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:53.014263  8495 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:53.014689  8674 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:53.016750  8706 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:53.018236  8636 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:53.019721  8676 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.813s	user 0.004s	sys 0.003s
I20260709 13:16:53.020622  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2465) took 1455 ms. Trace:
I20260709 13:16:53.059659  3126 rpcz_store.cc:276] 0709 13:16:51.564729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.564857 (+   128us) service_pool.cc:224] Handling call
0709 13:16:51.565129 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.243651 (+678522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.020362 (+776711us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54002c0bd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:53.020556 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1557039872}
I20260709 13:16:53.061091  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2466) took 1496 ms. Trace:
I20260709 13:16:53.061487  3120 rpcz_store.cc:276] 0709 13:16:51.565078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.565200 (+   122us) service_pool.cc:224] Handling call
0709 13:16:51.565540 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:51.566185 (+   645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:51.566214 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:51.566791 (+   577us) log.cc:844] Serialized 52 byte log entry
0709 13:16:51.946164 (+379373us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:51.948305 (+  2141us) log.cc:844] Serialized 14 byte log entry
0709 13:16:52.051352 (+103047us) log.cc:844] Serialized 14 byte log entry
0709 13:16:52.062448 (+ 11096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.062526 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:53.015394 (+952868us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b18003d3de0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c6557 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:16:53.019151 (+  3757us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:16:53.060854 (+ 41703us) raft_consensus.cc:1685] finished
0709 13:16:53.060874 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.061031 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36540,"prepare.queue_time_us":16641,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":73,"raft.queue_time_us":115047,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":11980,"spinlock_wait_cycles":13669504,"thread_start_us":287376,"threads_started":1,"wal-append.queue_time_us":588670}
I20260709 13:16:53.022214  8096 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:53.023135  8665 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:53.025094  8644 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.064205  8644 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:53.066388  8644 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:53.027343  8107 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.067154  8107 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:53.067972  8518 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:53.069104  8736 tablet_replica.cc:333] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:16:53.069293  8107 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:52.968058  8723 consensus_queue.cc:237] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:53.035671  3090 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:53.072321  3090 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:53.073060  8666 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:16:53.029924  8672 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.698s	user 0.002s	sys 0.001s
W20260709 13:16:53.035153  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 91221.7us
I20260709 13:16:53.072827  8739 consensus_queue.cc:1059] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:16:53.038192  8555 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:53.085213  3791 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:16:53.086409  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:53.073560  3090 leader_election.cc:400] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19.
I20260709 13:16:53.087530  3090 leader_election.cc:403] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:53.041857  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 51954.5us
W20260709 13:16:53.075230  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 158083us
I20260709 13:16:53.073537  8636 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:53.082373  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:53.092541  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:53.082352  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:53.083369  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:53.079504  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:53.094698  3794 raft_consensus.cc:2410] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:16:53.042340  8283 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.042259  8637 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:53.093524  3121 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:53.089298  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:53.103415  3090 leader_election.cc:400] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13.
I20260709 13:16:53.103777  3090 leader_election.cc:403] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:16:53.103852  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:53.104434  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:53.104959  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:53.108381  3090 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:53.107581  3045 raft_consensus.cc:2393] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:53.115283  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:53.107561  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:53.083986  8695 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:53.122653  3124 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:53.124766  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:53.128840  3090 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:53.130400  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:53.131162  3046 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:53.137775  3125 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:53.106325  8674 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19.
I20260709 13:16:53.112324  8358 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:53.121582  8739 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:53.147089  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:53.123226  8689 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:53.125689  8719 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13.
I20260709 13:16:53.151697  3120 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:16:53.092924  8555 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:53.106438  8637 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:53.123147  8495 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:53.073634  8666 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:53.143406  8723 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:53.154791  3121 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:53.145776  8358 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:53.141052  8695 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:53.123658  8283 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:53.153905  8739 raft_consensus.cc:697] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:53.187407  8637 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:53.190724  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.152313  8740 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:16:53.131868  8729 consensus_queue.cc:1059] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.057s
W20260709 13:16:53.232566  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:53.238049  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 95659.9us
W20260709 13:16:53.244262  3090 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.132:43109 timed out after 1.522s (SENT) [suppressed 4 similar messages]
I20260709 13:16:53.192050  8358 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:53.230273  8731 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.155695  8724 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:53.257057  8699 consensus_meta.cc:287] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.554s	user 0.013s	sys 0.000s
I20260709 13:16:53.257712  8699 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:53.266157  3090 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:53.191730  8723 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:53.254134  8441 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:53.259516  8695 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:16:53.283295  3090 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:53.284359  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 159641us
I20260709 13:16:53.283761  8096 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:53.287900  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:53.286056  8518 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.270076  8742 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:53.266398  8746 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:53.288316  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:53.295809  3015 leader_election.cc:400] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16.
I20260709 13:16:53.296219  3015 leader_election.cc:403] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:16:53.283586  8719 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:53.261801  8731 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:53.287161  8441 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:53.290172  8747 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:53.291507  8636 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:53.309180  8723 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:53.319255  8723 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16.
I20260709 13:16:53.322383  8666 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:53.324219  8555 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:53.311498  8737 log.cc:927] Time spent T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:16:53.340407  8747 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:53.341061  8747 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:53.342370  8637 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:53.343585  8747 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:53.312791  8692 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:53.315179  8724 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:53.315475  8699 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:53.300572  8746 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:53.291858  8518 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:53.298671  8742 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:53.299428  8751 raft_consensus.cc:2764] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:16:53.417833  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:53.419013  3046 raft_consensus.cc:2410] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:16:53.420130  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:53.421532  3051 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:53.422230  8731 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:53.291146  8739 consensus_queue.cc:237] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:53.339942  3796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 726) took 1175 ms. Trace:
I20260709 13:16:53.340135  8496 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.289700  8096 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:53.306805  8441 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:53.358289  8283 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:53.377992  8637 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:53.378839  8206 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:53.425042  3796 rpcz_store.cc:276] 0709 13:16:52.164673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.190255 (+ 25582us) service_pool.cc:224] Handling call
0709 13:16:52.190663 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.334185 (+143522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.339717 (+1005532us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54005f0fd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:53.339878 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328232320}
I20260709 13:16:53.427035  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:53.439502  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:53.436501  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.440371  3046 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:53.457032  3796 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:16:53.458098  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:53.461338  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:53.462172  3125 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 18: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:53.462585  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:53.463335  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:53.463734  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:53.463999  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:53.464684  3191 raft_consensus.cc:2410] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:16:53.465667  3196 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:16:53.465947  3199 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:16:53.466481  3199 pending_rounds.cc:85] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 7
I20260709 13:16:53.466739  3117 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 16: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:53.466800  3199 pending_rounds.cc:107] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:16:53.467588  3199 raft_consensus.cc:2889] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:53.464632  3195 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:53.472919  3164 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:53.474617  3164 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:53.435760  8283 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.468500  3196 raft_consensus.cc:2955] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:16:53.432991  8495 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:53.483400  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:53.487316  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:53.488571  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:53.454089  8515 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.428110  8496 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:53.496460  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:53.478470  8461 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.475870  8685 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.509142  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:53.476444  8644 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:53.510439  3047 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:16:53.490585  8749 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:53.484570  8555 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:53.518848  3193 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:53.519807  8685 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:53.522925  3091 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:53.526981  3046 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:16:53.527599  3046 pending_rounds.cc:85] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 10
I20260709 13:16:53.527887  3046 pending_rounds.cc:107] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:16:53.528250  3046 raft_consensus.cc:2889] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:53.493333  8283 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:53.521899  8555 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.528831  8637 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:53.505666  8515 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:53.519472  8358 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:53.540901  8495 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:53.550001  8685 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:53.522176  8461 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:53.522512  8644 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:53.555557  3164 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:53.570500  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:53.537127  8742 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:53.541915  8555 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:53.557705  3165 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:53.536870  8736 raft_consensus.cc:2243] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:53.545295  8424 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.545643  8637 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:53.571151  8685 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:53.594310  8736 pending_rounds.cc:70] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b: Trying to abort 1 pending ops.
I20260709 13:16:53.594712  8736 pending_rounds.cc:77] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting op as it isn't in flight: id { term: 12 index: 8 } timestamp: 7305637815783313408 op_type: NO_OP noop_request { }
I20260709 13:16:53.595151  8736 raft_consensus.cc:2889] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:53.595564  8736 raft_consensus.cc:2272] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:53.597869  8424 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:53.599465  8692 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:53.599977  3135 tablet_copy_service.cc:140] P f20672b2852447a6bc1e137c4dd40904: Received BeginTabletCopySession request for tablet 4b83202a913e45d5830d2ecdfb5354c2 from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:55318)
I20260709 13:16:53.600481  8424 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:53.600621  3135 tablet_copy_service.cc:161] P f20672b2852447a6bc1e137c4dd40904: Beginning new tablet copy session on tablet 4b83202a913e45d5830d2ecdfb5354c2 from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:55318: session id = e9165fe61ab04bfb9a48889156d5c161-4b83202a913e45d5830d2ecdfb5354c2
I20260709 13:16:53.601065  8637 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:53.602312  3118 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:53.602826  8096 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:53.603621  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:53.605124  8555 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:53.605695  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:53.606367  3125 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:16:53.607445  3121 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:53.608935  8555 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:53.602239  8515 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:53.637776  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:53.585696  8740 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:16:53.696409  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 123295us
I20260709 13:16:53.667199  8685 raft_consensus.cc:697] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:53.610198  8742 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 13:16:53.719422  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:53.693697  8515 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:16:53.722846  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:53.695677  8424 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.695535  8746 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:53.693917  8607 consensus_queue.cc:1059] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:16:53.724720  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:53.725396  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:53.726302  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:53.723994  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:53.704162  8716 consensus_queue.cc:1059] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:16:53.802074  8283 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:53.807822  8496 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:53.799650  3015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.003s	sys 0.011s
W20260709 13:16:53.872305  3015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.006s	sys 0.011s
W20260709 13:16:53.873066  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 577349us
I20260709 13:16:53.834340  8637 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:53.866652  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 309030us
W20260709 13:16:53.849527  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 320440us
I20260709 13:16:53.713851  8358 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:53.898274  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:53.901841  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:53.915361  3791 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:53.860867  8736 ts_tablet_manager.cc:1916] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:53.903194  3165 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:53.910913  3762 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:53.921622  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 47639.2us
I20260709 13:16:53.922478  3794 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:53.922613  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:53.864301  8424 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:53.713044  8740 raft_consensus.cc:697] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:53.923856  3050 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:16:53.921941  3165 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:53.929497  3165 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:53.933573  3165 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:53.933153  8555 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:53.951406  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:53.959551  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 263712us
I20260709 13:16:53.960716  3794 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:53.925369  8707 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:53.933373  8755 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:53.962229  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:53.962596  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:53.969696  3794 raft_consensus.cc:2368] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19.
I20260709 13:16:53.948172  8687 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:53.866930  8685 consensus_queue.cc:237] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:53.964066  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:53.971891  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:53.958899  8165 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:53.961712  8709 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:53.968587  8755 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:53.985720  8767 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:16:53.980908  8165 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.968272  8742 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:53.969030  8496 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:16:53.987497  8755 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:53.994797  8165 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:53.999094  8742 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:54.014515  8206 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:54.149441  8206 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.151335  8206 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:53.964466  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:54.028959  8424 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:54.156569  8424 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:54.157438  8424 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:54.158438  7743 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:54.159452  7743 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:54.160993  8424 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:54.118768  3117 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:16:54.161942  3117 pending_rounds.cc:85] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 12
I20260709 13:16:54.162302  3117 pending_rounds.cc:107] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:16:54.162722  3117 raft_consensus.cc:2889] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:54.114943  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:53.966035  3135 tablet_copy_source_session.cc:215] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:54.131841  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2487) took 1041 ms. Trace:
I20260709 13:16:54.169950  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:54.172916  3051 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:16:54.113029  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 190211us
I20260709 13:16:54.175604  8283 raft_consensus.cc:3055] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:54.175935  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:54.176187  8283 raft_consensus.cc:740] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:54.176765  3117 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 18. Current term is 19. Ops: []
W20260709 13:16:54.156620  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 192105us
I20260709 13:16:54.164217  3125 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:54.164994  3124 rpcz_store.cc:276] 0709 13:16:53.090608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.091293 (+   685us) service_pool.cc:224] Handling call
0709 13:16:54.131332 (+1040039us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b54000a9954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:54.131579 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14700800}
I20260709 13:16:54.183888  8358 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:54.188283  8283 consensus_queue.cc:260] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:54.189801  8424 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:54.190032  8283 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:54.190462  8424 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:54.192306  8424 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:54.187769  7743 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:54.191045  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:54.204316  8091 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:54.206025  7743 consensus_queue.cc:1059] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:16:54.208456  7743 raft_consensus.cc:3055] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:16:54.208835  7743 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:54.210903  3050 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:16:54.212282  8424 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:54.213881  3090 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:54.214939  8358 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:54.215669  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:54.218138  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:54.218483  3117 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:54.220743  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:54.219640  3120 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:54.221529  3796 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:54.222851  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:54.223693  3126 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:54.224246  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:54.224318  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:54.226009  3122 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:54.227312  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:54.228313  3122 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:54.228057  7743 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:54.229491  7743 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:54.230334  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:54.223261  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:54.231511  3123 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:16:54.234388  3121 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:16:54.046280  8717 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:54.002111  8740 consensus_queue.cc:237] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:54.030259  8742 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:54.053717  8748 raft_consensus.cc:3055] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:54.304543  8748 raft_consensus.cc:740] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:54.306265  8748 consensus_queue.cc:260] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:54.307060  8706 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:54.305286  8165 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:54.308320  8748 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:54.044480  8749 consensus_meta.cc:287] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.520s	user 0.006s	sys 0.002s
W20260709 13:16:54.073666  8765 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.086s	user 0.000s	sys 0.002s
W20260709 13:16:54.025959  8766 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:16:54.310751  8749 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:54.033622  8637 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:54.254190  3050 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
W20260709 13:16:54.286844  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 111134us
I20260709 13:16:54.313627  8745 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:54.314210  8745 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:54.314899  8745 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:54.322918  8707 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:54.324136  8751 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:54.324698  8751 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.325089  8751 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:54.326185  8742 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:54.327144  8742 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:54.301158  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:54.328056  8644 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:54.330456  8206 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:54.323787  8707 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:54.314257  3124 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:54.293995  3126 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:54.031073  8665 raft_consensus.cc:3055] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:54.034408  8633 raft_consensus.cc:3055] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:54.339848  8424 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:54.360325  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:54.370039  8633 raft_consensus.cc:740] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:54.371719  8671 raft_consensus.cc:2764] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:16:54.371628  8633 consensus_queue.cc:260] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:54.374111  8739 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.000s	sys 0.020s
I20260709 13:16:54.382079  8717 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:54.375227  8444 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.087s	user 0.001s	sys 0.001s
I20260709 13:16:54.374020  8665 raft_consensus.cc:740] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:54.380297  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:54.382344  8739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.000s	sys 0.021s
W20260709 13:16:54.380926  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 92468.3us
W20260709 13:16:54.381146  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 89844.3us
I20260709 13:16:54.379881  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:54.400359  8665 consensus_queue.cc:260] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:54.377068  8441 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:54.401878  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:54.401623  8665 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:54.391412  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:54.413030  3050 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:54.414969  3164 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:54.416792  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:54.422736  8646 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:54.423389  8707 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:54.423535  8646 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:54.428092  8768 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:54.428771  8768 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.429195  8768 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:54.431473  8691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b83202a913e45d5830d2ecdfb5354c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.432281  8496 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:54.433113  8496 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:54.435770  8496 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:54.436299  8637 consensus_queue.cc:1059] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 13:16:54.438508  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.438623  8555 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:54.445339  3042 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:16:54.373689  8633 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:54.459853  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 52610.3us
I20260709 13:16:54.462666  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:54.463492  3049 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:16:54.466216  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:54.471791  8637 raft_consensus.cc:3055] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:54.472319  8637 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:54.474568  8518 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:54.451380  8444 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:16:54.477484  8717 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:54.479022  3119 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:54.484892  8717 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:54.491070  8699 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:54.491578  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:54.492358  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:54.493814  3197 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:16:54.494689  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:54.495450  3196 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:16:54.496609  8780 consensus_queue.cc:1059] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:54.498888  8738 raft_consensus.cc:3055] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:54.499521  8738 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:54.500846  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:54.501032  8738 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:54.503751  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:54.504500  3124 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16. Ops: [12.9-15.10]
I20260709 13:16:54.492048  8699 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:54.509362  8755 consensus_meta.cc:287] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.004s
I20260709 13:16:54.504834  3164 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:54.506510  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:54.509891  8755 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:54.510442  8518 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:54.511128  8518 raft_consensus.cc:697] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:54.506172  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:54.512362  8755 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:54.512535  8518 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:54.473630  8637 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:54.514194  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:54.514942  8637 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:54.515684  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:54.516438  3193 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
I20260709 13:16:54.521096  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:54.506796  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:54.507496  3121 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:54.508195  7743 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:16:54.508533  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:54.508988  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:54.538335  3196 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
I20260709 13:16:54.538736  3796 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:16:54.536682  3164 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:54.543746  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.541149  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:54.508117  8742 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:54.505424  8165 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:54.552412  8751 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:54.552824  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:54.508319  8699 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:54.555989  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:54.556910  3121 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 17: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:54.557854  8424 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:54.558363  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:54.558612  8424 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:16:54.560050  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:54.560791  3792 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:16:54.559135  3799 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:16:54.563359  3046 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:54.547428  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:54.565897  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:54.566648  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:54.566386  8745 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:54.568959  8745 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:54.569068  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:54.569985  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:54.571013  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:54.571360  8739 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:54.572319  8739 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:54.522877  8496 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:54.573588  8496 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:54.574618  8788 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:54.575554  8699 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:54.576032  8699 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.576200  8496 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:54.576460  8699 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:54.572736  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:54.577252  8739 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:54.577754  3191 raft_consensus.cc:2368] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16.
I20260709 13:16:54.578289  8461 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:54.579903  8751 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:54.582765  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 47383.2us
I20260709 13:16:54.586728  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:54.596836  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:54.586513  8646 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:54.613983  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:54.615015  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:54.593317  8496 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:54.621109  7743 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:54.623713  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:54.624241  3121 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:54.619738  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:54.621759  3049 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:54.620622  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:54.612494  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:54.628777  3118 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:54.627717  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:54.618248  8444 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.052s	user 0.003s	sys 0.001s
I20260709 13:16:54.575435  8788 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:16:54.656908  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 70269.6us
I20260709 13:16:54.657245  3197 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17. Ops: []
W20260709 13:16:54.659412  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.662371  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:54.663923  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:54.665854  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:54.669929  7743 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:54.672222  3050 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:16:54.673182  8738 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:54.676369  8424 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:54.683300  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:54.688925  3193 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:54.691622  8788 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:54.695523  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:16:54.698060  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 43978.8us
I20260709 13:16:54.680141  3120 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:54.704605  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:54.705278  7743 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:54.627943  8755 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:54.709033  3117 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:54.712143  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:54.719077  3200 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
W20260709 13:16:54.726153  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 205237us
I20260709 13:16:54.727923  3090 leader_election.cc:400] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19.
I20260709 13:16:54.729578  3090 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:54.714175  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:54.730696  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:54.732378  3050 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:16:54.733455  8745 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:54.751106  3046 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:54.751382  8745 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:54.752137  8745 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:54.752274  3118 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:54.756093  3091 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:54.756615  8358 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:54.734012  8742 consensus_queue.cc:1059] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:54.758199  8742 raft_consensus.cc:3055] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:54.758749  8742 raft_consensus.cc:740] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:54.734694  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:54.735044  8707 consensus_queue.cc:1059] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:54.761210  8707 raft_consensus.cc:3055] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:54.760286  8742 consensus_queue.cc:260] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:54.738183  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:54.738572  8633 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:54.739594  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:54.739845  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:54.746722  8699 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:54.750723  8424 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:54.610858  8768 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:54.709879  3015 connection.cc:256] RPC call timeout handler was delayed by -3.0203027479999491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 13:16:54.774855  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 45438.9us
W20260709 13:16:54.775687  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.767467  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:54.778496  3015 connection.cc:256] RPC call timeout handler was delayed by -2.9375027479998153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
I20260709 13:16:54.777580  3762 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:16:54.786535  3015 connection.cc:256] RPC call timeout handler was delayed by -2.9069027479999932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
W20260709 13:16:54.787166  3015 connection.cc:256] RPC call timeout handler was delayed by -2.8223027479998564s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
W20260709 13:16:54.787703  3015 connection.cc:256] RPC call timeout handler was delayed by -2.5019027479997931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2098s for a response
I20260709 13:16:54.788889  3790 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:16:54.788295  3015 connection.cc:256] RPC call timeout handler was delayed by -1.4471027479999066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.327s for a response
W20260709 13:16:54.790135  3015 connection.cc:256] RPC call timeout handler was delayed by -1.3941609019998396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 13:16:54.790729  3015 connection.cc:256] RPC call timeout handler was delayed by -1.2159609019997788s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2242s for a response
I20260709 13:16:54.792268  3199 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:54.728008  3796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12725e4e41614e1292b974e17635f758"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:54.796018  3796 raft_consensus.cc:606] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:54.761853  8707 raft_consensus.cc:740] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:54.798137  8686 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:54.798622  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:54.798715  8707 consensus_queue.cc:260] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:54.800364  8707 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:54.777176  8358 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:54.803697  8768 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:54.805660  8444 tablet_bootstrap.cc:492] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:54.811378  3195 raft_consensus.cc:1240] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:54.812861  3790 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:16:54.813498  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:54.835201  3122 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 17: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:54.833184  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:54.807422  8444 tablet_bootstrap.cc:492] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
W20260709 13:16:54.844053  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 70231.1us
I20260709 13:16:54.833225  3118 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17. Ops: [14.9-16.10]
W20260709 13:16:54.855551  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.810375  8742 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:54.861582  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:54.865959  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:54.865613  3794 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:54.855553  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:54.852008  8283 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:16:54.920045  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 71186us
I20260709 13:16:54.809576  8745 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:54.882975  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:54.934473  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:54.851823  8644 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.954448  3122 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:54.946991  3049 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:16:54.942090  8748 consensus_meta.cc:287] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.633s	user 0.006s	sys 0.009s
I20260709 13:16:54.934013  8283 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.988548  3790 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:16:54.998432  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:55.015102  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 161245us
I20260709 13:16:55.020500  8692 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:54.985545  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:55.029400  3045 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:16:55.033679  8780 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:55.034085  8685 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:55.034605  8780 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:55.040237  3119 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:55.021356  8692 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:55.046826  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:55.012032  8283 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:55.051653  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:55.053278  8736 ts_tablet_manager.cc:1929] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.8
W20260709 13:16:55.054900  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.055478  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:55.028517  8751 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:55.034821  8557 consensus_queue.cc:1059] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.157s
I20260709 13:16:55.094676  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:55.058090  8685 raft_consensus.cc:697] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:55.068035  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:55.068958  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:55.069960  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:55.070914  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:55.072975  8692 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:55.033845  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.076129  8745 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:55.077015  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:55.078439  3795 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:55.054900  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:55.050561  8555 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:55.082584  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:55.083173  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:55.085867  8753 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:55.093582  3119 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:16:55.102861  3194 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:55.104312  3196 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:55.095885  3791 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:16:55.049932  8444 ts_tablet_manager.cc:1403] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 2.956s	user 0.047s	sys 0.033s
I20260709 13:16:55.087435  8739 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:55.122843  8746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.062s	sys 0.082s
I20260709 13:16:55.114619  3197 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:16:55.111444  8736 log.cc:1199] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P 501fdf2af2bc4b0c971ae880e98f466b: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-2-root/wals/0ee6c4dbcb7b45729d4e2bdcc3a09297
I20260709 13:16:55.151129  8736 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60578 (request call id 0) took 2384 ms. Trace:
I20260709 13:16:55.086629  8644 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:55.151840  8780 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:55.152647  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:16:55.185019  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 167582us
I20260709 13:16:55.198235  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:55.208515  3761 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:55.234411  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:55.242794  3192 raft_consensus.cc:2410] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 20 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:16:55.254106  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:55.190235  8739 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:55.246483  8691 consensus_meta.cc:287] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.545s	user 0.013s	sys 0.000s
I20260709 13:16:55.298377  3797 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:16:55.306121  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:55.342830  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:55.345521  3794 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:55.257468  8751 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.257094  8165 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:55.205772  8555 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:16:55.257054  8788 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:55.361977  3046 consensus_meta.cc:287] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.610s	user 0.012s	sys 0.000s
I20260709 13:16:55.368301  3046 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:16:55.343762  8557 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:55.377108  8808 log.cc:927] Time spent T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
W20260709 13:16:55.378353  8797 log.cc:927] Time spent T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 13:16:55.380227  8798 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 13:16:55.381661  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 150062us
I20260709 13:16:55.383427  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:55.384624  8810 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:55.397540  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.237388  8685 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:55.151619  8736 rpcz_store.cc:276] 0709 13:16:52.795993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.837075 (+ 41082us) service_pool.cc:224] Handling call
0709 13:16:53.068579 (+231504us) ts_tablet_manager.cc:1151] Deleting tablet 0ee6c4dbcb7b45729d4e2bdcc3a09297
0709 13:16:53.068793 (+   214us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:16:54.552595 (+1483802us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:54.959853 (+407258us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:55.150968 (+191115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":381957,"tablet-delete.queue_time_us":180550,"thread_start_us":83230,"threads_started":1}
I20260709 13:16:55.371065  8699 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:55.445688  3200 pending_rounds.cc:85] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 8
I20260709 13:16:55.451793  3200 pending_rounds.cc:107] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:16:55.365406  8165 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:55.452176  3200 raft_consensus.cc:2889] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:55.402621  8751 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:55.464838  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 81547.4us
W20260709 13:16:55.468688  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 312387us
I20260709 13:16:55.467456  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:55.453176  8788 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:55.472321  8358 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:55.472958  8358 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:16:55.474399  8803 log.cc:927] Time spent T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:16:55.479194  8751 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:55.479957  8691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:43908 (request call id 723) took 3379 ms. Trace:
W20260709 13:16:55.480857  8742 consensus_meta.cc:287] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.602s	user 0.001s	sys 0.008s
I20260709 13:16:55.482004  8644 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:55.486783  8555 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:55.487603  8707 consensus_meta.cc:287] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.687s	user 0.003s	sys 0.008s
I20260709 13:16:55.491101  8788 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:55.496552  3792 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:16:55.498370  3049 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:16:55.500862  3194 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:55.499989  3197 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:55.505530  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:55.491101  8165 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:55.520228  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:55.520562  3117 consensus_meta.cc:287] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.743s	user 0.011s	sys 0.000s
I20260709 13:16:55.520936  3117 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:16:55.480394  8691 rpcz_store.cc:276] 0709 13:16:52.101126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.101237 (+   111us) service_pool.cc:224] Handling call
0709 13:16:52.524152 (+422915us) ts_tablet_manager.cc:934] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
0709 13:16:54.292383 (+1768231us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:16:54.695384 (+403001us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:54.695510 (+   126us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:16:55.347610 (+652100us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:16:55.405247 (+ 57637us) tablet_replica.cc:206] Creating consensus instance
0709 13:16:55.466887 (+ 61640us) ts_tablet_manager.cc:989] Replica registered.
0709 13:16:55.479854 (+ 12967us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":300,"tablet-copy.queue_time_us":381142,"thread_start_us":276813,"threads_started":2}
I20260709 13:16:55.524895  8812 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:55.525637  8691 tablet_copy_client.cc:806] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
W20260709 13:16:55.534446  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 64070.7us
I20260709 13:16:55.534785  8691 tablet_copy_client.cc:670] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:55.524950  8739 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:55.535643  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:55.539803  8444 raft_consensus.cc:359] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:16:55.540987  8444 raft_consensus.cc:740] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
W20260709 13:16:55.548202  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.527580  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2503) took 1302 ms. Trace:
I20260709 13:16:55.549669  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:55.550554  3793 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:55.553228  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:55.561414  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 56646.2us
I20260709 13:16:55.549777  8206 raft_consensus.cc:3055] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:55.543645  8739 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:55.567067  3194 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:55.574414  3793 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:55.569645  3195 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:16:55.586513  3090 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:55.589320  8637 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:55.589401  8730 consensus_queue.cc:1059] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:55.589282  8566 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:55.590883  8566 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:55.525815  8812 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:55.595301  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:55.595384  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2311) took 1061 ms. Trace:
I20260709 13:16:55.597148  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:55.589424  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 552121us
I20260709 13:16:55.548913  3123 rpcz_store.cc:276] 0709 13:16:54.224943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.232266 (+  7323us) service_pool.cc:224] Handling call
0709 13:16:54.232652 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:54.233283 (+   631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.233318 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:54.234167 (+   849us) log.cc:844] Serialized 26 byte log entry
0709 13:16:54.533398 (+299231us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:54.533473 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.533578 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:55.527327 (+993749us) raft_consensus.cc:1685] finished
0709 13:16:55.527351 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.527493 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62870,"raft.queue_time_us":18948,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":35756,"thread_start_us":298684,"threads_started":1,"wal-append.queue_time_us":1233076}
I20260709 13:16:55.605195  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:55.568647  8206 raft_consensus.cc:740] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:55.609490  8730 raft_consensus.cc:3055] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:16:55.630324  3119 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:16:55.610244  3126 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:16:55.551429  8444 consensus_queue.cc:260] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:16:55.614574  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:55.617404  8630 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.620339  8566 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:55.652000  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:55.651535  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:16:55.691732  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.693374  3125 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 17: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:55.655794  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:55.597898  8739 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 14 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:55.579324  8283 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:55.695747  3193 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:55.598434  3124 rpcz_store.cc:276] 0709 13:16:54.533610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.551126 (+ 17516us) service_pool.cc:224] Handling call
0709 13:16:54.567783 (+ 16657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.568196 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:54.568562 (+   366us) log.cc:844] Serialized 14 byte log entry
0709 13:16:54.887655 (+319093us) log.cc:844] Serialized 14 byte log entry
0709 13:16:55.585403 (+697748us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b1800387820. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d240c0a 00007ff836980219 00007ff82d2c8a40 00007ff82d2c34e4 00007ff82d2c3455 00007ff8303ab060 00007ff8303bd716 00007ff8303ce287 00007ff8303ce208
0709 13:16:55.585624 (+   221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:55.585701 (+    77us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:55.595145 (+  9444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.595218 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.595328 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90280,"prepare.queue_time_us":1030,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":81,"raft.queue_time_us":775355,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":11656,"spinlock_wait_cycles":30705408,"thread_start_us":276026,"threads_started":1,"wal-append.queue_time_us":404582}
I20260709 13:16:55.702950  8283 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:55.704361  3799 raft_consensus.cc:2393] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:16:55.706019  8740 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.706700  8740 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:55.709028  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 146484us
I20260709 13:16:55.699889  8739 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:55.697232  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:55.713464  3761 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:55.715106  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:55.717409  3120 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:55.705549  8780 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:55.731949  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 178470us
I20260709 13:16:55.727623  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:55.629983  8730 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:55.654543  8751 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:55.734717  3124 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:55.693498  8165 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:16:55.742307  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:55.742209  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:55.738427  3762 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:55.763204  3117 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
W20260709 13:16:55.773358  8804 log.cc:927] Time spent T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.197s	user 0.005s	sys 0.000s
I20260709 13:16:55.774731  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:55.774344  8730 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:55.775910  8730 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:55.778453  3799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:55.779150  3799 raft_consensus.cc:606] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:55.785017  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.743239  8816 raft_consensus.cc:2764] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:16:55.813184  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:55.813903  3793 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:55.752722  8461 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:55.716866  8630 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:55.817209  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:55.760399  8809 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:55.824678  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:55.742931  8751 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:55.743654  8780 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:55.828442  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 67130.4us
I20260709 13:16:55.834582  3044 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:16:55.875270  8206 consensus_queue.cc:260] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:55.880178  8206 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:55.838666  8630 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:55.838557  3165 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:55.884130  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 133215us
I20260709 13:16:55.885447  8699 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:55.840315  8822 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:55.849860  8788 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:55.854133  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:55.855114  8746 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:16:55.864259  8817 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:16:55.835400  8461 raft_consensus.cc:697] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:55.867385  8496 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:55.871855  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47488 (request call id 1042) took 1282 ms. Trace:
I20260709 13:16:55.874155  3118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:16:55.898867  3118 raft_consensus.cc:606] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:55.899382  3118 raft_consensus.cc:614] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:55.839543  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:55.885219  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:55.886153  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 56827.1us
I20260709 13:16:55.898077  3045 rpcz_store.cc:276] 0709 13:16:54.589797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.595933 (+  6136us) service_pool.cc:224] Handling call
0709 13:16:55.871639 (+1275706us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b54001f6b54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:55.871761 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":931101952}
I20260709 13:16:55.875351  8444 ts_tablet_manager.cc:1434] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.750s	user 0.006s	sys 0.005s
I20260709 13:16:55.896466  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:55.904848  3120 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:55.915673  3090 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:55.896963  8810 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.894075  8665 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:55.809448  8820 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.139s
I20260709 13:16:55.920887  8740 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:55.921615  8740 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:55.921238  8461 consensus_queue.cc:237] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:55.922161  8740 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:55.922315  3165 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:55.923202  8740 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:55.894748  8822 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:55.926040  8707 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:55.927901  8822 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:55.902240  8444 ts_tablet_manager.cc:1467] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Tablet startup took 785ms
W20260709 13:16:55.928136  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.914361  8630 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:55.914918  8812 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:55.912899  8753 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:55.993284  8753 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:55.994179  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:55.994927  3118 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:55.895387  8788 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:55.999537  8788 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:55.938184  8810 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.001804  3164 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:56.002070  8690 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.002637  8690 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.002972  3164 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:56.003791  8810 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:56.004701  8690 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:55.908176  8496 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.006400  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:56.007112  8496 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:56.007270  3193 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:55.955689  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:55.956786  8283 raft_consensus.cc:993] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: : Instructing follower aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:16:55.957013  8780 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:55.957527  8633 raft_consensus.cc:993] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: : Instructing follower aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:16:55.958300  8751 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:55.960088  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:55.962000  3165 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:55.962134  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:55.962604  8686 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:55.962787  8637 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:16:55.928645  8444 ts_tablet_manager.cc:1469] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Trace:
0709 13:16:45.803157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.813857 (+ 10700us) service_pool.cc:224] Handling call
0709 13:16:45.985970 (+172113us) ts_tablet_manager.cc:934] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
0709 13:16:46.595779 (+609809us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82d2a90ac 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c2caa 00007ff82d2c2bd2 00007ff835327131
0709 13:16:48.356251 (+1760472us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:16:48.923745 (+567494us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:48.923875 (+   130us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:16:48.989351 (+ 65476us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:16:48.989668 (+   317us) tablet_replica.cc:206] Creating consensus instance
0709 13:16:49.045993 (+ 56325us) ts_tablet_manager.cc:989] Replica registered.
0709 13:16:49.046147 (+   154us) inbound_call.cc:177] Queueing success response
0709 13:16:50.038258 (+992111us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b4c000efa40. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82e67fa20 00007ff82e690a29 00007ff82e69113f 00007ff82e6552ab 00007ff82e682f3c 00007ff82e683461 00007ff82e683768 00007ff83440966b 00007ff83534615b 00007ff835345f98 00007ff835337322
0709 13:16:52.074331 (+2036073us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:16:55.130833 (+3056502us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:16:55.307818 (+176985us) tablet_replica.cc:261] Starting instrumentation
0709 13:16:55.308473 (+   655us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":226,"mutex_wait_us":5564,"raft.queue_time_us":61907,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":17174,"spinlock_wait_cycles":55777920,"tablet-copy.queue_time_us":127335,"tablet-download-pool.queue_time_us":6155,"tablet-download-pool.run_cpu_time_us":7976,"tablet-download-pool.run_wall_time_us":2010402,"thread_start_us":923619,"threads_started":2}
I20260709 13:16:56.025045  3200 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:55.983901  8630 raft_consensus.cc:697] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:55.988085  8811 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:55.990787  8717 raft_consensus.cc:3055] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:56.032161  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:56.014397  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 196277us
I20260709 13:16:56.014439  3199 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
W20260709 13:16:56.022431  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 146598us
W20260709 13:16:56.026163  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.027176  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:56.036440  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 74549.3us
I20260709 13:16:56.037272  3046 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:16:56.038771  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:56.026970  8633 raft_consensus.cc:1081] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Signalling peer aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:16:56.080451  3792 raft_consensus.cc:2410] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:16:56.045954  3126 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:16:56.082656  8358 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.609s	user 0.009s	sys 0.002s
I20260709 13:16:56.083141  8358 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:56.028808  8751 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:56.085371  8751 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:55.951385  8665 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:56.087543  8751 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:56.046900  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:56.040411  8637 raft_consensus.cc:697] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:56.047740  8769 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:56.048965  3762 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:56.049388  3165 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:56.031379  8717 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:56.041085  8644 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:16:56.062032  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 149817us
I20260709 13:16:56.066277  8630 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:56.067392  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:56.100922  3117 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:16:56.069298  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:56.045080  8165 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.025599  8742 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:56.025449  8441 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 13:16:56.089397  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 63505.8us
I20260709 13:16:56.028960  8822 raft_consensus.cc:1081] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Signalling peer aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:16:56.088744  3118 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:16:56.091801  3193 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
W20260709 13:16:56.088961  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 54127.3us
I20260709 13:16:56.056680  3796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
W20260709 13:16:56.093816  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 44978.6us
I20260709 13:16:56.087561  8665 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:56.035539  3761 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:56.096065  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 46758.1us
I20260709 13:16:56.096752  8780 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:56.096459  8717 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:56.097266  8769 raft_consensus.cc:697] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:56.097414  8637 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:56.037228  8811 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.102437  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:56.106667  3796 raft_consensus.cc:606] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:56.092561  8751 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:56.107796  3091 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:56.095125  8644 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:56.112176  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 76720.3us
I20260709 13:16:56.113396  8283 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:56.114413  3048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:47488
I20260709 13:16:56.105132  8742 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.122388  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:56.105404  8633 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:56.127979  3047 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12725e4e41614e1292b974e17635f758"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:47488
I20260709 13:16:56.136585  3047 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:56.137006  3047 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:56.128290  3048 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:56.137621  3048 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:56.114842  3165 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:56.135492  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:56.138864  8283 raft_consensus.cc:697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 17 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:56.128683  8644 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:56.108837  8165 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:56.152381  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:56.133431  8742 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:56.131701  8496 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:56.131080  8690 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:56.169965  8690 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.170538  8690 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:56.170042  8283 consensus_queue.cc:237] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:56.130604  8820 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:56.160392  8555 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.175782  8820 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:56.176126  8555 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.136389  8633 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.178184  8769 consensus_queue.cc:237] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:56.180155  3047 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:56.180629  8496 raft_consensus.cc:697] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:56.181613  8496 consensus_queue.cc:237] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:56.182387  3047 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:56.184556  8811 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:56.186784  8165 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:56.124799  8751 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:16:56.161612  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.188344  8751 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:56.192387  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.178189  8633 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:56.158864  8730 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.194660  8730 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.196776  8730 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:56.197382  8555 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:56.198371  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46053.7us
I20260709 13:16:56.199645  3015 leader_election.cc:400] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16.
I20260709 13:16:56.199970  3015 leader_election.cc:403] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:56.202098  8834 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16.
I20260709 13:16:56.151464  8691 tablet_copy_client.cc:538] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:56.151486  8461 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:56.159052  8699 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:56.167409  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 52653us
I20260709 13:16:56.158844  8717 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:56.207439  3165 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:56.208500  8461 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:56.209757  3165 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:56.120115  8753 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:56.198472  8665 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:56.220896  3122 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:56.160926  8358 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:56.225767  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:56.228451  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:56.229130  8753 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:56.229450  3117 raft_consensus.cc:2410] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:16:56.232438  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:56.233294  3792 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:56.235451  8834 consensus_queue.cc:1059] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:56.235626  2943 catalog_manager.cc:5697] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:56.236640  8834 raft_consensus.cc:3055] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:56.237154  8834 raft_consensus.cc:740] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:56.243048  8811 consensus_queue.cc:1059] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:56.244048  8811 consensus_queue.cc:1243] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:56.244673  8811 raft_consensus.cc:3055] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:16:56.244966  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.245028  8811 raft_consensus.cc:740] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:56.247128  8165 consensus_queue.cc:1059] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:56.246955  8811 consensus_queue.cc:260] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.248600  8811 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:56.254237  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 44594.3us
W20260709 13:16:56.258735  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 128853us
I20260709 13:16:56.255647  3048 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:56.262779  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:56.263738  3051 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
W20260709 13:16:56.261029  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 47136.5us
I20260709 13:16:56.267304  3762 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:56.269523  8815 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:56.270408  3792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:56.270272  8834 consensus_queue.cc:260] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.271277  3164 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:56.271576  8834 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:56.273937  8441 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:56.274219  8751 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.274708  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:56.275316  3047 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:16:56.276403  8751 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:56.278187  8815 raft_consensus.cc:993] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: : Instructing follower aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:16:56.270996  3792 raft_consensus.cc:606] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Received request to transfer leadership to TS 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:56.312188  3792 raft_consensus.cc:614] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:56.281945  8820 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:56.260743  8780 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:56.261997  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:56.290616  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:56.294322  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:56.301896  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:16:56.316782  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 54843.1us
I20260709 13:16:56.252398  2943 catalog_manager.cc:5697] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 9 to 8, leader changed from <none> to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 8 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:56.310755  3048 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:56.318668  3091 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:56.281368  8690 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.316792  3045 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:56.324540  3126 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:16:56.318483  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:56.325805  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:56.326546  3042 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:56.327580  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:56.328418  3117 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:56.274386  8441 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.321259  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:56.324819  8665 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:56.331071  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:56.332255  8815 raft_consensus.cc:1081] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Signalling peer aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:16:56.322158  8811 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:56.333897  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:56.337046  3123 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:16:56.338255  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:56.349694  3091 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:56.350369  3792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:56.351806  3792 raft_consensus.cc:606] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:56.352133  3792 raft_consensus.cc:614] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:56.353592  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:56.353987  3121 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:16:56.336397  8441 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:56.336621  8665 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.337702  8812 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:56.362217  8107 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:56.362816  2934 catalog_manager.cc:5028] TS 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): tablet 0ee6c4dbcb7b45729d4e2bdcc3a09297 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:16:56.362792  8107 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.322248  8633 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:56.364614  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:56.373062  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:16:56.375506  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.360493  8751 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:16:56.362891  8841 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:56.382005  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:56.382879  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:56.387609  3046 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:16:56.383450  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:56.384908  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:56.391913  3049 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:56.361343  8665 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:56.383446  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:56.395900  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:56.348461  8811 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.398671  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:56.403927  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 54320.4us
I20260709 13:16:56.405984  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:56.395506  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:56.412258  3042 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:16:56.412825  3199 raft_consensus.cc:2410] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:16:56.413439  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.415413  3197 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:16:56.415735  8107 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:56.416599  8835 consensus_queue.cc:1059] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:16:56.417505  8835 raft_consensus.cc:3055] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:56.417892  8835 raft_consensus.cc:740] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:56.418711  3047 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:56.372931  8812 raft_consensus.cc:697] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:56.358718  8742 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.386844  8730 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:56.388830  8841 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:56.438568  3091 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:56.412166  8753 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.420847  8690 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:56.461350  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:56.430877  8820 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:56.468129  3051 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:47488
I20260709 13:16:56.468750  3051 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:56.469168  3051 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:16:56.460072  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 77914us
I20260709 13:16:56.478196  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:56.465382  8820 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:56.481555  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:56.447046  8841 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:56.455080  8730 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.534448  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:56.418748  8835 consensus_queue.cc:260] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.537720  8850 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:56.531411  3210 tablet_copy_service.cc:342] P 501fdf2af2bc4b0c971ae880e98f466b: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-1e1474206f8d49e58df15541f5a5725e received from {username='slave'} at 127.0.0.1:34728
I20260709 13:16:56.544591  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:56.544986  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 83704.8us
I20260709 13:16:56.549582  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:56.551743  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:56.465989  8753 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.531018  8820 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:56.561731  3165 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:56.555639  3123 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:16:56.566303  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:56.569844  3193 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:16:56.559778  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:56.567454  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:56.572237  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:56.573489  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:56.581102  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 124738us
I20260709 13:16:56.467945  8739 consensus_queue.cc:1059] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 13.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:16:56.528787  8810 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:56.586069  7743 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.528674  8851 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:56.605125  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:56.605183  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:56.600239  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:56.609184  7743 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:56.609850  3200 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:16:56.600257  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:56.610960  3198 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:56.586964  3164 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:56.587740  3044 raft_consensus.cc:2410] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:16:56.560503  2934 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet fcf5db67d30f487d873766886c2ef408 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:16:56.613842  2934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 53428.5us
I20260709 13:16:56.594134  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:56.615168  3761 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:56.620639  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 186086us
I20260709 13:16:56.592665  8842 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:16:56.635244  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.591854  8165 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:56.625830  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:56.600155  8851 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.614183  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:56.618531  3210 tablet_copy_service.cc:434] P 501fdf2af2bc4b0c971ae880e98f466b: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-1e1474206f8d49e58df15541f5a5725e on tablet 1e1474206f8d49e58df15541f5a5725e with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:56.638455  8835 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:56.639385  8842 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.591959  8850 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.648226  8811 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:56.638768  8847 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:56.658313  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 44253.7us
I20260709 13:16:56.665759  3164 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:56.643090  8851 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:56.650794  8740 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:56.645084  8834 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:16:56.657819  2945 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57750 (request call id 229) took 43660 ms (client timeout 15000 ms). Trace:
I20260709 13:16:56.666749  7743 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:56.583866  8812 consensus_queue.cc:237] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:56.665885  3090 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:56.646076  8833 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:56.626730  8849 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:56.658039  8781 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:56.663089  8555 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:16:56.676597  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.642560  8769 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:16:56.659394  8815 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:56.735261  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 68622.3us
W20260709 13:16:56.737542  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 175918us
I20260709 13:16:56.739485  3165 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:56.741005  3165 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:56.663823  8842 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:16:56.735859  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 186393us
I20260709 13:16:56.676060  8740 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:56.707895  8843 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 13:16:56.705411  8849 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:56.753518  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:56.754191  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 139131us
I20260709 13:16:56.739996  8862 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:56.675259  8742 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:56.739871  8769 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:16:56.763832  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:56.768481  3117 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:16:56.752229  8691 tablet_bootstrap.cc:492] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
I20260709 13:16:56.744805  8740 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:56.713255  8781 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:56.751685  8630 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:56.758203  8862 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:56.765893  8844 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 13:16:56.758579  8831 raft_consensus.cc:3055] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:16:56.784766  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 126253us
I20260709 13:16:56.766227  8730 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:56.756260  8849 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:56.763355  8555 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:56.751964  8690 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:56.787961  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.675101  2943 catalog_manager.cc:5697] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:56.772500  3051 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:56.796264  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:56.798382  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:56.810719  3125 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:56.815231  3122 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:56.780766  8811 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:56.803402  3120 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:16:56.817621  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:56.780342  8859 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:56.804631  8441 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:56.822435  8845 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:16:56.822634  8690 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.822989  2943 catalog_manager.cc:5697] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 14 to 17, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 17 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:56.824590  3051 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:56.826306  8858 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:56.826118  8851 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:56.827334  8855 log.cc:927] Time spent T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:16:56.835704  8751 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:56.797644  8862 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:16:56.882431  8644 consensus_meta.cc:287] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.658s	user 0.010s	sys 0.000s
I20260709 13:16:56.882918  8644 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.885090  8644 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:56.797406  8831 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:56.887588  8831 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:56.889183  8831 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:56.889958  8811 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:16:56.891125  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 92822.9us
I20260709 13:16:56.891835  8781 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:56.705788  8847 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.892277  3090 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:56.894487  8847 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:56.895232  2943 catalog_manager.cc:5697] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:56.895936  8847 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:56.896476  8847 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.806694  8753 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:56.805958  8850 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:56.869127  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 110244us
I20260709 13:16:56.893533  3090 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:56.788410  8742 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:16:56.817149  8856 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.904429  3122 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:16:56.873531  3198 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:16:56.880214  8851 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:56.868358  8730 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:56.902570  3124 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:16:56.893596  8690 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:56.812431  8864 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:16:56.902981  3191 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 14: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:16:56.907707  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 79191.3us
I20260709 13:16:56.896958  2943 catalog_manager.cc:5697] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 10 to 15, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 15 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.908740  8358 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:56.909611  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:56.675467  2945 rpcz_store.cc:269] 0709 13:16:12.798453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.803095 (+  4642us) service_pool.cc:224] Handling call
0709 13:16:56.446962 (+43643867us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:53.186568 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:53.290001 (+103433us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:53.291198 (+  1197us) write_op.cc:435] Acquired schema lock
0709 13:16:53.292495 (+  1297us) tablet.cc:662] Decoding operations
0709 13:16:53.418472 (+125977us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:53.418541 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:53.418571 (+    30us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:16:53.419447 (+   876us) tablet.cc:701] Row locks acquired
0709 13:16:53.419466 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:16:53.419627 (+   161us) write_op.cc:270] Start()
0709 13:16:53.419768 (+   141us) write_op.cc:276] Timestamp: P: 1783603013419583 usec, L: 0
0709 13:16:53.419795 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:16:53.494868 (+ 75073us) log.cc:844] Serialized 4083 byte log entry
0709 13:16:54.046976 (+552108us) op_driver.cc:464] REPLICATION: finished
0709 13:16:54.065377 (+ 18401us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b54000d98d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303aee28 00007ff833de9581 00007ff833de8d58 00007ff833ded9f1 00007ff833ded9a9 00007ff833ded939 00007ff833ded901 00007ff833decb2d 000000000038f354 000000000038f199
0709 13:16:54.071191 (+  5814us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b180030bf80. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c6522 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:16:54.076233 (+  5042us) write_op.cc:301] APPLY: starting
0709 13:16:54.076367 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:54.448209 (+371842us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:54.480460 (+ 32251us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:54.572374 (+ 91914us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:54.572767 (+   393us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 13:16:54.572861 (+    94us) write_op.cc:312] APPLY: finished
0709 13:16:54.573491 (+   630us) log.cc:844] Serialized 97 byte log entry
0709 13:16:54.608983 (+ 35492us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:54.666612 (+ 57629us) write_op.cc:454] Released schema lock
0709 13:16:54.666696 (+    84us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:54.667422 (+   726us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:54.667480 (+    58us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26691,"reported_tablets":51,"spinlock_wait_cycles":18176,"child_traces":[["op",{"apply.queue_time_us":28850,"apply.run_cpu_time_us":21121,"apply.run_wall_time_us":591083,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45947,"num_ops":10,"prepare.queue_time_us":120742,"prepare.run_cpu_time_us":25196,"prepare.run_wall_time_us":918642,"raft.queue_time_us":256568,"raft.run_cpu_time_us":8213,"raft.run_wall_time_us":46967,"replication_time_us":616394,"spinlock_wait_cycles":16970368,"thread_start_us":401739,"threads_started":4,"wal-append.queue_time_us":227910,"wal-append.run_cpu_time_us":29022,"wal-append.run_wall_time_us":1842156}]]}
I20260709 13:16:56.915614  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:56.916054  3761 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:56.917695  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:56.904484  8742 consensus_queue.cc:1243] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:56.923712  3090 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:56.925585  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:56.870325  8842 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:56.921168  8751 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:16:56.909626  8856 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:56.988098  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:56.994068  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 68534.9us
W20260709 13:16:56.994596  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 70944.3us
I20260709 13:16:56.995332  3090 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:56.896970  8847 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:56.925299  8165 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:56.997428  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:57.000259  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:56.996779  8555 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:57.001024  3120 raft_consensus.cc:2393] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:57.001286  8555 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:57.003571  8555 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:57.004870  3198 raft_consensus.cc:2410] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:16:56.998826  3792 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:57.005817  8730 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:56.990005  8739 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:57.008730  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:57.007884  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:56.993594  8665 consensus_meta.cc:287] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.000s
I20260709 13:16:57.011376  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:56.992630  8751 consensus_queue.cc:1243] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:57.008499  8730 raft_consensus.cc:697] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:57.017024  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:57.020691  3120 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:16:57.012589  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:57.018005  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:56.996004  8358 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:57.014884  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:57.021982  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:57.017000  8858 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:57.026145  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:57.026759  3791 raft_consensus.cc:3055] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:57.025522  3793 raft_consensus.cc:3055] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:57.028174  3793 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:57.028293  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:57.028906  3122 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:57.028913  3792 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:57.030628  8834 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:57.031104  8834 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:57.032358  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:57.032958  3790 raft_consensus.cc:3055] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:57.033257  3790 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:57.027050  3791 raft_consensus.cc:740] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:57.046924  3090 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:57.022898  3015 connection.cc:256] RPC call timeout handler was delayed by -1.1415886870001941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
I20260709 13:16:56.992055  8690 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:57.013273  8165 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:57.044981  3790 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:57.048797  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:57.011410  8739 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:57.048760  3791 consensus_queue.cc:260] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:57.059283  8870 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:57.060048  3791 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:57.060182  8842 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:57.024127  8496 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:57.078800  8717 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:57.079982  8868 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.081056  8441 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:57.080674  8868 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:57.082046  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:57.080166  3125 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:16:57.086215  8730 consensus_queue.cc:237] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.087028  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:57.087870  3791 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
W20260709 13:16:57.068910  8841 consensus_meta.cc:287] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.001s
I20260709 13:16:57.089596  3120 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:57.020720  8665 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.103438  3122 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:16:57.070024  8739 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:57.087615  8707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.010s	sys 0.011s
W20260709 13:16:57.111863  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 65018.5us
I20260709 13:16:57.116202  8871 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:57.118445  8847 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.139751  3048 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:16:57.128070  8707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.010s	sys 0.012s
I20260709 13:16:57.127245  8496 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:57.147614  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.134733  8755 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:57.165902  8822 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.165685  3793 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:57.166409  8822 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:57.167502  3796 raft_consensus.cc:1217] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.8->[16.9-16.9]   Dedup: 16.9->[]
I20260709 13:16:57.107851  8841 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:57.179925  8853 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.539s	user 0.000s	sys 0.007s
I20260709 13:16:57.180312  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:57.180923  3191 raft_consensus.cc:2376] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14. Re-sending same reply.
I20260709 13:16:57.182155  8665 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:57.183451  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:16:57.184674  8835 consensus_meta.cc:287] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.520s	user 0.007s	sys 0.002s
I20260709 13:16:57.186566  3799 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:57.188530  3796 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:16:57.191195  8868 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:57.151986  8496 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:57.152835  2943 catalog_manager.cc:5697] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:57.195262  2943 catalog_manager.cc:5697] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:57.197109  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:57.198457  8873 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:57.199211  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:57.199095  8873 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.153007  8165 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:57.201303  8873 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:16:57.202327  3193 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:57.202469  3795 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:57.198608  3197 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:57.203589  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:57.204710  3798 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:57.199265  3195 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:57.153126  8755 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.208945  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:57.209904  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:57.210270  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:57.210543  3193 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:57.210932  3198 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:16:57.209964  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:57.214737  3195 raft_consensus.cc:2393] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:57.219976  3193 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
I20260709 13:16:57.222131  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:57.223335  8441 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:57.224050  3051 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:16:57.224140  8555 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:57.224895  8441 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:57.226159  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:57.226917  3798 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:16:57.226267  8866 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:57.227459  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:57.227773  8866 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.228585  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:57.230170  8866 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:57.230636  8810 raft_consensus.cc:3055] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:57.231042  8810 raft_consensus.cc:740] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:57.231894  8810 consensus_queue.cc:260] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.233283  8810 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:57.243511  3126 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:57.249652  3120 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:16:57.256481  3191 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:16:57.210270  8755 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:57.144336  8871 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:57.266440  3043 pending_rounds.cc:85] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 9
I20260709 13:16:57.272266  3043 pending_rounds.cc:107] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:16:57.273032  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:57.272621  3043 raft_consensus.cc:2889] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:57.281685  8847 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:57.285164  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:57.286729  3046 raft_consensus.cc:1240] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:57.289103  3164 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:57.289649  8856 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:57.227757  8834 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.271808  2943 catalog_manager.cc:5697] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 8 to 9, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 9 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.302371  2943 catalog_manager.cc:5697] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 6 to 11, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 11 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
W20260709 13:16:57.306354  8820 consensus_meta.cc:287] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.713s	user 0.011s	sys 0.000s
I20260709 13:16:57.306807  8820 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:57.307890  3117 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:57.290907  8686 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:57.308563  8686 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:57.308928  8686 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:57.293586  3793 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:57.310667  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:57.311280  3191 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:57.290295  3164 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:57.294140  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:57.313530  3090 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:57.314186  3045 raft_consensus.cc:2410] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:16:57.324347  3195 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:16:57.324822  3195 pending_rounds.cc:85] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 8
I20260709 13:16:57.325079  3195 pending_rounds.cc:107] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:16:57.325305  3195 raft_consensus.cc:2889] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:57.325899  3051 raft_consensus.cc:3055] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:57.326277  3051 raft_consensus.cc:740] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:57.331431  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:57.289147  8873 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:16:57.333002  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:57.333660  3790 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:57.334074  3051 consensus_queue.cc:260] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:57.335391  3091 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:57.343200  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:57.333623  3200 raft_consensus.cc:2376] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14. Re-sending same reply.
I20260709 13:16:57.298569  8755 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.347496  8755 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.335415  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:57.350783  3198 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:16:57.350857  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:57.354471  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:57.355293  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:57.355698  3196 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 14: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:57.357141  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:57.359319  3051 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:57.276737  8841 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:57.360466  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:57.362318  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:57.361387  3192 raft_consensus.cc:2376] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14. Re-sending same reply.
I20260709 13:16:57.365276  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:57.366621  3046 raft_consensus.cc:2410] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:16:57.368451  3045 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:57.369668  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:57.370944  3199 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 16: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:57.373350  3117 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:16:57.350456  8877 log.cc:927] Time spent T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:16:57.292187  8496 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:57.374696  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:57.380126  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:57.381757  3046 raft_consensus.cc:2410] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:16:57.375137  3118 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:57.377562  3120 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:57.282788  8849 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.356730  8699 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:57.388214  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:57.359206  8851 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:57.359463  8717 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:16:57.401819  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:57.376600  8730 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:16:57.403080  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:57.368062  8206 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.404038  8206 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:57.382735  8637 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 13:16:57.406432  8206 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:57.392463  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:57.408381  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:57.409456  8739 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.410732  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:57.411409  3192 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 19: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:57.398056  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:57.397895  8865 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 13:16:57.386914  8862 consensus_meta.cc:287] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.000s
I20260709 13:16:57.369012  8358 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:57.405444  8861 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.412533  3050 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:57.392599  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:57.413265  3118 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:57.435578  3051 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:16:57.436026  3051 pending_rounds.cc:85] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 8
I20260709 13:16:57.436316  3051 pending_rounds.cc:107] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:16:57.436426  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:57.399277  8633 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:57.418761  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:57.418196  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.437248  3195 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:57.372854  8834 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:57.429531  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:57.432425  3790 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:16:57.433945  3793 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:16:57.436586  3051 raft_consensus.cc:2889] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:57.413249  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:57.382081  8841 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.438205  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:57.448583  3123 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:16:57.450486  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:57.447949  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:57.453380  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:57.454869  3193 raft_consensus.cc:2410] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:16:57.456133  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:57.460229  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 66524.3us
I20260709 13:16:57.304059  2943 catalog_manager.cc:5697] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 12 to 14, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 14 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:16:57.446007  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:57.437978  8862 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.472848  8753 raft_consensus.cc:1064] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:16:57.444463  8865 consensus_queue.cc:1243] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:16:57.476094  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:57.434062  8699 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:57.479818  3197 raft_consensus.cc:2393] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 18: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:57.476953  3049 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:16:57.483757  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:57.491008  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:57.492709  8876 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:57.493800  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:57.494477  3193 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:16:57.494773  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:57.494836  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:57.495694  3044 raft_consensus.cc:2393] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 15: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:57.495688  3193 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:16:57.496129  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:57.496749  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:57.498445  8871 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:57.499436  8740 consensus_meta.cc:287] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.702s	user 0.009s	sys 0.002s
I20260709 13:16:57.499732  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:57.500041  3044 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:16:57.499853  8740 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.501330  3044 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:57.501444  3048 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:57.502511  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:57.503216  3047 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:57.504566  8831 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.615s	user 0.012s	sys 0.000s
I20260709 13:16:57.463239  8861 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:57.507143  3200 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 16: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:57.449533  8165 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:16:57.507956  8861 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:57.508641  8107 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.499460  2943 catalog_manager.cc:5697] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 8 to 12, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 12 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.510311  8699 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.511082  2943 catalog_manager.cc:5697] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:16:57.513582  8165 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.468309  8555 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.514346  8555 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.514290  8165 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:57.516229  3792 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:16:57.512907  2943 catalog_manager.cc:5697] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.519236  2943 catalog_manager.cc:5697] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 7 to 12, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 12 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.527249  8740 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:57.479396  8822 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:57.494459  3046 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:16:57.462373  8868 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:57.540206  3045 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:57.530408  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:57.527715  8753 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 7, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:57.542606  3191 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:16:57.544413  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:57.545114  3118 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:16:57.497575  3051 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:57.531266  3762 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:57.545974  3198 raft_consensus.cc:1240] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:57.547147  3762 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:57.548820  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:57.536337  3047 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:16:57.539206  3050 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:16:57.541656  3046 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
W20260709 13:16:57.541613  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 57959.3us
I20260709 13:16:57.542379  3195 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:16:57.550596  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:57.509315  8107 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.555449  3118 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: [17.9-19.10]
I20260709 13:16:57.464351  8841 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:57.561069  3118 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:16:57.563191  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:57.564065  3195 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:57.548172  8876 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:57.568622  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:57.574298  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:57.509349  8633 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:16:57.575168  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:57.584234  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:57.551433  8860 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:57.589128  3195 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:16:57.590307  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:57.593904  3191 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:16:57.592903  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:57.595129  3195 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:16:57.597167  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:57.602015  3117 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:57.560356  8206 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:57.602949  3051 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:57.605773  3123 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:16:57.603497  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.603641  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:57.601490  8858 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.604398  8876 raft_consensus.cc:697] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 14 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:57.606859  3196 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:16:57.610109  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:57.615016  3120 raft_consensus.cc:2368] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16.
W20260709 13:16:57.615490  2934 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet fcf5db67d30f487d873766886c2ef408 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:57.610894  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:57.616420  3122 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:16:57.580703  8630 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:57.617978  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:57.620440  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:57.603148  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.585640  8820 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:57.622563  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.621232  3195 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:57.624348  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:57.630079  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:16:57.631125  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 60278.6us
I20260709 13:16:57.631875  3090 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:57.581476  8358 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:16:57.637871  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:57.640260  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:57.629657  8863 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:57.628364  8630 raft_consensus.cc:697] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:57.636643  8665 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:16:57.622603  8822 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:16:57.654583  3124 raft_consensus.cc:1217] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Deduplicated request from leader. Original: 9.5->[11.6-18.10]   Dedup: 12.7->[15.8-18.10]
I20260709 13:16:57.680079  3124 pending_rounds.cc:85] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 7
I20260709 13:16:57.680392  3124 pending_rounds.cc:107] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260709 13:16:57.658387  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:57.680858  3124 raft_consensus.cc:2889] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:57.658089  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:57.681169  3046 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:16:57.634759  8835 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:57.681699  3047 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 16: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:57.521571  2943 catalog_manager.cc:5697] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 9 to 13, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 13 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:57.651369  8884 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:16:57.674655  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:57.690078  3051 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:57.638526  8555 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:57.656654  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:57.691254  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:57.691776  3119 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 16: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:57.647711  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:57.674021  3165 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:57.619614  8858 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.687356  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:57.696031  3165 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:57.667042  8850 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:57.689530  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:57.701469  3091 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:57.682901  8810 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.679762  8165 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:57.666491  8863 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:57.740479  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 53200.2us
I20260709 13:16:57.661479  8107 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:57.741813  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 45908.7us
I20260709 13:16:57.736017  8637 consensus_queue.cc:1059] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
W20260709 13:16:57.750162  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.649191  8849 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:57.756075  3051 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:16:57.658545  8831 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:57.756577  3195 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:16:57.798662  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:57.799563  3045 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
W20260709 13:16:57.765470  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 64087.1us
I20260709 13:16:57.800684  3091 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:57.733714  8742 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:57.736502  8555 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:57.693847  8496 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 13:16:57.802470  8699 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:57.804287  8699 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:57.808408  3165 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:57.662563  8740 consensus_queue.cc:1059] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.107s
I20260709 13:16:57.812552  3090 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:57.813031  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 167657us
I20260709 13:16:57.758378  8780 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:57.818930  3091 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:57.820196  8755 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:57.809324  8707 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:57.822381  8690 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:16:57.824195  8739 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:57.826803  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:57.758458  8850 raft_consensus.cc:697] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:57.785893  8863 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:57.785418  8730 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:57.832257  3091 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:16:57.824141  8883 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 13:16:57.818106  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:57.796754  8831 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.809859  8461 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.815174  8358 raft_consensus.cc:3055] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:57.829277  8665 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:57.830199  8637 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:57.784153  8810 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.701310  8876 consensus_queue.cc:237] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:57.850737  8665 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:57.810509  8441 consensus_queue.cc:1059] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:16:57.836263  8842 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:57.852035  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:57.846354  8690 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:57.855701  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:57.845803  8831 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:57.858402  3762 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:57.844056  8841 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:57.854980  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 80625.2us
I20260709 13:16:57.846726  8358 raft_consensus.cc:740] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:57.868618  3091 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:57.831259  8739 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
W20260709 13:16:57.870025  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.870448  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:57.839258  8496 consensus_queue.cc:1059] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
W20260709 13:16:57.871100  8889 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 13:16:57.872260  8890 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:16:57.876454  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:57.885939  3164 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:57.863485  8665 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:57.889681  8810 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:57.871100  8895 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:57.852196  8461 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:57.877000  8842 raft_consensus.cc:697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:57.839064  8859 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:16:57.903014  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:57.910974  8842 consensus_queue.cc:237] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:57.915535  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 47000.1us
I20260709 13:16:57.916610  3091 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:57.866926  8896 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:57.864936  8835 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:16:57.896231  8849 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:57.886920  8894 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.920635  3091 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:16:57.884752  8815 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:57.922641  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:57.873126  8856 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:16:57.848121  8630 consensus_queue.cc:237] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.895774  8780 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.951474  8780 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.954151  8886 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:57.949419  8555 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:16:57.954802  8892 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:16:57.954980  8886 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:57.956082  8886 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:57.958338  8815 raft_consensus.cc:697] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:57.959373  8815 consensus_queue.cc:237] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:57.925071  8841 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:57.960333  8841 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.960806  8841 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:57.923803  8901 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:57.963959  8873 raft_consensus.cc:3055] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:57.964455  8873 raft_consensus.cc:740] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:57.924625  8895 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:57.932536  8820 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:57.933805  8835 raft_consensus.cc:2764] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:16:57.934341  8858 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:57.930284  8885 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:16:57.961212  8730 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:57.939105  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 53261.6us
I20260709 13:16:57.974593  3042 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:16:57.980728  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:57.999015  3051 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
W20260709 13:16:57.980970  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 58426.5us
I20260709 13:16:57.905210  8441 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:16:57.927439  8896 raft_consensus.cc:697] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:57.997591  3048 raft_consensus.cc:3055] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:58.000628  3164 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:58.001215  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:58.007545  3048 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:57.928032  8904 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:58.006028  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 87976.6us
I20260709 13:16:58.008538  3164 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:57.924660  8690 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:16:58.014391  3164 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:58.022450  8896 consensus_queue.cc:237] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:58.025934  8873 consensus_queue.cc:260] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:58.027348  8873 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:58.027380  8863 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:58.030082  3790 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:16:58.004910  8780 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:57.927745  8866 consensus_queue.cc:1059] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:16:58.015734  3091 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:57.901170  8850 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:58.034723  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:58.032081  3048 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:58.009234  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:58.036406  3165 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:58.047465  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:58.047636  3165 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:58.051118  3165 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:58.010957  8856 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:58.019528  8739 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:58.031517  8859 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:58.059674  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:58.042024  8707 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:58.052266  8686 consensus_meta.cc:287] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.743s	user 0.012s	sys 0.001s
I20260709 13:16:58.077986  8686 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:58.080317  8686 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:58.080808  8461 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:58.081378  8461 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:58.061223  8780 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:58.081445  3194 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:58.083207  8847 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:58.052326  8637 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:58.051290  8810 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:57.930680  8894 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:58.052924  8781 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:16:58.110915  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 51337.3us
I20260709 13:16:58.066721  8876 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:58.069083  8866 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:58.130795  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:58.142179  8866 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:58.142814  8866 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:58.128949  8781 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.145236  8781 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:58.145363  8894 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:58.147702  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:58.162632  3015 leader_election.cc:400] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16.
I20260709 13:16:58.163120  3015 leader_election.cc:403] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:16:58.117020  8895 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:58.117218  8780 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.168715  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:58.170058  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:58.172634  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:58.164394  8461 raft_consensus.cc:697] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:58.122710  8637 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.186436  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:58.181766  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:58.193693  3792 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:16:58.194446  3792 pending_rounds.cc:85] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: Aborting all ops after (but not including) 10
I20260709 13:16:58.194761  3792 pending_rounds.cc:107] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:16:58.195086  3792 raft_consensus.cc:2889] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:58.163746  8876 raft_consensus.cc:697] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:58.164433  8863 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:58.201587  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 166990us
I20260709 13:16:58.202193  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:58.208190  3123 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:16:58.176083  8858 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:58.193533  3124 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
I20260709 13:16:58.174204  8739 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:58.174993  8780 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:58.216121  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:16:58.215796  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 164746us
I20260709 13:16:58.216398  3200 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:58.178205  8896 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:58.218986  3198 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:16:58.193065  8637 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:58.186925  8894 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:58.222479  3164 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:58.167680  8835 consensus_queue.cc:1059] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:16:58.230283  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:16:58.231441  8906 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:16:58.222417  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:58.236631  3191 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18. Ops: [16.8-17.9]
I20260709 13:16:58.250638  3200 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:16:58.238793  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:58.213670  8858 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.212110  8555 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:16:58.246093  8907 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16.
I20260709 13:16:58.251709  3197 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
I20260709 13:16:58.255540  3199 raft_consensus.cc:2368] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16.
I20260709 13:16:58.246549  8903 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:16:58.266387  8461 consensus_queue.cc:237] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:58.268862  8903 consensus_queue.cc:1243] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:16:58.274487  8891 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.430s	user 0.001s	sys 0.003s
I20260709 13:16:58.273959  8876 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:58.272893  8831 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:58.257247  8858 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:58.291054  8637 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:58.293563  8358 consensus_queue.cc:260] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:58.294940  8358 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:58.298611  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:58.299579  3046 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:16:58.262926  8895 raft_consensus.cc:697] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 16 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:58.265240  8913 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:58.304761  8637 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:58.326898  3046 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:16:58.328104  3091 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:58.312422  8834 raft_consensus.cc:3055] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:16:58.333788  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 116281us
I20260709 13:16:58.356281  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:58.315843  8665 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:58.357342  8922 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:58.357686  8917 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:58.357998  8922 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:58.359172  8665 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:58.332484  8862 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:58.360811  3047 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:58.370925  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:58.383461  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:58.384109  3046 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:16:58.331650  8834 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:58.360307  8922 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:58.370980  8917 raft_consensus.cc:697] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:58.405061  3198 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:58.405352  3200 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:58.329185  8841 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:58.408951  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:58.413722  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:58.414924  3046 raft_consensus.cc:2410] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:16:58.416114  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:58.404004  8633 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.419170  8633 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:58.397440  8742 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.422282  8742 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:58.423753  8841 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:58.424654  8742 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:16:58.425144  8691 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:16:58.426389  8904 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:58.428611  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:58.432808  3126 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:16:58.437381  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:58.438130  3197 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:58.432768  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:58.440536  8917 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:58.442816  3199 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:58.443923  8780 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:58.447870  8781 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:58.439092  8834 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:58.450148  8831 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:58.450886  8834 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:58.462132  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:58.391098  8895 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:58.464071  3165 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:58.504215  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:58.504905  3197 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:16:58.507344  3191 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:16:58.474555  8831 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:58.502414  8849 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:58.501945  8868 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:58.508486  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 270058us
I20260709 13:16:58.516610  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:58.477334  8780 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:58.520943  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:58.476286  8823 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:16:58.538288  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:58.541608  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:58.542910  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:58.543319  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:58.545262  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:58.517236  8849 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.546305  3118 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:16:58.548941  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:58.558223  8858 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:58.561348  8858 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:58.562127  3043 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:16:58.520813  8809 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:16:58.564819  8933 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:16:58.564958  3200 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:16:58.565825  8931 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:16:58.566085  3124 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:16:58.566475  8810 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:58.599407  3799 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:58.521093  8868 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:58.600152  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:58.600754  3121 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:58.601058  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:58.601436  8868 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:58.602240  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:58.602567  3043 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:58.602747  3046 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:58.515132  8866 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:58.603241  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:58.605085  3117 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:58.605334  8866 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:58.571310  8925 consensus_queue.cc:1059] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:58.572971  8740 raft_consensus.cc:3055] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:58.606058  8740 raft_consensus.cc:740] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:58.605508  3043 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:58.595651  3119 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:58.597041  3122 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: [17.9-19.10]
I20260709 13:16:58.597124  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:58.562745  8849 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:58.611431  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:58.611498  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:58.612498  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:58.615149  3195 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:58.609706  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:58.615715  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:58.617884  3796 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:58.632337  3121 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:16:58.636051  3164 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:58.637049  8742 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:58.637967  8810 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:16:58.638942  8866 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:58.640026  8926 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:58.633911  8925 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:58.643134  8925 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.643469  8925 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:58.635293  8868 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:58.650071  8868 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.650463  8868 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:58.653379  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:58.656016  3165 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:58.651721  8691 tablet_bootstrap.cc:492] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:58.657903  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:58.658561  8691 tablet_bootstrap.cc:492] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:16:58.659449  8691 ts_tablet_manager.cc:1403] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 1.975s	user 0.051s	sys 0.023s
I20260709 13:16:58.632083  8858 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:16:58.648911  3164 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:58.607029  8740 consensus_queue.cc:260] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:58.675006  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:58.675691  3051 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:16:58.677183  3125 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:16:58.675586  8780 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:58.675822  8866 consensus_queue.cc:1059] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:16:58.696382  3165 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:58.673623  8707 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:58.693991  8665 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:16:58.706146  8707 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:58.706677  8707 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.707049  8707 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:58.710759  3051 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:16:58.714504  3164 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:58.721485  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.779644  8932 consensus_queue.cc:1059] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:16:58.829048  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:58.834941  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.721794  8920 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:16:58.870949  8858 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:58.871886  8858 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:58.878604  8934 log.cc:927] Time spent T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
W20260709 13:16:58.879467  8935 log.cc:927] Time spent T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.314s	user 0.005s	sys 0.000s
W20260709 13:16:58.884359  8905 log.cc:927] Time spent T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:16:58.876906  8707 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:58.902122  3049 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:16:58.902583  3049 pending_rounds.cc:85] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 9
I20260709 13:16:58.902863  3049 pending_rounds.cc:107] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:16:58.903162  3049 raft_consensus.cc:2889] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:58.726251  8555 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.145s
I20260709 13:16:58.904378  8555 consensus_queue.cc:1243] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:16:58.930344  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.940243  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:58.867579  8925 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:58.963714  8925 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:58.949060  8842 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:58.965431  8842 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:16:58.968016  8842 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:58.950527  8630 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.968930  8630 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:58.971428  8630 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:58.975535  8630 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:58.976260  8849 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:58.987715  8630 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:59.002882  3117 pending_rounds.cc:85] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 8
I20260709 13:16:59.003399  3117 pending_rounds.cc:107] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:16:59.003731  3117 raft_consensus.cc:2889] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:58.996357  8929 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:59.009325  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:59.007057  8929 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:59.013237  8755 raft_consensus.cc:3055] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:59.016387  8755 raft_consensus.cc:740] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:59.017658  8755 consensus_queue.cc:260] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:59.018968  8755 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:59.020666  8929 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:59.007578  8707 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:59.021939  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:59.026026  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 344033us
I20260709 13:16:59.027944  8809 consensus_queue.cc:1059] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:59.027707  8691 raft_consensus.cc:359] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:16:59.029011  8691 raft_consensus.cc:740] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:16:59.029052  8809 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:59.033938  8823 raft_consensus.cc:3055] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:59.034373  8823 raft_consensus.cc:740] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:16:59.034300  8809 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:59.035421  8823 consensus_queue.cc:260] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:59.036844  8823 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:59.036873  8809 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:59.038710  8630 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:59.038722  8809 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:59.029769  8822 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:16:59.033255  8691 consensus_queue.cc:260] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:16:59.042073  8809 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:59.043507  3043 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:16:59.067589  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.068531  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:59.071311  8849 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:59.072664  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:59.073086  3048 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:59.073187  8809 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:59.073352  3118 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:59.075366  8868 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:59.076809  8691 ts_tablet_manager.cc:1434] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.417s	user 0.005s	sys 0.005s
I20260709 13:16:59.092381  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:59.106931  3196 raft_consensus.cc:1240] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:59.107156  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:59.108176  3796 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:16:59.111843  3191 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:59.116078  3796 raft_consensus.cc:1217] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.7->[15.8-15.8]   Dedup: 15.8->[]
I20260709 13:16:59.116657  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:59.118247  3191 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:16:59.120102  3048 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:16:59.120441  3048 pending_rounds.cc:85] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 12
I20260709 13:16:59.120790  3048 pending_rounds.cc:107] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:16:59.121060  3048 raft_consensus.cc:2889] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:59.121810  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1089) took 1145 ms. Trace:
I20260709 13:16:59.123272  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:59.123816  3798 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:59.124964  3195 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:16:59.126921  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:59.127574  3196 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 18: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:59.128181  3191 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:59.122189  3048 rpcz_store.cc:276] 0709 13:16:57.976221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.976356 (+   135us) service_pool.cc:224] Handling call
0709 13:16:57.997424 (+ 21068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.072248 (+1074824us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b5800735ed0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83030f0aa 00007ff830391447 00007ff8303a9fe7 00007ff8303ab7de 00007ff8303b5b49 00007ff8303b6416 00007ff8303b2d8f 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4
0709 13:16:59.121524 (+ 49276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.121694 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":653601024}
I20260709 13:16:59.136742  8781 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:59.138983  8849 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:59.090888  8841 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
W20260709 13:16:59.158514  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.159592  8849 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:59.162084  8861 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:59.162918  8861 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:59.165357  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:59.140182  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:16:59.144912  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:59.169440  3195 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:59.172165  3135 tablet_copy_service.cc:342] P f20672b2852447a6bc1e137c4dd40904: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-4b83202a913e45d5830d2ecdfb5354c2 received from {username='slave'} at 127.0.0.1:55318
I20260709 13:16:59.172689  3135 tablet_copy_service.cc:434] P f20672b2852447a6bc1e137c4dd40904: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-4b83202a913e45d5830d2ecdfb5354c2 on tablet 4b83202a913e45d5830d2ecdfb5354c2 with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:59.162865  8868 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:59.149974  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:59.151602  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:59.174299  3200 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 18: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:59.175217  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:59.176314  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:59.151624  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:59.178814  8896 raft_consensus.cc:3055] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:59.179216  8896 raft_consensus.cc:740] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:59.180068  8896 consensus_queue.cc:260] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:59.119148  8960 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.154421  3798 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:16:59.156610  8865 raft_consensus.cc:3055] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:59.147974  8730 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:16:59.210598  8865 raft_consensus.cc:740] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:59.183105  8858 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:16:59.154130  8927 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.794s	user 0.000s	sys 0.011s
I20260709 13:16:59.180354  3191 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:59.177636  3200 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:16:59.197757  3118 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:16:59.201452  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:59.187463  3790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 763) took 1311 ms. Trace:
I20260709 13:16:59.214790  3195 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:16:59.225721  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3062) took 1061 ms. Trace:
I20260709 13:16:59.210847  3796 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:16:59.183233  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:59.230567  3047 rpcz_store.cc:276] 0709 13:16:58.163876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.164029 (+   153us) service_pool.cc:224] Handling call
0709 13:16:58.164372 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.361209 (+196837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.225352 (+864143us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b540028e454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:59.225630 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":451345664}
W20260709 13:16:59.213331  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 132323us
I20260709 13:16:59.229511  3198 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:59.229031  3790 rpcz_store.cc:276] 0709 13:16:57.875680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.875807 (+   127us) service_pool.cc:224] Handling call
0709 13:16:57.890969 (+ 15162us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:58.030485 (+139516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.187158 (+1156673us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54004bb254. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:59.187374 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319310592}
I20260709 13:16:59.244619  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:59.180860  8849 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:59.242486  8730 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:59.231518  8960 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:59.249512  8922 consensus_queue.cc:1059] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:16:59.293006  3797 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:16:59.249949  8896 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:59.250739  8630 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:16:59.247225  8165 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:16:59.321447  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:59.313235  8842 consensus_queue.cc:1059] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:16:59.322341  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:16:59.323422  3194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2745) took 2003 ms (client timeout 1530 ms). Trace:
I20260709 13:16:59.323520  3193 raft_consensus.cc:1240] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17. Ops: []
W20260709 13:16:59.332007  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:59.331511  3194 rpcz_store.cc:269] 0709 13:16:57.319695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.319836 (+   141us) service_pool.cc:224] Handling call
0709 13:16:59.323173 (+2003337us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b5400036e54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:59.323334 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1695475072}
I20260709 13:16:59.331694  3126 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:16:59.335932  3761 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:16:59.336597  3792 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEARNER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:16:59.296404  8730 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:59.324666  8960 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:59.324892  8861 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:59.342065  8962 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:16:59.343233  8873 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.024s	sys 0.017s
W20260709 13:16:59.350039  8873 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.025s	sys 0.017s
I20260709 13:16:59.348737  8962 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.343575  8849 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:16:59.373421  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:16:59.378226  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:59.379536  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:16:59.380256  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:16:59.380713  3794 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:16:59.380865  3126 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 16: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:16:59.381134  3195 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:16:59.380885  3194 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:59.383606  3192 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:16:59.383612  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 288516us
W20260709 13:16:59.387898  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.388507  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:59.393088  3117 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:16:59.395072  3126 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:16:59.387912  8858 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:59.381960  8461 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.403096  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:59.380026  8962 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:59.398629  8842 consensus_queue.cc:1059] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:16:59.399607  3118 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:16:59.410600  3792 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:16:59.412959  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:16:59.416388  3198 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:59.411491  8917 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:59.411077  8461 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:59.425187  8461 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:59.395835  8868 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:59.426110  8868 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:59.426461  8730 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:59.426647  8630 raft_consensus.cc:3055] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:59.427286  8630 raft_consensus.cc:740] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:59.428333  8868 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:16:59.428454  8630 consensus_queue.cc:260] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:59.408811  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:59.438846  3194 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
W20260709 13:16:59.408149  3090 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 1.530s (SENT) [suppressed 7 similar messages]
I20260709 13:16:59.387005  8923 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:59.466790  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:59.467509  3050 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:59.469630  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:59.471168  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:59.471989  3047 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:59.445914  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:59.413785  3117 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:59.406250  8895 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:59.456455  8865 consensus_queue.cc:260] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:59.457499  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.457391  8815 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.458037  3790 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:16:59.478541  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.462674  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:59.479499  3048 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:59.463425  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2254) took 1898 ms. Trace:
I20260709 13:16:59.463872  8868 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:59.452211  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 43502.3us
W20260709 13:16:59.451546  8862 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.025s	sys 0.067s
I20260709 13:16:59.483628  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:59.480017  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:59.496923  3047 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:16:59.498028  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:59.481868  3193 rpcz_store.cc:276] 0709 13:16:57.564626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.566083 (+  1457us) service_pool.cc:224] Handling call
0709 13:16:59.323300 (+1757217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.331595 (+  8295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.463201 (+131606us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b5400036e50. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:16:59.463342 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4040359296}
I20260709 13:16:59.498483  3762 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:16:59.499950  8831 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:59.492316  3050 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:16:59.493790  3015 leader_election.cc:400] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16.
I20260709 13:16:59.494047  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:16:59.500630  8831 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.501478  3051 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 18: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:16:59.501598  8831 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:59.502398  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:59.503268  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:59.509701  3126 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:16:59.511961  3762 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:59.403344  8973 consensus_queue.cc:1059] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
W20260709 13:16:59.514799  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.531078  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:59.410390  8858 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:16:59.496286  8862 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.025s	sys 0.067s
I20260709 13:16:59.546859  3042 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:59.547628  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:59.548863  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:59.548971  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:59.551612  3048 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
W20260709 13:16:59.557821  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 149684us
W20260709 13:16:59.562870  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 47766.8us
I20260709 13:16:59.563007  8834 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:59.533891  8833 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:59.514897  8904 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:59.590402  3117 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:16:59.588423  3090 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:59.545718  8865 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:59.474613  8923 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:59.565192  8739 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:16:59.607650  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:59.508632  8815 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:59.608129  8740 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:59.490900  8895 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
W20260709 13:16:59.613937  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 48686.1us
I20260709 13:16:59.621668  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:16:59.623800  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.605962  8851 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:16:59.624965  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 76171.4us
I20260709 13:16:59.628615  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:16:59.564658  8868 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:16:59.587105  8780 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:16:59.635797  3045 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:16:59.625267  8637 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.618425  8904 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:59.614859  8973 consensus_queue.cc:1059] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 13:16:59.648782  3165 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:59.616626  8730 consensus_queue.cc:1059] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
W20260709 13:16:59.655256  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.668407  3794 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12725e4e41614e1292b974e17635f758"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:59.669274  3794 raft_consensus.cc:606] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:59.669665  3794 raft_consensus.cc:614] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:59.643592  8904 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:16:59.673563  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2676) took 1319 ms. Trace:
I20260709 13:16:59.648152  8849 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:59.680349  3165 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:59.679139  3049 rpcz_store.cc:276] 0709 13:16:58.354002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.432297 (+ 78295us) service_pool.cc:224] Handling call
0709 13:16:58.433007 (+   710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.903665 (+470658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.673277 (+769612us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b540027d3d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:16:59.673490 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1073794944}
I20260709 13:16:59.682854  3165 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:59.682235  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 51954.8us
I20260709 13:16:59.685859  3090 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:59.646087  8637 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:16:59.689818  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:59.698307  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:59.676494  8932 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:59.701027  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:59.682788  8904 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:59.714860  3796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:16:59.709271  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:59.720448  3796 raft_consensus.cc:606] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:59.689426  8707 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:16:59.696642  8717 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:59.760603  3796 raft_consensus.cc:614] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:59.707599  8985 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:59.770908  3049 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:16:59.695785  8555 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:16:59.775054  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:16:59.695720  8841 consensus_queue.cc:1059] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.067s
I20260709 13:16:59.706847  8730 consensus_queue.cc:1059] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
W20260709 13:16:59.798902  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 84747.3us
I20260709 13:16:59.706550  8358 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:16:59.707867  8868 consensus_queue.cc:1059] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:16:59.757658  8849 raft_consensus.cc:697] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:59.765144  8461 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.812935  3796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
W20260709 13:16:59.814330  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.768455  8858 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:59.815245  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:59.815665  3796 raft_consensus.cc:606] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:59.802623  8781 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:59.830367  8849 consensus_queue.cc:237] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:59.839222  8633 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:59.807163  8815 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:16:59.825697  3796 raft_consensus.cc:614] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:59.824889  3761 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:59.815388  8987 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
W20260709 13:16:59.875414  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 50675.3us
I20260709 13:16:59.876472  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:16:59.826864  8983 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:16:59.828681  8923 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:59.829053  8358 raft_consensus.cc:3055] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:59.814494  8717 consensus_queue.cc:1059] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:16:59.798409  8985 raft_consensus.cc:697] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:16:59.885169  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:16:59.814845  8932 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:16:59.835017  8823 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:59.834700  8753 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:59.879802  8633 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:59.885107  8781 raft_consensus.cc:697] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:16:59.887382  8358 raft_consensus.cc:740] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:16:59.834513  8861 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.066s
W20260709 13:16:59.941547  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 258758us
I20260709 13:16:59.821801  8461 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:59.893972  8989 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:16:59.894263  8895 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:16:59.895905  8637 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:16:59.993474  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 304693us
I20260709 13:16:59.995898  3090 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:59.891707  8165 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:59.976210  3048 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:16:59.975677  3165 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:59.981066  3126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:17:00.012310  3126 raft_consensus.cc:606] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:16:59.934736  8841 raft_consensus.cc:3055] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:00.012979  8841 raft_consensus.cc:740] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:00.013432  8856 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:00.013849  8841 consensus_queue.cc:260] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:16:59.934439  8958 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:00.015802  8958 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:17:00.018715  3165 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:16:59.979830  8973 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.028587  3165 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:16:59.975160  8739 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:17:00.005774  8934 log.cc:927] Time spent T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:17:00.028913  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 399392us
I20260709 13:16:59.992307  8707 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:16:59.936190  8753 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.022944  8966 raft_consensus.cc:3055] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:59.900480  8932 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:00.027362  8841 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:00.027009  8834 raft_consensus.cc:697] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:00.028457  8895 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.030813  8915 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:00.038817  8920 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:00.024945  8856 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:17:00.043467  8966 raft_consensus.cc:740] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:00.046164  8862 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:00.087035  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 201985us
I20260709 13:17:00.082263  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:00.038914  8929 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:16:59.996641  8989 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.081274  3050 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:00.039744  8739 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.044198  8707 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:00.087858  8981 log.cc:927] Time spent T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
W20260709 13:17:00.109606  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 129628us
I20260709 13:17:00.084151  8993 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.113389  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:00.040964  8358 consensus_queue.cc:260] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.120767  3790 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:17:00.041373  8973 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:00.120307  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:00.074983  8895 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.129405  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:00.128549  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:00.123711  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:00.118708  8831 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.616s	user 0.014s	sys 0.003s
I20260709 13:17:00.147469  3050 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:00.147326  8831 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:00.148648  8962 consensus_meta.cc:287] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.702s	user 0.011s	sys 0.002s
W20260709 13:17:00.151667  8992 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:17:00.152199  8707 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:00.126912  8993 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.111109  8923 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:00.143477  8739 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:00.093439  8862 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.106359  8988 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
W20260709 13:17:00.146466  8896 consensus_meta.cc:287] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.832s	user 0.012s	sys 0.000s
I20260709 13:17:00.146611  8932 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:00.039268  8985 consensus_queue.cc:237] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.132007  3192 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:17:00.154086  3792 raft_consensus.cc:2368] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20.
I20260709 13:17:00.175899  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:00.141655  8358 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:00.078209  8781 consensus_queue.cc:237] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.134702  8637 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:00.130343  8823 raft_consensus.cc:697] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:00.149223  8962 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:00.181102  3048 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:17:00.185313  3048 pending_rounds.cc:85] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 8
I20260709 13:17:00.185585  3048 pending_rounds.cc:107] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:17:00.185846  3048 raft_consensus.cc:2889] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:00.185930  3795 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:00.178112  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:00.171847  8920 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:00.172266  8914 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:00.263252  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 91875.8us
W20260709 13:17:00.268828  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 157351us
I20260709 13:17:00.157218  8834 consensus_queue.cc:237] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.263365  9006 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.234285  8896 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:00.231470  8999 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:00.169215  8739 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.086s
W20260709 13:17:00.180995  8865 consensus_meta.cc:287] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.568s	user 0.007s	sys 0.007s
W20260709 13:17:00.274307  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 278505us
W20260709 13:17:00.284421  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.159003  8966 consensus_queue.cc:260] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.314342  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:00.320447  3195 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:00.323375  3200 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:00.324755  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:00.277920  8896 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:00.362470  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:00.354344  3196 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:00.362470  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:00.369362  3051 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:00.369689  3042 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:17:00.272928  9012 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:00.390096  9012 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:00.293609  8753 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:17:00.373847  8896 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:00.391404  8842 raft_consensus.cc:3055] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:00.391944  8842 raft_consensus.cc:740] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:00.380789  8862 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:00.394794  8831 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:00.281689  8637 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.082s
I20260709 13:17:00.399646  8896 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.400568  9004 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.272588  8914 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:00.380988  9003 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:17:00.401165  9004 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.402611  8914 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:00.282987  8915 raft_consensus.cc:697] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:17:00.403760  9001 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:17:00.404101  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:00.404749  3047 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:17:00.404520  8915 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.270130  8920 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:00.408471  8920 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:00.382318  8973 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:00.290341  8999 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:00.312976  8823 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:00.387728  8997 log.cc:927] Time spent T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 13:17:00.392992  8842 consensus_queue.cc:260] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:00.349254  9009 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.410573  3790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:17:00.435523  3790 raft_consensus.cc:606] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:00.435910  3790 raft_consensus.cc:614] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:00.310182  8991 consensus_queue.cc:1059] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
W20260709 13:17:00.377593  8740 consensus_meta.cc:287] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.759s	user 0.011s	sys 0.002s
I20260709 13:17:00.360128  8993 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:00.431668  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 49738.1us
I20260709 13:17:00.446105  3047 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:00.349520  3794 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:00.449165  3762 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:00.450548  3194 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:00.450793  3090 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:00.450922  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:00.447890  3091 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:00.419566  8996 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:00.459870  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:00.465348  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:00.280769  9006 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:00.456058  8932 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.510211  8932 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.462805  8989 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:00.516995  8630 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:00.494602  8740 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.518361  8740 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.520989  8740 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:00.470556  8973 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.522238  8973 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.523991  8999 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:00.525058  8973 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:00.488906  8996 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.528508  8996 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:00.450182  8730 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:00.529398  8730 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.532138  8730 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:00.541924  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 94121.4us
I20260709 13:17:00.542423  3015 leader_election.cc:400] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20.
I20260709 13:17:00.542773  3015 leader_election.cc:403] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:00.542892  3091 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:00.543423  8989 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20.
I20260709 13:17:00.545460  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:00.547524  8989 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.548069  8989 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.354521  9013 consensus_queue.cc:1059] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 13:17:00.552001  9013 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:00.552237  9011 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:00.552583  9013 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.552764  9011 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.554133  9019 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:00.554929  9011 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:00.554713  9019 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:00.557106  9019 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:00.557624  8991 raft_consensus.cc:3055] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:17:00.557546  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 94234.4us
I20260709 13:17:00.558193  8991 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:00.558646  3090 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:00.559108  8991 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.560498  8991 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:00.567361  8993 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:00.499657  8962 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:00.551198  8637 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:00.560398  3090 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:00.498930  9012 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:00.563763  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2693) took 1099 ms. Trace:
I20260709 13:17:00.572121  8966 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:00.600837  8461 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:00.446095  9009 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:00.602098  8999 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.602689  8999 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.603062  9009 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:00.561676  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 3080) took 1003 ms. Trace:
I20260709 13:17:00.603749  3045 rpcz_store.cc:276] 0709 13:16:59.558734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.577730 (+ 18996us) service_pool.cc:224] Handling call
0709 13:17:00.561490 (+983760us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b54000c6554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:00.561615 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54707456}
I20260709 13:17:00.563146  3043 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:00.549458  9016 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:00.592183  3046 rpcz_store.cc:276] 0709 13:16:59.464197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.464329 (+   132us) service_pool.cc:224] Handling call
0709 13:16:59.464587 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.543193 (+ 78606us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:00.031311 (+488118us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.275430 (+244119us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.275827 (+   397us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.276040 (+   213us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:00.276100 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:00.276170 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.513540 (+237370us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b180033aa20. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:17:00.562392 (+ 48852us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b180033aa20. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2942a6 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419
0709 13:17:00.563515 (+  1123us) spinlock_profiling.cc:243] Waited 78.3 ms on lock 0x7b54003c32d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:00.563564 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.563705 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58145,"prepare.queue_time_us":107876,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":9374,"raft.queue_time_us":93,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":15247,"spinlock_wait_cycles":269957504,"thread_start_us":667571,"threads_started":2,"wal-append.queue_time_us":356240}
I20260709 13:17:00.605119  9016 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.593871  8637 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.605497  9016 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:00.605895  8637 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:00.595296  9021 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:00.607724  9021 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.608091  9021 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:00.595865  8755 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.573593  9023 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:00.604676  8999 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:00.615353  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:00.616659  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 56333.8us
I20260709 13:17:00.617112  3191 raft_consensus.cc:2410] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:17:00.621991  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:00.624392  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:00.589613  8895 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:00.615850  8904 consensus_meta.cc:287] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.857s	user 0.010s	sys 0.010s
I20260709 13:17:00.664803  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:00.665576  3191 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:17:00.664803  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:00.573594  8991 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:00.614825  8755 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.676862  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:00.669057  3197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.029s	sys 0.026s
W20260709 13:17:00.677594  3197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.029s	sys 0.026s
I20260709 13:17:00.681058  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:00.682037  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:00.687013  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:00.702595  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:00.702661  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:00.706346  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:00.707110  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.704241  3122 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:17:00.630314  8358 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:00.709918  8358 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.664075  8962 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:00.664739  8461 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.712801  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:00.668659  8960 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:00.716830  3794 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:17:00.717268  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:00.664187  9023 raft_consensus.cc:697] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:00.722440  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:00.709556  8841 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:00.710412  8358 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:00.727121  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:00.736876  3198 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:00.741950  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:00.741142  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:00.743048  3123 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 16: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:00.744663  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:00.745138  9020 log.cc:927] Time spent T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.233s	user 0.004s	sys 0.000s
I20260709 13:17:00.675984  8904 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.754142  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:00.755144  3118 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:00.738672  8863 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:00.717509  8962 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:00.716820  9016 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.719905  8461 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:00.723312  8960 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:00.738176  8841 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:00.755769  8730 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:00.830186  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:00.802466  8863 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:00.850903  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:00.833012  9035 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:17:00.855345  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:00.856108  3118 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:17:00.842429  9013 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:00.850075  8863 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:00.862843  3090 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:00.864594  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:00.879913  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:00.882787  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:00.862390  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:00.895496  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:00.895828  3118 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:00.846670  8730 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.886730  8755 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:00.934453  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:00.939481  3790 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 18: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:00.939905  9011 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:00.940528  9011 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:00.941896  9032 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:00.942548  9032 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:00.946612  8841 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:00.947248  8841 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.947767  8841 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:00.817265  9023 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:00.949550  9051 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:00.952822  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:00.953563  9033 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.150s	user 0.001s	sys 0.001s
I20260709 13:17:00.933871  9039 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:00.954313  9039 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:00.940615  9042 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:17:00.958250  9034 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:00.958931  9034 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:00.898171  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:00.963438  9012 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:00.963865  8896 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:00.965516  9025 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.966202  8923 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:00.966894  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 68791.5us
I20260709 13:17:00.900246  8985 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:00.898098  9010 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:00.944828  9032 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:00.900399  9029 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:00.923691  8895 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:00.966626  8923 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.971951  8896 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:00.972229  9002 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:00.973208  8985 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:00.966114  9025 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:00.998131  8740 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.983036  8923 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:00.963999  9012 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:00.984815  8917 raft_consensus.cc:3055] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:00.988045  8895 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:00.999857  8985 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:00.976511  9010 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:01.014441  8917 raft_consensus.cc:740] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:01.015533  8740 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:01.053543  8851 raft_consensus.cc:3055] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:01.057446  8851 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:01.058370  8851 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:01.059157  8740 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:01.059406  8851 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:01.064023  8637 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:01.065062  9012 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:01.065488  3117 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 20: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:01.052285  8755 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.066551  8755 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.067675  9025 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.068684  8755 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:01.069489  8960 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.041755  8895 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:01.072539  8895 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:01.073146  8895 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:01.076858  8917 consensus_queue.cc:260] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.078329  8917 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:01.047004  9021 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:01.083900  9006 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:01.084570  9021 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:00.987536  9029 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:01.037833  8904 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.097522  3122 raft_consensus.cc:2393] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 18: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:01.101323  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.106087  3049 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:17:01.008186  8461 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:01.109959  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.111176  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.124975  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.126022  3045 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
W20260709 13:17:01.126302  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 263522us
I20260709 13:17:01.127494  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.084595  9006 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:17:01.056362  8630 consensus_meta.cc:287] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.538s	user 0.012s	sys 0.000s
I20260709 13:17:01.124706  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.135783  3049 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:01.136650  3044 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:01.138047  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.138932  3051 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:17:01.150332  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.151893  3051 raft_consensus.cc:2410] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 19 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:17:01.117219  8966 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.134518  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:00.998822  8896 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.001994  9002 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.115056  3091 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:01.129007  8904 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:01.165817  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:01.103160  8358 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:01.141786  8991 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.073698  8895 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:01.177201  3051 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:01.179544  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:01.167142  9059 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:01.184753  8991 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:01.185853  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 58302.8us
I20260709 13:17:01.187148  9002 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.174978  8461 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.194897  3126 raft_consensus.cc:2393] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 17: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:01.168154  8966 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.180449  8904 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:01.199160  9046 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:17:01.199806  9056 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:01.200253  9050 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:17:01.200341  9056 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:01.200994  9056 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:01.202099  9011 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:01.196467  8461 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:01.198529  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 83610.9us
I20260709 13:17:01.204749  3091 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:01.188048  9059 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.146216  9006 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:01.209182  3051 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:17:01.212333  8461 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:01.214390  8904 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:01.215447  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.216684  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.217170  3195 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:17:01.217818  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:01.218115  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 215717us
I20260709 13:17:01.218948  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:01.220196  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.220402  9011 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:01.220804  3091 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:01.221305  8851 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:01.221828  8851 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.222097  9054 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:01.222257  8851 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:01.222785  9054 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.223675  9049 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:01.224229  9049 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:01.224632  9049 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:01.226145  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.226882  3199 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:17:01.228719  9051 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:01.229255  3091 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:01.221032  9011 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.231343  9058 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:01.231839  9058 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:01.232263  9058 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:01.232621  9016 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.232916  9011 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.233588  8851 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.234967  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.236174  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3089) took 1568 ms. Trace:
I20260709 13:17:01.236255  8851 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.236770  3048 rpcz_store.cc:276] 0709 13:16:59.667607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.023295 (+355688us) service_pool.cc:224] Handling call
0709 13:17:00.023548 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.232398 (+208850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.235920 (+1003522us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b540029ca54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:01.236112 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361567488}
I20260709 13:17:01.237833  3091 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:01.236852  9054 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.238855  3090 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:01.241014  3091 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:01.229358  8991 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:01.216259  8868 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.387s	user 0.016s	sys 0.008s
I20260709 13:17:01.233305  9016 consensus_queue.cc:1059] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:17:01.208503  9059 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:01.252478  8896 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.254765  8895 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:01.255066  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2274) took 1141 ms. Trace:
I20260709 13:17:01.255512  3193 rpcz_store.cc:276] 0709 13:17:00.113194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.113361 (+   167us) service_pool.cc:224] Handling call
0709 13:17:00.113708 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.231687 (+117979us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:00.285387 (+ 53700us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.424381 (+138994us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:00.425319 (+   938us) log.cc:844] Serialized 26 byte log entry
0709 13:17:00.425503 (+   184us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:00.425548 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.254628 (+829080us) spinlock_profiling.cc:243] Waited 66.8 ms on lock 0x7b540013a6d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:01.254678 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:01.254726 (+    48us) raft_consensus.cc:1685] finished
0709 13:17:01.254835 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.254979 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73535,"prepare.queue_time_us":146747,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":81334,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":15853,"spinlock_wait_cycles":153685376,"thread_start_us":148571,"threads_started":2,"wal-append.queue_time_us":200697}
I20260709 13:17:01.260025  8923 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.261346  3050 raft_consensus.cc:2368] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15.
I20260709 13:17:01.247622  8637 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:01.263685  9006 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:01.264580  8985 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:17:01.249231  3091 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:01.266673  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.268445  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.269140  3051 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:01.270411  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.271188  3049 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
W20260709 13:17:01.248426  8868 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.427s	user 0.017s	sys 0.009s
I20260709 13:17:01.245708  9051 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:01.273115  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.240232  8851 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.274286  9010 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.286723  8841 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:01.275090  8982 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 1.454s	user 0.000s	sys 0.009s
I20260709 13:17:01.278057  3125 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:01.278280  9029 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:01.279168  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.279860  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.304844  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.299646  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.247854  9013 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:01.281080  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2706) took 1686 ms. Trace:
I20260709 13:17:01.247078  9011 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:01.288005  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2276) took 1173 ms. Trace:
I20260709 13:17:01.309813  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.310088  3194 rpcz_store.cc:276] 0709 13:17:00.114664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.114814 (+   150us) service_pool.cc:224] Handling call
0709 13:17:01.287831 (+1173017us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b54003b9554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:01.287944 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":736432000}
I20260709 13:17:01.294200  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.295892  3046 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:01.293419  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.307482  3043 rpcz_store.cc:276] 0709 13:16:59.594686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.994866 (+400180us) service_pool.cc:224] Handling call
0709 13:17:00.562777 (+567911us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.604967 (+ 42190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.280860 (+675893us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b54000c6550. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:01.281013 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1230801280}
W20260709 13:17:01.308780  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 59606.9us
I20260709 13:17:01.312839  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.307003  9013 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:01.314509  9013 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:01.315783  8991 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:01.316039  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:01.316419  8991 raft_consensus.cc:697] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:01.317322  8926 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:01.317833  8926 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:01.317466  8991 consensus_queue.cc:237] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.318274  8926 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:01.319222  9023 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:01.319788  9023 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:01.323778  8987 raft_consensus.cc:1064] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:17:01.326722  9061 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.326794  9002 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:01.327543  9057 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:01.327659  9002 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.328312  9057 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:17:01.330260  9002 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.327569  9061 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.282445  8966 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.310832  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.332185  3196 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:01.332880  9061 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.333900  8895 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:01.334594  8895 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.333434  9061 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.330857  9002 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:01.281720  9058 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.340719  8895 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.341513  9049 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.333442  8358 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:01.345841  3126 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:01.375725  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:01.372912  8923 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.377067  8873 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:01.380160  3117 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:17:01.307013  8851 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:01.380637  3117 pending_rounds.cc:85] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 15
I20260709 13:17:01.375757  9058 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.380993  3117 pending_rounds.cc:107] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 19.16
W20260709 13:17:01.381264  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 67739us
I20260709 13:17:01.381459  9058 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:01.382910  9039 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.383718  8985 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.384644  8987 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 6, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:01.381326  3117 raft_consensus.cc:2889] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:01.350793  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 44335.8us
I20260709 13:17:01.366232  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:01.366816  9029 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:01.374460  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:01.350216  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 77972.6us
I20260709 13:17:01.395282  3090 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:01.404173  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:01.406720  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:01.407621  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.407691  3796 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:17:01.413044  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:01.414945  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.418143  3200 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:01.415936  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:01.416725  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.418926  3192 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:01.417304  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.420243  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.420989  3200 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
I20260709 13:17:01.423314  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.424626  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.430855  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:01.440630  3200 raft_consensus.cc:2410] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:17:01.442006  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:01.442695  3196 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:01.439579  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:01.442800  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:01.444335  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.445724  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:01.445904  3123 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 16: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:01.446859  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:01.447532  3793 raft_consensus.cc:2955] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 8 to 12, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:01.446930  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.452665  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:01.454967  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.456104  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.466884  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.467478  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:01.424654  9019 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:01.473776  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:01.470798  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.473871  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:01.474453  3796 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:01.474742  3791 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:17:01.439350  8739 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.374071  9002 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.364708  9061 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.444957  8358 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.487215  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.489449  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.487881  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:01.452574  9053 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:01.411746  9029 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.497803  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.499985  3049 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:17:01.500941  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.504256  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.468636  9023 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.499797  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.472863  9019 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:01.524899  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.522553  3195 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:01.479027  9060 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:01.537578  3042 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 16: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:01.534369  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.546844  3194 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 18: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:01.552471  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:01.566797  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:01.496604  9053 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.570480  3117 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 16: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:01.550734  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.588732  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.589601  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:01.592871  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.537331  9019 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:01.595002  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.546160  9060 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.536643  9057 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.601588  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:01.497320  8358 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.491479  9056 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:17:01.491878  8739 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.510437  8926 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.629376  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2615) took 1939 ms. Trace:
I20260709 13:17:01.593675  3042 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:01.635018  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.652460  3048 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:01.652627  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.653450  3194 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:01.603030  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 115139us
I20260709 13:17:01.621757  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.653904  3042 raft_consensus.cc:2410] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 13:17:01.632861  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.640774  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.655953  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.656560  3125 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
I20260709 13:17:01.656579  3761 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:01.658406  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.570514  9049 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.654706  3121 rpcz_store.cc:276] 0709 13:16:59.689556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.690022 (+   466us) service_pool.cc:224] Handling call
0709 13:16:59.706264 (+ 16242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.796205 (+ 89941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.796250 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:59.796308 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:59.796370 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.629026 (+1832656us) spinlock_profiling.cc:243] Waited 89.6 ms on lock 0x7b54003e7e54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:01.629097 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.629290 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205975936}
I20260709 13:17:01.588161  9053 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:01.610054  8863 consensus_meta.cc:287] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.710s	user 0.012s	sys 0.000s
I20260709 13:17:01.662976  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:01.663213  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.657701  3043 raft_consensus.cc:2393] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 15: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:01.663345  8822 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:01.657559  9060 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:01.678416  8851 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:01.679610  9029 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.680807  9072 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:17:01.687014  3196 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:17:01.689234  9002 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.706620  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.639475  9067 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.716827  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:01.674531  9061 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.700899  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.618412  9012 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:17:01.709576  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.719206  3121 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:01.719228  3796 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
W20260709 13:17:01.715682  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 56785.4us
I20260709 13:17:01.690122  3119 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 17: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:01.687834  9013 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.721534  3761 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:01.699223  8822 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.728191  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.737852  8822 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:01.738221  3125 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 21: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:01.738431  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.739109  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:01.728127  9023 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:01.733083  3795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 715) took 1612 ms. Trace:
I20260709 13:17:01.701988  9059 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.743278  3795 rpcz_store.cc:276] 0709 13:17:00.121058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.121586 (+   528us) service_pool.cc:224] Handling call
0709 13:17:00.121883 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.226763 (+104880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.732828 (+1506065us) spinlock_profiling.cc:243] Waited 63.9 ms on lock 0x7b54004be954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:01.733019 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146881280}
I20260709 13:17:01.734773  8926 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.736001  8932 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:01.739199  3044 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:01.731606  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.739655  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.748713  3123 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:01.749382  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:01.741698  3192 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:01.750903  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:01.720875  8960 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:01.753182  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:01.755074  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.755761  9059 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.756633  9049 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:01.756659  9066 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.786091  8958 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:01.786532  8730 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.757385  9048 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:01.759205  9040 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.810s	user 0.003s	sys 0.000s
I20260709 13:17:01.759791  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:01.761106  3042 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:17:01.761647  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:01.762408  8739 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.763336  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:01.789950  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.764990  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:01.791194  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.766209  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:01.793426  3795 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:17:01.769254  8858 raft_consensus.cc:3055] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:01.770970  9004 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.766937  3049 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:01.779484  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:01.780694  3090 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:01.768415  8926 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.700703  8863 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:01.783926  3194 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:17:01.799678  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:01.801564  3090 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:01.802943  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.803606  3121 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:01.777156  8358 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.725188  9012 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:01.799054  8858 raft_consensus.cc:740] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:01.819044  8858 consensus_queue.cc:260] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.820549  8858 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:01.804975  8926 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.825592  8926 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.814102  9047 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:01.786231  9066 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.823643  9048 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:01.833200  3797 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: []
W20260709 13:17:01.833755  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.724028  9067 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.838114  9067 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.838835  3117 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:01.803996  8730 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:01.805599  9016 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:01.829267  8822 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:01.935768  8863 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.840993  9048 raft_consensus.cc:697] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:01.959440  3761 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:01.485359  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:01.951013  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.953008  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.928876  9016 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:01.970511  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.928416  9013 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:01.951346  9044 log.cc:927] Time spent T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.993s	user 0.000s	sys 0.002s
I20260709 13:17:01.931227  8926 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:01.984699  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.943280  9056 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.980018  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:01.989207  3118 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:17:01.991065  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:01.991792  3118 raft_consensus.cc:2368] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17.
I20260709 13:17:01.964677  9066 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.996366  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:01.967841  9004 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:01.981393  9016 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:02.001770  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:01.997026  3118 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:02.003600  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:02.004200  3118 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:01.981622  9010 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:01.986395  8630 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.945647  9053 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:01.995095  8926 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:01.956708  9060 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:01.949541  8461 raft_consensus.cc:2955] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 8 to 12, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:02.015735  9034 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:02.019598  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:01.983397  8739 consensus_queue.cc:1059] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:17:02.021073  3015 leader_election.cc:400] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17.
I20260709 13:17:01.994112  9012 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:01.985347  9007 consensus_queue.cc:1059] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:17:02.000597  9061 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:01.954593  9048 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:02.023708  9002 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:02.030313  9002 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:02.030759  9002 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:02.032922  3797 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 984) took 1156 ms. Trace:
I20260709 13:17:02.033433  3797 rpcz_store.cc:276] 0709 13:17:00.876641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.879052 (+  2411us) service_pool.cc:224] Handling call
0709 13:17:00.879380 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.833632 (+954252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.032611 (+198979us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b54005a5354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:02.032847 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2193066368}
I20260709 13:17:02.036300  8637 raft_consensus.cc:3055] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:02.036897  8637 raft_consensus.cc:740] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:02.024358  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3096) took 1575 ms. Trace:
I20260709 13:17:02.039829  3047 rpcz_store.cc:276] 0709 13:17:00.448780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.448912 (+   132us) service_pool.cc:224] Handling call
0709 13:17:00.449259 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.585902 (+136643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.585947 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:00.586510 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:17:00.714527 (+128017us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:00.714584 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.330650 (+616066us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54001ae5d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:01.330704 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:01.950751 (+620047us) spinlock_profiling.cc:243] Waited 8.9 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:02.024121 (+ 73370us) raft_consensus.cc:1685] finished
0709 13:17:02.024145 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.024294 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":428,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":19472,"spinlock_wait_cycles":332597376,"thread_start_us":86617,"threads_started":1,"wal-append.queue_time_us":342651}
I20260709 13:17:02.010039  9059 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:02.052953  3091 leader_election.cc:400] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15.
I20260709 13:17:02.023589  3015 leader_election.cc:403] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:17:02.007875  9004 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:02.070107  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:02.072283  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:02.073705  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:02.075461  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:02.077400  3049 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:02.078233  3050 raft_consensus.cc:2410] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:17:02.078613  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:02.078785  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:02.079545  3049 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:02.079399  3118 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:02.082273  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:02.084421  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 63514us
I20260709 13:17:02.085242  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:02.086527  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.087198  8926 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:02.064199  9057 raft_consensus.cc:3055] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:02.088007  9057 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:02.089105  8842 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:02.088908  9057 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:02.090389  9057 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:02.093026  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:02.097892  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:02.099226  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:02.099370  8822 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:02.100549  8989 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:02.102890  9053 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:02.103803  3792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 778) took 1483 ms. Trace:
I20260709 13:17:02.104166  3792 rpcz_store.cc:276] 0709 13:17:00.620908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.621545 (+   637us) service_pool.cc:224] Handling call
0709 13:17:02.103577 (+1482032us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54005f0fd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:02.103724 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1397890176}
I20260709 13:17:02.106046  9004 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:02.106985  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 385770us
I20260709 13:17:02.107443  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:02.108105  3117 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:02.019984  8630 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:02.110711  3044 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:02.111057  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:02.111833  3117 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 17: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:02.112103  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:02.112845  3792 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:17:02.113886  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:02.114100  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:02.119109  3124 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:17:02.116578  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:02.064162  9007 raft_consensus.cc:3055] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:17:02.123720  3122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55318 (request call id 1022) took 1405 ms (client timeout 1510 ms). Trace:
I20260709 13:17:02.121531  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:02.130460  3117 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:02.132411  3049 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
W20260709 13:17:02.124161  3122 rpcz_store.cc:269] 0709 13:17:00.712372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.712532 (+   160us) service_pool.cc:224] Handling call
0709 13:17:02.117295 (+1404763us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b5400301bd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:02.117446 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":867886976}
I20260709 13:17:02.120282  9007 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:02.083691  8637 consensus_queue.cc:260] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:02.137537  3121 raft_consensus.cc:2410] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 16 because replica has last-logged OpId of term: 14 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 5.
I20260709 13:17:02.120986  9004 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:02.139561  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:02.110502  9060 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:02.138082  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:02.156879  3118 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:02.146130  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:02.150175  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:02.133481  8920 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:02.136837  8926 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:02.160060  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:02.162192  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:02.141852  9059 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17.
I20260709 13:17:02.162871  3122 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:02.168378  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:02.169238  3122 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:02.172863  9002 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:02.178169  3120 raft_consensus.cc:2410] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
W20260709 13:17:02.178376  9019 consensus_meta.cc:287] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.548s	user 0.014s	sys 0.005s
I20260709 13:17:02.178867  9019 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:02.179453  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:02.180258  3049 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:02.181128  9019 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:02.180258  3125 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:02.184015  8966 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.184530  8966 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:02.158051  8739 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:02.188977  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:02.189683  3123 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:02.190109  3792 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:02.191525  8962 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:02.191908  9007 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:02.193289  9007 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:02.160717  9060 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:02.194238  9060 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:02.195778  9016 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:02.196343  9060 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:02.202451  3119 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 16: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:02.168780  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:02.203153  3049 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:02.204391  3762 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:02.204746  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:02.205478  3047 raft_consensus.cc:2410] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:17:02.174453  3117 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:02.175137  8630 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:02.175938  8920 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:02.208389  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:02.205982  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:02.177583  9061 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:02.209609  3122 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:02.213958  3125 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:17:02.217289  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:02.218448  3122 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:02.166846  8858 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:02.222160  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:02.224502  3122 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:17:02.226138  3762 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:02.229117  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:02.235329  3117 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:02.235903  3118 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:02.236572  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:02.206918  8926 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:02.246706  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:02.247509  3045 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:02.235272  9072 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:02.244136  9002 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:02.244616  9061 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:02.208117  9076 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:17:02.245620  9031 log.cc:927] Time spent T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 1.402s	user 0.000s	sys 0.011s
I20260709 13:17:02.238298  9025 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:02.217900  9057 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:02.247622  3049 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:02.241581  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:02.250917  9061 raft_consensus.cc:697] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:02.233209  9004 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:02.251600  9076 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:02.253545  8920 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:02.253620  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:02.275349  3044 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:02.276407  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:02.255411  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:02.277763  3050 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:17:02.257200  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:02.277664  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:02.258924  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:02.280154  3049 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:02.260617  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:02.263459  9016 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:02.273223  9057 raft_consensus.cc:697] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 16 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:02.276702  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:02.263973  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:02.264415  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:02.273837  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:02.290145  3194 raft_consensus.cc:2368] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17.
I20260709 13:17:02.262665  8739 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:02.283243  9010 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:02.283977  9061 consensus_queue.cc:237] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:02.296060  3045 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:02.260902  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:02.286796  3050 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:17:02.291410  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:02.282030  3195 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:02.299942  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:02.301347  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:02.301851  9004 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:02.306896  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:02.309455  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:02.311733  3192 raft_consensus.cc:1275] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:02.313035  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:02.302421  9004 raft_consensus.cc:697] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:02.310328  3200 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:17:02.327522  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:02.330585  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:02.333906  3043 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:02.334363  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:02.338066  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:02.337595  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:02.339324  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:02.339825  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:02.340518  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:02.342141  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 331415us
W20260709 13:17:02.345048  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 222945us
I20260709 13:17:02.345755  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:02.326337  8920 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:02.348613  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:02.351051  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:02.351995  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:02.351919  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:02.352666  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:02.353396  3790 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:02.353855  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:02.337339  8858 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:02.297494  8739 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:02.360565  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:02.342612  9002 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:02.342665  8926 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:02.364969  3790 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEARNER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:02.364594  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:02.368412  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:02.369069  3117 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:02.369393  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:02.347023  9065 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:02.301347  9057 consensus_queue.cc:237] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:02.357676  8936 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:17:02.382211  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.341156  8823 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:17:02.350407  9086 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.345309  8834 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:02.365598  8849 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:02.366216  8991 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:02.413298  8991 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:02.413992  9010 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:02.414542  9010 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:02.415835  8991 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:02.416738  9010 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:02.356480  8958 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
W20260709 13:17:02.418613  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.391088  3164 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:02.419168  9007 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:02.419364  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:02.362723  8858 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:02.419975  9060 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:02.420607  8858 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:02.384778  8461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60578 (request call id 5) took 3959 ms. Trace:
I20260709 13:17:02.370043  8755 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:02.396793  9076 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:02.421303  8461 rpcz_store.cc:276] 0709 13:16:58.407095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.412647 (+  5552us) service_pool.cc:224] Handling call
0709 13:16:59.228098 (+815451us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b54002e16a0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff830330520 00007ff8303b9b42 00007ff8303b8800 00007ff8303b19fa 00007ff8353794c9 00007ff82e8f5c54 00007ff82e8f5be2 00007ff82e8f5b11 00007ff82e8f5a8c 00007ff82e8f4d42
0709 13:16:59.238988 (+ 10890us) log.cc:844] Serialized 501 byte log entry
0709 13:16:59.454498 (+215510us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b54002e16a0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83032c142 00007ff83030ceaa 00007ff830313d53 00007ff830313cd9 00007ff830313c69 00007ff830313c31 00007ff830312dfd 000000000038f354 000000000038f199 00007ff82d2c6475
0709 13:16:59.460492 (+  5994us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b54002e16a0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff830328dbe 00007ff830333930 00007ff8303338d8 00007ff830333858 00007ff830333813 00007ff830332a9c 00007ff83621e626 00007ff836218dd8 00007ff83036f7cb 00007ff8303722c0
0709 13:17:02.366290 (+2905798us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":197056,"raft.queue_time_us":4627,"raft.run_cpu_time_us":2854,"raft.run_wall_time_us":89786,"spinlock_wait_cycles":48803840,"thread_start_us":147938,"threads_started":1,"wal-append.queue_time_us":162132,"wal-append.run_cpu_time_us":4973,"wal-append.run_wall_time_us":1065186}
I20260709 13:17:02.367491  8926 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:02.425647  8926 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:02.426081  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:02.347798  8915 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:02.356791  8920 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:02.385543  9065 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.449682  3043 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:02.387708  9004 consensus_queue.cc:237] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:02.371929  8780 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:02.407377  8742 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:02.501968  8742 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.502434  8742 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:02.399087  8834 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.505538  8920 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:02.505954  8834 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:02.410356  8851 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:02.393652  9087 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:02.418424  8958 raft_consensus.cc:3055] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:02.419492  8739 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:02.420637  9060 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.420172  3126 raft_consensus.cc:2393] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 18: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:02.421121  9086 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:02.366920  9002 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:02.425724  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:02.420341  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:02.386777  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:02.435072  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:02.405850  9032 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:02.399271  8849 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.472889  8755 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:02.473246  8989 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:02.451256  9065 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:02.397442  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 51837.6us
I20260709 13:17:02.450304  8915 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:02.455772  3117 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:02.678959  3117 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:02.679536  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2636) took 1179 ms. Trace:
I20260709 13:17:02.497082  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2370) took 1654 ms. Trace:
I20260709 13:17:02.680341  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:02.680313  3124 rpcz_store.cc:276] 0709 13:17:00.842319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.842686 (+   367us) service_pool.cc:224] Handling call
0709 13:17:02.118859 (+1276173us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:02.122096 (+  3237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.496773 (+374677us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400301bd0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:02.496996 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2934163712}
I20260709 13:17:02.682135  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2640) took 1086 ms. Trace:
I20260709 13:17:02.682296  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:02.682437  3124 rpcz_store.cc:276] 0709 13:17:01.595414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.681402 (+1085988us) service_pool.cc:224] Handling call
0709 13:17:02.681651 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.681833 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:02.681865 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:02.681906 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:02.681935 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.681982 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.682087 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:02.527731  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:02.528789  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:02.529680  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:02.530644  3090 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:02.510586  8851 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:02.628710  3121 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:02.514279  8780 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:02.686936  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:02.630347  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 210070us
I20260709 13:17:02.524469  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fcf5db67d30f487d873766886c2ef408 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 5)
I20260709 13:17:02.689375  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:02.689956  2934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 165533us
I20260709 13:17:02.638406  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2626) took 1253 ms. Trace:
I20260709 13:17:02.690598  3123 rpcz_store.cc:276] 0709 13:17:01.384701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.499552 (+1114851us) service_pool.cc:224] Handling call
0709 13:17:02.637551 (+137999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.637813 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:02.637851 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:02.637920 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:02.637969 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.638160 (+   191us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.638324 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:02.666886  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:02.664008  8849 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:02.671950  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:02.674605  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.674767  3761 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:02.694072  8932 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:02.694484  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:02.677618  3015 leader_election.cc:400] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17.
I20260709 13:17:02.629161  3790 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:02.695560  8851 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:02.697932  8960 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:02.698783  8960 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:02.699303  8960 raft_consensus.cc:697] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:02.700215  8960 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:02.686160  3051 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 17: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:02.679844  3117 rpcz_store.cc:276] 0709 13:17:01.500422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.678567 (+1178145us) service_pool.cc:224] Handling call
0709 13:17:02.678815 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.679331 (+   516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.679489 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:02.702150  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 171678us
I20260709 13:17:02.702605  9063 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:02.628419  9002 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:02.629606  9060 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:02.705090  3117 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:17:02.706691  3117 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18. Ops: []
W20260709 13:17:02.706965  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.697424  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:02.693408  8915 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:02.708854  3117 raft_consensus.cc:1275] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:02.669353  9087 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:02.715767  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2641) took 1112 ms. Trace:
I20260709 13:17:02.714805  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:02.716527  3193 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:02.716296  3124 rpcz_store.cc:276] 0709 13:17:01.603775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.684479 (+1080704us) service_pool.cc:224] Handling call
0709 13:17:02.684734 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.715431 (+ 30697us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:02.715460 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:02.715511 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:02.715548 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.715605 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.715718 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28830}
I20260709 13:17:02.717940  3124 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:02.718312  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:02.712730  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:02.712908  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:02.704908  3090 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:02.515496  8958 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:02.719547  3121 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:02.715009  3790 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:02.721025  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:02.724095  3165 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:02.731148  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:02.732434  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:02.724875  3123 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:17:02.694507  8932 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.715816  9087 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.739600  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:02.733151  3123 pending_rounds.cc:85] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 9
I20260709 13:17:02.741709  3123 pending_rounds.cc:107] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:17:02.742029  3123 raft_consensus.cc:2889] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:02.742527  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:02.742691  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2642) took 1111 ms. Trace:
I20260709 13:17:02.743152  3123 rpcz_store.cc:276] 0709 13:17:01.631263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.691569 (+1060306us) service_pool.cc:224] Handling call
0709 13:17:02.724642 (+ 33073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.742455 (+ 17813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.742639 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:02.734867  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:02.735033  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 2382) took 1223 ms. Trace:
I20260709 13:17:02.735261  3790 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:02.735970  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:02.747886  3165 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:02.722360  8781 consensus_queue.cc:1059] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:17:02.737962  9061 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:02.738343  8932 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:02.754590  3198 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:02.746141  3125 rpcz_store.cc:276] 0709 13:17:01.511160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.777865 (+266705us) service_pool.cc:224] Handling call
0709 13:17:02.734885 (+957020us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b540031ae54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:02.734981 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886147328}
I20260709 13:17:02.722329  9004 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:02.750813  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:02.751832  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:02.753623  8915 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:02.762300  8915 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:02.762755  8915 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:02.763706  8780 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:02.766654  8637 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:02.771605  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55318 (request call id 1034) took 1042 ms. Trace:
I20260709 13:17:02.772029  3119 rpcz_store.cc:276] 0709 13:17:01.729626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.970324 (+240698us) service_pool.cc:224] Handling call
0709 13:17:02.771370 (+801046us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b540011c1d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:02.771528 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529350016}
I20260709 13:17:02.774032  3126 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:02.775434  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2635) took 1278 ms. Trace:
I20260709 13:17:02.775820  3126 rpcz_store.cc:276] 0709 13:17:01.497135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.653185 (+1156050us) service_pool.cc:224] Handling call
0709 13:17:02.773826 (+120641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.774488 (+   662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.775231 (+   743us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540011c1d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:02.775372 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276402560}
I20260709 13:17:02.734400  9045 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:02.719899  8859 consensus_queue.cc:1059] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:17:02.778756  9086 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:02.779145  3120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55318 (request call id 1023) took 2057 ms (client timeout 1695 ms). Trace:
I20260709 13:17:02.750855  9087 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:02.779682  3120 rpcz_store.cc:269] 0709 13:17:00.722007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.722186 (+   179us) service_pool.cc:224] Handling call
0709 13:17:02.778901 (+2056715us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b540010d954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:02.779064 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3345663232}
I20260709 13:17:02.754601  9025 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:02.719767  9094 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 13:17:02.798978  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 47226.3us
I20260709 13:17:02.800132  8958 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:02.801342  8958 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:02.808238  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.811455  8841 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:02.812142  8841 raft_consensus.cc:697] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:02.814043  9045 raft_consensus.cc:697] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:17:02.814383  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.815150  9045 consensus_queue.cc:237] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:02.778100  3795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 716) took 1025 ms. Trace:
I20260709 13:17:02.822085  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:02.821782  3795 rpcz_store.cc:276] 0709 13:17:01.752564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.752720 (+   156us) service_pool.cc:224] Handling call
0709 13:17:01.753167 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:01.794126 (+ 40959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.777722 (+983596us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b5400627fd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:02.778022 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92025600}
I20260709 13:17:02.813071  8841 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:02.828269  3762 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:02.830588  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:02.705925  8858 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:02.753844  9057 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:02.839928  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 92114.4us
I20260709 13:17:02.728271  9010 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.102s
I20260709 13:17:02.839098  3797 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:02.757754  9092 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:02.837080  9076 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:02.842468  8859 raft_consensus.cc:3055] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:02.840204  8999 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:02.850405  9092 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:02.851814  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 52316.1us
I20260709 13:17:02.841043  9057 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:02.843894  8936 raft_consensus.cc:697] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:02.851851  8859 raft_consensus.cc:740] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:02.866379  3165 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:02.871912  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:02.858063  9076 raft_consensus.cc:697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:02.867985  9057 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:02.855329  8461 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:17:02.859651  8740 consensus_queue.cc:1059] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:17:02.870030  8780 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:17:02.897498  8858 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:02.907095  8755 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:02.953219  3193 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:02.912060  8461 raft_consensus.cc:3055] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:02.961401  9092 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:02.954169  8936 consensus_queue.cc:237] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:02.964150  9060 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:02.983883  8966 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:02.953188  9048 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.994910  8849 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:02.997196  8849 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:02.997424  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:02.997762  9072 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:02.998133  3799 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:02.998373  9072 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:02.999603  9002 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.000489  9072 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:02.976251  8461 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:03.005551  3797 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:03.005925  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:02.950632  8859 consensus_queue.cc:260] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.001708  9002 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:03.033409  8991 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:02.997509  8742 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.004472  8932 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.051348  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:03.001993  9048 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:03.073100  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 243000us
I20260709 13:17:03.085481  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:03.099709  8932 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:02.992884  9076 consensus_queue.cc:237] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:03.078488  9092 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:03.102936  9085 raft_consensus.cc:3055] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:03.103420  9085 raft_consensus.cc:740] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:03.104292  9085 consensus_queue.cc:260] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:03.104959  9065 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.039517  9032 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:17:03.051750  8859 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:03.116232  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 251057us
I20260709 13:17:03.053504  8991 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.002806  8461 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.110708  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:03.124651  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:03.107821  9085 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:03.134608  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.136135  3197 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:03.139127  3049 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:03.139643  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:03.133450  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:03.142151  3126 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:17:03.144169  3118 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:17:03.144080  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:03.144861  3126 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:03.142375  3091 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:03.149065  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:03.145766  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:03.151990  3118 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:03.152186  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:03.152678  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:03.156414  3792 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:03.118702  8991 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:03.159657  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:03.164441  3091 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:03.155869  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 289554us
I20260709 13:17:03.166612  3165 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:03.190587  3126 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:03.192194  3792 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:03.139282  9092 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:03.193687  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:03.197916  3195 raft_consensus.cc:2368] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17.
I20260709 13:17:03.194942  3198 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 18: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:03.198576  3165 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:03.200856  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 47202.8us
I20260709 13:17:03.212628  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:03.155042  8461 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:03.220219  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 55867.4us
I20260709 13:17:03.222510  3091 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:03.139529  8932 consensus_queue.cc:1059] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
W20260709 13:17:03.198165  8834 consensus_meta.cc:287] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.692s	user 0.011s	sys 0.000s
I20260709 13:17:03.234727  3120 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:03.159535  8780 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:03.141562  9059 consensus_queue.cc:1059] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:17:03.197386  9045 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:03.238087  3091 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:03.239647  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 48708.2us
I20260709 13:17:03.254396  3091 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:03.153877  8989 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:17:03.160873  8781 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:17:03.262821  3091 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:03.228358  9007 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:03.265304  8755 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:03.244755  8630 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:03.271986  8841 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:17:03.272429  8932 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:03.265616  8851 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:03.229172  9104 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:03.196118  9096 consensus_queue.cc:1059] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.101s
I20260709 13:17:03.240163  9060 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:03.253433  9045 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:03.318570  9045 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:03.263516  9016 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:03.326757  9065 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:03.334784  9107 log.cc:927] Time spent T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:17:03.344563  8926 consensus_meta.cc:287] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.918s	user 0.010s	sys 0.000s
I20260709 13:17:03.256273  8780 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.351287  8742 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:03.302484  8873 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:03.241003  8834 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.356333  8834 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:03.364110  8849 raft_consensus.cc:3055] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:03.364540  8849 raft_consensus.cc:740] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:03.365327  8849 consensus_queue.cc:260] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.366632  8849 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:03.366968  9108 consensus_queue.cc:1059] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:03.369220  9060 raft_consensus.cc:3055] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:03.369943  9060 raft_consensus.cc:740] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:17:03.371420  8915 consensus_meta.cc:287] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.608s	user 0.007s	sys 0.003s
I20260709 13:17:03.371959  8915 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:17:03.361300  9048 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:03.274864  9094 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
W20260709 13:17:03.388245  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 261107us
I20260709 13:17:03.351760  8780 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:03.419276  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 147922us
W20260709 13:17:03.365619  9061 consensus_meta.cc:287] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.000s
W20260709 13:17:03.438342  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 239836us
I20260709 13:17:03.440979  3165 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:03.378110  9112 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:17:03.429961  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 204529us
I20260709 13:17:03.345271  8926 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:03.377712  9087 consensus_meta.cc:287] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.000s
I20260709 13:17:03.442420  3091 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:03.452560  3015 leader_election.cc:400] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17.
I20260709 13:17:03.457813  3015 leader_election.cc:403] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:03.443675  8958 consensus_meta.cc:287] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.642s	user 0.010s	sys 0.000s
I20260709 13:17:03.464301  3091 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:03.470480  8966 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:03.470727  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:03.470963  8966 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.471355  8966 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:03.471506  3198 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:03.474017  9117 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:03.474582  8739 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:03.475126  8739 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.476125  3091 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:03.477021  3091 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:03.477530  8637 consensus_meta.cc:287] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.710s	user 0.011s	sys 0.002s
I20260709 13:17:03.477954  8630 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:03.478119  8637 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:03.478461  8630 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.478618  8637 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.478914  8630 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:03.479051  8637 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:03.479349  9104 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:03.482121  8915 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:03.481671  8966 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.468466  8851 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:03.485772  8851 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:03.487036  8966 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:03.486788  8851 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.450434  9061 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:03.489881  9061 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:03.490613  9061 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:03.458878  8740 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:03.461937  9087 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:03.494051  8740 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:03.494851  3200 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:03.494984  8740 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.496182  8740 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:03.496313  9087 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:03.503108  8637 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.507053  8637 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:03.507725  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:03.509527  9110 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
W20260709 13:17:03.483033  9057 consensus_meta.cc:287] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.000s
I20260709 13:17:03.469668  3165 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:03.529975  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:03.532752  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 257479us
I20260709 13:17:03.538235  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:03.467760  8834 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:17:03.458364  9065 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
W20260709 13:17:03.549638  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 80098.2us
I20260709 13:17:03.551826  3165 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:03.557333  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:03.557458  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.554759  8932 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:03.572386  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 141977us
I20260709 13:17:03.532100  9057 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:03.564239  9113 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:03.590919  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 112031us
I20260709 13:17:03.593864  3045 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:03.593710  3091 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:03.576280  9115 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.601766  3042 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:17:03.602209  3042 pending_rounds.cc:85] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 12
I20260709 13:17:03.602496  3042 pending_rounds.cc:107] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:17:03.602788  3042 raft_consensus.cc:2889] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:03.611079  9045 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.602123  9115 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:03.604080  9048 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:03.621023  3042 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:03.591756  8991 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:03.636670  3165 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:03.643373  8991 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:03.644395  8630 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.646428  9061 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:03.649952  9059 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.650579  9094 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.651587  9057 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:03.651258  9094 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:03.655699  9094 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:03.650547  9059 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.658209  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:03.661514  3165 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:03.658824  9057 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:03.664870  9057 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:03.667398  9057 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:03.662796  9094 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:03.668183  9094 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.626837  8936 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:17:03.670507  9094 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:03.671905  9059 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:03.672372  8834 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17.
I20260709 13:17:03.663256  8920 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:03.678396  8630 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:03.663908  9114 log.cc:927] Time spent T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.322s	user 0.004s	sys 0.000s
I20260709 13:17:03.636737  8960 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 13:17:03.683028  9111 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 13:17:03.687870  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1036) took 1343 ms. Trace:
I20260709 13:17:03.688364  3165 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:03.688338  3124 rpcz_store.cc:276] 0709 13:17:02.344115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.719291 (+375176us) service_pool.cc:224] Handling call
0709 13:17:02.719571 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:02.719904 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:17:02.769771 (+ 49867us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b18001a9140. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c3455 00007ff833dab3c7 00007ff8303bd9a7 00007ff8303cd0bf 00007ff8303cd038
0709 13:17:03.036986 (+267215us) log.cc:844] Serialized 14 byte log entry
0709 13:17:03.237601 (+200615us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:03.239202 (+  1601us) log.cc:844] Serialized 26 byte log entry
0709 13:17:03.239397 (+   195us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:17:03.239433 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.239501 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:03.649293 (+409792us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:03.687626 (+ 38333us) raft_consensus.cc:1685] finished
0709 13:17:03.687649 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.687805 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26725,"prepare.queue_time_us":254552,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":2635,"raft.queue_time_us":13442,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":20543,"spinlock_wait_cycles":125000320,"thread_start_us":456171,"threads_started":2,"wal-append.queue_time_us":303182}
I20260709 13:17:03.689997  3165 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:03.691907  9060 consensus_queue.cc:260] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:03.693305  9060 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:03.690263  9120 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:03.694931  9057 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:03.696825  8936 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:03.700147  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:03.732687  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:03.733109  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:03.735077  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:03.735723  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:03.694943  8740 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:03.737983  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:03.756863  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:03.758673  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:03.759364  3792 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:03.762189  3164 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:03.767030  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:03.767540  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:03.767861  3124 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:03.768141  3044 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:03.768985  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:03.770117  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:03.770226  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:03.770851  3120 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:03.760504  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:03.783452  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:03.785938  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:03.787765  3197 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:03.788098  3195 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:17:03.788808  3195 pending_rounds.cc:85] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 10
I20260709 13:17:03.789039  3195 pending_rounds.cc:107] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:17:03.789376  3195 raft_consensus.cc:2889] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:03.791276  3119 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:03.789911  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:03.789060  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:03.799328  3051 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:03.799912  3122 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 17: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:03.802089  3120 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:03.729992  8858 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.698760  8960 consensus_queue.cc:1059] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 13:17:03.829775  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:03.830312  3118 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:17:03.830747  3200 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 18: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:03.737974  8834 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:03.808151  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:03.791278  9059 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:03.807199  8991 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.723232  8461 consensus_queue.cc:1059] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:17:03.753196  9094 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:03.840896  3122 pending_rounds.cc:85] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 5
I20260709 13:17:03.841416  3122 pending_rounds.cc:107] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 14.6
I20260709 13:17:03.841760  3122 raft_consensus.cc:2889] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:03.843950  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:03.847615  3125 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:03.782409  8630 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.791672  9120 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:03.856235  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:03.803622  9121 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:03.807276  9061 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.857139  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:03.829463  9065 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:03.859623  9057 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.861019  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:03.886899  3051 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:03.862251  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:03.807626  8849 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:03.889434  3164 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:03.858716  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 74795.1us
I20260709 13:17:03.917109  3762 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:03.917757  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:03.865293  3200 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:03.859472  9140 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:03.856930  9072 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:03.838999  9004 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.870479  3118 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:03.872926  9115 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:03.850847  9059 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.887960  3198 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:03.892666  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:03.956347  3048 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:03.919530  3044 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:03.919927  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:03.919575  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:03.863786  9120 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:03.959329  3200 raft_consensus.cc:2410] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:17:03.922971  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:03.960369  9132 log.cc:927] Time spent T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:17:03.864868  8936 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 13:17:03.961380  9126 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:17:03.959471  9120 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:03.949182  9140 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.964080  9140 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:03.915474  8989 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.869405  9121 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.965137  8989 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:17:03.967284  9121 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:03.967619  8989 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:03.942589  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:03.852180  9094 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:03.959550  3051 raft_consensus.cc:2393] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:03.845165  8834 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.842955  8858 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:03.970500  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.868137  9045 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:03.850714  8991 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.993798  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:03.951166  8962 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:03.863404  8630 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:04.056813  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:03.921221  9016 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.116s
I20260709 13:17:04.065552  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:04.043393  3792 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:03.950670  9085 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 13:17:04.043993  3198 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:04.072481  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:04.072800  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:04.073280  3120 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 17: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:04.074126  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:03.921804  8915 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:03.951550  9072 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:03.954385  9004 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:04.077679  3196 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:17:04.079504  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:04.080317  3120 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 18: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:04.052830  3048 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:03.887920  9061 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:03.916301  9065 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:04.060518  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:03.918277  9057 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:04.044163  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:04.070101  3797 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:03.951359  9119 consensus_queue.cc:1059] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.130s
I20260709 13:17:04.074352  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:04.075733  3119 raft_consensus.cc:2393] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:04.051206  8962 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.084633  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:04.100955  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:04.101270  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:04.062836  9121 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:04.090993  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:04.091248  3196 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:04.092258  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:04.106052  3118 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:04.097008  3193 raft_consensus.cc:1275] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:04.106690  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:04.113919  9092 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:04.165872  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:04.111449  9124 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:17:04.166725  3195 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:04.168016  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:04.169271  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 59656.5us
I20260709 13:17:04.170701  3048 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:04.173662  3792 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:04.089224  8841 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:04.179448  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:04.207572  3192 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:04.208120  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:04.180197  3047 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:04.099838  8739 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:04.103538  8962 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:04.099445  8915 raft_consensus.cc:697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:04.180531  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:04.260097  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:04.162671  9138 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:04.246999  3123 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:17:04.265857  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 85408.3us
I20260709 13:17:04.272540  3118 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:04.199724  8849 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:04.177608  9147 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:04.277478  3124 consensus_meta.cc:287] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.509s	user 0.004s	sys 0.003s
I20260709 13:17:04.181849  9007 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:17:04.288610  3124 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:04.265477  9138 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.290395  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:04.296190  3192 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:04.262315  8739 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:04.202404  9092 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:17:04.265313  9063 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:04.294394  3117 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:04.308380  3192 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:04.309258  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:04.311297  3194 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:04.261300  8841 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:04.319509  3118 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:17:04.177925  9121 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:04.320885  9148 log.cc:927] Time spent T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 13:17:04.322346  9144 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:04.322425  8926 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:04.325965  8915 consensus_queue.cc:237] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:04.327049  9145 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:17:04.312253  8739 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:04.318595  9063 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:04.330422  9105 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.309393  8991 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:04.286459  9128 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:04.305032  9138 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:04.288990  9149 raft_consensus.cc:2764] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:17:04.362795  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:04.421108  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:04.428526  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:04.390872  9092 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.365301  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:04.293674  9139 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:04.377094  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:04.434412  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:04.434705  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:04.435735  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:04.436365  3121 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:04.438177  3044 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:04.439510  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:04.440133  3044 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:04.441258  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:17:04.378489  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 112504us
I20260709 13:17:04.382532  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:04.442109  3090 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 1.600s (SENT) [suppressed 9 similar messages]
I20260709 13:17:04.410411  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:04.414785  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:04.443329  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:04.416281  9072 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:04.351420  9085 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.343786  9059 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:04.416890  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:04.454648  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:04.455497  3049 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:04.456496  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:04.420447  3119 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:17:04.427024  3043 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:04.363250  3045 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:04.457589  3044 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:04.363335  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:04.392386  8858 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:04.423048  9128 raft_consensus.cc:697] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:04.411537  8630 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:04.288671  8849 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:04.444339  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:04.446333  9106 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.447311  8739 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:04.445905  3192 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:04.449409  3165 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:04.472013  3165 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:04.472621  3192 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:17:04.417956  9094 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:04.415482  3194 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:04.423600  9105 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:04.477131  3200 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:04.464154  9149 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:04.473610  3165 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:04.477970  3191 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:04.472919  9106 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:04.466684  9004 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:04.451030  9139 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:04.458276  9085 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:04.438222  9092 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:04.467510  9059 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:04.492161  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:04.508457  9059 raft_consensus.cc:697] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:04.504572  9119 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.509661  9059 consensus_queue.cc:237] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:04.488641  9061 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:04.482016  9002 raft_consensus.cc:3055] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:04.509845  9119 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:04.515940  9002 raft_consensus.cc:740] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:04.489388  9121 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:04.489843  9128 consensus_queue.cc:237] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:04.483328  9120 consensus_meta.cc:287] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.001s
I20260709 13:17:04.508620  3126 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:04.479394  9124 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:04.478084  8913 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:04.526674  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:04.489519  8841 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:04.485662  9105 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:04.503199  8834 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:05.077207  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 620472us
W20260709 13:17:05.224661  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.230317  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:17:04.743757  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 317770us
I20260709 13:17:04.486930  9063 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:05.120787  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.245460  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:04.548648  9002 consensus_queue.cc:260] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:04.493506  8962 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:04.654994  9065 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:04.541925  9124 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:05.283941  9124 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:05.284632  3791 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:17:05.284798  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3153) took 1397 ms. Trace:
I20260709 13:17:04.482614  9127 raft_consensus.cc:3055] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:05.286197  9127 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:05.285380  3050 rpcz_store.cc:276] 0709 13:17:03.887530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.887649 (+   119us) service_pool.cc:224] Handling call
0709 13:17:03.888077 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:03.968336 (+ 80259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:03.968368 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:03.968807 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:17:04.438172 (+469365us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:04.438214 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.228663 (+790449us) spinlock_profiling.cc:243] Waited 80 ms on lock 0x7b54001d74d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:05.228742 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.228833 (+    91us) raft_consensus.cc:1685] finished
0709 13:17:05.228852 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.284508 (+ 55656us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183992576,"thread_start_us":419808,"threads_started":1,"wal-append.queue_time_us":468659}
I20260709 13:17:05.287773  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2409) took 1206 ms. Trace:
I20260709 13:17:05.288255  9127 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:05.130175  3196 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:05.127180  9072 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:04.524976  9120 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:05.290697  9072 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:05.293005  9120 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:05.293160  3049 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:17:04.513499  9138 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:04.488430  8849 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:05.150851  8873 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:05.302198  8873 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:05.302737  8873 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:04.489215  9117 raft_consensus.cc:3055] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:05.162119  9119 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:05.170310  9139 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:05.384166  9104 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.385213  9104 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:05.179253  9092 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:05.386847  9105 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:05.388249  9104 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:05.388998  8913 raft_consensus.cc:697] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:04.516824  9159 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:05.111810  3120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.003s	sys 0.006s
W20260709 13:17:05.390413  3120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.003s	sys 0.006s
I20260709 13:17:05.391083  9117 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:17:05.391254  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 917517us
I20260709 13:17:05.224947  9085 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:05.226785  9060 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.118263  3046 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:05.228580  8920 raft_consensus.cc:3055] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:05.224691  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:05.279016  8962 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:05.249158  9002 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:05.288439  3117 rpcz_store.cc:276] 0709 13:17:04.072992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.073101 (+   109us) service_pool.cc:224] Handling call
0709 13:17:04.291380 (+218279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.310392 (+ 19012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.231781 (+921389us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b540010de50. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:05.279140 (+ 47359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501354752}
W20260709 13:17:05.139413  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 681235us
I20260709 13:17:05.140448  8859 raft_consensus.cc:3055] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:05.301280  3051 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:17:05.293341  9072 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:05.318437  9065 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:05.319679  9057 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:05.323942  9106 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:05.324849  9127 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:05.325381  9138 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:05.453505  3045 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:05.454372  9065 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:05.455050  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:05.456110  3045 raft_consensus.cc:2410] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:17:05.457089  9065 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:05.457332  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:05.326535  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1137) took 1678 ms. Trace:
I20260709 13:17:05.327006  9113 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.328298  8849 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.333101  3199 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:05.340364  9120 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:05.403115  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 178776us
I20260709 13:17:05.402542  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:05.441471  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 192481us
I20260709 13:17:05.393010  9117 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:05.451505  8913 consensus_queue.cc:237] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:05.393718  3165 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:05.452278  3122 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 17. Current term is 18. Ops: [12.9-17.11]
I20260709 13:17:05.395193  8932 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:05.419683  8859 raft_consensus.cc:740] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:05.506724  8859 consensus_queue.cc:260] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:05.420060  9092 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:05.453608  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2754) took 1037 ms. Trace:
I20260709 13:17:05.325192  9108 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:05.458550  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1045) took 1368 ms. Trace:
I20260709 13:17:05.401969  8920 raft_consensus.cc:740] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:05.390568  8834 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:05.397928  9119 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:05.501513  9065 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.521289  9139 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:05.527861  9092 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:05.462229  3042 rpcz_store.cc:276] 0709 13:17:03.648231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.648422 (+   191us) service_pool.cc:224] Handling call
0709 13:17:03.648788 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.649019 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:17:03.698659 (+ 49640us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.325227 (+1626568us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b18004b8fe0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82ff5b4bc 00007ff82d2a948b 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff5323a
0709 13:17:05.325756 (+   529us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.325838 (+    82us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:05.326016 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.326131 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.326349 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1760,"prepare.queue_time_us":200304,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":2560,"raft.queue_time_us":59334,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":245,"spinlock_wait_cycles":4554496,"thread_start_us":178376,"threads_started":2,"wal-append.queue_time_us":171566,"wal-append.run_cpu_time_us":1232,"wal-append.run_wall_time_us":1001242}
I20260709 13:17:05.531483  8859 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:05.531018  8849 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:05.580019  8849 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:05.580873  8849 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:05.581821  9104 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:05.582705  9104 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:05.549449  9113 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:05.515183  3051 rpcz_store.cc:276] 0709 13:17:04.406282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.300239 (+893957us) service_pool.cc:224] Handling call
0709 13:17:05.300800 (+   561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.438200 (+137400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.443379 (+  5179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.589972  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:05.590510  3126 consensus_meta.cc:287] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.067s	user 0.011s	sys 0.009s
I20260709 13:17:05.590819  3051 raft_consensus.cc:1813] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Handling vote request from an unknown peer f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:05.591043  3126 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:05.591732  3051 raft_consensus.cc:2410] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:17:05.591845  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2655) took 1825 ms. Trace:
I20260709 13:17:05.592097  9063 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.592347  3126 rpcz_store.cc:276] 0709 13:17:03.766855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.768587 (+  1732us) service_pool.cc:224] Handling call
0709 13:17:04.492004 (+723417us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b5800003398. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff8353790a0 00007ff835378984 00007ff82e8f36d4 00007ff82e8f3662
0709 13:17:05.591755 (+1099751us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3314560}
I20260709 13:17:05.592756  9063 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:05.467439  9085 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:05.594246  9085 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:05.595026  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2842) took 1332 ms. Trace:
I20260709 13:17:05.595486  3196 rpcz_store.cc:276] 0709 13:17:04.262877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.263030 (+   153us) service_pool.cc:224] Handling call
0709 13:17:04.264673 (+  1643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.289788 (+1025115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.594640 (+304852us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54003b9554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:05.594947 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889785216}
I20260709 13:17:05.532074  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:05.555387  9117 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:05.598119  3198 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:17:05.394788  9060 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:05.600666  9063 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:05.601897  9138 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:05.560082  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:05.602769  9138 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:05.603541  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3157) took 1518 ms. Trace:
I20260709 13:17:05.556756  3761 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:05.538317  3045 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
W20260709 13:17:05.605720  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 49247us
I20260709 13:17:05.606914  3045 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:17:05.607370  3761 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:05.610087  8936 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:05.610589  9124 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:05.610936  8936 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:05.612149  9168 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:05.613061  9168 consensus_queue.cc:1059] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:17:05.558856  9120 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:05.558208  3049 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:05.560669  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:05.560923  8932 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:05.497382  8873 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:05.561847  9048 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:05.562156  9108 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:05.563023  9057 consensus_queue.cc:1059] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:05.522589  3120 rpcz_store.cc:276] 0709 13:17:04.090464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.095117 (+  4653us) service_pool.cc:224] Handling call
0709 13:17:04.095347 (+   230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:04.095633 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:17:04.432810 (+337177us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.391408 (+958598us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.392326 (+   918us) log.cc:844] Serialized 26 byte log entry
0709 13:17:05.392579 (+   253us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:05.392959 (+   380us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.393196 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.393327 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.410383 (+ 17056us) raft_consensus.cc:1685] finished
0709 13:17:05.410408 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.458486 (+ 48078us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":427202,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":108599,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":8103,"thread_start_us":1221813,"threads_started":2,"wal-append.queue_time_us":171761}
I20260709 13:17:05.564952  8920 consensus_queue.cc:260] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:05.566421  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:05.567143  8834 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:05.567934  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:05.570246  9119 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:05.570698  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 177380us
I20260709 13:17:05.571331  9159 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:05.571504  9065 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:05.544572  9139 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.574414  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:05.575951  8630 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.604281  9092 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:05.613337  9124 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:05.560081  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:05.597229  9085 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:05.601423  9060 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:05.622085  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:05.698046  8630 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:05.698953  8920 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:05.700914  3165 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:05.614269  9160 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:05.604017  3048 rpcz_store.cc:276] 0709 13:17:04.084541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.085325 (+   784us) service_pool.cc:224] Handling call
0709 13:17:04.085966 (+   641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.171076 (+ 85110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.603009 (+1431933us) spinlock_profiling.cc:243] Waited 84.2 ms on lock 0x7b540029cf54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:05.603359 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193634176}
W20260709 13:17:05.728826  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 168430us
I20260709 13:17:05.729214  3124 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:05.621217  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:05.730593  3118 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:05.730814  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:05.731468  3191 raft_consensus.cc:2410] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:17:05.640152  3198 raft_consensus.cc:1240] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:05.647684  3793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 1020) took 1153 ms. Trace:
W20260709 13:17:05.653107  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.701323  8630 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:05.733606  9057 raft_consensus.cc:3055] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:05.734234  9057 raft_consensus.cc:740] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:05.734637  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:05.623337  3119 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:17:05.651508  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:05.736661  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:05.613673  8936 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:05.661463  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 54300.8us
I20260709 13:17:05.729019  9049 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:05.605484  9138 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:05.624329  3121 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:05.641021  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:05.698091  9092 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.739694  9048 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:05.740432  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:05.740597  9092 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:05.680290  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2749) took 1305 ms. Trace:
I20260709 13:17:05.731846  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:05.743254  9092 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:05.743507  9108 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:05.697886  9139 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:05.663460  3791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 810) took 1683 ms. Trace:
I20260709 13:17:05.732636  3793 rpcz_store.cc:276] 0709 13:17:04.493958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.494134 (+   176us) service_pool.cc:224] Handling call
0709 13:17:04.494468 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:04.494815 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.494844 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:04.495300 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:17:04.584633 (+ 89333us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:04.584697 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.584805 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.647197 (+1062392us) raft_consensus.cc:1685] finished
0709 13:17:05.647251 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.647481 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1075,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":88840,"threads_started":1,"wal-append.queue_time_us":1133345}
I20260709 13:17:05.745715  9065 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:05.640614  9174 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:05.746560  9119 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:05.675158  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2741) took 1311 ms. Trace:
W20260709 13:17:05.657220  9164 log.cc:927] Time spent T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.267s	user 0.004s	sys 0.000s
I20260709 13:17:05.623517  9104 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:05.685992  8849 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.668205  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:05.619933  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:05.748387  3044 consensus_meta.cc:287] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.289s	user 0.007s	sys 0.020s
I20260709 13:17:05.639437  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:05.742717  3046 rpcz_store.cc:276] 0709 13:17:04.375250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.464612 (+ 89362us) service_pool.cc:224] Handling call
0709 13:17:04.464902 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.398457 (+933555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.679836 (+281379us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b5400074c54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:05.680218 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1407868160}
I20260709 13:17:05.743286  3118 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:05.684281  2942 catalog_manager.cc:5697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 8 to 12, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 12 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:05.750829  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:05.707417  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.731752  3120 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:05.736922  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:05.842078  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:05.738615  3761 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:05.757165  8873 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:05.757942  3195 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:05.742012  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:05.701572  8932 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:05.735466  8834 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:05.763111  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:05.778988  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.811123  3791 rpcz_store.cc:276] 0709 13:17:03.979736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.984077 (+  4341us) service_pool.cc:224] Handling call
0709 13:17:03.984528 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.285399 (+1300871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.662971 (+377572us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400627fd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:05.663356 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2933909888}
I20260709 13:17:05.826045  9049 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:05.839250  9120 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:05.840040  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:05.823359  3047 rpcz_store.cc:276] 0709 13:17:04.363211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.363903 (+   692us) service_pool.cc:224] Handling call
0709 13:17:04.364187 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.414368 (+ 50181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.414403 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:04.414448 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:04.414483 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.674565 (+1260082us) spinlock_profiling.cc:243] Waited 50 ms on lock 0x7b540028c654. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:05.674665 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.674951 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114953984}
I20260709 13:17:05.718873  9113 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:05.735482  9057 consensus_queue.cc:260] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:05.846863  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:05.731673  9159 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:05.853371  3122 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:17:05.849933  8849 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:05.858690  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:05.863059  3044 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:05.864092  9104 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:05.864190  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:05.865131  3198 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:05.867674  9057 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:05.867339  9049 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:05.869901  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:05.870105  3118 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
W20260709 13:17:05.870230  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 131786us
I20260709 13:17:05.862412  9160 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:05.870821  3196 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:05.871336  9160 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:05.872587  3123 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:05.873791  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:05.873948  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:05.866310  9168 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:05.876037  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 125418us
I20260709 13:17:05.877290  3199 raft_consensus.cc:2393] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:05.865672  3799 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:05.878419  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:05.881148  3193 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:05.870131  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:05.877334  3090 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:05.890452  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:05.895871  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:05.890266  3044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 2744) took 1520 ms (client timeout 1708 ms). Trace:
I20260709 13:17:05.893369  3795 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
W20260709 13:17:05.897665  3044 rpcz_store.cc:269] 0709 13:17:04.366595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.441051 (+ 74456us) service_pool.cc:224] Handling call
0709 13:17:05.880451 (+1439400us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.865060  8859 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:05.908855  3121 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:05.909597  8849 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:05.908847  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:05.907536  9160 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:05.943228  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:05.943544  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:05.944279  3120 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:05.910303  2942 catalog_manager.cc:5697] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 13 to 15, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 15 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:05.944664  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:05.911984  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:05.945341  3121 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:05.861131  9174 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:05.913880  9173 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:05.948207  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:05.919341  3043 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.008s	sys 0.005s
W20260709 13:17:05.949222  3043 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.008s	sys 0.005s
W20260709 13:17:05.924590  9002 consensus_meta.cc:287] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.520s	user 0.013s	sys 0.001s
I20260709 13:17:05.925417  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:05.926100  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:05.926393  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:05.930590  3762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.051s	sys 0.075s
I20260709 13:17:05.931211  9048 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:05.951200  3762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.052s	sys 0.076s
I20260709 13:17:05.934141  3164 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:05.934649  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:05.894340  9049 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:05.936462  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:05.936898  9116 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.000s	sys 0.013s
I20260709 13:17:05.957753  3118 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:05.957980  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:05.938304  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2405) took 1866 ms. Trace:
I20260709 13:17:05.915509  3090 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:05.950564  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:05.951584  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 758594us
I20260709 13:17:05.956120  3797 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:05.959766  3200 raft_consensus.cc:2393] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 18: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:05.951584  9173 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:05.961822  9173 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:05.963510  8849 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:05.964063  8849 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:05.964598  8849 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:05.964766  2943 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57732 (request call id 232) took 28409 ms (client timeout 15000 ms). Trace:
I20260709 13:17:05.965775  9065 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:05.966642  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:05.970423  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:05.966168  2942 catalog_manager.cc:5697] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 14 to 15, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 15 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:17:05.976639  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:05.980669  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 279907us
I20260709 13:17:05.966246  3194 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
W20260709 13:17:05.967641  9116 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.000s	sys 0.013s
W20260709 13:17:05.989457  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.996819  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:05.958801  3125 rpcz_store.cc:276] 0709 13:17:04.071864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.071995 (+   131us) service_pool.cc:224] Handling call
0709 13:17:04.075661 (+  3666us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:04.417563 (+341902us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.417599 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:04.418284 (+   685us) log.cc:844] Serialized 52 byte log entry
0709 13:17:04.524421 (+106137us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:04.524458 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.524527 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.656070 (+1131543us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:05.937769 (+281699us) raft_consensus.cc:1685] finished
0709 13:17:05.937795 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.938103 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100301,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":22229,"spinlock_wait_cycles":88468864,"thread_start_us":393523,"threads_started":2,"wal-append.queue_time_us":945180}
I20260709 13:17:06.001498  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:06.009322  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:06.010337  3193 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:05.980448  9174 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:05.997807  9049 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:06.015100  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:06.015136  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:06.025104  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:06.001058  9065 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:05.995801  2942 catalog_manager.cc:5697] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 7 to 15. New cstate: current_term: 15 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.023401  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:06.030665  3126 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 18: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:17:06.026772  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.032612  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.035903  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:06.012414  9127 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:06.038851  3045 raft_consensus.cc:2410] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:17:06.041903  9065 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:06.042129  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 53642.1us
I20260709 13:17:06.029246  8932 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:06.043615  8932 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:06.044067  8932 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:05.998677  9139 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
W20260709 13:17:05.965287  2943 rpcz_store.cc:269] 0709 13:16:37.555340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.555694 (+   354us) service_pool.cc:224] Handling call
0709 13:17:05.964414 (+28408720us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:58.697072 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:58.779410 (+ 82338us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:58.779485 (+    75us) write_op.cc:435] Acquired schema lock
0709 13:16:58.779535 (+    50us) tablet.cc:662] Decoding operations
0709 13:16:58.781191 (+  1656us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:58.781304 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:58.781340 (+    36us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:16:59.007868 (+226528us) tablet.cc:701] Row locks acquired
0709 13:16:59.012714 (+  4846us) write_op.cc:260] PREPARE: finished
0709 13:16:59.027491 (+ 14777us) write_op.cc:270] Start()
0709 13:16:59.027666 (+   175us) write_op.cc:276] Timestamp: P: 1783603019027416 usec, L: 0
0709 13:16:59.027688 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:16:59.028421 (+   733us) log.cc:844] Serialized 6396 byte log entry
0709 13:16:59.227251 (+198830us) op_driver.cc:464] REPLICATION: finished
0709 13:16:59.351041 (+123790us) write_op.cc:301] APPLY: starting
0709 13:16:59.351164 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:59.455193 (+104029us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:59.455319 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:00.505026 (+1049707us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:00.505447 (+   421us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 13:17:00.505492 (+    45us) write_op.cc:312] APPLY: finished
0709 13:17:00.626873 (+121381us) log.cc:844] Serialized 148 byte log entry
0709 13:17:00.850209 (+223336us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:00.861274 (+ 11065us) write_op.cc:454] Released schema lock
0709 13:17:00.888287 (+ 27013us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:00.925535 (+ 37248us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:00.935014 (+  9479us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":106049,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":114817,"apply.run_cpu_time_us":52552,"apply.run_wall_time_us":1545067,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71039,"num_ops":16,"prepare.queue_time_us":220098,"prepare.run_cpu_time_us":18682,"prepare.run_wall_time_us":362841,"raft.queue_time_us":170795,"raft.run_cpu_time_us":45480,"raft.run_wall_time_us":71412,"replication_time_us":199380,"spinlock_wait_cycles":61312,"thread_start_us":482106,"threads_started":5,"wal-append.queue_time_us":430834,"wal-append.run_cpu_time_us":31810,"wal-append.run_wall_time_us":2231708}]]}
I20260709 13:17:06.027776  9049 raft_consensus.cc:697] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:06.046257  9139 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:06.047734  3047 raft_consensus.cc:2393] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 18: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:06.048241  3050 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 18: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:06.039779  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:06.035331  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:06.049082  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 133753us
I20260709 13:17:06.043881  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:06.051226  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:06.053678  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:06.030190  9160 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:06.050630  3125 raft_consensus.cc:2376] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17. Re-sending same reply.
I20260709 13:17:06.046993  9139 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:17:06.058928  3795 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:06.049347  9174 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:06.064247  3091 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:06.067207  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.067533  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:06.067979  3047 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:06.068181  3125 raft_consensus.cc:2376] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17. Re-sending same reply.
I20260709 13:17:06.068868  3091 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:06.070037  9128 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:06.070120  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:06.071497  9065 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:06.060832  9160 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:06.072384  9123 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:06.072981  9123 raft_consensus.cc:697] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:06.073022  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:06.073887  3797 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:17:06.075943  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:06.079326  9138 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:06.078334  2942 catalog_manager.cc:5697] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 13 to 15, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 15 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:06.079450  9173 consensus_queue.cc:1059] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:17:06.080070  8461 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.011s	sys 0.048s
I20260709 13:17:06.077116  9123 consensus_queue.cc:237] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:06.076122  8834 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:06.082240  3762 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:06.053328  9127 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:06.086750  9104 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:06.079985  9138 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:06.087846  9138 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:06.085649  9048 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:06.075560  8849 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:06.046851  9049 consensus_queue.cc:237] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:06.080631  8461 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.012s	sys 0.049s
I20260709 13:17:06.089397  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:06.094065  9115 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:06.094601  9115 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:06.095031  9115 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:06.098147  3762 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:06.081557  8834 raft_consensus.cc:3055] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:06.092470  9160 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:06.112015  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.096817  9127 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:06.116891  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.118597  3047 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:17:06.106703  9105 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:06.122197  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:06.108675  9139 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:06.121306  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:06.109925  8834 raft_consensus.cc:740] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:06.145354  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:06.148703  3797 raft_consensus.cc:2393] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 18: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:06.123767  9105 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:06.152860  8849 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:06.157574  8461 consensus_queue.cc:1059] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:06.081534  2942 catalog_manager.cc:5697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 13 to 16, leader changed from <none> to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 16 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.159072  8461 raft_consensus.cc:3055] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:06.159555  8461 raft_consensus.cc:740] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:06.159471  2942 catalog_manager.cc:5697] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 9 to 11, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 11 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.174976  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:06.153952  9105 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:06.177567  8932 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:06.190285  9181 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:06.190966  9181 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:06.191458  9181 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:06.216189  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:06.196910  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:06.227182  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:06.168980  9048 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:17:06.240495  9174 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:06.240969  9174 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.241331  9174 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:06.257995  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 186988us
I20260709 13:17:06.244329  8932 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:06.267293  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:06.268440  3091 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:06.284096  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 64497.5us
I20260709 13:17:06.235755  8461 consensus_queue.cc:260] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:06.289211  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:06.266664  8630 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:06.269670  9128 raft_consensus.cc:697] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:06.290088  3792 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:06.294684  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:06.245009  8834 consensus_queue.cc:260] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:06.304852  9161 raft_consensus.cc:3055] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:06.305387  9161 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:06.306367  9161 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:06.307605  9161 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:06.307426  9138 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:06.310545  9127 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:17:06.304661  9183 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:17:06.273885  2942 catalog_manager.cc:5697] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 15 to 18, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 18 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:06.324093  2942 catalog_manager.cc:5697] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:06.326763  9184 log.cc:927] Time spent T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:17:06.345156  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.347759  3795 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:06.350844  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.297647  9085 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:06.363277  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:06.369040  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:06.370738  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.375895  3044 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:06.384158  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.351642  3050 raft_consensus.cc:2955] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 8 to 12, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:06.396436  3051 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 16: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:06.397439  3048 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:06.400635  3049 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:06.400981  3045 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: []
W20260709 13:17:06.395341  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 125110us
I20260709 13:17:06.373790  9139 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:06.404693  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 147694us
I20260709 13:17:06.410780  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:06.411085  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.413694  3046 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 18: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:06.417124  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.388895  9127 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:17:06.422107  9200 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:06.404788  9191 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:06.403415  9128 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:06.411377  8834 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:06.413432  8859 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:06.437526  8859 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:06.437923  9057 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:06.438691  8859 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:06.441134  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.429018  3051 raft_consensus.cc:2393] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 16: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:06.442744  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.443415  3051 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:06.444370  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.426277  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.413254  9138 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:06.433647  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:06.434280  9188 log.cc:927] Time spent T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:17:06.445549  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:06.401643  9085 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:06.455468  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:06.419972  8913 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:06.431407  9191 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:06.478129  9186 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:17:06.478489  9191 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:06.482007  8913 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:06.483539  9115 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:06.460695  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 87448.7us
W20260709 13:17:06.468146  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 57467.5us
I20260709 13:17:06.468737  9198 consensus_queue.cc:1059] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:06.427397  2942 catalog_manager.cc:5697] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.477047  9085 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:06.485675  8913 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:06.489272  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:06.510975  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:06.511237  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:06.511391  9159 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:06.490792  9198 raft_consensus.cc:3055] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:06.515007  9198 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:06.516396  9198 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:06.490808  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:06.518199  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:06.520287  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.522421  9065 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:06.523329  9065 raft_consensus.cc:697] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:06.491570  2942 catalog_manager.cc:5697] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:06.491840  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.449663  9063 raft_consensus.cc:3055] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:06.511718  3047 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:06.521143  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:06.501498  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:06.497342  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 97174.2us
I20260709 13:17:06.524763  9065 consensus_queue.cc:237] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:06.543256  3761 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:06.529464  2942 catalog_manager.cc:5697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.531505  9115 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:06.497962  9195 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:17:06.496708  9200 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:06.493537  9057 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:06.494074  9173 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.555589  8461 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:06.556143  9173 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:06.557828  3048 raft_consensus.cc:2393] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 16: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:17:06.548310  9179 log.cc:927] Time spent T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.393s	user 0.002s	sys 0.001s
I20260709 13:17:06.535530  9063 raft_consensus.cc:740] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:06.561146  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2750) took 2185 ms. Trace:
I20260709 13:17:06.561730  3043 rpcz_store.cc:276] 0709 13:17:04.375594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.085650 (+710056us) service_pool.cc:224] Handling call
0709 13:17:05.209726 (+124076us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.221411 (+ 11685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.221452 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.293667 (+ 72215us) log.cc:844] Serialized 26 byte log entry
0709 13:17:05.949942 (+656275us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:05.950004 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.950098 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.547517 (+597419us) spinlock_profiling.cc:243] Waited 8.42 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:06.560679 (+ 13162us) raft_consensus.cc:1685] finished
0709 13:17:06.560715 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.561059 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19365760,"thread_start_us":655520,"threads_started":1,"wal-append.queue_time_us":802955}
I20260709 13:17:06.563597  9200 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:06.564487  3049 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:17:06.566043  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.559046  9173 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:06.585675  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 222501us
W20260709 13:17:06.604302  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.606225  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 63073.6us
W20260709 13:17:06.607344  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 86322.4us
I20260709 13:17:06.608014  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:06.616264  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:06.620453  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:06.622269  3090 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:06.624091  3090 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:06.625478  9063 consensus_queue.cc:260] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:06.654174  9198 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:06.662102  2942 catalog_manager.cc:5697] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 13 to 15, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 15 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.682691  9139 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:06.685014  3044 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:17:06.692983  3051 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:06.694726  3047 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
W20260709 13:17:06.692559  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 81223.3us
I20260709 13:17:06.701589  3762 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:17:06.697395  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 265961us
W20260709 13:17:06.714865  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 107874us
W20260709 13:17:06.720293  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.720988  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 113027us
W20260709 13:17:06.699584  9201 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:17:06.714589  9160 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:06.724895  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:06.725190  9160 raft_consensus.cc:697] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:06.726497  9160 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:06.692025  8630 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:06.708822  9115 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:06.691936  9092 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:06.730458  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.730279  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:06.731325  9199 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:06.664892  2942 catalog_manager.cc:5697] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 13 to 15, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 15 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:06.732935  2942 catalog_manager.cc:5697] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.735133  2942 catalog_manager.cc:5697] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.730738  9092 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:06.706571  9175 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.738565  9192 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:06.738492  9175 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:06.739472  9092 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:06.737218  9139 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:06.740550  9139 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.741012  9139 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:06.741165  9175 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:06.731747  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:06.706226  9200 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.754550  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:06.755635  3194 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 11.
I20260709 13:17:06.715938  8859 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.763196  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:06.688097  9105 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:06.730362  9115 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.768101  9115 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:06.769333  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:06.770821  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:06.771175  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:06.771507  3191 raft_consensus.cc:2376] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19. Re-sending same reply.
I20260709 13:17:06.771936  3194 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:06.772804  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:06.773552  3197 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
W20260709 13:17:06.773429  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 149464us
I20260709 13:17:06.775986  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:06.776737  3199 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:06.776973  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:06.766870  3792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:17:06.777853  3792 raft_consensus.cc:606] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:06.778051  3197 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 16: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:06.778291  3792 raft_consensus.cc:614] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:06.778751  3196 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:17:06.767130  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:06.777863  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:06.780094  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:06.780776  3199 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:06.777269  3191 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:17:06.782239  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:06.783094  3195 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 16: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:06.783026  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:06.783749  9105 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:06.783860  3122 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:17:06.784269  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.785667  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:06.786053  3193 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:17:06.786517  3193 pending_rounds.cc:85] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 10
I20260709 13:17:06.786804  3193 pending_rounds.cc:107] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:17:06.787163  3193 raft_consensus.cc:2889] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:06.787734  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:06.789235  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.789103  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:06.792193  9063 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:06.792635  3193 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
W20260709 13:17:06.789484  9181 consensus_meta.cc:287] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.003s
I20260709 13:17:06.793799  9181 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:06.794487  8913 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:06.794664  3198 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:06.795282  3045 raft_consensus.cc:2393] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 20: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:06.795838  9049 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:06.796510  9181 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:06.798133  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:06.798913  3119 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
W20260709 13:17:06.765201  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 146065us
W20260709 13:17:06.790627  9174 consensus_meta.cc:287] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.549s	user 0.005s	sys 0.005s
I20260709 13:17:06.749805  9057 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:06.809674  3119 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:06.810539  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:06.811272  3198 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:06.752209  3761 leader_election.cc:336] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 1.710s (SENT)
I20260709 13:17:06.812690  3165 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:06.815469  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:06.817584  3191 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:06.815629  9202 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:06.820554  8932 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.820719  9202 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.821345  9202 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:06.824764  3199 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:06.816179  9085 consensus_queue.cc:1059] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:06.826504  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:06.737210  2942 catalog_manager.cc:5697] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 11 to 15, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 15 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:06.830852  9113 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:06.821233  8932 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:06.831091  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:06.831465  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:06.824155  3090 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:06.826092  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:06.861730  3047 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:06.864552  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.864888  9085 raft_consensus.cc:3055] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:06.865381  9085 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:06.865929  3121 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:06.866005  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.867719  3124 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:17:06.822021  3119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:17:06.868587  3119 raft_consensus.cc:606] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:06.832593  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:06.832953  3165 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:17:06.833649  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 81470.7us
I20260709 13:17:06.833724  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:06.765527  8859 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:06.837651  3044 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:06.879348  3044 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:06.795163  8913 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:06.838402  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:06.838732  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.881846  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.838212  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:06.839993  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.844558  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.835381  3051 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:06.838688  9057 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:06.846810  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.847213  9065 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.885958  9057 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:06.887825  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:06.889426  8859 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:06.889365  2942 catalog_manager.cc:5697] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 14 to 18, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 18 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.758077  9200 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:06.891628  2942 catalog_manager.cc:5697] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 12 to 16, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 16 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.894341  9200 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:06.859262  9115 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:06.895450  3164 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:06.848075  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:06.907204  8834 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:06.907680  8834 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.908058  8834 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:06.909858  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 61919.8us
I20260709 13:17:06.910727  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:06.912055  9181 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:06.915704  9209 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:17:06.916996  3051 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:06.848551  3042 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:06.851267  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.922430  3045 raft_consensus.cc:2393] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:06.924080  9202 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:06.828531  9174 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:06.867993  8932 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:06.868764  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:06.926213  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:06.926611  3046 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:06.927208  9181 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:06.870019  9063 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:06.870607  3165 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:06.927711  9181 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:06.928316  9181 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:06.928427  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 57901.6us
I20260709 13:17:06.927711  9174 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:06.930486  8932 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:17:06.870959  3761 leader_election.cc:336] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 1.907s (SENT)
I20260709 13:17:06.931704  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:06.933164  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 62248us
I20260709 13:17:06.871903  3126 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:06.879271  3047 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:06.871913  9085 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:06.933571  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:06.868217  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 44164.6us
I20260709 13:17:06.883314  3049 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:06.846163  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:06.946329  3195 raft_consensus.cc:2410] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:06.884228  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:06.887907  9065 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:06.902560  2942 catalog_manager.cc:5697] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 10 to 14, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 14 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:06.904112  3117 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:06.887313  3191 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:06.895965  9057 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:06.906155  9115 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:06.869002  3119 raft_consensus.cc:614] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:06.970425  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:06.870793  8920 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:06.930974  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:06.948885  3164 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:06.977751  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:06.952283  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:06.918706  3051 raft_consensus.cc:2955] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:06.966737  3762 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:06.929651  3165 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:06.979751  3125 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:06.976233  3050 raft_consensus.cc:1275] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:06.971586  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:06.982895  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:06.979830  8834 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:06.990357  3044 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:17:06.993287  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 62405.8us
I20260709 13:17:06.994136  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:06.855444  9191 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:06.994931  3091 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:06.998871  3048 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:17:06.998824  3091 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:06.970186  9174 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.980497  9127 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:06.997231  9138 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:07.009320  3042 raft_consensus.cc:2393] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 19: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:06.982401  8920 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:06.951923  9105 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 13:17:07.013890  9185 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:07.013329  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:07.026849  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 58135.9us
I20260709 13:17:07.012091  8873 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:06.974157  9063 consensus_queue.cc:1059] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:17:06.998482  9175 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:07.022634  8920 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:07.044242  9175 raft_consensus.cc:697] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:07.045944  9085 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:07.047770  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:07.004518  9199 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:17:07.034372  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 98717.3us
I20260709 13:17:07.017354  9174 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.048882  9199 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.049228  3761 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:06.985422  9203 consensus_queue.cc:1059] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:17:07.005910  9128 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:06.991624  9139 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.042474  9065 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:07.043329  3198 raft_consensus.cc:2410] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:17:07.043498  9202 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:07.049351  9199 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:07.009939  9192 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:17:07.038136  9197 consensus_queue.cc:1059] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 13:17:07.049607  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:07.050542  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:07.060633  3792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
W20260709 13:17:07.061872  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.075011  3792 raft_consensus.cc:606] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:06.999936  9049 consensus_queue.cc:1059] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:17:07.071019  8834 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:07.016861  9181 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:07.084640  9181 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:07.072597  3046 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:17:07.075489  3792 raft_consensus.cc:614] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:07.071439  8920 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.050349  8461 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:07.050154  9185 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:07.050495  9174 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:07.045166  9175 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:07.059890  9138 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:07.091615  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:07.086966  9065 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:07.059685  9128 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.104007  9128 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:17:07.105199  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 175668us
I20260709 13:17:07.096208  8630 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:07.108784  8630 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:07.117921  9120 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:07.113545  8630 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:07.119978  9120 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:07.099300  3126 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:07.076381  9139 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:07.120666  9120 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:07.098932  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 13:17:07.101765  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 51277.3us
I20260709 13:17:07.063548  8932 raft_consensus.cc:2764] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 13:17:07.098515  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 149747us
I20260709 13:17:07.084987  9191 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:07.090258  8873 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.106612  3165 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:07.073778  9115 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:07.123363  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:07.136663  3165 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:07.136833  3164 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:07.138846  3047 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:07.139673  8859 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:07.105680  9160 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:07.105787  9174 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:07.141901  9174 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:07.138579  9115 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.142570  9174 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:07.142656  9115 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:07.121102  9139 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.152666  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:07.155191  3051 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:07.143950  3165 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:07.156667  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:07.144078  8849 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:07.161458  8859 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:17:07.160740  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:07.140467  9216 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:07.127485  9198 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:17:07.140738  8873 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:07.166565  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 55539.3us
I20260709 13:17:07.169296  8873 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:07.170832  8920 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:07.172150  9199 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.163556  9139 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.174086  3047 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:17:07.174769  9139 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:07.175016  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 52489.6us
I20260709 13:17:07.175243  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:07.141166  9160 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:07.176040  9160 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:07.176623  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:07.177166  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:07.182029  3761 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:07.192827  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 56081.1us
I20260709 13:17:07.194658  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:07.193434  3165 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:07.175359  9139 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:17:07.165467  9181 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:07.209071  9227 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:07.178293  9092 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:07.178966  8913 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:07.190829  8849 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:07.212836  9065 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.202666  8859 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:07.213290  9105 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:07.187522  9173 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:07.162758  9191 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:17:07.212692  9076 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:07.239246  9065 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.216073  9092 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:07.246201  9092 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:07.246486  9065 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:07.247265  9203 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:07.248399  9203 raft_consensus.cc:3055] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:07.248783  9203 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:07.235467  3165 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:07.187685  9161 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:17:07.228420  8849 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:07.240233  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 58300.4us
I20260709 13:17:07.227594  9216 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:07.273963  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:07.211866  9181 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:07.250864  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.232769  8920 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:07.274988  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 97866.6us
I20260709 13:17:07.229530  9127 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:17:07.229902  9197 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:17:07.272662  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:07.239737  9173 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:07.240417  9199 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:07.280972  3799 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:07.284297  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:17:07.282109  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 90875.3us
I20260709 13:17:07.282361  3165 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:07.284957  3124 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:07.285583  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:07.286542  3123 raft_consensus.cc:3055] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:07.284338  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:07.271763  8849 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:07.290727  9214 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:07.292577  3797 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:07.294116  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:07.294719  9048 raft_consensus.cc:3055] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:07.295142  9048 raft_consensus.cc:740] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:07.295974  9048 consensus_queue.cc:260] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.296451  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:07.297250  3122 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 17: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:07.298281  9063 raft_consensus.cc:3055] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:07.249686  9203 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:07.298709  9063 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:07.300246  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:07.300841  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:07.286882  3123 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:07.305778  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:07.306469  3193 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:07.308952  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:07.297534  9048 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:07.280215  9181 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:07.319814  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:07.373899  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:07.374322  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:07.281526  9216 raft_consensus.cc:697] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:07.386374  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:07.387153  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:07.299273  9203 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:07.454811  3791 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:07.426337  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:07.373535  9063 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.373538  9220 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:07.398398  3123 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:07.445017  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:07.278666  8859 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:07.451077  3193 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:07.462263  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:07.448073  9214 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:07.465957  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:07.466728  3199 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:07.467049  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:07.467671  3798 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:17:07.469873  9225 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:07.470491  9225 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.459679  3048 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:17:07.472677  9225 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:07.472961  9174 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:07.474182  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:07.475235  9174 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:07.475962  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:07.476106  3793 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19. Ops: []
W20260709 13:17:07.452248  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.221834  9222 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:17:07.453173  3051 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:07.454052  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:07.284325  9173 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:07.450435  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:07.454670  3042 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:17:07.476574  3118 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:07.480372  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:07.482182  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:07.496493  3193 raft_consensus.cc:2376] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19. Re-sending same reply.
I20260709 13:17:07.496657  3195 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:07.482414  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:07.482978  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:07.482750  9115 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:07.483893  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:07.484530  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:07.485198  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:07.485450  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:07.485194  9057 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:07.488631  9185 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:07.489204  9220 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:07.490127  9192 raft_consensus.cc:3055] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:07.443903  8913 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.502506  3124 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:07.543381  8913 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.504268  3191 raft_consensus.cc:2410] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 20 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:17:07.508379  3123 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:07.509389  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:07.545068  3198 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
W20260709 13:17:07.510200  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 65314.4us
I20260709 13:17:07.511211  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:07.511438  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:07.518507  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:07.526510  3121 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:07.526283  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:07.531581  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:07.501633  8932 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.531903  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:07.507678  9199 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:07.532613  8849 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.533730  9160 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:07.542532  9063 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:07.539754  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:07.554364  3197 raft_consensus.cc:2410] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:17:07.545855  3193 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 18: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:07.554822  3051 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:07.555501  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:07.556414  3193 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:07.547118  3118 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:07.539475  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:07.547215  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:07.552011  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 278047us
I20260709 13:17:07.561005  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:07.561350  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:07.561806  3191 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 22: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:07.561866  3761 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:07.527002  9065 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:07.562788  9065 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:07.563170  9065 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:07.565954  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:07.566695  3122 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:07.566740  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:07.567492  3795 raft_consensus.cc:2393] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 19: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:07.568169  8461 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:07.513417  9197 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:07.570052  8461 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:07.570902  9116 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:07.570549  9197 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:07.571226  8849 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:07.566046  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:07.564950  3761 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:07.569136  9128 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.576532  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:07.573767  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:07.572636  3793 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:07.577900  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:07.519671  8859 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:07.527736  9192 raft_consensus.cc:740] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:07.535058  9115 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:07.552582  9199 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:07.595870  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:07.537341  9120 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.600750  9198 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:17:07.535509  9092 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:07.605695  3119 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
W20260709 13:17:07.609108  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:07.622956  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.586124  9228 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:07.615271  3043 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:07.611863  3042 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:07.607260  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:07.621281  3195 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:07.607638  8849 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:07.617498  9216 consensus_queue.cc:237] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.629881  9197 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:07.630059  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:07.630873  3125 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 18: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:07.613080  9092 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:07.634011  3191 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:07.555660  8932 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:07.635391  3193 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:17:07.597474  8920 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:07.640529  3049 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:07.641058  3045 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 13: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:07.638029  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:07.641757  3198 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:07.581321  9215 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
W20260709 13:17:07.647269  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 100150us
I20260709 13:17:07.648427  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:07.611044  9222 raft_consensus.cc:3055] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:07.657029  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:07.611539  9120 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:07.661576  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 83747us
I20260709 13:17:07.625141  9228 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:07.663177  3164 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:07.664409  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:07.664687  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:07.711232  3042 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 16. Current term is 17. Ops: []
W20260709 13:17:07.716965  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 52370.3us
I20260709 13:17:07.718115  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:07.654465  9222 raft_consensus.cc:740] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:07.722579  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:07.722673  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:07.658620  9174 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:07.663477  9057 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:07.677806  9105 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:07.714902  8920 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:07.733636  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:07.741091  3121 raft_consensus.cc:1240] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:17:07.684667  9228 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:07.726456  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:07.634087  8859 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.712733  9115 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.733649  3118 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 22: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:07.748272  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:07.750192  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:07.680279  9185 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:17:07.723467  9138 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:07.756589  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:07.760727  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:07.772058  3195 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:07.720196  9214 raft_consensus.cc:697] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:07.767038  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:07.742908  9197 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:07.779709  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 184191us
I20260709 13:17:07.783488  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:07.658869  9199 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.752272  8461 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.751124  9139 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:07.811012  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:07.819133  3761 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:07.754281  3090 connection.cc:256] RPC call timeout handler was delayed by -1.1221645359999002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
I20260709 13:17:07.685324  9230 consensus_queue.cc:1059] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
I20260709 13:17:07.777311  9220 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:07.808459  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:07.767867  9113 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.827073  3791 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:07.814066  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:07.832203  3117 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 18: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:07.748870  9227 raft_consensus.cc:697] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:07.822352  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:07.824018  9222 consensus_queue.cc:260] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.755205  9105 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:07.838624  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:07.711210  9192 consensus_queue.cc:260] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.803180  9138 raft_consensus.cc:697] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 16 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:17:07.831971  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 110711us
I20260709 13:17:07.871681  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:07.872727  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:07.777328  9115 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:07.824066  9127 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:07.831403  9160 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:07.836755  9216 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.872872  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:07.883920  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:07.881219  3090 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:07.885324  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:07.836678  9239 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.828128  8461 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.913251  3117 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:17:07.899596  8873 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:07.914269  8932 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:07.915393  9065 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:07.916056  3798 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:17:07.916620  9105 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:07.918008  3047 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:07.923357  8913 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:07.917563  9065 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:07.924660  9138 consensus_queue.cc:237] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.926836  3123 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:17:07.928016  9128 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:07.929054  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 48470.4us
I20260709 13:17:07.922617  9227 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:17:07.931318  3047 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16. Ops: []
W20260709 13:17:07.935649  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 64445.8us
I20260709 13:17:07.935737  9065 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:07.931653  3793 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:07.813071  9197 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:07.877321  9237 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:07.836771  9113 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.896448  9222 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:07.892745  9200 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.941815  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:07.941466  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 68828.1us
I20260709 13:17:07.939936  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:07.956866  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:07.957612  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:07.954394  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:07.964402  3125 raft_consensus.cc:2410] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:17:07.962741  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:07.941222  9198 raft_consensus.cc:2764] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:17:07.976315  3762 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:07.941125  8630 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 13:17:07.981767  3090 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:07.984076  9234 raft_consensus.cc:3055] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:07.984627  9234 raft_consensus.cc:740] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:17:07.990595  9236 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:17:07.990767  3049 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:17:07.952325  9065 raft_consensus.cc:697] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:07.993078  9065 consensus_queue.cc:237] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.993602  9115 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:07.978394  9048 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:17:07.902304  9239 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.898300  9216 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:07.954623  9237 raft_consensus.cc:697] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:07.964399  8834 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:07.969399  9230 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:08.014838  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:08.016026  3798 raft_consensus.cc:2410] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:17:08.005752  9200 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
W20260709 13:17:08.020690  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 58007.6us
I20260709 13:17:08.020874  9191 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:08.021679  9216 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:08.022311  9200 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:08.022791  9235 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:17:08.024284  9199 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:08.024469  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.019114  8834 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.034497  9197 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:08.059537  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:08.060424  3121 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:08.035169  9113 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:08.010035  9175 consensus_queue.cc:1059] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:17:08.062240  9175 raft_consensus.cc:3055] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:08.062680  9175 raft_consensus.cc:740] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:08.063854  9175 consensus_queue.cc:260] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:08.035933  9233 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 13:17:08.036231  9230 raft_consensus.cc:697] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:08.068094  9230 consensus_queue.cc:237] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:08.036644  9243 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.115s	user 0.000s	sys 0.002s
I20260709 13:17:08.008409  9049 consensus_queue.cc:1059] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:17:08.031031  9221 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:17:08.070585  9203 raft_consensus.cc:3055] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:08.071026  9203 raft_consensus.cc:740] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:07.973760  9127 consensus_queue.cc:1059] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:17:08.072307  9127 raft_consensus.cc:3055] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:08.072758  9127 raft_consensus.cc:740] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:08.038714  8461 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:08.022228  9241 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:07.948794  9214 consensus_queue.cc:237] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:08.071182  9175 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:08.041977  9239 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:08.042531  9237 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:08.012616  9161 consensus_queue.cc:1059] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:17:08.079658  9161 raft_consensus.cc:3055] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:08.080142  9161 raft_consensus.cc:740] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:08.047955  3194 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
W20260709 13:17:08.055913  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.082322  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:08.082643  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:08.071846  9203 consensus_queue.cc:260] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:08.039106  9181 consensus_meta.cc:287] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.000s
I20260709 13:17:08.089704  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:08.093075  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:08.093613  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:08.098924  3198 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:17:08.085873  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 79908.2us
I20260709 13:17:08.018872  9116 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:08.101718  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:08.102996  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:08.103688  3195 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:08.098189  9092 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:08.107784  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:08.058440  8834 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:08.114105  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:08.115783  9057 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:08.131497  3195 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:08.087910  9197 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:08.100471  9063 consensus_meta.cc:287] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.001s
I20260709 13:17:08.071237  9221 raft_consensus.cc:3055] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:08.021698  9191 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.082s
W20260709 13:17:08.137128  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 121438us
I20260709 13:17:08.081322  9161 consensus_queue.cc:260] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:08.132017  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:08.152148  9249 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:08.152591  9249 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.152946  9249 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:08.150044  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 139065us
W20260709 13:17:08.154947  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 349384us
I20260709 13:17:08.098714  8461 consensus_queue.cc:1059] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:17:08.156746  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:08.100131  9160 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:17:08.103185  9181 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:08.161207  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:08.155673  3165 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:08.144346  9221 raft_consensus.cc:740] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:08.168552  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:08.171195  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:08.196295  9085 raft_consensus.cc:3055] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:08.196834  9085 raft_consensus.cc:740] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:08.202585  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:08.205878  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:08.206640  3795 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:08.209326  3799 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
W20260709 13:17:08.214928  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 59341.3us
I20260709 13:17:08.259476  3165 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:08.261596  3044 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 22: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:17:08.262899  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 60409.7us
I20260709 13:17:08.265988  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:08.269284  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:08.161929  9215 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.107s
I20260709 13:17:08.272575  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:08.202260  9174 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:08.145129  9197 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:08.272648  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:08.282019  3048 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:08.207095  9138 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:08.289021  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:08.290205  3126 raft_consensus.cc:2410] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:17:08.271975  8932 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:08.297463  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:08.298698  3126 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
I20260709 13:17:08.299901  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:08.301187  3126 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:08.306694  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:08.276006  8461 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:08.321348  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 114649us
I20260709 13:17:08.288407  9138 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.292209  9253 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:08.197719  9085 consensus_queue.cc:260] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:08.293162  9120 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:08.292380  8932 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:08.347185  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:08.345789  9138 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:08.154160  9234 consensus_queue.cc:260] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:08.376174  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:08.347141  9214 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
W20260709 13:17:08.386044  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 126260us
I20260709 13:17:08.389149  3090 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:08.348958  9239 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:17:08.389456  9250 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.241s	user 0.000s	sys 0.000s
W20260709 13:17:08.377453  9223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.008s	sys 0.005s
I20260709 13:17:08.354135  9120 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.354365  8932 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:08.402021  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 129525us
I20260709 13:17:08.344815  8461 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:08.379446  9057 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:08.440008  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:08.404861  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:08.400115  9197 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:08.450580  3164 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:08.475270  9274 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:17:08.475630  9259 log.cc:927] Time spent T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
W20260709 13:17:08.479943  9271 log.cc:927] Time spent T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:17:08.480023  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 2787) took 1171 ms. Trace:
I20260709 13:17:08.485075  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2453) took 1005 ms. Trace:
W20260709 13:17:08.489766  9273 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:17:08.536695  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 86192.9us
W20260709 13:17:08.446339  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 163329us
I20260709 13:17:08.440009  9191 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:08.552802  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 148054us
W20260709 13:17:08.442837  9223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.013s	sys 0.008s
I20260709 13:17:08.557966  3048 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
W20260709 13:17:08.442880  9260 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 13:17:08.442567  9174 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:08.446792  9120 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:08.559600  8849 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:08.562309  3044 rpcz_store.cc:276] 0709 13:17:07.308526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.308703 (+   177us) service_pool.cc:224] Handling call
0709 13:17:08.479794 (+1171091us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b540027d3d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:08.479965 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082418432}
I20260709 13:17:08.440832  9085 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:08.561996  3124 rpcz_store.cc:276] 0709 13:17:07.479273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.543676 (+ 64403us) service_pool.cc:224] Handling call
0709 13:17:07.543981 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.544168 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:07.743952 (+199784us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.483866 (+739914us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b1800392920. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d240c0a 00007ff836980219 00007ff82d2c8a40 00007ff82d2c34e4 00007ff82d2c3455 00007ff833dab3c7 00007ff8303bd9a7 00007ff8303cd0bf 00007ff8303cd038
0709 13:17:08.484117 (+   251us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.484467 (+   350us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.484600 (+   133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:08.484644 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:08.484692 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.484767 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.485009 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":612995,"prepare.queue_time_us":936404,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":91,"raft.queue_time_us":18089,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":13209,"spinlock_wait_cycles":26962176,"thread_start_us":322023,"threads_started":2,"wal-append.queue_time_us":359504}
I20260709 13:17:08.574317  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:08.452458  8461 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:08.575065  3165 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:08.557885  9250 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:17:08.374308  9221 consensus_queue.cc:260] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:08.544068  9057 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:08.604290  3197 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:08.591491  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:08.561506  9253 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:17:08.593187  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 204126us
I20260709 13:17:08.589818  3091 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:08.586589  9181 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:08.611217  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:08.591531  8849 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.635752  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:08.614567  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:08.650653  3119 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:08.639673  3165 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:08.606657  9057 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:08.613411  9175 consensus_meta.cc:287] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.001s
I20260709 13:17:08.595702  8834 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:08.666774  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 55614.8us
I20260709 13:17:08.596391  9248 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:17:08.644636  8849 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:08.605881  9225 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:17:08.702246  3790 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:17:08.679225  9277 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:17:08.679629  9240 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.739s	user 0.000s	sys 0.002s
I20260709 13:17:08.666045  9253 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:08.660053  9128 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:08.711772  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 931) took 1232 ms. Trace:
W20260709 13:17:08.681447  9222 consensus_meta.cc:287] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.732s	user 0.002s	sys 0.015s
I20260709 13:17:08.689944  9242 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:08.713111  9242 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.712189  3199 rpcz_store.cc:276] 0709 13:17:07.479747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.479847 (+   100us) service_pool.cc:224] Handling call
0709 13:17:07.485957 (+  6110us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:07.511653 (+ 25696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.511683 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:07.527112 (+ 15429us) log.cc:844] Serialized 26 byte log entry
0709 13:17:07.743591 (+216479us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:07.743633 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.743707 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.678802 (+935095us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:08.711428 (+ 32626us) raft_consensus.cc:1685] finished
0709 13:17:08.711452 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.711711 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35855,"raft.queue_time_us":33462,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":10399,"spinlock_wait_cycles":3279232,"thread_start_us":183421,"threads_started":1,"wal-append.queue_time_us":284423}
I20260709 13:17:08.715881  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2365) took 1428 ms. Trace:
I20260709 13:17:08.716349  3194 rpcz_store.cc:276] 0709 13:17:07.287249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.287871 (+   622us) service_pool.cc:224] Handling call
0709 13:17:08.715624 (+1427753us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b540013c4d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:08.715772 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375576448}
I20260709 13:17:08.717975  9127 consensus_queue.cc:260] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:08.723939  9173 consensus_meta.cc:287] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.213s	user 0.006s	sys 0.006s
W20260709 13:17:08.660266  9199 consensus_meta.cc:287] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.635s	user 0.003s	sys 0.008s
I20260709 13:17:08.653790  8873 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:08.732698  3121 raft_consensus.cc:2410] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
W20260709 13:17:08.691690  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.634820  9174 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:17:08.695626  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.738866  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.689203  9057 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:08.691485  9264 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:17:08.706406  9278 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260709 13:17:08.706836  9270 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
W20260709 13:17:08.707273  9268 log.cc:927] Time spent T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:17:08.707921  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 72288.2us
W20260709 13:17:08.708823  9269 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.311s	user 0.000s	sys 0.003s
I20260709 13:17:08.709146  9280 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:08.709564  9244 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.075s
W20260709 13:17:08.691030  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.719913  9127 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:08.637840  9237 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 13:17:08.713537  9242 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:08.740000  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:08.745539  3194 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:08.758394  3192 raft_consensus.cc:1275] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:08.751153  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:08.754726  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:08.754882  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:08.759881  3195 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 22: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:08.738579  9174 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.770531  3125 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 22: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:08.744513  9199 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:08.703660  8932 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:08.773875  9199 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:08.775357  8932 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:08.776140  9199 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:08.744891  9264 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.778280  3199 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:17:08.753850  9280 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.755903  8873 raft_consensus.cc:697] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:08.737076  9173 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:08.757506  9286 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:17:08.777320  9249 consensus_meta.cc:287] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.001s
I20260709 13:17:08.778633  9174 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:08.790433  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.792522  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:08.783599  9264 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:08.800293  9287 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:17:08.801385  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:08.802084  3797 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:08.793503  9277 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:17:08.785068  9280 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:08.809221  9294 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:08.810223  3797 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:08.785894  9253 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:08.819416  3045 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 16. Current term is 17. Ops: []
W20260709 13:17:08.822022  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 182487us
I20260709 13:17:08.824105  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:08.824311  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:08.824641  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:08.825454  3193 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 18: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:17:08.826383  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 77052.7us
I20260709 13:17:08.827196  3090 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:08.793165  9199 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:08.794571  9262 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.841962  3191 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:08.843570  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:08.843683  9242 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:08.844107  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:08.844568  3196 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
I20260709 13:17:08.844833  3118 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:08.794289  9249 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:08.846293  9288 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:17:08.848165  9249 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:08.794174  9286 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:08.852125  3090 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:08.836203  9128 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:08.864924  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:08.867161  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:08.868685  3118 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:08.870880  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:08.870911  3123 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:17:08.833959  9294 raft_consensus.cc:697] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:08.834169  9253 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:08.859972  9065 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.898365  9065 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:08.900537  9065 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:08.903100  9286 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:08.897665  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:08.908764  3123 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:17:08.860673  9262 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:08.910352  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:08.911325  9244 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:08.911847  9244 raft_consensus.cc:697] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:08.912002  9262 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:08.915062  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:08.849987  8873 consensus_queue.cc:237] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:08.917549  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 65522.1us
I20260709 13:17:08.917953  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:08.916779  9065 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:08.867703  8834 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:08.919605  9138 consensus_meta.cc:287] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.002s
I20260709 13:17:08.914718  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:08.920738  9173 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:08.868887  9092 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:08.896746  9203 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:08.916807  9290 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:08.923209  9174 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:08.923638  9120 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:08.925812  9264 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:08.925982  9244 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:08.941551  3123 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:08.869261  9199 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:08.870263  9128 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:08.944674  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:08.951553  8849 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:08.953852  9065 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:08.977981  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.961349  9294 consensus_queue.cc:237] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:08.947312  9092 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:08.946712  9248 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:08.948477  9242 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:09.007680  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:08.959242  9290 raft_consensus.cc:697] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:08.958595  9057 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:09.006181  9128 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:09.079012  9290 consensus_queue.cc:237] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.011186  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:09.014355  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:17:09.020113  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 91003.6us
I20260709 13:17:09.085855  3126 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:09.087082  9128 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.042595  9276 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:09.012534  9286 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.006666  9197 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.040834  9291 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:09.038697  9253 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.090240  9276 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.090371  9286 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.065815  9174 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:09.090421  9197 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.094259  9199 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.094831  9199 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.097036  9199 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:08.946347  9138 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.097198  9197 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:09.103739  9291 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.105985  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:09.106657  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 99049us
I20260709 13:17:09.085546  3090 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:09.076655  9230 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:09.129535  3126 raft_consensus.cc:1275] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:09.132714  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:09.134357  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:09.100056  9248 raft_consensus.cc:697] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:09.098160  9239 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:09.039748  8461 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.089609  9128 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:09.144888  9128 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:09.126935  9174 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.128394  9287 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:09.151782  9291 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:09.156960  9280 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.159471  9286 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:09.159490  9228 consensus_meta.cc:287] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.387s	user 0.011s	sys 0.004s
I20260709 13:17:09.159286  9248 consensus_queue.cc:237] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.140817  9120 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:09.191125  9228 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.161253  9174 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.143550  9230 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.130335  9199 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:17:09.174512  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.175060  9287 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.186422  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2867) took 1553 ms. Trace:
I20260709 13:17:09.187654  3192 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:17:09.188303  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:09.209363  3196 raft_consensus.cc:2410] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:17:09.194128  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:09.184404  3200 raft_consensus.cc:1240] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:09.206023  3191 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:17:09.210001  3126 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 12.
I20260709 13:17:09.206738  3125 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:17:09.210213  3165 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:09.208184  3197 rpcz_store.cc:276] 0709 13:17:07.632948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.640289 (+  7341us) service_pool.cc:224] Handling call
0709 13:17:07.658299 (+ 18010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.611908 (+953609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.186203 (+574295us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b5400178754. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:09.186367 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2172848896}
I20260709 13:17:09.212692  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:09.207960  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:09.214211  3193 raft_consensus.cc:2368] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14.
I20260709 13:17:09.215313  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:09.216195  3193 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 22: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:09.216876  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:09.218878  3192 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 21: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:09.218956  3165 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:09.219815  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:09.193696  8849 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:09.148200  9239 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.225494  3197 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:09.226490  3165 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:09.230474  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.211521  9287 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:09.226114  8932 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:09.241032  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:09.223670  9249 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:09.223695  9264 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:09.246081  3044 raft_consensus.cc:2410] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:17:09.238785  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:09.231164  8859 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:17:09.271124  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:09.272727  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:09.231554  9291 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:17:09.270123  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:09.290221  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.266224  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:09.286609  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:09.286782  3042 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:09.290059  3048 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:17:09.245383  8932 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.292114  9065 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:09.313465  3042 raft_consensus.cc:1275] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:09.318933  3043 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:17:09.319058  9092 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.330397  9174 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:09.331913  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.332629  8932 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:09.334038  9239 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:09.334369  9280 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:09.342639  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:09.343648  3793 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 16: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:09.349218  8461 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:09.352130  3790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 754) took 1297 ms. Trace:
W20260709 13:17:09.353012  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.353663  9092 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:09.356436  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:17:09.358780  9284 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.682s	user 0.001s	sys 0.001s
I20260709 13:17:09.361070  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:09.364871  9287 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.352607  3790 rpcz_store.cc:276] 0709 13:17:08.054301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.054457 (+   156us) service_pool.cc:224] Handling call
0709 13:17:09.351898 (+1297441us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b540060c2d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:09.352034 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1349897472}
I20260709 13:17:09.366484  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:09.370149  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:09.370793  3117 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:09.372558  9256 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.372921  9161 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:09.357372  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:09.373081  9256 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.374496  9282 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:09.375363  9282 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:09.376324  9291 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:17:09.378262  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.378648  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:09.379329  3197 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:09.380910  3198 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:17:09.380998  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:09.382288  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:09.388466  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:09.390276  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:09.388320  9224 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.394588  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:09.397655  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:09.398733  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:09.397934  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:09.428412  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:09.429338  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:09.430325  3192 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:17:09.432415  3121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 2458) took 1341 ms (client timeout 1637 ms). Trace:
I20260709 13:17:09.396284  9300 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:09.433027  3121 rpcz_store.cc:269] 0709 13:17:08.090714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.101459 (+ 10745us) service_pool.cc:224] Handling call
0709 13:17:09.428870 (+1327411us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54003917d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:09.432335 (+  3465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1448449408}
I20260709 13:17:09.434007  9300 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.438052  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:09.439473  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:09.440052  3124 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:09.438048  3043 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:09.460628  3124 raft_consensus.cc:1275] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:09.442420  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:09.395370  9308 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:17:09.443118  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 315800us
I20260709 13:17:09.466436  3197 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:09.468928  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:09.469703  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:09.474386  3044 raft_consensus.cc:2393] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:09.475453  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:09.476565  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:09.470566  3049 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:09.471400  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:09.485810  3090 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:09.487246  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:09.488034  3049 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:09.487908  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:09.494050  3090 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:09.494695  3044 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 16 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:09.497852  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:09.498893  3047 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 16: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:09.460794  9174 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.509596  3048 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:09.513942  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:09.524380  3051 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
W20260709 13:17:09.493026  9268 log.cc:927] Time spent T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:09.425427  9224 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.540021  3050 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:09.537298  3117 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:17:09.478649  9065 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:09.500239  9235 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:09.506408  9185 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:09.552911  3049 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:09.554601  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:09.492383  9057 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:09.580972  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:09.590713  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:09.593611  3121 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:17:09.594349  3121 pending_rounds.cc:85] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 8
I20260709 13:17:09.594663  3121 pending_rounds.cc:107] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:17:09.594955  3121 raft_consensus.cc:2889] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:09.531201  9244 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:09.597951  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 117882us
I20260709 13:17:09.546660  9191 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:09.601253  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:09.549975  9309 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:09.502971  9139 consensus_queue.cc:1059] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:17:09.578625  9185 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:09.617775  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 123781us
I20260709 13:17:09.526567  9174 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.619554  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:09.621842  3047 raft_consensus.cc:2393] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 12: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:09.622951  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:09.623742  3199 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:09.614069  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:09.502830  9308 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.576736  9065 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.632084  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:09.632231  9253 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:09.633298  9253 raft_consensus.cc:3055] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:09.633798  9253 raft_consensus.cc:740] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:09.635874  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:09.612883  9286 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:09.619825  9185 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:09.617488  9221 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:09.650663  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:09.651110  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:09.654201  3047 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:09.611596  9227 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:17:09.662940  3090 leader_election.cc:400] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14.
I20260709 13:17:09.603536  9057 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.607599  9244 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.674010  3165 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:09.677369  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:09.669448  3090 leader_election.cc:403] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:09.603143  9314 consensus_queue.cc:1059] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:17:09.640089  9322 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:17:09.685269  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:09.649266  9139 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:09.687418  3165 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:09.645545  9256 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:09.689028  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 52057.2us
I20260709 13:17:09.690773  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:09.632110  9248 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 13:17:09.693169  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 62248us
I20260709 13:17:09.656271  9287 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:09.693912  9239 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:09.689354  9191 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:09.706151  9328 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14.
I20260709 13:17:09.706387  9191 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.708830  9191 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:09.634745  9253 consensus_queue.cc:260] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.695848  3090 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:09.712611  9214 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:09.713282  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:09.722218  3165 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:09.724920  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:09.645977  9309 consensus_queue.cc:1059] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:17:09.687973  9280 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:09.752288  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:09.725016  9322 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:09.709779  9334 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:09.754865  9334 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.757189  9334 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:09.727898  9191 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:09.729406  9225 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:09.728763  3090 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:09.734330  3044 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:17:09.759130  3044 pending_rounds.cc:85] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 13
I20260709 13:17:09.759379  3044 pending_rounds.cc:107] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:17:09.759650  3044 raft_consensus.cc:2889] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:09.760450  9331 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:17:09.730201  9277 consensus_queue.cc:1059] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:09.761276  9331 consensus_queue.cc:1059] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:09.738327  9244 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:09.739874  9249 consensus_queue.cc:1059] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:09.762130  9331 consensus_queue.cc:1243] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:17:09.762681  9249 raft_consensus.cc:3055] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:09.763067  9249 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:09.742431  9065 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:09.742782  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1177) took 1998 ms. Trace:
I20260709 13:17:09.763885  9249 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.767055  3045 rpcz_store.cc:276] 0709 13:17:07.744310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.744478 (+   168us) service_pool.cc:224] Handling call
0709 13:17:07.767539 (+ 23061us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.820617 (+1053078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.742517 (+921900us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540027d8d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:09.742713 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2414989184}
I20260709 13:17:09.767946  9249 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:09.770721  9237 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:09.692036  9326 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:09.771759  9326 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.772265  9138 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:09.772677  9237 consensus_queue.cc:1059] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:09.746692  9174 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:09.773892  9127 raft_consensus.cc:3055] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:09.746327  9309 raft_consensus.cc:3055] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:09.710534  9232 consensus_queue.cc:1059] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:17:09.774295  9127 raft_consensus.cc:740] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:09.652356  9286 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:09.775749  9317 log.cc:927] Time spent T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.299s	user 0.002s	sys 0.000s
I20260709 13:17:09.748260  3118 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:09.714491  9224 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:09.749781  9057 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:09.761884  9277 raft_consensus.cc:3055] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:09.726517  8849 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 13:17:09.757090  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 43967.8us
I20260709 13:17:09.777885  9277 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:09.748867  9253 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:09.766036  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:09.770923  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:09.775328  9127 consensus_queue.cc:260] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.775668  3199 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:09.747592  9308 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:09.780045  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 272375us
I20260709 13:17:09.736132  8630 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:09.784729  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.785933  3119 raft_consensus.cc:2393] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 19: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:17:09.786903  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 71352.6us
I20260709 13:17:09.801257  3165 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:09.802323  8873 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:09.802861  3165 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:09.804101  9214 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:09.790145  3044 raft_consensus.cc:2393] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 19: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:09.806255  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:09.793045  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:09.774518  9309 raft_consensus.cc:740] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:09.808736  3123 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:09.809448  9309 consensus_queue.cc:260] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.810984  9309 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:09.813200  3165 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:09.814742  9214 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:09.816547  9214 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:09.821008  8873 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:09.822678  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.757150  9181 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:09.827709  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:09.835378  3197 raft_consensus.cc:1275] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:09.836091  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:09.836495  9292 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:09.795208  9232 consensus_queue.cc:1243] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:09.829388  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:09.839135  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:09.839620  3191 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:17:09.840793  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:09.829607  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:09.842090  3198 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:09.832330  3124 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:17:09.844151  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:09.845046  3198 raft_consensus.cc:2393] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:09.851174  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:09.852137  3195 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:09.853614  3199 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:09.856330  3194 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:17:09.860352  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:09.862295  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:09.863123  3191 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:09.860140  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:09.860919  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:09.867715  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:09.867405  3192 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:09.868917  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:09.872072  3200 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:09.881471  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:09.854800  9322 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:09.885978  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:09.846657  9225 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:09.886246  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 84856.1us
I20260709 13:17:09.824191  8630 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.885179  9335 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:09.896471  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:09.899241  9048 consensus_queue.cc:1059] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:17:09.903499  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:09.931610  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:09.932636  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:09.874634  9221 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:09.933161  3124 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:09.936069  9234 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:09.936795  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:09.938097  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:09.939534  3117 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:17:09.939839  3117 pending_rounds.cc:85] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 10
I20260709 13:17:09.940066  3117 pending_rounds.cc:107] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:17:09.940088  9230 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:09.779013  9277 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.942615  9127 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:09.943635  9277 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:09.946132  9159 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:09.946750  9159 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.949156  9159 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:09.949708  9159 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.950191  9159 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.950511  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:09.952322  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:09.952626  9224 raft_consensus.cc:3055] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:09.953166  9224 raft_consensus.cc:740] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:09.953331  3200 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 16: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:09.954128  9224 consensus_queue.cc:260] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.898597  3198 raft_consensus.cc:2393] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:17:09.956362  9161 consensus_meta.cc:287] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.583s	user 0.006s	sys 0.007s
I20260709 13:17:09.882422  9181 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:09.957508  3198 raft_consensus.cc:1275] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:17:09.911813  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:09.958948  3121 raft_consensus.cc:1275] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:17:09.957233  9181 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:09.960695  9242 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.961628  9181 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:09.961432  9242 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.907444  3049 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 17. Current term is 18. Ops: []
W20260709 13:17:09.929080  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.940407  3117 raft_consensus.cc:2889] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:09.868541  9329 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:09.968463  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 72077.9us
I20260709 13:17:09.971374  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:09.968859  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 157336us
I20260709 13:17:09.978701  3193 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:09.979808  3191 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
W20260709 13:17:10.005365  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 188660us
I20260709 13:17:09.900360  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:09.977404  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:10.030391  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 58318.9us
I20260709 13:17:10.031519  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:09.904297  8834 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:10.246716  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 346433us
I20260709 13:17:10.251451  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:10.251546  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 220137us
I20260709 13:17:10.247694  3091 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:10.253178  9191 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:10.253652  9191 raft_consensus.cc:697] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:10.254527  9191 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:10.248878  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 271548us
I20260709 13:17:10.258356  3164 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:09.963729  9322 raft_consensus.cc:697] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:10.260686  9322 consensus_queue.cc:237] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:10.264868  9276 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:09.963485  9225 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:10.280726  9225 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:10.246390  9063 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.282203  9063 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:10.285274  9063 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:10.016896  9329 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:09.933537  9221 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:10.289582  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.976781  9230 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:10.305924  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 54525.6us
I20260709 13:17:10.306702  9340 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:09.894863  9332 raft_consensus.cc:2764] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:17:09.928260  9113 raft_consensus.cc:3055] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:09.962743  9286 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:10.325306  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:10.370991  3090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.009s	sys 0.024s
W20260709 13:17:10.422151  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 169349us
W20260709 13:17:10.433436  3090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.009s	sys 0.024s
W20260709 13:17:10.434414  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 597093us
I20260709 13:17:10.436084  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:10.321933  9330 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 13:17:10.310526  9244 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:10.451566  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 126390us
W20260709 13:17:10.452330  3123 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.006s	sys 0.024s
W20260709 13:17:10.454550  3123 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.007s	sys 0.024s
W20260709 13:17:10.395452  3044 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.014s	sys 0.013s
W20260709 13:17:10.378943  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 120650us
W20260709 13:17:10.452878  3119 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.011s	sys 0.024s
I20260709 13:17:10.315228  9262 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:10.424130  9113 raft_consensus.cc:740] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:10.326676  9225 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:10.387044  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:10.517342  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:10.484879  3791 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
W20260709 13:17:10.520227  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 87010.7us
W20260709 13:17:10.517589  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.424943  8849 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:17:10.557868  3044 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.014s	sys 0.016s
W20260709 13:17:10.558307  3119 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.012s	sys 0.024s
I20260709 13:17:10.486023  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:10.534057  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.526667  8630 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:10.560385  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:17:10.517951  9339 log.cc:927] Time spent T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.224s	user 0.000s	sys 0.002s
I20260709 13:17:10.560832  9341 consensus_queue.cc:1059] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:10.560303  9239 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:10.595916  9239 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:10.598969  9239 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:10.600400  9127 consensus_meta.cc:287] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.657s	user 0.011s	sys 0.000s
I20260709 13:17:10.560336  9092 consensus_queue.cc:1048] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:17:10.522678  9300 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:10.562263  9329 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:10.566808  9237 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.086s	sys 0.124s
I20260709 13:17:10.586717  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1185) took 1119 ms. Trace:
I20260709 13:17:10.602546  3046 rpcz_store.cc:276] 0709 13:17:09.467293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.470001 (+  2708us) service_pool.cc:224] Handling call
0709 13:17:09.512660 (+ 42659us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.580814 (+ 68154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.580845 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:09.599513 (+ 18668us) log.cc:844] Serialized 26 byte log entry
0709 13:17:09.781426 (+181913us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:09.781480 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.781583 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.586459 (+804876us) raft_consensus.cc:1685] finished
0709 13:17:10.586481 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.586642 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12014,"raft.queue_time_us":13102,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":15092,"thread_start_us":223915,"threads_started":2,"wal-append.queue_time_us":283657}
I20260709 13:17:10.604391  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:10.586769  9342 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:10.458750  9326 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:10.460045  9161 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:10.607282  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 47697.4us
I20260709 13:17:10.590195  8849 raft_consensus.cc:697] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:17:10.590999  9185 consensus_meta.cc:287] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.910s	user 0.011s	sys 0.000s
W20260709 13:17:10.591099  9253 consensus_meta.cc:287] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.795s	user 0.009s	sys 0.000s
I20260709 13:17:10.514187  9332 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:17:10.607594  9237 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.087s	sys 0.124s
I20260709 13:17:10.460219  9325 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.145s
I20260709 13:17:10.615238  3048 raft_consensus.cc:2410] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:17:10.615602  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:10.617611  3044 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
W20260709 13:17:10.618782  3050 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.033s	sys 0.044s
W20260709 13:17:10.619280  3050 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.034s	sys 0.044s
I20260709 13:17:10.633164  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:10.607420  3198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.016s	sys 0.057s
I20260709 13:17:10.603662  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2469) took 1490 ms. Trace:
I20260709 13:17:10.635010  3125 rpcz_store.cc:276] 0709 13:17:09.112850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.212125 (+ 99275us) service_pool.cc:224] Handling call
0709 13:17:09.212392 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.600000 (+1387608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:10.600036 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:10.600081 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:10.600114 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.603417 (+  3303us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54001c39d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:10.603470 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.603603 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3190688640}
W20260709 13:17:10.636826  3198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.016s	sys 0.058s
I20260709 13:17:10.516148  9221 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:10.509274  9159 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:10.613857  3090 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:10.605527  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:10.638731  3015 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.132:43109 timed out after 1.781s (SENT) [suppressed 8 similar messages]
I20260709 13:17:10.483150  8834 raft_consensus.cc:697] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:10.650727  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:10.656085  3044 raft_consensus.cc:2393] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:10.564867  9173 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
W20260709 13:17:10.752282  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 138526us
I20260709 13:17:10.753554  3090 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:10.818774  8834 consensus_queue.cc:237] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:10.823318  9345 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:10.824100  9345 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.824590  9345 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:10.654372  9277 consensus_meta.cc:287] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.710s	user 0.009s	sys 0.004s
I20260709 13:17:10.585367  9225 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:10.832270  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.834175  3090 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:10.837393  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:10.842264  3197 raft_consensus.cc:2410] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:17:10.850518  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:10.751616  9253 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:10.760565  9191 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:10.649821  9256 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.186s
I20260709 13:17:10.760802  9232 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:10.615043  9185 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:10.842867  9234 consensus_meta.cc:287] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.906s	user 0.012s	sys 0.000s
I20260709 13:17:10.880087  3044 raft_consensus.cc:1217] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Deduplicated request from leader. Original: 14.8->[15.9-17.10]   Dedup: 15.9->[17.10-17.10]
I20260709 13:17:10.881912  3799 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:17:10.882669  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.863767  9221 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:10.839373  9292 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.886258  3044 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 17. Current term is 18. Ops: [15.9-17.10]
I20260709 13:17:10.623991  9113 consensus_queue.cc:260] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:10.889061  3047 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:10.890563  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:10.891077  9253 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:10.846138  9277 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:10.614720  9332 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:10.894619  3090 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:10.867545  9237 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:17:10.885433  9249 consensus_meta.cc:287] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.112s	user 0.011s	sys 0.002s
I20260709 13:17:10.872169  9342 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:10.902101  3042 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:10.888293  9221 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.935477  9199 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:10.936302  9199 raft_consensus.cc:697] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:10.937297  9199 consensus_queue.cc:237] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:10.900686  9292 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:10.941114  9332 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:10.944159  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2407) took 1097 ms. Trace:
I20260709 13:17:10.944631  3198 rpcz_store.cc:276] 0709 13:17:09.846885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.958287 (+111402us) service_pool.cc:224] Handling call
0709 13:17:09.958612 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:09.958971 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.959004 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:09.959571 (+   567us) log.cc:844] Serialized 52 byte log entry
0709 13:17:10.637426 (+677855us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:10.637484 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.637573 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.943884 (+306311us) raft_consensus.cc:1685] finished
0709 13:17:10.943909 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.944091 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":785,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":25856,"thread_start_us":677428,"threads_started":1,"wal-append.queue_time_us":982190}
I20260709 13:17:10.840764  8849 consensus_queue.cc:237] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:10.919312  9237 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:10.949668  9221 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:10.951295  9225 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:10.891927  9344 consensus_queue.cc:1059] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:17:10.955889  9253 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:10.918418  9159 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:10.898147  9308 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.891921  9232 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:10.959115  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.895638  9326 consensus_queue.cc:1059] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:17:10.899844  9191 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:10.904979  9113 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:10.918212  9342 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.949558  9237 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:10.990756  9244 consensus_meta.cc:287] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.528s	user 0.007s	sys 0.003s
I20260709 13:17:10.906051  9277 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:10.988662  9253 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:10.957706  9159 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:11.061682  3793 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
W20260709 13:17:11.066428  3761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.028s	sys 0.047s
W20260709 13:17:11.066792  3761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.028s	sys 0.047s
I20260709 13:17:11.003579  9326 consensus_queue.cc:1243] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:17:11.072825  3051 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.006s	sys 0.068s
I20260709 13:17:11.040829  9344 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:17:11.074436  3043 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.006s	sys 0.014s
I20260709 13:17:11.023645  9342 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:10.991753  9308 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:11.040913  8630 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:11.044111  9244 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:11.085500  3043 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.006s	sys 0.014s
I20260709 13:17:11.052130  9329 raft_consensus.cc:3055] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:17:11.084184  3051 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.006s	sys 0.068s
I20260709 13:17:10.994051  9191 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:11.076684  9301 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.759s	user 0.004s	sys 0.031s
I20260709 13:17:11.108184  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:11.109022  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:11.110760  3799 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 19. Current term is 20. Ops: [17.12-19.13]
I20260709 13:17:11.111497  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:11.112278  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:11.047681  9343 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:11.116209  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:11.150154  3795 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:11.126114  3761 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:11.130139  9352 log.cc:927] Time spent T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:17:11.149014  3796 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
W20260709 13:17:11.131011  9348 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 13:17:11.139590  9350 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:17:11.143460  9232 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:11.068774  9253 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:11.122725  9294 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:11.172717  9343 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:11.182966  9159 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:11.183825  3790 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:11.184135  9343 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:11.158766  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:11.114791  9282 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.185050  9282 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.185516  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:11.187172  3792 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:17:11.187758  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2826) took 1365 ms. Trace:
I20260709 13:17:11.188922  9277 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:11.188184  3043 rpcz_store.cc:276] 0709 13:17:09.822411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.017539 (+195128us) service_pool.cc:224] Handling call
0709 13:17:10.295313 (+277774us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:10.483561 (+188248us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:10.483598 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:10.519352 (+ 35754us) log.cc:844] Serialized 26 byte log entry
0709 13:17:11.115187 (+595835us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:11.115242 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.115329 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:11.187575 (+ 72246us) raft_consensus.cc:1685] finished
0709 13:17:11.187593 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.187708 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":187720,"raft.queue_time_us":219374,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":90,"thread_start_us":595400,"threads_started":1,"wal-append.queue_time_us":656282}
I20260709 13:17:11.187279  9282 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:11.190071  9253 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:11.190469  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:11.190912  9197 raft_consensus.cc:3055] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:11.191445  9197 raft_consensus.cc:740] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:11.192518  9197 consensus_queue.cc:260] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.187513  3792 pending_rounds.cc:85] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Aborting all ops after (but not including) 9
I20260709 13:17:11.195083  3792 pending_rounds.cc:107] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 16.10
W20260709 13:17:11.195885  3048 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 2820) took 1557 ms (client timeout 1656 ms). Trace:
W20260709 13:17:11.196027  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 557295us
W20260709 13:17:11.197943  3048 rpcz_store.cc:269] 0709 13:17:09.638196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.638379 (+   183us) service_pool.cc:224] Handling call
0709 13:17:11.194448 (+1556069us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b540004a1d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:11.195805 (+  1357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2215267584}
I20260709 13:17:11.195566  3792 raft_consensus.cc:2917] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Aborting config change with OpId 16.10: Aborted: Op aborted by new leader
I20260709 13:17:11.200023  3792 raft_consensus.cc:2889] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:11.193966  9185 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:11.166850  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:11.167996  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:11.169849  3050 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.014s	sys 0.026s
I20260709 13:17:11.174007  9346 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:11.116050  8630 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:11.117317  9329 raft_consensus.cc:740] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:17:11.148422  9301 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.834s	user 0.004s	sys 0.031s
I20260709 13:17:11.172479  9198 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:11.177672  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:11.118170  9344 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:11.200698  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 361746us
I20260709 13:17:11.170248  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:11.190840  9191 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:11.187431  9262 consensus_meta.cc:287] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.622s	user 0.004s	sys 0.004s
W20260709 13:17:11.165038  3123 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.010s	sys 0.017s
I20260709 13:17:11.207583  3090 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:11.241564  3123 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.011s	sys 0.018s
I20260709 13:17:11.217375  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:11.243605  9198 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.243949  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:11.203300  9234 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:17:11.207396  9267 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:11.246745  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:11.245047  3090 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:11.243881  9048 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:11.216218  9249 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:11.255424  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.255522  9282 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.202569  9345 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.228621  9346 raft_consensus.cc:697] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:11.283089  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:11.283877  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:11.284644  3199 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:11.284963  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:11.287889  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:11.288618  3191 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:11.249109  9262 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:11.293782  3199 raft_consensus.cc:1240] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:11.289696  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:11.295372  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:11.296012  3124 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:17:11.297461  3199 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:17:11.228417  9325 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:17:11.265697  9343 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.262398  9277 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.303488  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2825) took 1482 ms. Trace:
I20260709 13:17:11.308050  3051 rpcz_store.cc:276] 0709 13:17:09.821170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.955237 (+134067us) service_pool.cc:224] Handling call
0709 13:17:09.955589 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.974607 (+ 19018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.974637 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:10.307457 (+332820us) log.cc:844] Serialized 26 byte log entry
0709 13:17:11.119213 (+811756us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:11.119269 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.119363 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:11.303275 (+183912us) raft_consensus.cc:1685] finished
0709 13:17:11.303298 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.303428 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":202628,"raft.queue_time_us":19217,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":234613,"thread_start_us":811264,"threads_started":1,"wal-append.queue_time_us":907548}
I20260709 13:17:11.304808  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:11.287402  9253 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:11.309008  3191 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:17:11.309890  3120 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:11.291774  9203 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:11.259402  9048 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:11.311491  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:11.252653  9220 consensus_queue.cc:1059] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:17:11.307605  9262 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:11.319357  8630 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:11.319734  9262 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:11.291657  9282 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.322695  9282 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:17:11.326198  9346 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:11.313102  9343 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.315358  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:11.292520  9063 raft_consensus.cc:3055] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:11.331830  9063 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:11.332723  9063 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.333793  9063 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:11.334148  9292 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:11.334975  9307 raft_consensus.cc:3055] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:11.316654  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:11.335361  9307 raft_consensus.cc:740] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:11.336194  9307 consensus_queue.cc:260] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.336988  9225 raft_consensus.cc:3055] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:11.337199  9307 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:11.338768  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 2823) took 1683 ms. Trace:
I20260709 13:17:11.339118  3047 rpcz_store.cc:276] 0709 13:17:09.655415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.676690 (+ 21275us) service_pool.cc:224] Handling call
0709 13:17:11.338603 (+1661913us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54001f5254. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:11.338713 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2775036800}
I20260709 13:17:11.340266  9342 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.299640  8920 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:17:11.341854  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.342093  8920 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.344107  9262 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:11.344763  8920 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:11.349787  9332 raft_consensus.cc:3055] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:11.350224  9332 raft_consensus.cc:740] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:11.351131  9332 consensus_queue.cc:260] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:11.352671  9332 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:11.341756  3042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 2817) took 1729 ms (client timeout 1780 ms). Trace:
W20260709 13:17:11.358675  3042 rpcz_store.cc:269] 0709 13:17:09.612544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.613301 (+   757us) service_pool.cc:224] Handling call
0709 13:17:11.341560 (+1728259us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400074c54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:11.341683 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2936729856}
I20260709 13:17:11.337391  9225 raft_consensus.cc:740] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:11.360988  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:11.286283  9329 consensus_queue.cc:260] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:11.376168  3118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2735) took 2364 ms (client timeout 2154 ms). Trace:
W20260709 13:17:11.376816  3118 rpcz_store.cc:269] 0709 13:17:09.007738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.069167 (+ 61429us) service_pool.cc:224] Handling call
0709 13:17:11.372029 (+2302862us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b540038fed4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:11.372196 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465321216}
I20260709 13:17:11.318079  9203 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.291479  9249 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:11.371347  9161 consensus_meta.cc:287] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.760s	user 0.012s	sys 0.000s
I20260709 13:17:11.372994  9048 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:11.384135  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:11.388648  3193 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 19. Current term is 20. Ops: [17.10-19.11]
I20260709 13:17:11.365438  9294 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:11.395630  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:11.315711  9277 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.386554  9203 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:11.363492  9221 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.389910  9161 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:11.426950  3196 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:17:11.422650  9277 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:11.397184  9222 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:11.443655  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.405424  9294 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:11.527380  3798 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:11.426482  9192 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:11.401727  3165 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:11.512117  9325 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:11.539467  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 151657us
I20260709 13:17:11.543349  9362 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:11.548143  9362 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.550058  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:11.528324  9222 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.548246  9277 consensus_queue.cc:1059] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:17:11.554225  9277 raft_consensus.cc:3055] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:11.554616  9277 raft_consensus.cc:740] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:11.555505  9277 consensus_queue.cc:260] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.556907  9277 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:11.549705  9362 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:11.563727  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1086) took 1814 ms. Trace:
I20260709 13:17:11.568163  3126 rpcz_store.cc:276] 0709 13:17:09.749307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.750584 (+  1277us) service_pool.cc:224] Handling call
0709 13:17:09.750918 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.776382 (+ 25464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.776433 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.776479 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:09.776520 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.563479 (+1786959us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b540011d0d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:11.563536 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.563671 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58077952}
I20260709 13:17:11.569639  9308 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:11.567404  9197 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:11.580720  3165 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:11.586447  9253 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:11.544610  9325 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.588841  9063 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:11.594148  9309 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:11.594774  9331 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:11.592950  9199 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:11.606542  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2749) took 1796 ms. Trace:
I20260709 13:17:11.611662  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:11.618678  3796 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:11.612282  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3211) took 1357 ms. Trace:
I20260709 13:17:11.627007  3165 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:11.623190  3050 rpcz_store.cc:276] 0709 13:17:10.255050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.622483 (+367433us) service_pool.cc:224] Handling call
0709 13:17:10.622791 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.623009 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:11.206436 (+583427us) log.cc:844] Serialized 14 byte log entry
0709 13:17:11.611887 (+405451us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:11.611966 (+    79us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:11.612026 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.612123 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.612231 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":696934,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":845,"thread_start_us":955998,"threads_started":2}
I20260709 13:17:11.618458  3123 rpcz_store.cc:276] 0709 13:17:09.811397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.811715 (+   318us) service_pool.cc:224] Handling call
0709 13:17:09.811993 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.812189 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:09.812490 (+   301us) log.cc:844] Serialized 14 byte log entry
0709 13:17:11.247756 (+1435266us) log.cc:844] Serialized 14 byte log entry
0709 13:17:11.606122 (+358366us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:11.606192 (+    70us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:11.606252 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.606337 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.606470 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51796,"prepare.queue_time_us":589163,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":139858,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":3399,"thread_start_us":1734993,"threads_started":3}
W20260709 13:17:11.611243  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 364560us
I20260709 13:17:11.601378  9249 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:11.631012  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:11.612774  9173 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:11.639899  3165 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:17:11.644327  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.648782  3761 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:11.649021  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:11.648290  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:11.647312  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:11.649704  3047 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:17:11.656553  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:11.656052  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:11.660970  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:11.661412  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:11.662204  3042 raft_consensus.cc:1813] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Handling vote request from an unknown peer f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:11.662931  3042 raft_consensus.cc:2410] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:17:11.637681  9221 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:11.664455  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:11.665256  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:11.614183  9309 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.666630  3050 raft_consensus.cc:2393] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 16: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:11.667133  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:11.690579  3049 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 18: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:11.625175  9199 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:11.670063  9161 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:17:11.674270  9228 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:11.675769  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:11.631115  9063 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:11.697516  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:11.675874  9225 consensus_queue.cc:260] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.679823  9191 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:11.706156  9191 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.660542  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:11.708607  9191 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:11.709851  9371 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:11.710522  9371 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.712219  9343 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:11.651062  9234 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.712636  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1193) took 1944 ms. Trace:
I20260709 13:17:11.712951  9371 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:11.713135  3045 rpcz_store.cc:276] 0709 13:17:09.768089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.768223 (+   134us) service_pool.cc:224] Handling call
0709 13:17:09.768542 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.780015 (+ 11473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.780049 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.780091 (+    42us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:17:09.780127 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.712405 (+1932278us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b54001ae5d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:11.712457 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.712580 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25944448}
I20260709 13:17:11.656311  9293 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:11.715420  9293 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:11.715845  9293 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:11.650820  8920 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:11.623662  9331 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.651281  9311 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:11.692973  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:11.678629  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2408) took 1831 ms. Trace:
W20260709 13:17:11.690959  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 76545us
I20260709 13:17:11.693305  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:11.655984  9373 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:11.687089  9220 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.702957  9325 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:11.703363  9199 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:11.703649  9222 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:11.705264  9063 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:11.643683  9308 consensus_queue.cc:1048] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:17:11.738981  9220 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.722710  3090 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:11.713013  9234 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:11.744292  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.744851  3122 raft_consensus.cc:1275] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:11.728330  9242 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:11.719139  3200 rpcz_store.cc:276] 0709 13:17:09.847220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.966348 (+119128us) service_pool.cc:224] Handling call
0709 13:17:09.967085 (+   737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:10.061824 (+ 94739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:10.061853 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:10.302785 (+240932us) log.cc:844] Serialized 26 byte log entry
0709 13:17:11.362063 (+1059278us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x7b180019d920. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:17:11.632065 (+270002us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:11.632106 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.632168 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:11.678314 (+ 46146us) raft_consensus.cc:1685] finished
0709 13:17:11.678336 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.678560 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44504,"raft.queue_time_us":278163,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":12981,"spinlock_wait_cycles":19562752,"thread_start_us":269793,"threads_started":1,"wal-append.queue_time_us":1369001}
I20260709 13:17:11.730154  9311 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:11.731673  9235 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:11.732759  9331 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:11.733912  9225 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:11.749068  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:11.738161  3047 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:11.692859  9326 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:11.741005  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:11.751133  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.734612  9373 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.749138  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:11.758463  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 91127.5us
I20260709 13:17:11.752676  3042 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:11.818544  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:11.739300  8920 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.816846  9063 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:11.833600  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:11.834578  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 53806.5us
I20260709 13:17:11.745517  9216 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.746901  9264 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:11.854828  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 105830us
I20260709 13:17:11.855679  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:11.857787  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.857987  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:11.858361  3119 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:11.735870  9048 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:11.881909  3125 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 19: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:11.882552  3119 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 13:17:11.884912  3121 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:17:11.829319  9373 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:11.855695  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:11.832360  9220 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:11.854116  9253 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:11.895308  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:11.896082  3124 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:11.856174  9308 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:11.891080  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:11.856418  9331 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:11.864682  9264 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.894322  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:11.897713  3118 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:11.892539  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:11.855027  9228 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:11.856400  9235 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.864420  9216 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:11.910002  9216 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:11.900091  9048 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:11.900307  9311 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:11.854401  8920 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:11.912712  8920 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:11.907758  9235 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:11.913784  3125 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:11.914502  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:11.914959  9235 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:11.915162  3118 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
W20260709 13:17:11.891824  9370 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:17:11.881953  9234 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:11.921932  3164 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:11.856683  9309 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:11.856962  9197 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:11.929886  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:11.828536  9326 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.896940  9325 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:11.898277  9346 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:17:11.929406  9203 consensus_meta.cc:287] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.001s
I20260709 13:17:11.927812  9253 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.948975  3118 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 13:17:11.931988  9332 consensus_meta.cc:287] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.001s
I20260709 13:17:11.921703  8873 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:17:11.901868  9185 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:17:11.942765  9262 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:11.933701  9234 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:11.954478  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:11.960978  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:11.965173  3792 raft_consensus.cc:2410] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:17:11.961871  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:11.965216  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:11.951386  9384 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:11.926416  9228 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:11.944960  9308 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:11.965938  3117 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:11.946612  9311 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:11.967517  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:11.934496  9293 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:11.951849  9239 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:11.980849  9311 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:11.981612  9239 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.983525  9311 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:11.947356  9362 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.935105  9197 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.979230  9228 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:11.979764  9293 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:11.987536  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:11.989423  9173 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:11.980307  9384 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:11.991236  9197 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:11.991585  9384 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:11.971343  9290 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:11.972432  3121 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:11.994699  3117 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:17:11.984405  9239 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:11.952752  9203 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:12.000154  9203 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:12.001219  3124 raft_consensus.cc:2368] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 16. Current term is 17.
I20260709 13:17:11.963908  9262 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.009984  9262 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:11.986369  9308 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:12.012567  9308 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:11.954852  9253 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.015491  9253 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:11.946777  9346 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:12.004336  9239 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:12.027479  9382 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:17:12.027709  9239 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.029693  9346 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:11.970335  9234 raft_consensus.cc:697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:12.031136  9234 consensus_queue.cc:237] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:12.033356  9326 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:12.019711  9294 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:12.035336  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.036363  9294 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:12.037297  9362 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:12.042944  9239 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:12.049592  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 103911us
I20260709 13:17:12.050855  9294 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.051347  9253 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:12.051491  9294 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:12.053449  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.055058  9262 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.057610  9262 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:12.059087  9373 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:12.062464  9294 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:12.062521  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:12.063652  9384 consensus_queue.cc:1059] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:12.064109  9326 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:12.084975  3792 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:12.085166  9294 raft_consensus.cc:3055] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:12.085852  9294 raft_consensus.cc:740] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:12.085179  9326 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:17:12.086719  9294 consensus_queue.cc:260] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.088073  9294 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:12.065423  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:12.076040  9329 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:12.064612  9185 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:12.090166  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:12.092032  9203 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.092218  8834 raft_consensus.cc:3055] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:12.090229  9185 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:12.092670  8834 raft_consensus.cc:740] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:12.083336  9345 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:12.092957  9185 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:12.093717  9384 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:12.094090  9185 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:12.079777  3798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43926 (request call id 1086) took 1694 ms. Trace:
I20260709 13:17:12.093835  8834 consensus_queue.cc:260] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.094672  3798 rpcz_store.cc:276] 0709 13:17:10.385995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.386664 (+   669us) service_pool.cc:224] Handling call
0709 13:17:12.079572 (+1692908us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b54005a19d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:12.079711 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2224758144}
I20260709 13:17:12.092684  9203 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:12.095495  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:12.094218  9384 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.088093  9326 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:12.097883  8834 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:12.098261  9384 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:12.098680  9311 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:12.097821  9203 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:12.102264  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.106802  9262 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:12.107477  9262 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.108232  9198 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:12.081807  9342 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:12.107138  9293 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:12.109215  9215 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:12.109908  9239 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.109689  9215 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.110857  9228 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:12.110563  9239 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.111402  9228 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:12.112015  9215 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:12.112547  9215 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.113047  9239 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:12.112965  9215 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.113602  9228 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:12.098129  9307 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:12.113881  9277 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:12.118224  9277 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:12.120795  9264 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:12.109575  9293 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:12.121805  9262 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:12.123721  9277 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:12.124811  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.116379  3195 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:17:12.127213  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.136217  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.126219  3195 pending_rounds.cc:85] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 9
I20260709 13:17:12.137095  3195 pending_rounds.cc:107] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 16.10
I20260709 13:17:12.138095  3192 raft_consensus.cc:2393] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 19: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:12.138268  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.139312  3198 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:12.136664  9293 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:12.140635  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.115134  9291 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.141358  9291 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.142479  9224 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:12.143471  3194 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:12.143594  9291 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:12.114897  9200 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.144847  9200 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:12.147190  9200 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:12.114797  8920 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.148008  8920 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.141357  3045 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:12.150244  8920 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:12.150980  3195 raft_consensus.cc:2917] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Aborting config change with OpId 16.10: Aborted: Op aborted by new leader
I20260709 13:17:12.151620  3195 raft_consensus.cc:2889] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:12.114398  9307 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:12.153270  9307 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:12.113706  9239 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:12.158275  9239 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:12.160717  3197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2401) took 2322 ms (client timeout 2534 ms). Trace:
I20260709 13:17:12.160851  9239 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:12.162161  3791 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 753) took 4109 ms (client timeout 1781 ms). Trace:
W20260709 13:17:12.162586  3791 rpcz_store.cc:269] 0709 13:17:08.052604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.052744 (+   140us) service_pool.cc:224] Handling call
0709 13:17:12.161957 (+4109213us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b5400660154. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:12.162064 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4415703808}
I20260709 13:17:12.165678  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2463) took 3366 ms. Trace:
I20260709 13:17:12.167074  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.167914  3118 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:12.169888  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.174145  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.174804  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.175446  3120 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:17:12.158717  9344 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:12.161151  3197 rpcz_store.cc:269] 0709 13:17:09.838643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.838913 (+   270us) service_pool.cc:224] Handling call
0709 13:17:12.160306 (+2321393us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400178754. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:12.160624 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2304429312}
I20260709 13:17:12.176719  3196 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:17:12.167681  3122 rpcz_store.cc:276] 0709 13:17:08.799012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.799131 (+   119us) service_pool.cc:224] Handling call
0709 13:17:08.799421 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.745211 (+2945790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.165284 (+420073us) spinlock_profiling.cc:243] Waited 2.94 s on lock 0x7b5400319554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:12.165558 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6759526784}
I20260709 13:17:12.178141  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:12.178258  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.178725  3197 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:12.179378  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.180022  3191 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:12.180652  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:12.180843  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.181241  3193 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:12.181969  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.182101  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.182717  3191 raft_consensus.cc:2393] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 18: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:12.182756  3192 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:17:12.183812  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.184505  3192 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:12.185256  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.186671  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.183751  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.189172  3191 raft_consensus.cc:2410] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
W20260709 13:17:12.157546  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.191303  3042 raft_consensus.cc:1240] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:12.193020  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.193701  3042 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 16: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:12.193725  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.193957  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.194594  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.195211  3051 raft_consensus.cc:2393] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:12.195323  3192 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:12.201709  3792 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:12.208459  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.208827  3191 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:17:12.209667  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.210284  3046 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:12.195240  3050 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:17:12.211504  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.219185  3197 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:12.221276  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.116497  9215 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:12.222064  3046 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:12.222182  3043 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:12.222711  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:12.222985  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.223289  3192 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:12.223564  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.224076  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.224268  3043 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:12.225152  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:12.225994  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:12.226631  3796 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:17:12.226871  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:17:12.227429  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.227545  3049 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:12.221341  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.083266  9373 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:12.228827  3194 raft_consensus.cc:2393] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 19: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:12.187608  3200 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:12.229661  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:12.225315  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:12.230618  3043 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:12.235270  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.236017  3042 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:12.239462  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.240346  3042 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:17:12.225704  3046 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:12.242872  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.243839  3042 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:12.246018  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.230465  3795 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:17:12.249514  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:12.250876  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:12.254370  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:12.255843  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:12.256323  3049 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:12.256699  3799 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:17:12.262387  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46828.3us
I20260709 13:17:12.262432  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:12.263276  3090 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:12.263568  3791 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:12.264309  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:12.265095  3049 raft_consensus.cc:2393] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:12.269508  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.270565  3197 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:12.271916  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.276789  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.273547  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.278148  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.278841  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:12.281107  3197 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:12.281661  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:12.283219  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.285701  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.286556  3196 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:12.299993  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:12.301074  3797 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:12.301332  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:12.291213  3164 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:17:12.293810  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 196761us
I20260709 13:17:12.306648  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.309881  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:12.311710  3117 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:17:12.316751  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.316802  3091 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:12.320302  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.321205  3194 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 19: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:12.323910  3790 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:17:12.325274  3091 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:12.330807  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.331038  3091 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:12.262547  8920 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.332556  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:12.333420  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.337472  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:12.338186  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.338235  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.339746  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.329118  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:12.288786  9293 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:12.345620  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.379783  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.408643  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:12.427572  3122 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:12.344630  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.395195  3198 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:12.407146  3046 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:12.427934  3042 raft_consensus.cc:2410] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:17:12.344102  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:12.426442  3120 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:12.343442  3165 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:12.429659  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 100646us
I20260709 13:17:12.431033  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.437422  3192 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:12.444218  3200 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:17:12.445652  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:12.436834  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 92786.3us
W20260709 13:17:12.440179  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 96851.7us
I20260709 13:17:12.323338  9344 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:12.327207  9342 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:12.448945  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.498358  3195 raft_consensus.cc:2410] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:17:12.449136  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.449779  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:12.450387  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 119626us
I20260709 13:17:12.500496  3091 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:12.362219  9326 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.503492  3164 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:12.340660  3193 raft_consensus.cc:2410] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:17:12.455140  3165 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:12.479162  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.346565  9373 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:12.442416  9391 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:12.492406  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:12.511396  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:12.511895  9394 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:17:12.512436  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:12.512558  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:12.410554  9384 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.515653  9384 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:12.516340  9384 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:12.516938  9384 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:12.517498  9384 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:12.344548  9173 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.520089  9384 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:12.520569  9384 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:12.520262  9173 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.522275  9198 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:12.522598  9173 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:12.382598  9329 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:12.522940  9198 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.523543  9329 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:12.435680  9232 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:12.447163  9363 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:12.525859  9232 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:12.526345  9232 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:12.493532  9344 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:12.526988  9344 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:12.511616  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.528683  3091 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:12.530242  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.530740  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.531531  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.532287  9221 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:12.533952  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.534253  9057 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:12.534785  3120 raft_consensus.cc:2410] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:17:12.537330  9264 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:12.526320  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:12.537153  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.538940  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:12.540930  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:12.493152  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:12.542325  9344 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.543741  3124 raft_consensus.cc:2410] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:17:12.544258  9221 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:12.525540  9198 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:12.528839  9329 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:12.545994  9294 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:12.546310  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.546952  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:12.547974  3125 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:17:12.548334  9326 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.458029  9345 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:12.549045  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.573302  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:12.551573  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 47006.2us
I20260709 13:17:12.333022  9161 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.121s
I20260709 13:17:12.557396  3043 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:17:12.557977  3799 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:12.588426  3120 raft_consensus.cc:2410] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:17:12.588639  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:12.558736  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.560485  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.591203  3124 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
W20260709 13:17:12.562685  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 107624us
I20260709 13:17:12.592335  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:12.593122  3122 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:12.593631  3046 raft_consensus.cc:2368] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19.
I20260709 13:17:12.375478  8920 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.566850  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.568377  9239 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:12.570946  3125 pending_rounds.cc:85] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 12
I20260709 13:17:12.597580  3125 pending_rounds.cc:107] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:17:12.597868  3125 raft_consensus.cc:2889] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:12.561559  9234 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:12.596505  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:12.596833  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:12.564922  9256 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:12.605119  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:12.606024  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 304752us
I20260709 13:17:12.561852  9325 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:12.609440  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:12.620520  3117 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:12.620838  3125 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:12.621886  3126 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:12.563179  9344 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:12.696518  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 73396.2us
I20260709 13:17:12.709519  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:12.721383  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.722795  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:12.724583  3761 leader_election.cc:400] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 16. Current term is 17.
I20260709 13:17:12.724942  3761 leader_election.cc:403] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:12.620048  9256 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:17:12.631541  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 56799.5us
I20260709 13:17:12.632429  3165 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:17:12.734133  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 101799us
I20260709 13:17:12.735642  3794 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:12.632711  8873 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:12.638864  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:12.712824  9203 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:12.642204  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.643131  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.645118  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:12.658039  9394 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:17:12.675961  8920 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:12.676911  3196 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:17:12.598851  8834 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:12.708127  9329 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.031s
I20260709 13:17:12.595479  9391 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:12.680395  9294 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:12.597237  9173 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:12.568773  9373 raft_consensus.cc:697] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:17:12.686059  9224 consensus_meta.cc:287] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.004s
W20260709 13:17:12.689430  9185 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.595s	user 0.009s	sys 0.000s
I20260709 13:17:12.447433  9293 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:12.730517  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.731874  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.733430  3164 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:17:12.623915  2942 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49738 (request call id 151) took 17815 ms (client timeout 15000 ms). Trace:
I20260709 13:17:12.735854  3165 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:12.738300  3042 raft_consensus.cc:2410] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:17:12.639087  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.815527  3046 raft_consensus.cc:2393] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 19: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:12.739128  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.816748  3043 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 18: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:12.721292  9358 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:12.758181  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.758283  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:12.820048  3117 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:12.820137  3051 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:12.621600  9307 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:12.679563  9326 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:12.759908  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.760054  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.825201  3049 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 18: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:12.737497  9256 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:12.746977  9277 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:12.745232  9346 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:17:12.817768  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 81949.7us
I20260709 13:17:12.818956  3125 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:17:12.819082  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:12.792616  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.750639  9280 consensus_queue.cc:1059] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:17:12.770803  9242 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:12.827888  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.828258  3043 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:17:12.825152  3119 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:12.845604  3048 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:12.838336  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.840569  3046 raft_consensus.cc:2393] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:12.840806  3165 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:12.816915  9198 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.816687  9128 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:12.826068  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 92741.5us
I20260709 13:17:12.823868  9383 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.817998  9398 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 16. Current term is 17.
I20260709 13:17:12.844671  9242 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:12.814091  9221 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:12.820606  8920 raft_consensus.cc:2764] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:17:12.815990  9185 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:12.818161  9344 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:12.819756  9358 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:12.826614  9262 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:12.852161  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 255358us
I20260709 13:17:12.839952  9277 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.770502  9173 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.841356  9326 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.846432  3042 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:17:12.871476  3051 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
W20260709 13:17:12.822695  2942 rpcz_store.cc:269] 0709 13:16:54.809131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.809468 (+   337us) service_pool.cc:224] Handling call
0709 13:16:55.587844 (+778376us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b5400002490. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28f0b2 00007ff836208a89 00007ff8361a0da6 00007ff836172088 00007ff83627037e 00007ff8347312a4 00007ff834731232 00007ff834731161 00007ff8347310dc
0709 13:17:12.623824 (+17035980us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:07.208998 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:07.209684 (+   686us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:07.214660 (+  4976us) write_op.cc:435] Acquired schema lock
0709 13:17:07.219215 (+  4555us) tablet.cc:662] Decoding operations
0709 13:17:07.491430 (+272215us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:07.491566 (+   136us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:07.491594 (+    28us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:17:07.493132 (+  1538us) tablet.cc:701] Row locks acquired
0709 13:17:07.493183 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:17:07.493373 (+   190us) write_op.cc:270] Start()
0709 13:17:07.493550 (+   177us) write_op.cc:276] Timestamp: P: 1783603027493305 usec, L: 0
0709 13:17:07.493584 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:17:07.559806 (+ 66222us) log.cc:844] Serialized 7814 byte log entry
0709 13:17:08.044557 (+484751us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82d2a90ac 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b
0709 13:17:08.720708 (+676151us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b54000d98d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303aee28 00007ff833de9581 00007ff833de8d58 00007ff833ded9f1 00007ff833ded9a9 00007ff833ded939 00007ff833ded901 00007ff833decb2d 000000000038f354 000000000038f199
0709 13:17:09.284352 (+563644us) op_driver.cc:464] REPLICATION: finished
0709 13:17:10.519291 (+1234939us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82d2a90ac 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff833de9ef0
0709 13:17:11.178068 (+658777us) write_op.cc:301] APPLY: starting
0709 13:17:11.178174 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:11.424034 (+245860us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:11.424140 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:11.611331 (+187191us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b1800386560. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c6522 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:17:12.072594 (+461263us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:12.073001 (+   407us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=0,mrs_lookups=0
0709 13:17:12.073076 (+    75us) write_op.cc:312] APPLY: finished
0709 13:17:12.073568 (+   492us) log.cc:844] Serialized 180 byte log entry
0709 13:17:12.382705 (+309137us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:12.382993 (+   288us) write_op.cc:454] Released schema lock
0709 13:17:12.383076 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:12.383494 (+   418us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:12.383526 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2216018,"reported_tablets":27,"spinlock_wait_cycles":95385856,"child_traces":[["op",{"apply.queue_time_us":1887474,"apply.run_cpu_time_us":58158,"apply.run_wall_time_us":1205413,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87767,"num_ops":20,"prepare.queue_time_us":95986,"prepare.run_cpu_time_us":38394,"prepare.run_wall_time_us":1511982,"raft.queue_time_us":343852,"raft.run_cpu_time_us":37201,"raft.run_wall_time_us":2022783,"replication_time_us":1738226,"spinlock_wait_cycles":84111872,"thread_start_us":3473398,"threads_started":5,"wal-append.queue_time_us":1142825,"wal-append.run_cpu_time_us":87576,"wal-append.run_wall_time_us":1851057}]]}
I20260709 13:17:12.861382  9242 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:12.874971  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:12.871169  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 146778us
I20260709 13:17:12.906908  3119 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
W20260709 13:17:12.880330  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 50292us
I20260709 13:17:12.909134  3165 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:12.885200  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.861377  9224 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:12.907469  3761 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:12.861716  9362 raft_consensus.cc:3055] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:12.880297  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.915225  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:12.915625  3043 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:17:12.882347  9358 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:12.874359  9221 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:12.905788  3047 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 20. Current term is 21. Ops: []
W20260709 13:17:12.882999  9396 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:17:12.934994  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:12.912635  3165 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:17:12.904704  9399 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:17:12.929852  9402 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:17:12.885836  9344 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.941569  3165 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:12.910036  3117 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:12.913650  9329 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:12.917621  9401 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:17:12.859838  9198 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:12.879866  9215 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.929677  9409 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:12.882200  9262 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.889065  9277 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:12.891851  9373 consensus_queue.cc:237] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:12.918665  9371 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:17:12.926910  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:12.928500  3762 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:12.893148  9291 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:12.883579  9311 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:12.892210  9173 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:12.932583  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:12.932832  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:12.862756  9383 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.939922  3119 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:12.862412  9128 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:12.914494  9362 raft_consensus.cc:740] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:12.920476  8873 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:12.944633  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:12.947454  3165 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:12.920238  9224 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.936180  9384 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:12.945844  9325 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:12.949790  3118 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:12.944700  9216 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:12.954538  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.933877  9228 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.960337  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:12.946879  9329 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.962958  9198 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:12.910037  9326 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:12.925554  3122 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:12.927134  8834 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:17:12.930378  9294 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:17:12.976392  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:13.052094  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 75796.3us
I20260709 13:17:13.052902  3164 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:13.054411  3164 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:12.983486  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 56675.3us
I20260709 13:17:12.988724  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.988881  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.955852  9280 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:12.994123  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:12.934219  9400 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:17:13.031951  9363 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:12.937459  9232 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:12.970145  9262 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:12.985212  9406 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:17:13.008060  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:13.006783  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:13.011129  3091 leader_election.cc:400] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19.
I20260709 13:17:13.094298  3091 leader_election.cc:403] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:13.011843  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:13.095268  3044 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:13.025220  3793 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
W20260709 13:17:13.029229  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 81890.8us
I20260709 13:17:12.994123  9291 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:13.030462  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 95546.6us
I20260709 13:17:13.098927  3042 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 18: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:13.101662  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:12.997375  9342 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:13.005188  9413 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:13.013139  9057 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:17:13.090834  9405 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:17:13.024753  8873 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.056385  3045 raft_consensus.cc:2410] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:17:13.058097  3043 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:13.059296  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:13.057614  3090 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:13.038779  9216 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.957034  9200 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.043258  9329 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:13.012939  9308 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:17:13.097229  3165 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:17:13.107613  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 96668us
I20260709 13:17:13.099483  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:13.056684  9280 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.143059  9280 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:13.078513  8932 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:13.028671  9311 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:13.127897  8873 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:13.136822  9410 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.199s	user 0.001s	sys 0.001s
W20260709 13:17:13.116171  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 187729us
I20260709 13:17:12.969599  9215 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:13.049125  9228 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:13.109282  9291 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:13.093585  9185 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:13.112965  9203 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:17:13.110785  9342 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.111552  9363 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:13.082374  9161 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 13:17:13.146679  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 49584us
I20260709 13:17:13.082604  9198 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.045s
W20260709 13:17:13.152982  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 53594.1us
I20260709 13:17:13.115394  9057 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:13.066397  9290 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:13.165074  8932 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:13.131031  9216 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:13.165462  9415 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:17:13.164062  9294 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:13.166436  9293 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:13.184973  3762 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:13.193624  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:13.191535  3165 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:13.140980  9200 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:13.201802  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 147451us
I20260709 13:17:13.211617  3164 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:13.185712  9344 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:13.191774  9342 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:13.201615  9412 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:17:13.213783  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:13.224005  9363 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:13.224205  8834 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:13.224526  9363 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:13.225580  9363 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:13.229382  9430 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:13.233011  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:13.235751  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:13.236522  3193 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:13.238178  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:13.238945  3119 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:13.239493  9428 consensus_queue.cc:1059] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:13.201087  9221 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:13.205212  9224 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:13.210644  9185 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:13.268529  9185 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.269071  9185 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:13.211303  9232 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:13.223219  9419 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.258070  9228 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:13.207652  8932 raft_consensus.cc:697] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:13.291802  9326 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:13.291960  9256 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:13.242545  9344 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:13.254128  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:13.296674  3196 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:13.223636  9293 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:13.246569  9414 consensus_queue.cc:1059] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:17:13.274224  9346 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.284500  9057 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:13.258659  9418 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:17:13.317138  3200 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:13.318650  3199 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:13.294579  9344 raft_consensus.cc:697] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:13.320243  9344 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:13.321116  9159 raft_consensus.cc:3055] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:13.321547  9159 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:13.274968  9419 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:13.313170  3121 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:13.314767  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:13.303937  9293 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:13.352244  9293 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:13.353786  9232 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.354364  9232 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:13.355002  9185 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:13.356559  9232 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:13.357086  9185 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:13.262334  9417 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:13.242511  9384 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:13.269709  9128 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:13.359985  9419 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:13.290927  9345 consensus_meta.cc:287] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.696s	user 0.010s	sys 0.002s
I20260709 13:17:13.360690  9345 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:13.307993  3761 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:13.361990  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 54118us
I20260709 13:17:13.362825  3761 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:13.280128  9362 consensus_queue.cc:260] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:13.363567  9408 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.424s	user 0.000s	sys 0.003s
I20260709 13:17:13.364234  9362 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:13.366904  3761 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:13.330590  9159 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:13.244588  9383 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:13.332468  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2427) took 1072 ms. Trace:
I20260709 13:17:13.368532  9419 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:13.332726  9173 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:13.378108  9342 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:13.322427  9371 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:13.333557  9277 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:13.335204  9294 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.387226  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:13.322891  9346 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:13.336431  9280 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:13.351351  9057 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:13.368710  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 157222us
I20260709 13:17:13.407754  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:13.320180  9215 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:13.413769  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:13.388707  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:13.389019  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:13.414983  3043 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:13.381803  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:13.365984  9413 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:13.402874  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:13.411545  3121 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:13.412776  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:13.412896  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:13.414113  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 180938us
I20260709 13:17:13.413679  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:13.295863  9200 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:13.377396  3197 rpcz_store.cc:276] 0709 13:17:12.259835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.508230 (+248395us) service_pool.cc:224] Handling call
0709 13:17:12.508673 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:12.631525 (+122852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:12.631574 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:12.632128 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:17:12.860750 (+228622us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:12.860813 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.860909 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:13.332241 (+471332us) raft_consensus.cc:1685] finished
0709 13:17:13.332262 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.332405 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122242,"raft.queue_time_us":123096,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":228176,"threads_started":1,"wal-append.queue_time_us":312433}
I20260709 13:17:13.427214  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:13.417382  3193 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:13.420243  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:13.421465  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:13.424860  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:13.454218  9307 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:13.458467  9307 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:13.460970  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 79247.4us
W20260709 13:17:13.453477  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 311144us
I20260709 13:17:13.451675  3200 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:13.383406  9398 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:13.462642  3091 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:13.464102  3091 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:13.465041  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.465442  3091 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:13.466805  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 409226us
I20260709 13:17:13.467093  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:13.467603  3090 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:13.469389  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 61759.3us
I20260709 13:17:13.469858  3794 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:13.470305  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:13.471406  3196 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:13.291975  8932 consensus_queue.cc:237] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:13.478524  3199 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:13.471925  3762 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:13.419037  9308 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.482201  3090 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:13.483829  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:13.486058  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:13.486806  3795 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:13.489625  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:13.491292  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:17:13.495086  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.497715  3091 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:13.457099  9290 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:13.403848  9262 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:13.403151  9294 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:13.485277  9436 log.cc:927] Time spent T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:17:13.406111  9371 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:13.505420  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:13.468791  9383 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:13.472054  9228 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:13.476622  9128 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:13.503003  3164 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:13.510485  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:13.475572  9413 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 17 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:17:13.515663  9358 consensus_meta.cc:287] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.000s
I20260709 13:17:13.537231  3121 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:17:13.501410  9224 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:13.486085  9326 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:13.504988  9419 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:13.529175  9242 consensus_meta.cc:287] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.603s	user 0.010s	sys 0.001s
I20260709 13:17:13.540899  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:13.505213  9198 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:13.545025  3048 raft_consensus.cc:2410] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:17:13.501279  9373 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:13.549229  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:13.546221  9423 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:13.543823  9224 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:13.561393  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:13.494199  8873 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:13.490080  9308 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:13.563599  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:13.575702  3119 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:13.540007  9426 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:17:13.581260  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 109409us
I20260709 13:17:13.559252  3164 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:13.509845  9200 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:17:13.584084  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:13.601822  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 96529.2us
I20260709 13:17:13.602605  3090 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:13.603029  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 43897.6us
I20260709 13:17:13.567770  9224 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:13.611711  3195 raft_consensus.cc:2368] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19.
I20260709 13:17:13.566545  9425 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:13.565394  9290 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:13.600939  9426 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:13.547833  9358 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:13.594283  9173 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:13.704947  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:13.557235  9242 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:13.701949  3090 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:13.728309  3090 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:13.729648  3090 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:13.730775  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:13.731799  3090 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:13.599294  9311 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:13.575441  9128 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:17:13.727034  3124 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 19: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:13.710779  9426 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:13.729417  9425 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:13.743275  9277 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:13.748121  9228 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:13.790206  9438 log.cc:927] Time spent T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
W20260709 13:17:13.791136  9442 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:17:13.791889  9443 log.cc:927] Time spent T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
W20260709 13:17:13.792743  9439 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
W20260709 13:17:13.794399  9446 log.cc:927] Time spent T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:17:13.931891  9291 consensus_meta.cc:287] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.746s	user 0.006s	sys 0.002s
I20260709 13:17:13.893517  9228 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.934716  9228 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:13.939167  9308 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:13.939767  9384 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.940450  9384 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:13.941256  9128 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:13.943197  9384 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:13.823149  9161 raft_consensus.cc:3055] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:13.782626  9293 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:13.953094  9128 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:13.953807  9128 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:13.955950  9128 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:13.896310  9425 raft_consensus.cc:697] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 21 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:13.963105  9425 consensus_queue.cc:237] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:13.945591  9161 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:13.970614  9161 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:13.973016  9161 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:13.833724  3796 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:13.834527  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:13.836786  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:13.982611  9358 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:13.842478  9280 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:13.846491  9256 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:13.853152  9159 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:13.855899  9198 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:13.997399  9198 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:13.998010  9198 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:13.858250  9342 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:13.860479  9221 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:13.780244  2947 catalog_manager.cc:5697] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 11 to 16, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 16 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:14.003845  2947 catalog_manager.cc:5697] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 8 to 12, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 12 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.705847  9434 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.158s
I20260709 13:17:13.903139  9371 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:13.906329  9262 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:13.907215  9294 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:13.908442  8873 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:13.909099  9448 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:14.008061  9448 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 21 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:13.702102  9413 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:13.793555  9433 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:17:13.909225  9242 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:13.912714  9216 consensus_meta.cc:287] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.696s	user 0.007s	sys 0.003s
I20260709 13:17:14.023159  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:14.023981  3794 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:13.828474  9345 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:14.009240  9448 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:14.019397  2947 catalog_manager.cc:5697] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 10 to 17, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 17 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:14.022257  9216 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:14.068054  9216 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:14.072867  9345 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:14.073662  9345 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:14.076867  9345 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:14.090845  9293 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:13.863950  9203 consensus_meta.cc:287] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.678s	user 0.009s	sys 0.000s
I20260709 13:17:14.106371  9203 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19.
W20260709 13:17:14.116237  9362 consensus_meta.cc:287] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.751s	user 0.009s	sys 0.004s
I20260709 13:17:13.932636  9291 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:14.118588  3192 raft_consensus.cc:2368] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21.
I20260709 13:17:14.124058  9291 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:14.142789  9329 consensus_meta.cc:287] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.980s	user 0.011s	sys 0.001s
I20260709 13:17:14.143553  9329 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:14.146900  9329 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:14.153195  3117 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:14.159376  3799 raft_consensus.cc:1240] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:14.161274  3761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.008s	sys 0.000s
W20260709 13:17:14.276042  3761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.009s	sys 0.001s
W20260709 13:17:14.276451  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 692452us
I20260709 13:17:14.254365  2947 catalog_manager.cc:5697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 12 to 17, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 17 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.281559  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:14.272861  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:14.284687  3796 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:14.285465  3123 raft_consensus.cc:2368] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 17. Current term is 18.
I20260709 13:17:14.290583  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 2519) took 1058 ms. Trace:
I20260709 13:17:14.291134  3117 rpcz_store.cc:276] 0709 13:17:13.232602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.232764 (+   162us) service_pool.cc:224] Handling call
0709 13:17:14.290425 (+1057661us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b54000a9954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:14.290531 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2009048320}
W20260709 13:17:14.252029  3196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.048s	sys 0.143s
W20260709 13:17:14.293877  3196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.049s	sys 0.143s
I20260709 13:17:14.295845  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:14.296568  3117 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:14.266341  3794 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:17:14.297580  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:14.166185  9294 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.250756  9371 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:14.304726  3121 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:14.272780  9384 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.307649  2947 catalog_manager.cc:5697] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 1 to 13. New cstate: current_term: 13 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:14.322764  3125 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.003s	sys 0.008s
W20260709 13:17:14.323439  3125 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.003s	sys 0.008s
I20260709 13:17:14.344527  3121 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:14.346287  3761 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:14.331089  9326 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.000s	sys 0.015s
W20260709 13:17:14.338796  3191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.000s	sys 0.012s
W20260709 13:17:14.356472  3191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.000s	sys 0.012s
I20260709 13:17:14.351372  2947 catalog_manager.cc:5697] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index -1 to 9, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 16 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:17:14.374243  2947 catalog_manager.cc:5697] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 10 to 15, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 15 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
W20260709 13:17:14.350800  9346 consensus_meta.cc:287] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.933s	user 0.008s	sys 0.004s
W20260709 13:17:14.391716  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.402767  3761 leader_election.cc:400] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 17. Current term is 18.
W20260709 13:17:14.357564  3090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.014s	sys 0.009s
I20260709 13:17:14.403182  3761 leader_election.cc:403] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:17:14.403389  3090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.015s	sys 0.010s
I20260709 13:17:14.321861  9294 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:14.358538  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2437) took 1126 ms. Trace:
W20260709 13:17:14.357236  9344 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.005s	sys 0.015s
I20260709 13:17:14.360885  9423 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:14.411360  2947 catalog_manager.cc:5697] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 11 to 14, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 14 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:14.348057  3091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.011s	sys 0.002s
I20260709 13:17:14.409657  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2443) took 1020 ms. Trace:
I20260709 13:17:14.329909  9262 consensus_queue.cc:1059] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
W20260709 13:17:14.360303  9326 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.000s	sys 0.016s
I20260709 13:17:14.338310  9384 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:14.330266  9371 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:14.413162  3191 rpcz_store.cc:276] 0709 13:17:13.232406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.232530 (+   124us) service_pool.cc:224] Handling call
0709 13:17:13.232842 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:13.233018 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:13.233277 (+   259us) log.cc:844] Serialized 14 byte log entry
0709 13:17:13.396161 (+162884us) log.cc:844] Serialized 14 byte log entry
0709 13:17:13.861114 (+464953us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b18003984a0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c6522 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:17:14.356887 (+495773us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:14.356947 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:14.356989 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.357104 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.358466 (+  1362us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48267,"prepare.queue_time_us":892,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":3389,"raft.queue_time_us":76982,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":29446,"spinlock_wait_cycles":10466560,"thread_start_us":1089487,"threads_started":2,"wal-append.queue_time_us":137786}
I20260709 13:17:14.360723  8873 consensus_queue.cc:1059] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:17:14.456174  3796 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:14.427990  9400 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:14.434742  3091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.012s	sys 0.002s
I20260709 13:17:14.375355  9329 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:17:14.463131  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 950056us
I20260709 13:17:14.330641  9228 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:14.399317  9308 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:14.410812  9426 consensus_meta.cc:287] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
I20260709 13:17:14.432359  3196 rpcz_store.cc:276] 0709 13:17:13.389751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.478504 (+ 88753us) service_pool.cc:224] Handling call
0709 13:17:13.478832 (+   328us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:13.501311 (+ 22479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:13.501346 (+    35us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:13.513373 (+ 12027us) log.cc:844] Serialized 78 byte log entry
0709 13:17:14.294379 (+781006us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:14.317099 (+ 22720us) log.cc:844] Serialized 14 byte log entry
0709 13:17:14.317393 (+   294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.317476 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.409354 (+ 91878us) raft_consensus.cc:1685] finished
0709 13:17:14.409383 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.409579 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22082,"prepare.queue_time_us":22209,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":2905,"raft.queue_time_us":41167,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":32037,"spinlock_wait_cycles":1792,"thread_start_us":719060,"threads_started":1,"wal-append.queue_time_us":821360}
W20260709 13:17:14.417145  9344 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.009s	sys 0.015s
W20260709 13:17:14.405411  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 673618us
I20260709 13:17:14.438266  9326 raft_consensus.cc:697] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:17:14.454442  9057 consensus_meta.cc:287] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.045s	user 0.006s	sys 0.006s
I20260709 13:17:14.440145  9449 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:14.477921  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:14.489806  3797 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.000s	sys 0.024s
W20260709 13:17:14.490147  3797 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.000s	sys 0.024s
W20260709 13:17:14.461407  9224 consensus_meta.cc:287] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.756s	user 0.012s	sys 0.000s
W20260709 13:17:14.482967  3198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.005s	sys 0.018s
I20260709 13:17:14.486357  3798 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 17: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:14.466958  9329 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:14.494694  3198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.005s	sys 0.018s
I20260709 13:17:14.363294  3164 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:17:14.496806  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 133610us
W20260709 13:17:14.500422  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 65872.8us
W20260709 13:17:14.491662  3015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.036s	user 0.004s	sys 0.020s
W20260709 13:17:14.501847  3015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.004s	sys 0.020s
W20260709 13:17:14.502544  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 1.08226e+06us
I20260709 13:17:14.503254  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:14.487519  3763 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.012s	sys 0.012s
W20260709 13:17:14.506513  3763 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.012s	sys 0.012s
I20260709 13:17:14.488343  9203 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:14.501238  9329 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:14.495987  9344 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:14.501237  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:14.503230  9262 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:14.473265  9308 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:14.523581  3762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.911s	user 0.061s	sys 0.057s
I20260709 13:17:14.465757  3091 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:17:14.532085  3762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.061s	sys 0.057s
W20260709 13:17:14.532518  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 66875.7us
I20260709 13:17:14.414965  9346 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:14.526602  3165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.121s	user 0.018s	sys 0.010s
W20260709 13:17:14.542032  3165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.136s	user 0.018s	sys 0.010s
I20260709 13:17:14.500826  9057 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:14.542719  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 1.1369e+06us
I20260709 13:17:14.523262  2947 catalog_manager.cc:5697] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:14.547340  3047 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:14.549302  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:14.527578  9344 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.534057  3091 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:14.546212  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:14.482321  9426 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:17:14.499116  9224 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:14.552039  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:14.492321  9449 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:14.556138  3042 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:14.560428  3091 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:14.548903  9198 consensus_meta.cc:287] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.001s
I20260709 13:17:14.544661  9383 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:14.547425  9293 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:14.523800  9203 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:14.568532  3091 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:14.550040  9294 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:14.547842  9262 raft_consensus.cc:697] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:14.578824  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:14.579835  3043 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:14.580869  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:14.581956  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:14.582202  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:14.582993  3051 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:14.583063  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:14.583813  3126 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:14.583947  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:14.584565  3125 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:14.576663  2947 catalog_manager.cc:5697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 11 to 16, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 16 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:14.529235  8932 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.004s	sys 0.023s
I20260709 13:17:14.522581  3117 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:14.577605  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:14.556823  9344 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:14.583181  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:14.596158  3117 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:17:14.588557  9345 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.598745  3091 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:14.589340  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:14.548156  9057 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:14.569165  9221 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:14.581627  3045 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:14.590660  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:14.580193  3165 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:14.568324  9383 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.607141  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:14.594023  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:14.612083  3118 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:14.588230  3048 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:14.596097  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:14.594026  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:14.592861  3047 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:17:14.593755  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:14.594074  3042 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:14.569561  9198 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:14.599443  2947 catalog_manager.cc:5697] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 8 to 12, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 12 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:14.600138  9346 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:14.602281  3123 raft_consensus.cc:2410] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:17:14.571988  9458 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:14.638178  3122 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:17:14.595800  9294 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.642386  2947 catalog_manager.cc:5697] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 15 to 18, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 18 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:14.606576  9362 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:14.591099  9457 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:14.615978  9383 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:14.639564  9159 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.649s	user 0.004s	sys 0.008s
I20260709 13:17:14.663753  3119 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:14.673418  2947 catalog_manager.cc:5697] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 10 to 12, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 12 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:14.559211  9326 consensus_queue.cc:237] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:14.617971  9371 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:14.683813  9463 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:14.691778  2947 catalog_manager.cc:5697] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 11 to 13, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 13 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.603118  9345 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:14.672178  9457 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:14.647886  9384 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:14.669821  9362 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.594828  3126 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:14.652686  9221 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:14.745302  3122 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:14.761682  3118 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:14.763828  3790 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
W20260709 13:17:14.794665  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.701087  9425 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:14.783867  2947 catalog_manager.cc:5697] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:14.656286  9294 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:14.811375  9384 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.811899  9362 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:14.729075  8932 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.005s	sys 0.023s
I20260709 13:17:14.812307  9457 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:14.813833  9221 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:14.739270  9228 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:14.815323  9423 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:14.822621  9256 raft_consensus.cc:3055] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:14.826298  3790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 777) took 1359 ms. Trace:
I20260709 13:17:14.829567  3797 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 852) took 1350 ms. Trace:
W20260709 13:17:14.832017  9460 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:17:14.865154  9448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.013s	sys 0.011s
I20260709 13:17:14.833112  9414 raft_consensus.cc:2955] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Committing config change with OpId 15.9: config changed from index 8 to 9, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:14.835956  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:14.882579  3051 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:14.837128  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:14.883679  3043 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:14.837834  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:14.884465  3042 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:17:14.838004  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:14.841389  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:14.886148  3048 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:14.842422  9224 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:14.844470  9198 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:14.845275  9371 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:14.848253  3045 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
W20260709 13:17:14.848639  9161 consensus_meta.cc:287] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.872s	user 0.006s	sys 0.005s
I20260709 13:17:14.903074  9371 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:14.849309  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:14.904241  3047 raft_consensus.cc:2393] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 21: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:14.849568  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:14.905049  3050 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:14.905174  9371 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:14.849948  9203 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:14.850944  3049 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:17:14.851531  9345 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:14.852656  9057 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:14.755209  9413 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.024s	sys 0.026s
I20260709 13:17:14.722302  9459 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.871526  3119 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:14.873781  2947 catalog_manager.cc:5697] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 4 to 14. New cstate: current_term: 14 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:14.875465  3790 rpcz_store.cc:276] 0709 13:17:13.466745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.466863 (+   118us) service_pool.cc:224] Handling call
0709 13:17:14.826062 (+1359199us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54005f0fd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:14.826220 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2804094848}
I20260709 13:17:14.871165  9423 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:14.832955  9456 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:17:14.860361  9426 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:14.864189  9425 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.864001  9280 raft_consensus.cc:3055] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:14.875247  9256 raft_consensus.cc:740] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:14.875644  3797 rpcz_store.cc:276] 0709 13:17:13.479404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.479543 (+   139us) service_pool.cc:224] Handling call
0709 13:17:13.509227 (+ 29684us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:13.516927 (+  7700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:13.516963 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:13.533506 (+ 16543us) log.cc:844] Serialized 52 byte log entry
0709 13:17:14.490482 (+956976us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:14.490522 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.490608 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.829229 (+338621us) raft_consensus.cc:1685] finished
0709 13:17:14.829263 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.829485 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137,"raft.queue_time_us":24927,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":6332,"thread_start_us":929827,"threads_started":1,"wal-append.queue_time_us":1134016}
I20260709 13:17:14.843014  9308 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:14.869666  9458 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.869843  9384 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:14.720093  9262 consensus_queue.cc:237] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:14.880898  8932 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:14.899227  9294 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:14.900972  9221 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:14.920807  9449 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:14.923571  9383 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:14.905722  9371 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:14.926929  9400 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for earlier term 17. Current term is 18.
I20260709 13:17:14.943013  3042 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:14.947227  3048 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:14.950738  3051 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:14.952960  3043 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:14.954406  3050 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
W20260709 13:17:14.947839  9448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.014s	sys 0.011s
W20260709 13:17:14.937582  9413 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.024s	sys 0.026s
I20260709 13:17:14.959928  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2440) took 1649 ms. Trace:
I20260709 13:17:14.954255  9057 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.961980  2947 catalog_manager.cc:5697] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
W20260709 13:17:14.970858  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 372166us
W20260709 13:17:14.981092  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 432250us
I20260709 13:17:14.961277  9425 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:14.993937  3198 rpcz_store.cc:276] 0709 13:17:13.310526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.310768 (+   242us) service_pool.cc:224] Handling call
0709 13:17:13.332925 (+ 22157us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:13.379122 (+ 46197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:13.379155 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:13.379620 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:17:14.495117 (+1115497us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:14.495155 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.495219 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.959658 (+464439us) raft_consensus.cc:1685] finished
0709 13:17:14.959687 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.959855 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33079,"raft.queue_time_us":50582,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":12133,"thread_start_us":1019114,"threads_started":1,"wal-append.queue_time_us":1199581}
I20260709 13:17:14.995710  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:17:14.996378  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 445434us
I20260709 13:17:14.996929  3050 raft_consensus.cc:2393] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 18: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:14.998628  3043 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:17:14.960522  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 457305us
W20260709 13:17:14.990741  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 459343us
I20260709 13:17:15.001387  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:15.001242  2947 catalog_manager.cc:5697] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:14.963671  9458 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:15.004141  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:14.957459  9459 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:17:14.960830  9280 raft_consensus.cc:740] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:15.000571  3091 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:15.101248  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 100765us
I20260709 13:17:15.025096  9400 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:15.106102  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:15.024013  9256 consensus_queue.cc:260] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.030412  3762 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:17:15.145120  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 114821us
I20260709 13:17:15.145241  9256 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:15.032310  9466 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:15.035194  9383 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:14.995049  9463 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:15.147372  9466 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.147819  9463 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:14.993194  9462 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:15.140645  9221 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:15.149320  9462 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.150279  9221 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:15.150777  9221 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:15.150926  9346 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:15.152830  9462 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:15.048563  8873 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:14.998624  9344 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.153709  9466 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:15.153867  8873 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:15.154963  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:15.155395  9344 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:14.983783  9329 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.156250  8873 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:15.157431  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:15.157862  9329 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:15.053200  2947 catalog_manager.cc:5697] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 12 to 14, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 14 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:14.979629  8932 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:17:15.159654  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:15.160132  8932 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:14.982440  9371 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:15.159729  2947 catalog_manager.cc:5697] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:15.162187  3120 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 17: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:15.056066  9216 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.997298  9057 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:15.162621  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:15.163239  3046 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:17:15.163048  9216 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:15.091125  3798 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:15.163741  9344 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:15.162089  9371 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:15.164573  9057 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:15.108558  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 458319us
I20260709 13:17:15.000705  3164 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:15.165347  9216 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:15.169453  2947 catalog_manager.cc:5697] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 6 to 15. New cstate: current_term: 15 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:15.143844  9400 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.149946  9452 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:15.158209  3043 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:17:15.160507  3050 raft_consensus.cc:2368] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19.
I20260709 13:17:14.995412  9293 raft_consensus.cc:697] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:17:15.096966  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 97347.2us
I20260709 13:17:15.164295  9344 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:15.165728  8932 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:17:15.166270  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 165633us
I20260709 13:17:15.198338  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:15.199288  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:15.142688  9280 consensus_queue.cc:260] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.094760  9449 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:15.171895  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:15.213358  3046 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:15.171489  2947 catalog_manager.cc:5697] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e reported cstate change: config changed from index -1 to 8, term changed from 11 to 15, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 15 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:17:15.200598  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:15.215694  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:15.216822  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:15.201283  3798 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:17:15.218071  3050 raft_consensus.cc:2393] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:15.202281  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:15.202529  3200 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:17:15.210937  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:15.219041  3191 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:15.219148  3196 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:15.219377  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:15.220046  3043 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:15.220573  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:15.221342  3191 raft_consensus.cc:2368] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19.
I20260709 13:17:15.222193  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:15.222728  3191 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:15.213569  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:15.225322  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:15.225829  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:15.226369  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:15.227000  3200 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:17:15.225935  3794 raft_consensus.cc:1240] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:15.225090  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:15.248601  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:15.248809  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:15.250464  3199 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:15.249836  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:15.231223  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:15.251683  3197 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:15.252815  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:15.254263  3195 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:15.233946  3762 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:15.254798  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:15.253429  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:15.255554  3193 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:15.234004  3091 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:15.255776  2947 catalog_manager.cc:5697] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:15.248872  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:15.258868  3194 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:15.260731  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:15.262559  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.262550  3043 raft_consensus.cc:2410] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:17:15.137835  9448 consensus_queue.cc:1059] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.099s
I20260709 13:17:15.287043  3090 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:15.300259  3199 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:17:15.210656  9462 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:15.306277  3198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "f20672b2852447a6bc1e137c4dd40904"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:17:15.306967  3198 raft_consensus.cc:606] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Received request to transfer leadership to TS f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:15.307155  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 73217.3us
I20260709 13:17:15.306643  2947 catalog_manager.cc:5697] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 11 to 14, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 14 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:15.309309  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:15.210355  9239 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.309952  2947 catalog_manager.cc:5697] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 12 to 13, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 13 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:15.307888  3091 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:15.312685  2947 catalog_manager.cc:5697] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 13 to 14, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 14 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:15.313966  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:15.317878  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:15.226841  9215 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:15.224365  9291 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:15.320392  2947 catalog_manager.cc:5697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 14 to 19, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 19 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:15.320026  9474 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:15.330013  9291 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:15.330575  2947 catalog_manager.cc:5697] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 9 to 15, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 15 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:15.331337  9344 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:15.332242  9291 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:17:15.331271  9329 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:15.332820  9329 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:15.333243  9329 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:15.252223  9308 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:15.334483  9463 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:15.336133  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 297598us
W20260709 13:17:15.320701  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 86830.4us
I20260709 13:17:15.253394  9280 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:15.233465  9452 raft_consensus.cc:697] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 17 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:15.298619  9384 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:15.224141  9057 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.115s
I20260709 13:17:15.231562  8932 raft_consensus.cc:697] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:15.342550  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:15.192767  9362 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:15.346045  3091 leader_election.cc:400] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19.
I20260709 13:17:15.371237  3091 leader_election.cc:403] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:17:15.232825  9449 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:15.355297  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.378832  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:15.384168  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:15.382397  3043 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:15.351500  9203 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:15.391940  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:15.306056  9462 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.395078  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:15.394256  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:15.375597  9478 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:15.377391  9466 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:15.429162  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 83320.2us
I20260709 13:17:15.429317  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:15.431167  3049 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:15.352862  9308 raft_consensus.cc:697] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:15.381426  9474 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:15.322263  9239 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:15.438597  3164 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:15.445458  3043 pending_rounds.cc:85] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 10
I20260709 13:17:15.459573  3043 pending_rounds.cc:107] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:17:15.459903  3043 raft_consensus.cc:2889] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:15.446590  3048 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:17:15.461174  3048 pending_rounds.cc:85] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 12
I20260709 13:17:15.461436  3048 pending_rounds.cc:107] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:17:15.461658  3048 raft_consensus.cc:2889] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:15.388919  9344 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:15.450138  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:15.477500  3126 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:15.450351  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:15.479215  3118 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:17:15.477519  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 190565us
I20260709 13:17:15.450623  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:15.480738  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:15.481038  3123 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:15.482328  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:15.450546  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:15.427862  9291 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:15.345155  9215 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:15.452699  3120 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:15.484481  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:15.440393  9478 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.462230  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:15.466938  3191 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:15.447679  9198 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19.
I20260709 13:17:15.468089  3196 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:15.371583  9293 consensus_queue.cc:237] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.429872  9480 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:15.426759  9203 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.433457  9426 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:15.467183  3195 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:15.469645  3197 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:15.429816  9346 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:17:15.438977  9228 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 13:17:15.477238  9161 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:17:15.521339  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 296300us
I20260709 13:17:15.477129  9344 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:15.494668  9262 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:15.452410  9216 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:17:15.516251  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:15.493513  9478 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:15.455366  9466 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.517650  9203 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:15.524271  9457 consensus_meta.cc:287] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.645s	user 0.007s	sys 0.003s
I20260709 13:17:15.489120  9291 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:15.560772  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:15.533910  9344 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:15.536625  9454 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:15.561347  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 107791us
I20260709 13:17:15.574847  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:15.516860  9458 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:15.579149  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 98484.4us
I20260709 13:17:15.555765  9459 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:15.583952  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:15.584704  3798 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:15.581197  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:15.586732  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:15.535773  9326 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:17:15.587632  3794 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:15.588956  3090 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:15.531203  9470 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 13:17:15.623437  9486 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.102s	user 0.002s	sys 0.000s
I20260709 13:17:15.511093  8932 consensus_queue.cc:237] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.625209  9215 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:15.628404  9423 consensus_meta.cc:287] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.669s	user 0.009s	sys 0.000s
I20260709 13:17:15.628676  9239 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:15.567824  9457 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.525911  9426 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.594359  9454 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:17:15.601279  9481 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:17:15.566326  9294 consensus_queue.cc:1059] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:17:15.571748  9400 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:15.609591  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2796) took 1024 ms. Trace:
I20260709 13:17:15.489090  9452 consensus_queue.cc:237] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.612533  9466 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:15.576184  9489 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:15.618551  9473 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:17:15.592121  9469 log.cc:927] Time spent T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260709 13:17:15.621587  9462 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:15.517482  9480 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.555042  9308 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.674826  3199 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:17:15.629089  9423 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:15.618585  9345 raft_consensus.cc:3055] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:15.637849  9457 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:15.642350  9449 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:15.640765  9413 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.620807  9475 raft_consensus.cc:3055] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:15.654237  9326 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:15.661855  9425 consensus_meta.cc:287] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.002s
I20260709 13:17:15.692294  9345 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:15.689026  9426 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:15.690670  9489 raft_consensus.cc:697] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:15.702873  9470 raft_consensus.cc:1064] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:17:15.681483  9473 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.712409  9473 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:15.702230  9475 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:15.714742  9475 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.714742  9470 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.716194  9475 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:15.716857  9480 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:15.716231  9489 consensus_queue.cc:237] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:15.719487  9478 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:15.722280  9478 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:15.635236  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46402.5us
I20260709 13:17:15.760815  3090 leader_election.cc:400] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19.
W20260709 13:17:15.762346  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 302955us
I20260709 13:17:15.764226  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:15.654027  3121 rpcz_store.cc:276] 0709 13:17:14.584733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.585206 (+   473us) service_pool.cc:224] Handling call
0709 13:17:14.585485 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:14.993949 (+408464us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:17:15.313492 (+319543us) log.cc:844] Serialized 14 byte log entry
0709 13:17:15.483883 (+170391us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:15.491407 (+  7524us) log.cc:844] Serialized 26 byte log entry
0709 13:17:15.491585 (+   178us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:15.491817 (+   232us) log.cc:844] Serialized 14 byte log entry
0709 13:17:15.492023 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:15.492117 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:15.609350 (+117233us) raft_consensus.cc:1685] finished
0709 13:17:15.609384 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:15.609526 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10851,"prepare.queue_time_us":558272,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":23553,"raft.queue_time_us":112575,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":28400,"thread_start_us":887069,"threads_started":3,"wal-append.queue_time_us":262290}
I20260709 13:17:15.766911  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:15.631472  3122 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:15.768766  3047 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
W20260709 13:17:15.756906  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.770498  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:15.773207  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:15.773468  3165 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:15.774312  3123 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:15.775210  3165 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:15.694072  3799 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:15.784226  9215 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.790041  9215 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.776162  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:15.756881  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 177861us
I20260709 13:17:15.705153  9345 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:15.804725  9345 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:15.804873  9239 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:15.703752  9329 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.706288  9326 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:15.810878  9326 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:15.810331  9262 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:15.707032  9425 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:15.703119  9413 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:15.818418  9423 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:15.819900  9423 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:15.820551  9423 raft_consensus.cc:697] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:15.823330  9425 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:15.824244  9413 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:15.830660  9215 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:15.849825  9423 consensus_queue.cc:237] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:15.859249  9256 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:17:15.846096  9457 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:15.862111  9462 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:15.862459  9457 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:15.868098  3762 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:15.869068  9458 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:15.856933  9329 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:15.858345  9449 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:15.862936  9462 raft_consensus.cc:697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:15.872458  9462 consensus_queue.cc:237] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:15.854907  9280 consensus_meta.cc:287] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.003s
W20260709 13:17:15.886699  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.892161  3123 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:15.865629  9457 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:15.907718  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:17:15.908054  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 132205us
I20260709 13:17:15.909286  3090 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:15.909618  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:15.922287  3121 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:15.926875  3192 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:15.928380  9329 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:15.931246  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:15.931669  9344 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:15.932386  3042 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:15.932590  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:15.934099  9293 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:15.934401  3047 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:15.934763  9293 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.935340  9293 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:15.951303  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 176376us
I20260709 13:17:15.954244  3165 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:15.954380  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:15.955533  3165 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:15.956717  8873 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:17:15.957183  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 48094.7us
I20260709 13:17:15.958101  9256 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:15.958343  9425 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:15.958994  9256 raft_consensus.cc:697] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:15.957314  8873 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:17:15.960139  9515 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.234s	user 0.002s	sys 0.000s
I20260709 13:17:15.960325  9256 consensus_queue.cc:237] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:15.960817  8873 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:15.934576  9291 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:15.982712  3123 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16. Ops: []
W20260709 13:17:15.988745  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 194207us
I20260709 13:17:15.998508  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:15.999450  3047 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:15.999635  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:15.999917  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.001132  3120 raft_consensus.cc:2393] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 18: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:16.001802  9308 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.003057  9308 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:16.004833  9476 raft_consensus.cc:3055] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:17:16.006186  9221 consensus_meta.cc:287] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.855s	user 0.013s	sys 0.007s
I20260709 13:17:16.006708  9221 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:16.010897  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:16.010370  9203 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:16.016891  3050 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.010s	sys 0.010s
W20260709 13:17:16.017583  3050 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.010s	sys 0.010s
I20260709 13:17:16.021677  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:16.028371  3199 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:16.005569  9476 raft_consensus.cc:740] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:16.031302  9476 consensus_queue.cc:260] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:16.032793  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.011371  9362 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:16.044803  3047 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:15.999468  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:15.997085  9344 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:16.048159  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.049292  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:16.009604  9221 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:16.051545  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.052803  3199 raft_consensus.cc:2393] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 21: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:17:16.053056  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 53811.5us
I20260709 13:17:16.054798  8932 consensus_queue.cc:1059] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:17:16.065109  9426 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.066233  9346 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:16.066121  9426 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:16.067107  9346 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:16.066457  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:16.067457  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:16.068624  9426 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:16.068858  3198 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:16.069463  9346 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:16.075901  3122 raft_consensus.cc:2410] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:17:16.076548  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.077301  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:16.077524  3121 raft_consensus.cc:2393] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:16.077440  3794 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:16.078724  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:16.079134  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:16.080019  3790 raft_consensus.cc:2393] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 20: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:16.081557  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:16.083940  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:16.086447  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:16.087296  3198 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
W20260709 13:17:16.086463  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 50312.3us
I20260709 13:17:16.088479  9476 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:16.057547  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.089607  3090 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:16.101944  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 53131.6us
I20260709 13:17:16.106699  3123 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:16.111510  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:16.101284  3762 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:16.097708  3091 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:16.111176  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:16.119572  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:16.119760  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.120055  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:16.120851  3124 raft_consensus.cc:2393] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 17: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:16.120848  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:16.110297  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:16.102439  8932 raft_consensus.cc:3055] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:16.123692  8932 raft_consensus.cc:740] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:16.117156  9345 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:16.116552  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.123823  3799 raft_consensus.cc:2393] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 18: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:16.122090  9329 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:16.112064  3165 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:17:16.125160  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.125231  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:16.103614  9256 raft_consensus.cc:993] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b: : Instructing follower f20672b2852447a6bc1e137c4dd40904 to start an election
I20260709 13:17:16.119417  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.132177  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:16.126251  9426 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.136034  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.126181  9329 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.126858  9345 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:16.138247  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:16.139443  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:16.139106  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.142141  3047 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:17:16.143203  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 53623us
I20260709 13:17:16.130098  9308 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:16.141520  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.142764  9344 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:16.152351  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:16.152578  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.135265  9488 raft_consensus.cc:1081] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Signalling peer f20672b2852447a6bc1e137c4dd40904 to start an election
I20260709 13:17:16.139151  9329 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:16.139386  9203 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:16.156275  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:16.141116  9345 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:16.155925  9291 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:17:16.155988  3126 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 19: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:16.154356  3194 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:16.106290  9461 consensus_queue.cc:1059] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:17:16.156809  3120 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:16.156602  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.162599  3043 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:16.176539  3121 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:17:16.178102  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 88700.7us
I20260709 13:17:16.176451  3122 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:16.177400  9344 raft_consensus.cc:697] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:16.164256  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:16.161839  3164 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:16.161330  3761 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 1.693s (SENT) [suppressed 8 similar messages]
I20260709 13:17:16.184957  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.190361  9344 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:16.177448  8932 consensus_queue.cc:260] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:16.196614  3047 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:16.196691  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:16.197880  3194 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
W20260709 13:17:16.198572  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 45624.3us
I20260709 13:17:16.185261  9221 raft_consensus.cc:3055] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:16.201401  3761 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:16.205303  3120 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:16.161100  9326 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:16.194941  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.162058  9426 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:16.208985  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:16.193796  9462 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:16.206825  9291 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:17:16.203974  9221 raft_consensus.cc:740] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:16.221781  3200 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:16.224960  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.223434  3124 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
W20260709 13:17:16.223829  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 64864.6us
I20260709 13:17:16.212920  8932 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:16.228242  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.227430  3119 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:16.231969  9400 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:16.226406  9462 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.254756  3164 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:16.256428  9529 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:17:16.258580  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 63060.6us
W20260709 13:17:16.262338  9530 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:17:16.262126  9457 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:16.264647  3042 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:16.267849  3091 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:16.236133  9400 raft_consensus.cc:697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:16.265635  9462 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:16.282963  9425 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:16.282609  9400 consensus_queue.cc:237] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:16.283746  9425 raft_consensus.cc:697] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:16.283661  9221 consensus_queue.cc:260] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:16.264510  9293 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:16.292332  9293 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:16.271867  9488 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:16.285384  9221 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:16.283829  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 82613.4us
I20260709 13:17:16.293977  9475 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.285166  9425 consensus_queue.cc:237] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:16.319392  9293 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.332185  3043 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:17:16.334426  3042 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:17:16.335942  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:16.335821  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:16.340569  9475 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:16.343178  9475 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:16.343741  9475 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:16.343819  3761 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:16.348570  9452 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:16.334414  9511 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.357964  9511 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:16.357066  9476 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:16.363236  9308 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:16.364065  9308 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:16.370613  9308 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:16.370713  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:16.371171  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:16.372015  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:16.380175  3042 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:16.373009  3046 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:16.374176  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:16.374326  9326 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:16.360265  9511 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:16.374430  9461 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:16.374337  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:16.382285  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:16.382827  3124 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:16.382534  9476 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:16.383911  3119 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:17:16.386524  3091 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:16.337556  9345 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:16.369884  9426 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:16.372319  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:16.393299  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:16.394596  3120 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:17:16.392165  3126 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:16.396297  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:16.336586  9293 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:16.384474  3015 connection.cc:256] RPC call timeout handler was delayed by -1.1077047989999755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
I20260709 13:17:16.359411  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:16.408053  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.409936  3194 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 19: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:16.382529  9461 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:16.411306  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:16.414819  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:16.387844  9329 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:16.395005  9472 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:17:16.403525  9426 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:16.444654  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:16.448633  3042 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:16.448661  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.452040  9423 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.452322  9232 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:16.452715  9423 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:16.453068  9232 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:16.455130  9423 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:16.455298  9232 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:16.457165  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:16.457193  3194 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:17:16.408453  9475 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:16.461418  9414 raft_consensus.cc:3055] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:16.474807  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:16.479882  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:16.480726  3195 raft_consensus.cc:2376] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13. Re-sending same reply.
I20260709 13:17:16.481776  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:16.482791  3045 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:16.466009  9426 raft_consensus.cc:697] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:16.469993  9476 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:16.464107  9256 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:16.505324  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 133161us
I20260709 13:17:16.506897  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:16.478241  9414 raft_consensus.cc:740] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:17:16.520824  9532 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.188s	user 0.000s	sys 0.003s
W20260709 13:17:16.523504  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.539202  3048 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:17:16.541534  3798 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:16.542709  3790 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:16.542415  9426 consensus_queue.cc:237] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:16.543793  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:16.552753  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:16.520542  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:16.546617  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.554129  3044 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
W20260709 13:17:16.554304  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 92540.6us
I20260709 13:17:16.549588  9329 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:16.506336  9057 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:17:16.555250  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 229188us
I20260709 13:17:16.556192  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:16.557183  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.557974  9362 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:16.558372  9362 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:16.558780  9362 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:16.553620  9345 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:16.591971  3195 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:17:16.555665  9057 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:16.588729  3050 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
W20260709 13:17:16.601214  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 46181.3us
W20260709 13:17:16.603799  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 47768.5us
I20260709 13:17:16.612015  3124 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:16.614585  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:16.592000  9293 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:16.618185  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:16.635820  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:16.638556  3762 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:16.636540  3195 raft_consensus.cc:2376] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18. Re-sending same reply.
I20260709 13:17:16.644332  3091 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:16.653386  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:16.643936  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:16.562357  9414 consensus_queue.cc:260] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:16.659258  3124 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:16.632719  9458 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.654119  3199 raft_consensus.cc:2376] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13. Re-sending same reply.
I20260709 13:17:16.669109  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:16.670492  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:16.673195  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:16.676205  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.672448  9203 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:16.677632  9203 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:16.679983  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:16.680168  9203 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:16.667320  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.681327  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:16.682005  3126 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:16.662643  9449 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:16.622514  9308 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:17:16.664186  9293 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:16.663722  3194 raft_consensus.cc:2955] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:16.695078  3042 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
I20260709 13:17:16.654691  9425 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:16.697468  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:16.687047  9531 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
W20260709 13:17:16.702474  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 74404.5us
I20260709 13:17:16.703892  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:16.704258  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:16.704097  3192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:17:16.705005  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:16.705475  9537 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:17:16.708907  3192 raft_consensus.cc:606] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:16.712253  9536 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:17:16.714779  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:16.717159  3192 raft_consensus.cc:614] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:16.694276  9449 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.670222  9475 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:17:16.663504  9452 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:17:16.703202  9293 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.692971  9057 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:16.735415  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 52437.5us
I20260709 13:17:16.734021  3761 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:16.740520  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 127147us
I20260709 13:17:16.741703  3792 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:17:16.743170  3042 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:17:16.744593  3042 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:16.746894  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:16.749352  9256 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:16.751224  3047 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:16.750156  9242 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 13:17:16.729399  9449 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:16.739867  9293 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:16.715809  8932 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:17:16.750415  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:16.759786  9462 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:16.761405  8873 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:16.762159  9345 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:16.762833  3043 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:17:16.763489  9425 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:16.764568  3120 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
I20260709 13:17:16.765589  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.765929  9457 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:16.725703  9461 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:16.698297  9458 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:16.768941  3042 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:17:16.769279  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.770301  3124 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 17: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:16.770138  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:16.762789  9345 raft_consensus.cc:697] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:16.769233  9458 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:16.772470  9345 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:16.774205  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:16.774791  9475 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:16.775493  9475 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:16.776548  3119 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15. Ops: [14.7-14.7]
W20260709 13:17:16.778405  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 78414.1us
I20260709 13:17:16.779227  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.779268  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:16.782382  9452 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:16.774942  3043 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:17:16.792498  3042 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:17:16.793673  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 55360.7us
I20260709 13:17:16.795049  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:16.794797  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.811661  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.784781  9242 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:17:16.817134  9256 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:16.818113  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.820164  3761 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:16.785650  9449 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:16.841966  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 47035us
I20260709 13:17:16.828269  9425 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:16.836624  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:16.846285  3120 raft_consensus.cc:2368] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 19. Current term is 20.
I20260709 13:17:16.849282  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:16.836243  9458 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:16.837019  9475 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:16.853050  3123 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:16.834084  9293 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:16.876899  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 62422.2us
I20260709 13:17:16.869014  3090 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:16.884274  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.862707  9308 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:17:16.888758  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 72580.2us
I20260709 13:17:16.864147  9475 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:16.882841  9400 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:16.893848  9475 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:16.896198  3119 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:16.902746  9362 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:16.913908  9533 log.cc:927] Time spent T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
W20260709 13:17:16.917851  9541 log.cc:927] Time spent T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:17:16.920837  9558 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:16.918805  9449 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:16.908182  9547 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:17:16.919832  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:16.915503  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:16.921702  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.922214  9291 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:16.932356  3123 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:16.891799  9344 raft_consensus.cc:2764] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
W20260709 13:17:16.930701  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 234263us
I20260709 13:17:16.938060  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:16.940531  9539 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:16.945220  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.922724  9293 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:16.947009  9552 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:16.934892  9558 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:16.947011  3124 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:16.930835  8873 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:17:16.951270  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:16.957654  3118 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:16.953807  3091 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:16.959584  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:16.960546  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:16.963596  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.966075  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:16.974472  3120 raft_consensus.cc:2410] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 20 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:17:16.966552  9414 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:16.970528  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:16.975190  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.976532  3762 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:16.977079  3124 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 21. Current term is 22. Ops: []
W20260709 13:17:16.982712  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 123552us
I20260709 13:17:16.977620  3125 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:17:16.932953  8932 consensus_queue.cc:1059] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:17:16.993165  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:16.996064  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:16.998833  3046 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:16.997311  3126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
 from {username='slave'} at 127.0.0.1:54688
I20260709 13:17:17.000250  3120 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:17:17.000250  3192 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:17:17.002390  3124 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:17.004700  9561 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:17.005610  3051 raft_consensus.cc:3055] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:17.005669  8932 raft_consensus.cc:3055] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:17.006117  3051 raft_consensus.cc:740] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:17.006294  8932 raft_consensus.cc:740] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:17.006989  3051 consensus_queue.cc:260] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:17.007272  8932 consensus_queue.cc:260] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:17.008030  3051 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:17.008646  8932 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:16.935055  9527 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:17:16.985421  9552 raft_consensus.cc:697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:16.982170  8873 consensus_queue.cc:1243] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:17.014878  9552 consensus_queue.cc:237] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:16.976291  9344 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:17.023321  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:17.041600  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:17.042544  3044 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:17:17.017786  9345 consensus_queue.cc:1059] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:17:17.044178  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:17.044812  9462 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:17.046743  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 74330.5us
I20260709 13:17:17.021548  9344 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:17.047770  9344 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.049635  9057 consensus_queue.cc:1059] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:17.051249  9476 raft_consensus.cc:3055] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:17.051663  9476 raft_consensus.cc:740] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:17.052373  9558 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:17.052564  9476 consensus_queue.cc:260] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:16.985276  9449 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
W20260709 13:17:17.059785  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.062348  9449 raft_consensus.cc:3055] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:17.062485  9527 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:17.062923  9449 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:17.063252  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:17.063900  9449 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:17.064865  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:17.046605  9475 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:17.068799  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:17.069427  3197 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:17.070518  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:17.071336  3090 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:17.074827  3126 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:17:17.075039  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 88832.3us
I20260709 13:17:17.075294  3126 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:17.077330  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.074038  9346 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:17.079249  9346 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:17.082119  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:17.083976  9362 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:17.084832  3761 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:17.084981  9545 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:17.085033  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:17.087371  9545 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:17.087786  9545 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.088171  9545 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:17.092693  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:17.095701  3164 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:17.097697  3762 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:17.098933  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:17.099434  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 78856.5us
I20260709 13:17:17.102095  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:17.102749  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:17.102095  9457 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:17.103379  3192 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:17.103425  9475 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.104091  9475 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:17.105044  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:17.105896  9462 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:17.106329  9362 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.106839  9362 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:17.108554  9475 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:17.108954  9362 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:17.109424  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:17.110033  3197 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:17.110922  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:17.072780  9561 raft_consensus.cc:697] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:17.112268  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:17.112969  9057 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:17.081611  9346 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:17.114643  9540 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:17.115311  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:17.116128  9449 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:17.113566  9057 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:17.116793  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:17.118765  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:17.118628  3120 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:17:17.121868  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.144454  3050 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:17.122473  9476 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:17.124464  9346 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:17.127707  9554 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.128494  9472 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:17.132131  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:17.132447  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:17.132601  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:17.113117  9561 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:17.135438  3121 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:17.146786  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:17.146992  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 51304.5us
I20260709 13:17:17.150813  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:17.151167  9457 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:17.151608  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:17.151901  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:17.152626  9308 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:17.152855  9554 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:17.172071  3164 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:17.178669  3798 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:17.182312  3123 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:17.186152  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:17.187413  3120 raft_consensus.cc:2410] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:17:17.180982  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:17.143110  9540 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.147109  9057 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:17.193053  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:17.197281  3046 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:17.197350  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:17.154834  9346 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:17.201241  3042 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:17.201686  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:17.174535  9308 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.223990  3118 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:17.224676  3192 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:17.198333  9291 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:17.195860  9540 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:17.229959  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 57980.2us
I20260709 13:17:17.244374  3798 raft_consensus.cc:1240] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:17.239636  3126 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:17.215603  9346 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:17.254217  9565 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:17:17.259027  9554 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:17.269307  3048 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:17:17.269363  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:17.225652  9308 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:17.250443  3090 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:17.284369  3091 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:17.173669  9472 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:17.290867  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:17.236740  9221 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:17.291431  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:17.293208  3762 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:17.298060  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 47962.1us
I20260709 13:17:17.299902  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:17.301461  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:17.313205  3164 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:17.303651  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:17.287321  9552 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.318845  3761 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:17.320122  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:17.326097  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:17.326737  3200 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:17.306819  9425 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:17.314901  9329 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:17.331207  3164 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:17.345640  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:17.349951  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 196627us
I20260709 13:17:17.357270  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:17.358083  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:17.362386  3051 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:17:17.363029  3051 pending_rounds.cc:85] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 11
I20260709 13:17:17.321679  9560 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:17.325120  9452 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:17.366024  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:17.343981  9345 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:17.323137  9552 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:17.314859  9221 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:17.342235  9329 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.389089  9329 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:17.375484  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:17.379165  9400 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:17.363358  3051 pending_rounds.cc:107] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 17.12
W20260709 13:17:17.382241  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 51146.2us
I20260709 13:17:17.359375  9425 raft_consensus.cc:697] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:17.395423  3192 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:17.393726  3118 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:17.397652  3045 raft_consensus.cc:1217] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Deduplicated request from leader. Original: 14.8->[15.9-19.11]   Dedup: 15.9->[17.10-19.11]
I20260709 13:17:17.398126  3164 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:17.398226  3051 raft_consensus.cc:2889] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:17.402617  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:17.403767  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 85019.6us
I20260709 13:17:17.405102  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:17.405316  3198 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:17.376088  9256 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:17.408721  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:17.401521  3045 pending_rounds.cc:85] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 9
I20260709 13:17:17.385146  9280 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:17:17.416265  3045 pending_rounds.cc:107] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:17:17.418071  3045 raft_consensus.cc:2889] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:17.411502  3196 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
W20260709 13:17:17.395119  9556 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:17:17.420360  3761 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:17.414283  9475 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.433094  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:17.406831  9345 raft_consensus.cc:697] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:17:17.442253  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 88636.8us
W20260709 13:17:17.444793  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 226776us
I20260709 13:17:17.424074  9400 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:17.460136  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 62102.4us
I20260709 13:17:17.461191  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:17.436362  9554 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:17.441177  9573 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:17:17.435921  9577 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.472584  3126 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:17.438455  9562 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:17.482138  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:17.438355  9578 raft_consensus.cc:2764] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:17:17.485306  3197 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:17:17.491477  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:17.486668  3198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:17:17.481325  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:17.492264  3198 raft_consensus.cc:606] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:17.497118  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:17.497857  3193 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:17.502702  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:17.502933  3049 raft_consensus.cc:1275] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:17.504112  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:17.495885  3790 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEARNER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:17.505275  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:17.479635  9280 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:17.512414  3198 raft_consensus.cc:2393] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 13: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
W20260709 13:17:17.515290  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:17.515864  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.455190  9475 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:17.518451  3121 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:17.518863  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 57790.3us
I20260709 13:17:17.519412  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:17.521667  3123 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:17:17.510999  9572 log.cc:927] Time spent T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:17:17.523006  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:17.526858  3120 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 19: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:17.526984  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:17.528944  9552 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:17.532855  3050 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:17.533560  3044 raft_consensus.cc:1240] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:17.533965  9581 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:17.516472  9425 consensus_queue.cc:237] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:17.480036  9577 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:17.540690  9577 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:17.542826  3164 leader_election.cc:400] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 19. Current term is 20.
I20260709 13:17:17.544135  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:17.543967  8873 consensus_queue.cc:1059] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:17.544363  9458 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:17.545140  8873 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:17.525437  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.546353  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:17.537523  8932 consensus_meta.cc:287] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.528s	user 0.006s	sys 0.002s
I20260709 13:17:17.552938  3200 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:17.558388  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:17.560355  3200 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:17.566787  3123 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:17:17.569049  3196 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:17.570006  3194 raft_consensus.cc:2410] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:17:17.570804  3200 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:17.572485  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:17.573035  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:17.577786  3120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:42960
I20260709 13:17:17.545681  8873 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:17.580610  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.578425  3120 raft_consensus.cc:606] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:17.580466  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:17.557722  9291 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:17.545910  9562 raft_consensus.cc:3055] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:17:17.596189  9414 consensus_meta.cc:287] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.604s	user 0.004s	sys 0.008s
I20260709 13:17:17.581477  9560 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:17:17.613858  3047 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:17.588182  8932 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:17:17.622787  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 148683us
I20260709 13:17:17.587884  9345 consensus_queue.cc:237] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:17.590339  9527 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:17:17.591239  9581 raft_consensus.cc:697] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:17:17.618810  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.580139  9280 consensus_queue.cc:1059] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:17:17.598095  9562 raft_consensus.cc:740] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:17.582540  9511 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
W20260709 13:17:17.621867  9564 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.242s	user 0.000s	sys 0.002s
W20260709 13:17:17.632016  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 49847.6us
I20260709 13:17:17.619374  9524 raft_consensus.cc:3055] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:17.686875  3164 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:17.626710  9462 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.621755  9586 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:17.704031  9462 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:17.706923  9462 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:17.707856  9462 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:17.708770  9462 raft_consensus.cc:697] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:17.710105  9462 consensus_queue.cc:237] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:17.722241  9535 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:17:17.724597  9566 log.cc:927] Time spent T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:17:17.686450  9527 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.692238  9524 raft_consensus.cc:740] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:17.700260  9586 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.749042  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:17.730217  9582 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:17.741356  9559 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:17.727558  9291 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:17:17.783175  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:17.775131  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:17.785948  3120 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
W20260709 13:17:17.789871  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 89174.1us
I20260709 13:17:17.751797  9586 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:17.792032  3164 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:17.798039  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 55650.6us
I20260709 13:17:17.772361  9554 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.745774  9527 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:17.802670  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:17.794095  9583 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:17.800069  9344 consensus_meta.cc:287] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.752s	user 0.012s	sys 0.001s
I20260709 13:17:17.791545  9582 raft_consensus.cc:697] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:17.789383  9604 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:17:17.804418  9057 consensus_meta.cc:287] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.000s
I20260709 13:17:17.813390  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:17.818480  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:17.807729  9559 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:17:17.812884  9540 consensus_meta.cc:287] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.556s	user 0.012s	sys 0.000s
I20260709 13:17:17.822717  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:17.822914  3790 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:17:17.824515  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:17.825172  3123 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
W20260709 13:17:17.819773  9574 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:17:17.798305  9524 consensus_queue.cc:260] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:17.827129  9346 consensus_meta.cc:287] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.000s
I20260709 13:17:17.827710  9524 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:17.827535  9346 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:17.828807  3794 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:17.817636  9057 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:17.830116  3042 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 21. Current term is 22. Ops: []
W20260709 13:17:17.830494  9594 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:17:17.831346  9057 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:17.832469  9582 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:17:17.834134  9585 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:17.836483  3090 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:17.800041  9581 consensus_queue.cc:237] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:17.837568  9457 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:17.836917  9604 raft_consensus.cc:697] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:17.840121  9604 consensus_queue.cc:237] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:17.842549  9602 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:17.817873  9475 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:17.844341  9596 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:17.846966  9472 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:17.768821  9562 consensus_queue.cc:260] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:17.824807  9540 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:17.869948  9540 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:17.871770  3090 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:17.873541  3043 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 20: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:17:17.874063  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 51441.8us
I20260709 13:17:17.811517  9344 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:17.879513  3090 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:17.863619  9576 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.358s	user 0.002s	sys 0.000s
I20260709 13:17:17.892935  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:17.884073  9346 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:17.890489  9605 log.cc:927] Time spent T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:17:17.897547  3762 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:17.808279  9554 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:17.836517  8873 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:17.852051  9559 raft_consensus.cc:697] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:17:17.910669  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.914575  3125 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:17.916651  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:17.916649  3198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:17:17.897095  9221 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:17.917546  3197 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:17.917582  3198 raft_consensus.cc:606] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:17.889453  9329 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:17.916121  9308 consensus_meta.cc:287] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.626s	user 0.020s	sys 0.012s
I20260709 13:17:17.911789  9577 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:17.912436  9562 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:18.100627  3192 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:17.907449  9558 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:18.102849  9345 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:18.103726  9449 consensus_meta.cc:287] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.951s	user 0.010s	sys 0.005s
W20260709 13:17:18.105208  9476 consensus_meta.cc:287] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.951s	user 0.011s	sys 0.003s
I20260709 13:17:18.000159  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:18.001214  9576 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:17:18.137030  3121 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.588s	user 0.008s	sys 0.010s
I20260709 13:17:18.199224  3121 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:17:17.916558  9256 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:18.200059  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2824) took 1264 ms. Trace:
I20260709 13:17:18.200567  9256 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:18.200491  3119 rpcz_store.cc:276] 0709 13:17:16.935596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.935797 (+   201us) service_pool.cc:224] Handling call
0709 13:17:16.959711 (+ 23914us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:16.962657 (+  2946us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:17.134093 (+171436us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.349874 (+215781us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.351674 (+  1800us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:17.362253 (+ 10579us) log.cc:844] Serialized 26 byte log entry
0709 13:17:17.362525 (+   272us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:17.362620 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.362694 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:17.393482 (+ 30788us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b180049ba60. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:17:17.841056 (+447574us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:18.199850 (+358794us) raft_consensus.cc:1685] finished
0709 13:17:18.199873 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.200001 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3461,"prepare.queue_time_us":297117,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":36463,"raft.run_cpu_time_us":498,"raft.run_wall_time_us":27291,"spinlock_wait_cycles":10417664,"thread_start_us":323801,"threads_started":2,"wal-append.queue_time_us":252573}
W20260709 13:17:18.003810  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 88180.8us
W20260709 13:17:18.204353  9607 log.cc:927] Time spent T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:17:18.206540  9609 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:17:18.206936  9476 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:18.209980  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:18.139230  3198 raft_consensus.cc:614] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:17.903795  9400 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.196s
W20260709 13:17:18.211341  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 331894us
I20260709 13:17:18.154347  9308 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:18.165905  9559 consensus_queue.cc:237] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:18.167354  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:18.168133  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:18.168869  9344 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:18.214386  3050 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 12.
W20260709 13:17:18.171381  9593 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.449s	user 0.002s	sys 0.000s
I20260709 13:17:18.175581  9554 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:18.233158  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:18.144923  9597 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:18.161345  9558 raft_consensus.cc:697] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 17 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:18.156276  9346 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:18.189915  9539 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:18.192216  9545 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.104s	user 0.011s	sys 0.001s
I20260709 13:17:18.193634  9527 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:18.233871  3121 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:18.175949  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2835) took 1231 ms. Trace:
I20260709 13:17:18.236189  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:18.278651  3200 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:18.278766  9586 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:18.239856  9329 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:18.278364  3125 rpcz_store.cc:276] 0709 13:17:16.944577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.028617 (+ 84040us) service_pool.cc:224] Handling call
0709 13:17:17.085329 (+ 56712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.914974 (+829645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.175672 (+260698us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b54003e7e54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:18.175853 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1901767424}
I20260709 13:17:18.281908  9539 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:18.286224  9558 consensus_queue.cc:237] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:18.239961  9308 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:18.241396  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:17:18.291966  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 50636.4us
I20260709 13:17:18.249050  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:18.294394  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 45418.2us
I20260709 13:17:18.295059  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:18.253294  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1258) took 1021 ms. Trace:
I20260709 13:17:18.296168  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:18.296875  9540 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:18.254405  9610 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:17:18.298805  9581 raft_consensus.cc:2764] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:17:18.254854  3051 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
W20260709 13:17:18.255919  9608 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:17:18.256503  9579 log.cc:927] Time spent T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.776s	user 0.005s	sys 0.000s
I20260709 13:17:18.258635  3193 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 13:17:18.238059  3165 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:17:18.273550  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 61531.6us
I20260709 13:17:18.302197  3193 pending_rounds.cc:85] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 11
I20260709 13:17:18.302577  3193 pending_rounds.cc:107] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 13:17:18.302989  3193 raft_consensus.cc:2889] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:18.304219  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 982) took 1173 ms. Trace:
I20260709 13:17:18.304361  3090 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:18.238620  9476 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:18.231173  9345 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:18.304728  3199 rpcz_store.cc:276] 0709 13:17:17.130896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.132999 (+  2103us) service_pool.cc:224] Handling call
0709 13:17:17.133424 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:17.168450 (+ 35026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:17.168485 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:17.188359 (+ 19874us) log.cc:844] Serialized 26 byte log entry
0709 13:17:17.379233 (+190874us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:17.379284 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.379360 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:18.173661 (+794301us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b2400200438. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d14c9c4 00007ff82d14aacb 00007ff82d305dc9 00007ff82d305a55 00007ff82d30509d 00007ff82ff3710e 00007ff82ff4e88c 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221
0709 13:17:18.303844 (+130183us) raft_consensus.cc:1685] finished
0709 13:17:18.303869 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.304120 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8370,"raft.queue_time_us":39201,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":10339,"spinlock_wait_cycles":6877056,"thread_start_us":138219,"threads_started":1,"wal-append.queue_time_us":226820}
I20260709 13:17:18.305989  9603 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:18.307771  9345 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:18.307976  9511 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:18.308449  9345 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:18.308382  9511 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.255988  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 2957) took 1193 ms. Trace:
W20260709 13:17:18.302533  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 64583us
I20260709 13:17:18.309515  3090 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:18.292073  9329 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:18.310834  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:18.311219  9604 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:18.297569  9540 raft_consensus.cc:2764] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:17:18.309304  3194 rpcz_store.cc:276] 0709 13:17:17.062583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.064635 (+  2052us) service_pool.cc:224] Handling call
0709 13:17:18.255742 (+1191107us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b540002b2d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:18.255914 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1159615872}
I20260709 13:17:18.311532  9476 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.295928  3042 rpcz_store.cc:276] 0709 13:17:17.231642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.231887 (+   245us) service_pool.cc:224] Handling call
0709 13:17:17.232262 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.830483 (+598221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.253054 (+422571us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b54001ae5d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:18.253229 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1374516480}
I20260709 13:17:18.336344  3761 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:18.308976  9511 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:18.281358  9586 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:18.297410  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:18.311637  9604 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:18.335538  9524 consensus_meta.cc:287] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.000s
I20260709 13:17:18.347903  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:18.317507  9449 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:18.350360  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:18.273923  9346 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:18.340061  9476 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:18.357352  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:18.357695  3165 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:18.358198  3194 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:18.333630  9545 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:18.352524  9458 raft_consensus.cc:993] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: : Instructing follower aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:17:18.315382  9329 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:18.359452  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46009.8us
I20260709 13:17:18.367633  3090 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:18.284879  9539 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:18.345530  9604 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:18.380595  3194 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:18.382211  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:18.340747  9587 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:17:18.360764  9475 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:18.389884  3799 raft_consensus.cc:2368] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22.
I20260709 13:17:18.389449  9562 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.390739  9562 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:18.362709  9554 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.363098  9462 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:18.393074  9562 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:18.365830  9540 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:17:18.369831  9329 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:18.371466  9449 raft_consensus.cc:1081] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Signalling peer aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:17:18.412281  3761 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:18.400593  3090 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:18.403123  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:18.412897  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:18.415052  3090 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:18.404242  9476 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:18.405422  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2919) took 1139 ms. Trace:
I20260709 13:17:18.418390  3044 rpcz_store.cc:276] 0709 13:17:17.266059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.266219 (+   160us) service_pool.cc:224] Handling call
0709 13:17:17.533397 (+267178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.533984 (+   587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.405204 (+871220us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54001f6b50. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:18.405343 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613456640}
I20260709 13:17:18.409909  9562 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.393812  9458 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:18.419585  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:18.425758  3123 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:18.419545  3090 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:18.393993  9586 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:18.396055  9462 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.443317  3090 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:18.420616  9583 consensus_meta.cc:287] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.607s	user 0.005s	sys 0.005s
W20260709 13:17:18.438839  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 141520us
I20260709 13:17:18.444372  3118 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:18.421216  9344 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:18.453706  3200 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:18.454246  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:18.425261  9345 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:18.423758  9475 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:18.448544  9603 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:17:18.441964  9577 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:18.446142  9462 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:18.448724  9472 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.399801  9554 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:18.485095  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:18.455519  9582 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:18.449587  9583 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:18.466764  9545 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:18.468276  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:18.493182  9472 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:18.495347  9362 raft_consensus.cc:3055] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:18.495849  3121 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:18.495922  9362 raft_consensus.cc:740] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:18.497370  9472 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:18.471685  3123 raft_consensus.cc:2410] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:17:18.498974  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:18.499729  3797 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:18.502054  9582 raft_consensus.cc:697] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 21 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:18.502453  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:18.503485  9582 consensus_queue.cc:237] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:18.453465  9562 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:18.480644  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:18.483096  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:18.442619  9617 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:18.486567  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:18.490002  3792 raft_consensus.cc:2393] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 19: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:18.492128  3197 raft_consensus.cc:1275] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:18.453177  9586 raft_consensus.cc:697] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:18.468452  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:18.468266  9540 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:18.502110  3196 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:18.478197  9475 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.510537  3200 raft_consensus.cc:3055] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:18.516606  3200 raft_consensus.cc:740] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:18.480286  9603 consensus_queue.cc:1243] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:17:18.492614  9344 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.532198  3192 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:18.511283  3121 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:17:18.514544  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:18.515784  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 47411.7us
I20260709 13:17:18.540119  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:18.543274  3197 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:18.540982  3200 consensus_queue.cc:260] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:18.497208  9362 consensus_queue.cc:260] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:18.546833  3200 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:18.526505  9475 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:18.561226  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:18.570039  9362 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:18.574895  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2549) took 1066 ms. Trace:
I20260709 13:17:18.575451  3118 rpcz_store.cc:276] 0709 13:17:17.508195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.508349 (+   154us) service_pool.cc:224] Handling call
0709 13:17:17.521862 (+ 13513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.447112 (+925250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.574543 (+127431us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b540031a454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:18.574812 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2121081600}
I20260709 13:17:18.577993  9511 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:18.579519  3194 raft_consensus.cc:1240] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:17:18.581209  9511 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:18.587625  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.590281  3200 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:17:18.591511  3797 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:17:18.555145  9476 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:18.526672  9617 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:18.600843  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:18.602056  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:18.539422  9344 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:18.593248  9583 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:18.614009  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 52859.4us
W20260709 13:17:18.620707  9592 log.cc:927] Time spent T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.919s	user 0.002s	sys 0.002s
I20260709 13:17:18.631502  9562 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:18.636123  9346 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:18.604321  9308 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:18.638156  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:18.642423  9604 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:18.641223  9329 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:18.644536  9604 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:18.642315  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:18.659991  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:17:18.661132  3043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 2928) took 1383 ms (client timeout 1571 ms). Trace:
I20260709 13:17:18.603190  9256 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:18.661624  3043 rpcz_store.cc:269] 0709 13:17:17.268582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.269107 (+   525us) service_pool.cc:224] Handling call
0709 13:17:18.651625 (+1382518us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b540029cf54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:18.651803 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1370635648}
I20260709 13:17:18.671049  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:18.671820  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 56865.9us
I20260709 13:17:18.672606  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:18.672664  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:18.600536  9565 consensus_queue.cc:1059] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.060s
I20260709 13:17:18.688980  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:18.692360  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:18.693338  3043 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:17:18.667479  9604 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.687254  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:18.716990  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:18.717969  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 45440.9us
I20260709 13:17:18.699357  9540 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:18.678056  9581 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:18.681550  9603 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:18.735143  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:18.660534  9586 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:18.747736  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2962) took 1428 ms. Trace:
I20260709 13:17:18.694715  9345 raft_consensus.cc:697] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:18.697619  8873 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:18.753262  3043 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:18.759369  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:18.766059  3118 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:17:18.738862  9611 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:18.749356  9591 log.cc:927] Time spent T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 1.220s	user 0.005s	sys 0.000s
I20260709 13:17:18.772395  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:18.773078  3121 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:18.774845  3118 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:18.779115  3797 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:18.757812  3191 rpcz_store.cc:276] 0709 13:17:17.319186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.319321 (+   135us) service_pool.cc:224] Handling call
0709 13:17:17.328881 (+  9560us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:17.371555 (+ 42674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:17.371602 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:17.407808 (+ 36206us) log.cc:844] Serialized 26 byte log entry
0709 13:17:17.520499 (+112691us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:17.552606 (+ 32107us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.556185 (+  3579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.556259 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:17.848529 (+292270us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b18003b5300. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:17:18.311449 (+462920us) spinlock_profiling.cc:243] Waited 7.24 ms on lock 0x7b18003b5300. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c6522 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:17:18.619666 (+308217us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:18.747494 (+127828us) raft_consensus.cc:1685] finished
0709 13:17:18.747519 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.747652 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31875,"prepare.queue_time_us":35978,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":8727,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":20843,"spinlock_wait_cycles":115701376,"thread_start_us":90030,"threads_started":1,"wal-append.queue_time_us":166401}
I20260709 13:17:18.719466  9604 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:18.755523  9539 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:18.758659  9554 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:18.771245  9630 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:18.791505  3043 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:18.782083  9344 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:18.783097  9527 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:18.796680  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:18.751952  9581 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:18.803992  3043 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:18.789628  9539 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:18.800401  9630 raft_consensus.cc:697] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:18.813807  9630 consensus_queue.cc:237] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:18.822129  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:18.822480  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:18.822896  3048 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:18.823751  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:18.824190  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:18.824366  3047 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:18.830236  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.832418  9618 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 13:17:18.833905  9345 consensus_queue.cc:237] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:18.823665  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:17:18.856092  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 53105.1us
I20260709 13:17:18.787024  9603 consensus_queue.cc:1059] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:17:18.862707  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:18.863446  3048 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:18.867108  3194 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:18.867578  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:18.868407  3192 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:18.868974  3199 pending_rounds.cc:85] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 9
I20260709 13:17:18.869434  3199 pending_rounds.cc:107] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:17:18.869731  3199 raft_consensus.cc:2889] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:18.875696  3047 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:17:18.879925  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:18.881110  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:18.881695  3044 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:18.792426  9626 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:17:18.838205  9539 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:18.889045  3048 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:17:18.889775  3790 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19. Ops: []
W20260709 13:17:18.890240  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.890571  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 133811us
W20260709 13:17:18.892040  9629 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:17:18.892294  9291 consensus_queue.cc:1059] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:18.893224  9291 raft_consensus.cc:3055] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:18.895433  3192 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:18.896950  3043 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:18.897344  3762 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:18.899065  3762 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:18.901968  9475 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:18.902944  9554 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:18.904492  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.904664  3164 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:18.893591  9291 raft_consensus.cc:740] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:18.904333  9562 consensus_queue.cc:1059] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:17:18.914338  9475 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:18.915055  9291 consensus_queue.cc:260] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:18.905599  9558 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:18.906235  3046 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:18.916496  9291 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:18.918424  9476 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:18.919664  9554 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:18.922528  3762 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:18.915692  9462 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:18.923221  9639 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:18.924955  9462 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:18.925405  3165 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:18.925760  9554 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:18.926337  9554 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.926767  9639 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:18.926764  9554 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:18.906322  3043 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:18.927214  9639 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.928495  9639 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:18.937130  3762 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:18.937319  9627 consensus_queue.cc:1059] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:18.938421  9628 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:17:18.939153  9558 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:18.939930  9558 raft_consensus.cc:697] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:18.940529  9617 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:18.941202  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:18.940810  9558 consensus_queue.cc:237] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:18.942817  9472 raft_consensus.cc:3055] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:18.943264  9472 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:18.944183  9472 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:18.946123  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:18.946702  3123 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:18.946942  9329 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:18.947093  9581 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:18.945540  9472 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:18.949189  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:18.951341  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 2971) took 1602 ms. Trace:
I20260709 13:17:18.951890  9639 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:18.949296  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:18.954322  3794 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:18.954581  3799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 864) took 1803 ms. Trace:
I20260709 13:17:18.955035  3798 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:18.955914  3118 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
W20260709 13:17:18.958048  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 66837.6us
I20260709 13:17:18.955952  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:18.959548  3191 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:18.959738  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:18.939201  9291 raft_consensus.cc:3055] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:18.963999  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:18.965548  3123 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:18.969316  3044 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:17:18.951737  3193 rpcz_store.cc:276] 0709 13:17:17.348623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.498667 (+150044us) service_pool.cc:224] Handling call
0709 13:17:18.258259 (+759592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.303567 (+ 45308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.951161 (+647594us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b540002b2d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:18.951291 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1746140032}
I20260709 13:17:18.974169  3195 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:17:18.978816  3195 pending_rounds.cc:85] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 11
I20260709 13:17:18.979081  3195 pending_rounds.cc:107] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:17:18.979313  3195 raft_consensus.cc:2889] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:18.955070  3799 rpcz_store.cc:276] 0709 13:17:17.150772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.151324 (+   552us) service_pool.cc:224] Handling call
0709 13:17:18.954309 (+1802985us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54005f0fd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:18.954495 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2806281600}
I20260709 13:17:18.975469  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:18.980448  3200 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:18.984881  3761 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:18.985332  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:18.986377  3192 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:18.988103  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:18.990368  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:18.992585  3761 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:18.997359  3164 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:18.998764  3051 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:17:18.999390  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:19.000310  3200 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:19.001190  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:19.002889  3120 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 20: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:19.003479  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:19.001924  9329 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:19.024791  9639 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:18.977159  9291 raft_consensus.cc:740] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:19.112849  3191 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:19.002414  9540 consensus_queue.cc:1059] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:17:19.104607  3192 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:19.001211  9476 consensus_queue.cc:1059] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:17:18.993582  9280 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.993861  9057 consensus_queue.cc:1059] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:17:19.106036  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:18.991509  9581 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:18.988446  9562 consensus_queue.cc:1059] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:17:19.121819  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:18.994004  9362 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.122148  9562 raft_consensus.cc:3055] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:19.122715  9562 raft_consensus.cc:740] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:19.122699  9362 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:17:19.123888  9562 consensus_queue.cc:260] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:19.125958  9562 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:19.107327  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 104376us
I20260709 13:17:19.110348  9329 raft_consensus.cc:697] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:19.110668  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:19.128785  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:19.115116  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:19.115577  3193 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:19.129593  3047 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:19.130174  3118 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:17:19.118072  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.115060  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:19.120646  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:19.002209  9527 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:19.125128  9362 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:19.156246  3165 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:19.157191  9539 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:19.158607  3045 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22. Ops: []
W20260709 13:17:19.161391  9644 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.271s	user 0.001s	sys 0.001s
I20260709 13:17:19.160779  9256 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:18.990013  9586 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:19.163350  9586 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:19.163645  9554 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:19.165311  9642 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.272s	user 0.002s	sys 0.000s
I20260709 13:17:19.134686  9280 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:19.119189  8932 consensus_queue.cc:1059] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:17:19.165694  9586 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:19.168010  9280 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:19.107169  3121 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:19.107692  9617 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:19.129021  9329 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:19.138563  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:19.181059  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:19.181757  3193 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:19.141227  3192 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:19.108057  9511 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:19.144068  9647 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.150019  9604 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:19.187045  9647 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:19.173998  9554 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:19.189345  9647 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:19.181677  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 44170.6us
I20260709 13:17:19.138720  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:19.189932  9527 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:19.189345  3191 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:17:19.189956  9646 raft_consensus.cc:3055] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:19.196398  3798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 789) took 1722 ms. Trace:
I20260709 13:17:19.202157  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:19.176594  3047 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:19.206724  3790 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:19.181901  3195 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:19.208561  3798 rpcz_store.cc:276] 0709 13:17:17.473860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.474168 (+   308us) service_pool.cc:224] Handling call
0709 13:17:18.954860 (+1480692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.955533 (+   673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.196165 (+240632us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54005f0fd0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:19.196320 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3364640512}
I20260709 13:17:19.158648  9362 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:19.168277  9561 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:19.224740  3124 raft_consensus.cc:1275] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:19.142467  9639 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.218258  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:19.218895  3123 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:17:19.219667  3118 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:19.222525  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:19.204780  9221 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:19.229243  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:19.230211  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:19.230764  3123 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:19.168227  9581 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:19.228929  3165 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:19.224404  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:19.232102  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:19.232108  3198 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 12.
I20260709 13:17:19.230319  3125 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:19.232005  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:19.233604  3124 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:19.208473  9646 raft_consensus.cc:740] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:19.225231  9586 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:19.262547  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:19.227295  9345 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:19.269011  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:19.236172  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:19.236413  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:19.235903  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:19.270470  3121 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:19.232123  9639 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:19.241845  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:19.241786  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:19.242980  3126 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 21 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:19.227392  9615 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.239435  3091 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:19.246042  9221 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:19.229895  9449 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.252799  9291 consensus_queue.cc:260] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:19.258152  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:19.241212  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:19.213384  9527 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:19.275998  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:19.280100  3047 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:19.229560  9582 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.280125  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:19.294636  3049 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:19.280511  9615 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:19.300700  9449 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:19.302403  9362 raft_consensus.cc:697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:19.303241  9615 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:19.303412  9362 consensus_queue.cc:237] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:19.304448  9449 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:19.285944  9291 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:19.306245  9597 raft_consensus.cc:3055] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:19.306640  9597 raft_consensus.cc:740] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:19.307524  9597 consensus_queue.cc:260] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:19.308583  9597 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:19.310062  9511 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:19.310658  9511 raft_consensus.cc:697] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:19.240144  9057 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:17:19.311528  9511 consensus_queue.cc:237] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:19.262442  9577 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:19.312575  9577 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:19.314682  9577 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:19.316263  9646 consensus_queue.cc:260] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:19.318225  9646 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:19.320362  9648 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.430s	user 0.003s	sys 0.001s
I20260709 13:17:19.320843  9308 raft_consensus.cc:3055] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:19.321250  9308 raft_consensus.cc:740] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:19.275599  9345 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:19.322096  9308 consensus_queue.cc:260] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:19.323516  9308 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:19.324765  9345 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:19.326714  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:19.299625  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 86404.6us
I20260709 13:17:19.260736  9586 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:17:19.304245  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 75433.6us
I20260709 13:17:19.349961  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:19.312000  9057 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:19.287545  9540 raft_consensus.cc:3055] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:19.325757  9539 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:19.277107  9652 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:19.329290  3046 raft_consensus.cc:1240] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:17:19.334877  9636 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:19.327896  9639 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:19.330907  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:19.366938  3048 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:19.238626  9561 raft_consensus.cc:697] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:19.294747  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:19.284883  9221 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:19.333061  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:19.379568  3042 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:17:19.327972  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.366930  3165 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:19.388690  3124 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
W20260709 13:17:19.344132  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.299779  9582 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:19.346436  3790 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:19.351413  3123 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
I20260709 13:17:19.275049  9476 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:19.359529  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:19.365453  9345 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:19.261205  9581 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:19.374918  3195 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:17:19.408489  3195 pending_rounds.cc:85] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 9
I20260709 13:17:19.408771  3195 pending_rounds.cc:107] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:17:19.409006  3195 raft_consensus.cc:2889] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:19.376163  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 81493.7us
I20260709 13:17:19.297884  3121 raft_consensus.cc:2410] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:17:19.393671  3047 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:17:19.411430  9256 consensus_queue.cc:1059] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:19.411890  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:19.357241  9586 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:19.402997  3049 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:19.417934  3044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:35712
I20260709 13:17:19.274245  9635 consensus_queue.cc:1059] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 13:17:19.402048  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1165) took 1809 ms. Trace:
I20260709 13:17:19.357905  9540 raft_consensus.cc:740] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:19.418659  3044 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:19.469930  3044 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:19.419130  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:19.424185  3761 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:19.391394  9414 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:19.476984  3117 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:17:19.483631  3042 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:19.464143  3122 rpcz_store.cc:276] 0709 13:17:17.592815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.594823 (+  2008us) service_pool.cc:224] Handling call
0709 13:17:17.613457 (+ 18634us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:17.737482 (+124025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:17.737516 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.790862 (+1053346us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b2c00010988. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:17:18.795405 (+  4543us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.890162 (+ 94757us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:18.890198 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.890276 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.319741 (+429465us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:19.401836 (+ 82095us) raft_consensus.cc:1685] finished
0709 13:17:19.401858 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.401988 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24416,"raft.queue_time_us":47882,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":3229,"spinlock_wait_cycles":29161728,"thread_start_us":131544,"threads_started":2,"wal-append.queue_time_us":52647}
I20260709 13:17:19.487335  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:17:19.488897  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 211158us
I20260709 13:17:19.407569  9639 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:19.418018  9462 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:19.515388  3165 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:19.523221  9581 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:19.500339  9540 consensus_queue.cc:260] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:19.566380  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 51086us
I20260709 13:17:19.566938  9540 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:19.567160  3165 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:19.526463  9293 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:19.564406  3044 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:19.571720  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.470805  9345 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:19.528137  9582 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:19.479067  9344 raft_consensus.cc:2764] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:17:19.480909  9414 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:19.537948  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 301815us
I20260709 13:17:19.554756  3119 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:17:19.580108  3119 pending_rounds.cc:85] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 12
I20260709 13:17:19.580439  3119 pending_rounds.cc:107] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:17:19.580679  3119 raft_consensus.cc:2889] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:19.562000  3091 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:19.563783  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:19.542143  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 257078us
I20260709 13:17:19.471359  9552 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:17:19.586230  3044 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:19.586824  3091 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:19.591177  3091 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:19.592279  3090 leader_election.cc:400] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22.
I20260709 13:17:19.592597  3090 leader_election.cc:403] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:19.569757  9462 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.573241  9559 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:19.590764  9582 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:17:19.595862  9559 raft_consensus.cc:697] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:19.573423  9641 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.599588  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:19.589964  9659 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:19.603909  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:19.595772  9539 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:19.604772  9657 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:19.607388  3191 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:17:19.579882  9560 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:19.618104  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:19.640002  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.643931  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:19.586249  9414 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:19.589901  9581 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 13:17:19.585878  9423 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.652678  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:19.655670  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:19.586297  9293 raft_consensus.cc:697] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:19.657176  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:19.658057  3199 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19. Ops: [16.12-18.13]
I20260709 13:17:19.618960  9577 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:19.638003  9597 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22.
I20260709 13:17:19.644501  3195 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:19.571249  9639 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:19.685915  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:19.737008  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 48971.2us
I20260709 13:17:19.742656  3198 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:19.659610  3197 raft_consensus.cc:1240] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: []
W20260709 13:17:19.659266  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 64449.2us
I20260709 13:17:19.596719  9462 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:19.659482  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:19.748209  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 91106.3us
I20260709 13:17:19.749670  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:19.654742  9560 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:19.758713  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.758589  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:19.759275  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 335158us
I20260709 13:17:19.683912  9647 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:19.609520  9586 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:19.685151  9657 raft_consensus.cc:697] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:17:19.760186  9645 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:17:19.686697  9400 consensus_queue.cc:1059] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
W20260709 13:17:19.777403  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.769902  9597 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
W20260709 13:17:19.785930  9656 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:17:19.745522  9423 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:19.762389  9654 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:19.791500  3050 raft_consensus.cc:1275] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:19.755515  9476 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:19.580891  9561 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:19.798200  3790 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:19.766875  9560 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:19.823181  9462 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:19.769579  9626 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.828929  9626 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:19.831445  9626 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:19.573071  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:19.764472  3761 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:19.837893  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 73488.4us
I20260709 13:17:19.838696  3118 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:19.841797  9664 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:19.842700  9664 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:19.843113  9664 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:19.849175  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:19.850207  3196 raft_consensus.cc:2410] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:17:19.854411  9658 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:19.855249  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3315) took 1034 ms. Trace:
I20260709 13:17:19.855082  9658 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:19.855633  3045 rpcz_store.cc:276] 0709 13:17:18.820837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.824056 (+  3219us) service_pool.cc:224] Handling call
0709 13:17:18.824279 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.159087 (+334808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.855014 (+695927us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54003c32d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:19.855192 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":768440576}
I20260709 13:17:19.856932  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:19.857256  9658 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:19.858799  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:19.804862  9559 consensus_queue.cc:237] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:19.806883  9639 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:17:19.773645  9653 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:19.817996  3046 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:17:19.875200  3046 pending_rounds.cc:85] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 10
I20260709 13:17:19.684566  9641 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:19.826365  9414 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:19.770488  9527 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:19.885366  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:19.804028  9423 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:19.857652  3199 raft_consensus.cc:1240] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:17:19.874586  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:19.875494  3046 pending_rounds.cc:107] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 18.11
I20260709 13:17:19.687523  9582 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:17:19.887423  3046 raft_consensus.cc:2917] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Aborting config change with OpId 18.11: Aborted: Op aborted by new leader
I20260709 13:17:19.884729  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:19.887810  3126 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:17:19.801652  9654 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.877955  3117 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:17:19.902155  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:19.903518  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:19.910171  3798 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 14: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:19.912248  3797 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:19.919319  3791 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:17:19.922322  9462 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:19.923507  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:19.926389  9636 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:17:19.926994  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:19.931180  3196 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:17:19.936100  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:19.894203  9652 consensus_meta.cc:287] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.000s
I20260709 13:17:19.762900  9057 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:17:19.942890  9639 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.881108  3198 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:19.756938  9659 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:17:19.943658  9639 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:19.944974  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:19.875654  3045 raft_consensus.cc:2410] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:17:19.945683  3050 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:17:19.946725  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:19.947751  9554 consensus_queue.cc:1059] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:19.948601  9639 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:19.882407  3118 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:17:19.889642  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:19.949894  3118 pending_rounds.cc:85] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 13
I20260709 13:17:19.887858  3046 raft_consensus.cc:2889] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:19.950397  3118 pending_rounds.cc:107] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:17:19.949909  9329 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:19.950722  3118 raft_consensus.cc:2889] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:19.889201  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:19.891846  3794 raft_consensus.cc:2393] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 21: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:19.886394  9653 raft_consensus.cc:697] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:19.942999  9615 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:19.942611  9256 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:19.948486  9554 consensus_queue.cc:1243] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:17:19.954697  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:19.960632  3797 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:17:19.878549  3048 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
I20260709 13:17:19.961815  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:19.984800  3124 raft_consensus.cc:3055] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:19.985188  3124 raft_consensus.cc:740] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:19.905570  9654 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:19.943718  9057 raft_consensus.cc:3055] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:19.972294  9636 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:19.954437  3165 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:19.989197  3050 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:17:19.989517  3046 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:17:19.984334  3797 pending_rounds.cc:85] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Aborting all ops after (but not including) 10
I20260709 13:17:19.955621  9652 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:20.005982  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 261970us
I20260709 13:17:19.986619  3124 consensus_queue.cc:260] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:20.018179  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 259930us
I20260709 13:17:20.008714  3797 pending_rounds.cc:107] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 18.11
W20260709 13:17:20.013062  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 58673.7us
I20260709 13:17:20.020673  3797 raft_consensus.cc:2917] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Aborting config change with OpId 18.11: Aborted: Op aborted by new leader
I20260709 13:17:20.020896  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:20.021183  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.023089  3042 raft_consensus.cc:3055] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:20.023506  3042 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:20.030887  3047 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:17:20.025806  9583 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:17:19.985970  9475 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:17:20.013387  9345 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:19.992959  9057 raft_consensus.cc:740] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:20.013969  9280 raft_consensus.cc:3055] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:17:20.037478  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 291982us
I20260709 13:17:20.019140  9638 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:20.037103  3042 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:19.933687  9293 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:19.993268  9657 consensus_queue.cc:237] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:20.048625  9345 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:20.014827  9615 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:17:20.030730  9636 raft_consensus.cc:697] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:20.021593  3797 raft_consensus.cc:2889] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:20.053921  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:20.060173  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:20.054548  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:20.055302  3042 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:20.055137  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:20.062688  3120 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:20.065292  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 44472us
I20260709 13:17:20.030712  9603 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:17:20.078495  3090 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:20.082372  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:20.079248  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:20.086575  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:20.087333  3123 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:17:20.088035  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:20.088294  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:20.081727  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:20.047712  9280 raft_consensus.cc:740] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:20.092271  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:20.050137  9586 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:20.097040  3121 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:20.050313  9638 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.097044  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:20.102861  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:20.109575  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:20.044044  9665 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:17:20.050844  9524 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:17:20.104715  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:20.104971  3123 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:17:20.046332  9659 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:17:20.104331  3042 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:17:20.137013  3042 pending_rounds.cc:85] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 14
I20260709 13:17:20.137591  3042 pending_rounds.cc:107] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:17:20.137914  3042 raft_consensus.cc:2889] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:20.130988  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 88304.7us
W20260709 13:17:20.131245  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 90855.7us
I20260709 13:17:20.082930  9658 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:20.109093  9638 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:20.143962  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:20.145339  3118 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:17:20.146694  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:20.147184  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:20.137022  9663 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 13:17:20.139993  9658 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:20.149972  9658 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:20.061676  9626 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:17:20.152845  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:20.106979  9221 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:20.165791  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.098251  9329 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:17:20.156888  9677 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:20.180857  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:20.182003  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 134875us
I20260709 13:17:20.182206  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:20.186127  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:20.186618  3199 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:20.148734  9057 consensus_queue.cc:260] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:20.188282  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:20.189076  3164 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:20.118342  9308 consensus_queue.cc:1059] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:17:20.154063  9641 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:20.157146  9291 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:20.159737  9647 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:20.077559  9653 consensus_queue.cc:237] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:20.165822  9586 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.092s
W20260709 13:17:20.206785  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:20.196575  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.163041  9540 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:17:20.175812  9582 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:20.158216  9458 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
W20260709 13:17:20.270823  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 99587.5us
I20260709 13:17:20.198267  3120 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
I20260709 13:17:20.291975  3125 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:20.292515  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:20.273134  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 194723us
W20260709 13:17:20.274137  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 85149.6us
I20260709 13:17:20.294821  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:20.185458  9414 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:20.249399  9581 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:20.195851  9652 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
W20260709 13:17:20.307163  9675 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:17:20.182348  9221 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:20.313843  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 58529.2us
I20260709 13:17:20.315102  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:20.286773  9627 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:20.297266  9678 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.260361  9291 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:20.327749  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:20.337001  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:20.290906  9647 raft_consensus.cc:697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:20.345965  9647 consensus_queue.cc:237] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:20.341502  9524 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:20.271044  9664 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:20.355470  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 60467.7us
I20260709 13:17:20.360597  3090 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:20.366235  9583 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:20.373365  9524 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:20.270942  9677 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:20.372252  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 44591.1us
I20260709 13:17:20.256860  9280 consensus_queue.cc:260] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:20.258035  9636 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:20.338430  9688 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:20.373582  9583 raft_consensus.cc:697] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:20.332676  9345 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:17:20.405375  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:20.487247  3049 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.024s	sys 0.036s
I20260709 13:17:20.393910  9691 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:20.469995  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 66895us
I20260709 13:17:20.356029  9678 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:20.495327  9684 log.cc:927] Time spent T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
W20260709 13:17:20.494546  9686 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:17:20.409126  9687 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.524746  9687 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:20.512637  9691 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:20.532584  9691 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:20.394364  9344 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:20.540349  9658 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:20.500839  3049 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.024s	sys 0.036s
I20260709 13:17:20.501679  9696 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:20.501946  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 96650.9us
I20260709 13:17:20.393206  9582 raft_consensus.cc:697] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:20.543316  9583 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:20.492710  9638 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:20.513702  9681 log.cc:927] Time spent T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
W20260709 13:17:20.514768  9690 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:17:20.523885  9677 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:20.542006  9697 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:17:20.407691  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:20.588353  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.591929  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:17:20.608865  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 201266us
I20260709 13:17:20.555804  9664 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:20.546810  9221 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:20.613675  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:20.616580  3199 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:20.515651  9527 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.101s
W20260709 13:17:20.629220  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.623075  3090 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:20.639182  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1284) took 1238 ms. Trace:
I20260709 13:17:20.625056  9345 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:20.646162  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 135069us
I20260709 13:17:20.648568  3048 raft_consensus.cc:1240] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:20.649574  3164 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:20.649514  3090 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:20.639619  3049 rpcz_store.cc:276] 0709 13:17:19.400568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.779339 (+378771us) service_pool.cc:224] Handling call
0709 13:17:19.779710 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.779925 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:17:20.587679 (+807754us) log.cc:844] Serialized 14 byte log entry
0709 13:17:20.638656 (+ 50977us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:20.638731 (+    75us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:20.638796 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.638981 (+   185us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.639123 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9161,"prepare.queue_time_us":628928,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"thread_start_us":848761,"threads_started":2}
I20260709 13:17:20.652109  3090 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:20.655126  3164 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:20.638882  9560 consensus_meta.cc:287] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.816s	user 0.002s	sys 0.010s
I20260709 13:17:20.659739  9638 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:20.660248  9345 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:20.661023  9345 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.661502  9345 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:20.662106  3164 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:20.663173  9688 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:20.663623  3164 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:20.663852  9688 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:20.647586  9221 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:20.664484  9345 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:20.664907  9221 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:20.619125  9677 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:17:20.627774  9344 consensus_queue.cc:1059] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:17:20.668937  9524 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:20.677506  9511 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:20.672235  9560 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:20.703610  9524 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:20.691824  9638 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:17:20.727715  3200 raft_consensus.cc:2393] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 21: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:20.734329  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:20.737675  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 85665.6us
I20260709 13:17:20.738672  3090 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:20.722901  9524 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:20.682793  9582 consensus_queue.cc:237] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:20.748500  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:20.750381  9583 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:20.750978  9583 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:20.751444  9721 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:20.751986  9721 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:20.753237  9583 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:20.755254  9706 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:17:20.756711  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:20.757483  3126 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:20.758332  9705 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:17:20.725929  9702 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:20.765262  9699 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:17:20.765933  9682 log.cc:927] Time spent T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:17:20.766193  9699 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:20.782255  3119 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 13:17:20.783047  3119 pending_rounds.cc:85] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 11
I20260709 13:17:20.783444  3119 pending_rounds.cc:107] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:17:20.784162  3119 raft_consensus.cc:2889] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:20.794605  9721 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:20.805083  9603 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:20.805822  9603 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:20.807078  9603 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:20.808691  9603 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:20.812378  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3327) took 1414 ms. Trace:
I20260709 13:17:20.813038  3047 rpcz_store.cc:276] 0709 13:17:19.397447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.581956 (+184509us) service_pool.cc:224] Handling call
0709 13:17:19.596682 (+ 14726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:20.031280 (+434598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.812011 (+780731us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54001f6654. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:20.812284 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":997773056}
I20260709 13:17:20.816783  9458 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:20.820425  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2483) took 1202 ms. Trace:
I20260709 13:17:20.827602  9646 raft_consensus.cc:3055] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:20.828329  9646 raft_consensus.cc:740] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:20.768242  9658 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:20.842032  9472 raft_consensus.cc:3055] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:20.842573  9472 raft_consensus.cc:740] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:20.801237  9678 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:20.821072  3200 rpcz_store.cc:276] 0709 13:17:19.617722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.617880 (+   158us) service_pool.cc:224] Handling call
0709 13:17:20.820100 (+1202220us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001de554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:20.820313 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2465342336}
I20260709 13:17:20.836123  9688 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.840129  9560 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:20.851616  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:20.843528  9472 consensus_queue.cc:260] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:20.854070  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.854159  9472 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:20.857857  9688 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:20.860585  9688 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:20.850286  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:20.867945  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:20.869618  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:20.870394  3198 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
W20260709 13:17:20.871234  9654 consensus_meta.cc:287] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.856s	user 0.010s	sys 0.003s
I20260709 13:17:20.872936  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:20.875797  3200 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:20.871747  9654 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:20.879840  9654 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:20.882467  9291 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:20.883492  3045 raft_consensus.cc:2393] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:20.885617  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:20.886341  3194 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:20.893390  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:20.894402  3198 raft_consensus.cc:2393] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:20.890343  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:20.897789  9654 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:20.898224  9654 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:20.898651  9654 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:20.906411  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:20.907459  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:20.907826  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:20.908335  3046 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 22: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:20.909128  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:20.909696  3049 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:20.913368  3794 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:17:20.913703  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:20.914026  3794 pending_rounds.cc:85] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: Aborting all ops after (but not including) 10
I20260709 13:17:20.914428  3794 pending_rounds.cc:107] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:17:20.914763  3794 raft_consensus.cc:2889] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:20.916211  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:20.917140  3799 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
W20260709 13:17:20.891146  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.925189  9560 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:20.925908  9560 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:20.926266  9242 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.927121  9242 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:20.928303  9560 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:20.932221  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:20.918309  9702 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:20.934891  9702 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:20.874663  9647 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:20.940585  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:20.942366  9654 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:20.943573  3042 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:20.941578  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:20.955533  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:20.967422  3199 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:17:20.970687  3194 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
I20260709 13:17:20.972677  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:20.974050  3191 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 19: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:20.975559  3199 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:17:20.981300  3126 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:20.983736  3164 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:20.986490  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:20.994709  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:20.998512  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:20.999455  3197 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:17:20.999440  3191 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 16: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:21.001957  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:20.980096  9560 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.944245  9242 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:20.982714  9400 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:21.016409  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.984755  9641 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:20.985298  9658 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:21.019428  3191 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:17:21.019997  3049 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:20.985839  9706 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:20.997664  9721 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:20.989188  9678 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.954265  9362 consensus_queue.cc:1059] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:17:20.919989  9646 consensus_queue.cc:260] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:21.049857  9458 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:21.050556  9719 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:21.027046  9560 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:20.984836  9702 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:21.001586  9638 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:17:21.095343  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:21.100523  3197 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:21.086630  3191 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
W20260709 13:17:21.096732  9663 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:17:21.048750  9641 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.083288  9476 consensus_queue.cc:1059] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:17:21.154752  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:21.156315  3197 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:21.047307  9400 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:21.087396  9678 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:21.174767  3200 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:21.120266  9641 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:21.122018  9635 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:21.099336  9458 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:21.076144  9706 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:21.188721  3090 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:21.093849  9719 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:21.193100  9702 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:21.208297  3200 raft_consensus.cc:1240] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:17:21.206984  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:21.252379  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.268400  9458 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:21.194819  9577 consensus_queue.cc:1059] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:17:21.198597  9659 consensus_queue.cc:1059] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:17:21.189347  9635 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:21.269497  9659 raft_consensus.cc:3055] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:21.269610  9577 raft_consensus.cc:3055] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:21.270062  9659 raft_consensus.cc:740] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:21.270180  9577 raft_consensus.cc:740] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:21.271219  9577 consensus_queue.cc:260] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:21.203788  9654 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:21.263547  9633 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:21.199949  9699 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:17:21.271729  9635 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:21.275115  9362 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:21.312484  3117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.000s	sys 0.011s
W20260709 13:17:21.312875  3117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.000s	sys 0.011s
W20260709 13:17:21.274083  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 67195.9us
I20260709 13:17:21.275179  9458 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:17:21.310025  9723 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:17:21.254546  9708 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 13:17:21.254302  9717 consensus_queue.cc:1059] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 8, Time since last communication: 0.118s
I20260709 13:17:21.315481  9458 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.342924  3200 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:17:21.348263  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:21.357422  3799 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:17:21.326191  9577 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:21.272751  9633 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:21.330425  9722 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:17:21.387836  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:21.327392  9560 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:21.388101  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.388271  3798 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:21.388511  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:21.393258  3193 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:17:21.388996  3197 raft_consensus.cc:1240] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:17:21.391832  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:21.395766  3794 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 20: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
W20260709 13:17:21.396999  9524 consensus_meta.cc:287] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.629s	user 0.008s	sys 0.003s
I20260709 13:17:21.397439  9524 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:21.399633  9524 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:17:21.411371  9400 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:21.350065  9458 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:21.416119  3197 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:17:21.319839  9362 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:21.421056  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:21.422197  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:21.423185  9362 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:21.423928  9706 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:21.424400  9678 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:21.430979  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2491) took 1282 ms. Trace:
I20260709 13:17:21.502745  3192 rpcz_store.cc:276] 0709 13:17:20.148438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.166242 (+ 17804us) service_pool.cc:224] Handling call
0709 13:17:20.166676 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:20.167204 (+   528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:20.167247 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:20.706961 (+539714us) spinlock_profiling.cc:243] Waited 7.97 ms on lock 0x7b2c000fc108. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:17:20.707433 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:17:20.789895 (+ 82462us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:20.789940 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.790024 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.430632 (+640608us) raft_consensus.cc:1685] finished
0709 13:17:21.430656 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.430906 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":175,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":10254,"spinlock_wait_cycles":18344192,"thread_start_us":82047,"threads_started":1,"wal-append.queue_time_us":379225}
W20260709 13:17:21.432161  9737 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:17:21.434551  9633 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:21.436144  9731 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
W20260709 13:17:21.437558  9730 log.cc:927] Time spent T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:17:21.442762  9719 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:21.443940  9727 log.cc:927] Time spent T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
W20260709 13:17:21.445328  9738 log.cc:927] Time spent T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:17:21.446319  9724 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:17:21.330191  9702 consensus_queue.cc:1059] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.118s
I20260709 13:17:21.322896  9657 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:17:21.506955  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:21.508782  3120 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:17:21.386981  9559 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:21.559300  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:21.521966  9647 consensus_meta.cc:287] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.583s	user 0.007s	sys 0.004s
I20260709 13:17:21.502030  9560 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:21.565776  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:21.573635  9559 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:21.592165  9559 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:21.569590  9344 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.009s	sys 0.013s
I20260709 13:17:21.576506  9647 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:17:21.600730  9344 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.009s	sys 0.013s
I20260709 13:17:21.619370  9744 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:21.620174  9744 raft_consensus.cc:697] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:21.620963  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:21.597486  9641 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:21.627789  3196 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
W20260709 13:17:21.632444  9680 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 1.359s	user 0.006s	sys 0.006s
I20260709 13:17:21.599148  9560 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:21.666621  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 107447us
W20260709 13:17:21.738610  9742 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 13:17:21.752168  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 81657.3us
W20260709 13:17:21.767576  9603 consensus_meta.cc:287] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.958s	user 0.015s	sys 0.002s
I20260709 13:17:21.759222  9458 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:21.789723  9560 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:21.790705  9641 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:21.791406  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3334) took 1733 ms. Trace:
I20260709 13:17:21.791875  3048 rpcz_store.cc:276] 0709 13:17:20.058312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.096107 (+ 37795us) service_pool.cc:224] Handling call
0709 13:17:20.096344 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:20.649008 (+552664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.791137 (+1142129us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54000c6054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:21.791340 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1269453696}
I20260709 13:17:21.793175  9221 raft_consensus.cc:3055] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:21.793769  9221 raft_consensus.cc:740] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:21.793352  9458 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:21.797178  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2862) took 1712 ms. Trace:
I20260709 13:17:21.797639  3125 rpcz_store.cc:276] 0709 13:17:20.084482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.089871 (+  5389us) service_pool.cc:224] Handling call
0709 13:17:20.291763 (+201892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:20.292496 (+   733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.796953 (+1504457us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b540010d950. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:21.797111 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463582080}
I20260709 13:17:21.799664  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:21.800508  9641 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:21.802076  3164 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:21.803459  9560 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:17:21.806362  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46432.7us
I20260709 13:17:21.809410  9280 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:21.812359  3164 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:21.813805  3164 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:21.811375  9627 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:17:21.814734  9256 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:17:21.815583  9256 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:21.815991  9739 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.405s	user 0.003s	sys 0.000s
I20260709 13:17:21.816231  9717 raft_consensus.cc:3055] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:21.816651  9717 raft_consensus.cc:740] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:21.817474  9717 consensus_queue.cc:260] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:21.817986  3164 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:21.818873  9256 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:21.819360  9256 raft_consensus.cc:697] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:21.820233  9256 consensus_queue.cc:237] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:21.821281  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:21.822275  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:21.823655  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.823655  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:21.824555  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:21.825384  3192 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:17:21.826314  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:21.827404  3194 raft_consensus.cc:2410] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:17:21.846854  3761 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:21.849449  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:21.854457  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:21.767740  9744 consensus_queue.cc:237] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:21.857051  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.872084  9603 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:21.872110  9678 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.872866  9603 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:21.873208  9678 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:21.873978  9699 consensus_queue.cc:1059] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:21.875171  9678 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:21.872215  9706 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:21.876027  9706 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:21.877184  9633 consensus_queue.cc:1059] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:21.877944  9633 consensus_queue.cc:1243] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:21.878312  9706 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:21.844157  9719 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.879058  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:21.881448  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:21.887203  3125 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:21.887646  3121 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:17:21.886780  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2875) took 1141 ms. Trace:
I20260709 13:17:21.882758  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:21.847752  9400 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:21.875192  9603 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:21.884384  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.893056  3194 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:21.903815  3124 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:21.911492  9733 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.475s	user 0.000s	sys 0.001s
I20260709 13:17:21.922564  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:21.925247  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:21.928977  9582 raft_consensus.cc:3055] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:21.931195  9659 consensus_queue.cc:260] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:21.932919  9659 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:21.864627  9291 consensus_queue.cc:1059] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:17:21.854370  9751 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:21.922641  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:21.865710  9583 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.942175  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:21.944063  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:21.945361  3196 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:17:21.909330  3199 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:17:21.890976  3117 rpcz_store.cc:276] 0709 13:17:20.745893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.746209 (+   316us) service_pool.cc:224] Handling call
0709 13:17:20.746572 (+   363us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:20.778984 (+ 32412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:20.779026 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:20.779740 (+   714us) log.cc:844] Serialized 52 byte log entry
0709 13:17:21.313246 (+533506us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:21.336484 (+ 23238us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.813228 (+476744us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:21.815752 (+  2524us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b18003ad7a0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d240c0a 00007ff836980219 00007ff82d2c8a40 00007ff82d2c34e4 00007ff82d2c3455 00007ff8303ab060 00007ff8303bd716 00007ff8303ce287 00007ff8303ce208
0709 13:17:21.846135 (+ 30383us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.886470 (+ 40335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.886546 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.886584 (+    38us) raft_consensus.cc:1685] finished
0709 13:17:21.886597 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.886723 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78258,"prepare.queue_time_us":23490,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":10131,"raft.queue_time_us":559473,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":6525,"spinlock_wait_cycles":107577984,"thread_start_us":562071,"threads_started":2,"wal-append.queue_time_us":606726}
W20260709 13:17:21.945703  3045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 2984) took 2015 ms (client timeout 2038 ms). Trace:
W20260709 13:17:21.950887  3045 rpcz_store.cc:269] 0709 13:17:19.930641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.946435 (+ 15794us) service_pool.cc:224] Handling call
0709 13:17:21.945447 (+1999012us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b54001f7054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:21.945637 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2152436352}
I20260709 13:17:21.945963  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:21.952396  3794 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 20: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:21.946487  3044 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:21.955646  3196 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:21.878525  9554 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.069s
I20260709 13:17:21.852249  9475 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.096s
I20260709 13:17:21.961675  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:21.962421  3198 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:21.963786  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:21.949891  9739 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:17:21.929564  9582 raft_consensus.cc:740] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:17:21.972236  3165 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.129:44609 timed out after 2.038s (SENT) [suppressed 1 similar messages]
I20260709 13:17:21.921970  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:21.981906  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:21.995205  9539 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:21.920785  9221 consensus_queue.cc:260] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:21.996775  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:22.020028  3794 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 22: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:22.024621  9293 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:22.026154  9752 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:17:22.026722  9539 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:21.959872  9652 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:22.029232  9652 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:21.968886  9679 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.896601  9719 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:22.044529  3194 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:21.956553  9654 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.049371  3200 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:17:21.953779  9583 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:22.059013  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:22.031689  9679 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:22.080682  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:22.081413  3792 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:22.065800  9221 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:22.068387  9766 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.086402  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:22.065249  9582 consensus_queue.cc:260] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:22.085023  9654 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:22.084664  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:22.016969  3124 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:22.108767  3122 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:17:22.095860  9540 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:22.158257  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 186016us
I20260709 13:17:22.097608  9762 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:22.166194  3048 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:22.167336  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:22.168607  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:22.172730  3049 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
W20260709 13:17:22.174993  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.103935  9647 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:22.185238  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:22.185941  3049 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:22.179905  3124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 2573) took 2203 ms (client timeout 2043 ms). Trace:
I20260709 13:17:22.105432  9582 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:22.174233  3090 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:22.190732  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:22.107147  9653 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:22.106833  9308 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:22.195631  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:22.189131  3124 rpcz_store.cc:269] 0709 13:17:19.961212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.961419 (+   207us) service_pool.cc:224] Handling call
0709 13:17:21.903315 (+1941896us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b580077f0d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83030f0aa 00007ff830391447 00007ff8303a9fe7 00007ff8303ab7de 00007ff8303b727c 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c
0709 13:17:22.164069 (+260754us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1909181312}
I20260709 13:17:22.200538  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:22.133329  9611 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:22.202998  3050 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:17:22.199553  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:22.159663  9400 raft_consensus.cc:697] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:22.205855  3049 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
W20260709 13:17:22.215219  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.159339  9291 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:22.206476  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:22.275590  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 69210.7us
W20260709 13:17:22.268646  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.159617  9597 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:22.280970  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.210875  3165 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:22.181730  9721 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.181456  9658 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:22.183688  9604 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:22.199967  9697 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:22.199131  9653 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:22.306069  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 95378.9us
I20260709 13:17:22.329023  3165 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:22.199011  2943 catalog_manager.cc:5697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 10 to 19, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 19 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:22.268020  9747 log.cc:927] Time spent T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:17:22.204200  9633 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:22.212984  9603 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:22.179663  9344 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 13:17:22.098510  9766 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:22.335794  3165 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:22.292121  9678 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:22.293331  9706 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:22.210747  9540 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:22.342691  9057 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:22.387342  9757 log.cc:927] Time spent T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:17:22.267311  9308 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:22.272815  9626 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:17:22.318307  9697 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:22.202600  9762 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:22.319363  9658 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:22.358770  9639 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:22.401225  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:22.346230  9603 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.298647  9597 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:22.212112  9647 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:22.299181  9291 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:22.310705  9721 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:22.369194  9577 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:22.344123  9604 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:22.357285  9638 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
W20260709 13:17:22.559185  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.444700  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.471026  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.606205  9449 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:22.413548  3045 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:22.486846  9583 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:22.397238  9696 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.766165  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3336) took 2639 ms. Trace:
I20260709 13:17:22.766645  3044 rpcz_store.cc:276] 0709 13:17:20.064698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.096360 (+ 31662us) service_pool.cc:224] Handling call
0709 13:17:21.946250 (+1849890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.954053 (+  7803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.704110 (+750057us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b54001f7050. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:22.704341 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4202736384}
I20260709 13:17:22.627681  9511 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:22.409125  9697 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:22.632876  3792 consensus_meta.cc:287] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.550s	user 0.005s	sys 0.008s
I20260709 13:17:22.776739  3792 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:22.633458  9717 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:22.634507  9782 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:22.625279  9776 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:17:22.636096  9764 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:22.628963  9652 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:22.389432  9641 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:17:22.725085  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.462903  9774 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 13:17:22.731110  3794 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.011s	sys 0.003s
W20260709 13:17:22.841651  3794 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.012s	sys 0.003s
I20260709 13:17:22.415889  9762 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:22.628504  9653 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:22.767138  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2873) took 2023 ms. Trace:
I20260709 13:17:22.846365  3118 rpcz_store.cc:276] 0709 13:17:20.743793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.743939 (+   146us) service_pool.cc:224] Handling call
0709 13:17:20.744286 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:20.764420 (+ 20134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:20.764468 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.905952 (+1141484us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b2c00010988. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:17:21.906395 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:17:22.118474 (+212079us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:22.118536 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.118633 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.641422 (+522789us) raft_consensus.cc:1685] finished
0709 13:17:22.641447 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.767070 (+125623us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16989,"raft.queue_time_us":20730,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":9160448,"thread_start_us":211537,"threads_started":1,"wal-append.queue_time_us":548407}
I20260709 13:17:22.627537  9597 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:22.393461  9706 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:22.719660  9577 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:22.409335  9708 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:22.409601  9678 raft_consensus.cc:697] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:22.474709  9687 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:22.440650  9743 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:22.458664  9646 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:22.577560  9603 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:22.405285  9719 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:22.461436  9476 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:22.464323  9308 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:22.464278  9766 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:22.463209  9540 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:22.835172  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.776988  9221 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:22.867923  9560 consensus_meta.cc:287] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.064s	user 0.013s	sys 0.000s
I20260709 13:17:22.491358  9654 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:22.850271  3763 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.011s	sys 0.010s
I20260709 13:17:22.766037  9449 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:22.440833  9400 consensus_queue.cc:237] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:22.778740  9696 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:22.853358  9659 consensus_meta.cc:287] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.920s	user 0.016s	sys 0.000s
I20260709 13:17:22.847144  9641 raft_consensus.cc:697] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:22.923051  9641 consensus_queue.cc:237] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:22.866364  9771 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:22.785040  9511 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:22.928366  9771 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:22.931062  9458 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.931788  9458 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:22.852311  9745 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:22.933921  9344 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.934087  9702 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:22.934859  9785 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
I20260709 13:17:22.836005  9764 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:22.934667  9344 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:22.936594  9654 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:22.937316  9344 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:22.937196  9654 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:22.937877  9597 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:22.938199  9718 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:22.938431  9597 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:22.915369  9647 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:22.938794  9718 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:22.939545  9654 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:22.865157  9753 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.012s	sys 0.010s
W20260709 13:17:22.940260  9753 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.012s	sys 0.010s
I20260709 13:17:22.842576  9782 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:22.833796  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 325346us
I20260709 13:17:22.869503  9721 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:22.872592  9708 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:22.960978  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:22.961274  3118 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:22.878286  9476 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:22.874507  9688 raft_consensus.cc:3055] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:22.885067  9221 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:22.943766  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:22.950659  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:22.867561  9256 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.044s	user 0.007s	sys 0.018s
I20260709 13:17:22.961884  3125 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:22.938824  9697 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:22.997268  3761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.014s	sys 0.032s
I20260709 13:17:22.933490  9745 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:22.969254  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:23.009614  3117 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
W20260709 13:17:22.887079  3763 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.011s	sys 0.011s
I20260709 13:17:22.971414  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:22.978740  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.988246  3049 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
W20260709 13:17:22.989861  9744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.008s	sys 0.017s
W20260709 13:17:23.003305  3761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.015s	sys 0.033s
I20260709 13:17:23.013989  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:23.000399  3048 raft_consensus.cc:2393] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:22.946934  9560 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:22.940984  9597 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:22.916239  9291 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:22.897990  9692 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:23.018992  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:23.014524  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 950656us
I20260709 13:17:23.037348  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:22.934744  9702 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:23.027410  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:22.990566  9256 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.167s	user 0.007s	sys 0.018s
I20260709 13:17:22.967648  9280 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.054994  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:23.032359  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:23.035133  9761 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 13:17:23.035305  9658 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:22.967492  9647 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:23.037351  3200 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:22.954759  9639 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.041174  3799 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:22.992827  9654 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:22.991394  9721 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:22.869163  9743 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:23.054620  3014 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.101s	user 0.032s	sys 0.016s
I20260709 13:17:23.089064  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:23.091048  3014 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.138s	user 0.032s	sys 0.016s
I20260709 13:17:23.055982  3119 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:23.058172  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:23.059509  3792 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:17:23.039384  9291 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:22.986541  9688 raft_consensus.cc:740] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:23.021080  9511 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:23.042725  9293 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.013s	sys 0.024s
I20260709 13:17:23.114425  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:23.075791  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:23.082502  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:23.042335  3192 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.024s	sys 0.031s
W20260709 13:17:23.117028  3192 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.024s	sys 0.031s
I20260709 13:17:23.082549  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:23.089632  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:23.090399  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:23.007438  9308 consensus_queue.cc:1059] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:17:23.099769  9221 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:23.100239  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 2989) took 2197 ms. Trace:
I20260709 13:17:23.063652  9744 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:23.102684  9771 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:23.059885  9770 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:23.035636  9678 consensus_queue.cc:237] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:23.109642  9057 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:23.108790  3118 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:17:23.146349  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:23.116648  3122 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:23.147598  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:23.145097  9057 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:23.148629  3050 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 16: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:23.101770  9745 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:23.130422  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:23.103361  9781 log.cc:927] Time spent T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 13:17:23.151831  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:23.152017  9057 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:23.152666  3049 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:23.121555  3051 rpcz_store.cc:276] 0709 13:17:20.902390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.902546 (+   156us) service_pool.cc:224] Handling call
0709 13:17:20.902915 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:20.903315 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:20.983361 (+ 80046us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.894338 (+910977us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:22.464377 (+570039us) spinlock_profiling.cc:243] Waited 44.1 ms on lock 0x7b2c0001afe8. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:17:22.464808 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:17:22.865354 (+400546us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:22.865397 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.865464 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:23.099934 (+234470us) raft_consensus.cc:1685] finished
0709 13:17:23.100028 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.100174 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":731655,"prepare.queue_time_us":99118,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":697791,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":194,"spinlock_wait_cycles":101469568,"thread_start_us":553471,"threads_started":2,"wal-append.queue_time_us":889718,"wal-append.run_cpu_time_us":1099,"wal-append.run_wall_time_us":1001140}
I20260709 13:17:23.063373  9280 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:23.141539  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:23.143220  9603 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:23.108855  9658 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.158226  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:23.193157  3048 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:23.093137  9721 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:23.089407  9639 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:23.195901  9696 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:23.220533  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:23.121345  9540 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:23.138586  9611 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:23.198876  3117 raft_consensus.cc:1275] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:17:23.225268  3117 pending_rounds.cc:85] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 9
I20260709 13:17:23.126349  9476 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:23.121750  9787 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.203239  3796 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:23.138332  9653 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:23.268369  9653 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:23.042111  9692 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:23.218422  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 60308us
I20260709 13:17:23.219163  3051 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:23.272771  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:23.195641  9280 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:23.189680  9761 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:17:23.221799  3048 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:23.223232  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:23.109056  9647 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:23.113607  9291 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:23.231600  3042 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:23.103330  9654 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:17:23.225625  3117 pending_rounds.cc:107] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 17.10
W20260709 13:17:23.243389  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.253934  3043 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:23.265333  9743 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:23.186544  9770 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:23.266441  9782 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:23.150342  9744 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:23.274469  3051 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:23.280792  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3018) took 1455 ms. Trace:
I20260709 13:17:23.282582  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:23.288398  3122 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 13.
W20260709 13:17:23.236790  9582 consensus_meta.cc:287] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.037s	user 0.010s	sys 0.002s
I20260709 13:17:23.236414  9636 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:23.198227  9688 consensus_queue.cc:260] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:23.236474  9540 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:23.216224  9658 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:23.633836  3015 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.024s	sys 0.039s
W20260709 13:17:23.621256  3165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.014s	sys 0.030s
I20260709 13:17:23.520584  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:23.662619  3762 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.018s	sys 0.050s
W20260709 13:17:23.790110  3762 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.026s	sys 0.070s
I20260709 13:17:23.790175  3121 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
W20260709 13:17:23.345858  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 352861us
W20260709 13:17:23.790683  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 778997us
I20260709 13:17:23.791486  3118 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
W20260709 13:17:23.442297  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 490571us
W20260709 13:17:23.789208  3015 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.029s	sys 0.066s
W20260709 13:17:23.792977  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 817961us
W20260709 13:17:23.793349  3165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.018s	sys 0.032s
W20260709 13:17:23.600688  3191 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.009s	sys 0.024s
W20260709 13:17:23.799015  3191 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.013s	sys 0.030s
W20260709 13:17:23.794175  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 807141us
I20260709 13:17:23.319206  3117 raft_consensus.cc:2889] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:23.635094  3797 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 881) took 2231 ms. Trace:
W20260709 13:17:23.788282  3193 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.005s	sys 0.003s
W20260709 13:17:23.803777  3193 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.005s	sys 0.003s
W20260709 13:17:23.787878  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 516428us
I20260709 13:17:23.787611  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:23.792227  3192 rpcz_store.cc:276] 0709 13:17:21.824968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.844217 (+ 19249us) service_pool.cc:224] Handling call
0709 13:17:21.844584 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.852877 (+  8293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.852926 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.884887 (+ 31961us) log.cc:844] Serialized 26 byte log entry
0709 13:17:22.484523 (+599636us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b1800308320. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:17:23.117390 (+632867us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:23.117432 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.117514 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:23.280304 (+162790us) raft_consensus.cc:1685] finished
0709 13:17:23.280342 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.280702 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12295,"raft.queue_time_us":10003,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":11124,"spinlock_wait_cycles":4054272,"thread_start_us":632661,"threads_started":1,"wal-append.queue_time_us":1393374}
I20260709 13:17:23.806931  3048 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:23.809192  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:23.809834  3048 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:23.794131  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:23.801929  3797 rpcz_store.cc:276] 0709 13:17:21.388962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.389109 (+   147us) service_pool.cc:224] Handling call
0709 13:17:21.407223 (+ 18114us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.407597 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.407624 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.923728 (+516104us) spinlock_profiling.cc:243] Waited 39.3 ms on lock 0x7b2c00047618. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:17:21.924248 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:17:22.164091 (+239843us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:22.169871 (+  5780us) log.cc:844] Serialized 14 byte log entry
0709 13:17:22.514011 (+344140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.514104 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:23.489467 (+975363us) raft_consensus.cc:1685] finished
0709 13:17:23.620054 (+130587us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.620285 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1064,"prepare.queue_time_us":98,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":48,"raft.queue_time_us":175955,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":26035,"spinlock_wait_cycles":90355072,"thread_start_us":517303,"threads_started":2,"wal-append.queue_time_us":865015}
I20260709 13:17:23.283856  9476 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:23.788654  9641 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.018s	sys 0.017s
I20260709 13:17:23.788511  9636 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:23.698372  9784 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.417s	user 0.001s	sys 0.000s
W20260709 13:17:23.486366  9753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.026s	sys 0.037s
I20260709 13:17:23.821120  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:23.781733  9653 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:23.829618  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.293663  9652 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:23.818362  3044 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.006s	sys 0.014s
I20260709 13:17:23.697445  9692 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:23.820052  9559 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:23.927726  9344 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.026s	sys 0.054s
I20260709 13:17:23.699652  9291 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:23.663355  9697 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:23.928640  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.785548  9654 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:23.939527  9636 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:23.683094  9702 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:23.937688  3043 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
W20260709 13:17:23.938496  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:23.953356  3044 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.006s	sys 0.014s
I20260709 13:17:23.816999  9803 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:23.830655  9641 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.018s	sys 0.019s
I20260709 13:17:23.903033  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:23.966853  9659 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.052237  9702 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:24.053073  9702 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:24.055652  9702 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:24.056241  9702 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:24.056806  9702 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:24.059773  9702 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:24.062602  9813 log.cc:927] Time spent T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:24.065122  9744 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:24.065773  9744 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:24.066286  9744 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:24.068377  9744 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:24.076761  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 3012) took 1134 ms. Trace:
I20260709 13:17:24.077247  3044 rpcz_store.cc:276] 0709 13:17:22.941994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.943353 (+  1359us) service_pool.cc:224] Handling call
0709 13:17:22.948318 (+  4965us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:22.967456 (+ 19138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.967498 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:22.991980 (+ 24482us) log.cc:844] Serialized 26 byte log entry
0709 13:17:24.038058 (+1046078us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:24.038105 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.038178 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:24.076392 (+ 38214us) raft_consensus.cc:1685] finished
0709 13:17:24.076424 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.076675 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8153,"raft.queue_time_us":50621,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":978385,"threads_started":1,"wal-append.queue_time_us":950719}
I20260709 13:17:24.079071  9658 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:24.079278  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:24.080680  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:24.080585  9803 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:24.081521  3044 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:24.083083  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:24.083655  9803 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:23.281458  9787 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:24.110134  3050 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:23.698127  9647 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:23.978183  9797 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.112435  9797 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:24.115927  9797 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:23.986989  9692 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:24.118453  9692 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:24.122675  9805 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.123395  9805 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:24.126235  9659 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:24.128870  9659 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:23.818678  9687 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:23.953117  9753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.030s	sys 0.037s
I20260709 13:17:23.827592  9782 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:23.997712  9559 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:23.826903  9476 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:24.146874  9611 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:24.147738  9611 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.155660  9764 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:24.157228  9706 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:24.164876  9721 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:24.171438  3045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 3000) took 2006 ms (client timeout 2208 ms). Trace:
W20260709 13:17:24.172032  3045 rpcz_store.cc:269] 0709 13:17:22.164783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.167082 (+  2299us) service_pool.cc:224] Handling call
0709 13:17:24.171197 (+2004115us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b540029de54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:24.171353 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":554344192}
I20260709 13:17:24.177520  3799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 1163) took 2136 ms. Trace:
I20260709 13:17:24.134188  9687 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:24.178025  3799 rpcz_store.cc:276] 0709 13:17:22.040900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.041041 (+   141us) service_pool.cc:224] Handling call
0709 13:17:22.041395 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.083532 (+1042137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.177248 (+1093716us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b54006540d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:24.177449 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2298728320}
I20260709 13:17:24.179922  9687 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:24.134891  9782 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:24.182827  9782 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:24.189095  9787 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:24.173663  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:24.140033  3051 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:23.975936  9603 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:23.904510  9717 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:24.277802  9717 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:24.280624  9717 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:23.702150  9639 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:23.904728  9582 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:23.976541  9652 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:24.027127  9577 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:23.989106  9344 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.027s	sys 0.054s
I20260709 13:17:24.281766  9582 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:24.084376  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:24.283743  3044 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:24.284734  9582 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:24.285197  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:24.129724  9692 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:24.287076  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:24.288578  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:24.084636  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 3014) took 1141 ms. Trace:
I20260709 13:17:24.085816  9449 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:24.290664  9770 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:24.094787  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 3003) took 1929 ms. Trace:
I20260709 13:17:24.291436  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2896) took 1327 ms. Trace:
I20260709 13:17:24.291684  3042 rpcz_store.cc:276] 0709 13:17:22.165777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.168231 (+  2454us) service_pool.cc:224] Handling call
0709 13:17:24.094543 (+1926312us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54003c28d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:24.094702 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2359486848}
I20260709 13:17:24.291906  3126 rpcz_store.cc:276] 0709 13:17:22.963687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.965095 (+  1408us) service_pool.cc:224] Handling call
0709 13:17:22.999373 (+ 34278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:22.999646 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.999688 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:23.028894 (+ 29206us) log.cc:844] Serialized 26 byte log entry
0709 13:17:23.518926 (+490032us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:23.518963 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.519039 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:24.291247 (+772208us) raft_consensus.cc:1685] finished
0709 13:17:24.291267 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.291387 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":455786,"threads_started":1,"wal-append.queue_time_us":1195815}
I20260709 13:17:24.039403  9653 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:17:24.293522  3091 connection.cc:256] RPC call timeout handler was delayed by -1.1257760610001242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
I20260709 13:17:24.107136  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:24.294088  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:24.295082  3042 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:24.295341  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:24.236595  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:24.296710  3042 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:17:24.296902  3051 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:24.297145  3042 pending_rounds.cc:85] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 9
I20260709 13:17:24.297493  3042 pending_rounds.cc:107] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:17:24.297786  3042 raft_consensus.cc:2889] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:24.299404  3042 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:17:24.035598  9708 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:24.139726  9476 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:24.290369  3047 rpcz_store.cc:276] 0709 13:17:22.942821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.944201 (+  1380us) service_pool.cc:224] Handling call
0709 13:17:22.944604 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:22.945009 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.945049 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:22.966825 (+ 21776us) log.cc:844] Serialized 26 byte log entry
0709 13:17:23.319048 (+352223us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:23.319092 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.319159 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:24.084355 (+765196us) raft_consensus.cc:1685] finished
0709 13:17:24.084395 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.084567 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1265,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":96,"thread_start_us":351766,"threads_started":1,"wal-append.queue_time_us":1029939}
I20260709 13:17:24.302769  9577 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.303267  9577 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:24.304255  3091 connection.cc:256] RPC call timeout handler was delayed by -1.0024760610001522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
I20260709 13:17:24.270427  9805 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:24.050786  9291 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:24.319988  9449 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.320073  9291 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:24.097106  9718 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:24.320662  9449 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:24.293931  9653 raft_consensus.cc:697] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:24.106151  9697 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:24.137480  9559 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:24.301905  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:23.926131  9688 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:24.319516  9577 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:24.276826  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:24.272554  9540 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:24.331606  3045 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
W20260709 13:17:24.329396  3193 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.004s	sys 0.064s
W20260709 13:17:24.350548  3193 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.004s	sys 0.065s
W20260709 13:17:24.328416  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 522956us
W20260709 13:17:24.338788  3048 consensus_meta.cc:287] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.001s
I20260709 13:17:24.353519  3048 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:24.364885  3761 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:24.377106  3165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.035s	sys 0.040s
I20260709 13:17:24.322322  9653 consensus_queue.cc:237] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:24.330863  9697 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:24.329313  9708 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:24.378876  3165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.035s	sys 0.040s
I20260709 13:17:24.366175  9670 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
W20260709 13:17:24.396715  3046 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.095s	sys 0.144s
W20260709 13:17:25.107657  3046 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.444s	user 0.105s	sys 0.161s
W20260709 13:17:24.728008  3015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.035s	sys 0.055s
W20260709 13:17:25.108978  3015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.284s	user 0.043s	sys 0.058s
W20260709 13:17:24.977591  3016 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.160s	user 0.012s	sys 0.024s
W20260709 13:17:25.109629  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 1.31547e+06us
W20260709 13:17:25.109730  3016 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.292s	user 0.012s	sys 0.028s
I20260709 13:17:24.373245  9751 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:25.110594  9751 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.111009  9751 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:24.428440  9762 raft_consensus.cc:3055] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:24.431964  9539 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:25.082103  3760 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.000s	sys 0.018s
W20260709 13:17:24.783885  9611 consensus_meta.cc:287] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.002s
I20260709 13:17:24.432050  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2590) took 1444 ms. Trace:
W20260709 13:17:24.742600  3089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.005s	sys 0.013s
I20260709 13:17:24.427610  9679 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:25.114624  9611 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:24.741407  3092 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.012s	sys 0.008s
W20260709 13:17:24.793952  9636 consensus_meta.cc:287] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.664s	user 0.012s	sys 0.000s
W20260709 13:17:25.123767  3092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.166s	user 0.016s	sys 0.011s
I20260709 13:17:25.123871  9652 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:25.113828  3760 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.083s	user 0.002s	sys 0.020s
I20260709 13:17:24.322449  9291 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:25.124037  9636 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:24.558852  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.126511  9694 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:25.124094  9611 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:25.119318  3089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.081s	user 0.007s	sys 0.018s
W20260709 13:17:25.132000  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 1.33148e+06us
W20260709 13:17:25.132519  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.115882  9708 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:25.111688  9762 raft_consensus.cc:740] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:17:25.121958  3200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 3030) took 2135 ms (client timeout 1870 ms). Trace:
W20260709 13:17:24.662611  3164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.004s	sys 0.017s
I20260709 13:17:25.126556  9636 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:25.127677  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3348) took 1939 ms. Trace:
I20260709 13:17:25.127251  9694 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:24.741183  3049 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.000s	sys 0.020s
I20260709 13:17:25.129356  9759 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:24.751539  3166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.009s	sys 0.017s
I20260709 13:17:25.114825  3124 rpcz_store.cc:276] 0709 13:17:22.987376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.987571 (+   195us) service_pool.cc:224] Handling call
0709 13:17:22.987848 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.139572 (+151724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:23.139618 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:23.139673 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:23.139724 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.431708 (+1291984us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54003e8854. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:24.431773 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.431957 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348342016}
I20260709 13:17:24.401046  2943 catalog_manager.cc:5697] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 16 to 18, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 18 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:17:25.135810  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:25.136555  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:25.136751  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:25.144009  9449 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:25.144217  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:25.144475  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:25.144250  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:25.145017  9688 consensus_meta.cc:287] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.813s	user 0.014s	sys 0.001s
I20260709 13:17:25.132858  3165 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:17:25.147051  3164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.193s	user 0.011s	sys 0.028s
W20260709 13:17:25.149544  3166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.195s	user 0.012s	sys 0.028s
I20260709 13:17:25.157182  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:25.152606  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:25.159621  3165 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:25.149679  3049 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.155s	user 0.000s	sys 0.028s
I20260709 13:17:25.155330  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:25.146833  3200 rpcz_store.cc:269] 0709 13:17:22.986298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.986415 (+   117us) service_pool.cc:224] Handling call
0709 13:17:25.121686 (+2135271us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b540013bad4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:25.121839 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51798912}
I20260709 13:17:25.147497  3050 rpcz_store.cc:276] 0709 13:17:23.188656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.188837 (+   181us) service_pool.cc:224] Handling call
0709 13:17:23.189220 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.110660 (+921440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.127418 (+1016758us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b54003c32d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:25.127606 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2117273984}
I20260709 13:17:25.162322  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3028) took 2165 ms. Trace:
W20260709 13:17:25.161322  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 1.33258e+06us
W20260709 13:17:25.167145  3191 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.209s	user 0.007s	sys 0.025s
W20260709 13:17:25.167824  3191 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.230s	user 0.007s	sys 0.025s
I20260709 13:17:25.170691  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.163581  3193 rpcz_store.cc:276] 0709 13:17:22.985617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.985920 (+   303us) service_pool.cc:224] Handling call
0709 13:17:23.020528 (+ 34608us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:23.200815 (+180287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:23.200858 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:23.226440 (+ 25582us) log.cc:844] Serialized 52 byte log entry
0709 13:17:23.804161 (+577721us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:24.351136 (+546975us) log.cc:844] Serialized 14 byte log entry
0709 13:17:24.351458 (+   322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.135702 (+784244us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54003bb854. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:25.135772 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.135840 (+    68us) raft_consensus.cc:1685] finished
0709 13:17:25.150435 (+ 14595us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.150609 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":376831,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":31,"raft.queue_time_us":601,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":16099,"spinlock_wait_cycles":413417344,"thread_start_us":1065123,"threads_started":2,"wal-append.queue_time_us":550447}
I20260709 13:17:25.171679  3050 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:25.175056  9626 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:25.176699  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:25.180801  3163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.227s	user 0.013s	sys 0.016s
W20260709 13:17:25.181257  3163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.227s	user 0.013s	sys 0.016s
I20260709 13:17:25.170218  9641 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:17:25.146308  9678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.115s	user 0.016s	sys 0.013s
I20260709 13:17:25.175377  9256 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:25.193090  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.176462  9611 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.186131  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3007) took 4067 ms. Trace:
I20260709 13:17:25.179848  9638 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:25.180442  9626 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:25.209494  3050 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:17:25.168607  9759 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:25.207785  3091 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.007s	sys 0.021s
I20260709 13:17:25.205180  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:25.216601  3091 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.007s	sys 0.021s
W20260709 13:17:25.197520  9678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.201s	user 0.017s	sys 0.013s
I20260709 13:17:25.185158  9688 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:25.217083  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 773092us
I20260709 13:17:25.205264  3191 rpcz_store.cc:276] 0709 13:17:21.118783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.120644 (+  1861us) service_pool.cc:224] Handling call
0709 13:17:21.121049 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.121496 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:22.467332 (+1345836us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b18004213c0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c3455 00007ff833dab3c7 00007ff8303bd9a7 00007ff8303cd0bf 00007ff8303cd038
0709 13:17:22.875619 (+408287us) log.cc:844] Serialized 14 byte log entry
0709 13:17:23.827207 (+951588us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:23.937383 (+110176us) log.cc:844] Serialized 26 byte log entry
0709 13:17:23.937581 (+   198us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:25.168321 (+1230740us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.175856 (+  7535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.177252 (+  1396us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.185896 (+  8644us) raft_consensus.cc:1685] finished
0709 13:17:25.185920 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.186068 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47561,"prepare.queue_time_us":722322,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":75,"raft.queue_time_us":291408,"raft.run_cpu_time_us":6069,"raft.run_wall_time_us":27930,"spinlock_wait_cycles":26540288,"thread_start_us":2521576,"threads_started":3,"wal-append.queue_time_us":1275736}
I20260709 13:17:25.190900  9641 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:25.226460  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.229115  3048 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
W20260709 13:17:25.233053  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:25.237483  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.222510  9638 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:17:25.247314  9708 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:25.230439  9688 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:25.250200  9688 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:25.238659  9604 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:25.257918  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3352) took 2033 ms. Trace:
I20260709 13:17:25.258558  3049 rpcz_store.cc:276] 0709 13:17:23.224652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.808507 (+583855us) service_pool.cc:224] Handling call
0709 13:17:23.809390 (+   883us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:23.823760 (+ 14370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:23.823804 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:23.824399 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:17:25.160799 (+1336400us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:25.160857 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.160948 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.257590 (+ 96642us) raft_consensus.cc:1685] finished
0709 13:17:25.257623 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.257839 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13881,"raft.queue_time_us":155317,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":19416,"spinlock_wait_cycles":6016,"thread_start_us":1166280,"threads_started":1,"wal-append.queue_time_us":1307961}
I20260709 13:17:25.180073  9762 consensus_queue.cc:260] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:25.263751  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.264662  3049 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:17:25.230568  9641 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:25.203099  9611 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:25.287972  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 176969us
I20260709 13:17:25.203256  9256 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:25.237208  9678 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:25.298877  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:25.300441  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:25.300768  9751 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:25.302459  9815 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:25.302501  9652 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:25.303119  9815 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:25.303206  9652 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:25.303649  9815 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:25.303726  9652 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:25.294164  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:25.314782  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.314364  2943 catalog_manager.cc:5697] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 15 to 18, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 18 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.315404  3049 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:17:25.316375  2943 catalog_manager.cc:5697] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 14 to 17, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 17 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.296229  9762 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.336404  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.337107  3049 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:25.338444  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.339636  3797 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:25.340448  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:25.342789  9626 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:25.344115  9458 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:25.344779  9638 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:25.306624  9821 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:25.310437  9679 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.040s
I20260709 13:17:25.310763  9817 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:17:25.353690  9697 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:25.358361  9604 raft_consensus.cc:1064] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
W20260709 13:17:25.361681  2947 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57732 (request call id 233) took 28998 ms (client timeout 15000 ms). Trace:
I20260709 13:17:25.323700  3091 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:25.327188  2943 catalog_manager.cc:5697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.367141  2943 catalog_manager.cc:5697] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 11 to 12, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 12 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:25.369172  2943 catalog_manager.cc:5697] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 18 to 19, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 19 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.370715  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.371323  3049 raft_consensus.cc:1813] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Handling vote request from an unknown peer f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:25.309511  9678 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:25.371479  2943 catalog_manager.cc:5697] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 13 to 20, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 20 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:25.394428  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.372205  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:25.395303  3048 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
W20260709 13:17:25.392858  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 69230.7us
I20260709 13:17:25.340955  9694 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:25.400430  9611 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:25.396243  3091 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:25.396900  2943 catalog_manager.cc:5697] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 12 to 13, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 13 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:25.403734  2943 catalog_manager.cc:5697] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 8 to 12, term changed from 7 to 14, VOTER f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) evicted. New cstate: current_term: 14 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:25.404596  3091 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:25.418437  9653 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.051s	sys 0.074s
I20260709 13:17:25.371805  9708 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:25.428594  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.417564  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.416869  9458 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:25.424813  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.425454  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.401719  3049 raft_consensus.cc:2410] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:17:25.432411  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.435382  3051 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:25.435812  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.398939  9449 consensus_queue.cc:1059] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
W20260709 13:17:25.440508  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 280935us
W20260709 13:17:25.428373  9653 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.051s	sys 0.074s
I20260709 13:17:25.429665  3050 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:25.423674  9823 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:25.445436  3165 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:25.427575  2943 catalog_manager.cc:5697] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.447978  9256 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:25.448122  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.428421  9826 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:17:25.449018  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.449771  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.454499  3165 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:25.454718  2943 catalog_manager.cc:5697] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 14 to 17, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 17 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:25.455808  3045 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:25.434485  9458 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.456323  3043 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:25.435892  9759 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:25.459594  2943 catalog_manager.cc:5697] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 18 to 21, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 21 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:25.464529  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 162945us
I20260709 13:17:25.464393  2943 catalog_manager.cc:5697] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.467730  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.415594  9652 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:25.470330  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:25.454445  9751 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:25.467965  2943 catalog_manager.cc:5697] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 8 to 9, term changed from 15 to 16, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.476423  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:25.477026  3792 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:25.457175  9822 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:25.471082  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.472404  3796 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:25.479743  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:25.480432  3118 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:17:25.480456  3049 raft_consensus.cc:2410] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 21 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:17:25.462159  9458 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:25.483121  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:25.481618  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.482461  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:25.482741  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.484589  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:25.362725  2947 rpcz_store.cc:269] 0709 13:16:56.363422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.405024 (+ 41602us) service_pool.cc:224] Handling call
0709 13:16:57.009355 (+604331us) spinlock_profiling.cc:243] Waited 7.03 ms on lock 0x7b5400002490. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28f0b2 00007ff836208a89 00007ff8361a0da6 00007ff836172088 00007ff83627037e 00007ff8347312a4 00007ff834731232 00007ff834731161 00007ff8347310dc
0709 13:17:25.361385 (+28352030us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:15.924623 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:15.925571 (+   948us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:15.925644 (+    73us) write_op.cc:435] Acquired schema lock
0709 13:17:15.925682 (+    38us) tablet.cc:662] Decoding operations
0709 13:17:15.977329 (+ 51647us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:15.977446 (+   117us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:15.977494 (+    48us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:17:16.054091 (+ 76597us) tablet.cc:701] Row locks acquired
0709 13:17:16.110361 (+ 56270us) write_op.cc:260] PREPARE: finished
0709 13:17:16.110644 (+   283us) write_op.cc:270] Start()
0709 13:17:16.110827 (+   183us) write_op.cc:276] Timestamp: P: 1783603036110540 usec, L: 0
0709 13:17:16.110939 (+   112us) op_driver.cc:348] REPLICATION: starting
0709 13:17:16.196518 (+ 85579us) log.cc:844] Serialized 11178 byte log entry
0709 13:17:16.678698 (+482180us) op_driver.cc:464] REPLICATION: finished
0709 13:17:16.889194 (+210496us) write_op.cc:301] APPLY: starting
0709 13:17:16.893618 (+  4424us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:17.254945 (+361327us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:17.255079 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:18.291214 (+1036135us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:18.298340 (+  7126us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=0,mrs_lookups=0
0709 13:17:18.298442 (+   102us) write_op.cc:312] APPLY: finished
0709 13:17:18.301201 (+  2759us) log.cc:844] Serialized 244 byte log entry
0709 13:17:18.617031 (+315830us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:18.686531 (+ 69500us) write_op.cc:454] Released schema lock
0709 13:17:18.740900 (+ 54369us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:19.170795 (+429895us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b180008dee0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2942a6 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83676f9e1 00007ff83676e64c 00007ff833dff3fd 00007ff833deb389
0709 13:17:19.172142 (+  1347us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b54000d9728. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83676f9e1 00007ff83676e64c 00007ff833dff3fd 00007ff833deb389 00007ff833deab53 00007ff833deed61 00007ff833deed19 00007ff833deeca9 00007ff833deec71 00007ff833dede9d 000000000038f354
0709 13:17:19.229818 (+ 57676us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:19.232040 (+  2222us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":372371,"reported_tablets":51,"spinlock_wait_cycles":16167680,"child_traces":[["op",{"apply.queue_time_us":171420,"apply.run_cpu_time_us":85680,"apply.run_wall_time_us":2340330,"cfile_cache_hit":114,"cfile_cache_hit_bytes":121223,"num_ops":28,"prepare.queue_time_us":370149,"prepare.run_cpu_time_us":41689,"prepare.run_wall_time_us":352809,"raft.queue_time_us":145325,"raft.run_cpu_time_us":39906,"raft.run_wall_time_us":165426,"replication_time_us":567550,"spinlock_wait_cycles":12590208,"thread_start_us":860833,"threads_started":5,"wal-append.queue_time_us":576596,"wal-append.run_cpu_time_us":17418,"wal-append.run_wall_time_us":2443389}]]}
I20260709 13:17:25.485839  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:25.485608  3015 connection.cc:256] RPC call timeout handler was delayed by -1.8748403849999704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
I20260709 13:17:25.466233  9256 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:17:25.490196  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0711085850000472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
I20260709 13:17:25.490350  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.492787  9833 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.498893  3044 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:17:25.502264  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:25.523855  3048 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:17:25.478505  9821 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.478713  9638 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.526163  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:25.534174  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 491252us
I20260709 13:17:25.483707  9653 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:25.481168  9822 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:25.536484  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.537307  3049 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:17:25.538547  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.538853  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.540114  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.540903  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.541600  3044 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:25.489758  9256 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.524040  9833 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:25.549129  9833 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:25.543670  9827 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:17:25.543771  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.551265  3045 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:25.546392  3762 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:25.556592  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:25.556748  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:25.556784  9694 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:25.557281  3045 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:25.557494  9694 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:25.558164  9694 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:25.560221  9825 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:17:25.563804  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:25.564520  3050 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:25.568744  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.525687  9817 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:25.569389  3044 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:17:25.572960  3045 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:17:25.575922  3119 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:17:25.576473  3119 pending_rounds.cc:85] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 12
I20260709 13:17:25.576772  3119 pending_rounds.cc:107] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:17:25.577160  3119 raft_consensus.cc:2889] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:25.581032  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.542137  9822 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:25.585654  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:25.552301  9256 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:25.590404  3047 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.028s	sys 0.024s
W20260709 13:17:25.591456  3047 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.028s	sys 0.024s
I20260709 13:17:25.566861  9833 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:17:25.591650  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.592919  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3366) took 1808 ms. Trace:
I20260709 13:17:25.595534  3043 rpcz_store.cc:276] 0709 13:17:23.784757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.296189 (+511432us) service_pool.cc:224] Handling call
0709 13:17:24.296458 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.459048 (+1162590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.592699 (+133651us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540032ffd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:25.592860 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2667048832}
I20260709 13:17:25.596669  9604 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:25.593034  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3356) took 2320 ms. Trace:
I20260709 13:17:25.566969  9652 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:25.545519  9653 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:25.606017  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.536129  9762 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.048s
I20260709 13:17:25.598145  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.598785  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.599390  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.537302  9638 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:25.600778  9820 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.598150  3046 rpcz_store.cc:276] 0709 13:17:23.272621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.288777 (+ 16156us) service_pool.cc:224] Handling call
0709 13:17:23.447596 (+158819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.601888 (+154292us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:25.108169 (+1506281us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.438784 (+330615us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.438871 (+    87us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:25.438934 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.592747 (+153813us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54000c6554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:25.592823 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.592965 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":334,"prepare.queue_time_us":1616202,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":1409,"raft.queue_time_us":7341,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":2588,"spinlock_wait_cycles":354129664,"thread_start_us":1773985,"threads_started":2,"wal-append.queue_time_us":360425}
I20260709 13:17:25.612957  3762 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:25.616328  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:25.601085  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:25.616760  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.614377  3193 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:25.617130  3762 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:25.617372  3198 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:25.618047  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.618212  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.618710  3197 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
W20260709 13:17:25.597982  9832 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:17:25.617453  3196 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:25.620532  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:25.620922  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.588582  9678 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:25.621863  3194 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 18: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:25.615091  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:25.622691  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:25.623405  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 446540us
I20260709 13:17:25.624315  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:25.624979  3120 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:25.625630  9820 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:25.626431  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.626766  9815 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:25.628065  9820 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:25.629019  9815 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:25.537168  9821 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:25.602763  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:25.630091  3762 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:25.635106  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:25.635895  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.636225  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:25.637312  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:25.638144  3799 raft_consensus.cc:2393] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:25.603713  3123 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:17:25.639931  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:25.640954  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:25.641193  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:25.606835  3199 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 12.
I20260709 13:17:25.608489  3125 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:25.642057  3792 raft_consensus.cc:2393] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 16: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:25.637352  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:25.549172  9641 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:25.614138  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:25.643666  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.644119  3118 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:25.642727  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:25.614845  3192 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:25.616865  3191 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:25.631363  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:25.631505  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:25.644273  3199 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:25.642045  3762 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:25.649667  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:25.650342  3123 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:17:25.651115  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:25.651958  3123 raft_consensus.cc:2410] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:17:25.631753  3050 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:17:25.599148  9833 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:25.630143  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:25.602655  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1309) took 1405 ms. Trace:
I20260709 13:17:25.633520  3049 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:17:25.645874  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:25.657651  3125 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:25.656478  3762 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:25.659976  3796 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 15: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:25.653846  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:25.631953  9652 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:25.623318  9475 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:25.639025  9779 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:25.657281  3047 rpcz_store.cc:276] 0709 13:17:24.197387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.303261 (+105874us) service_pool.cc:224] Handling call
0709 13:17:24.303532 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.303709 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:17:24.662620 (+358911us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.602285 (+939665us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.602338 (+    53us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:25.602389 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.602464 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.602603 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":934831,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":14146,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":7567,"spinlock_wait_cycles":17890048,"thread_start_us":1281728,"threads_started":2,"wal-append.queue_time_us":961851}
I20260709 13:17:25.662339  3120 raft_consensus.cc:2376] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19. Re-sending same reply.
I20260709 13:17:25.664019  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:25.668468  3118 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:17:25.662889  9554 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:25.651563  9670 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:25.650120  9817 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:25.678709  3198 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:25.679807  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:25.680997  9820 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:25.671411  9779 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:25.681907  9554 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:25.682209  9749 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:25.677582  3119 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:25.684365  9821 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:25.686077  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.666035  9475 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:25.656761  9678 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:25.660430  9833 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:25.700017  9708 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:25.691883  9749 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:25.690613  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:25.665557  9652 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:25.687517  9817 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:25.654488  9815 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:17:25.665030  9636 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:17:25.686544  9638 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:25.658643  9841 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.698575  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.685828  9670 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:25.703423  3118 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:17:25.692576  9779 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:25.703831  3120 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:25.694895  3191 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:25.692731  9554 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:25.698210  9475 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:25.704321  9749 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:25.731969  9458 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:25.709553  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:25.711526  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:25.707821  9817 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:25.702963  9678 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:25.711876  9670 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:25.708436  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.694409  9820 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:25.705268  9652 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:25.712556  9641 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:25.709633  3198 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:25.738204  3123 raft_consensus.cc:2410] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:17:25.808410  9694 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:25.801095  3194 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:25.749337  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.808715  9678 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:25.733937  9653 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:25.820309  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.820520  9820 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:25.821322  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.822018  3194 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:25.822839  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.824146  3194 raft_consensus.cc:1240] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:25.825664  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.826289  3193 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:25.828464  9256 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:25.831509  9694 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:25.810292  3191 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:25.811705  3123 raft_consensus.cc:1240] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:25.815868  3122 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:17:25.836851  3198 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:25.837301  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:25.818328  9652 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:25.864137  9652 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:25.866039  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:25.867007  3122 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:17:25.712710  9841 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:25.893689  3197 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:17:25.890925  3200 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:17:25.890446  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:25.892266  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 235825us
W20260709 13:17:25.889940  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 231569us
W20260709 13:17:25.899463  3164 connection.cc:256] RPC call timeout handler was delayed by -2.2392007849998663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
W20260709 13:17:25.908253  3164 connection.cc:256] RPC call timeout handler was delayed by -1.7406007849999696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2183s for a response
W20260709 13:17:25.908885  3164 connection.cc:256] RPC call timeout handler was delayed by -1.2917137880001519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
I20260709 13:17:25.908082  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.912683  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:25.915105  3761 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:25.921545  3200 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:17:25.922046  3192 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:25.923252  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:25.924285  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.936481  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:17:25.925472  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 461395us
I20260709 13:17:25.937317  3044 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:25.945036  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:25.945547  3046 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:25.952193  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:25.910883  9820 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.955245  3197 raft_consensus.cc:1275] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:17:25.955688  3200 raft_consensus.cc:1240] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:25.885916  9833 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:25.965222  3091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.021s	sys 0.013s
W20260709 13:17:25.965595  3091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.021s	sys 0.013s
W20260709 13:17:25.966073  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 539372us
I20260709 13:17:25.935515  9759 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:17:25.970237  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:25.971047  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 58445.7us
W20260709 13:17:25.956439  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 307287us
I20260709 13:17:25.997610  3091 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:25.991184  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:26.000571  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 74117.1us
I20260709 13:17:26.001623  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.953927  9449 raft_consensus.cc:1027] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: attempt to promote peer e9165fe61ab04bfb9a48889156d5c161: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:17:25.921305  9751 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 13:17:26.019170  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.021266  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.026340  3195 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:26.023882  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:25.921056  9819 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:17:26.032955  9817 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:26.051067  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 52165.9us
I20260709 13:17:26.034214  9670 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.035166  9458 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:26.038215  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:26.040004  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.045030  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:26.068637  3194 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:26.047798  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:26.018021  9759 raft_consensus.cc:697] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:26.028795  9256 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:26.014302  9821 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:25.963299  9694 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:17:26.082273  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.082613  3051 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:17:26.048579  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:26.083438  3045 raft_consensus.cc:2410] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 22 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:17:25.965591  9820 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:26.083619  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:17:26.053476  9839 log.cc:927] Time spent T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.339s	user 0.001s	sys 0.000s
I20260709 13:17:26.071841  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.057880  3044 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:25.967767  9554 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.075740  3195 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:17:26.087993  3193 raft_consensus.cc:2393] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:26.088687  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.091545  3198 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:17:26.072989  9819 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:26.095775  9694 raft_consensus.cc:3055] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:26.095968  9670 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:26.096259  9694 raft_consensus.cc:740] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:26.099355  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.102592  3192 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:26.102474  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.103518  3090 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:26.032955  9749 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.088860  9449 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:26.117432  3194 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:17:26.093220  9819 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.123529  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.087121  9825 consensus_queue.cc:1059] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
W20260709 13:17:26.135187  9844 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:17:26.088647  9779 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.113222  9449 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:26.127645  9819 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:26.135538  9749 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:26.145726  9822 consensus_meta.cc:287] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.000s
I20260709 13:17:26.146281  9822 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.147002  9817 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:26.147827  9833 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:26.148571  9822 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:26.152607  9820 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:17:26.153419  9841 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:26.145792  9759 consensus_queue.cc:237] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.141897  9449 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:26.155407  9855 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:17:26.155565  9779 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:26.149626  9475 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.158591  9475 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:26.167865  9823 raft_consensus.cc:3055] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:26.169131  9823 raft_consensus.cc:740] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:17:26.210666  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 159685us
W20260709 13:17:26.212809  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.212406  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:26.212549  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:26.214747  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:26.216568  3050 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:26.217724  3049 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:26.222419  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:26.226686  3043 raft_consensus.cc:1240] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:26.227598  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:26.215013  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:26.230257  3047 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:26.234506  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 130867us
I20260709 13:17:26.236562  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:26.241778  3090 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:26.245548  3090 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:26.257187  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 130293us
I20260709 13:17:26.257565  3196 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:26.257982  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.259487  3195 raft_consensus.cc:2410] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 21 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:17:26.259295  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.260411  3193 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:26.261353  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:26.262341  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 339037us
I20260709 13:17:26.262434  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.262935  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:26.263813  3197 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 20: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:26.264254  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.264993  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:26.265169  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.262986  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.266162  3198 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:26.266559  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:26.266709  3200 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 18: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:26.267781  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.268476  3043 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 18: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:26.245483  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:26.261580  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.163035  9554 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:26.097282  9694 consensus_queue.cc:260] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.278855  9458 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:26.279546  9458 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:26.280138  9458 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:26.288569  9826 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:26.289501  9694 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:26.291088  9762 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:26.296609  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.298084  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:26.298952  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.299188  3197 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 20: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:26.300505  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.303115  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.303488  3047 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:26.286072  3193 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:26.310066  9871 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:26.311730  9708 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:26.310933  9823 consensus_queue.cc:260] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.312387  9708 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.312763  3193 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:17:26.312919  9708 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:26.314221  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.315174  3200 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:26.314271  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.309471  9652 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:26.320037  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.313400  9823 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:26.310885  9871 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:17:26.327068  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 81927.1us
I20260709 13:17:26.317526  9652 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:26.336793  9652 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:26.342262  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:26.346143  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 100971us
I20260709 13:17:26.347553  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:26.349191  9859 raft_consensus.cc:3055] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:26.349879  9859 raft_consensus.cc:740] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:26.351643  9859 consensus_queue.cc:260] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.353211  9859 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:26.354580  9873 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
W20260709 13:17:26.363551  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 50138.4us
I20260709 13:17:26.338258  9762 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:17:26.366112  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.338351  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.377254  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:26.378760  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:26.335284  9871 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:26.385438  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.386857  3199 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 14.
I20260709 13:17:26.388291  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:26.385506  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:26.391171  3047 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:26.365582  3165 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:17:26.395653  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 48373us
I20260709 13:17:26.380957  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:26.402153  9833 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:26.402784  9833 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:26.403288  9833 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:26.423849  9751 consensus_queue.cc:1059] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:26.427101  3796 raft_consensus.cc:1240] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:26.430290  9874 raft_consensus.cc:3055] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:26.431049  9874 raft_consensus.cc:740] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:26.432571  9874 consensus_queue.cc:260] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.441131  9874 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:26.444051  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:26.445322  9762 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:26.436699  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:26.434744  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 437046us
I20260709 13:17:26.442251  9611 consensus_queue.cc:1059] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:26.434739  3165 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:26.425822  9751 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 13:17:26.445950  9762 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.451117  3799 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:26.456177  3762 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:26.458673  9652 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:26.463115  9762 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:26.417531  9748 raft_consensus.cc:3055] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:26.466149  9748 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:26.467375  9748 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.468858  9748 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:26.470822  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:26.472275  3796 raft_consensus.cc:1240] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:26.473186  9867 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:26.473874  9867 raft_consensus.cc:697] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:26.475329  9867 consensus_queue.cc:237] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.481267  9749 consensus_queue.cc:1059] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:17:26.482722  3792 raft_consensus.cc:2410] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:17:26.482872  9749 raft_consensus.cc:3055] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:26.484272  9749 raft_consensus.cc:740] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:26.485858  9749 consensus_queue.cc:260] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.412010  9256 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:26.486886  9256 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:26.487345  9256 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:26.487989  9611 raft_consensus.cc:3055] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:26.488487  9611 raft_consensus.cc:740] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:26.489657  9611 consensus_queue.cc:260] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:26.490068  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 55570.7us
I20260709 13:17:26.490331  9511 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:26.490875  9511 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:26.490491  9458 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:26.491423  9511 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:26.491353  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:26.492647  3165 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:26.493182  9458 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:26.493888  9834 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:26.526043  9834 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.526538  9834 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:17:26.528455  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.495551  9841 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:26.530400  9841 raft_consensus.cc:697] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:26.531610  9841 consensus_queue.cc:237] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:26.534373  9819 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.491415  9611 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:26.504204  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 54295.3us
I20260709 13:17:26.504664  9749 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:26.505061  9511 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:26.505355  9751 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:17:26.508062  9833 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:26.557055  9833 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:26.543854  9652 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:26.560528  9641 consensus_queue.cc:1059] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:17:26.502535  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 76946.5us
I20260709 13:17:26.561969  9641 raft_consensus.cc:3055] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:26.562440  9641 raft_consensus.cc:740] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:26.563659  9641 consensus_queue.cc:260] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.565362  9641 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:26.567050  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:26.567351  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:26.568248  3796 raft_consensus.cc:2410] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:17:26.569152  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:26.571527  9834 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:26.522279  3091 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:26.535820  9697 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:26.582190  9697 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:26.582741  9697 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:26.497470  3165 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:26.586587  9611 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:26.586786  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 89413.5us
I20260709 13:17:26.587277  9611 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:26.587836  3165 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:26.589605  9820 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:26.590111  9820 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:26.590684  9820 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:26.593899  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.546545  9291 consensus_queue.cc:1059] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:17:26.594663  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.596293  9291 raft_consensus.cc:3055] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:26.596813  9291 raft_consensus.cc:740] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:26.597935  9291 consensus_queue.cc:260] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.599964  9291 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:26.602373  3165 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:26.603582  9822 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:26.604023  3797 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 13:17:26.605255  9819 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:26.606191  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:26.606695  9821 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:26.609071  3165 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:26.547364  9256 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:26.548131  9511 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:26.550571  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:26.554332  9751 raft_consensus.cc:3055] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:26.511911  9449 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:26.587890  9611 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:26.536732  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 100256us
I20260709 13:17:26.614450  3799 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:26.641410  9818 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:26.642153  3165 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:26.643054  9821 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:26.644153  9821 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:26.644940  3165 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:26.644794  9762 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:26.647866  9762 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:26.649909  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 99487us
I20260709 13:17:26.650666  9762 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:26.651288  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:26.651091  9833 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:26.609328  9871 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:26.618119  9751 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:26.652839  9823 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:26.529579  9708 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:26.654579  9762 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:26.663188  9821 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:26.658169  9652 raft_consensus.cc:2764] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:17:26.701408  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:26.702500  9821 raft_consensus.cc:697] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:26.703022  3090 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:26.703717  9821 consensus_queue.cc:237] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:26.706770  3122 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:17:26.708509  9449 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:26.710515  9256 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:26.715754  9890 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.082s	user 0.003s	sys 0.000s
W20260709 13:17:26.717080  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.718641  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:26.718688  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:26.721084  9859 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:26.722476  3048 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:26.722787  9697 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.723203  9708 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:26.675763  9820 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:26.678843  3045 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:26.723932  9708 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:26.682152  9611 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.684926  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:26.697961  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 175835us
I20260709 13:17:26.723462  9751 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.746212  3799 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:26.747105  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:26.700867  9822 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:26.728472  9871 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:26.730909  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:26.735154  3120 raft_consensus.cc:1240] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:26.735926  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.658514  9834 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:26.737452  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.741053  9652 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:17:26.741258  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 56510.2us
I20260709 13:17:26.743206  3091 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:26.746209  9751 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:26.754429  3090 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:26.736742  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:26.724429  9708 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:26.758236  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.748773  9762 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:26.772019  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 67989.2us
I20260709 13:17:26.773003  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:26.755131  9841 consensus_queue.cc:1059] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:17:26.763927  9449 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:26.786224  9871 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:26.786585  9841 raft_consensus.cc:3055] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:26.786967  9874 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.803568  9871 raft_consensus.cc:697] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:26.803675  9874 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.804641  9871 consensus_queue.cc:237] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:26.787554  9883 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:26.806403  9883 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:26.806483  9817 consensus_queue.cc:1059] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:17:26.806911  9883 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:26.759195  9748 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:17:26.797623  9833 consensus_queue.cc:1059] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:26.799003  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:26.794482  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:26.809116  3124 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:26.809294  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:26.811453  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:26.799978  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 56929.5us
I20260709 13:17:26.809930  9458 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:26.813077  9846 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:26.813485  9846 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:26.813868  9846 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:26.806733  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:26.814682  9843 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:26.815184  9843 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:26.815373  3045 raft_consensus.cc:2410] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 22 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:17:26.815294  3091 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:26.815673  9843 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:26.817188  9884 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:26.817618  9845 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:26.819126  9458 raft_consensus.cc:697] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:26.819380  3090 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:26.820097  9458 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.821820  9841 raft_consensus.cc:740] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:17:26.822613  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.822887  9841 consensus_queue.cc:260] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.825124  9882 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:17:26.825210  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.814199  9874 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:26.825815  9882 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:26.825886  3124 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 23.
I20260709 13:17:26.825460  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:26.826354  9882 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:26.826143  9841 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:26.828519  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:26.821516  3091 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:26.830928  9847 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:26.831357  9847 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:26.831766  9847 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:26.774395  9708 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:26.855923  3799 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:26.870571  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:26.871435  3047 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 23: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:26.871937  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:26.835573  9883 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:26.874166  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 52757.7us
W20260709 13:17:26.875305  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 72856.9us
I20260709 13:17:26.872627  3043 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:26.784644  9867 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
W20260709 13:17:26.886962  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 58693.1us
I20260709 13:17:26.890687  9843 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:26.892017  9883 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:26.896051  3117 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:26.892122  9882 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:26.897200  3124 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:26.897269  9611 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:26.898145  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:26.898439  9882 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:26.892804  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:26.899807  3196 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:26.892971  9843 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:26.894243  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:26.894349  3761 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:26.895085  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:26.917924  3198 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
W20260709 13:17:26.923288  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 57964.9us
I20260709 13:17:26.924678  3165 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:26.928761  3043 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:17:26.933341  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:26.938789  3049 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:26.941711  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:26.951239  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.954015  3043 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:26.932339  3091 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:26.953714  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.883425  9874 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:17:26.958755  3090 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:26.966243  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:26.964529  3121 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:26.978503  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.993382  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.994498  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:26.945124  9449 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:27.031965  3047 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:27.032825  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 143517us
I20260709 13:17:26.961915  9697 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:26.959830  9748 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:26.960588  9256 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:27.048375  9836 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:27.048617  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:27.049043  9836 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:27.052062  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 142999us
W20260709 13:17:27.050678  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 97886.4us
I20260709 13:17:27.065205  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:27.008387  9449 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:27.069367  9652 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:27.074755  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:27.075536  3199 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:17:27.069778  9906 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:17:27.080727  9843 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:27.081166  9843 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.081516  9843 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:27.082031  9871 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:27.084903  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:27.085515  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:27.086154  3042 raft_consensus.cc:1240] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:27.086433  3121 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:27.087101  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:27.087760  3118 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:27.087845  3117 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 13:17:27.089123  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:27.090163  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:27.091259  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:27.091993  3196 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 23: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:27.091934  9847 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:27.087853  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 180295us
I20260709 13:17:27.086200  3122 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:27.087132  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:27.094604  3191 raft_consensus.cc:2368] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 14. Current term is 15.
I20260709 13:17:27.095765  3091 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:27.097298  3091 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:27.097937  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.098827  9871 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:27.099860  3125 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 21: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:27.103181  9902 raft_consensus.cc:3055] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:27.103652  9902 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:27.104640  9902 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:27.107173  9817 raft_consensus.cc:3055] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:27.107630  9817 raft_consensus.cc:740] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:27.108716  9817 consensus_queue.cc:260] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:27.111999  9894 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:17:27.115258  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.115922  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:27.116878  9817 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:27.117328  9902 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:27.126219  9697 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:17:27.128480  9291 consensus_meta.cc:287] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.003s
I20260709 13:17:27.129369  9820 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:27.129603  3198 raft_consensus.cc:2393] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 18: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:17:27.130514  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 83283.7us
I20260709 13:17:27.130491  3091 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:27.132830  9903 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:27.133574  9899 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:17:27.135563  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.137341  3192 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:17:27.049489  9836 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:27.144366  3118 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:27.144367  3197 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:27.160102  3122 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
W20260709 13:17:27.188730  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 58416.8us
I20260709 13:17:27.192569  9833 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:27.195356  9847 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:27.196729  9871 raft_consensus.cc:2764] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:17:27.198273  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:27.199169  3799 raft_consensus.cc:2393] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:27.212620  3797 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:17:27.217233  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.080416  9823 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:17:27.209966  3164 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 1.501s (SENT) [suppressed 24 similar messages]
I20260709 13:17:27.149914  9708 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:27.146167  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 62773.9us
W20260709 13:17:27.158171  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 94019us
I20260709 13:17:27.225509  3047 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:27.082933  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:27.227666  3165 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:27.240734  3165 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:27.237449  9818 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:27.247354  3119 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:17:27.237675  9841 consensus_queue.cc:1059] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:17:27.249022  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:27.233256  9871 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:27.250303  9871 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:27.250720  3091 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:27.251983  9708 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:27.252631  9708 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:27.253032  9708 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:27.253413  9708 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:27.209751  9903 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:27.262094  9821 consensus_queue.cc:1059] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:27.263089  9818 raft_consensus.cc:697] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:27.263550  9903 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:27.264191  9903 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:27.264066  9818 consensus_queue.cc:237] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:27.266500  9841 raft_consensus.cc:3055] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:27.266953  9841 raft_consensus.cc:740] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:27.267948  9841 consensus_queue.cc:260] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:27.269223  9841 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:27.231287  9859 consensus_queue.cc:1059] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 13:17:27.198293  9899 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:27.270721  9859 raft_consensus.cc:3055] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:27.271096  9859 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:27.272011  9899 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:27.271961  9859 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:27.250722  9871 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:27.278227  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 196320us
I20260709 13:17:27.280071  3090 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:27.280834  9697 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:27.263563  9821 raft_consensus.cc:3055] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:27.282591  9821 raft_consensus.cc:740] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:27.283756  9821 consensus_queue.cc:260] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:27.284984  9821 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:27.287658  3124 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:27.289076  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:27.289201  9458 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.289827  3047 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:27.289901  9458 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:27.292130  9458 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:27.238148  9820 consensus_queue.cc:1059] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:17:27.295269  9820 raft_consensus.cc:3055] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:27.295712  9820 raft_consensus.cc:740] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:17:27.301116  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:27.302037  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:27.302500  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 61869.2us
I20260709 13:17:27.296870  9820 consensus_queue.cc:260] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:27.306233  9611 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:27.261198  9449 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:27.313562  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:27.316283  9611 raft_consensus.cc:697] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:27.320303  9611 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:27.322018  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 73066.8us
I20260709 13:17:27.322484  9843 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:27.322810  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:27.323748  9908 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:27.323942  3198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "f20672b2852447a6bc1e137c4dd40904"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:17:27.326431  3198 raft_consensus.cc:606] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Received request to transfer leadership to TS f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:27.326812  3198 raft_consensus.cc:614] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:27.339444  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:27.340051  9449 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:27.346616  9846 consensus_meta.cc:287] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.002s
I20260709 13:17:27.347169  9846 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:27.349413  9846 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:27.327978  9908 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:27.351531  9762 consensus_meta.cc:287] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.000s
I20260709 13:17:27.353976  9843 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:27.356145  3194 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:27.356390  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:27.358330  3196 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:27.359570  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:27.361845  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:27.362325  3050 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:17:27.362912  3198 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:17:27.361886  9871 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:27.373358  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:27.377899  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 55159.4us
I20260709 13:17:27.316835  9652 raft_consensus.cc:697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:27.384828  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:27.385610  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:27.400017  3043 raft_consensus.cc:2368] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 22. Current term is 23.
I20260709 13:17:27.388887  9908 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:27.386567  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:27.387238  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:27.383188  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:27.402439  3042 raft_consensus.cc:2393] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:17:27.427623  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:27.428323  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:27.428689  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.431010  3193 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:27.431250  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:27.434228  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:27.434873  3195 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:27.435736  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:27.395337  9762 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:27.394788  9847 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:27.434089  9846 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:17:27.445539  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 72314.8us
I20260709 13:17:27.436954  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:27.448374  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:27.447635  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.446794  3050 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:17:27.448606  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:27.447621  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:27.467134  3045 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:27.467561  3090 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:27.471776  3049 raft_consensus.cc:2393] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 18: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:27.465305  3051 raft_consensus.cc:2376] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20. Re-sending same reply.
I20260709 13:17:27.475554  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:27.476611  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:27.478915  9841 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:27.485505  3199 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:27.493953  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:27.495391  3198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:17:27.496182  3198 raft_consensus.cc:606] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:27.496567  3198 raft_consensus.cc:614] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:17:27.497792  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 62161.5us
I20260709 13:17:27.499099  9911 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:27.472847  9910 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.503921  9910 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:27.506740  9458 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:27.479678  9841 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:27.480680  9846 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:27.518862  9697 consensus_queue.cc:1059] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:17:27.518778  9652 consensus_queue.cc:237] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:27.527938  9697 consensus_queue.cc:1243] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:27.528498  9697 raft_consensus.cc:3055] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:27.528885  9697 raft_consensus.cc:740] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:27.527302  9867 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:17:27.532769  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 322817us
I20260709 13:17:27.536091  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:27.528762  3761 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:27.539053  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:27.539852  3196 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:27.537964  9867 raft_consensus.cc:697] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 23 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:27.494753  9749 consensus_queue.cc:1059] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:17:27.566817  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:27.508916  9708 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:27.575168  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:27.522291  9823 consensus_queue.cc:1059] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:17:27.580790  3193 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:27.580947  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:27.591104  3051 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:27.605039  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 76346.7us
I20260709 13:17:27.572053  9911 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:27.610097  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:27.612268  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 80210.2us
I20260709 13:17:27.614637  3200 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:27.530230  9697 consensus_queue.cc:260] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:27.592502  9751 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:27.634127  3042 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:27.647883  3199 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:27.651656  3050 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:17:27.656225  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:27.663658  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:27.657336  3042 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 16: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:17:27.695099  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.623066  9818 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:27.714535  3047 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 23: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:27.740144  3118 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 20. Current term is 22. Ops: []
I20260709 13:17:27.639580  9910 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:27.645632  9817 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:27.738794  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:27.742518  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:27.751384  3124 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:17:27.743140  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 96427.5us
I20260709 13:17:27.619810  9874 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:17:27.747195  3198 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:17:27.749825  9913 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:17:27.754407  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:27.755235  3799 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 18: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:27.655555  9871 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:27.756596  3042 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:27.713616  9762 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:27.760632  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:27.752272  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:27.759511  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:27.747704  9697 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:27.620597  9867 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:27.660308  9836 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:27.776458  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 211813us
I20260709 13:17:27.763867  3050 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:27.782627  3792 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:27.645748  9611 consensus_queue.cc:1059] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.111s
I20260709 13:17:27.785377  3050 raft_consensus.cc:1240] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:27.713274  9914 consensus_queue.cc:1059] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 12, Time since last communication: 0.122s
I20260709 13:17:27.786823  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:27.787142  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:27.789462  3050 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:27.787354  3090 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:27.789950  3799 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: []
W20260709 13:17:27.793570  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.803884  3050 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:27.804472  3125 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 23: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:27.780117  9871 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.836476  3119 raft_consensus.cc:1240] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:27.808732  3090 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:27.838169  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:27.812911  9694 raft_consensus.cc:3055] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:27.815012  9256 raft_consensus.cc:3055] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:27.817281  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:27.830618  9859 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:27.803596  3796 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEARNER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:17:27.786755  9841 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:27.763091  9817 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:27.768076  9818 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:27.805956  9843 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:27.846990  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:27.857824  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:27.864835  3125 raft_consensus.cc:2393] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 24: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:27.865792  3050 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:27.844607  9823 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:27.841706  9694 raft_consensus.cc:740] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:17:27.871919  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 89182.5us
I20260709 13:17:27.872188  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:27.844136  9256 raft_consensus.cc:740] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:27.870499  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:27.851418  9762 raft_consensus.cc:2764] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
W20260709 13:17:27.861871  9909 log.cc:927] Time spent T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:17:27.855072  9708 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:27.930326  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:27.931262  3124 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 15: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:27.849852  9458 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:17:27.932374  9910 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:27.934808  9910 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:27.937170  9910 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:27.845187  9871 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:27.938309  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:27.867460  9843 raft_consensus.cc:697] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:27.881613  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 3057) took 1021 ms. Trace:
W20260709 13:17:27.948156  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 153210us
W20260709 13:17:27.971791  3044 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.066s	user 0.002s	sys 0.043s
W20260709 13:17:27.972502  3044 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.066s	user 0.003s	sys 0.043s
I20260709 13:17:27.937371  9847 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:27.983572  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:27.884804  9823 raft_consensus.cc:697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:27.998956  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:27.999217  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:27.999585  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.986326  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:27.861032  9841 consensus_queue.cc:1059] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 13:17:27.984498  3194 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:28.006557  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:27.991271  9611 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.014508  3043 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:28.014425  3196 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
W20260709 13:17:28.022184  3195 consensus_meta.cc:287] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.000s
I20260709 13:17:28.023785  3195 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 24.
I20260709 13:17:28.022737  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.025808  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:28.031641  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:28.005883  9847 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:28.037508  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:28.038599  3195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:17:28.039132  3195 raft_consensus.cc:606] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:28.039443  3195 raft_consensus.cc:614] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:28.011669  9933 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.022840  9652 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:28.047657  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 262759us
I20260709 13:17:28.052407  3045 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 13.
I20260709 13:17:28.055809  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:28.055634  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 116954us
I20260709 13:17:28.022106  9694 consensus_queue.cc:260] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:28.060179  9694 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:28.066463  9920 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:17:28.068346  9930 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:28.068549  3192 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:28.071499  9836 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:28.073380  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:28.026237  9611 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:28.074647  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.075734  9611 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:28.076130  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.056758  9843 consensus_queue.cc:237] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:28.078286  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.079232  3124 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 20: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:28.077531  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:28.059303  9921 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:17:28.082700  3118 raft_consensus.cc:2393] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 22: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:28.083709  3195 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:17:28.087265  3797 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:28.090421  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:28.096798  9908 consensus_meta.cc:287] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.659s	user 0.007s	sys 0.004s
I20260709 13:17:28.097433  9908 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:17:28.100306  9908 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:28.101701  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:28.102643  3125 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:28.104357  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.106132  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.106948  3121 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:28.108268  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.109208  3121 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:28.110307  3761 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:28.111989  3761 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:28.113489  3761 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:28.114171  9749 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:28.116003  9749 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:28.116588  9749 raft_consensus.cc:697] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:28.118588  9823 consensus_queue.cc:237] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:28.113471  3124 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 23. Current term is 24. Ops: []
I20260709 13:17:28.122897  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.123984  3117 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 23: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:17:28.127624  9916 log.cc:927] Time spent T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
W20260709 13:17:28.129662  9923 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:17:28.131508  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.129859  3124 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:28.130746  3043 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:28.142927  3047 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:28.142978  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:28.153163  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:28.154415  3043 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 21: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:27.950450  3046 rpcz_store.cc:276] 0709 13:17:26.859991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.860106 (+   115us) service_pool.cc:224] Handling call
0709 13:17:26.872360 (+ 12254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.966713 (+ 94353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.966794 (+    81us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:27.136813 (+170019us) spinlock_profiling.cc:243] Waited 995 us on lock 0x7b2c0001afe8. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:17:27.137249 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:17:27.390073 (+252824us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:27.390112 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.390175 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.868920 (+478745us) raft_consensus.cc:1685] finished
0709 13:17:27.868951 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.881518 (+ 12567us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":258489,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":2288512,"thread_start_us":335973,"threads_started":2,"wal-append.queue_time_us":430629}
W20260709 13:17:28.163956  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 79556us
I20260709 13:17:28.165827  3042 raft_consensus.cc:2410] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:17:28.167181  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:28.171119  3799 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:17:28.171706  3799 pending_rounds.cc:85] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: Aborting all ops after (but not including) 15
I20260709 13:17:28.172000  3799 pending_rounds.cc:107] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:17:28.201107  3799 raft_consensus.cc:2889] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:28.201402  3051 consensus_meta.cc:287] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.000s
I20260709 13:17:28.202173  3051 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:17:28.050529  9935 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.143s
I20260709 13:17:28.205129  3048 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:28.204656  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:28.211611  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.182050  9925 raft_consensus.cc:3055] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:28.214231  3118 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:28.215778  3125 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:28.158104  9926 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.128s
W20260709 13:17:28.227195  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 202612us
I20260709 13:17:28.187554  9914 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:28.234486  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.056686  9256 consensus_queue.cc:260] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:28.208504  9817 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:28.241874  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.228085  3165 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:28.229240  9925 raft_consensus.cc:740] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:28.225826  9748 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.244637  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:28.048671  9933 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:28.231331  3164 connection.cc:256] RPC call timeout handler was delayed by -1.0614927999999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
I20260709 13:17:28.117693  9749 consensus_queue.cc:237] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:28.255820  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.213228  9897 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:17:28.231396  9652 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:28.266515  3118 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: []
W20260709 13:17:28.256467  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.268731  9256 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:28.249383  3165 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:28.256743  9748 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:28.272861  9748 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:28.257211  9934 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:28.273798  9934 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:28.274214  9934 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:28.275588  9939 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.276396  9924 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:28.276153  9939 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:28.276962  9924 raft_consensus.cc:697] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:28.277999  9924 consensus_queue.cc:237] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:28.280048  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:28.280674  3043 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:28.281608  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:28.238873  9818 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:28.204591  9937 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:17:28.283277  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:28.284251  3118 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 23: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:28.286902  3124 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:28.287425  3762 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:28.270824  9847 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:28.288460  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:28.290930  9933 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:28.258332  9908 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:28.295650  3195 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:28.299572  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:17:28.294225  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 86929.8us
W20260709 13:17:28.303004  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 189586us
I20260709 13:17:28.311247  3193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "f20672b2852447a6bc1e137c4dd40904"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:17:28.312088  3193 raft_consensus.cc:606] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Received request to transfer leadership to TS f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:28.312567  3193 raft_consensus.cc:614] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:28.316298  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:28.334312  9939 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:28.334646  9847 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:28.335341  9847 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.335527  3761 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:28.335855  9847 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:28.336566  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:28.338016  9928 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:17:28.339085  9932 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:17:28.339380  9847 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:28.338039  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:28.340829  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:28.341022  3797 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:28.341547  3196 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 23: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:28.344641  3120 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:17:28.295156  9871 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:28.347364  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:28.352546  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.351673  3048 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
W20260709 13:17:28.362485  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:28.363188  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.363798  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.315564  9914 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:28.375275  3118 raft_consensus.cc:3055] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:28.375703  3118 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:28.373697  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:17:28.386171  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 50728.8us
I20260709 13:17:28.387176  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:28.387344  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:28.372401  9914 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.366988  9928 raft_consensus.cc:697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:28.391314  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.398554  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.399344  3125 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 23: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:28.384619  9818 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:28.411648  3122 raft_consensus.cc:3055] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:28.412101  3122 raft_consensus.cc:740] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:28.384022  9947 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:28.396001  9914 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:28.397948  3118 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:28.398556  9933 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:28.426848  3125 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:28.410351  9652 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:28.412184  9818 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.431075  3119 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:28.428769  3123 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:28.432219  3118 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:28.303886  9925 consensus_queue.cc:260] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:28.438313  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.422773  3122 consensus_queue.cc:260] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:28.423741  9947 raft_consensus.cc:697] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:28.414525  9859 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:17:28.454080  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.454985  3125 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:28.455154  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.434976  9818 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:28.458465  3117 raft_consensus.cc:2393] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 20: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:28.460484  3122 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:17:28.464082  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 121953us
I20260709 13:17:28.462736  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.465144  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.450731  9820 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:28.474453  3125 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:28.450922  9817 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:28.482380  3117 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:17:28.461778  9925 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:28.490800  3122 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:17:28.494683  3118 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:17:28.496796  3125 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:28.495424  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.493916  9817 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:28.499348  9449 raft_consensus.cc:3055] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:28.499928  9449 raft_consensus.cc:740] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:28.511627  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:28.513258  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:28.516001  3122 raft_consensus.cc:2393] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 22: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:28.516076  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:28.514438  9652 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:28.460117  9928 consensus_queue.cc:237] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:28.510183  9944 log.cc:927] Time spent T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:17:28.521024  3050 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:28.521656  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:28.522469  3049 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:28.524173  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:28.526069  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3067) took 1165 ms. Trace:
I20260709 13:17:28.527395  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:28.528064  3050 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 23: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:28.528458  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:17:28.529793  9952 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:17:28.530046  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:28.534636  9823 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:28.535229  9823 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:28.526558  3200 rpcz_store.cc:276] 0709 13:17:27.357478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.358136 (+   658us) service_pool.cc:224] Handling call
0709 13:17:27.358402 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.619780 (+261378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.522713 (+902933us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b540013c4d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:28.522898 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":588716928}
W20260709 13:17:28.538125  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.540482  3796 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:17:28.517092  9449 consensus_queue.cc:260] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:28.545060  3045 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:28.547091  3091 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:28.632215  9876 raft_consensus.cc:3055] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:28.632836  9876 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:28.522645  9947 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:28.638041  9449 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:28.640026  9962 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:17:28.641924  9458 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:28.642333  9817 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:28.643499  9960 log.cc:927] Time spent T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:17:28.644052  9945 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.150s	user 0.001s	sys 0.001s
I20260709 13:17:28.645200  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 3058) took 1784 ms. Trace:
W20260709 13:17:28.645917  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 97308.4us
I20260709 13:17:28.645610  3044 rpcz_store.cc:276] 0709 13:17:26.860281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.860397 (+   116us) service_pool.cc:224] Handling call
0709 13:17:26.877160 (+ 16763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:27.973163 (+1096003us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.973216 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:28.023771 (+ 50555us) log.cc:844] Serialized 26 byte log entry
0709 13:17:28.225798 (+202027us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:28.357077 (+131279us) log.cc:844] Serialized 14 byte log entry
0709 13:17:28.357351 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.357425 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:28.644904 (+287479us) raft_consensus.cc:1685] finished
0709 13:17:28.644933 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.645103 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26733,"prepare.queue_time_us":202349,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":254863,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":6826,"thread_start_us":1336063,"threads_started":3,"wal-append.queue_time_us":242622}
I20260709 13:17:28.653484  3050 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:17:28.672055  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:28.684826  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:28.685812  3049 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:28.662039  9940 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.642356  9458 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:28.716588  9458 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:28.718729  9652 raft_consensus.cc:2764] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:17:28.667224  9611 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:28.720368  9955 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:17:28.720813  9611 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:28.722611  9961 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
W20260709 13:17:28.724107  9959 log.cc:927] Time spent T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:17:28.724577  9611 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:28.662640  9817 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.725684  9817 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:28.728403  9817 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:28.731030  9964 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:17:28.739205  3045 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
W20260709 13:17:28.743059  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 205748us
I20260709 13:17:28.744161  3091 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:28.747112  9958 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.225s	user 0.000s	sys 0.000s
I20260709 13:17:28.751127  9843 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:28.752295  9934 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:28.678607  9876 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:28.753526  3199 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:28.753656  9876 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:28.754683  9934 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:28.755856  9867 consensus_queue.cc:1175] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aaf88538197a49adb8bcf3790309a67e" responder_term: 21 status { last_received { term: 21 index: 15 } last_committed_idx: 15 last_received_current_leader { term: 21 index: 15 } }
I20260709 13:17:28.680673  9823 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:28.758519  3091 leader_election.cc:400] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 22. Current term is 23.
I20260709 13:17:28.758867  3091 leader_election.cc:403] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:28.760097  3091 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:28.761364  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 62514us
I20260709 13:17:28.746028  9963 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.774439  3165 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:28.780061  3044 raft_consensus.cc:1275] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:17:28.777792  9934 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.782038  9841 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:28.782871  9841 raft_consensus.cc:697] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:28.782644  9934 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:28.784230  9841 consensus_queue.cc:237] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:28.785076  9919 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.851s	user 0.008s	sys 0.011s
W20260709 13:17:28.799567  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:28.810956  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 139019us
I20260709 13:17:28.758061  9940 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:28.774968  9823 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 22. Current term is 23.
I20260709 13:17:28.813074  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:28.828519  9749 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.830243  3197 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:28.813867  3193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:17:28.831034  9749 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:28.831796  3193 raft_consensus.cc:606] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:28.773554  9256 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.833592  9749 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:28.833472  9256 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:28.827924  3194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 3074) took 1433 ms (client timeout 1877 ms). Trace:
I20260709 13:17:28.777621  9963 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:28.834498  3194 rpcz_store.cc:269] 0709 13:17:27.374831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.432721 (+ 57890us) service_pool.cc:224] Handling call
0709 13:17:28.807766 (+1375045us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b5400036e54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:28.807891 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370345344}
I20260709 13:17:28.836293  9256 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:28.836467  9924 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.837154  9924 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:28.841588  9934 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:28.848737  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.914472  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3404) took 1201 ms. Trace:
I20260709 13:17:28.921159  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:28.904450  3796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 912) took 1026 ms. Trace:
I20260709 13:17:28.806391  9843 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:28.927788  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:28.921921  9867 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.929177  9291 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:28.922454  3047 rpcz_store.cc:276] 0709 13:17:27.713269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.774122 (+ 60853us) service_pool.cc:224] Handling call
0709 13:17:27.774457 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.143543 (+369086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.914124 (+770581us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54000c6554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:28.914385 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":846802816}
I20260709 13:17:28.923583  3796 rpcz_store.cc:276] 0709 13:17:27.878477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.878637 (+   160us) service_pool.cc:224] Handling call
0709 13:17:28.904230 (+1025593us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b54005c0154. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:28.904355 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1346355584}
I20260709 13:17:28.931430  3761 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:28.933826  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:28.939677  3050 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
W20260709 13:17:28.940016  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.836308  9963 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:28.948297  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.935150  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:28.949990  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:28.950661  3044 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:17:28.950883  3194 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:28.950050  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:28.950117  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.951643  3048 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:28.944056  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:28.953302  3050 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:28.956321  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:28.960006  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:28.960826  3799 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:28.958743  9821 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.962414  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:28.963804  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:28.964581  3796 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 19: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:28.967367  3042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46028
I20260709 13:17:28.968005  3042 raft_consensus.cc:606] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Received request to transfer leadership
I20260709 13:17:28.968654  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:28.968683  3042 raft_consensus.cc:614] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:28.977833  3047 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:17:28.979229  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:28.947623  9256 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:28.976330  3762 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:17:28.983799  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.987178  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:28.990306  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:28.992287  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:28.992923  3198 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:28.981004  9846 consensus_queue.cc:1059] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 13:17:28.949353  9867 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:28.996954  9867 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:28.998296  9967 log.cc:927] Time spent T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:17:28.967401  9963 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:29.002691  9963 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.003208  9963 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:29.002847  3165 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:29.004503  9926 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:28.973425  9821 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.006673  9926 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:29.007270  9926 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:29.007802  9926 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:29.010514  9823 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:17:29.011571  9914 consensus_meta.cc:287] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.583s	user 0.012s	sys 0.000s
I20260709 13:17:29.012097  9914 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.007831  9821 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:29.013263  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.965994  9843 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:29.015735  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 255726us
I20260709 13:17:29.021090  3091 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:29.016628  3197 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:17:29.018448  3762 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:29.024704  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:29.029054  3047 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:29.030880  9934 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:17:29.014870  9256 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:29.035267  9914 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:29.036422  9256 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:29.019263  9820 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:28.957901  9291 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:29.038061  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 51095.1us
I20260709 13:17:29.030683  3762 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:29.027087  9931 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:29.026093  9867 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:29.052654  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:29.151444  3198 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:29.151822  3042 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:29.154856  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 115721us
I20260709 13:17:29.078981  9931 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.027954  9843 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:29.161901  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 223699us
I20260709 13:17:29.115028  9694 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:17:29.163952  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 132584us
I20260709 13:17:29.084811  9867 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:29.156724  9921 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.114s	user 0.000s	sys 0.009s
W20260709 13:17:29.176461  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 155469us
I20260709 13:17:29.177539  3091 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:29.168037  9931 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:29.169093  9694 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.170693  9867 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:29.194000  9846 raft_consensus.cc:3055] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:29.194659  9846 raft_consensus.cc:740] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:29.195794  9846 consensus_queue.cc:260] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.199172  9846 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:29.205065  9977 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:29.169186  9897 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 23.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:17:29.208562  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2908) took 1127 ms. Trace:
I20260709 13:17:29.209525  3121 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:29.191727  9694 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:29.217228  9924 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:29.174806  9256 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:17:29.222363  9256 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.222892  9256 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:29.225427  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:29.226192  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.208987  3120 rpcz_store.cc:276] 0709 13:17:28.072893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.073033 (+   140us) service_pool.cc:224] Handling call
0709 13:17:29.199686 (+1126653us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54003e7e54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:29.199802 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479379840}
W20260709 13:17:29.226583  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.168239  9458 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:29.229647  3042 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
W20260709 13:17:29.231585  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 55409.5us
W20260709 13:17:29.230345  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 56822.9us
I20260709 13:17:29.233315  3164 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:29.217510  9846 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:29.245472  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:29.228178  9291 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:29.253871  3042 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:17:29.255368  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 273412us
I20260709 13:17:29.257043  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:29.263950  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:29.264151  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:29.253674  9652 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:29.271780  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:29.273226  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:29.274178  3045 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:29.258665  9940 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:29.255002  9973 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:29.299010  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:29.301019  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 123600us
I20260709 13:17:29.299733  3047 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:29.264771  9291 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:17:29.265713  9979 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:29.302831  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 69620.2us
I20260709 13:17:29.330770  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:29.306941  9256 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:29.311267  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.297729  9841 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:29.328215  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 64141.2us
I20260709 13:17:29.331593  3047 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
W20260709 13:17:29.316812  9449 consensus_meta.cc:287] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.676s	user 0.012s	sys 0.006s
I20260709 13:17:29.338812  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:29.338984  3091 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:29.297346  9652 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:29.326313  9986 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.326275  9843 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:29.341290  9846 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:17:29.344651  9256 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:29.385896  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 47171.9us
I20260709 13:17:29.389182  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:29.384536  3762 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:29.380749  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:29.356596  9987 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:29.362532  9976 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:17:29.341873  9841 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:29.368801  9867 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:29.350907  9978 log.cc:927] Time spent T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:17:29.373548  9963 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.374883  9982 raft_consensus.cc:3055] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:17:29.374637  9926 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:29.377063  9924 raft_consensus.cc:3055] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:17:29.377684  9818 consensus_meta.cc:287] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.896s	user 0.006s	sys 0.003s
W20260709 13:17:29.380643  9953 log.cc:927] Time spent T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.158s	user 0.003s	sys 0.001s
I20260709 13:17:29.398202  3043 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:29.388111  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:29.410701  3046 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 17. (term mismatch)
I20260709 13:17:29.349888  9991 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:17:29.380738  9925 consensus_meta.cc:287] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.886s	user 0.004s	sys 0.008s
I20260709 13:17:29.404181  3047 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:29.411119  3046 pending_rounds.cc:85] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 16
I20260709 13:17:29.429971  3046 pending_rounds.cc:107] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 22.17
I20260709 13:17:29.430361  3046 raft_consensus.cc:2889] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:29.406141  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:29.420912  3165 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:29.433197  3165 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:17:29.434918  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 45821.3us
I20260709 13:17:29.437073  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:17:29.437439  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 98523.1us
I20260709 13:17:29.390722  9823 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:29.407320  9846 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:29.443732  3091 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:29.444207  3051 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:29.409277  9876 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:29.435417  9694 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.451653  9694 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:29.352627  9986 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:29.410022  9924 raft_consensus.cc:740] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:29.454531  9924 consensus_queue.cc:260] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:29.456007  9924 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:29.460192  9989 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:29.460675  9989 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.461046  9989 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:29.461684  9981 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:29.463151  9841 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:29.429301  9818 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.467402  3195 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:29.412755  9458 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:29.468849  9818 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:29.469587  9991 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:29.470177  9991 raft_consensus.cc:697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:29.471417  9963 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:29.471165  9991 consensus_queue.cc:237] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.397199  9843 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 13:17:29.441022  9897 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:29.474267  9897 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.474758  9897 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:29.475104  9926 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:29.477638  9925 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:29.397490  9256 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.478376  9984 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:29.407212  9982 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:29.483002  9982 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:29.484453  9982 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:29.448220  9846 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.486374  9846 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:29.486462  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3086) took 1198 ms. Trace:
I20260709 13:17:29.487036  3199 rpcz_store.cc:276] 0709 13:17:28.291481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.291630 (+   149us) service_pool.cc:224] Handling call
0709 13:17:28.291952 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.753959 (+462007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.486176 (+732217us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b540013bfd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:29.486405 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1061009280}
I20260709 13:17:29.490437  9652 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:29.492343  9458 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:29.492977  9458 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:29.498342  9876 raft_consensus.cc:697] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:29.499439  9876 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.509509  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:29.510362  3050 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:29.523231  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 117155us
I20260709 13:17:29.528837  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:29.531430  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:29.542925  3124 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:17:29.446214  3090 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:29.546028  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 249120us
I20260709 13:17:29.546319  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:29.547737  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:29.550910  3123 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:29.550895  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 104790us
I20260709 13:17:29.551120  3042 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:17:29.551787  3090 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:29.545683  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:29.554164  3048 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:29.552636  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:29.559032  3043 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:17:29.562991  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 119377us
I20260709 13:17:29.564003  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2933) took 1260 ms. Trace:
I20260709 13:17:29.564477  3121 rpcz_store.cc:276] 0709 13:17:28.295876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.304200 (+  8324us) service_pool.cc:224] Handling call
0709 13:17:29.199896 (+895696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.209882 (+  9986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.554878 (+344996us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b54003e7e50. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:29.556666 (+  1788us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1982254848}
I20260709 13:17:29.544754  9652 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:29.566591  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 126971us
I20260709 13:17:29.554121  9867 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:29.582883  3051 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:17:29.603902  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.561313  9986 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:29.606287  9874 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.613564  9458 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:29.622965  2997 auto_rebalancer.cc:893] Removing replace marker failed: Replica aaf88538197a49adb8bcf3790309a67e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
W20260709 13:17:29.638392  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.730618  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:29.641114  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 77368.3us
W20260709 13:17:29.739559  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:29.749794  2997 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:17:29.719496  9963 consensus_queue.cc:1059] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:17:29.739902  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:29.749249  3091 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:29.750352  2997 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:17:29.753667  9914 consensus_queue.cc:1059] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:17:29.754851  9935 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:17:29.740039  9874 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.541914  9933 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.029s
W20260709 13:17:29.680299  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 105558us
I20260709 13:17:29.556586  9843 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:29.680470  9992 consensus_queue.cc:1059] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:29.681067  9256 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:29.681901  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 108514us
I20260709 13:17:29.606343  9821 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:17:29.683771  3042 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:29.684954  3047 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:29.572907  9749 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:17:29.686398  9973 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:29.777661  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:29.778301  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:29.778709  9992 raft_consensus.cc:3055] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:29.778971  3791 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:29.779179  9992 raft_consensus.cc:740] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:29.719174  9928 consensus_queue.cc:1059] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 13:17:29.780159  9992 consensus_queue.cc:260] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:29.780978  9924 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:29.781581  9924 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.714466  9987 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:29.782315  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:29.809827  9987 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:17:29.810226  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.777787  9973 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:29.693338  9841 consensus_queue.cc:1048] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:29.693549  9291 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:29.718878  9694 consensus_queue.cc:1059] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.055s
I20260709 13:17:29.695456  9979 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:29.695633  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:29.685322  9931 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:29.703442  3076 heartbeater.cc:646] Failed to heartbeat to 127.1.227.190:44821 (5 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.1.227.190:44821 timed out after 15.000s (SENT)
I20260709 13:17:29.817555  3797 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 20: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:29.706564  9997 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:29.689215  9897 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:29.824630  3791 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:29.712903  9981 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:29.556857  9823 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:29.752434  3796 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:29.762282  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:29.714421  3123 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:29.714560  3050 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:29.765475  3091 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:29.770648  3048 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:29.772774  3165 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:29.774966  3762 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:29.688675  9925 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:29.557103  9449 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:17:29.781454  9992 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:29.818411  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 60073.6us
I20260709 13:17:29.814183  9982 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.830686  3120 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:29.815704  9984 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.728500  9989 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.734920  9846 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:29.835920  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 70517.1us
I20260709 13:17:29.811658  9652 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:29.836104  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 63385.2us
I20260709 13:17:29.827081  9914 raft_consensus.cc:3055] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:29.841917  3165 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:29.815645  9256 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:29.837882  3091 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:29.838086  3799 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:29.846086  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:29.852476  3165 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:29.835919  9926 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.861493  3119 raft_consensus.cc:2393] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 17: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:29.840183  9449 raft_consensus.cc:697] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 24 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:17:29.863308  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 88473.6us
I20260709 13:17:29.861940  3165 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:17:29.864215  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 102020us
I20260709 13:17:29.837700  9979 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:17:29.862744  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.841182  9998 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:29.866091  3091 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:29.874776  3091 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:29.863166  9611 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:29.847790  9820 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:29.838730  9982 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.836905  9993 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:29.870152  9940 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:29.871907  3120 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
W20260709 13:17:29.866802  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 292367us
I20260709 13:17:29.856563  9818 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:29.866119  9981 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:29.877995  3762 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:29.857280  9843 raft_consensus.cc:697] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:29.842151  9984 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.880942  9820 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.895037  9982 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:29.895885  9924 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:29.898255  9933 raft_consensus.cc:3055] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:29.898790  9652 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:29.878123  9991 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:29.903245  9449 consensus_queue.cc:237] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:29.906008  9963 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.947748  9963 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.920589  9981 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.949451  9981 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:29.950117  9963 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:29.907382  9989 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:29.908795  9759 raft_consensus.cc:3055] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:29.951011  9759 raft_consensus.cc:740] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:29.951933  9759 consensus_queue.cc:260] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.953414  9759 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:29.954334  9897 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:29.868754  9926 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.959187  9984 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:29.959503  9926 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:29.891703  9987 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:17:29.959882  9973 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:29.910898  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:17:29.960695  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 71223us
I20260709 13:17:29.961112  9846 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:29.912534  9931 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:29.888769  9867 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:17:29.962041  9874 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:29.922405  9940 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:29.879300  9934 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:29.963019  9934 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.963420  9934 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:29.933386  9928 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:29.964565  9928 raft_consensus.cc:697] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:29.859133  9256 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.965487  9928 consensus_queue.cc:237] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.967875  9256 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:29.968715  9652 raft_consensus.cc:2764] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:17:29.870141  9823 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:17:29.851348  9914 raft_consensus.cc:740] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:29.971217  9914 consensus_queue.cc:260] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.972782  9914 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:17:29.923296  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 45385.6us
I20260709 13:17:29.974915  3090 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:29.963233  9940 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.925937  9820 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:29.880059  9998 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:29.976765  3091 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:29.981863  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:29.982048  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:29.984320  3044 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:29.984890  3164 leader_election.cc:336] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 1.502s (SENT)
I20260709 13:17:29.985472  3164 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:29.980726  3090 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:29.982630  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:29.961726  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:30.032049  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 44495.9us
I20260709 13:17:30.033223  3091 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:29.988248  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 112865us
I20260709 13:17:29.941354  9933 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:30.037699  3043 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:17:29.983551  9874 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.044358  9291 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.046200  9291 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:30.047402  9998 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:30.048491  9291 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:29.999917  9947 raft_consensus.cc:3055] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:30.049007  9979 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:30.049224  9947 raft_consensus.cc:740] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:30.049628  9979 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:30.050266  9947 consensus_queue.cc:260] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:30.051805  9979 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:30.036369  9993 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:29.988724  9843 consensus_queue.cc:237] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:30.054015  9984 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:17:30.055007 10003 log.cc:927] Time spent T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:17:30.065387  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:30.066330  3043 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:29.993820  9823 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:30.051362  9947 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:30.000710 10004 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:17:30.079039  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 94193.8us
I20260709 13:17:30.086848  3091 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:30.105023  3091 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:30.087885  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 107226us
I20260709 13:17:30.107961  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:30.108747  3791 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 13: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:30.108913  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:30.109987  9997 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:30.110291  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:30.111176  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:30.111828  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:30.112632  3794 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
W20260709 13:17:30.089241  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 127585us
I20260709 13:17:30.114442  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:30.077389  9652 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:30.086126 10005 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 13:17:30.091693  9934 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:30.053505  9820 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:30.056281  9991 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:17:30.101078  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:30.086031  9987 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:30.132180  3049 raft_consensus.cc:3055] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:30.132645  3049 raft_consensus.cc:740] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:30.132929  3164 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:30.133759  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:30.119371  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:30.116552  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 228479us
I20260709 13:17:30.090173  9823 raft_consensus.cc:697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 21 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:30.138293  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:30.125226  3043 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:30.128935  3045 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:30.138923  3794 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:30.073529  9874 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:30.098498  9979 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:30.140388  3761 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:30.124511  9993 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:30.147075  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:30.124308 10001 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:17:30.120994  9981 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:30.162272  3046 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:30.166196  3119 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:30.192953  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:30.164177  9935 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:30.128811  9652 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:30.198511  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:30.144629  9926 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:30.137887  9611 raft_consensus.cc:697] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:17:30.200989  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 86621.8us
I20260709 13:17:30.210249  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:30.201727  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.211103  3120 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:30.202056  3797 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:17:30.204291  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:30.204312  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:30.214226  3796 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:30.197499  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:30.128616  9997 consensus_queue.cc:1059] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:17:30.194054  3049 consensus_queue.cc:260] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:30.219213  3049 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:30.209066  3051 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 18: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:30.196470  9987 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.175995  9963 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:30.206350 10001 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.161104  9876 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.064s
I20260709 13:17:30.136808  9256 consensus_queue.cc:1059] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:17:30.191844  9928 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.230139  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:30.210441  9926 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.137037  9933 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:30.202736  9982 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:17:30.242976  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:30.260499  3164 leader_election.cc:336] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 1.558s (SENT)
I20260709 13:17:30.266456  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:30.266633  3120 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:30.266716  3164 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:30.251499  9926 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:30.271780  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.273449  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.280652  3122 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 20: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:30.280920  3796 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:30.284775  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:30.289322  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 94962.6us
I20260709 13:17:30.291867  3044 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 14.
I20260709 13:17:30.291760  3761 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:30.296938  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:30.301252  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.302122  3123 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 23: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:30.305660  3121 raft_consensus.cc:2368] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17.
I20260709 13:17:30.312667  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:30.313872  3051 raft_consensus.cc:2393] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
W20260709 13:17:30.322167  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.319347  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.339918  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:30.341061  3044 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 20: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:30.342121  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.343146  3126 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:30.344671  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:30.282868  9993 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:30.231189  9823 consensus_queue.cc:237] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:30.239605 10001 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:30.351377  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.237957  9963 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:30.347036  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 86569.7us
I20260709 13:17:30.354295  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.358911  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:30.360076  9935 raft_consensus.cc:697] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:30.363272  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.366453  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.370149  3121 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:17:30.366653  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 144033us
W20260709 13:17:30.364925  3164 leader_election.cc:336] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 1.689s (SENT)
I20260709 13:17:30.372084  3164 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:30.371495  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:30.373558  3051 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:30.373569  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.365438  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:30.375622  3044 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:17:30.376148  9979 raft_consensus.cc:697] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:30.378000  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:30.379999  9979 consensus_queue.cc:237] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:30.381898  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:30.385236  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:30.387403  3044 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:30.233641  9987 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:30.364486  3117 raft_consensus.cc:2376] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14. Re-sending same reply.
I20260709 13:17:30.253729  9928 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:30.431030  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.430395  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:30.436123  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.438167  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.439044  3123 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:30.440678  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:30.361210 10023 raft_consensus.cc:3055] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:17:30.454887  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 110257us
I20260709 13:17:30.425876  9925 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:30.422175  9897 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:30.425434 10011 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:30.465198  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:17:30.472951  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.477442  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.356963 10004 consensus_queue.cc:1059] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.096s
I20260709 13:17:30.479408  3123 raft_consensus.cc:2376] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20. Re-sending same reply.
I20260709 13:17:30.475661  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.480168  3124 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:17:30.481208  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.455006 10023 raft_consensus.cc:740] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:30.460675 10020 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:17:30.483829 10023 consensus_queue.cc:260] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:30.487730 10016 log.cc:927] Time spent T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.206s	user 0.003s	sys 0.000s
I20260709 13:17:30.489056  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.489130  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:30.490473  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.490535  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:30.491255  3121 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:30.491991 10012 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 13:17:30.493605 10015 log.cc:927] Time spent T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:17:30.482406  3117 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
W20260709 13:17:30.494606 10022 log.cc:927] Time spent T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:17:30.495443  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:17:30.496470  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 125261us
I20260709 13:17:30.497241  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.498042  3120 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
W20260709 13:17:30.498257 10013 log.cc:927] Time spent T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:17:30.499033  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.500511  9874 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:30.500293  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:30.502254 10014 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:17:30.503471  9928 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:30.461335  9973 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:30.458794 10021 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.496712  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.506664 10021 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:30.507210  9963 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:30.509123 10021 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:30.458360  9934 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:30.509977  9652 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:30.511438  3051 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:30.511659 10001 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:30.512759  3051 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:17:30.513608  3120 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:30.513880 10025 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:17:30.515743  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 150859us
I20260709 13:17:30.516548  3121 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:30.517227  3164 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:30.497390  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:30.457827  9843 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:30.485514 10023 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:30.572007  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 47027.4us
I20260709 13:17:30.354146  9611 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:30.580322  3164 leader_election.cc:400] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17.
I20260709 13:17:30.586309  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.586874  3164 leader_election.cc:403] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:30.509177  9987 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:30.587877  3125 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:17:30.515376  9981 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:30.571345  9256 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:30.588707  9992 consensus_meta.cc:287] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.752s	user 0.012s	sys 0.000s
I20260709 13:17:30.526356 10025 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:30.597803  9914 consensus_meta.cc:287] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.625s	user 0.014s	sys 0.000s
I20260709 13:17:30.597592  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:30.581300  9652 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:30.589761  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.587718  9963 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.645390  3119 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
W20260709 13:17:30.647595  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 150294us
I20260709 13:17:30.650532  3049 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:17:30.652823  3015 leader_election.cc:400] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 14. Current term is 15.
I20260709 13:17:30.653231  3015 leader_election.cc:403] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:30.638288 10004 raft_consensus.cc:3055] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:17:30.655260  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.644652  9981 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:17:30.505410  9935 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:30.642866 10025 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:30.654747  9925 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:30.658362  9992 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 14. Current term is 15.
I20260709 13:17:30.675755  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:30.678241 10039 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:30.678753 10039 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.679138 10039 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:30.656829 10004 raft_consensus.cc:740] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:17:30.687717  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 90223.4us
W20260709 13:17:30.664491  9759 consensus_meta.cc:287] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.711s	user 0.010s	sys 0.001s
I20260709 13:17:30.652410  9963 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:30.573191 10011 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:30.726869  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:30.749485  3091 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:30.751261  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:30.719820  9843 raft_consensus.cc:697] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:17:30.761890  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.771090  3091 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:30.772693  3091 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:30.780395  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 127712us
I20260709 13:17:30.781461  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:30.741379  9897 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:30.745116 10035 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:30.748744 10001 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:30.779532 10046 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:30.835685 10052 raft_consensus.cc:2764] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:17:30.784667  9611 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:30.838937  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 57567.1us
I20260709 13:17:30.841346  3119 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:30.851723  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.852624  3119 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 24: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:30.833868  9652 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:30.784983  3164 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:30.864653  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:30.794919  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 119239us
W20260709 13:17:30.883980  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.884595  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.884902  3015 connection.cc:256] RPC call timeout handler was delayed by -3.3223706139999649s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
I20260709 13:17:30.880017  3761 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:30.892751  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:30.894068  3015 connection.cc:256] RPC call timeout handler was delayed by -3.1432706139999027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
W20260709 13:17:30.870188 10048 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:17:30.897781  9820 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:30.914175 10041 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:30.914723 10041 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.898707  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.784885 10020 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.115s
I20260709 13:17:30.896332  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:17:30.887676 10028 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:17:30.918377  3126 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 20: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:17:30.905448 10033 log.cc:927] Time spent T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 13:17:30.906275 10011 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:30.769718 10034 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.142s
I20260709 13:17:30.906625  9843 consensus_queue.cc:237] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:30.916653  3119 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:30.904215  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 119318us
I20260709 13:17:30.920166  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.787222 10021 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:30.898272  9897 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:30.915128 10041 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:30.927592  3015 connection.cc:256] RPC call timeout handler was delayed by -2.6550582410000061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
I20260709 13:17:30.933212  3125 raft_consensus.cc:2393] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 22: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:17:30.934239  3015 connection.cc:256] RPC call timeout handler was delayed by -2.6550582410000061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
W20260709 13:17:30.934688  3015 connection.cc:256] RPC call timeout handler was delayed by -2.1213582410000527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
W20260709 13:17:30.935034  3015 connection.cc:256] RPC call timeout handler was delayed by -2.0871582409999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21720000000000003s for a response
W20260709 13:17:30.935389  3015 connection.cc:256] RPC call timeout handler was delayed by -2.0205582409998897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
W20260709 13:17:30.935688  3015 connection.cc:256] RPC call timeout handler was delayed by -2.0205582409998897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
W20260709 13:17:30.935875  3015 connection.cc:256] RPC call timeout handler was delayed by -1.215958240999953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31400000000000006s for a response
I20260709 13:17:30.938447  3164 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:30.880780 10035 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:30.947402  9963 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:30.949124  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:30.928380  9973 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:30.950623 10011 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:17:30.953718 10029 log.cc:927] Time spent T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:17:30.783326 10004 consensus_queue.cc:260] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:30.890034 10001 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:30.967244  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.971693  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:30.972216  9973 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:30.975359  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:30.977861  3119 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
W20260709 13:17:31.007328 10006 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.778s	user 0.002s	sys 0.000s
I20260709 13:17:31.050788  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:31.051777  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:31.123534  3122 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
W20260709 13:17:31.049717 10044 log.cc:927] Time spent T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:17:30.958231  9979 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.578264  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:31.080871  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 105886us
I20260709 13:17:31.082991  9652 consensus_queue.cc:1059] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:31.084362  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:31.085208  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:31.126333  9979 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.131160  3193 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:31.132231  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:31.132802  3193 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:31.133041 10023 consensus_meta.cc:287] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.555s	user 0.000s	sys 0.011s
I20260709 13:17:31.086149  9818 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.089968  9897 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.090657  9820 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:31.091679  3195 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: [19.10-19.10]
W20260709 13:17:31.138183  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 213310us
I20260709 13:17:31.140532  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:31.141461  3796 raft_consensus.cc:2393] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 14: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:31.092023  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:31.092657  3200 raft_consensus.cc:1240] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:17:31.093146  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:31.094251  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:31.095307  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:31.095631  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:31.096002  9926 consensus_meta.cc:287] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.801s	user 0.010s	sys 0.003s
I20260709 13:17:31.097846  9981 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17.
I20260709 13:17:31.098623  9611 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:31.106673  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 131372us
I20260709 13:17:31.109263  3799 consensus_queue.cc:237] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.145628  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:31.150920  3200 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:31.151361  3164 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:31.111824 10035 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:31.113139  9947 consensus_meta.cc:287] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.989s	user 0.015s	sys 0.002s
I20260709 13:17:31.107291  9925 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:31.158217  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:31.116427  9973 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:31.105049 10025 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.134907  3118 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:31.135612  3124 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:17:31.143288  3194 raft_consensus.cc:2368] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 18. Current term is 19.
I20260709 13:17:31.139266  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:31.146755  3192 raft_consensus.cc:2393] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:31.161644  3191 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:31.149338  3193 raft_consensus.cc:2410] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:17:31.092481 10039 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.150000  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:31.123502 10011 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:31.124229  9997 raft_consensus.cc:3055] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:31.153399  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:31.173393  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:31.153770  9820 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.122972  9256 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:31.159541  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:31.177306  3796 raft_consensus.cc:2393] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 16: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:31.079353  9458 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:31.121481  2943 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49738 (request call id 152) took 14217 ms (client timeout 15000 ms). Trace:
I20260709 13:17:31.119592 10041 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.164791  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:31.168146  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:31.141494  9979 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:31.174822  3199 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:31.140662  9818 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:31.143647  9897 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:31.182701  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:31.186295  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:31.187609 10001 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:31.188359  9990 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:17:31.190143 10039 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:31.190258  9820 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:31.176380  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:31.191720  3797 raft_consensus.cc:2368] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 22. Current term is 23.
I20260709 13:17:31.191859  3792 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:31.197386  3200 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:31.198843  3198 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:31.154414  9926 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.206570  3791 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:31.203006  3164 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:31.205895  3796 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:17:31.172698  9997 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:31.208348  3194 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 19: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:31.191320  9925 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.210637  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:31.211505  3796 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:31.213094  3196 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 24.
I20260709 13:17:31.213168  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:31.214196  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:31.214612  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:31.214828  3200 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:31.216207  3200 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 23. Current term is 24. Ops: [22.12-23.13]
I20260709 13:17:31.217005  3194 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:31.209093  3164 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:31.223126  3164 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:31.227269  3197 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:31.204708 10011 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:31.311625  3194 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:31.312672  3200 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:31.313445  3195 raft_consensus.cc:2368] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17.
I20260709 13:17:31.194315  9458 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.210911 10046 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:31.436220  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.421191  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 259341us
I20260709 13:17:31.213383  9291 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:31.207206  9256 consensus_queue.cc:1059] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.156s
W20260709 13:17:31.454155  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 231092us
W20260709 13:17:31.457099  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.458158  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.456990  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:31.453840  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:31.460964  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:31.462206  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:31.433888  9820 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:31.439801  9981 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:31.435830 10034 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.433290 10039 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.471976  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:31.473069  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:31.477778  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:31.452808  9997 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.481626  9997 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:31.487447  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.490744 10041 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:31.491804  3197 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 22. Current term is 23. Ops: []
W20260709 13:17:31.496096 10064 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
W20260709 13:17:31.497917 10001 consensus_queue.cc:1175] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e9165fe61ab04bfb9a48889156d5c161" responder_term: 21 status { last_received { term: 17 index: 15 } last_committed_idx: 15 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: [20.16-20.16]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:17:31.498782 10063 log.cc:927] Time spent T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.323s	user 0.000s	sys 0.000s
I20260709 13:17:31.500396 10010 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.500963 10010 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:31.465555  9846 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:31.506132  9846 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.506597  9846 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:17:31.183399  2943 rpcz_store.cc:269] 0709 13:17:16.916728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.917070 (+   342us) service_pool.cc:224] Handling call
0709 13:17:31.121208 (+14204138us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:25.660580 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:25.707788 (+ 47208us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:25.710187 (+  2399us) write_op.cc:435] Acquired schema lock
0709 13:17:25.710860 (+   673us) tablet.cc:662] Decoding operations
0709 13:17:26.133844 (+422984us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:26.139898 (+  6054us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:26.141040 (+  1142us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:17:26.151247 (+ 10207us) tablet.cc:701] Row locks acquired
0709 13:17:26.151284 (+    37us) write_op.cc:260] PREPARE: finished
0709 13:17:26.151544 (+   260us) write_op.cc:270] Start()
0709 13:17:26.151743 (+   199us) write_op.cc:276] Timestamp: P: 1783603046151467 usec, L: 0
0709 13:17:26.151781 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:17:26.152791 (+  1010us) log.cc:844] Serialized 6151 byte log entry
0709 13:17:26.367362 (+214571us) op_driver.cc:464] REPLICATION: finished
0709 13:17:26.521108 (+153746us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54000d98d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b032a 00007ff830335f14 00007ff830335ec3 00007ff830335e38 00007ff830335df3 00007ff8303350dc 00007ff83035ee16 00007ff830346cbb 00007ff83033139d 00007ff830334d75
0709 13:17:26.681998 (+160890us) write_op.cc:301] APPLY: starting
0709 13:17:26.682142 (+   144us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:26.733502 (+ 51360us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:26.733547 (+    45us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:27.254304 (+520757us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:27.254674 (+   370us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 13:17:27.254736 (+    62us) write_op.cc:312] APPLY: finished
0709 13:17:27.255223 (+   487us) log.cc:844] Serialized 139 byte log entry
0709 13:17:27.255446 (+   223us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:27.255750 (+   304us) write_op.cc:454] Released schema lock
0709 13:17:27.255847 (+    97us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:27.256383 (+   536us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:27.256414 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3379262,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":286733,"apply.run_cpu_time_us":25290,"apply.run_wall_time_us":589065,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66857,"num_ops":15,"prepare.queue_time_us":20174,"prepare.run_cpu_time_us":11020,"prepare.run_wall_time_us":626754,"raft.queue_time_us":1228,"raft.run_cpu_time_us":25149,"raft.run_wall_time_us":343496,"replication_time_us":215204,"spinlock_wait_cycles":345267584,"thread_start_us":162487,"threads_started":4,"wal-append.queue_time_us":7277,"wal-append.run_cpu_time_us":4511,"wal-append.run_wall_time_us":2083883}]]}
W20260709 13:17:31.517750  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 44725.5us
I20260709 13:17:31.512357 10010 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:31.520767  3197 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:17:31.539130  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.540510  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:31.538822  3762 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:31.462014  9843 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:17:31.553251  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:31.541517 10005 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.559333 10005 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.563088  3197 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:17:31.467362  9652 consensus_queue.cc:1059] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:17:31.566272  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:31.568933  3051 raft_consensus.cc:2393] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:31.557425 10070 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:17:31.571494  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:31.572263  3045 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:31.573045  3049 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:17:31.574878  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:31.575479  3046 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:31.568732  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:31.577189  3197 raft_consensus.cc:2376] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20. Re-sending same reply.
I20260709 13:17:31.514998 10039 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.564469  9963 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:31.552452  9992 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:31.589636  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:31.584611  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:31.474957 10034 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:31.610515  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 155080us
I20260709 13:17:31.611053  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:31.611967  3049 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:17:31.616124  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:31.617311  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:31.618187  3799 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:17:31.619031  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:31.583081 10005 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:31.626374  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:31.629338  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:31.615125 10070 raft_consensus.cc:2764] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 13:17:31.623340  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:31.612412  9818 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:31.623308  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:31.615413  9963 raft_consensus.cc:697] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:31.636880  3799 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:31.634280  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:31.632351  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:31.638033  3124 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:31.635846  3049 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:17:31.644263  3118 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:17:31.618566  9987 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:31.621014  9897 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:31.647022  3798 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:17:31.644886  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:31.622623  3051 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:31.655560  3124 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:31.629288 10046 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.657047  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:31.667984  3121 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:31.669122  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:31.658054  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:31.672708  3121 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:31.673980  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:31.674844  3121 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:31.658090  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:31.626092  9843 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.613125  9992 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.661798  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:31.678390  3126 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:31.676899  3118 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 24.
I20260709 13:17:31.674233  3164 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:31.636605  9981 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:17:31.682402  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 129263us
I20260709 13:17:31.679903  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:31.716462  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 177724us
I20260709 13:17:31.676487  3045 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:31.647469  9820 raft_consensus.cc:2764] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:17:31.722235  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:31.722929  3795 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:31.723050  9256 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:31.723624  9256 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.724061  9256 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:31.725855 10005 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.726418 10005 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.726637  9993 consensus_queue.cc:1059] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:31.727628  9993 raft_consensus.cc:3055] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:17:31.728006  9993 raft_consensus.cc:740] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:31.728080  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 3105) took 1442 ms. Trace:
I20260709 13:17:31.728626 10005 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:31.728505  3044 rpcz_store.cc:276] 0709 13:17:30.285772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.389837 (+104065us) service_pool.cc:224] Handling call
0709 13:17:30.420865 (+ 31028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:31.727212 (+1306347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:31.727243 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:31.727282 (+    39us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:31.727320 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.727885 (+   565us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540028cb54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:31.727920 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:31.728025 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3003803008}
W20260709 13:17:31.704205 10057 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.799s	user 0.000s	sys 0.011s
I20260709 13:17:31.663230  9818 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:31.680137  9291 raft_consensus.cc:697] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:31.763415  3795 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:31.700284  9990 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:31.767513  9256 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:31.748077  9925 consensus_meta.cc:287] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.001s
I20260709 13:17:31.718966  9981 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:31.678541 10036 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.774523  3126 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:31.733338  9458 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:31.743753  3049 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:31.729198 10067 raft_consensus.cc:2764] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:17:31.681061  9897 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 13:17:31.761911  9820 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.759169  9992 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:31.700124  9991 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:31.786108  9256 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:31.786573  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:31.774019  9990 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.774036  9818 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:31.672266  9987 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.681670 10046 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.780474  9981 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:31.782020  9925 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:31.801560  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:31.700980  9843 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.728891  9993 consensus_queue.cc:260] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:31.808573  9458 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.817772  9458 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.821058  9458 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:31.797988  9818 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:31.822435 10078 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:17:31.824895 10078 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:31.751220  9963 consensus_queue.cc:237] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.826150  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:31.789613  9992 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:31.826812  3193 raft_consensus.cc:2376] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19. Re-sending same reply.
I20260709 13:17:31.796113  9990 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:31.815660  3194 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 13.
I20260709 13:17:31.828697  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:31.816133  3165 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:31.814698  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 72961.1us
I20260709 13:17:31.830753  3046 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:31.816382 10034 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:31.832944  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:31.835017  3199 raft_consensus.cc:2368] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19.
I20260709 13:17:31.835255  9256 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:17:31.835484  3164 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:31.836344  3164 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:31.836788  9652 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.838078  9652 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:31.840168  9652 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:31.840943  9846 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.843343  9846 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:31.843564 10072 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:31.844182 10072 raft_consensus.cc:697] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:31.844307  9846 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:31.845165  3122 raft_consensus.cc:2368] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 22. Current term is 23.
I20260709 13:17:31.785406 10036 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.814527 10039 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:31.845171 10072 consensus_queue.cc:237] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.846127  9993 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:31.846925  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:31.796178  9991 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.834213  9992 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.848037  9987 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:31.848590  3794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 1205) took 1623 ms. Trace:
I20260709 13:17:31.868546  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:31.829010  9291 consensus_queue.cc:237] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:31.838330  3165 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:31.788785  9820 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.850695  9256 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:17:31.872723  9256 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.871325  3165 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:31.873236  9256 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:31.874270  3165 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:31.852439  3126 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:31.855445  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:31.856114  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:31.857435  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 55531.7us
I20260709 13:17:31.866173 10036 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:31.838068  9897 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:31.840194 10046 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:31.876425  3121 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:31.849414  9843 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:31.895581  9256 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:31.880119  3165 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:31.894093  9897 raft_consensus.cc:697] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:31.899787  3165 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:31.868345  3794 rpcz_store.cc:276] 0709 13:17:30.225329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.225485 (+   156us) service_pool.cc:224] Handling call
0709 13:17:30.244285 (+ 18800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:30.444416 (+200131us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:17:30.593070 (+148654us) log.cc:844] Serialized 14 byte log entry
0709 13:17:30.737918 (+144848us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:30.738007 (+    89us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:30.738078 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.848339 (+1110261us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54005a19d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:31.848391 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:31.848511 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":812,"prepare.queue_time_us":55446,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":938,"spinlock_wait_cycles":481896064,"thread_start_us":256814,"threads_started":2,"wal-append.queue_time_us":195418,"wal-append.run_cpu_time_us":1177,"wal-append.run_wall_time_us":1013917}
I20260709 13:17:31.882536  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:31.886116  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:31.879688  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:31.891824  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.910403  3121 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:31.870158 10081 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.877939  9984 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:31.921484  9821 raft_consensus.cc:3055] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:31.922279  9821 raft_consensus.cc:740] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:31.923512  9821 consensus_queue.cc:260] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.924942  9821 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.925153  9991 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:31.881681 10073 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:31.927512 10025 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:31.928236 10073 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:31.885675  9925 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:31.933830  9256 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:31.937258  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:31.938180  3121 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:31.948238  3121 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 25.
I20260709 13:17:31.914541 10010 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:31.955786  3791 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:17:31.956521  3199 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:17:31.929827 10081 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:31.962713 10081 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:31.963351 10081 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.963864 10081 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:31.928043  9990 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:31.970130 10081 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:31.970786 10081 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:31.971341 10081 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:31.972755  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.977643  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:31.978682  3121 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:17:31.994513 10070 raft_consensus.cc:3055] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:31.995047 10070 raft_consensus.cc:740] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:31.996136  3196 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:31.995991 10070 consensus_queue.cc:260] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:31.999095  3196 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 13:17:32.003934  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:32.024246  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 124544us
I20260709 13:17:32.025758  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:32.026539  3042 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
I20260709 13:17:32.026610  3165 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:31.990056  9652 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:32.029690  3196 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:17:32.031208  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:32.032264  3042 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
W20260709 13:17:32.032871  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.025193  9820 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:31.997499 10070 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:32.032212  9984 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:32.043519  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:32.044842  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 165283us
I20260709 13:17:32.047072  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:32.035984  9846 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:32.048256  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.046087  9984 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.048588  9846 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:32.049291  9984 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:32.051891  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:32.000058  9897 consensus_queue.cc:237] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:32.058867  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:32.038334  9652 raft_consensus.cc:697] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:32.057811  3042 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:17:32.035385 10092 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:31.973685 10081 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:32.059753  3049 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:17:32.041193  9992 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:32.082332  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:32.084998  3044 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 13:17:32.067922  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.057457 10089 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:32.094218  3191 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:32.053267 10098 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:32.102236  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:32.103369  3049 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 23.
I20260709 13:17:32.107928  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2552) took 1011 ms. Trace:
I20260709 13:17:32.061447  3165 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:32.110637  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:32.108487  3195 rpcz_store.cc:276] 0709 13:17:31.096611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.139020 (+ 42409us) service_pool.cc:224] Handling call
0709 13:17:32.107598 (+968578us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400177354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:32.107773 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342827904}
I20260709 13:17:32.112254  3051 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:32.112984  3049 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:17:32.113868  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 52503.4us
I20260709 13:17:32.082655  9991 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:32.063696 10093 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:32.094074  9992 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:32.086551 10102 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:32.119144  3165 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:32.129151  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:32.129884  9256 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:32.130256  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:32.130496  3165 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:32.126752  3051 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:32.131954 10073 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:17:32.131589  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.086409 10085 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:17:32.116233 10010 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:32.141409  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:32.119716 10081 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.145015 10102 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:32.149941  9652 consensus_queue.cc:237] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:32.152773 10068 log.cc:927] Time spent T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.595s	user 0.000s	sys 0.005s
I20260709 13:17:32.165154  3044 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:32.167032  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:32.167894  3191 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:17:32.174510  9256 raft_consensus.cc:697] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:32.174490  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2974) took 1688 ms. Trace:
I20260709 13:17:32.098002 10092 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:32.127538  9991 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:32.175658  3120 rpcz_store.cc:276] 0709 13:17:30.486359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.514685 (+ 28326us) service_pool.cc:224] Handling call
0709 13:17:31.081392 (+566707us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:31.083425 (+  2033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:31.083458 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:31.845337 (+761879us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b2c00010988. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:17:31.845773 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:17:31.864388 (+ 18615us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:31.864446 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.864540 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:31.969349 (+104809us) raft_consensus.cc:1685] finished
0709 13:17:31.969374 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.174293 (+204919us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b5400319a50. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:32.174425 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1651,"raft.queue_time_us":2032,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":1192943232,"thread_start_us":18164,"threads_started":1,"wal-append.queue_time_us":72119}
I20260709 13:17:32.183928 10102 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:32.155767 10011 raft_consensus.cc:3055] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:32.157931  9846 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:32.176132  9256 consensus_queue.cc:237] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:32.184978  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:32.135875  9992 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:32.169893 10073 raft_consensus.cc:697] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:32.191547  3191 raft_consensus.cc:2368] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22.
I20260709 13:17:32.142915  9981 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:32.201877  3193 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:32.199172 10111 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.200237 10112 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:32.129550 10093 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:32.184571 10102 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:32.207682  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 76380.7us
I20260709 13:17:32.209437  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:32.225284  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:32.227993  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:32.230509  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:32.231120  3047 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:17:32.236130 10102 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:32.238638 10102 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:32.238756  9818 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:32.239250 10102 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:32.241075  9818 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:32.190164 10011 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:32.191407 10113 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.244653 10112 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:32.246905  9981 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:32.247321  9991 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:32.242615 10092 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:32.295231  3191 raft_consensus.cc:1275] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:32.168726 10081 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:32.296428  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 68535us
W20260709 13:17:32.299481  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 158918us
W20260709 13:17:32.377538  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.381706  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:32.385039  3015 leader_election.cc:400] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 18. Current term is 19.
I20260709 13:17:32.385435  3015 leader_election.cc:403] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:17:32.388087  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:32.390584  3050 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:17:32.390776  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:32.391902  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:32.373327  3047 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 25.
I20260709 13:17:32.376955  9997 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:32.314502 10102 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:32.412081  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:32.413236  3047 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 22
W20260709 13:17:32.413810  9993 consensus_meta.cc:287] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.542s	user 0.011s	sys 0.001s
I20260709 13:17:32.414491  9993 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 18. Current term is 19.
I20260709 13:17:32.415227  9993 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:32.416044 10116 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.215245 10089 consensus_queue.cc:1059] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.182s
I20260709 13:17:32.401235 10073 consensus_queue.cc:237] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:32.388521  9991 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:32.434666  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.209077 10111 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:32.432927  3047 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:17:32.450918 10093 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:32.452488  9992 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:32.453527  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.459048 10112 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:32.460362 10078 raft_consensus.cc:3055] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:32.460892 10078 raft_consensus.cc:740] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:32.461804 10078 consensus_queue.cc:260] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:32.464931 10081 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:32.467201  9990 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:32.412367 10122 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:32.437606  9991 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:32.475078  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.476257  9991 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:32.406136  9986 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:17:32.376487 10113 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:32.482908  3047 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:17:32.483985 10113 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:32.412238 10109 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.486465 10109 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:32.488991 10109 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:32.429236  9979 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:17:32.424072 10011 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:32.498915 10011 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:32.440430 10106 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.232s	user 0.000s	sys 0.000s
I20260709 13:17:32.426705 10116 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:32.520177 10116 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:32.522111  9933 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:32.439239 10102 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:32.524930 10102 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:32.507174 10111 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:32.509747  3047 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 13. (term mismatch)
I20260709 13:17:32.527428  3047 pending_rounds.cc:85] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 12
I20260709 13:17:32.527786  3047 pending_rounds.cc:107] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 23.13
I20260709 13:17:32.528079  3047 raft_consensus.cc:2889] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:32.511780  9926 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:32.515749 10094 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:32.515898  9928 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:17:32.403781  9846 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 13:17:32.530849  3762 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:32.497159  9984 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:32.553278  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:32.553534  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:32.554235  3124 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 21: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:32.554987  3121 raft_consensus.cc:1240] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:32.555397  3762 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:32.556543  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:32.556602  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:32.554168  3120 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:32.558480  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:32.549175 10008 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:32.580257  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:32.580538  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 189863us
I20260709 13:17:32.535907 10078 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:32.558293  3124 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:32.588657  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:32.559084  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:32.590742  3120 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:32.594355  3121 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:32.594954  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:32.592669  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:32.587502  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 188401us
I20260709 13:17:32.559194  9991 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.596966  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:32.559724  9997 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.588135  9940 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:32.585963  9926 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:32.606446  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:32.605516  3118 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:32.608361  9997 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:32.605616  3120 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:32.610832  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:32.619626  3124 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:32.623057  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:32.623906  3118 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:32.625082  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:32.629453  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:32.644264  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3095) took 1070 ms. Trace:
I20260709 13:17:32.644729  3199 rpcz_store.cc:276] 0709 13:17:31.573874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.885077 (+311203us) service_pool.cc:224] Handling call
0709 13:17:31.909534 (+ 24457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:31.956985 (+ 47451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.644015 (+687030us) spinlock_profiling.cc:243] Waited 42.9 ms on lock 0x7b5400035054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:32.644203 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98558720}
W20260709 13:17:32.606422 10069 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 1.069s	user 0.000s	sys 0.012s
I20260709 13:17:32.583530 10092 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:17:32.651222  3124 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 23.
I20260709 13:17:32.629963  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:32.604007 10102 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:17:32.614084 10070 consensus_meta.cc:287] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.568s	user 0.006s	sys 0.005s
I20260709 13:17:32.660445  3043 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:32.663682  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:32.664469 10126 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:32.665071 10126 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:32.665246  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:32.591497 10005 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:17:32.673449  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:32.654481  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:32.612109 10109 consensus_queue.cc:1059] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:17:32.654481 10102 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:32.646572  9926 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:32.646896  9940 raft_consensus.cc:697] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:32.665531 10126 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:32.651290  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:32.690317  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:32.668634 10073 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.668612  3165 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:32.617236  9997 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:32.612419 10111 raft_consensus.cc:2764] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:17:32.669672 10122 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:17:32.954165  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.741847 10126 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:32.894354  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.676435  3043 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:32.971422 10011 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:17:32.788964  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:32.790431  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1281) took 1871 ms. Trace:
I20260709 13:17:32.686550  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:32.686510  3761 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 2.523s (SENT) [suppressed 26 similar messages]
I20260709 13:17:32.972586 10011 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 25 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:32.787624  3050 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:17:32.642187 10112 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:17:32.973532  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 287034us
I20260709 13:17:32.607993  9991 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:32.974586  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:32.974836  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:32.975744  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:32.976082 10098 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:32.720980 10008 raft_consensus.cc:697] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 23 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:32.974237 10011 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:32.972997  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:32.977339 10121 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:32.976231  9991 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:32.743285  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:32.769869  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:32.978253  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:32.742282  9973 raft_consensus.cc:3055] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:32.979019  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:32.785882  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:32.735168 10040 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.749646  9940 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:32.827018  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3110) took 1209 ms. Trace:
I20260709 13:17:32.973963 10112 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:32.849668 10097 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.733s	user 0.000s	sys 0.012s
I20260709 13:17:32.988467 10112 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:32.976011  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:32.967950 10073 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:32.991669 10073 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:32.992340 10111 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:32.992861 10111 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:32.993325 10111 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:32.674415 10125 log.cc:927] Time spent T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:17:32.779573 10107 log.cc:927] Time spent T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.540s	user 0.000s	sys 0.001s
I20260709 13:17:32.977905 10121 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:32.994833 10121 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:32.995028  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2996) took 1139 ms. Trace:
I20260709 13:17:32.972615  3123 rpcz_store.cc:276] 0709 13:17:30.919360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.134106 (+214746us) service_pool.cc:224] Handling call
0709 13:17:31.134409 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:31.470589 (+336180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:31.470630 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:31.470669 (+    39us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:31.470702 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.789987 (+1319285us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54002585d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:32.790054 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.790219 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":772620160}
I20260709 13:17:32.995576  3126 rpcz_store.cc:276] 0709 13:17:31.855245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.903280 (+ 48035us) service_pool.cc:224] Handling call
0709 13:17:31.930066 (+ 26786us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:31.930509 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:31.930552 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:31.934405 (+  3853us) log.cc:844] Serialized 26 byte log entry
0709 13:17:32.095052 (+160647us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:32.095095 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.095160 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:32.778949 (+683789us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:32.994615 (+215666us) raft_consensus.cc:1685] finished
0709 13:17:32.994644 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.994957 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2415,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":16140,"spinlock_wait_cycles":27350400,"thread_start_us":118106,"threads_started":1,"wal-append.queue_time_us":216303}
I20260709 13:17:32.997380  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:32.998275  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:32.999060  3126 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:32.976938 10098 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:33.002000 10098 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:32.979384  3043 raft_consensus.cc:2410] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:17:32.714855  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:33.005970  3046 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 20: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:33.006553  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:32.763947  9984 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:32.809106 10120 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.572s	user 0.002s	sys 0.000s
I20260709 13:17:33.008531 10078 consensus_queue.cc:1059] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:32.688621 10070 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:32.792805  3049 raft_consensus.cc:1240] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:17:32.749367  9926 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:32.695909  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 98054.9us
I20260709 13:17:32.841698  3200 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:32.762377  3792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 822) took 1621 ms. Trace:
I20260709 13:17:32.824112  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:33.019827  3124 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:32.842013 10001 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.840974  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34728 (request call id 1091) took 1369 ms. Trace:
I20260709 13:17:33.021780  3194 rpcz_store.cc:276] 0709 13:17:31.471536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.471784 (+   248us) service_pool.cc:224] Handling call
0709 13:17:32.840694 (+1368910us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54001b85d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:32.840889 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":785366912}
I20260709 13:17:33.023319  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.025465  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:32.982743 10126 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:32.784385  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:32.857090  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.055552  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.056726  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:32.866750 10004 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:32.983387 10040 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:32.875166  9979 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:32.724504 10084 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.741s	user 0.007s	sys 0.002s
I20260709 13:17:32.695748  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2973) took 2209 ms. Trace:
I20260709 13:17:32.936671 10100 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.838899  9449 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:32.835505  3791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 1207) took 1218 ms. Trace:
I20260709 13:17:32.696640  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:32.972697  3119 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:32.791333  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:33.090921  3791 rpcz_store.cc:276] 0709 13:17:31.616593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.617105 (+   512us) service_pool.cc:224] Handling call
0709 13:17:31.617435 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:31.956385 (+338950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.835111 (+878726us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b540060c2d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:32.835413 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":777008256}
I20260709 13:17:33.053970  9997 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.096315  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:33.096516  3790 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:17:32.786350  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:32.750064  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 3098) took 1175 ms. Trace:
I20260709 13:17:33.096940  3120 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:32.977594 10008 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:32.860672  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.872365  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 3112) took 1137 ms. Trace:
I20260709 13:17:32.979918  3042 raft_consensus.cc:2393] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 23: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
W20260709 13:17:32.851631 10108 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.611s	user 0.000s	sys 0.003s
I20260709 13:17:32.746565  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 2986) took 1111 ms. Trace:
I20260709 13:17:32.987341  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:32.987594  3050 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
W20260709 13:17:32.987773  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 319229us
I20260709 13:17:33.107429  3051 raft_consensus.cc:2410] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:17:33.107873  3165 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:17:32.753568  3198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2555) took 1656 ms (client timeout 2057 ms). Trace:
I20260709 13:17:32.831887  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:32.685698  3199 raft_consensus.cc:2393] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:33.016219  3126 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:17:33.109066  3121 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
W20260709 13:17:32.848364 10083 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.866s	user 0.007s	sys 0.000s
I20260709 13:17:33.106910  3122 rpcz_store.cc:276] 0709 13:17:31.634642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.634741 (+    99us) service_pool.cc:224] Handling call
0709 13:17:32.746373 (+1111632us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b540010d954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:32.746505 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":402249984}
I20260709 13:17:33.010068 10070 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:32.895777  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:33.108855  3198 rpcz_store.cc:269] 0709 13:17:31.097588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.156341 (+ 58753us) service_pool.cc:224] Handling call
0709 13:17:32.753305 (+1596964us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b54003bb854. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:32.753484 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40707968}
I20260709 13:17:33.113981  3192 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:32.859069  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:33.026139  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.026724  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.018733  3792 rpcz_store.cc:276] 0709 13:17:31.141017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.141233 (+   216us) service_pool.cc:224] Handling call
0709 13:17:31.155822 (+ 14589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:31.208788 (+ 52966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.762010 (+1553222us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b54006ea0d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:32.762285 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82457344}
I20260709 13:17:33.028301  3794 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:17:33.034459  9843 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:33.035020  9991 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.035763  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3100) took 1460 ms. Trace:
I20260709 13:17:33.126785  3200 rpcz_store.cc:276] 0709 13:17:31.575195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.913333 (+338138us) service_pool.cc:224] Handling call
0709 13:17:32.841200 (+927867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.018336 (+177136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.035508 (+ 17172us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b54001b85d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:33.035694 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2132810112}
W20260709 13:17:33.128134  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 232464us
I20260709 13:17:33.126137  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:32.956370  3091 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:33.130582  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 174366us
I20260709 13:17:33.131304  3091 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:32.979152  9973 raft_consensus.cc:740] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:33.132014  9256 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:33.131286  3050 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:33.134353  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:33.081799 10126 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:33.083696  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.089151  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:32.870993  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:33.094360  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 103026us
W20260709 13:17:33.073648  9897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.000s	sys 0.015s
I20260709 13:17:33.054229 10109 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.140655  3195 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:33.149816  3091 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:33.101914  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.079628  3117 rpcz_store.cc:276] 0709 13:17:30.486089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.507687 (+ 21598us) service_pool.cc:224] Handling call
0709 13:17:32.387536 (+1879849us) spinlock_profiling.cc:243] Waited 6.84 ms on lock 0x7b5800003398. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff83538cfc0 00007ff835377929 00007ff8353773d2 00007ff82e8eebd4
0709 13:17:32.387969 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:32.402013 (+ 14044us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.402075 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:32.436991 (+ 34916us) log.cc:844] Serialized 26 byte log entry
0709 13:17:32.693993 (+257002us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:32.694038 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.694110 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:32.695387 (+  1277us) raft_consensus.cc:1685] finished
0709 13:17:32.695414 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.695661 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2972,"raft.queue_time_us":3368,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":9927,"spinlock_wait_cycles":15726976,"thread_start_us":99658,"threads_started":1,"wal-append.queue_time_us":136739}
I20260709 13:17:33.097173  3197 rpcz_store.cc:276] 0709 13:17:31.574701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.615887 (+ 41186us) service_pool.cc:224] Handling call
0709 13:17:32.749709 (+1133822us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b5400177d54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:32.749955 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1348993408}
I20260709 13:17:33.035610 10054 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:17:33.098111  3193 rpcz_store.cc:276] 0709 13:17:31.735125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.833075 (+ 97950us) service_pool.cc:224] Handling call
0709 13:17:32.872161 (+1039086us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54002bbbd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:32.872293 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":747951872}
I20260709 13:17:33.076671  9652 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:32.687186 10102 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:33.010226  3196 rpcz_store.cc:276] 0709 13:17:31.618032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.037384 (+419352us) service_pool.cc:224] Handling call
0709 13:17:32.753865 (+716481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.754147 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.754189 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:32.754250 (+    61us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:32.754300 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.754381 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.826802 (+ 72421us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b54003bb850. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:32.826933 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633046784}
I20260709 13:17:33.120558  3797 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
W20260709 13:17:33.111579 10137 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:17:33.089150  9979 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:33.122205  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.039652 10001 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:33.126113  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:33.209226  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:33.139356  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.139439  3122 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:33.142793  3120 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:33.138221  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:33.108352  9997 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:33.182266  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:33.121421 10070 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:33.093156 10100 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:33.189606  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:33.221154  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:33.121793  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:33.198076  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.198307  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 2983) took 1567 ms. Trace:
I20260709 13:17:33.222774  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:33.223498  3120 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
W20260709 13:17:33.143813  9897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.000s	sys 0.015s
I20260709 13:17:33.203599  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.206658  3091 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:33.206794  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.224341  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:33.221611  3121 raft_consensus.cc:2368] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 22. Current term is 23.
I20260709 13:17:33.225986  3121 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:33.138758 10023 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:33.226145  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:33.205771 10052 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:33.232241  3192 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:33.131202  9984 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.233292  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.233237  9984 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:33.234356  3192 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
W20260709 13:17:33.235597  2946 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57732 (request call id 230) took 111681 ms (client timeout 15000 ms). Trace:
W20260709 13:17:33.236025  2946 rpcz_store.cc:269] 0709 13:15:41.536032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.536349 (+   317us) service_pool.cc:224] Handling call
0709 13:17:33.205161 (+111668812us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1309502,"reported_tablets":51}
I20260709 13:17:33.235800  2942 catalog_manager.cc:5697] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 8 to 16, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 16 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:33.237198  3119 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:17:33.238016  2942 catalog_manager.cc:5697] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 16 to 18, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 18 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:33.239413  3119 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:33.239903  2942 catalog_manager.cc:5697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 17 to 18, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 18 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:33.235961  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.151026 10126 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:33.095897  9449 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:33.220690  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:33.250870  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.222128  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.224210  3195 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
I20260709 13:17:33.143404 10073 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:33.227356  3126 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
W20260709 13:17:33.046371  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 359841us
I20260709 13:17:33.185140 10109 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:33.222563  3125 rpcz_store.cc:276] 0709 13:17:31.631328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.632288 (+   960us) service_pool.cc:224] Handling call
0709 13:17:31.632602 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:31.632939 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:31.632963 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:31.637087 (+  4124us) log.cc:844] Serialized 26 byte log entry
0709 13:17:31.802565 (+165478us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:32.106521 (+303956us) log.cc:844] Serialized 14 byte log entry
0709 13:17:32.106934 (+   413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.107040 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:32.723907 (+616867us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:33.187330 (+463423us) raft_consensus.cc:1685] finished
0709 13:17:33.198089 (+ 10759us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.198245 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":338442,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":59,"raft.queue_time_us":7283,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":8023,"spinlock_wait_cycles":3538816,"thread_start_us":390965,"threads_started":2,"wal-append.queue_time_us":288173}
I20260709 13:17:33.151937  3044 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:33.231101  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:33.243896  3198 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:33.218161  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.258178  3124 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:33.258502  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.259213  3200 raft_consensus.cc:1813] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Handling vote request from an unknown peer f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:33.259866  3200 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 15: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:33.260408  9984 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:33.261094  9984 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:33.261466  9984 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.261853  9984 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:33.231774 10122 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:33.246563  3191 raft_consensus.cc:1240] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:33.222661 10132 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:17:33.249434  3194 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 22: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:33.252637  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.231684 10052 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:33.245136  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:33.254971  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.205533  9823 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:33.251595  3199 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:33.258620  3197 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:33.138273  9991 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:33.241358  2942 catalog_manager.cc:5697] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 13 to 14, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 14 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:33.282986  3198 raft_consensus.cc:1240] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:33.283730  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3114) took 1484 ms. Trace:
I20260709 13:17:33.284139  3198 rpcz_store.cc:276] 0709 13:17:31.799820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.268298 (+1468478us) service_pool.cc:224] Handling call
0709 13:17:33.282832 (+ 14534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.283436 (+   604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.283665 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.267324 10126 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:33.267817  9997 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:33.218870  9846 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:17:33.231060 10078 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:33.253387  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.294862  3196 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:33.273900  3123 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:33.272428  3195 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
W20260709 13:17:33.275461  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 143855us
I20260709 13:17:33.306650  3124 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:33.272565 10073 raft_consensus.cc:697] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 22 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:33.301337  2942 catalog_manager.cc:5697] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 13 to 15, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 15 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:33.318096  9256 raft_consensus.cc:697] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:33.320107  9759 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:33.358515  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:33.324151 10040 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:33.280117 10052 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:33.351687  3044 raft_consensus.cc:1275] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:33.353303  3119 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:17:33.384562  3119 pending_rounds.cc:85] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 15
I20260709 13:17:33.384856  3119 pending_rounds.cc:107] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:17:33.385082  3119 raft_consensus.cc:2889] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:33.226893  9973 consensus_queue.cc:260] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:33.264127 10121 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:33.367725  3199 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:17:33.317901 10126 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:33.280251 10054 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:17:33.314262 10140 log.cc:927] Time spent T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:17:33.435796  3118 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:33.436386  9986 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.436857  9986 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:33.439447 10109 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:33.441530 10100 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:33.387176  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3113) took 1606 ms. Trace:
I20260709 13:17:33.442440  3191 rpcz_store.cc:276] 0709 13:17:31.780739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.392518 (+611779us) service_pool.cc:224] Handling call
0709 13:17:32.409576 (+ 17058us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.268963 (+859387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.373988 (+105025us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b54002e25a0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83032adc0 00007ff8303b6a02 00007ff8303b2dd6 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:17:33.386932 (+ 12944us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b540013a6d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:33.387119 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1934129280}
W20260709 13:17:33.368765  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 142723us
I20260709 13:17:33.445096  3015 leader_election.cc:400] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22.
I20260709 13:17:33.445389  3015 leader_election.cc:403] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:33.393607 10040 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:33.390285  9256 consensus_queue.cc:237] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:33.373075  9823 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:33.399714 10001 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:33.400604 10121 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:33.403851 10112 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:33.313086 10037 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.077s
I20260709 13:17:33.396924 10071 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.422008  9897 consensus_queue.cc:1059] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:33.425009  9449 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:33.426654  9991 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:33.469960 10040 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.433825  9973 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:33.450642 10122 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22.
W20260709 13:17:33.492479  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 151730us
W20260709 13:17:33.454309  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.372448 10078 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:33.462875  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 324867us
I20260709 13:17:33.394569 10126 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:33.476348 10054 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:33.432152  3043 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:33.446396  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:33.488962  2942 catalog_manager.cc:5697] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 5 to 14, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 14 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:17:33.502432  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 144029us
I20260709 13:17:33.507659  3761 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:33.504067  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 293430us
I20260709 13:17:33.509430  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:33.512034  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:17:33.513854  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.515051  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 308445us
I20260709 13:17:33.516311  3091 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:33.494359 10040 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:33.518347  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 72020.9us
I20260709 13:17:33.531971  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:33.519899  2942 catalog_manager.cc:5697] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 11 to 15, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 15 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:33.479696 10111 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:33.534731 10111 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:33.535379  3049 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: []
W20260709 13:17:33.531287  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.535198  2942 catalog_manager.cc:5697] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 16 to 20, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 20 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:33.532078  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:33.536288  3090 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:33.536401 10121 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:33.536487  3043 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:33.536912 10121 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:33.537444 10121 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:33.512950  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:33.543727  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:33.475749  9823 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:33.502055 10126 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:33.552691  3091 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:33.557951  3091 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:33.558043  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:33.548249  3090 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:33.554654  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:33.546819  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:33.560048  3761 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:33.562263  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:33.559091  3091 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:33.492781 10071 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:33.544724 10152 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:33.569234 10071 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:33.556083 10001 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:33.571012  3118 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:33.555365  9867 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:33.551311  9991 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:33.575179  3090 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:33.564035  9759 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:33.562950 10004 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:33.561476  9846 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:33.543524  2942 catalog_manager.cc:5697] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 13 to 15, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 15 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:33.493587 10073 consensus_queue.cc:237] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:33.562536 10109 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:33.545629  9946 consensus_queue.cc:1059] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 13:17:33.564248 10153 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.509166 10054 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:33.556164  9843 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:17:33.553476  9984 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:33.561004 10132 consensus_queue.cc:1059] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:17:33.594820  3043 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:17:33.570633 10154 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:33.582726 10071 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:33.582844 10094 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:33.584852  9867 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.607762  3200 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 21. Ops: []
I20260709 13:17:33.625717  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:33.600944 10122 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:33.588989  9759 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.647699  9759 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:33.610351  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.612425  3126 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:17:33.650319 10112 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:33.651074 10112 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:33.589689 10004 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.651832 10004 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:33.651633 10112 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:33.585491  9997 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:33.625165  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:33.593560  9991 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:33.606398 10098 consensus_meta.cc:287] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.004s
I20260709 13:17:33.606691 10159 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:33.663902  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:33.668705  3126 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:33.659597  3123 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:33.670300  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:33.687991  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 103896us
I20260709 13:17:33.609853  3043 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:33.592257 10161 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:33.593359 10166 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:17:33.641827 10152 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:33.643296  9823 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:33.606803 10158 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:33.603053 10109 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:33.643909 10094 raft_consensus.cc:697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:33.644734  3050 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:17:33.644603  2942 catalog_manager.cc:5697] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:33.645991  9984 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:33.596752  9979 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:33.638517  9867 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:33.693671  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 102328us
I20260709 13:17:33.694991  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.763232  3090 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:33.763391  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.659538 10071 raft_consensus.cc:697] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:33.697424  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:33.775208  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.776681  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.699054  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:33.778092  3195 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:33.691040  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 135255us
I20260709 13:17:33.666653 10154 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:33.671859 10132 raft_consensus.cc:3055] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:17:33.703816  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 143832us
I20260709 13:17:33.610038 10153 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:33.712270 10052 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:33.715595  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.716581  3191 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:33.717123  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:33.718863  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.747241  3123 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:33.640183 10111 consensus_queue.cc:1059] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
W20260709 13:17:33.748311  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 78125.1us
I20260709 13:17:33.694188 10112 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:33.758584  2942 catalog_manager.cc:5697] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:33.867087  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 68838.2us
I20260709 13:17:33.871078  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:33.796437  9979 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:33.767872  9256 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:33.770833  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:33.777403  3192 raft_consensus.cc:2376] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19. Re-sending same reply.
I20260709 13:17:33.796334 10132 raft_consensus.cc:740] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:33.793326  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.741806 10163 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.697322 10023 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:17:33.689764 10098 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:33.690758 10159 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:33.741554 10152 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:33.874500  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:33.883111  3196 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:33.759179 10158 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:33.897433  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:33.897615  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:33.886018  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.899632  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:33.887270  9256 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:33.891347  3195 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:33.886026  2942 catalog_manager.cc:5697] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 15 to 18, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 18 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:33.897909  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:33.883468  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 112716us
I20260709 13:17:33.858189 10157 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:33.834229 10070 consensus_meta.cc:287] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.605s	user 0.012s	sys 0.000s
I20260709 13:17:33.851394  9946 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:17:33.911353  3090 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:33.918890  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.924592  3192 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:33.904747  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.927277  3051 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:33.930068  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.930320  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:33.927930  2942 catalog_manager.cc:5697] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 15 to 17, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 17 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:33.927995  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.931504  3090 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:33.891593  9991 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:33.936918  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:33.937845  3192 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:33.942797  3195 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:33.897516 10152 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:33.941682  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:33.949138  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:33.950567  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:33.884963 10112 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:17:33.961913  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:33.962142  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:33.967811  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:33.969158 10158 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:33.969034 10181 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:33.969805 10181 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:33.970194 10181 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:33.974404 10177 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:17:33.976329 10109 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:33.952183  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:33.938730  9843 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:33.998862  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:33.999966  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:33.939816  9991 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.007717 10054 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:34.006806  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 53163.1us
I20260709 13:17:34.008695  9991 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:33.966027 10175 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:34.013128 10175 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.013705 10175 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:34.017879  3050 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 19: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:34.019100  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:33.923379 10157 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.027416 10098 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:34.028502 10098 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:33.902030 10163 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:33.996068  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:34.036963  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:34.038468  3121 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:17:33.954357  9823 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:34.039358  3761 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:34.003732 10102 consensus_meta.cc:287] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.795s	user 0.010s	sys 0.004s
I20260709 13:17:33.923213 10070 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:34.010568 10109 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.056406  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.057247  3795 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:33.906101 10094 consensus_queue.cc:237] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:33.991796 10166 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:17:34.077320  3122 raft_consensus.cc:1275] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:34.029304 10098 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:33.954283 10004 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:33.954483  9979 consensus_queue.cc:1059] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.092s
I20260709 13:17:34.059504  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:34.029228 10152 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.047178  9823 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.045378 10150 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.079097  3047 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:33.953877 10071 consensus_queue.cc:237] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:34.045600 10170 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:34.088624  3797 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:17:34.090826 10126 consensus_meta.cc:287] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.001s
I20260709 13:17:34.112131  3123 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 24: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:17:34.108769  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 69506.9us
W20260709 13:17:34.103603 10168 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 13:17:34.114302  3050 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:34.091575 10162 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:34.053599 10172 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:17:34.102267 10072 raft_consensus.cc:3055] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:34.102707  9823 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:34.141883 10072 raft_consensus.cc:740] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:34.143085 10072 consensus_queue.cc:260] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.144351 10072 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:34.000422 10154 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.146070 10098 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:34.147171 10004 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:34.091041  9694 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:34.149024  3111 tablet_service.cc:1558] Processing DeleteTablet for tablet fcf5db67d30f487d873766886c2ef408 with delete_type TABLET_DATA_TOMBSTONED (TS f20672b2852447a6bc1e137c4dd40904 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:42724
I20260709 13:17:34.111461 10150 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:34.150844 10181 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.152740 10150 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:34.102035 10161 raft_consensus.cc:697] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:34.113773 10001 raft_consensus.cc:3055] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:34.064968 10109 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.153708 10181 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:34.159336 10109 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:34.160101  9843 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:34.161711 10159 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:34.157949  3043 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
W20260709 13:17:34.096254 10121 consensus_meta.cc:287] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.004s
I20260709 13:17:34.055655 10102 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.062877  3165 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:34.041926 10132 consensus_queue.cc:260] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.128544 10152 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:34.082717  9946 consensus_queue.cc:1059] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:17:34.135125 10163 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:34.170543  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 107811us
W20260709 13:17:34.175959  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.226344  3165 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:17:34.154286 10182 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:17:34.154836 10173 log.cc:927] Time spent T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:17:34.179634  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 3001) took 1234 ms. Trace:
W20260709 13:17:34.174882  9759 consensus_meta.cc:287] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.527s	user 0.006s	sys 0.006s
W20260709 13:17:34.229498  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 114480us
I20260709 13:17:34.157233 10070 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:34.125087 10052 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:34.233548  3048 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:34.236222 10190 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.236164 10150 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:34.240506 10189 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.243088 10200 tablet_replica.cc:333] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:17:34.230693  3119 rpcz_store.cc:276] 0709 13:17:32.945143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.241835 (+296692us) service_pool.cc:224] Handling call
0709 13:17:33.242107 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.385496 (+143389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.179246 (+793750us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54003e8354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:34.179533 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254998272}
I20260709 13:17:34.253312 10190 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:34.255802 10189 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:34.256721 10158 raft_consensus.cc:3055] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:34.257180 10158 raft_consensus.cc:740] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:34.258327 10190 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:34.182866  3797 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 24.
I20260709 13:17:34.156015 10001 raft_consensus.cc:740] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:34.174327 10159 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:17:34.230801  9973 consensus_meta.cc:287] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.736s	user 0.009s	sys 0.003s
I20260709 13:17:34.115887 10170 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.120594 10126 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:34.253803  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 466026us
W20260709 13:17:34.246728 10040 consensus_meta.cc:287] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.686s	user 0.012s	sys 0.000s
W20260709 13:17:34.260710  3042 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.014s	sys 0.006s
I20260709 13:17:34.245715  9984 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:34.177214 10054 consensus_queue.cc:1059] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:17:34.265651  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:34.275561  3164 leader_election.cc:400] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 22. Current term is 23.
I20260709 13:17:34.259673 10184 raft_consensus.cc:3055] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:34.270385  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3455) took 1434 ms. Trace:
W20260709 13:17:34.273155  3042 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.014s	sys 0.006s
I20260709 13:17:34.179664 10121 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.258419 10189 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:34.249413  9759 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:34.288141  3044 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:34.280301  3761 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:34.281657  3164 leader_election.cc:400] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 22. Current term is 23.
I20260709 13:17:34.282186  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:34.280364  3046 rpcz_store.cc:276] 0709 13:17:32.836151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.223311 (+387160us) service_pool.cc:224] Handling call
0709 13:17:33.242978 (+ 19667us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:33.382251 (+139273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.382282 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:33.397919 (+ 15637us) log.cc:844] Serialized 26 byte log entry
0709 13:17:33.594084 (+196165us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:33.594123 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.594192 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:34.270049 (+675857us) raft_consensus.cc:1685] finished
0709 13:17:34.270081 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:34.270304 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":72041,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":51095,"thread_start_us":334769,"threads_started":2,"wal-append.queue_time_us":301389}
W20260709 13:17:34.288864  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.155740 10161 consensus_queue.cc:237] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:34.281267  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2561) took 2220 ms. Trace:
I20260709 13:17:34.298511  3200 rpcz_store.cc:276] 0709 13:17:32.060835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.278591 (+1217756us) service_pool.cc:224] Handling call
0709 13:17:33.278993 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.635104 (+356111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.281060 (+645956us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b54001df454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:34.281214 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":755637632}
I20260709 13:17:34.292131  3164 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:34.297106  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:34.295212  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:34.265256  9946 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 13:17:34.258234 10158 consensus_queue.cc:260] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:34.275758 10040 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:34.299876  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:34.300393  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:34.264995 10094 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:17:34.290311 10054 consensus_queue.cc:1243] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:17:34.328045  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1419) took 1660 ms. Trace:
I20260709 13:17:34.396487  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:34.400604  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.304297  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.400840  3200 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:34.402135  3193 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:34.403211  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.315260  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:34.320946  3091 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:34.405375  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:34.317691  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1426) took 1126 ms. Trace:
I20260709 13:17:34.406383  3044 rpcz_store.cc:276] 0709 13:17:33.190842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.408993 (+218151us) service_pool.cc:224] Handling call
0709 13:17:33.409227 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.289555 (+880328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.317445 (+ 27890us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b54003a8ed4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:34.317630 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2020834048}
I20260709 13:17:34.407760  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:34.408363  3043 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
W20260709 13:17:34.398118  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 106095us
I20260709 13:17:34.399124  3042 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:17:34.410430  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:34.410661  3164 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:34.411238  3042 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:34.311491  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1421) took 1575 ms. Trace:
I20260709 13:17:34.329922  3794 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:17:34.412216  3047 rpcz_store.cc:276] 0709 13:17:32.736378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.190207 (+453829us) service_pool.cc:224] Handling call
0709 13:17:33.214532 (+ 24325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.104874 (+890342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.311160 (+206286us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b5400075154. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:34.311403 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1987593984}
I20260709 13:17:34.352815  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:34.413642  3046 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:34.401104  3045 rpcz_store.cc:276] 0709 13:17:32.667230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.122539 (+455309us) service_pool.cc:224] Handling call
0709 13:17:33.127068 (+  4529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:33.589988 (+462920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.590034 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:33.590609 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:17:33.659989 (+ 69380us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:17:33.660043 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.327672 (+667629us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b540029de54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:34.327719 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:34.327764 (+    45us) raft_consensus.cc:1685] finished
0709 13:17:34.327776 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:34.327983 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96743,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":8543,"spinlock_wait_cycles":355717888,"thread_start_us":344376,"threads_started":2,"wal-append.queue_time_us":114052}
I20260709 13:17:34.280318 10184 raft_consensus.cc:740] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:34.397187  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:34.410265  3165 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:34.328249  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3456) took 1491 ms. Trace:
I20260709 13:17:34.307173  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:34.313865  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 3132) took 1653 ms. Trace:
W20260709 13:17:34.405821  3015 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.000s	sys 0.024s
I20260709 13:17:34.417433  3799 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:17:34.419014  3015 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.001s	sys 0.024s
I20260709 13:17:34.280257 10192 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:34.286782  9984 raft_consensus.cc:697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:17:34.421257  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 100334us
I20260709 13:17:34.418139  3048 rpcz_store.cc:276] 0709 13:17:32.836467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.267411 (+430944us) service_pool.cc:224] Handling call
0709 13:17:33.267724 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.247250 (+979526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.328011 (+ 80761us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b540028e454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:34.328187 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2220559232}
I20260709 13:17:34.423864  3090 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:34.332160 10008 raft_consensus.cc:3055] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:34.301903 10183 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:34.434576  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:34.419411  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 562256us
I20260709 13:17:34.435539  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1418) took 1768 ms. Trace:
I20260709 13:17:34.334620 10102 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:34.418879  3049 rpcz_store.cc:276] 0709 13:17:32.660786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.017722 (+356936us) service_pool.cc:224] Handling call
0709 13:17:33.018081 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.535802 (+517721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.313614 (+777812us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b5400474fd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:34.313806 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189253376}
I20260709 13:17:34.338193  9874 raft_consensus.cc:2955] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Committing config change with OpId 19.11: config changed from index 5 to 11, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:34.428821 10078 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:34.430272 10157 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:34.320663 10122 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:34.305123  9759 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:34.438452  3799 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
W20260709 13:17:34.425262  9867 consensus_meta.cc:287] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.626s	user 0.006s	sys 0.006s
I20260709 13:17:34.435976  3051 rpcz_store.cc:276] 0709 13:17:32.666875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.112173 (+445298us) service_pool.cc:224] Handling call
0709 13:17:33.112475 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.929412 (+816937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.435327 (+505915us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b54000c6f54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:34.435480 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1873452928}
I20260709 13:17:34.328989 10170 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:34.442417  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.454725  3794 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:34.417098 10150 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:34.420282 10191 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.463951  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.464540  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:34.466292  3044 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:17:34.341387 10195 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 13:17:34.448132 10122 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:34.448805  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:34.453052  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.442636  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:34.420740 10192 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.317202  9991 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:34.313354  9823 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.454185  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:34.478082  3165 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:34.478754  3051 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 21: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:34.456485  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:34.447620 10175 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:34.439432 10158 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:34.439571 10008 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:34.493062 10008 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:34.494513 10008 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:34.498917 10151 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:34.500017  9256 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:34.499716 10151 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.434435 10183 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:34.504850 10183 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:34.471585  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.469053 10191 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.509055 10191 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:34.420449 10159 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 13:17:34.440248 10189 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:34.510361  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:34.511137  9823 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:34.510993 10189 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:34.511693  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:34.512524  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:34.513151  3048 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:17:34.513475  3124 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 24: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:34.445134 10166 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:34.515169 10151 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:34.515353  3091 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:34.499733 10187 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.263s	user 0.005s	sys 0.000s
I20260709 13:17:34.516722  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:34.517319  3047 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:34.518621  3197 raft_consensus.cc:1275] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:17:34.520161 10153 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:34.446185  9997 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:34.473232  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.535064  3795 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 24: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:34.438583  9843 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:34.464051 10150 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.535704  9843 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.535912 10126 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:34.536098 10150 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:34.536216  9843 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:34.461701  9926 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.537595 10040 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:34.538532 10121 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:34.538077  9926 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:34.479077 10184 consensus_queue.cc:260] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:34.540185 10184 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:34.462352 10102 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.468648  9867 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:34.541610 10102 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.543347  9867 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:34.544152  3791 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:34.544258 10102 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:34.540989  9926 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:34.481572  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:34.545828  3051 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:17:34.546388  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.513125 10189 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:34.548349 10189 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.548759 10189 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.549888 10121 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.550364 10121 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.550786 10189 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:34.552366 10121 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:34.481786  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.486397 10170 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:34.488541 10194 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:34.488955  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.483652 10078 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:34.489842 10175 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:34.554171  9986 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:34.565644 10198 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.330s	user 0.002s	sys 0.000s
I20260709 13:17:34.491576  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:34.439186  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:34.510481  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:34.516554 10154 consensus_queue.cc:1059] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:34.521327 10166 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:34.523376  3049 raft_consensus.cc:1240] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:17:34.524713 10183 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:34.500602 10149 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:34.526883  3192 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:17:34.527999  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:34.588367  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.528054  3047 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:34.591027  3047 raft_consensus.cc:1275] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 17 index: 7. (index mismatch)
I20260709 13:17:34.476612 10192 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:34.528064  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:34.464169 10157 consensus_queue.cc:1059] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:17:34.533984 10188 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.088s
I20260709 13:17:34.533797  9984 consensus_queue.cc:237] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.534858  9997 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.513125  9991 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:34.480803  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:34.604748  3051 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 24.
I20260709 13:17:34.484949  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:34.554283  3091 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:34.608629  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 54439.6us
I20260709 13:17:34.295753 10001 consensus_queue.cc:260] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.516036  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:34.618175  3193 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:34.475437  3042 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:34.619278  3045 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:34.562057 10170 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:34.568976  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 131270us
I20260709 13:17:34.569456  3792 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
W20260709 13:17:34.621615  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 140911us
I20260709 13:17:34.622225  3043 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 13:17:34.622424  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:34.624521  3043 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:17:34.577898  3046 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 19. Current term is 20. Ops: []
W20260709 13:17:34.580593  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:34.534958 10199 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.291s	user 0.000s	sys 0.002s
W20260709 13:17:34.596038  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 68039.2us
I20260709 13:17:34.593726  3047 raft_consensus.cc:1240] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:17:34.611482  3051 raft_consensus.cc:1275] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:17:34.570261  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 279259us
I20260709 13:17:34.630762  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.623767  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:34.578435 10194 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:17:34.657145  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 47398.9us
I20260709 13:17:34.575219 10166 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:34.638182 10170 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:34.676482  3091 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:34.681457  3091 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:34.683527  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.658488  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.658767  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.584084 10149 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.662487  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.656937 10175 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:34.689927  3091 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:34.608445  9926 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:34.684357 10166 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:34.674168  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 50456.7us
I20260709 13:17:34.686471  9846 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:34.708036  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.677845  3046 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:17:34.646829  9979 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:34.657029 10121 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:17:34.672032  3049 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:17:34.678932 10098 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:34.705123  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:34.657574  3165 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:34.666260 10023 consensus_queue.cc:1059] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:17:34.692348 10149 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:34.721470  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.675665  3193 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:34.714347  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:34.699910  9823 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:34.715898  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:34.713536  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:34.694437  9449 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:17:34.710958 10037 consensus_queue.cc:1059] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 13:17:34.730425 10037 raft_consensus.cc:3055] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:34.730851 10037 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:34.731962 10037 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:34.734134  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.734822  3790 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:34.723526  3042 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:34.716713 10098 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:34.735805 10098 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:34.737270  3042 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:34.738266 10102 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.738574  9823 raft_consensus.cc:697] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:34.738826 10102 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.739650  9823 consensus_queue.cc:237] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.740993 10102 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:34.726423  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:34.704917  9926 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.727761  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:34.711258  9979 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.746315  9979 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:34.747167  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:34.748454 10150 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.748798  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:34.749636 10126 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:34.750303 10126 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:34.750787 10126 raft_consensus.cc:697] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:34.751482  3047 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:17:34.751571 10126 consensus_queue.cc:237] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.752811  9926 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:34.753996 10153 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:34.754416 10153 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:34.754786 10153 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:34.728406  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.757529  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:34.757834  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:34.704005 10176 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.759480  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:34.762522  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:34.755144  3045 raft_consensus.cc:2955] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Committing config change with OpId 19.11: config changed from index 5 to 11, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:34.794103  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:34.795192  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:34.794153  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:34.650971 10134 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.016s	sys 0.016s
I20260709 13:17:34.798621  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:34.802165  3125 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:34.703652  9991 consensus_queue.cc:1059] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:17:34.699345 10175 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:34.719820  9846 raft_consensus.cc:697] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:34.807036  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.807415  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:34.820219  3192 raft_consensus.cc:2368] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 22. Current term is 23.
I20260709 13:17:34.707084 10172 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.087s
I20260709 13:17:34.706748 10040 consensus_queue.cc:1059] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.087s
I20260709 13:17:34.831764  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:34.832552  3192 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:34.818318  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:34.835297  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:34.836639  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:34.733640 10037 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:34.826437  3125 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:34.838038  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:34.838243  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:34.839552  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:34.756729 10121 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:17:34.799716 10134 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.017s	sys 0.017s
I20260709 13:17:34.841465  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:34.857097  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:34.843055  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:34.766994  9449 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 24 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:34.859706  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:34.862061  3122 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:34.875319  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:34.875958  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:34.876952  3795 raft_consensus.cc:2376] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23. Re-sending same reply.
I20260709 13:17:34.876084  3125 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:34.881160  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:34.882788  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:34.883702  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:34.882925  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:34.888676 10175 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:34.890117 10183 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:34.890223  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.891127  3795 raft_consensus.cc:2393] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 19: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:34.891057  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.891551  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:34.892225  3792 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 24: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:34.892385  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.893033  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.893759  3799 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:34.893041  3798 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 24: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:34.891225  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:34.897094  3791 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:34.840515 10102 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:34.900310  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:34.884500  3124 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:34.902370  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:34.906219  3125 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 24: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:34.906060  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:34.907048  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:34.907555  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:34.818725 10052 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:17:34.914765  3794 raft_consensus.cc:2410] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:17:34.875473 10189 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:34.806502 10176 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:34.910724  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:34.950435  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.899564 10121 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:34.950626  3125 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:34.949770  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:34.952283  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:34.950793  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.947359  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:34.954238  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:34.955394  3049 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 20: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:34.915863  3090 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:34.958117  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:34.959388  3125 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 20: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:34.959538  3192 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:34.963523  3124 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:34.966318  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.967736  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:34.968523  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:34.969107  3125 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:34.970342  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 54563.5us
I20260709 13:17:34.910857 10158 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:34.956486  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 191389us
I20260709 13:17:34.965065  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:34.975229  3124 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:34.973706  3120 raft_consensus.cc:1275] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 17 index: 7. (index mismatch)
I20260709 13:17:34.914536  9973 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:34.980756  3049 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:17:34.981280  3049 pending_rounds.cc:85] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 12
I20260709 13:17:34.981570  3049 pending_rounds.cc:107] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:17:34.968747  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:34.983237  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:34.971868  3090 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:34.953539 10189 raft_consensus.cc:697] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:34.952384 10121 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.984627  3049 raft_consensus.cc:2889] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:34.988050  3125 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:34.965935 10150 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:34.916842 10154 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
I20260709 13:17:34.977056 10052 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:17:34.994518  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.999580  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:34.996729  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:35.004913  3124 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:35.007529  3049 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 21: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:34.986845  9997 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:34.991979 10121 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:35.010736 10225 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:17:35.012902  3118 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:34.990536  9874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60218 (request call id 7) took 3873 ms. Trace:
I20260709 13:17:35.008569  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:34.957751  9846 consensus_queue.cc:237] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.007196 10175 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.046373 10175 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.048796 10175 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:35.053220 10008 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.558s	user 0.003s	sys 0.007s
I20260709 13:17:35.029790  9979 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.032159  9874 rpcz_store.cc:276] 0709 13:17:31.106948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.107108 (+   160us) service_pool.cc:224] Handling call
0709 13:17:31.155809 (+ 48701us) log.cc:844] Serialized 501 byte log entry
0709 13:17:32.506465 (+1350656us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b18002d0ac0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:17:32.530003 (+ 23538us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:32.741848 (+211845us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b18002d0ac0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c6522 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:17:32.752604 (+ 10756us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b54003e5e20. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff830328dbe 00007ff830333930 00007ff8303338d8 00007ff830333858 00007ff830333813 00007ff830332a9c 00007ff83621e626 00007ff836218dd8 00007ff83036f7cb 00007ff8303722c0
0709 13:17:34.980100 (+2227496us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5989,"raft.run_cpu_time_us":8310,"raft.run_wall_time_us":253657,"spinlock_wait_cycles":38884224,"thread_start_us":48245,"threads_started":1,"wal-append.queue_time_us":303033,"wal-append.run_cpu_time_us":18144,"wal-append.run_wall_time_us":2387237}
I20260709 13:17:35.056018  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a1ccbbf27f0b436d8c79dfb6db7fc703 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:35.060216  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3463) took 1061 ms. Trace:
I20260709 13:17:35.055179  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:35.061378  3761 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:35.062160  9874 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:35.062647  9874 raft_consensus.cc:697] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:35.063716  9874 consensus_queue.cc:237] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:35.065503 10184 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:35.067894 10184 raft_consensus.cc:697] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:35.068742 10184 consensus_queue.cc:237] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:35.070303 10211 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:17:35.073135  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:35.049649  9843 consensus_meta.cc:287] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.000s
I20260709 13:17:35.075444  9843 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.077106  3126 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:35.077785  3125 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:34.995683 10098 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:35.078624 10215 log.cc:927] Time spent T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:17:35.078685 10170 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.080467 10098 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:35.081056 10098 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.082003  3046 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 20. Current term is 21. Ops: []
W20260709 13:17:35.080503 10213 log.cc:927] Time spent T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:17:35.083650  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3144) took 1085 ms. Trace:
I20260709 13:17:35.084224  9843 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:35.089917  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.020891 10191 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:35.084007  3197 rpcz_store.cc:276] 0709 13:17:33.998698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.519345 (+520647us) service_pool.cc:224] Handling call
0709 13:17:34.519612 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.519945 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.519970 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:34.520385 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:17:34.710541 (+190156us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:34.710589 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.710677 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:35.083459 (+372782us) raft_consensus.cc:1685] finished
0709 13:17:35.083478 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:35.083593 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1100,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":185302,"threads_started":1,"wal-append.queue_time_us":358412}
I20260709 13:17:35.086105 10176 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:35.056475  9979 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:35.088017  3124 raft_consensus.cc:2368] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 22. Current term is 23.
I20260709 13:17:35.059674 10189 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:35.060635  3048 rpcz_store.cc:276] 0709 13:17:33.998811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.513843 (+515032us) service_pool.cc:224] Handling call
0709 13:17:34.514145 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.514532 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:34.766696 (+252164us) log.cc:844] Serialized 14 byte log entry
0709 13:17:35.000547 (+233851us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:35.018053 (+ 17506us) log.cc:844] Serialized 26 byte log entry
0709 13:17:35.018251 (+   198us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:35.018296 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.018394 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:35.059991 (+ 41597us) raft_consensus.cc:1685] finished
0709 13:17:35.060018 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:35.060157 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":375507,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":25781,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":5108,"thread_start_us":419235,"threads_started":2,"wal-append.queue_time_us":254669}
I20260709 13:17:35.092007  3799 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:35.083644  3049 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:35.033694 10052 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:35.081498 10098 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.014639  9867 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
I20260709 13:17:35.115430  3164 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:35.117327 10207 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.550s	user 0.001s	sys 0.001s
I20260709 13:17:35.117465 10071 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:35.103976  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:35.104432 10078 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:35.106083 10098 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:35.106464 10214 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:17:35.107795  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:35.108398 10217 log.cc:927] Time spent T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.216s	user 0.002s	sys 0.000s
W20260709 13:17:35.131652  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 224146us
I20260709 13:17:35.132764  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:35.134475  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:35.129262  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:35.137880  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:35.111891 10132 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:34.988363  9449 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.118991  3048 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 25.
W20260709 13:17:35.120647  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 148861us
I20260709 13:17:35.160049  3090 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:35.128984  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:35.101709  9973 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.139798  3043 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:35.077643 10166 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.109658 10158 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:35.145480  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:35.125344 10161 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:35.297248  3195 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:35.146798  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:35.147629  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:35.298923  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:35.148435  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.148345  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:35.122339  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 464793us
I20260709 13:17:35.174072  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:35.120455 10094 raft_consensus.cc:3055] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:35.301538 10094 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:35.301651  3125 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:35.302524 10094 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:35.303563 10094 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:35.120426 10194 raft_consensus.cc:697] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:35.287220  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:35.102317 10008 consensus_queue.cc:1059] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.057s
I20260709 13:17:35.304852  3048 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:35.305459  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:35.306293  3192 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:35.307828  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:35.288169  3043 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: []
W20260709 13:17:35.158074 10206 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.339s	user 0.002s	sys 0.000s
I20260709 13:17:35.141799 10126 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:17:35.316886  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 201499us
I20260709 13:17:35.317970  9256 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:35.349610  3120 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:17:35.352223  3195 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:35.283547  9986 raft_consensus.cc:3055] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:35.360361  3123 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 20: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:35.286577 10098 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:17:35.352936  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 51687.2us
I20260709 13:17:35.366515  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3466) took 1366 ms. Trace:
I20260709 13:17:35.367079  3050 rpcz_store.cc:276] 0709 13:17:33.999578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.521805 (+522227us) service_pool.cc:224] Handling call
0709 13:17:34.522132 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.522458 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.522488 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:34.522945 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:17:34.785923 (+262978us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:34.785986 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.786090 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:35.366261 (+580171us) raft_consensus.cc:1685] finished
0709 13:17:35.366286 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:35.366426 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3688,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":61,"thread_start_us":262489,"threads_started":1,"wal-append.queue_time_us":393120}
I20260709 13:17:35.306596 10102 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:35.371968  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3474) took 1322 ms. Trace:
I20260709 13:17:35.381537  3044 rpcz_store.cc:276] 0709 13:17:34.049501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.619456 (+569955us) service_pool.cc:224] Handling call
0709 13:17:34.619876 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.620244 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.620279 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:34.656664 (+ 36385us) log.cc:844] Serialized 26 byte log entry
0709 13:17:34.835627 (+178963us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:34.835689 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.835779 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:35.107846 (+272067us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:35.371665 (+263819us) raft_consensus.cc:1685] finished
0709 13:17:35.371690 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:35.371887 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":20819,"spinlock_wait_cycles":4362752,"thread_start_us":178590,"threads_started":1,"wal-append.queue_time_us":235216}
W20260709 13:17:35.384824  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 224850us
W20260709 13:17:35.384927  3194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 3133) took 1627 ms (client timeout 1672 ms). Trace:
I20260709 13:17:35.385921  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:35.385846  3194 rpcz_store.cc:269] 0709 13:17:33.757474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.763153 (+  5679us) service_pool.cc:224] Handling call
0709 13:17:35.384706 (+1621553us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b54003bae54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:35.384859 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2177604992}
I20260709 13:17:35.363178  9986 raft_consensus.cc:740] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:35.384271 10023 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:35.392752 10023 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:35.392948  9986 consensus_queue.cc:260] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.393963  9986 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:35.394701 10243 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:35.395109 10023 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:35.396410  3120 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:17:35.368363 10158 consensus_queue.cc:1059] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:17:35.399108 10245 raft_consensus.cc:3055] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:35.399533 10245 raft_consensus.cc:740] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:35.400369 10171 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:35.400333 10245 consensus_queue.cc:260] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:35.402536 10232 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:17:35.402633 10209 log.cc:927] Time spent T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 13:17:35.401079 10171 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.383527  3048 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:35.298210  9973 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:35.372584 10122 consensus_meta.cc:287] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.894s	user 0.011s	sys 0.000s
W20260709 13:17:35.413265  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 277314us
I20260709 13:17:35.419376  3090 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:35.424028  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:35.414011 10153 consensus_meta.cc:287] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.659s	user 0.009s	sys 0.002s
I20260709 13:17:35.438553  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:35.439292  3194 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:35.439603  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:35.429245  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:35.440330 10175 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:35.447438  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3132) took 1690 ms. Trace:
W20260709 13:17:35.448248 10210 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.555s	user 0.004s	sys 0.006s
W20260709 13:17:35.449903 10229 log.cc:927] Time spent T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:35.450842  9986 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:35.451377  9986 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.451498 10234 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:35.451833  9986 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:35.412706 10126 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.454154 10126 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.454222 10194 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:35.456895 10126 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:35.458431 10234 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:35.459059 10234 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:35.460464  9926 consensus_meta.cc:287] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.694s	user 0.008s	sys 0.000s
I20260709 13:17:35.460906  9926 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.462044 10234 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:35.459084 10204 raft_consensus.cc:3055] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:17:35.462865 10192 consensus_meta.cc:287] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.857s	user 0.011s	sys 0.000s
I20260709 13:17:35.454263  9991 raft_consensus.cc:3055] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:35.464948  3191 raft_consensus.cc:1275] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:35.466109  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3130) took 1709 ms. Trace:
I20260709 13:17:35.467090 10230 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:17:35.442449  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.451849  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:35.476855  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:35.479230  3015 leader_election.cc:400] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 22. Current term is 23.
I20260709 13:17:35.481302  9256 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:35.562031  3015 leader_election.cc:403] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:17:35.420161 10170 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:35.562668 10098 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 22. Current term is 23.
I20260709 13:17:35.447938  3196 rpcz_store.cc:276] 0709 13:17:33.757246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.939987 (+182741us) service_pool.cc:224] Handling call
0709 13:17:33.990153 (+ 50166us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:34.001302 (+ 11149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.001332 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:34.012168 (+ 10836us) log.cc:844] Serialized 52 byte log entry
0709 13:17:34.341382 (+329214us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b1800469ea0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:17:34.663650 (+322268us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:34.953287 (+289637us) log.cc:844] Serialized 14 byte log entry
0709 13:17:35.105541 (+152254us) spinlock_profiling.cc:243] Waited 5.28 ms on lock 0x7b1800469ea0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:17:35.317378 (+211837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.317515 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:35.447175 (+129660us) raft_consensus.cc:1685] finished
0709 13:17:35.447195 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:35.447362 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":379696,"prepare.queue_time_us":178760,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":382430,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":29683,"spinlock_wait_cycles":52885632,"thread_start_us":583791,"threads_started":2,"wal-append.queue_time_us":828808}
I20260709 13:17:35.563227 10234 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:35.463734  9973 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:35.426425 10151 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:17:35.563871 10234 raft_consensus.cc:697] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:17:35.564574  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 90391.4us
W20260709 13:17:35.511345 10149 consensus_meta.cc:287] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.754s	user 0.009s	sys 0.000s
I20260709 13:17:35.426025 10122 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.565915  3042 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:35.514245  3194 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:35.512231 10161 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:35.566246 10054 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:35.519894  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:35.565537 10149 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:35.567200  9984 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:35.566883 10054 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:35.567695  3193 raft_consensus.cc:2393] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:35.567900  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:35.568436  3123 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:35.520630  3119 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:35.570403  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:35.570490  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 118787us
I20260709 13:17:35.571079 10054 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:35.523175  3198 rpcz_store.cc:276] 0709 13:17:33.756648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.756764 (+   116us) service_pool.cc:224] Handling call
0709 13:17:33.795607 (+ 38843us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:34.231307 (+435700us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:34.291386 (+ 60079us) log.cc:844] Serialized 14 byte log entry
0709 13:17:35.122075 (+830689us) log.cc:844] Serialized 14 byte log entry
0709 13:17:35.122382 (+   307us) log.cc:844] Serialized 14 byte log entry
0709 13:17:35.296556 (+174174us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:35.317001 (+ 20445us) log.cc:844] Serialized 52 byte log entry
0709 13:17:35.317159 (+   158us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:35.317442 (+   283us) log.cc:844] Serialized 14 byte log entry
0709 13:17:35.317596 (+   154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.317668 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:35.443501 (+125833us) spinlock_profiling.cc:243] Waited 5.91 ms on lock 0x7b180047e000. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:17:35.447498 (+  3997us) spinlock_profiling.cc:243] Waited 6.33 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:35.453608 (+  6110us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b180047e000. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:17:35.465811 (+ 12203us) raft_consensus.cc:1685] finished
0709 13:17:35.465844 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:35.466028 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":559831,"prepare.queue_time_us":349159,"prepare.run_cpu_time_us":218,"prepare.run_wall_time_us":13410,"raft.queue_time_us":1007678,"raft.run_cpu_time_us":452,"raft.run_wall_time_us":41020,"spinlock_wait_cycles":157310208,"thread_start_us":824255,"threads_started":4,"wal-append.queue_time_us":471670}
I20260709 13:17:35.426028 10223 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.572110 10223 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.564827 10234 consensus_queue.cc:237] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:35.513953 10192 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:35.574532  3797 raft_consensus.cc:1240] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:17:35.469429 10153 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.579952 10153 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:35.567739  9984 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.584357 10153 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:35.584936  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:35.586354 10153 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:35.587085  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:35.587954 10153 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:35.571413  3090 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:35.595494 10054 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:35.599874  9984 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:35.482936 10071 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:17:35.603855  3199 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 24: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:35.427445 10121 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.497354 10100 raft_consensus.cc:3055] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:35.494156 10204 raft_consensus.cc:740] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:35.522838  9991 raft_consensus.cc:740] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:35.504272 10150 consensus_queue.cc:1059] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.103s
I20260709 13:17:35.503204 10072 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
W20260709 13:17:35.617794  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 244958us
I20260709 13:17:35.619752 10149 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:35.620882 10223 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:35.621620  9926 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:35.623250 10192 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:35.626477  9991 consensus_queue.cc:260] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.608135 10100 raft_consensus.cc:740] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:35.627910 10001 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:17:35.633041  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 160810us
W20260709 13:17:35.639417  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.629632 10121 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:35.663702 10132 consensus_meta.cc:287] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.000s
I20260709 13:17:35.664644  3117 raft_consensus.cc:1275] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:17:35.665665  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:35.665989  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 3009) took 1716 ms. Trace:
I20260709 13:17:35.666451  3117 rpcz_store.cc:276] 0709 13:17:33.949134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.949254 (+   120us) service_pool.cc:224] Handling call
0709 13:17:33.949538 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:35.665119 (+1715581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.665721 (+   602us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b540010cf54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:35.665930 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3943450880}
I20260709 13:17:35.667073 10122 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:35.667901  3118 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:17:35.668318  3122 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:17:35.654879  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:35.642204  9874 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.007s	sys 0.017s
I20260709 13:17:35.657146  9991 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:35.660029 10166 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:35.662328 10100 consensus_queue.cc:260] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.665815  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:35.669198  3118 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:17:35.669605 10223 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:35.670320 10004 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.676204 10040 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:17:35.648926  3123 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:35.674243 10078 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:35.690200  3124 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 20. Current term is 21. Ops: [18.11-20.12]
I20260709 13:17:35.675557 10191 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:35.668437  3117 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:17:35.680256  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:35.650182  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:35.681310  3791 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:35.681365  3051 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:35.655582  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:35.694283  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:35.686667  3121 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 23: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:35.695470  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:35.680166 10207 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.012s	sys 0.014s
I20260709 13:17:35.664664 10204 consensus_queue.cc:260] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:35.682621  9874 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.007s	sys 0.017s
I20260709 13:17:35.689514  3164 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:35.694365  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 106150us
I20260709 13:17:35.697052  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:35.686113  3122 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 13:17:35.696606  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:35.707255  3049 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 23: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:35.701030  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:17:35.702016  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.710888  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:35.682559 10150 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:17:35.704144  3044 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:35.704545  3798 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 19. Current term is 20. Ops: []
W20260709 13:17:35.700451 10207 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.013s	sys 0.014s
I20260709 13:17:35.706390  3050 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:17:35.705253  3164 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:35.663719  9986 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:35.691705 10078 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:35.695287 10100 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:35.714735  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:35.703598  3046 raft_consensus.cc:2393] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 21: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:35.726814  3048 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:17:35.726699  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:35.757507  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:35.758245  3050 raft_consensus.cc:2393] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 21: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:35.707337 10163 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:35.771005  9984 raft_consensus.cc:3055] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:35.771575  9984 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:35.772497  9984 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:35.774637  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.776072 10158 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:35.776732 10158 raft_consensus.cc:697] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:35.777767 10158 consensus_queue.cc:237] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.780457  9986 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:35.686832 10192 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:17:35.685026 10194 consensus_queue.cc:1059] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:17:35.700224 10189 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:35.725510  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:35.688721 10149 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:17:35.688748 10223 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.690204 10004 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.712847 10204 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:35.763206  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:35.761029  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:35.836086  3046 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 24: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:35.735975  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3479) took 1220 ms. Trace:
I20260709 13:17:35.763948 10242 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:17:35.698164 10094 consensus_queue.cc:1048] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.059s
W20260709 13:17:35.782373  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 77210us
I20260709 13:17:35.705063 10195 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.078s
I20260709 13:17:35.784055 10188 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:17:35.785035 10216 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.829s	user 0.003s	sys 0.009s
I20260709 13:17:35.787009 10072 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:35.862380 10223 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:35.862284 10072 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:35.787796 10249 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.788975  3193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "f20672b2852447a6bc1e137c4dd40904"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:17:35.870239  3193 raft_consensus.cc:606] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Received request to transfer leadership to TS f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:35.870505  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 107362us
I20260709 13:17:35.871393  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:35.872618  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:35.872735  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:35.790473  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:35.873536  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:35.792991  3195 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:17:35.795357  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:35.797065 10245 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:35.696624 10191 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:35.799312  3196 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:35.724761 10122 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:17:35.704615  9759 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:17:35.811729  3044 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:35.816275  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.824905  3124 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:17:35.887194  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:35.887312  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:35.888352  3191 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:35.836490  3042 rpcz_store.cc:276] 0709 13:17:34.515451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.743205 (+227754us) service_pool.cc:224] Handling call
0709 13:17:34.743520 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:35.566359 (+822839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.735584 (+169225us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b540029ca54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:35.735874 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1890836352}
W20260709 13:17:35.815904 10208 log.cc:927] Time spent T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 1.150s	user 0.009s	sys 0.003s
I20260709 13:17:35.852126  3164 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:35.854267  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:35.809374  9979 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:17:35.856305  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.818593 10163 raft_consensus.cc:3055] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:35.811458 10244 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:35.792799  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:35.874038  3121 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 13:17:35.875463  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.876148  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:35.818883  9984 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:35.820289 10171 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:35.883219  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:35.908937  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:35.891009  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:35.822072 10189 raft_consensus.cc:697] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 16 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:35.898164  3791 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:35.909694  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:35.910328 10189 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:35.910980  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:35.912290  3015 leader_election.cc:400] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 22. Current term is 23.
I20260709 13:17:35.900969  3794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43926 (request call id 1224) took 1259 ms. Trace:
I20260709 13:17:35.914137  3794 rpcz_store.cc:276] 0709 13:17:34.627381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.629961 (+  2580us) service_pool.cc:224] Handling call
0709 13:17:35.878091 (+1248130us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400550354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:35.886670 (+  8579us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518538624}
I20260709 13:17:35.915961  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:35.916713  3117 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:35.918012  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:35.918774  3117 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:35.916723  9973 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:35.919647  3791 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:35.921149  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:35.898550  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 46504.2us
I20260709 13:17:35.903649  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:35.927433  3164 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:35.913690 10158 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:35.928812 10194 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:35.931115 10194 consensus_queue.cc:1059] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:35.932255 10194 consensus_queue.cc:1243] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:35.933924  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:35.943854  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:35.946547 10194 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:35.936414  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:35.947868 10194 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:35.952865  3197 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 20: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:17:35.951128  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.954883  3191 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:35.950913  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:35.957350  3123 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:35.958698  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:35.959618  3121 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:35.963310  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:35.966121  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:35.966172  3044 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:17:35.962232  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:35.881251 10153 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:35.970587  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:35.883247 10242 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:17:36.027733  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 63557.6us
I20260709 13:17:36.029821  3197 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:36.030217  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:36.007761  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.008503  3121 raft_consensus.cc:1275] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:35.897290 10253 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:35.907182  9946 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.031564  3196 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 23: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:35.963726 10194 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:36.038201  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 220882us
I20260709 13:17:35.904906 10163 raft_consensus.cc:740] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:35.983525 10122 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:35.902290 10094 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.135s
I20260709 13:17:36.051369  3090 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:36.131158  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 79912.3us
I20260709 13:17:35.970420 10158 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:36.124183  3042 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:36.125594 10258 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:17:36.039647 10208 log.cc:927] Time spent T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:17:36.140429  3117 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
I20260709 13:17:35.990015  9973 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:36.027007 10098 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.949427  9874 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.197s
I20260709 13:17:36.046609 10253 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:36.181799  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:36.185676  3042 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
W20260709 13:17:36.176927  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 143152us
I20260709 13:17:36.182039  3197 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:36.120899 10122 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:36.189397  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.160385 10261 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:36.198474  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:36.196035  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:36.189147  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:36.038667 10150 consensus_queue.cc:1048] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.134s
I20260709 13:17:36.189215  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:36.037966 10189 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.135s
I20260709 13:17:36.200634  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:36.096630 10159 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:17:36.202623  3042 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:36.209633  3197 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:17:36.200201  3123 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:36.175732  9973 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.212172  9973 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:36.213055  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:36.215833  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:36.216662  3196 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:36.217046 10260 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
W20260709 13:17:36.219709 10262 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:17:36.220125  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1300) took 1326 ms. Trace:
I20260709 13:17:36.221194  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1448) took 1098 ms. Trace:
I20260709 13:17:36.221788  3047 rpcz_store.cc:276] 0709 13:17:35.123127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.303563 (+180436us) service_pool.cc:224] Handling call
0709 13:17:35.303885 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.643173 (+339288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.643208 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:35.647844 (+  4636us) log.cc:844] Serialized 26 byte log entry
0709 13:17:35.810675 (+162831us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:35.810749 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.810843 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.220948 (+410105us) raft_consensus.cc:1685] finished
0709 13:17:36.220973 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.221119 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93393,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":73,"thread_start_us":501341,"threads_started":2,"wal-append.queue_time_us":313731}
I20260709 13:17:36.229923 10163 consensus_queue.cc:260] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:36.232067 10163 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:36.239032 10094 raft_consensus.cc:3055] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:36.239712 10094 raft_consensus.cc:740] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:36.129973  9984 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:17:36.198374 10122 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:17:36.187022 10001 consensus_meta.cc:287] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.001s
I20260709 13:17:36.178913 10158 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:36.220598  3125 rpcz_store.cc:276] 0709 13:17:34.893534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.302381 (+408847us) service_pool.cc:224] Handling call
0709 13:17:35.302868 (+   487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.303234 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.303260 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:35.304264 (+  1004us) log.cc:844] Serialized 501 byte log entry
0709 13:17:35.804964 (+500700us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:35.805019 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.805122 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.219906 (+414784us) raft_consensus.cc:1685] finished
0709 13:17:36.219924 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.220065 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":440417,"threads_started":1,"wal-append.queue_time_us":901876}
W20260709 13:17:36.239068 10268 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:36.189903 10253 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:36.290799  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:36.202839 10261 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:36.250751 10258 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.184612 10098 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:36.257011 10189 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:36.310137  3091 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:36.255685 10175 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.314570  3047 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:17:36.316923 10274 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.322081  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 3020) took 1606 ms. Trace:
I20260709 13:17:36.322335  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:36.322486  3045 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.004s	sys 0.010s
W20260709 13:17:36.325258  3045 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.004s	sys 0.010s
I20260709 13:17:36.322793  3126 rpcz_store.cc:276] 0709 13:17:34.715413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.715575 (+   162us) service_pool.cc:224] Handling call
0709 13:17:34.715983 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:35.077550 (+361567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.321793 (+1244243us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54003921d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:36.321990 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":829977984}
I20260709 13:17:36.317519 10274 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:36.121366  9946 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:36.337071 10230 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:35.866150 10249 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:35.964547 10244 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:36.306223 10261 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:36.346992 10189 raft_consensus.cc:697] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:36.398375  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:36.289093 10001 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:17:36.348093  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.289419 10158 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:36.348626  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 191135us
I20260709 13:17:36.354774  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:36.405020  3197 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:36.355029  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:36.362190  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.406476  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 51533.4us
I20260709 13:17:36.328843 10175 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:36.365830 10274 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:36.368192 10194 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:36.361223 10121 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:36.369942 10234 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:17:36.314778 10258 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:36.350170 10078 consensus_meta.cc:287] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.588s	user 0.014s	sys 0.000s
I20260709 13:17:36.371474  9946 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:36.372378 10191 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:36.359252 10195 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:36.375216  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:36.389884  3196 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:36.405071  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:36.408763  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:36.430284  3126 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:36.430846  3196 raft_consensus.cc:3055] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:36.413638  3193 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
W20260709 13:17:36.416271  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 106205us
I20260709 13:17:36.431391  3196 raft_consensus.cc:740] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:17:36.422137  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.314841 10094 consensus_queue.cc:260] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:36.432005  3091 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:36.432735  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.436446  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:36.437214  3046 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:36.432245  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:36.433408  3196 consensus_queue.cc:260] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:36.415020 10001 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:36.412884 10245 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:36.488231  3196 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:36.443178  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:36.492257  3192 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:36.497113  3044 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:17:36.498744  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:36.427220 10234 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.507644 10234 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:17:36.527866  3044 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:36.709489  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:36.711869  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:36.713385  3045 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:36.716531  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:36.720482  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:36.721524  3045 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:17:36.721724  3051 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
I20260709 13:17:36.535869  3197 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:36.714185  3044 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 23: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:17:36.532689  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.533401  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 101496us
W20260709 13:17:36.581389  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 206917us
I20260709 13:17:36.578325  9973 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:36.803004 10283 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.804148  3047 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:36.804258 10283 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:36.513145  9991 consensus_meta.cc:287] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.826s	user 0.009s	sys 0.003s
I20260709 13:17:36.434849 10078 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:36.809098  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3154) took 1004 ms. Trace:
W20260709 13:17:36.584267 10100 consensus_meta.cc:287] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.826s	user 0.006s	sys 0.006s
I20260709 13:17:36.540138 10189 consensus_queue.cc:237] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:36.578663 10191 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:36.811554  9867 consensus_queue.cc:1059] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:36.440034 10195 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:36.816164  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 1111) took 1018 ms. Trace:
I20260709 13:17:36.566073 10194 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:36.440249 10247 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.104s
I20260709 13:17:36.816680  3192 rpcz_store.cc:276] 0709 13:17:35.797926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.406599 (+608673us) service_pool.cc:224] Handling call
0709 13:17:36.406940 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.497120 (+ 90180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.815478 (+318358us) spinlock_profiling.cc:243] Waited 85 ms on lock 0x7b5400036454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:36.815904 (+   426us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195520384}
I20260709 13:17:36.670583 10261 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:36.487353 10274 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:36.579253 10279 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:36.576820 10285 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:17:36.921197 10122 consensus_meta.cc:287] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.677s	user 0.007s	sys 0.017s
I20260709 13:17:36.666985 10253 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:36.921983 10122 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:36.923640  3042 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 22. Current term is 23. Ops: [22.11-22.11]
W20260709 13:17:36.730542  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 294704us
I20260709 13:17:36.926414  3049 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 19. Current term is 20. Ops: []
W20260709 13:17:36.783627 10204 consensus_meta.cc:287] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.929s	user 0.012s	sys 0.001s
I20260709 13:17:36.784649  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 3022) took 2058 ms. Trace:
I20260709 13:17:36.786196 10001 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:36.786291  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1304) took 1882 ms. Trace:
I20260709 13:17:36.789934 10158 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:36.595304 10098 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:36.927897  3119 rpcz_store.cc:276] 0709 13:17:34.758023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.758308 (+   285us) service_pool.cc:224] Handling call
0709 13:17:35.520433 (+762125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:35.570142 (+ 49709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.783911 (+1213769us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b540010de50. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:36.784295 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1647113600}
I20260709 13:17:36.809770  3197 rpcz_store.cc:276] 0709 13:17:35.804669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.495803 (+691134us) service_pool.cc:224] Handling call
0709 13:17:36.535586 (+ 39783us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.799960 (+264374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.808738 (+  8778us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:36.816069 10195 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:36.723699  3045 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 16 LEADER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:36.580420 10249 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:36.768261 10245 raft_consensus.cc:697] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:17:36.878656  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 60369.6us
I20260709 13:17:36.879200 10283 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:36.881112  3051 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:17:36.975068  3051 pending_rounds.cc:85] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 13
I20260709 13:17:36.975396  3051 pending_rounds.cc:107] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:17:36.900233  3191 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:17:36.905961  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 44095.6us
I20260709 13:17:36.908054  9973 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:36.927258  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1315) took 1258 ms. Trace:
I20260709 13:17:36.921308 10285 raft_consensus.cc:697] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:17:36.953665  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 65056.7us
I20260709 13:17:36.928188  3120 rpcz_store.cc:276] 0709 13:17:34.903376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.408320 (+504944us) service_pool.cc:224] Handling call
0709 13:17:35.669839 (+261519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:35.670017 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.670040 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:35.670078 (+    38us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:35.670118 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.670168 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.785893 (+1115725us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b540011c1d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:36.786095 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559388032}
W20260709 13:17:36.966334  3199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 3149) took 2664 ms (client timeout 3059 ms). Trace:
I20260709 13:17:36.968431 10245 consensus_queue.cc:237] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:36.969888 10078 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:36.928527 10204 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:36.976652  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46830us
I20260709 13:17:36.975754  3051 raft_consensus.cc:2889] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:36.985522  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3157) took 1159 ms. Trace:
I20260709 13:17:36.988806 10274 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.988288  3191 rpcz_store.cc:276] 0709 13:17:35.821413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.796150 (+974737us) service_pool.cc:224] Handling call
0709 13:17:36.797243 (+  1093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.976181 (+178938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.980941 (+  4760us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:36.987268  3123 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.009s	sys 0.002s
W20260709 13:17:36.983268  3199 rpcz_store.cc:269] 0709 13:17:34.231824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.473543 (+241719us) service_pool.cc:224] Handling call
0709 13:17:36.858211 (+2384668us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b540013bad4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:36.896533 (+ 38322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2283490688}
I20260709 13:17:36.994073 10285 consensus_queue.cc:237] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:36.994968  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:36.997159  9946 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:36.997927 10298 raft_consensus.cc:3055] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:17:36.998207  3123 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.009s	sys 0.003s
I20260709 13:17:37.006856 10204 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:37.007972 10261 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:37.011932  3091 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:37.012460  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:37.012674 10163 consensus_meta.cc:287] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.780s	user 0.025s	sys 0.002s
W20260709 13:17:37.013129  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.015192 10004 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:37.027050  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:36.998667 10298 raft_consensus.cc:740] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:36.989559 10274 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:37.051023 10298 consensus_queue.cc:260] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:37.053117 10298 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:37.054951  3196 consensus_meta.cc:287] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.012s
I20260709 13:17:37.056525  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:37.057909 10306 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.981791  3118 rpcz_store.cc:276] 0709 13:17:35.666946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.687336 (+ 20390us) service_pool.cc:224] Handling call
0709 13:17:35.687726 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:35.688113 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:17:35.695821 (+  7708us) log.cc:844] Serialized 14 byte log entry
0709 13:17:36.791506 (+1095685us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b18002ac940. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff5323a 00007ff8303bda2a
0709 13:17:36.920444 (+128938us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:36.921416 (+   972us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:36.922097 (+   681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.922638 (+   541us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.925634 (+  2996us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7860,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":755,"raft.run_cpu_time_us":523,"raft.run_wall_time_us":5487,"spinlock_wait_cycles":7612800,"thread_start_us":86133,"threads_started":1}
I20260709 13:17:37.058509 10316 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:37.058789 10306 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:36.991313 10279 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.063722  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:37.059374 10316 raft_consensus.cc:697] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:17:37.064047  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 52399.2us
I20260709 13:17:37.029327 10078 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:37.077884  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.071717  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:37.078799  3762 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:37.079440 10054 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:37.080152 10054 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:37.080523 10286 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.081475 10286 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:37.082109  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 50622us
I20260709 13:17:37.083607  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:37.080693 10054 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:37.084829 10286 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:37.068961 10279 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:37.072085 10283 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.096751  3797 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 930) took 2795 ms. Trace:
I20260709 13:17:37.097360  3797 rpcz_store.cc:276] 0709 13:17:34.293284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.293431 (+   147us) service_pool.cc:224] Handling call
0709 13:17:34.293785 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.574939 (+1281154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.086340 (+1511401us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54005c0154. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:37.088504 (+  2164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2944569728}
I20260709 13:17:37.075855 10078 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:37.087786 10204 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:37.100311 10306 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:37.117890 10314 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.118012 10312 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:37.118968  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 121189us
I20260709 13:17:37.135414  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:37.136724 10255 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 1.320s	user 0.002s	sys 0.000s
I20260709 13:17:37.137873  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 3031) took 1228 ms. Trace:
W20260709 13:17:37.139190 10277 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.575s	user 0.001s	sys 0.010s
W20260709 13:17:37.145381 10264 log.cc:927] Time spent T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.980s	user 0.000s	sys 0.004s
I20260709 13:17:37.122452 10316 consensus_queue.cc:237] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:37.163873  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:37.125204  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:37.164531 10312 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:37.126010 10183 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:37.165614 10183 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.166247 10183 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:37.166429  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:37.169083  3761 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:37.120623  3046 consensus_meta.cc:287] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.683s	user 0.020s	sys 0.008s
I20260709 13:17:37.170413  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:37.170774  3046 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:37.172505  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:37.172859  3046 raft_consensus.cc:1275] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:17:37.173350  3121 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:37.150880  3051 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:37.151428  3050 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:37.152920  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:37.154459  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:37.155211  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 44651.8us
W20260709 13:17:37.156525  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 73191.4us
I20260709 13:17:37.121621 10192 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:17:37.158962  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 51715.5us
I20260709 13:17:37.106294 10286 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:37.125684  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:37.116632 10283 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:37.170012 10312 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:37.191409  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:37.191619 10305 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:37.192889  9973 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:37.192584 10305 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:37.191077 10314 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:37.193573  9973 raft_consensus.cc:697] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:37.195960 10314 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:37.195381  9973 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:37.196624 10314 raft_consensus.cc:2764] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election decision vote started in defunct term 20: won
I20260709 13:17:37.198170 10078 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:37.198941 10305 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:37.219462 10098 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:17:37.219920 10179 consensus_queue.cc:1059] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:17:37.221427 10179 raft_consensus.cc:3055] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:37.221987 10179 raft_consensus.cc:740] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:37.223412 10179 consensus_queue.cc:260] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:37.225347 10179 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:37.226155  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:37.227851 10242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.013s	user 0.005s	sys 0.011s
W20260709 13:17:37.228725 10242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.043s	user 0.006s	sys 0.011s
I20260709 13:17:37.229796 10242 raft_consensus.cc:697] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:37.232810 10183 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:37.138437  3124 rpcz_store.cc:276] 0709 13:17:35.867104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.888479 (+ 21375us) service_pool.cc:224] Handling call
0709 13:17:35.888918 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.905509 (+ 16591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.905538 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:35.962172 (+ 56634us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.787762 (+825590us) spinlock_profiling.cc:243] Waited 911 us on lock 0x7b18003bf4a0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:17:36.896088 (+108326us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:36.915263 (+ 19175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.932050 (+ 16787us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:37.066483 (+134433us) raft_consensus.cc:1685] finished
0709 13:17:37.066505 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.095092 (+ 28587us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16101,"raft.queue_time_us":61306,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":28397,"spinlock_wait_cycles":2094336,"thread_start_us":58366,"threads_started":1,"wal-append.queue_time_us":1096976}
I20260709 13:17:37.263474 10312 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.267660 10312 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:37.270426 10306 consensus_queue.cc:1059] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:37.270895  3091 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:37.271667 10306 raft_consensus.cc:3055] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:37.272157 10306 raft_consensus.cc:740] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:37.272608  3091 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:37.273995  9986 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:17:37.274222  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 1.22611e+06us
I20260709 13:17:37.274271 10132 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:37.274755  9986 raft_consensus.cc:697] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:37.275184 10132 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:37.275950 10132 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:37.276391  9986 consensus_queue.cc:237] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:37.278775 10243 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:37.273463 10306 consensus_queue.cc:260] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:37.281877  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3489) took 2072 ms. Trace:
I20260709 13:17:37.286068  3043 rpcz_store.cc:276] 0709 13:17:35.141418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.310554 (+169136us) service_pool.cc:224] Handling call
0709 13:17:35.311140 (+   586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.804373 (+493233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.804409 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:35.827367 (+ 22958us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.357856 (+530489us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:36.357921 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.358029 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:37.138080 (+780051us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:37.158154 (+ 20074us) raft_consensus.cc:1685] finished
0709 13:17:37.158177 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.213653 (+ 55476us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86274,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":2856320,"thread_start_us":953536,"threads_started":2,"wal-append.queue_time_us":639083}
I20260709 13:17:37.287797 10121 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:37.288455 10121 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:37.288625  3121 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
I20260709 13:17:37.291750 10183 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:37.292371 10072 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:37.292842 10262 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:17:37.293470 10324 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:17:37.282696  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 1106) took 1488 ms. Trace:
I20260709 13:17:37.285137 10094 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:37.289403 10306 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:37.314980  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 70366.5us
W20260709 13:17:37.333907  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.336359  9256 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:37.338053  9256 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:37.338724  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:37.339151  3798 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:17:37.339946  9926 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.340344  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:37.340476  9926 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:37.341326  3799 raft_consensus.cc:2410] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:17:37.342368  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:37.343348 10071 raft_consensus.cc:993] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: : Instructing follower f20672b2852447a6bc1e137c4dd40904 to start an election
I20260709 13:17:37.344004 10071 raft_consensus.cc:1081] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Signalling peer f20672b2852447a6bc1e137c4dd40904 to start an election
I20260709 13:17:37.348605  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:37.350437  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:37.373160  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 3186) took 1262 ms. Trace:
I20260709 13:17:37.378508  3042 rpcz_store.cc:276] 0709 13:17:36.110587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.211161 (+100574us) service_pool.cc:224] Handling call
0709 13:17:36.211649 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:36.924196 (+712547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.372712 (+448516us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b540029cf54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:37.373064 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1636089088}
I20260709 13:17:37.385195 10200 raft_consensus.cc:2243] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.386003 10328 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:37.386947 10328 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:37.390743  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 51098.1us
I20260709 13:17:37.398304  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:37.399559 10078 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:37.399814  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:37.400542 10078 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:37.408620 10234 consensus_meta.cc:287] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.693s	user 0.016s	sys 0.007s
I20260709 13:17:37.409384 10234 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:37.411748 10309 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.401s	user 0.001s	sys 0.001s
I20260709 13:17:37.412770 10234 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:37.342659  9984 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.296697  3200 rpcz_store.cc:276] 0709 13:17:35.793699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.793880 (+   181us) service_pool.cc:224] Handling call
0709 13:17:35.794259 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.794700 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.794734 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:35.795324 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 13:17:35.949593 (+154269us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:36.038055 (+ 88462us) log.cc:844] Serialized 14 byte log entry
0709 13:17:37.273465 (+1235410us) spinlock_profiling.cc:243] Waited 9.8 ms on lock 0x7b1800446d40. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d240c0a 00007ff836980219 00007ff82d2c8a40 00007ff82d2c34e4 00007ff82d2c3455 00007ff8303ab060 00007ff8303bd716 00007ff8303ce287 00007ff8303ce208
0709 13:17:37.278325 (+  4860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.281993 (+  3668us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:37.282082 (+    89us) raft_consensus.cc:1685] finished
0709 13:17:37.282186 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.282456 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83904,"prepare.queue_time_us":74101,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":4927,"raft.queue_time_us":116,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":22539520,"thread_start_us":153611,"threads_started":1,"wal-append.queue_time_us":406604,"wal-append.run_cpu_time_us":3038,"wal-append.run_wall_time_us":1031700}
I20260709 13:17:37.405606 10245 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:37.435292 10230 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:37.338755  9256 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:37.472450 10230 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:37.474663  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 74971.1us
W20260709 13:17:37.482030  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.438151 10258 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:37.493188  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.493637  9979 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:37.494349  9979 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:37.495090 10078 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:37.496596  9979 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:37.497901 10200 raft_consensus.cc:2272] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.498665 10312 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:37.499536  9256 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:37.501397 10310 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.487s	user 0.000s	sys 0.003s
I20260709 13:17:37.503126 10078 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:37.510643  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 200061us
I20260709 13:17:37.504165  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1318) took 1179 ms. Trace:
I20260709 13:17:37.518651 10171 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.519506 10171 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:37.522111 10313 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.464s	user 0.002s	sys 0.002s
I20260709 13:17:37.477795 10245 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:37.493093  3790 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:37.505671  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 1114) took 1706 ms. Trace:
W20260709 13:17:37.506614  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.526472  3196 rpcz_store.cc:276] 0709 13:17:35.798777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.430291 (+631514us) service_pool.cc:224] Handling call
0709 13:17:36.430696 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.505165 (+1074469us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:17:37.505219 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:37.505269 (+    50us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:37.505317 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.505431 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.505607 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":449140,"raft.queue_time_us":451133,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121}
I20260709 13:17:37.508777 10132 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:37.509224  3193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 3158) took 1661 ms (client timeout 1969 ms). Trace:
I20260709 13:17:37.511965 10078 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:37.512931 10315 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.516s	user 0.001s	sys 0.000s
I20260709 13:17:37.518795  3122 rpcz_store.cc:276] 0709 13:17:36.324669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.325480 (+   811us) service_pool.cc:224] Handling call
0709 13:17:36.326938 (+  1458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:36.442095 (+115157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:36.442148 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:36.442797 (+   649us) log.cc:844] Serialized 26 byte log entry
0709 13:17:37.005699 (+562902us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:37.005898 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.006067 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:37.438296 (+432229us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:37.503682 (+ 65386us) raft_consensus.cc:1685] finished
0709 13:17:37.503706 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.503978 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":226788,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":13998,"spinlock_wait_cycles":37846272,"thread_start_us":286089,"threads_started":2,"wal-append.queue_time_us":488937}
I20260709 13:17:37.514077 10153 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.514932  3165 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:37.503679  9867 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:17:37.479622  9984 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:37.509936 10300 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.522226  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:37.504660  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:37.522179  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:37.535523  3193 rpcz_store.cc:269] 0709 13:17:35.848259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.908641 (+ 60382us) service_pool.cc:224] Handling call
0709 13:17:37.508802 (+1600161us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b540002add4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:37.509017 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1158911360}
I20260709 13:17:37.539757  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:37.547148  3799 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
W20260709 13:17:37.550061  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.545994  9256 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:37.535311 10122 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:37.543757 10189 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.058s	sys 0.108s
I20260709 13:17:37.547925  3117 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:37.555850  3797 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:37.468431 10242 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:37.554270 10189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.058s	sys 0.109s
I20260709 13:17:37.560045  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:37.548722 10171 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:37.555050 10153 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:37.587150 10153 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:37.558862 10004 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.587935 10098 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.587822 10004 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:37.588563 10098 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:37.589083 10122 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.589778 10122 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:37.590343  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:37.590831  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:37.591835  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:37.592470 10190 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:37.592872  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:37.593210  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:37.593483  3049 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:37.594352  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:37.595088  3198 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:37.595337 10098 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:37.596560  3191 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:17:37.591928 10122 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:37.573757 10245 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:37.594369  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:37.601298  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:37.539022 10274 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:37.584887 10073 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:37.604154  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 257009us
I20260709 13:17:37.550323 10300 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:37.617254  3196 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:37.587175  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:37.607028 10052 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:37.618605  3049 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:37.618060  9256 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:37.584898 10072 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:37.631542  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:37.631752  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:37.632336  3049 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 23: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:37.606739 10153 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:37.616397 10245 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:37.642591  3042 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:17:37.643752  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:37.646234  9926 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:37.649960 10274 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:37.650454  9984 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:37.650837  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:37.651485 10078 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:37.652140  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:37.652657  3762 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:37.652941  3051 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:37.654640 10282 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:37.655264 10300 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:37.655387 10325 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.655872 10300 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:37.656471 10300 raft_consensus.cc:697] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:37.656317 10325 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:37.655314 10282 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:37.658485  3193 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 13:17:37.659567  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 145020us
I20260709 13:17:37.660470  3165 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:37.661154 10230 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:37.663529 10230 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:37.635088  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:37.622653 10073 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:37.640054  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:37.665472 10245 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:37.683300  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:37.627763 10312 consensus_queue.cc:1059] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:17:37.640268 10189 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:37.697908  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:37.698333  3121 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 22. Current term is 23. Ops: [22.11-22.11]
I20260709 13:17:37.698696 10249 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:17:37.698796  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:37.699399  3118 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:37.699580  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:37.699735  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:37.701364  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:37.701946  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:37.702291 10283 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:37.699765 10299 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.706453  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:37.707515  3165 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:37.672820 10200 ts_tablet_manager.cc:1916] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:37.711980  9256 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:37.689713  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:37.680676 10004 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:37.657459 10300 consensus_queue.cc:237] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:37.686020  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:37.717940  3200 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:37.714249  3191 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:37.638806 10052 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:37.725445  3051 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:17:37.709982 10153 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:37.726089  3194 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:37.734232  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:37.681806 10121 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:37.731644 10001 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.011s	sys 0.031s
I20260709 13:17:37.740446  3196 raft_consensus.cc:2393] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 15: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:37.741004  3117 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 25. Current term is 26. Ops: [25.12-25.12]
I20260709 13:17:37.738255  3193 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 24.
I20260709 13:17:37.736052  9256 consensus_queue.cc:1059] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 13:17:37.720638 10204 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:37.729275 10171 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:37.686242 10072 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:37.755602  3197 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:37.740057 10001 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.012s	sys 0.032s
I20260709 13:17:37.759740  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:37.715325 10189 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:37.772620  3199 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:37.762554 10204 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:37.763388 10073 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:37.763499  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 86887.6us
I20260709 13:17:37.767393 10153 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:37.770704 10072 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:37.771515 10054 consensus_meta.cc:287] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.662s	user 0.011s	sys 0.003s
I20260709 13:17:37.773180  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:37.778259 10052 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:37.750568 10299 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:37.784341  3795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 1230) took 2145 ms. Trace:
I20260709 13:17:37.785404 10189 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:37.786502  3121 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:17:37.786979  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:37.788544  3126 raft_consensus.cc:2955] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Committing config change with OpId 19.11: config changed from index 5 to 11, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:37.790097  3194 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:37.793699  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:37.758083 10283 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:17:37.798676  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 115949us
I20260709 13:17:37.798929  3199 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
I20260709 13:17:37.803499  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:37.805866  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:37.804208  3124 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
I20260709 13:17:37.808394  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:37.818375  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:37.819710  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:37.823122  3050 raft_consensus.cc:2393] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:37.820526  3121 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:17:37.825881  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:37.826717  3119 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:17:37.794485  3795 rpcz_store.cc:276] 0709 13:17:35.639026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.639195 (+   169us) service_pool.cc:224] Handling call
0709 13:17:35.639533 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.641892 (+  2359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.641926 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:37.506541 (+1864615us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b2c00047618. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:17:37.507166 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 13:17:37.719172 (+212006us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:37.719232 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.719348 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:37.783888 (+ 64540us) raft_consensus.cc:1685] finished
0709 13:17:37.783909 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.784156 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1888,"raft.queue_time_us":2307,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":16933,"spinlock_wait_cycles":10438400,"thread_start_us":205137,"threads_started":1,"wal-append.queue_time_us":274900}
I20260709 13:17:37.794611 10054 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:37.822350  3091 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.129:44609 timed out after 1.524s (SENT) [suppressed 24 similar messages]
I20260709 13:17:37.831894  3118 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
W20260709 13:17:37.830637 10279 consensus_meta.cc:287] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.711s	user 0.016s	sys 0.003s
W20260709 13:17:37.871387  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 49077.8us
I20260709 13:17:37.874099 10071 consensus_queue.cc:1059] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:17:37.891942  3121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31"
dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
 from {username='slave'} at 127.0.0.1:54688
I20260709 13:17:37.892792  3121 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:37.893181  3121 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:37.903388 10325 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:37.905681  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1451) took 1555 ms. Trace:
I20260709 13:17:37.906164  3047 rpcz_store.cc:276] 0709 13:17:36.350736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.350906 (+   170us) service_pool.cc:224] Handling call
0709 13:17:36.351288 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.804854 (+453566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.905400 (+1100546us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54000c5654. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:37.905623 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040075520}
I20260709 13:17:37.922134 10244 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:37.922307 10282 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:37.939332  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 54113.6us
I20260709 13:17:37.940373  3121 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:37.942175  3042 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 13:17:37.944033  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 61285.1us
I20260709 13:17:37.872054 10245 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:37.945351  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 65871.1us
I20260709 13:17:37.945854  3123 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:37.945632 10163 consensus_queue.cc:1059] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:17:37.946378  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 66609.7us
W20260709 13:17:37.946316  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.946219 10073 raft_consensus.cc:3055] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:37.956748  3117 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 20: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:17:37.957671  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 77262.4us
I20260709 13:17:37.961093 10071 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:37.961252 10235 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:37.964066 10094 raft_consensus.cc:3055] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:37.965691 10328 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:37.825778 10283 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:37.988917  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:37.878933 10153 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.993968  3197 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:37.959570 10204 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:37.878245 10279 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.006584  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:38.016654  3048 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 22: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:38.017033  3761 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:37.989951 10073 raft_consensus.cc:740] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:38.000007 10183 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.044312  3761 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:38.049131  3124 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:17:38.032518 10175 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:38.055076  3122 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 17. Current term is 18. Ops: [17.7-17.7]
I20260709 13:17:38.055284 10223 consensus_queue.cc:1059] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:17:38.056030 10247 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:38.056552 10247 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.056615 10223 raft_consensus.cc:3055] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:38.057030 10247 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:38.057446 10132 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:38.057886  9874 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:38.058465  9874 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:38.058938  9874 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:38.056080 10253 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:38.030511  3165 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:38.032110 10100 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:38.063550  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 48312.4us
I20260709 13:17:38.064733  3165 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:38.066166 10171 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:38.066891 10171 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:17:38.061728  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 58416.1us
I20260709 13:17:38.068267  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:38.062484 10287 raft_consensus.cc:3055] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:38.070062 10287 raft_consensus.cc:740] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:38.069931 10274 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:38.071105 10287 consensus_queue.cc:260] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.072497 10287 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:38.073136  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:38.063174 10100 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:38.074065  9256 consensus_queue.cc:1059] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:38.074590 10071 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:17:38.074904  9256 raft_consensus.cc:3055] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:38.075337  9256 raft_consensus.cc:740] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:38.075819 10100 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:38.075525 10235 consensus_queue.cc:1048] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:38.000442 10094 raft_consensus.cc:740] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:38.076321  9256 consensus_queue.cc:260] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.077365 10094 consensus_queue.cc:260] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:38.071619 10274 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:38.079066 10094 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:38.079308 10274 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.079756 10274 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:38.082644 10337 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:38.086246 10171 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:38.087003 10100 consensus_queue.cc:1059] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:38.087731 10100 consensus_queue.cc:1243] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 23.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:17:38.088215 10171 raft_consensus.cc:3055] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:38.088625 10171 raft_consensus.cc:740] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:38.088917 10245 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:38.020457 10121 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:38.090083 10171 consensus_queue.cc:260] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.091063 10054 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:38.091722 10171 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:38.077572  9256 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:38.085991  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:38.096803 10258 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:38.097327 10258 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.097800 10258 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:38.098001  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:38.098966 10245 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:38.099407 10245 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.099757 10245 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:38.102356  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:38.104336 10283 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:38.105273  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:38.107520 10279 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:38.109032 10299 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:38.017109 10153 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.111783 10183 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:38.112697  3165 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:38.115367  3118 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:17:38.115818 10204 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:38.118438 10235 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:38.146834 10247 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:38.152974 10336 log.cc:927] Time spent T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.169s	user 0.000s	sys 0.003s
I20260709 13:17:38.078179 10073 consensus_queue.cc:260] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.127259  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:38.139350  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 51884.9us
I20260709 13:17:38.057204 10223 raft_consensus.cc:740] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:38.142475  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:38.154042  3124 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:38.144137  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:38.145999  3045 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
W20260709 13:17:38.122432  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.163658  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:38.027535  3121 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:38.171129  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.166096  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:38.173444  3049 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:38.174544  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:38.177893  3051 raft_consensus.cc:2410] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 26 because replica has last-logged OpId of term: 25 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 11.
I20260709 13:17:38.178910  3123 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:38.179989  3047 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:38.186873  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:38.154699 10121 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:17:38.154989 10204 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:38.197141  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.189047  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:38.200062  3045 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:38.201894  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:38.190227  3090 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:38.191988  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:38.202857  3050 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.203506  3090 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:38.210304  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:38.213236  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:38.212548 10283 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:38.217093  3798 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:17:38.217334  3795 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:17:38.219617 10073 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:38.222000 10247 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:38.222602  9926 raft_consensus.cc:3055] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:38.223066  9926 raft_consensus.cc:740] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:38.223801  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:38.224957 10100 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:38.225464 10100 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:38.226440  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 85182.2us
I20260709 13:17:38.226894 10100 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:38.189023 10094 consensus_queue.cc:1059] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:17:38.227393  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:38.214658 10171 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:38.225603  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:38.228786  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:38.228875  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:38.225880  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:38.213967  3124 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:17:38.229893  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:38.226567  3120 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 13:17:38.232282  3120 pending_rounds.cc:85] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 12
I20260709 13:17:38.232527  3120 pending_rounds.cc:107] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:17:38.232751  3120 raft_consensus.cc:2889] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:38.224890  3164 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:38.230517  3117 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:38.229058  3045 raft_consensus.cc:2376] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21. Re-sending same reply.
I20260709 13:17:38.243253 10283 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:38.246479 10072 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:17:38.247018  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 168179us
I20260709 13:17:38.247210  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:38.248210  3165 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:38.191882 10121 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.162058 10274 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.252192  3124 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 16. Ops: []
I20260709 13:17:38.255012  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:38.159489 10190 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 23.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:17:38.208937 10204 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:38.239972 10235 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:38.261607  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:38.263355  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:38.260002  3118 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 26: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:38.279747 10282 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:38.280001  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:38.280139  3165 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:38.257683 10283 raft_consensus.cc:697] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:38.267858 10287 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:17:38.281613  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:38.282238 10274 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:38.290066  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:38.249462 10132 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.292472  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:38.268489  3042 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:38.247012 10072 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.262287 10121 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:38.315419  9256 consensus_queue.cc:1059] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:38.267834 10337 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:38.192031 10296 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.069s
I20260709 13:17:38.320575  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:38.306587  3091 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:38.322332  3795 raft_consensus.cc:2393] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 23: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:38.323515  3043 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:38.322037 10072 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:38.327203  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:38.330096  3197 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
I20260709 13:17:38.331095  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:38.271447 10299 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:38.333652  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 53631us
I20260709 13:17:38.330284  3799 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
I20260709 13:17:38.338162  3797 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:17:38.332907 10242 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:38.342680 10242 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.332989 10223 consensus_queue.cc:260] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.347393 10223 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:38.334463 10132 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.352087 10132 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:38.352674 10299 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.354437 10153 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:38.307025 10286 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:38.355293 10286 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:38.356851 10283 consensus_queue.cc:237] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.359724 10200 ts_tablet_manager.cc:1929] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 13:17:38.360323 10200 log.cc:1199] T fcf5db67d30f487d873766886c2ef408 P f20672b2852447a6bc1e137c4dd40904: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-1-root/wals/fcf5db67d30f487d873766886c2ef408
I20260709 13:17:38.324318 10282 raft_consensus.cc:697] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:38.366847 10282 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:38.369931 10337 raft_consensus.cc:697] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:38.371074 10337 consensus_queue.cc:237] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:38.374522 10346 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:17:38.378161  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:38.379230  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 72790.3us
I20260709 13:17:38.380203  3091 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:38.388289  3117 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:38.405149  9874 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:38.407608  9874 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:38.408438 10200 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42724 (request call id 0) took 4647 ms. Trace:
I20260709 13:17:38.410501 10245 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.410785 10258 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.412672 10245 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:38.413887 10071 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:38.414324 10071 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:38.414686 10071 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:38.414785 10183 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:38.416095 10054 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:38.416543 10054 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.416872 10054 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:38.422829  3045 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:17:38.345002 10242 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:38.407608  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:38.405537 10286 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:38.429526  3121 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:17:38.434785  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:38.435976  3123 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:17:38.437409  3123 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:17:38.438186  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:38.439869 10249 raft_consensus.cc:3055] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:38.440289 10249 raft_consensus.cc:740] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:38.441294 10249 consensus_queue.cc:260] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:38.442631 10249 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:38.445170  3042 raft_consensus.cc:2410] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 18 because replica has last-logged OpId of term: 17 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 6.
I20260709 13:17:38.445278  3197 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 11. (term mismatch)
I20260709 13:17:38.445688  3197 pending_rounds.cc:85] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 10
I20260709 13:17:38.445911  3197 pending_rounds.cc:107] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 21.11
I20260709 13:17:38.446121  3197 raft_consensus.cc:2889] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:38.446427 10244 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.446897 10244 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.447260  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:38.447917  3195 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:38.408838 10200 rpcz_store.cc:276] 0709 13:17:33.931519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.045775 (+114256us) service_pool.cc:224] Handling call
0709 13:17:34.242524 (+196749us) ts_tablet_manager.cc:1151] Deleting tablet fcf5db67d30f487d873766886c2ef408
0709 13:17:34.242644 (+   120us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:17:37.838565 (+3595921us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:38.359574 (+521009us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:38.392636 (+ 33062us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3235887,"tablet-delete.queue_time_us":92486,"thread_start_us":92024,"threads_started":1}
I20260709 13:17:38.462843  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:38.466966  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:38.467830  3121 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:17:38.476197  3050 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
W20260709 13:17:38.482944  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 102841us
I20260709 13:17:38.483697  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:38.487382  3799 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:17:38.412688 10258 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:38.486502  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:38.491638  3120 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:38.501128  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:38.510808  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:38.512800  3091 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:38.525362  3051 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:17:38.529275  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:38.531423  3119 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.006s	sys 0.009s
I20260709 13:17:38.511868 10287 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:38.531847  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:38.537860  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.536051  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:38.535252  3119 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.006s	sys 0.010s
I20260709 13:17:38.532008  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:38.527086 10279 raft_consensus.cc:2764] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:17:38.547215  3797 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:17:38.554068  3050 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:17:38.555770  3048 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:38.514569 10132 consensus_queue.cc:1059] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:17:38.533499 10258 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:38.563179  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:38.535789 10296 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:38.605391  3123 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:38.605473 10296 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:38.606540  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:38.607350  3123 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 19: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:38.608099  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:17:38.565397  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.609156  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:38.560117 10245 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:38.565917 10078 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:17:38.610273 10245 raft_consensus.cc:697] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:38.567296 10242 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:38.611310 10245 consensus_queue.cc:237] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.608253 10296 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:38.568512 10121 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.569950 10153 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:38.615185  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:38.569463  3121 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
W20260709 13:17:38.617298 10350 log.cc:927] Time spent T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:17:38.570992 10274 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:38.572705  3120 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:38.562654 10235 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:17:38.618702  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:38.618817  9926 consensus_queue.cc:260] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.619732  3047 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 24. Current term is 25. Ops: [24.12-24.12]
I20260709 13:17:38.619983  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:38.620628  3120 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:38.572929  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:38.617479  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:38.577415  3051 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:17:38.621443  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:38.578482  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:17:38.623318  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.579051  3794 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:38.579248 10192 consensus_queue.cc:1059] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:38.585618 10279 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.556844 10287 raft_consensus.cc:697] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 21 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:38.598351 10244 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:38.616264 10073 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:17:38.622660  3120 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:17:38.565618  2934 catalog_manager.cc:5028] TS f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): tablet fcf5db67d30f487d873766886c2ef408 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:17:38.647715  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:38.648496  3199 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:38.647778  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:38.635068  3090 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:38.655508  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:38.656529  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:38.656486  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:38.660295  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.661358  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:38.661556  3090 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:38.661679  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:38.621582 10121 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:38.662133  3193 raft_consensus.cc:2376] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21. Re-sending same reply.
I20260709 13:17:38.669459  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:38.670210  3192 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:38.680882  3194 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
W20260709 13:17:38.673801  2934 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 108329us
I20260709 13:17:38.625883 10100 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.631559 10279 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.698065  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:38.696167  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 289651us
I20260709 13:17:38.705425  3191 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 22: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:38.662459 10339 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:38.653644 10296 consensus_queue.cc:1059] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:17:38.685729  3120 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:38.646565 10321 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
W20260709 13:17:38.696306  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 471471us
I20260709 13:17:38.670595 10223 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:38.696664  3196 raft_consensus.cc:3055] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:38.727620  3196 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:38.728483  9256 consensus_queue.cc:1059] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:38.648778 10286 consensus_queue.cc:1059] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:17:38.704582 10100 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:38.710177  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:38.711946  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.696358 10302 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.674600 10325 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:17:38.700412 10071 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:38.726222 10296 raft_consensus.cc:3055] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:17:38.731307  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.744753  3125 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
I20260709 13:17:38.731917  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:38.673496 10072 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.707144 10175 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:38.747053  3120 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:38.742381  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:38.741962  3199 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:17:38.738722 10054 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.750545  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:38.743851  3196 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:38.860709  3194 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
W20260709 13:17:38.851233  3762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.031s	sys 0.023s
W20260709 13:17:38.881286  3762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.031s	sys 0.023s
W20260709 13:17:38.881708  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 668175us
I20260709 13:17:38.750314 10286 raft_consensus.cc:3055] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:17:38.946590  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 96635.9us
I20260709 13:17:38.754033 10192 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.745844 10296 raft_consensus.cc:740] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:17:38.855334 10001 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.013s	sys 0.027s
W20260709 13:17:38.970834  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 88294.8us
I20260709 13:17:38.977907  3122 raft_consensus.cc:2393] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 23: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:38.978770  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:39.039692 10071 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:38.731631 10339 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:39.044764  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 301393us
I20260709 13:17:39.046685  3164 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:39.049348  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:39.051030  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:39.051735  3199 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:39.052771  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:39.054282 10279 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:39.056392 10072 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:39.057294 10072 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:38.745139 10204 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:39.059823 10204 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:38.969240 10286 raft_consensus.cc:740] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:39.061656 10286 consensus_queue.cc:260] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:39.063112 10286 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:38.804306 10132 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.070125 10132 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:39.072849 10132 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:39.074919 10054 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:39.075902 10192 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:39.079034 10192 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:39.080314 10296 consensus_queue.cc:260] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:39.081913 10296 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:38.746178 10302 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:39.088119 10302 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:39.090389  3196 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:39.093394 10258 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:39.093832 10001 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.013s	sys 0.028s
I20260709 13:17:39.094362 10258 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:39.095566  3762 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:39.097222  3795 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 22. Current term is 23. Ops: []
W20260709 13:17:39.100265  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.106768  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:39.107592  3194 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:39.107780 10258 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:39.112214  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.147655  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:38.837985 10287 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:39.176996  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 81533.3us
W20260709 13:17:39.203893  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.149370  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:39.048035  3164 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:39.231333  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 183371us
W20260709 13:17:39.245368  3799 consensus_meta.cc:287] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.623s	user 0.004s	sys 0.004s
W20260709 13:17:39.277451  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.287729  3799 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:39.291055  3196 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:17:39.286055  3120 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
W20260709 13:17:39.285133  3192 consensus_meta.cc:287] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.612s	user 0.009s	sys 0.000s
I20260709 13:17:39.292503  3192 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
W20260709 13:17:39.306452 10073 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 23 current term: 23 is higher.
I20260709 13:17:39.308182 10258 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:39.308923 10258 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:39.309815 10183 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:39.310349 10183 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:39.310799 10183 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:39.315701  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.321799  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:39.334290 10171 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.106s	user 0.012s	sys 0.065s
I20260709 13:17:39.342478  3191 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:39.339888  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:39.347446  3199 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 18: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:39.353590  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:39.358443  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:39.359807  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:39.338786 10190 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.011s	user 0.011s	sys 0.062s
W20260709 13:17:39.348675 10171 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.114s	user 0.012s	sys 0.066s
I20260709 13:17:39.375331  9926 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:39.379563  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 2721) took 1112 ms. Trace:
I20260709 13:17:39.380093  3122 rpcz_store.cc:276] 0709 13:17:38.267046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.449164 (+182118us) service_pool.cc:224] Handling call
0709 13:17:39.379312 (+930148us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b54001c3ed4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:39.379489 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1086048128}
I20260709 13:17:39.385031  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:39.385767  3199 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
I20260709 13:17:39.386828  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:39.387710  3199 raft_consensus.cc:2410] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 24 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 13:17:39.388525  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:39.390301  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:39.395725 10339 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:39.397934 10072 raft_consensus.cc:2764] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:17:39.398725 10073 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:39.399971 10258 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:39.411101  3049 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 3511) took 1596 ms (client timeout 1934 ms). Trace:
I20260709 13:17:39.412817  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:39.407294  3199 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:39.411716  3049 rpcz_store.cc:269] 0709 13:17:37.805008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.053062 (+248054us) service_pool.cc:224] Handling call
0709 13:17:39.397700 (+1344638us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b540028e454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:39.401410 (+  3710us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42705280}
W20260709 13:17:39.373399 10190 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.050s	user 0.011s	sys 0.062s
I20260709 13:17:39.420053  3194 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:39.421830 10299 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:39.416746 10073 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.422689 10073 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:39.427311 10163 consensus_queue.cc:1059] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:17:39.427922 10175 consensus_meta.cc:287] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.587s	user 0.009s	sys 0.000s
I20260709 13:17:39.428385 10175 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:39.428527 10163 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:39.429185  3120 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:39.434983 10299 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.441395  3191 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:39.422734  3194 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:17:39.406077 10171 raft_consensus.cc:697] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:39.439467 10072 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:17:39.416262 10132 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:39.481897  3045 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.040s	sys 0.025s
W20260709 13:17:39.443107 10283 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.083s	user 0.020s	sys 0.060s
I20260709 13:17:39.488237 10367 consensus_queue.cc:1059] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 15.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:17:39.488332 10132 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:39.460608 10183 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:39.495256 10132 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:39.495532 10183 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:39.484516  3045 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.041s	sys 0.025s
W20260709 13:17:39.489195 10283 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.129s	user 0.021s	sys 0.060s
I20260709 13:17:39.500149 10365 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:39.501273 10365 raft_consensus.cc:3055] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:39.501685 10365 raft_consensus.cc:740] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:39.502351 10073 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:39.502686 10365 consensus_queue.cc:260] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:39.505371 10073 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:39.490274 10223 consensus_meta.cc:287] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.750s	user 0.009s	sys 0.002s
I20260709 13:17:39.439771 10299 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:39.521231  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:39.513827  3119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.023s	sys 0.045s
W20260709 13:17:39.527941  3119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.988s	user 0.023s	sys 0.045s
W20260709 13:17:39.516693  3166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.229s	user 0.009s	sys 0.060s
W20260709 13:17:39.529560  3166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.268s	user 0.009s	sys 0.060s
W20260709 13:17:39.533196  3796 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.019s	user 0.020s	sys 0.008s
W20260709 13:17:39.534835  3796 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.021s	user 0.021s	sys 0.008s
I20260709 13:17:39.535254  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1330) took 1746 ms. Trace:
W20260709 13:17:39.515618 10337 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.986s	user 0.083s	sys 0.126s
I20260709 13:17:39.538786  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:39.539309  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.540055  3191 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 23: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:39.543793 10298 raft_consensus.cc:3055] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:39.544076 10299 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:39.544528 10298 raft_consensus.cc:740] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:39.524066 10365 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:17:39.535739  3119 rpcz_store.cc:276] 0709 13:17:37.789084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.832110 (+ 43026us) service_pool.cc:224] Handling call
0709 13:17:37.889845 (+ 57735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.890162 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:17:38.539922 (+649760us) log.cc:844] Serialized 14 byte log entry
0709 13:17:39.534879 (+994957us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:39.534940 (+    61us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:39.534996 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.535070 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.535197 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82038,"prepare.queue_time_us":646151,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":59,"thread_start_us":1555447,"threads_started":2}
I20260709 13:17:39.526533 10190 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:39.523113 10223 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:39.560302  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:39.545416 10337 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.083s	sys 0.127s
I20260709 13:17:39.572453  3042 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:39.572979  9940 raft_consensus.cc:3055] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:39.573581  9940 raft_consensus.cc:740] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:39.574195  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3524) took 1056 ms. Trace:
I20260709 13:17:39.574716  3042 rpcz_store.cc:276] 0709 13:17:38.517952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.524400 (+  6448us) service_pool.cc:224] Handling call
0709 13:17:38.539009 (+ 14609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.572904 (+1033895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.573941 (+  1037us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001f7054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:39.574133 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2376186624}
I20260709 13:17:39.577564  3199 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
W20260709 13:17:39.555660  3198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.016s	user 0.013s	sys 0.055s
W20260709 13:17:39.579068  3198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.013s	sys 0.055s
I20260709 13:17:39.561815  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:39.580554  3196 raft_consensus.cc:2376] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21. Re-sending same reply.
I20260709 13:17:39.581319  3191 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:39.581617  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2615) took 1886 ms. Trace:
I20260709 13:17:39.599468  3191 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:39.602087  3199 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 13:17:39.605059  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 3056) took 1450 ms. Trace:
I20260709 13:17:39.605567  3117 rpcz_store.cc:276] 0709 13:17:38.157987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.242432 (+ 84445us) service_pool.cc:224] Handling call
0709 13:17:38.264972 (+ 22540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.394976 (+130004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.604775 (+1209799us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b540045a1d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:39.605002 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282921344}
I20260709 13:17:39.602596  3199 pending_rounds.cc:85] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 14
I20260709 13:17:39.608405  3199 pending_rounds.cc:107] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 13:17:39.608747  3199 raft_consensus.cc:2889] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:39.609218  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:39.604617 10282 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.007s	sys 0.016s
I20260709 13:17:39.613821  3126 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:17:39.614377  3196 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:39.574846  9940 consensus_queue.cc:260] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:39.587527  3198 rpcz_store.cc:276] 0709 13:17:37.694802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.700141 (+  5339us) service_pool.cc:224] Handling call
0709 13:17:37.700529 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:37.715822 (+ 15293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:37.715884 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:37.735283 (+ 19399us) log.cc:844] Serialized 26 byte log entry
0709 13:17:38.029584 (+294301us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:38.529013 (+499429us) log.cc:844] Serialized 14 byte log entry
0709 13:17:39.579745 (+1050732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.579880 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:39.581434 (+  1554us) raft_consensus.cc:1685] finished
0709 13:17:39.581447 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.581568 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10570,"prepare.queue_time_us":1242535,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":215659,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":9842,"thread_start_us":1611241,"threads_started":3,"wal-append.queue_time_us":440834,"wal-append.run_cpu_time_us":3761,"wal-append.run_wall_time_us":1363928}
I20260709 13:17:39.620946  9940 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:39.625991  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:39.626791  3015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.050s	user 0.020s	sys 0.031s
W20260709 13:17:39.627203  3015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.020s	sys 0.031s
W20260709 13:17:39.627733  3090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.008s	sys 0.006s
W20260709 13:17:39.615469 10282 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.007s	sys 0.016s
W20260709 13:17:39.628950  3091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.003s	sys 0.011s
I20260709 13:17:39.628587  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:39.628118  3090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.008s	sys 0.006s
W20260709 13:17:39.630057  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 968512us
I20260709 13:17:39.630893  3090 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:39.629410  3091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.004s	sys 0.011s
W20260709 13:17:39.631668  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 948314us
I20260709 13:17:39.633582  3121 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 23.
W20260709 13:17:39.628367 10148 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.016s	sys 0.008s
I20260709 13:17:39.581475 10190 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:39.642217  3196 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
W20260709 13:17:39.646857  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:39.643903  9256 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.006s	sys 0.009s
I20260709 13:17:39.651502  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:39.587482 10171 consensus_queue.cc:237] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:39.634681  9984 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.057s	user 0.003s	sys 0.011s
I20260709 13:17:39.636794  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:39.641609 10153 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:17:39.656831  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.611234 10298 consensus_queue.cc:260] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:39.652916  9256 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.007s	sys 0.009s
I20260709 13:17:39.658722  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1336) took 1017 ms. Trace:
I20260709 13:17:39.661958  3120 rpcz_store.cc:276] 0709 13:17:38.641042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.320507 (+679465us) service_pool.cc:224] Handling call
0709 13:17:39.320878 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.429553 (+108675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.658515 (+228962us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54000ba4d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:39.658665 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248659200}
I20260709 13:17:39.656005  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:17:39.664415  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:39.642156 10148 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.016s	sys 0.008s
W20260709 13:17:39.654734  9984 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.077s	user 0.003s	sys 0.012s
I20260709 13:17:39.658078  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1340) took 1003 ms. Trace:
I20260709 13:17:39.657933 10153 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:39.676113 10153 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:39.658810 10299 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:39.678228 10299 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:39.678792 10299 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:39.684670 10249 raft_consensus.cc:3055] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:17:39.685376 10249 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:39.674717  3122 rpcz_store.cc:276] 0709 13:17:38.654347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.381143 (+726796us) service_pool.cc:224] Handling call
0709 13:17:39.381511 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.400833 (+ 19322us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:17:39.420960 (+ 20127us) log.cc:844] Serialized 14 byte log entry
0709 13:17:39.504901 (+ 83941us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b1800380aa0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:17:39.657584 (+152683us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:39.657662 (+    78us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:39.657756 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.657847 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.658003 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20261,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":92,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":2335,"spinlock_wait_cycles":15312640,"thread_start_us":225080,"threads_started":1}
I20260709 13:17:39.686545 10249 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:39.688220 10249 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:17:39.693584  3091 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:39.695082 10282 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:39.695353  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 2718) took 1440 ms. Trace:
I20260709 13:17:39.695508 10282 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.695921 10282 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:39.695768  3118 rpcz_store.cc:276] 0709 13:17:38.255350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.319893 (+ 64543us) service_pool.cc:224] Handling call
0709 13:17:39.695118 (+1375225us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400216954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:39.695257 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3036426112}
I20260709 13:17:39.697125  3795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 852) took 1341 ms. Trace:
I20260709 13:17:39.641453 10337 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:17:39.697535  3795 rpcz_store.cc:276] 0709 13:17:38.355505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.355937 (+   432us) service_pool.cc:224] Handling call
0709 13:17:38.356437 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.097826 (+741389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.696844 (+599018us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b54005c0dd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:39.697043 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1703060352}
I20260709 13:17:39.674463  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:39.700819  3198 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:39.706542  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:39.699837 10366 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:39.697758 10100 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.710964  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:39.710747 10366 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:39.721678  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.730762  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:39.706877 10298 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:39.735908  3195 raft_consensus.cc:2368] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18.
W20260709 13:17:39.737303  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.754510  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:39.754913  3200 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.028s	user 0.009s	sys 0.027s
I20260709 13:17:39.755558  3191 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 22: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:17:39.724200 10245 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.972s	user 0.000s	sys 0.021s
W20260709 13:17:39.758958  3200 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.009s	sys 0.027s
I20260709 13:17:39.756181  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1335) took 1115 ms. Trace:
I20260709 13:17:39.761773  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:39.766882  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 408520us
I20260709 13:17:39.732797 10100 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:39.761307  3125 rpcz_store.cc:276] 0709 13:17:38.640651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.314630 (+673979us) service_pool.cc:224] Handling call
0709 13:17:39.315054 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.315306 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:17:39.315660 (+   354us) log.cc:844] Serialized 14 byte log entry
0709 13:17:39.755782 (+440122us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:39.755846 (+    64us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:39.755900 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.755976 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.756117 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1313,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":814,"thread_start_us":438930,"threads_started":1}
W20260709 13:17:39.759905 10245 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.000s	sys 0.021s
W20260709 13:17:39.756637 10001 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.015s	sys 0.011s
I20260709 13:17:39.781400  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:39.757108 10223 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:39.788053  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:39.768915  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:39.789492  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3522) took 1577 ms. Trace:
I20260709 13:17:39.789978  3047 rpcz_store.cc:276] 0709 13:17:38.212047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.286396 (+ 74349us) service_pool.cc:224] Handling call
0709 13:17:38.295268 (+  8872us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:38.620148 (+324880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.789247 (+1169099us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b54003c32d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:39.789435 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745589504}
I20260709 13:17:39.807193 10366 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:17:39.808192 10337 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:39.808796 10337 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:39.809280 10337 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:39.815228 10190 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:39.818502 10100 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:39.820833 10376 log.cc:927] Time spent T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:17:39.822733  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3531) took 1187 ms. Trace:
I20260709 13:17:39.823249  3045 rpcz_store.cc:276] 0709 13:17:38.635155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.635585 (+   430us) service_pool.cc:224] Handling call
0709 13:17:38.636030 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:38.646232 (+ 10202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.646280 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:38.654327 (+  8047us) log.cc:844] Serialized 26 byte log entry
0709 13:17:39.496132 (+841805us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:39.496176 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.496265 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:39.822430 (+326165us) raft_consensus.cc:1685] finished
0709 13:17:39.822462 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.822653 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1094,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5046,"thread_start_us":811258,"threads_started":1,"wal-append.queue_time_us":988404}
W20260709 13:17:39.826063 10364 log.cc:927] Time spent T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 13:17:39.827909  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:39.784622 10001 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.015s	sys 0.011s
I20260709 13:17:39.871992  3195 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 16. Current term is 17. Ops: []
W20260709 13:17:39.879145  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 110759us
I20260709 13:17:39.888165  3195 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:17:39.845158 10245 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:39.906418  3761 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.027s	sys 0.055s
W20260709 13:17:39.909853  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:39.907369  3761 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.027s	sys 0.055s
I20260709 13:17:39.913825  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:39.918571  3795 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 17. Current term is 18. Ops: []
W20260709 13:17:39.914040  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 1.00014e+06us
I20260709 13:17:39.922700  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2726) took 1587 ms. Trace:
I20260709 13:17:39.922840  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:39.923494  3125 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:39.923211  3126 rpcz_store.cc:276] 0709 13:17:38.335590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.439211 (+103621us) service_pool.cc:224] Handling call
0709 13:17:39.604957 (+1165746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.614422 (+  9465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.922497 (+308075us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540045a1d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:39.922644 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2680295168}
I20260709 13:17:39.927567  3194 raft_consensus.cc:2368] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16.
W20260709 13:17:39.913661 10300 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.028s	sys 0.049s
W20260709 13:17:39.937047 10300 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.028s	sys 0.050s
I20260709 13:17:39.945571  3195 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:17:39.945971  3762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.009s	sys 0.033s
W20260709 13:17:39.946900  3762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.009s	sys 0.033s
W20260709 13:17:39.947669  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 595652us
I20260709 13:17:39.906587 10282 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:39.931667 10375 raft_consensus.cc:3055] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:39.956336  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:39.958966  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:39.914553 10190 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 13:17:39.961434  3126 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:39.963066  3195 raft_consensus.cc:2376] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21. Re-sending same reply.
I20260709 13:17:39.905954 10245 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:39.968281  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.970727  3118 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:39.938966 10385 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:39.971778  3125 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 23.
I20260709 13:17:39.982944 10244 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:39.983757  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.983595 10244 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
W20260709 13:17:39.984310  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.985872 10244 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:39.958196 10375 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:39.986843  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:39.998507  3191 raft_consensus.cc:2410] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:17:40.000041  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:40.005904  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.006906  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 341697us
I20260709 13:17:40.009274  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:17:40.009496  3090 leader_election.cc:336] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 1.563s (SENT)
I20260709 13:17:40.010104  3122 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:39.973119 10368 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.222s	user 0.003s	sys 0.001s
I20260709 13:17:40.012679  3045 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:40.014319  3126 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:40.003039  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:40.017725  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:40.026214  3124 raft_consensus.cc:1240] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:17:40.026098  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:40.028043  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:40.029366  3191 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 16: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:40.031126  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:40.036049  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:40.037024  3047 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 22: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:40.037998  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:40.038300  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:40.038842  3050 raft_consensus.cc:1813] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Handling vote request from an unknown peer 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:40.039346  3048 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:40.039724  3050 raft_consensus.cc:2410] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:17:40.040920  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:40.041467  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:40.041869  3051 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 21: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:40.043080  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:40.044257  3050 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:40.044848  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:40.045848  3044 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 18: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:40.046106  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:40.046876  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:40.047518  3050 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:40.048028  3044 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 22: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:40.048982  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:40.050381  3046 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:40.051728  3046 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 17. Current term is 18. Ops: []
W20260709 13:17:40.053637  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.031153  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:40.060053  3120 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 18: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:40.061457  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:40.063474  3047 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:40.065536  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:40.065557  3797 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:40.067720  3043 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:17:40.067982  3045 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:40.071871  3044 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 18: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:40.072345  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:17:40.073931  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 410107us
I20260709 13:17:40.074903  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:40.076105  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 48252.7us
I20260709 13:17:39.996212 10365 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:39.996147 10385 raft_consensus.cc:697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:40.081708  3050 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:40.082082  3118 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 22: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:40.085070  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:40.018208 10192 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.091212  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:40.101450  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:40.097481  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:40.102635  3050 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:40.103539  3125 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 22: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:40.094363 10365 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:40.105441  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 95993.8us
I20260709 13:17:40.003345  9874 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.115355  9874 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:40.118409  9874 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:40.076728 10100 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.109629 10148 consensus_queue.cc:1059] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:17:40.132622 10148 raft_consensus.cc:3055] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:40.125430 10190 consensus_queue.cc:1059] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:17:40.133225 10148 raft_consensus.cc:740] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:40.133708 10190 raft_consensus.cc:3055] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:40.134186 10190 raft_consensus.cc:740] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:40.134379  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2633) took 1460 ms. Trace:
I20260709 13:17:40.134485 10148 consensus_queue.cc:260] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:40.134892  3193 rpcz_store.cc:276] 0709 13:17:38.673723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.391301 (+717578us) service_pool.cc:224] Handling call
0709 13:17:39.391612 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:39.410676 (+ 19064us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.410710 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:39.435833 (+ 25123us) log.cc:844] Serialized 26 byte log entry
0709 13:17:39.894245 (+458412us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:39.894304 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.894398 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.134126 (+239728us) raft_consensus.cc:1685] finished
0709 13:17:40.134147 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.134305 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8696,"raft.queue_time_us":109079,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":434455,"threads_started":1,"wal-append.queue_time_us":647174}
I20260709 13:17:40.136085 10148 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:40.069877  9984 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:40.131839  3125 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:40.140473  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:40.090008 10273 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.137498 10190 consensus_queue.cc:260] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:40.149940  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:40.150784  3193 raft_consensus.cc:2368] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21.
I20260709 13:17:40.150840 10190 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:40.111598 10192 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:40.153105  3121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55318 (request call id 1337) took 1511 ms (client timeout 1571 ms). Trace:
I20260709 13:17:40.153230  3123 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:40.153836 10388 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.154043  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:40.154500 10388 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:40.158200 10369 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:40.157847  9984 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:40.159484 10390 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 13:17:40.160439 10378 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:17:40.160538  9984 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:40.161693 10386 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 13:17:40.162138  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.030717 10299 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:40.153584  3121 rpcz_store.cc:269] 0709 13:17:38.641338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.647754 (+  6416us) service_pool.cc:224] Handling call
0709 13:17:40.152890 (+1505136us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b5400301bd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:40.153045 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2114874624}
I20260709 13:17:40.154994  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2732) took 1643 ms. Trace:
I20260709 13:17:40.167166  3796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 968) took 1760 ms. Trace:
I20260709 13:17:40.165725  3123 rpcz_store.cc:276] 0709 13:17:38.511782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.003125 (+491343us) service_pool.cc:224] Handling call
0709 13:17:40.153049 (+1149924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:40.153690 (+   641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.154837 (+  1147us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b5400301bd0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:40.154943 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1880891776}
I20260709 13:17:40.154944 10192 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:40.176856  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:40.130795 10244 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:17:40.192442  3045 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:17:40.174628  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:17:40.196446  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.167573  3796 rpcz_store.cc:276] 0709 13:17:38.407177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.407347 (+   170us) service_pool.cc:224] Handling call
0709 13:17:38.407847 (+   500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:38.449466 (+ 41619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.449501 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:38.467547 (+ 18046us) log.cc:844] Serialized 26 byte log entry
0709 13:17:39.535259 (+1067712us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:39.535340 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.535408 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:39.927152 (+391744us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:40.162146 (+234994us) raft_consensus.cc:1685] finished
0709 13:17:40.162170 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.167103 (+  4933us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17978,"raft.queue_time_us":41956,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":15408,"spinlock_wait_cycles":3692928,"thread_start_us":1021074,"threads_started":1,"wal-append.queue_time_us":1210427}
I20260709 13:17:40.207409  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:40.208550  3191 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 24: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:40.210080  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:40.211364  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.210800  3045 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 15.
I20260709 13:17:40.216104  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:40.216486  3044 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:17:40.216881  9256 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.165971 10388 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:40.217448  9256 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:40.195063 10235 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.219573  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:40.220444  3191 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:40.220963  3121 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:40.221544  3043 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16. Ops: []
W20260709 13:17:40.222177  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 92404.1us
I20260709 13:17:40.222745 10244 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:40.222529 10235 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:40.223134 10244 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.223260  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:40.223546 10244 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:40.224751 10235 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:40.224850  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:40.222523 10377 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:40.226323 10384 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:17:40.226994 10399 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:40.227687 10399 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.227203 10385 consensus_queue.cc:237] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:40.228176 10399 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:17:40.230440 10389 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:17:40.225941 10377 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:40.235519 10377 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:40.237661  3118 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 17. Current term is 18. Ops: [17.7-17.7]
I20260709 13:17:40.239279  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:40.239720 10399 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:40.163759 10396 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:17:40.148626 10100 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:40.165079 10273 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:40.300836  3191 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
W20260709 13:17:40.303766  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.309880  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 1115) took 1243 ms. Trace:
W20260709 13:17:40.523890  3122 consensus_meta.cc:287] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.000s
W20260709 13:17:40.516961  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 437575us
I20260709 13:17:40.524464  3122 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:40.242082  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:40.525261  9874 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:40.326056  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:40.527459  3762 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:40.528033  3193 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:40.512811  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:40.528988  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:40.529485  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:40.529831  3193 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:40.302568  3195 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:17:40.530102  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:40.257571 10366 consensus_queue.cc:1059] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.273s
I20260709 13:17:40.530926  3046 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
I20260709 13:17:40.531185  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:40.531826  9984 raft_consensus.cc:3055] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:40.532486  3048 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:40.300838  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:40.283601  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:40.301630  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:40.536082  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:40.532243  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 307439us
I20260709 13:17:40.537602 10372 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:40.531988  3195 raft_consensus.cc:2368] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22.
I20260709 13:17:40.539304  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:40.540902  3196 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
W20260709 13:17:40.293603  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.532033  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 310363us
I20260709 13:17:40.529158  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:40.530762  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:40.259279  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:40.523531  3192 rpcz_store.cc:276] 0709 13:17:39.066964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.405141 (+338177us) service_pool.cc:224] Handling call
0709 13:17:39.435174 (+ 30033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:39.490632 (+ 55458us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:17:39.545252 (+ 54620us) log.cc:844] Serialized 14 byte log entry
0709 13:17:39.976115 (+430863us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:40.003888 (+ 27773us) log.cc:844] Serialized 26 byte log entry
0709 13:17:40.004124 (+   236us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:40.004448 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 13:17:40.018667 (+ 14219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.018744 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.309546 (+290802us) raft_consensus.cc:1685] finished
0709 13:17:40.309576 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.309803 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79777,"prepare.queue_time_us":53192,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":4051,"raft.queue_time_us":45239,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":52578,"spinlock_wait_cycles":49142400,"thread_start_us":385606,"threads_started":1,"wal-append.queue_time_us":649482}
I20260709 13:17:40.545804  3123 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 14.
I20260709 13:17:40.543594  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:40.540324  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:40.545660  3193 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:40.532305  9984 raft_consensus.cc:740] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:40.300740  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:17:40.554194  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.555012  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.555469  3165 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:40.328655  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.550881  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:40.559440  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:40.485647 10388 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.242559 10398 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:40.561896  3196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:17:40.581322  3196 raft_consensus.cc:606] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:40.581203 10398 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:40.581686  3196 raft_consensus.cc:614] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:40.562323  9984 consensus_queue.cc:260] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:40.562597 10366 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:17:40.583066  9984 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:40.562649  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:40.583477 10398 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:40.585668 10399 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:40.585906 10388 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:40.299777 10405 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:17:40.587370  3194 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 23: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:40.546890  9874 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:40.588802  9874 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.588996 10388 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:40.589183  9874 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:40.592237 10400 log.cc:927] Time spent T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.368s	user 0.001s	sys 0.001s
I20260709 13:17:40.329114 10274 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:17:40.328631 10249 consensus_meta.cc:287] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.640s	user 0.014s	sys 0.000s
I20260709 13:17:40.565250 10404 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:40.565654  3761 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:40.566118 10302 consensus_queue.cc:1059] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:40.567145  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:40.306070 10365 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:40.570013 10407 consensus_queue.cc:1059] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:17:40.570361  3198 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:40.579276 10244 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:40.580518 10148 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:40.563695 10414 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:40.204547 10223 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:40.320976 10337 consensus_meta.cc:287] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.511s	user 0.006s	sys 0.003s
I20260709 13:17:40.612320 10377 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.614454  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:17:40.321676 10153 consensus_meta.cc:287] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.645s	user 0.013s	sys 0.000s
I20260709 13:17:40.219105 10296 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.589604 10388 raft_consensus.cc:3055] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:40.651929  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:40.652269  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.654664  3046 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 22: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:40.467311 10171 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.558962 10283 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:17:40.658586  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 101088us
I20260709 13:17:40.326728 10299 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:40.659111  3197 raft_consensus.cc:2410] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 26 because replica has last-logged OpId of term: 25 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 11.
I20260709 13:17:40.327316 10282 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:40.661410  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 95838.3us
I20260709 13:17:40.663563  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:40.664117  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.666257  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.723407  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.675429  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.715606  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.650105 10274 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:40.726325 10274 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:40.599258 10001 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 13:17:40.680017 10404 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:40.731842  3048 raft_consensus.cc:2393] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:40.680231 10287 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.195575 10375 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:40.739161  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 183754us
I20260709 13:17:40.737835  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:40.746397  3165 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:40.747622  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:40.717520 10388 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:40.719327 10414 raft_consensus.cc:697] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:40.754184  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:40.757469  3196 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:40.755121  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:40.761190  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:40.764608  3195 raft_consensus.cc:2393] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 16: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:40.766511  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:40.767725  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.768659  3761 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:40.765918 10235 consensus_queue.cc:1175] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "501fdf2af2bc4b0c971ae880e98f466b" responder_term: 20 status { last_received { term: 19 index: 12 } last_committed_idx: 12 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:40.771508  3195 raft_consensus.cc:2410] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 22 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:17:40.770457  9940 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:40.742138 10283 raft_consensus.cc:697] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:40.774487  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:40.776185  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:40.723932 10296 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:40.723709 10377 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:40.718843 10337 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:40.739078 10300 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:40.785050  3165 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:40.723515 10153 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:40.729559 10223 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:40.720788 10171 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:40.774453  9940 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:40.779551  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 224765us
I20260709 13:17:40.763995 10375 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:40.762811 10001 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.792325  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:40.816802  3195 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:40.766633 10148 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:40.771986 10299 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:40.795754  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 239790us
I20260709 13:17:40.796548  3165 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:40.795759  3796 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:40.779838 10245 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:40.811964  3121 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
W20260709 13:17:40.814213  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 132772us
I20260709 13:17:40.750545 10287 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:40.815755  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:40.832217  3120 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:40.837472  3123 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 22. Current term is 23. Ops: [21.15-22.16]
I20260709 13:17:40.839335  3191 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:40.840894  3196 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 25.
I20260709 13:17:40.819718  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:40.822321  3164 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:40.811240  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0409782990000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
W20260709 13:17:40.847893  3015 connection.cc:256] RPC call timeout handler was delayed by -1.0265782989999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
I20260709 13:17:40.798986 10190 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:40.857784  3193 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 16: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:40.863406  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:40.816421  9940 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:40.865051  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:40.868641  3165 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:40.866000 10249 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:17:40.874272 10412 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:17:40.874836  9256 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:40.876817 10358 raft_consensus.cc:3055] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:40.877296 10358 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:40.858832 10190 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:40.878363 10190 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:40.882364 10422 consensus_queue.cc:1059] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:17:40.883689 10422 consensus_queue.cc:1059] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 17.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:40.884531 10422 raft_consensus.cc:3055] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:40.884882 10422 raft_consensus.cc:740] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:17:40.882395 10421 log.cc:927] Time spent T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:17:40.885946 10283 consensus_queue.cc:237] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:40.887055 10422 consensus_queue.cc:260] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:40.888950  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:40.889783  3119 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 16: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:40.890482 10422 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:40.891597 10153 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:40.892560 10244 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:40.894440 10296 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:40.894624 10148 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:40.895030 10148 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:40.895417 10148 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:40.897267 10223 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:40.893580  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 72712.8us
I20260709 13:17:40.874756  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:40.890640  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:40.900540  3119 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
W20260709 13:17:40.908368  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.923261  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:40.924149  3196 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 22: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:17:40.924958  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 79859.5us
W20260709 13:17:40.926182  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 57669.9us
I20260709 13:17:40.927698  9256 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.928284  9256 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:40.930558  9256 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:40.931370  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:40.926153  3090 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:40.933956  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:40.935292  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:40.935684  9256 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.936411  9256 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:40.936721  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:40.932080  3193 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:40.944546  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:40.945940  3117 raft_consensus.cc:2410] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:17:40.799163 10300 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:40.947522 10425 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.948300 10379 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.948207 10425 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:40.949085 10379 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:40.951428  9256 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:40.952150 10379 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:40.952915 10415 log.cc:927] Time spent T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:17:40.946452 10418 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.890548 10377 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:40.954483 10418 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:40.955452 10377 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:40.956473 10377 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:40.957700 10418 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:40.964777  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:40.966634  3796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:17:40.968109  3796 raft_consensus.cc:606] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:40.970417  3117 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 22: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:40.974431 10358 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:40.976298 10358 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:40.824456 10001 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:40.980260 10001 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:40.992529 10397 log.cc:927] Time spent T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.768s	user 0.005s	sys 0.001s
I20260709 13:17:40.994251 10100 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:40.996328 10337 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:40.820696 10388 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:40.943969 10423 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:17:41.002329 10423 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:41.003511 10423 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:40.836894 10299 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:41.008340 10299 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:41.011560  9874 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:41.013245  3795 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:40.932425 10249 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:40.938131 10369 consensus_queue.cc:1059] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 15.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:17:40.867551 10414 consensus_queue.cc:237] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:41.023222 10171 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:41.027360  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:41.029340  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 82884.4us
I20260709 13:17:41.048853  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:40.942700  3090 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:41.005481 10423 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:41.026783 10223 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:17:41.059206 10287 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:41.061146  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3175) took 1450 ms. Trace:
I20260709 13:17:41.064631 10425 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:41.075382  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:41.079763  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 3183) took 1370 ms. Trace:
I20260709 13:17:41.115398  3197 rpcz_store.cc:276] 0709 13:17:39.709345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.709475 (+   130us) service_pool.cc:224] Handling call
0709 13:17:41.079572 (+1370097us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54000429d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:41.079703 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2176322816}
W20260709 13:17:41.116060  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 347503us
W20260709 13:17:41.080917 10380 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 1.141s	user 0.000s	sys 0.005s
I20260709 13:17:41.084514  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 3537) took 1079 ms. Trace:
I20260709 13:17:41.119071  3049 rpcz_store.cc:276] 0709 13:17:40.005111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.005302 (+   191us) service_pool.cc:224] Handling call
0709 13:17:41.084293 (+1078991us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b540029ca54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:41.084448 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1607461248}
I20260709 13:17:41.087479  3195 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
W20260709 13:17:41.089157  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 147466us
W20260709 13:17:41.092453  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 43735.2us
I20260709 13:17:41.112988  3199 rpcz_store.cc:276] 0709 13:17:39.610696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.610861 (+   165us) service_pool.cc:224] Handling call
0709 13:17:39.627155 (+ 16294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.660755 (+ 33600us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:39.666153 (+  5398us) log.cc:844] Serialized 14 byte log entry
0709 13:17:39.968766 (+302613us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:39.968838 (+    72us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:39.968899 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.590430 (+621531us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b48001b0258. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff8352dcaa1 00007ff8352d3b37 00007ff8352d39ca 00007ff8353cb26f 00007ff8353caf37 00007ff8353df55c 00007ff8353df508 00007ff8353df488 00007ff8353df443 00007ff8353de6ec 00007ff834308a96
0709 13:17:41.060906 (+470476us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b54001b85d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:41.060957 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.061085 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5192,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":4948,"raft.run_cpu_time_us":3436,"raft.run_wall_time_us":617198,"spinlock_wait_cycles":106849920,"thread_start_us":298850,"threads_started":1,"wal-append.queue_time_us":464947}
I20260709 13:17:41.116863  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:17:41.119664  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 294013us
I20260709 13:17:41.123700  3195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:17:41.128415  3195 raft_consensus.cc:606] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:41.128770  3195 raft_consensus.cc:614] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:41.129859  3091 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:41.131574  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:41.116398 10100 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:41.135946  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:41.122727  3122 raft_consensus.cc:2955] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:41.132465  3795 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:41.139425  3090 leader_election.cc:400] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18.
I20260709 13:17:41.139792  3090 leader_election.cc:403] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:41.146415  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:41.147140  3798 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:41.152091  3196 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:17:41.161586 10431 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:41.161855 10148 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:41.162359 10431 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:41.164215 10148 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:17:41.164816 10431 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:41.148305  9926 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.166154  9926 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:41.167124  3090 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:41.168147  9926 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:41.168852 10223 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18.
I20260709 13:17:41.169587 10223 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:41.170248 10223 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:17:41.180212  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:41.180964  3126 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:41.184820  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:41.188227  3126 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:41.189338  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:41.190230 10419 log.cc:927] Time spent T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.264s	user 0.004s	sys 0.000s
I20260709 13:17:41.190397  3126 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:17:41.191582  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:41.169400  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:41.195093 10375 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:41.196625 10375 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:41.199381 10300 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:41.200564  3090 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:41.200803  9874 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:41.140609 10171 consensus_queue.cc:1059] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:17:41.201750 10171 consensus_queue.cc:1243] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer e9165fe61ab04bfb9a48889156d5c161 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:17:41.201987 10431 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:41.202251 10171 raft_consensus.cc:3055] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:41.202667 10171 raft_consensus.cc:740] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:41.203522 10171 consensus_queue.cc:260] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:41.204651 10171 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:41.204694  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:41.149088 10369 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:41.211109 10190 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:41.211392 10369 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:41.213373 10369 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:41.210655  9926 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.138815 10425 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:41.214598 10425 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:41.214401  9926 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:41.215039 10425 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:41.216593  9926 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:41.218051  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:41.218324 10421 log.cc:927] Time spent T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:41.220036 10431 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:41.221448  3090 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:41.222680 10431 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:41.224280  3090 leader_election.cc:400] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21.
I20260709 13:17:41.229048  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:41.218954  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:41.219135  3119 raft_consensus.cc:1240] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:17:41.239323  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 3071) took 1002 ms. Trace:
I20260709 13:17:41.239879  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:41.240933  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:41.241176  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 376187us
I20260709 13:17:41.241995  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:41.143707  9940 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:41.243011 10372 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:41.243115  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:41.243425 10372 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.243822 10372 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:41.244692  9940 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:41.245255  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:41.253710  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:41.254444  3044 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:17:41.255412  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:41.255995  3044 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:41.257712  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:41.257962  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:41.258875  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:41.239760  3121 rpcz_store.cc:276] 0709 13:17:40.236600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.241818 (+  5218us) service_pool.cc:224] Handling call
0709 13:17:41.239141 (+997323us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b54003f1e54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:41.239264 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":658779008}
W20260709 13:17:41.263168  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.263614  3090 leader_election.cc:400] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16.
I20260709 13:17:41.213335 10190 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:41.268662  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:41.270797  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:41.275079  3193 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:41.278174  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:41.278537  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:41.279608  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:41.279825  3046 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 23. Current term is 24. Ops: []
I20260709 13:17:41.280133  3050 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:41.282583  3091 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:41.283103  3043 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:41.283893  3091 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:41.283980 10121 consensus_queue.cc:1059] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:17:41.285048 10121 raft_consensus.cc:3055] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:41.285372 10121 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:41.286167 10121 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:41.287227  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:41.248907 10282 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:17:41.287429 10287 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:41.287892 10287 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:41.288331 10287 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:41.278187 10244 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 13:17:41.289431 10244 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:41.268352 10399 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:17:41.290352 10283 raft_consensus.cc:3055] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:41.289350  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:41.290726 10283 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:41.246470 10258 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:17:41.291556 10283 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:41.291999 10258 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:41.291889  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:41.292783 10283 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:41.246318 10426 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:17:41.287279 10223 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:41.248087 10387 raft_consensus.cc:993] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: : Instructing follower aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:17:41.294023 10399 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:41.294724 10387 raft_consensus.cc:1081] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Signalling peer aaf88538197a49adb8bcf3790309a67e to start an election
I20260709 13:17:41.295269 10282 consensus_queue.cc:1059] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:41.290019 10244 raft_consensus.cc:697] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:41.283885  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:41.296449 10244 consensus_queue.cc:237] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:41.246191 10299 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:41.289908 10385 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:41.298050 10385 raft_consensus.cc:697] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:41.245978 10337 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:41.294095 10223 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.299244 10223 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:41.298911 10385 consensus_queue.cc:237] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:41.301079  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.293582  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:17:41.305346  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:41.306553  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.313930  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:41.318356  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 67722us
I20260709 13:17:41.319464  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:41.324659  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:41.331667  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 214868us
I20260709 13:17:41.287384 10121 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:41.308486 10398 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:41.354751  3761 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:41.358273  3042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:47488
I20260709 13:17:41.358605 10071 raft_consensus.cc:3055] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:41.359004  3042 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.359074 10071 raft_consensus.cc:740] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:41.359493  3042 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:41.360103 10071 consensus_queue.cc:260] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.7, Last appended by leader: 7, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:41.361502 10071 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:41.363837 10395 log.cc:927] Time spent T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 1.138s	user 0.005s	sys 0.000s
I20260709 13:17:41.365288 10094 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:41.366039  3761 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:41.367825 10408 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:41.368382 10408 raft_consensus.cc:697] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 23 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:41.369104  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:41.370081 10094 raft_consensus.cc:697] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 23 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:41.370522 10410 raft_consensus.cc:3055] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:41.370985  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:41.371047 10094 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:41.374627 10402 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 1.151s	user 0.002s	sys 0.003s
I20260709 13:17:41.329783 10258 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:41.377995 10432 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:41.378631  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2632) took 2711 ms. Trace:
I20260709 13:17:41.383599  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:41.384366  3050 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:17:41.385490  3762 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:41.387110  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:41.388056  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:41.389535  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:41.393339  3193 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 19. Current term is 20. Ops: []
W20260709 13:17:41.394200  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 53359.8us
I20260709 13:17:41.395900  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:41.327376 10299 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:41.379108  3200 rpcz_store.cc:276] 0709 13:17:38.667489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.683655 (+ 16166us) service_pool.cc:224] Handling call
0709 13:17:38.699844 (+ 16189us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:39.760498 (+1060654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.760551 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:39.789209 (+ 28658us) log.cc:844] Serialized 52 byte log entry
0709 13:17:40.078272 (+289063us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:40.134800 (+ 56528us) log.cc:844] Serialized 14 byte log entry
0709 13:17:40.135042 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.135121 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:41.374045 (+1238924us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:41.378311 (+  4266us) raft_consensus.cc:1685] finished
0709 13:17:41.378404 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.378554 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":56364,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":314716,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":226,"spinlock_wait_cycles":45830400,"thread_start_us":1197892,"threads_started":2,"wal-append.queue_time_us":328548}
I20260709 13:17:41.402724  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:41.405813  9940 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:41.406278  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:41.406983 10417 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:41.455272  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:41.455571  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:41.407171  3194 pending_rounds.cc:85] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 13
I20260709 13:17:41.407320 10223 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:41.402588  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:41.460176  3196 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
W20260709 13:17:41.460428  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 54225.8us
I20260709 13:17:41.416630  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:41.417378  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:41.418071  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:41.394443 10302 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.419036  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1491) took 1033 ms. Trace:
I20260709 13:17:41.461553  3043 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:41.461916  3045 rpcz_store.cc:276] 0709 13:17:40.386185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.386492 (+   307us) service_pool.cc:224] Handling call
0709 13:17:40.386899 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:40.597201 (+210302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:40.597243 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:40.597299 (+    56us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:40.597345 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.418761 (+821416us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b540027d8d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:41.418856 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.418983 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":483089152}
I20260709 13:17:41.462682  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:41.345919 10337 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.087s
I20260709 13:17:41.345860 10300 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:41.430016 10273 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:41.430783  3119 raft_consensus.cc:2410] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 25 because replica has last-logged OpId of term: 24 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:17:41.473419  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:41.435052  3123 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:41.370926 10410 raft_consensus.cc:740] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:41.436743  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:41.471168  3042 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:41.451476  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:41.451632  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:41.484596  3192 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
I20260709 13:17:41.457357  3194 pending_rounds.cc:107] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:17:41.485504  3194 raft_consensus.cc:2889] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:41.414429 10235 raft_consensus.cc:3055] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:17:41.320194 10387 consensus_queue.cc:1059] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.125s
I20260709 13:17:41.463871  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:41.345626 10399 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:17:41.459581  3118 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.017s	sys 0.019s
W20260709 13:17:41.464601  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 66351.4us
I20260709 13:17:41.506649  3090 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:41.465209  9256 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:41.507688  9256 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:41.465322  3047 raft_consensus.cc:2393] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 24: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:41.466336  3050 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:41.467454  3761 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:41.440565 10398 raft_consensus.cc:697] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:41.459734 10417 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:41.432444  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 3210) took 1129 ms. Trace:
I20260709 13:17:41.510139  3191 rpcz_store.cc:276] 0709 13:17:40.302549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.535858 (+233309us) service_pool.cc:224] Handling call
0709 13:17:41.432257 (+896399us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54001b80d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:41.432381 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":695479552}
I20260709 13:17:41.474313  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:41.469389 10407 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:41.471619 10302 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:41.471673 10409 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:17:41.478302 10223 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:41.480406 10424 log.cc:927] Time spent T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.584s	user 0.007s	sys 0.000s
I20260709 13:17:41.463673 10362 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.486014  3165 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:41.572489  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 86563.4us
I20260709 13:17:41.573328  3165 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:41.512284 10399 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.369346 10408 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:41.456799 10299 raft_consensus.cc:697] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:41.504781  3042 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:41.510893  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:41.512602 10407 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:41.514972  3090 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:41.519892 10296 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:41.616150  3050 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:17:41.593868 10071 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:17:41.473465 10418 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:41.519246  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 51903.1us
I20260709 13:17:41.519408  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:41.613570 10399 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:41.521409  9256 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:41.523473  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:41.524721  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:41.533432  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.496655 10249 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.682091  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:41.682379 10249 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:41.683339  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:41.684048  3042 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 25: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:41.684402 10249 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:41.496054 10235 raft_consensus.cc:740] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:41.675554  3045 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:41.575634  3798 raft_consensus.cc:2410] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:17:41.484604  3199 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:17:41.512578 10417 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:41.574308 10273 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:41.518478 10377 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.100s
I20260709 13:17:41.575218 10366 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:41.516104  3118 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.017s	sys 0.020s
I20260709 13:17:41.615723 10407 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:41.682132  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:41.615696 10296 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.703465  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 3068) took 1539 ms. Trace:
I20260709 13:17:41.721144  3125 rpcz_store.cc:276] 0709 13:17:40.163631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.199373 (+ 35742us) service_pool.cc:224] Handling call
0709 13:17:40.222030 (+ 22657us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:40.270357 (+ 48327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:40.270388 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:40.551168 (+280780us) log.cc:844] Serialized 26 byte log entry
0709 13:17:40.778507 (+227339us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:17:40.778567 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.778664 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:41.479712 (+701048us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:41.688116 (+208404us) raft_consensus.cc:1685] finished
0709 13:17:41.688145 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.703393 (+ 15248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14599,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":99896,"spinlock_wait_cycles":64680192,"thread_start_us":58108,"threads_started":1,"wal-append.queue_time_us":161283}
I20260709 13:17:41.623723 10431 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:17:41.703187 10273 raft_consensus.cc:697] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:41.730486  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1497) took 1052 ms. Trace:
W20260709 13:17:41.763773  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 248895us
I20260709 13:17:41.765544  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:41.763566  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 87646us
I20260709 13:17:41.766916  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:17:41.761895  3044 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.012s	sys 0.008s
W20260709 13:17:41.767772  3044 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.013s	sys 0.009s
W20260709 13:17:41.750568  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:41.771621  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.605562 10398 consensus_queue.cc:237] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:41.773362  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 330801us
I20260709 13:17:41.732656  3051 rpcz_store.cc:276] 0709 13:17:40.678032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.682259 (+  4227us) service_pool.cc:224] Handling call
0709 13:17:40.728494 (+ 46235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:40.862788 (+134294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:40.862841 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:40.926997 (+ 64156us) log.cc:844] Serialized 26 byte log entry
0709 13:17:41.487065 (+560068us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:41.487122 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.487209 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:41.730030 (+242821us) raft_consensus.cc:1685] finished
0709 13:17:41.730050 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.730421 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15287,"raft.queue_time_us":27102,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":3024,"thread_start_us":447426,"threads_started":2,"wal-append.queue_time_us":508849}
I20260709 13:17:41.725958 10296 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:41.778725  3761 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:41.778710  3090 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:41.780851  3050 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:41.787628  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:41.788543  3050 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 26.
I20260709 13:17:41.790763  3091 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:41.793099  3043 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:41.786413  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:41.811381  3165 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:41.802002  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:41.826303  3199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:17:41.834153  3199 raft_consensus.cc:606] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:41.834769  3199 raft_consensus.cc:614] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:41.836966  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:41.831650  3165 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:41.837816  3200 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:41.838392  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:41.839138  3192 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:41.840018  9256 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:17:41.840576  9256 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.843827  9256 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:17:41.785663 10094 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:41.776449 10244 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:41.784955 10282 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:41.720875 10418 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:41.819556 10071 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:41.848941 10423 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:17:41.859234  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 68586.2us
I20260709 13:17:41.864331  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2741) took 1051 ms. Trace:
I20260709 13:17:41.740206 10235 consensus_queue.cc:260] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:41.871276  3193 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:41.773900 10432 consensus_queue.cc:1059] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:17:41.870869  3118 rpcz_store.cc:276] 0709 13:17:40.813029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.813160 (+   131us) service_pool.cc:224] Handling call
0709 13:17:40.830312 (+ 17152us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:41.728987 (+898675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:41.729037 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:41.729792 (+   755us) log.cc:844] Serialized 26 byte log entry
0709 13:17:41.845794 (+116002us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:41.845831 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.845901 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:41.864021 (+ 18120us) raft_consensus.cc:1685] finished
0709 13:17:41.864050 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.864250 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":67242,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":76,"thread_start_us":984963,"threads_started":2,"wal-append.queue_time_us":131951}
I20260709 13:17:41.879541  3192 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 24.
I20260709 13:17:41.852258 10377 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:41.895563  3198 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:41.859860 10183 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:17:41.859288 10358 consensus_meta.cc:287] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.882s	user 0.008s	sys 0.020s
I20260709 13:17:41.850485 10001 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:41.875378  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:41.849298 10300 raft_consensus.cc:697] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:41.850032 10094 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:41.907238  3193 raft_consensus.cc:2410] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
W20260709 13:17:41.906701  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 118993us
W20260709 13:17:41.895133 10171 consensus_meta.cc:287] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.690s	user 0.017s	sys 0.004s
I20260709 13:17:41.911259  3193 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:17:41.911767  3042 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 19. Current term is 20. Ops: []
W20260709 13:17:41.911664  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 133028us
I20260709 13:17:41.871261  9940 raft_consensus.cc:697] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:41.913130  3090 leader_election.cc:400] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22.
I20260709 13:17:41.894747 10249 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:41.915515  3090 leader_election.cc:403] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:41.797207 10299 consensus_queue.cc:237] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:41.870401 10423 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:17:41.900107 10372 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.656s	user 0.017s	sys 0.005s
I20260709 13:17:41.919554  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:41.923122  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:41.899901 10183 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.929455  3195 raft_consensus.cc:2410] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:17:41.934854  9256 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:41.932401  3043 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:41.909919 10094 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:41.596143 10362 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:41.907531 10377 raft_consensus.cc:697] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:41.873601 10071 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:41.943243  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:41.957502  3044 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:17:41.850950 10273 consensus_queue.cc:237] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:41.860746 10244 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:41.949608  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.954618  3193 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:41.939180 10423 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:41.955919  3198 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:17:41.958673  9256 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:41.958170  3762 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:41.939899 10183 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:41.969990  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:41.945593 10432 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22.
W20260709 13:17:41.982102 10287 consensus_meta.cc:287] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.690s	user 0.020s	sys 0.005s
W20260709 13:17:41.985582  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 72588.3us
I20260709 13:17:41.986375  3090 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:41.940562 10372 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:41.989212  3090 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:41.991099  3090 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:41.997375 10388 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:41.999797 10300 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:41.987202 10283 consensus_meta.cc:287] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.694s	user 0.012s	sys 0.011s
W20260709 13:17:41.986423 10425 consensus_meta.cc:287] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.771s	user 0.014s	sys 0.008s
W20260709 13:17:42.023486  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 103974us
I20260709 13:17:41.963109 10387 consensus_queue.cc:1059] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:17:42.028875  3049 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 23. Current term is 24. Ops: []
I20260709 13:17:42.029590  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:42.017792 10375 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:17:41.987555 10287 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:42.042475  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:42.046164  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:42.039728 10337 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:42.003720  9940 consensus_queue.cc:237] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:42.031255 10425 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:42.058909 10460 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:42.059463 10445 log.cc:927] Time spent T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:17:42.085906  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2746) took 1227 ms. Trace:
I20260709 13:17:42.057811 10450 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:42.086331  3120 rpcz_store.cc:276] 0709 13:17:40.858487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.858710 (+   223us) service_pool.cc:224] Handling call
0709 13:17:41.247430 (+388720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:41.247709 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:41.247736 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:41.247775 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:41.247818 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.247888 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.085679 (+837791us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b54003f1e50. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:42.085841 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":526,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"spinlock_wait_cycles":868190976}
I20260709 13:17:42.086982 10450 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:42.058051 10442 log.cc:927] Time spent T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:17:42.064450 10458 consensus_queue.cc:1059] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 13:17:42.090675 10458 raft_consensus.cc:3055] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:42.091034 10458 raft_consensus.cc:740] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:42.091892 10458 consensus_queue.cc:260] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:42.093222 10458 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:42.077798 10466 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:42.094367 10466 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.094705 10466 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:42.064821 10287 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:42.065021 10446 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:17:42.065294 10456 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:42.069453 10423 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.070513 10362 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:42.071478 10418 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:42.077764 10372 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:42.079169 10071 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:42.099138  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:42.119465  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:42.163565  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 117362us
W20260709 13:17:42.089174 10258 consensus_meta.cc:287] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.711s	user 0.015s	sys 0.003s
I20260709 13:17:42.123376  3795 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:42.093374  3200 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:42.057009 10337 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:17:42.037009 10377 consensus_queue.cc:237] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.163389  3197 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:17:42.167853  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:42.166260  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:42.089198 10450 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:42.173589  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:42.148038 10456 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:42.159722 10296 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.179025  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:42.177306  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 186293us
I20260709 13:17:42.184717 10183 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:42.179800  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.190342  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:42.192680  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:42.195586  3044 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 27.
I20260709 13:17:42.196950 10387 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:17:42.174000 10258 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:42.178766 10456 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:42.207780 10071 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.208155 10183 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:42.208374 10071 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.214933 10423 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:42.198252 10399 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.216069 10410 consensus_queue.cc:260] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:42.200062 10296 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:42.217608 10410 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:42.220824  3090 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:42.175791 10398 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:17:42.235339  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:42.235549  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:42.236728  3194 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 22: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:42.237638  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:42.238222  3194 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:42.224790 10094 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:42.239041  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:42.239362  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 3078) took 1079 ms. Trace:
I20260709 13:17:42.239615  3194 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:42.239804  3119 rpcz_store.cc:276] 0709 13:17:41.159592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.240707 (+ 81115us) service_pool.cc:224] Handling call
0709 13:17:42.239139 (+998432us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54003917d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:42.239303 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434749184}
I20260709 13:17:42.235553 10258 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:42.240588 10094 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:42.240895 10258 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:42.220507 10460 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:42.242594 10423 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:42.236029  3196 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 13.
I20260709 13:17:42.242990  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:42.243126 10249 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.243584 10249 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:42.219542 10425 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:42.243008 10423 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.244917 10423 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:42.235373  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:42.246214  3200 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:42.241837 10258 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:42.249019 10446 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:17:42.250844  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2743) took 1434 ms. Trace:
I20260709 13:17:42.251210  3122 rpcz_store.cc:276] 0709 13:17:40.816905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.817237 (+   332us) service_pool.cc:224] Handling call
0709 13:17:40.817716 (+   479us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:41.116485 (+298769us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:41.273393 (+156908us) log.cc:844] Serialized 14 byte log entry
0709 13:17:41.877192 (+603799us) log.cc:844] Serialized 14 byte log entry
0709 13:17:41.903435 (+ 26243us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:41.913949 (+ 10514us) log.cc:844] Serialized 78 byte log entry
0709 13:17:41.914174 (+   225us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:41.914223 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.914334 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:42.250615 (+336281us) raft_consensus.cc:1685] finished
0709 13:17:42.250635 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.250786 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45416,"prepare.queue_time_us":221536,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":4021,"raft.queue_time_us":150264,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":7170,"spinlock_wait_cycles":7388544,"thread_start_us":653176,"threads_started":3,"wal-append.queue_time_us":348149}
I20260709 13:17:42.253970 10398 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 25 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:42.254943 10398 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.219503 10071 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:42.189337 10372 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:42.194826 10337 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:17:42.253516 10235 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:42.260262 10423 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.163332 10417 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:42.257827 10399 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:42.262845 10417 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:42.265555 10459 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.266192 10459 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.268611 10459 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:42.268718  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:42.269915  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:42.271389  3195 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:42.273551  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:42.273424  3165 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:42.274910  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:17:42.234315  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 44048.5us
I20260709 13:17:42.275012  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:42.293340  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:42.275208  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:42.234792  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:42.298849  3192 raft_consensus.cc:2368] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21.
I20260709 13:17:42.275331  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:42.278067  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:42.276487  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:42.278182  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:42.277347  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:42.277892  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:42.309579  3126 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 26.
I20260709 13:17:42.310336  3125 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:42.278606  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:42.279171  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:42.312376  3796 raft_consensus.cc:1813] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Handling vote request from an unknown peer 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:42.312996  3122 raft_consensus.cc:2410] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:17:42.313221  3796 raft_consensus.cc:2410] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:17:42.279453  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:42.314455  3124 raft_consensus.cc:1813] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Handling vote request from an unknown peer 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:42.277237  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:42.316881  3799 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 22: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
W20260709 13:17:42.285261  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 87734us
I20260709 13:17:42.276507  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3545) took 1026 ms. Trace:
I20260709 13:17:42.318522  3049 rpcz_store.cc:276] 0709 13:17:41.252967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.258956 (+  5989us) service_pool.cc:224] Handling call
0709 13:17:41.311414 (+ 52458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.030859 (+719445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.276286 (+245427us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b54000c5b54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:42.276453 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1649487744}
I20260709 13:17:42.280450  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:42.320354  3117 raft_consensus.cc:2410] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 22 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 13:17:42.321868  3124 raft_consensus.cc:2410] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:17:42.322940  3191 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22. Ops: [20.12-21.13]
I20260709 13:17:42.323450  3198 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:17:42.324554  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:42.327657  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:42.329052  3118 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:17:42.332804  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 55654.8us
I20260709 13:17:42.333767  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:42.325448  3191 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:42.273715 10407 consensus_meta.cc:287] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.544s	user 0.006s	sys 0.000s
I20260709 13:17:42.341250  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:42.342681  9256 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:42.348803  9256 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.349436  9256 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:42.351879  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:42.343356  3164 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:42.338297  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 43846.7us
I20260709 13:17:42.352550  3049 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:42.353250  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:42.354101  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:42.354249  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:42.356166  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:42.359328  3790 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:17:42.360366  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:42.363104  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:42.363330  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:42.360766  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:42.332273 10071 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:17:42.367129  3044 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:42.284579 10190 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.280112 10302 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:42.288735 10418 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:17:42.373695  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.376176  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:42.362596  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:42.372189  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:42.379025  3191 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
I20260709 13:17:42.344803 10366 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:42.387439  3797 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:42.364754 10283 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:42.358565  9926 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:42.282363 10466 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:42.370012 10425 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.399389  3049 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 24.
I20260709 13:17:42.363024 10100 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:42.370635 10430 raft_consensus.cc:2764] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Leader election decision vote started in defunct term 16: won
I20260709 13:17:42.288489 10249 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.366576 10372 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:17:42.393623  9256 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:42.400808  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:42.410229  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:42.280166 10456 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.415225  3191 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 22: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:42.375999 10385 consensus_queue.cc:1059] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:17:42.388273 10480 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.392813 10366 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.433501  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:42.429339  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:42.372087 10460 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:17:42.360291 10407 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:42.411701 10481 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:17:42.400072 10375 consensus_queue.cc:1059] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 13:17:42.404789 10464 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:42.440896  3790 raft_consensus.cc:2393] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:42.443190 10302 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:42.400820 10418 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.387050 10190 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.447666  9256 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:42.436806  3191 raft_consensus.cc:2393] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 18: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:42.458467  3761 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:42.403851 10377 consensus_queue.cc:1059] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:17:42.429153 10283 raft_consensus.cc:697] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:42.476663  3793 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:42.476269 10283 consensus_queue.cc:237] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.477124  9256 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:42.477666  9256 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.414944 10388 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:42.479661 10388 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:42.480077 10388 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:42.431581 10258 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:17:42.438432 10366 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:42.480015  9256 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:42.481618  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.454102 10287 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:17:42.485836  9256 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:42.490922  9256 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.429364 10425 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:42.492813  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 132541us
I20260709 13:17:42.494839  3193 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:17:42.476260 10479 log.cc:927] Time spent T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:17:42.498000  3090 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:42.462368 10302 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:42.500913 10302 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:42.501112 10375 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:42.501250  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:42.485697 10433 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.505240  9256 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:42.499835  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:42.506996  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:42.501951  3191 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 25.
I20260709 13:17:42.483091 10458 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:17:42.496845  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:42.509860  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:42.510906  3117 raft_consensus.cc:2410] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:17:42.504246  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:42.515595  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:42.490644 10450 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:42.516426  3090 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:42.516580  3117 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:42.519102  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:42.519582 10484 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:42.520315  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:42.523624 10482 log.cc:927] Time spent T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:17:42.524121  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:42.524710  3194 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:42.527017 10377 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:42.527485 10377 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.527834 10377 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:42.439255 10480 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:42.532349 10480 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:42.521459  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:42.533820 10287 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:42.534693  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:42.511369 10433 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:42.538713 10190 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:42.538800 10433 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:42.496713 10464 raft_consensus.cc:697] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:42.539100 10366 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:42.540117 10464 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.541874  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:42.546550  3790 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:42.547041 10407 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:42.548885 10418 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:42.550915 10425 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:42.551016  3194 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:42.552016  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:42.552212 10456 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:42.552569  3194 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:42.553467 10249 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:42.554141  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 44410us
I20260709 13:17:42.554353 10494 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:42.554539  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:42.554950  3792 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:42.555137  3191 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:42.501611 10375 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.556622  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:42.542529 10366 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:42.545853  3794 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:42.559890  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:17:42.565383  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 49032.5us
I20260709 13:17:42.565810  3117 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:17:42.566435  3090 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:42.566732  3118 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 27.
I20260709 13:17:42.568063  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:42.587393  3194 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
W20260709 13:17:42.592018  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:42.612367  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.645268  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:42.646186  3120 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 21
W20260709 13:17:42.647964  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 89844.7us
W20260709 13:17:42.653527  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 87205.3us
I20260709 13:17:42.654537  3090 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:42.657330  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:42.663882  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 264560us
I20260709 13:17:42.651358  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:42.668179  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:42.664306 10071 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 27 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:42.667835  3164 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:42.675727  3126 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 23. Current term is 24. Ops: []
I20260709 13:17:42.676385  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:42.679877  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:42.680179  3193 raft_consensus.cc:2468] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:42.681979  9256 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:42.682005  3164 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:42.555198 10494 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:42.565675 10375 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:42.701701  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:42.702679  3049 raft_consensus.cc:2410] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
W20260709 13:17:42.710552  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 59240us
I20260709 13:17:42.689378  3191 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:42.714004  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:42.714709  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:42.746085  3191 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:42.747218  3123 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 19: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:42.715108  3046 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:42.652901 10456 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:42.715602  3090 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:42.713887 10372 raft_consensus.cc:697] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 24 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:42.719857  3164 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:42.757500  3164 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:42.758129  3049 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 23. Current term is 24. Ops: []
I20260709 13:17:42.657943 10450 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:42.545550 10302 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:42.678025 10235 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:42.727772  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:42.733196  3042 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:42.696269 10366 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:42.739995  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:42.744249  3120 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:42.746272  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:42.746049  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:42.720588 10171 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:42.666067 10425 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:42.760805  3125 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:17:42.763082  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:42.764815  3164 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:42.745208 10494 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:42.775527  3123 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:17:42.772764  3045 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:42.775470  3049 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 16. (term mismatch)
I20260709 13:17:42.786888  3049 pending_rounds.cc:85] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 15
I20260709 13:17:42.787143  3049 pending_rounds.cc:107] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 13:17:42.788317  3049 raft_consensus.cc:2889] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:42.787947  3046 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 16. (term mismatch)
I20260709 13:17:42.789345  3046 pending_rounds.cc:85] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 15
I20260709 13:17:42.789649  3046 pending_rounds.cc:107] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 13:17:42.790015  3046 raft_consensus.cc:2889] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:42.791489  3164 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:42.773173  3051 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 24: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:42.764185 10190 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:42.800518  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:42.789489  3790 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 24.
I20260709 13:17:42.805565  3191 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:42.806787  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:42.750456 10493 consensus_queue.cc:1059] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 13:17:42.772416 10235 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.813639  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:42.814283  9256 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:42.818168  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:42.818774  3126 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:42.771725 10366 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:42.818789  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:42.822897  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.771008 10509 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:42.832187  3123 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:42.810006 10190 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:42.835492 10190 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:42.812582 10418 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:17:42.837306 10487 log.cc:927] Time spent T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:17:42.841837 10437 raft_consensus.cc:3055] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:17:42.842542 10437 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:42.800299 10494 raft_consensus.cc:697] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:42.843735 10437 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:42.845341 10494 consensus_queue.cc:237] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.7, Last appended by leader: 7, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.817000 10425 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:42.848681 10282 raft_consensus.cc:3055] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:42.849258 10282 raft_consensus.cc:740] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:42.750517 10071 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.12, Last appended by leader: 12, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.856798 10372 consensus_queue.cc:237] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.861187 10450 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:42.864962 10287 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:42.817800 10235 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:42.867246 10302 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:42.832482 10366 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:42.868780 10483 consensus_queue.cc:1059] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:42.869881 10483 consensus_queue.cc:1059] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:17:42.870812 10483 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:17:42.870941 10478 raft_consensus.cc:3055] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:42.871600 10433 raft_consensus.cc:3055] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:17:42.872138 10433 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:42.873018 10433 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:42.876868 10433 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:42.877002 10423 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:42.874361  3048 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:42.871544 10478 raft_consensus.cc:740] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:42.875893  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:42.883471  3795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 861) took 1496 ms. Trace:
I20260709 13:17:42.883926  3043 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 22: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:42.883885  3795 rpcz_store.cc:276] 0709 13:17:41.386745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.386862 (+   117us) service_pool.cc:224] Handling call
0709 13:17:42.883273 (+1496411us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b540009fe54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:42.883392 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1194354432}
I20260709 13:17:42.874828 10358 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:17:42.875877 10244 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:42.886557  3125 raft_consensus.cc:1275] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:17:42.887854  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:42.888068  3120 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:42.888701  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:42.889263  3119 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:42.831866 10492 consensus_queue.cc:1059] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.108s
W20260709 13:17:42.890897  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 72232.6us
I20260709 13:17:42.893092  3197 raft_consensus.cc:1240] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:42.901553  3164 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:42.898514  3048 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:17:42.902459  3045 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:17:42.757201 10456 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:42.904975  3164 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:42.764654 10466 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:42.902513  3197 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:17:42.905968  3120 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:17:42.845240 10437 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:42.909677  3191 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:42.909770  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:42.933988  3118 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:42.938964  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:42.877432 10377 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:42.939930  3191 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:17:42.940104  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:42.934060  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:42.903685 10362 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:42.947016  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:42.948542  3126 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:42.951694  3117 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 24.
W20260709 13:17:42.955078  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 48270.7us
I20260709 13:17:42.955237 10283 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:42.955135 10358 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:17:42.957979 10282 consensus_queue.cc:260] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.948243 10488 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:42.959136 10509 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.959426 10282 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:42.959798 10509 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.962638  3120 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:42.928959 10001 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.963536 10377 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:42.963915 10001 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:42.942993 10502 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:42.920554 10505 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:42.966915 10388 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:42.972020  3015 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.132:43109 timed out after 2.236s (SENT) [suppressed 8 similar messages]
I20260709 13:17:42.992476  3117 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:17:42.994609  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 47692.6us
I20260709 13:17:42.998215  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:42.998999  3795 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 22: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:42.948589 10418 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:42.882640 10478 consensus_queue.cc:260] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:42.967141 10505 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.004833  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:43.022593 10505 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:43.023123  3794 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 14: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:43.006269  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:43.024130  3795 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:43.010236 10459 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:43.011428 10235 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:42.993191 10362 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:43.016439 10425 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:43.001637 10488 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.032805 10488 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:43.035281 10488 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:43.036285  3126 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:17:43.037534 10509 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:43.040446  3198 raft_consensus.cc:1240] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 22. Current term is 23. Ops: []
W20260709 13:17:43.041580  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.042769  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:43.043052  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:43.043187  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:42.987663 10388 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:43.044461  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:43.044850  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:43.045202  3050 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 22: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:43.045540  3199 raft_consensus.cc:2368] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17.
I20260709 13:17:43.045954  3199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2659) took 1226 ms. Trace:
I20260709 13:17:43.046238  3199 rpcz_store.cc:276] 0709 13:17:41.819764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.847737 (+ 27973us) service_pool.cc:224] Handling call
0709 13:17:42.246371 (+398634us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b5800136e98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff8353790a0 00007ff835378984 00007ff82e8f36d4 00007ff82e8f3662
0709 13:17:43.044728 (+798357us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b5800136e98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28ee9c 00007ff82d28ea5b 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff8353790a0 00007ff835378984 00007ff82e8f36d4 00007ff82e8f3662
0709 13:17:43.045902 (+  1174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63585920}
I20260709 13:17:43.041632 10456 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:43.040447 10235 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:43.047758  3199 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:43.048576  3119 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:43.049726  3795 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:43.040611  3123 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:43.051334 10423 raft_consensus.cc:3055] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:43.051725 10423 raft_consensus.cc:740] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:17:43.052848  2942 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57732 (request call id 234) took 28241 ms (client timeout 15000 ms). Trace:
I20260709 13:17:43.052561 10423 consensus_queue.cc:260] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:43.054837  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:43.054709  2940 catalog_manager.cc:5697] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 14 to 19, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 19 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.055781  3200 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 24. Current term is 25. Ops: [24.12-24.12]
I20260709 13:17:43.040545  3192 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:17:43.058015  3198 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:43.058094  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:43.059075  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:43.060040  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:43.019003 10366 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:43.062584  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.021361  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:43.065209  3191 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:43.067551  3090 leader_election.cc:400] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21.
I20260709 13:17:43.068364  3090 leader_election.cc:403] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:43.069067  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:43.070305  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:43.070890  3198 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:43.056818  2940 catalog_manager.cc:5697] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 13 to 18, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 18 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:43.073263  2940 catalog_manager.cc:5697] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 14 to 19, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 19 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.075776  2940 catalog_manager.cc:5697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:43.084975  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:43.087683  3164 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:43.088701  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:43.091208  3196 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 23. Current term is 24. Ops: []
I20260709 13:17:43.092382  3090 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:43.088095 10513 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21.
I20260709 13:17:43.078986 10362 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.079107 10418 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:43.080379 10423 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:43.089880 10488 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.112237  3198 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:43.016496 10190 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:43.103245  3090 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:43.057310 10459 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:43.089967  9926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.002s	sys 0.015s
I20260709 13:17:43.154182  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:43.095112 10456 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:17:43.174276  9926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.002s	sys 0.016s
I20260709 13:17:43.146747  3090 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:43.095908 10430 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:17:43.145875 10501 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.198144  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:43.172024 10377 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:43.200766  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:43.200250  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:43.193871  3193 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 23. Current term is 24. Ops: [23.11-23.11]
I20260709 13:17:43.144966 10223 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.158974  3191 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:17:43.195961  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:43.193411  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46750.2us
W20260709 13:17:43.053246  2942 rpcz_store.cc:269] 0709 13:17:14.811060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.811303 (+   243us) service_pool.cc:224] Handling call
0709 13:17:43.052584 (+28241281us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:34.236480 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:34.237363 (+   883us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:34.237430 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:17:34.237459 (+    29us) tablet.cc:662] Decoding operations
0709 13:17:34.239205 (+  1746us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:34.239377 (+   172us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:34.239421 (+    44us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:17:34.241063 (+  1642us) tablet.cc:701] Row locks acquired
0709 13:17:34.241135 (+    72us) write_op.cc:260] PREPARE: finished
0709 13:17:34.241382 (+   247us) write_op.cc:270] Start()
0709 13:17:34.280488 (+ 39106us) write_op.cc:276] Timestamp: P: 1783603054241286 usec, L: 0
0709 13:17:34.287395 (+  6907us) op_driver.cc:348] REPLICATION: starting
0709 13:17:34.330241 (+ 42846us) log.cc:844] Serialized 5184 byte log entry
0709 13:17:35.116085 (+785844us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:35.962594 (+846509us) op_driver.cc:464] REPLICATION: finished
0709 13:17:36.361297 (+398703us) write_op.cc:301] APPLY: starting
0709 13:17:36.372334 (+ 11037us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:36.672418 (+300084us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:36.672457 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:36.822524 (+150067us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:36.823107 (+   583us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 13:17:36.823227 (+   120us) write_op.cc:312] APPLY: finished
0709 13:17:36.879979 (+ 56752us) log.cc:844] Serialized 121 byte log entry
0709 13:17:36.961294 (+ 81315us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:37.085962 (+124668us) write_op.cc:454] Released schema lock
0709 13:17:37.086070 (+   108us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:37.123943 (+ 37873us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:37.123993 (+    50us) write_op.cc:454] Released schema lock
0709 13:17:37.388787 (+264794us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
Metrics: {"mutex_wait_us":71036,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":375687,"apply.run_cpu_time_us":56512,"apply.run_wall_time_us":758221,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58493,"num_ops":13,"prepare.queue_time_us":78091,"prepare.run_cpu_time_us":12106,"prepare.run_wall_time_us":217762,"raft.queue_time_us":700607,"raft.run_cpu_time_us":51301,"raft.run_wall_time_us":460357,"replication_time_us":1586857,"spinlock_wait_cycles":22284928,"thread_start_us":1085015,"threads_started":5,"wal-append.queue_time_us":370070,"wal-append.run_cpu_time_us":38414,"wal-append.run_wall_time_us":3718359}]]}
I20260709 13:17:43.199479  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:43.204603  3120 raft_consensus.cc:2410] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:17:43.204685  3090 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:43.175631 10388 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.109351 10362 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:43.200321 10492 raft_consensus.cc:2804] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:43.195209 10430 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:43.196794 10100 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.002s	sys 0.019s
I20260709 13:17:43.108952 10418 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:43.212378  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:43.222801  3118 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:43.195789 10456 raft_consensus.cc:697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:43.219740  9256 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:43.222328  3091 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:43.169847 10488 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:43.211735  9926 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:43.212268 10377 raft_consensus.cc:697] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:43.219344 10430 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:17:43.280373  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 58163.5us
I20260709 13:17:43.209244 10223 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:43.216981 10425 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:17:43.284798  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.284621  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 65248.9us
I20260709 13:17:43.292718  3090 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:43.207947 10071 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:43.224964 10100 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.003s	sys 0.019s
I20260709 13:17:43.223227 10480 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:43.296346  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:43.287358  3091 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:43.283777  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:43.203696 10501 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:43.288069 10490 consensus_queue.cc:1059] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:17:43.298406  3120 raft_consensus.cc:2368] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15.
I20260709 13:17:43.217025 10388 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:43.308096  3046 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:43.318521  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:43.323554  3121 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:43.323830  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:43.309870  3048 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:43.311589  3050 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:43.326687  3048 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:43.317345  3047 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 13:17:43.222126 10287 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:17:43.291183 10001 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:43.287200 10296 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:17:43.330238  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:43.279162 10492 raft_consensus.cc:697] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:43.335021  3118 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
W20260709 13:17:43.347882  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 260284us
I20260709 13:17:43.296440 10100 raft_consensus.cc:697] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:43.174839  2940 catalog_manager.cc:5697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 19 to 23, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 23 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.354396  3121 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:43.349035  3164 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:43.327796 10515 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:43.299432 10425 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:43.346328 10513 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:17:43.365392  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:43.370430  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:43.320614 10071 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:43.375447  3044 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
W20260709 13:17:43.371799  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.347102 10366 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:43.398869 10249 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:43.399605 10249 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:17:43.400173 10362 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:43.400658 10190 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:43.401477  3124 raft_consensus.cc:2410] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
W20260709 13:17:43.402145 10518 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:17:43.402623 10223 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:43.404747  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3231) took 1081 ms. Trace:
I20260709 13:17:43.395524 10432 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.405190  3194 rpcz_store.cc:276] 0709 13:17:42.323771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.598427 (+274656us) service_pool.cc:224] Handling call
0709 13:17:42.677929 (+ 79502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:42.679106 (+  1177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:42.679146 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:42.679788 (+   642us) log.cc:844] Serialized 26 byte log entry
0709 13:17:43.091334 (+411546us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:43.219416 (+128082us) log.cc:844] Serialized 14 byte log entry
0709 13:17:43.219597 (+   181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.220053 (+   456us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:43.404489 (+184436us) raft_consensus.cc:1685] finished
0709 13:17:43.404512 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:43.404669 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":788,"raft.queue_time_us":73113,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":166,"thread_start_us":449908,"threads_started":2,"wal-append.queue_time_us":477814}
I20260709 13:17:43.406519 10432 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:43.407683 10516 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:17:43.408998 10488 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:43.409058 10501 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:43.409932 10299 raft_consensus.cc:3055] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:43.410420 10299 raft_consensus.cc:740] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:43.410035 10100 consensus_queue.cc:237] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:43.364954 10296 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:17:43.401528 10520 log.cc:927] Time spent T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:17:43.349699  9874 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.046s
W20260709 13:17:43.419518 10399 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.949s	user 0.013s	sys 0.027s
I20260709 13:17:43.396412 10515 raft_consensus.cc:697] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:43.399088 10418 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:43.436309  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 117938us
W20260709 13:17:43.452370  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.453102  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.454103  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:43.458112  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:43.414940 10513 raft_consensus.cc:697] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 24 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:43.408754 10432 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:43.411248 10299 consensus_queue.cc:260] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:43.448253 10399 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.014s	sys 0.027s
I20260709 13:17:43.363360 10377 consensus_queue.cc:237] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:43.470974 10519 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:17:43.472568  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:43.473688  3191 raft_consensus.cc:2410] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 24 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:17:43.435261 10296 raft_consensus.cc:697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:43.474759  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:43.474951 10296 consensus_queue.cc:237] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:43.475735  3194 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:43.471030  2940 catalog_manager.cc:5697] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 15 to 21, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 21 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:43.480098  2940 catalog_manager.cc:5697] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.353075 10456 consensus_queue.cc:237] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:43.466310 10375 consensus_meta.cc:287] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.734s	user 0.007s	sys 0.008s
W20260709 13:17:43.481691  3015 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.002s	sys 0.022s
W20260709 13:17:43.482981  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.432785 10437 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:43.532156  3015 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.002s	sys 0.025s
I20260709 13:17:43.498728  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:43.535039  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 563010us
I20260709 13:17:43.535269  3797 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 14.
W20260709 13:17:43.535786  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.535866  3797 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 977) took 1166 ms. Trace:
I20260709 13:17:43.536307  3797 rpcz_store.cc:276] 0709 13:17:42.369043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.406919 (+ 37876us) service_pool.cc:224] Handling call
0709 13:17:43.498548 (+1091629us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b58000c4b98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff8353790a0 00007ff835378984 00007ff82e8f36d4 00007ff82e8f3662
0709 13:17:43.535808 (+ 37260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8828800}
W20260709 13:17:43.537873  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 102483us
W20260709 13:17:43.514256 10282 consensus_meta.cc:287] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.001s
I20260709 13:17:43.547642 10337 consensus_queue.cc:1059] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:17:43.508296 10299 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:43.510522 10425 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:43.491634 10523 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:43.513833 10478 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:43.509212 10388 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:43.505303 10287 consensus_queue.cc:1059] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:17:43.567461  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:43.498457 10513 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:43.572149 10430 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:43.573585  3122 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 23. Current term is 24. Ops: []
I20260709 13:17:43.574546 10430 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:43.574815  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:43.541320 10437 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:43.576221  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:43.569321 10494 consensus_queue.cc:1059] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:17:43.577543  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:43.578267  3120 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:43.582676  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:43.583546  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.583863  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:43.584842  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:43.585317  3121 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:17:43.538074 10480 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:17:43.606534  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:43.607395  3048 raft_consensus.cc:2410] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 24 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:17:43.607654  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:43.587226 10536 raft_consensus.cc:3055] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:17:43.538749 10501 consensus_queue.cc:1059] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:17:43.533927 10375 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:43.591406  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:43.593389  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:43.596942  3196 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:17:43.597295  3120 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
I20260709 13:17:43.503752 10505 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:43.581408 10274 raft_consensus.cc:3055] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:43.625761  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:43.626678  3049 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:43.599421  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:43.627377  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 262088us
I20260709 13:17:43.597024  3194 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:17:43.630465  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2664) took 1221 ms. Trace:
I20260709 13:17:43.630911  3193 rpcz_store.cc:276] 0709 13:17:42.408546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.873643 (+465097us) service_pool.cc:224] Handling call
0709 13:17:42.885789 (+ 12146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:43.202914 (+317125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.630208 (+427294us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54003b9554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:43.630396 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669239168}
I20260709 13:17:43.605197  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:43.604864  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:43.634709  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:43.547446 10490 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.496737 10071 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:43.567817 10523 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:43.617700  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:43.644924  3196 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:17:43.620136  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:43.621970  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.622390  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:43.603660  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:43.465087 10492 consensus_queue.cc:237] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:43.608165  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:43.636577  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:43.636849  3091 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:43.651093  3091 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:43.631067  3090 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:43.648118  3045 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:17:43.633440  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:43.612851 10536 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:43.661159  3090 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:43.586684 10437 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:43.507797 10515 consensus_queue.cc:237] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:43.666285  3091 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:43.662484  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:43.668463  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:43.676959  3193 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:43.668869  3196 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 26.
I20260709 13:17:43.672219  3164 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:43.633440  9874 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:43.582307 10414 consensus_queue.cc:1059] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 13:17:43.582535 10417 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:17:43.625131 10274 raft_consensus.cc:740] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:43.681787  3191 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:17:43.693677  3191 pending_rounds.cc:85] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 11
I20260709 13:17:43.694002  3191 pending_rounds.cc:107] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:17:43.694260  3191 raft_consensus.cc:2889] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:43.696323  3194 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:17:43.681388  3091 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:43.691500  3164 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:43.655535 10071 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.658444 10461 consensus_queue.cc:1059] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:17:43.692440 10388 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:43.659113 10235 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:43.654045 10223 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:43.706269  3164 leader_election.cc:400] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15.
I20260709 13:17:43.712515  3164 leader_election.cc:403] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:17:43.623543 10464 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:17:43.663980 10538 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:43.675414 10488 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:43.674170 10337 consensus_queue.cc:1059] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:17:43.707298  3090 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:43.690613 10430 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:43.703789  3091 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:43.653613 10491 consensus_queue.cc:1059] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:17:43.649911 10490 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:43.693262 10437 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:43.704852 10432 raft_consensus.cc:2764] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:17:43.704674 10418 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:17:43.718918  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 65362.6us
I20260709 13:17:43.739977 10425 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:43.742174 10533 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 14. Current term is 15.
W20260709 13:17:43.742385 10517 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.542s	user 0.004s	sys 0.000s
I20260709 13:17:43.723255 10460 raft_consensus.cc:3055] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:43.744608 10459 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:43.709618 10071 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:43.748574 10506 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:17:43.750198  3192 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 22: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:43.728871 10258 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:17:43.758008  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 54349.8us
I20260709 13:17:43.716432 10223 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:43.763607 10430 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:43.737340  3164 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:43.755798 10488 raft_consensus.cc:697] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:17:43.774169 10423 consensus_meta.cc:287] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.628s	user 0.012s	sys 0.001s
I20260709 13:17:43.784735  3123 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 25. Current term is 26. Ops: []
I20260709 13:17:43.794523  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:43.799189  3122 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:43.776572 10396 raft_consensus.cc:3055] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:43.770315 10425 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.817657  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:43.804128  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:43.805449  3195 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16. Ops: []
W20260709 13:17:43.807271  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 70037.2us
I20260709 13:17:43.807338  3118 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:43.813148  3193 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:17:43.780364 10460 raft_consensus.cc:740] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:43.818362  3124 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
I20260709 13:17:43.818912  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:43.824795  3126 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:17:43.832033  3122 raft_consensus.cc:2393] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 24: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:43.779029 10417 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:17:43.802554 10375 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:43.836795  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:43.837767  3118 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:17:43.838153  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:43.839191  3118 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 27 index: 13. (index mismatch)
I20260709 13:17:43.814525 10418 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:43.844956 10418 raft_consensus.cc:697] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:43.846011 10418 consensus_queue.cc:237] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:43.811914 10258 raft_consensus.cc:697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:43.854074  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:43.854686  3197 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:43.854885 10258 consensus_queue.cc:237] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:43.819315 10396 raft_consensus.cc:740] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:43.795199 10448 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:17:43.843467  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:43.853703 10460 consensus_queue.cc:260] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:43.865357 10490 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:43.870352 10460 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:43.842177  3164 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:43.876636  3164 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:43.876803 10223 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:43.878391  3198 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:43.839792 10494 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:17:43.880079 10100 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:43.880496 10100 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.860913  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:43.836484  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:43.880865 10100 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:43.881117  3126 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
W20260709 13:17:43.881505  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 45097.7us
I20260709 13:17:43.881927 10190 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:43.882344 10536 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:43.883045  3015 leader_election.cc:400] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17.
I20260709 13:17:43.883365  3015 leader_election.cc:403] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:43.883724 10190 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:17:43.884649 10461 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:17:43.885169 10461 raft_consensus.cc:697] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 24 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:43.883383 10536 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:43.886044 10461 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:43.887730 10399 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17.
I20260709 13:17:43.866128  3118 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:43.824724 10425 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:43.890312  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:43.798427 10501 consensus_queue.cc:1059] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:17:43.918697  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:43.919926 10501 consensus_queue.cc:1243] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:43.920645 10501 raft_consensus.cc:3055] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:43.920984 10501 raft_consensus.cc:740] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:43.921849 10501 consensus_queue.cc:260] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:43.922950 10501 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:43.928716 10100 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:43.929318  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:43.930029  3196 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:43.930383 10249 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:43.931667 10121 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:43.932382  3122 raft_consensus.cc:1275] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 17 index: 7. (index mismatch)
I20260709 13:17:43.931712  3126 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 13:17:43.935030  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.840148 10505 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:43.937855  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:43.939826  3193 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:43.834148  9874 raft_consensus.cc:697] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:43.868813 10523 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:43.768230  2940 catalog_manager.cc:5697] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.891631 10478 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:43.960026  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:43.971719  3118 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:43.953498  9874 consensus_queue.cc:237] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:43.869086  3197 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:43.981406  3193 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:17:43.983511  3123 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:17:43.905036 10245 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:17:43.973380  3164 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:43.941293 10494 consensus_queue.cc:1059] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:17:43.990535  3193 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 25. Current term is 26. Ops: []
W20260709 13:17:43.992163  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.985816  3197 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18. Ops: []
W20260709 13:17:43.984381 10541 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:17:43.905386 10488 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:43.939056 10417 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
W20260709 13:17:43.995662 10548 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:17:43.994334 10542 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:17:43.986171 10245 consensus_queue.cc:1243] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 22.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:17:43.941093 10372 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:17:43.990700 10505 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:17:44.037575  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 452752us
I20260709 13:17:43.991942 10100 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:43.985405 10478 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:43.898568 10396 consensus_queue.cc:260] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:43.999874 10071 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:44.024302 10533 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:44.014652 10425 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:44.064062  3193 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:43.996091  2940 catalog_manager.cc:5697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 16 to 20, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 20 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.067401 10410 consensus_queue.cc:1059] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:17:44.079035 10410 raft_consensus.cc:3055] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:44.079479 10410 raft_consensus.cc:740] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:44.080487 10410 consensus_queue.cc:260] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:44.048378 10372 consensus_queue.cc:1243] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 24.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:17:44.084852  3194 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:44.088066  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:44.088670  3120 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:44.088917 10410 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:44.076833  2940 catalog_manager.cc:5697] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 17 to 19, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 19 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:44.090514 10557 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:17:44.092712  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:44.093317  3121 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:17:44.094101  3123 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:17:44.100041  3123 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:44.104133  3120 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 24.
I20260709 13:17:44.096889  3164 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:44.107985  3164 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:44.107841  3124 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:44.045920 10505 raft_consensus.cc:697] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:44.057471 10299 consensus_queue.cc:1059] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.059s
W20260709 13:17:44.114472  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 182138us
I20260709 13:17:44.111682 10249 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:44.111845 10418 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:17:44.121701  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:44.111581 10190 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:17:44.129244  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:44.132217  3797 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:44.130885  3200 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:44.134641  3200 raft_consensus.cc:1275] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 17 index: 7. Preceding OpId from leader: term: 19 index: 8. (index mismatch)
W20260709 13:17:44.135721  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 83042.7us
I20260709 13:17:44.137229  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:44.139722  3200 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:17:44.140944  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:44.141856 10563 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:44.142421 10563 raft_consensus.cc:697] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:44.143337 10563 consensus_queue.cc:237] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:44.144733 10460 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:44.146349 10505 consensus_queue.cc:237] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:44.122432 10249 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.132916  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:44.150450  3793 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:44.131820 10372 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:44.156229 10001 raft_consensus.cc:3055] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:44.156363 10372 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:44.156756 10001 raft_consensus.cc:740] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:44.156697 10568 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:17:44.157361 10245 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 25 LEADER]: Stepping down as leader of term 25
W20260709 13:17:44.159564  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.124094 10417 consensus_queue.cc:1059] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:17:44.133826 10418 raft_consensus.cc:697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:44.156221  2940 catalog_manager.cc:5697] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 14 to 15, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 15 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.165498  2940 catalog_manager.cc:5697] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 15 to 19, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 19 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:17:44.169575 10425 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:44.169942 10478 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:44.170311  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:44.150547 10461 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:17:44.151407 10249 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:44.160710 10372 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:44.177593 10375 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:44.178262 10375 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:44.180055  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.163169 10460 consensus_queue.cc:1059] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:17:44.181370 10418 consensus_queue.cc:237] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:44.182088  3164 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:44.149942 10258 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:17:44.157776 10245 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 25 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:17:44.185899  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.190665 10071 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:44.191308 10071 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:44.194311  3051 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 27 index: 13. (index mismatch)
I20260709 13:17:44.194554  3797 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:44.195322  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:44.195641 10417 consensus_queue.cc:1243] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 20.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:17:44.196472 10071 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:44.196558 10417 raft_consensus.cc:3055] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:44.197016 10417 raft_consensus.cc:740] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:44.197974 10417 consensus_queue.cc:260] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:44.198673  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:44.201573  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:44.203341  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:44.203503 10414 raft_consensus.cc:3055] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:44.203933 10414 raft_consensus.cc:740] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:44.203089 10372 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:44.204846 10414 consensus_queue.cc:260] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:44.192356 10245 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.12, Last appended by leader: 12, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:44.206522 10460 raft_consensus.cc:3055] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:44.209285  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:44.209874  3043 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:44.209851  3164 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:44.218361  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:44.161877 10001 consensus_queue.cc:260] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:44.210448 10399 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:17:44.286027  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:44.286710  3051 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:17:44.207006 10372 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:44.193434  2940 catalog_manager.cc:5697] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 16 to 17, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 17 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:44.291054  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.292616  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:44.293223  3120 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:44.291724  2940 catalog_manager.cc:5697] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 16 to 19, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 19 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.210554 10414 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:44.301432  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 91727.4us
I20260709 13:17:44.295665  3165 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:44.308105  9256 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.308925  9256 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:44.201923 10540 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:44.208988 10460 raft_consensus.cc:740] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:44.310876  3165 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:44.274304 10245 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:17:44.210989 10366 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:17:44.301103 10562 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:17:44.294617 10417 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:17:44.322305  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.336933  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.274863 10448 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 13:17:44.325229  3120 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 24.
I20260709 13:17:44.306537 10531 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:44.341701  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:44.345893  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 196549us
I20260709 13:17:44.319026  9874 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.357751  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:44.346014  9256 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:44.359169  9256 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:44.325091  3165 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:44.359637  3046 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:17:44.318131 10375 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:44.361490  3761 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:44.303619 10461 consensus_queue.cc:1059] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:17:44.361449  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:44.329795 10190 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:44.326686 10366 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.314589 10502 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:17:44.368566  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:44.370110  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:44.368674  3761 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:44.357621 10531 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:44.381130  3049 raft_consensus.cc:3055] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:44.381623  3049 raft_consensus.cc:740] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:44.387411  3051 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 13:17:44.387888  3051 pending_rounds.cc:85] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 11
I20260709 13:17:44.388192  3051 pending_rounds.cc:107] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 13:17:44.388515  3051 raft_consensus.cc:2889] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:44.390588  9256 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:44.391800  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:44.396339  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:44.397316  3120 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:17:44.382730  3049 consensus_queue.cc:260] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:44.399187  3049 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:44.399514  3047 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 21: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:44.367516 10410 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:44.374365 10366 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:44.371729 10568 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:44.373724 10190 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.373342 10540 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:17:44.415699  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:44.375967 10460 consensus_queue.cc:260] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:44.384282 10531 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:44.486507  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:44.386590 10258 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:44.404639 10461 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.386111 10506 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.104s
I20260709 13:17:44.462200 10190 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:44.459254 10576 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:17:44.373515  9874 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:44.493034 10563 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:17:44.497632 10539 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:44.513908 10549 log.cc:927] Time spent T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.645s	user 0.007s	sys 0.011s
I20260709 13:17:44.512447 10460 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:44.538851  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.540031  3049 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:17:44.540650  3049 pending_rounds.cc:85] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 12
I20260709 13:17:44.540987  3049 pending_rounds.cc:107] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:17:44.541348  3049 raft_consensus.cc:2889] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:44.512301 10461 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:44.521360 10258 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:44.561947 10573 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:17:44.589696  3043 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 24.
I20260709 13:17:44.558161 10399 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:17:44.591063  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 228405us
I20260709 13:17:44.595716  3165 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:44.537247 10539 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:44.603978  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 218226us
W20260709 13:17:44.601548  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.610644  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:44.591326 10580 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.615607  3165 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:44.616550  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:44.619951 10502 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:44.620352  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:44.606813 10523 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:44.627285  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 211684us
I20260709 13:17:44.604838 10509 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.603353 10258 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:44.635294 10539 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:44.623116 10580 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:44.636544 10274 consensus_queue.cc:260] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:44.628357 10410 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:17:44.651875  3045 raft_consensus.cc:2410] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 22 because replica has last-logged OpId of term: 21 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
I20260709 13:17:44.619443 10399 raft_consensus.cc:697] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 24 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:44.666659 10461 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:44.667286 10399 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:44.653111  3761 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:44.622864 10576 consensus_queue.cc:1059] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.036s
W20260709 13:17:44.658388 10583 log.cc:927] Time spent T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:17:44.658661 10466 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:17:44.660764 10121 raft_consensus.cc:3055] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:17:44.717654 10121 raft_consensus.cc:740] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:44.718595 10121 consensus_queue.cc:260] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:44.719429  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:44.720108  3197 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:44.721045  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:44.721582  3197 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:44.722061 10001 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:44.722523  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:44.725150 10592 raft_consensus.cc:3055] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:17:44.725637 10592 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:44.726790 10592 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:44.727684  3192 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 3242) took 1659 ms (client timeout 2059 ms). Trace:
W20260709 13:17:44.728106  3192 rpcz_store.cc:269] 0709 13:17:43.068589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.068722 (+   133us) service_pool.cc:224] Handling call
0709 13:17:44.727455 (+1658733us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b54001def54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:44.727621 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1563762944}
I20260709 13:17:44.729247  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:44.731271  3196 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22. Ops: [20.12-21.13]
W20260709 13:17:44.735580 10498 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:17:44.738076 10466 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.738770 10466 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:44.741910  3118 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:17:44.661777  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 1144) took 2314 ms. Trace:
I20260709 13:17:44.671253  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:44.629442 10568 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:44.676446  9874 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:44.650840 10509 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:44.745191  3195 rpcz_store.cc:276] 0709 13:17:42.347060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.859980 (+512920us) service_pool.cc:224] Handling call
0709 13:17:42.860271 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.825677 (+965406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.661535 (+835858us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b540013c9d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:44.661691 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2173226752}
I20260709 13:17:44.667317 10171 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:44.758176  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 86998.2us
W20260709 13:17:44.682998 10249 consensus_meta.cc:287] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.000s
I20260709 13:17:44.685068  3200 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 23. Current term is 24. Ops: [23.11-23.11]
W20260709 13:17:44.690011  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.702358 10410 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:44.669301 10417 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.710093 10580 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:44.714493  3051 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:17:44.749292  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.752795  3192 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:17:44.777861  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:44.677772 10396 raft_consensus.cc:3060] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:44.783540  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:44.682291 10574 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.096s	user 0.000s	sys 0.002s
I20260709 13:17:44.785970  3794 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:44.786065  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:44.760838  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:44.762601  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:44.764986  3790 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:44.766214  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:44.788262  3199 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:17:44.776557  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:44.775090  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:44.779559  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:44.757385 10490 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.804718  3125 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21. Ops: [20.12-20.12]
W20260709 13:17:44.806257  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46988.4us
I20260709 13:17:44.719635 10121 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:44.755638 10302 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.757159 10539 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:44.781437  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.799423  3122 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:17:44.788160  3792 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:44.783351 10579 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.799890 10502 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.771917  9874 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:44.801590  3090 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:44.759070 10586 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:44.802361 10466 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:44.802479 10375 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:17:44.785542 10417 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:44.806301  3123 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 23. Current term is 24. Ops: [21.15-23.16]
W20260709 13:17:44.807914  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.808926  3795 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:17:44.799791  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:44.810019  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:44.811239  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:44.814101  3195 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:17:44.777438 10576 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.822101  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:44.783926 10523 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.780654 10223 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:44.822641  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:44.823136  3796 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:17:44.827747  3200 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:44.783768 10100 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:44.792227 10410 raft_consensus.cc:697] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:44.891893 10410 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:44.894019  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 71452us
I20260709 13:17:44.894335 10591 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:44.894779  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:44.896091 10461 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:44.896467 10461 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:44.896850 10461 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:44.897374 10580 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:44.897816 10580 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.898186 10580 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:44.822299 10586 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:44.902442 10258 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:44.903102 10586 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:44.819869 10539 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:44.904008 10258 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:44.904585 10258 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:44.905511 10539 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:44.804049 10506 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:44.819399 10302 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:44.906311 10506 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:44.887779  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:44.908612 10506 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:44.894799 10591 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:44.909248 10591 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:44.909350 10533 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:44.910104 10533 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:44.910888 10366 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:44.911928 10466 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:44.912818 10466 consensus_queue.cc:1243] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:17:44.805927 10590 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.913635 10590 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:44.914350 10588 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:17:44.888685  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:44.890484 10100 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:44.915992 10590 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:44.916927  3126 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:17:44.917420 10100 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:44.887939 10190 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:44.816416 10579 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:44.919602 10190 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:44.914829  3200 raft_consensus.cc:1240] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:17:44.920097 10579 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:44.920679 10071 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.921216 10071 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:44.924561  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:44.925886  3196 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21. Ops: [20.17-20.17]
I20260709 13:17:44.775266 10171 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:44.933640  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:44.935696  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.938181  3790 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:44.939581  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:44.940812  3790 raft_consensus.cc:2376] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20. Re-sending same reply.
I20260709 13:17:44.777916 10249 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:44.947682  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:44.951109  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:44.952176  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:44.952841  3048 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:17:44.929302 10593 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.955873  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:44.957916  3044 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:17:44.962860  3048 raft_consensus.cc:2410] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:17:44.961292  3165 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:44.967065  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:44.967952  3790 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 24.
I20260709 13:17:44.962939  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:44.909298 10375 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 26 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:44.974171  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:44.819550 10502 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:44.970454  3197 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:44.923997 10071 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:44.820894 10498 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.151s
I20260709 13:17:44.816694 10490 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:45.030028  3790 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:17:45.031301  3794 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:17:44.978040  9926 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:44.930430 10223 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:44.955148 10523 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:45.044456  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2679) took 1238 ms. Trace:
I20260709 13:17:44.972851 10593 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:44.982249 10366 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:45.047698  3193 rpcz_store.cc:276] 0709 13:17:43.805898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.022333 (+216435us) service_pool.cc:224] Handling call
0709 13:17:44.040423 (+ 18090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:44.066448 (+ 26025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.037955 (+971507us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b5400177d54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:45.044356 (+  6401us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53731712}
I20260709 13:17:44.930619 10576 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:45.054955  3121 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:44.965101 10579 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:17:45.023947 10190 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:45.063225  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:44.982564 10245 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:17:45.047184  9926 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:45.054380 10542 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:17:45.050901 10414 consensus_meta.cc:287] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.736s	user 0.009s	sys 0.005s
W20260709 13:17:45.070889  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 269354us
I20260709 13:17:45.081025  3798 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 22: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:45.087864  3090 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:45.093636  3043 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:17:45.094051  3164 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:45.094094  3043 pending_rounds.cc:85] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 9
I20260709 13:17:45.095397  3043 pending_rounds.cc:107] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:17:45.095932  3043 raft_consensus.cc:2889] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:45.100304  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 146292us
W20260709 13:17:45.107952  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.112183  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:45.113095  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:45.106182 10258 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:45.086469  9926 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:45.116528  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:45.117120  3790 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:45.124818  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:45.117066  3090 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:45.097321 10414 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:45.135982  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.139338  3090 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:45.151089  3090 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:45.152878  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:45.079296 10190 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:45.110957 10540 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:45.145835  3790 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:45.166955  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:45.167665  3044 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:17:45.124469 10595 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:45.158463 10531 consensus_meta.cc:287] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.636s	user 0.010s	sys 0.001s
I20260709 13:17:45.159811 10456 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:45.151530 10506 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:45.089725 10375 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:45.156600 10282 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:45.128885 10603 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:17:45.178288  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 68831.4us
I20260709 13:17:45.184897  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:45.160085 10509 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:45.212236  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:45.212898  3042 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
I20260709 13:17:45.226179 10190 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:45.227313 10490 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:45.229138 10464 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:45.229959 10464 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:45.231015  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.231446 10596 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:45.232203 10464 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:45.178704 10171 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:17:45.196344 10417 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:45.160822 10414 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:45.245553 10502 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:45.254829 10580 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:45.182649 10595 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:45.247426 10223 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:45.251300 10282 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:45.255823 10523 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:45.255846 10414 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:45.196702 10501 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:45.243054 10593 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:45.210916 10603 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:45.219475 10366 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:45.266397  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 102272us
I20260709 13:17:45.306859 10366 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:45.308347 10505 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.009s	sys 0.004s
W20260709 13:17:45.308852 10505 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.009s	sys 0.004s
I20260709 13:17:45.310003  3198 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21. Ops: []
W20260709 13:17:45.310340 10598 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.167s	user 0.004s	sys 0.000s
I20260709 13:17:45.249284 10461 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:45.311249  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2681) took 1492 ms. Trace:
I20260709 13:17:45.311656  3198 rpcz_store.cc:276] 0709 13:17:43.819101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.092851 (+273750us) service_pool.cc:224] Handling call
0709 13:17:44.093122 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.310426 (+1217304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.310999 (+   573us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400035f54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:45.311182 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2798068992}
I20260709 13:17:45.313024 10461 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:45.314985 10595 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:45.315681 10603 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:45.182859 10531 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:45.318039 10431 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:45.258423 10456 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:17:45.326153  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:45.326942  3195 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:45.296195 10580 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:45.298226 10523 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:45.300776 10302 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:45.285068 10001 consensus_meta.cc:287] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.001s
I20260709 13:17:45.334235  3198 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:17:45.337049  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:45.336678  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:45.338824  3194 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:45.339818  3200 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
W20260709 13:17:45.336642  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 129544us
I20260709 13:17:45.341830  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:45.350221  3762 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:45.351302  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.334339 10506 raft_consensus.cc:697] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:45.368494  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:45.376019  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.332970 10431 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.375110  3762 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:45.381706  3791 raft_consensus.cc:1240] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:17:45.335981 10366 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:45.290817 10501 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:45.391459 10358 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:45.391999 10358 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.392374 10358 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:45.398037  3124 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 16. (term mismatch)
I20260709 13:17:45.398627  3124 pending_rounds.cc:85] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: Aborting all ops after (but not including) 15
I20260709 13:17:45.398933  3124 pending_rounds.cc:107] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260709 13:17:45.399289  3124 raft_consensus.cc:2889] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:45.401305  3043 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:17:45.394771  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:45.404752  3047 raft_consensus.cc:2410] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
W20260709 13:17:45.406488  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 82846.6us
I20260709 13:17:45.381331 10588 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:45.411978  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.383335 10531 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:45.341382 10523 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:45.421535  3090 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:45.424016 10614 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:17:45.431660 10414 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:45.432596 10414 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:45.437999 10576 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:45.440016 10501 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:45.421486 10258 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:45.442020 10258 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:45.443118 10414 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:45.444583 10258 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:45.458837  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:45.456254 10533 consensus_meta.cc:287] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.002s
I20260709 13:17:45.387652 10431 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:45.464367 10460 consensus_meta.cc:287] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.918s	user 0.004s	sys 0.011s
I20260709 13:17:45.462767 10617 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.482455  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:45.473284 10483 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.459681 10001 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:45.492895  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:45.470157 10591 consensus_meta.cc:287] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.560s	user 0.004s	sys 0.007s
I20260709 13:17:45.482257  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:45.468470 10414 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.494804  9256 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.496476 10563 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:45.497021  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:45.474036 10601 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:45.497561  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:45.499677 10617 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:45.500527 10483 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:45.502089  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 3587) took 1162 ms. Trace:
W20260709 13:17:45.502960 10621 log.cc:927] Time spent T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:45.466617 10375 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:17:45.514477  3047 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:45.472097 10531 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:45.516948  3048 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 24 LEADER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 23. Current term is 24. Ops: []
I20260709 13:17:45.516606  9256 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:45.502996 10523 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:45.508024 10396 consensus_meta.cc:287] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.719s	user 0.008s	sys 0.004s
I20260709 13:17:45.592702  9256 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:45.491863 10533 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:45.529883  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:45.532769  3123 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:17:45.538049  3045 rpcz_store.cc:276] 0709 13:17:44.339500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.339651 (+   151us) service_pool.cc:224] Handling call
0709 13:17:45.501844 (+1162193us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54003c2dd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:45.501986 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":634353920}
I20260709 13:17:45.539142  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:45.607241  3117 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:45.607666  3118 raft_consensus.cc:2410] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:17:45.465451  9926 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:45.467355 10418 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.521981 10414 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:45.509344 10431 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:45.508056 10001 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.552325 10617 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:45.536700 10494 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:17:45.556169  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:45.558060 10425 consensus_queue.cc:1059] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:17:45.559286 10632 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.561352 10358 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:45.564821 10460 consensus_queue.cc:1059] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:17:45.566413 10274 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:45.571818  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:45.654982  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:45.569320  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 28 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:45.656679  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:45.572886  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 28 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:45.573645  3126 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:17:45.658479  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:45.658641  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:45.540153  3090 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:45.576675  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:45.482303 10258 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:45.584903 10633 log.cc:927] Time spent T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:17:45.660000  3198 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:45.660056  3126 raft_consensus.cc:1240] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:45.586243 10483 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:45.586445 10366 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.587044  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:45.664328  3120 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:17:45.665597  3194 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
W20260709 13:17:45.588785 10624 log.cc:927] Time spent T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:17:45.591617  3761 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:45.598239  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:45.527326  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:45.538193 10601 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:45.609544  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:45.671955  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 73876us
I20260709 13:17:45.671713  3117 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
I20260709 13:17:45.479032 10506 consensus_queue.cc:237] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:45.627816  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:45.634763  3196 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:45.520637 10591 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:45.626452 10619 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.601018 10608 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.639155  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:45.640954  3195 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:45.644655  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:45.646981  3044 raft_consensus.cc:2410] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 19 because replica has last-logged OpId of term: 17 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:17:45.593322 10576 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.049s
I20260709 13:17:45.685724  3198 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:45.582664  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:45.655484  3199 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:45.636137 10001 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:45.689838  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:45.668751  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:45.590870 10531 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:45.668776  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 89247.4us
I20260709 13:17:45.620947 10456 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:17:45.676985  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:45.695685  3194 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
W20260709 13:17:45.656005 10430 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.011s	sys 0.012s
I20260709 13:17:45.673067  3164 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:45.643972 10425 raft_consensus.cc:3055] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:45.686332  3118 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:45.687453  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:45.687371  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:45.688464  3045 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:45.628372 10418 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:45.689437  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:45.662707  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 122643us
I20260709 13:17:45.690825  3050 raft_consensus.cc:2393] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:45.672353 10375 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:45.682884 10601 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:45.683979 10483 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:45.701310  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.761467  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 147907us
I20260709 13:17:45.756017  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:45.743505  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 70518.6us
I20260709 13:17:45.707226  3194 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:45.743641  3117 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 24.
I20260709 13:17:45.768106  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:45.744918  3199 raft_consensus.cc:2393] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:45.685129 10595 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:45.747474  3047 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:17:45.692876 10515 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:45.748584  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:45.674256 10366 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:45.710069  9256 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:45.654830 10632 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:45.819352  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:45.819968  3194 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:17:45.698697 10576 consensus_queue.cc:1243] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 24.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:17:45.755091  3762 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:17:45.767686 10638 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:17:45.759546  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 131803us
I20260709 13:17:45.828647  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:45.874795  3048 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:17:45.667618 10258 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:45.815600  3198 raft_consensus.cc:2393] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 20: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:45.816802  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:45.759826 10464 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:45.884258  3196 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:17:45.748376 10375 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:45.703450 10430 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.012s	sys 0.012s
I20260709 13:17:45.711144 10302 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.115s
I20260709 13:17:45.693540 10619 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:45.855839 10640 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:45.849324  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 2802) took 1038 ms. Trace:
W20260709 13:17:45.847100 10607 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.438s	user 0.001s	sys 0.000s
I20260709 13:17:45.699476  3761 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:45.894588  3121 rpcz_store.cc:276] 0709 13:17:44.810723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.810882 (+   159us) service_pool.cc:224] Handling call
0709 13:17:45.849136 (+1038254us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54003e7954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:45.849269 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393543552}
I20260709 13:17:45.894548  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:17:45.896075  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 196667us
I20260709 13:17:45.896402  3121 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:17:45.845683  3195 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:17:45.897063  3761 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:45.829629 10523 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.898757 10523 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:45.862455  3192 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 24.
I20260709 13:17:45.876456 10337 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.810884  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:45.878754  3048 pending_rounds.cc:85] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 7
I20260709 13:17:45.794874 10287 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.111s
I20260709 13:17:45.906468  3048 pending_rounds.cc:107] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260709 13:17:45.906831  3048 raft_consensus.cc:2889] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:45.822175  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 67170.3us
I20260709 13:17:45.844229  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:45.852751  3191 raft_consensus.cc:1240] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 16. Current term is 17. Ops: [14.11-16.12]
I20260709 13:17:45.907800  3118 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:17:45.758984  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:45.908833  3043 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:45.745652 10425 raft_consensus.cc:740] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:45.876955 10498 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:45.700809 10628 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.755147 10358 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:45.827135 10620 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:17:45.706425 10616 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.203s
I20260709 13:17:45.958119 10627 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:17:45.830756 10637 log.cc:927] Time spent T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:17:45.795392 10399 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:45.854566 10639 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:17:45.852667 10603 consensus_meta.cc:287] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.536s	user 0.012s	sys 0.000s
I20260709 13:17:45.693430 10608 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:45.813365 10595 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.891323  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:45.826288 10630 log.cc:927] Time spent T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:17:45.847986 10282 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.827028 10450 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:45.827528 10418 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:45.814842 10502 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:46.028316 10502 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:45.854506  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 3263) took 1141 ms. Trace:
I20260709 13:17:46.029892  3197 rpcz_store.cc:276] 0709 13:17:44.712853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.722216 (+  9363us) service_pool.cc:224] Handling call
0709 13:17:45.854311 (+1132095us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b540033e5d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:45.854435 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568659840}
I20260709 13:17:45.909525  3118 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:17:45.985035 10399 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:46.031558  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:45.700922 10410 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.125s
I20260709 13:17:46.032382 10399 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:45.751590 10414 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:46.009325 10533 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:45.914000  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.817838 10488 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:45.800590 10456 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.094s
I20260709 13:17:45.830667 10531 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:45.953893  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 44536.5us
I20260709 13:17:45.892570 10375 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:45.987640 10358 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.920858  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:46.053129  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:45.918545  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:45.837517 10625 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.065s
I20260709 13:17:45.958392  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:45.877995  3126 raft_consensus.cc:2410] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:17:45.959263  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1370) took 1162 ms. Trace:
I20260709 13:17:46.008505 10595 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:45.889845 10431 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:45.966287  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:45.967160  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:45.968237  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:45.843139 10505 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.110s
I20260709 13:17:45.918609  3798 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:17:45.917559  3045 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:45.970340  3043 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:17:45.830817 10515 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:45.953045 10433 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:45.915733 10337 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:45.958787 10619 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:45.897964 10001 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:45.959378 10638 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:17:45.906641  9874 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:46.005618  3117 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
W20260709 13:17:45.987272 10623 log.cc:927] Time spent T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:17:46.022807 10282 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:46.130084  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1548) took 1019 ms. Trace:
I20260709 13:17:46.130630  3042 rpcz_store.cc:276] 0709 13:17:45.110572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.221448 (+110876us) service_pool.cc:224] Handling call
0709 13:17:45.257661 (+ 36213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.420912 (+163251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.420955 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.420996 (+    41us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:45.421031 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.129797 (+708766us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b540028c154. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:46.129839 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:46.130006 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":374952704}
I20260709 13:17:46.132287 10282 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:46.030221  3044 raft_consensus.cc:1275] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:17:45.985944 10603 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:46.092896 10597 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.965s	user 0.004s	sys 0.000s
I20260709 13:17:46.037956  9256 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:46.034454 10488 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:46.125038 10608 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:45.894055 10461 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.118s
I20260709 13:17:45.964556  3191 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:17:46.060779  3119 rpcz_store.cc:276] 0709 13:17:44.796384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.796508 (+   124us) service_pool.cc:224] Handling call
0709 13:17:44.796821 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:45.064606 (+267785us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.064701 (+    95us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:45.085942 (+ 21241us) log.cc:844] Serialized 26 byte log entry
0709 13:17:45.264968 (+179026us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:17:45.265026 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.265178 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.959004 (+693826us) raft_consensus.cc:1685] finished
0709 13:17:45.959026 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.959189 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4967,"raft.queue_time_us":96903,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"thread_start_us":376176,"threads_started":2,"wal-append.queue_time_us":544238}
I20260709 13:17:45.984338 10628 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:46.186594 10274 consensus_meta.cc:287] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.001s
I20260709 13:17:46.188479 10628 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:46.190155  3051 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:46.192094 10372 raft_consensus.cc:3055] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:46.192588 10372 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:46.198364 10372 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:45.954128 10617 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.108s
I20260709 13:17:46.022430 10450 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.063699 10569 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:46.209455  3122 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:45.911309 10580 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.148s
I20260709 13:17:46.043337 10414 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.984253 10498 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:46.219694  3791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 871) took 1427 ms. Trace:
I20260709 13:17:46.095347 10337 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:46.102151  3795 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:46.107755 10258 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:46.108896 10249 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:46.115042 10592 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:46.117142 10001 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:46.117487  3797 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 983) took 1358 ms. Trace:
I20260709 13:17:46.080821 10366 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:46.072214 10494 consensus_queue.cc:1059] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:17:46.035905 10425 consensus_queue.cc:260] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:46.071940 10358 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:46.075503 10431 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:46.145936 10591 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:46.142524 10523 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:46.134977 10502 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:46.137878 10515 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:46.163295  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 3258) took 1494 ms. Trace:
I20260709 13:17:46.045838 10418 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:17:45.826704  9926 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:46.058683  3796 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 24.
I20260709 13:17:46.061659  3790 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 15.
I20260709 13:17:46.106884 10619 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:46.211186  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:46.212359  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 349199us
I20260709 13:17:46.224162  3046 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:46.220232  3791 rpcz_store.cc:276] 0709 13:17:44.792217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.792346 (+   129us) service_pool.cc:224] Handling call
0709 13:17:45.369015 (+576669us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:45.382340 (+ 13325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.219445 (+837105us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b54006f3bd0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:46.219622 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1325510528}
I20260709 13:17:46.233222  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:46.239356  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:46.199841 10612 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.183888 10632 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:46.246798  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 396659us
I20260709 13:17:46.231909 10450 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:46.270535  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:46.310813  3799 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:46.231753  9874 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.238277 10372 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:46.318168  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:46.322039  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:46.322503 10498 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:46.322875  3798 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 21: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:46.324014  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:46.325067  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:46.326027  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:46.318209  9874 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:46.282147  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:46.283706  3049 rpcz_store.cc:276] 0709 13:17:44.668773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.669256 (+   483us) service_pool.cc:224] Handling call
0709 13:17:44.669549 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.522869 (+853320us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:45.546967 (+ 24098us) log.cc:844] Serialized 14 byte log entry
0709 13:17:45.695433 (+148466us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.695487 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:45.695539 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.153440 (+457901us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b54001d74d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:46.153512 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:46.153727 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85529,"prepare.queue_time_us":44106,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":74936,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":17586,"spinlock_wait_cycles":1896357120,"thread_start_us":118426,"threads_started":1,"wal-append.queue_time_us":209214}
I20260709 13:17:46.331055  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:46.332476  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:46.273339 10506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.010s	sys 0.005s
I20260709 13:17:46.300444  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:46.306874  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:46.334038  3126 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:46.309789  3165 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:46.233366 10414 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:46.355499  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:46.241410 10399 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 13:17:46.343621  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:46.360379  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:46.407306  3049 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:46.343528 10619 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:46.361413  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:46.362439  3799 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:17:46.415688  3090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.007s	sys 0.019s
I20260709 13:17:46.362983  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:46.375590  3046 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:17:46.375247  9874 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:46.379081 10358 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:46.342934 10506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.010s	sys 0.005s
I20260709 13:17:46.387109 10488 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:46.389381 10431 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:46.391732 10595 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:46.346168 10612 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:46.447798 10001 consensus_queue.cc:1059] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:46.449251 10595 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:46.397094 10414 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:46.403589 10626 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:46.459571  3198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.017s	sys 0.013s
W20260709 13:17:46.416283  3090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.007s	sys 0.019s
I20260709 13:17:46.462101  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:46.433789 10396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.009s	sys 0.026s
I20260709 13:17:46.420385  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:46.419761  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 60627.7us
I20260709 13:17:46.431037  3126 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
W20260709 13:17:46.470083  3198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.017s	sys 0.014s
I20260709 13:17:46.449472 10515 raft_consensus.cc:3055] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:46.453299  3193 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 13:17:46.454993  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:46.405689  9926 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:17:46.455830  3196 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.002s	sys 0.028s
I20260709 13:17:46.404219  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:46.487427  3047 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.009s	sys 0.033s
I20260709 13:17:46.465274  3798 raft_consensus.cc:1813] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Handling vote request from an unknown peer 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:17:46.488586  3196 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.002s	sys 0.028s
I20260709 13:17:46.418898 10498 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.418789 10366 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.490414  3798 raft_consensus.cc:2368] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 20. Current term is 21.
I20260709 13:17:46.470506  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:46.394304 10603 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:46.472210  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:46.467434  3164 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:46.473984  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.475350  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:17:46.476512  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:46.445179 10466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.013s	sys 0.021s
I20260709 13:17:46.483201  3799 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 15.
I20260709 13:17:46.483871  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:46.450311 10523 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:46.416980  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:17:46.470264 10396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.009s	sys 0.027s
I20260709 13:17:46.487323  3090 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:46.449287 10001 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 13:17:46.682933  3195 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.022s	sys 0.034s
W20260709 13:17:47.060236  3195 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.161s	user 0.024s	sys 0.052s
I20260709 13:17:46.234457  3797 rpcz_store.cc:276] 0709 13:17:44.759401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.759558 (+   157us) service_pool.cc:224] Handling call
0709 13:17:44.759948 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:44.901826 (+141878us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:17:45.041189 (+139363us) log.cc:844] Serialized 14 byte log entry
0709 13:17:45.391312 (+350123us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.391369 (+    57us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:17:45.391421 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.117200 (+725779us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54006540d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:46.117263 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:46.117423 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1805,"prepare.queue_time_us":163598,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":81624,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":12401,"spinlock_wait_cycles":325663104,"thread_start_us":487917,"threads_started":3,"wal-append.queue_time_us":141597,"wal-append.run_cpu_time_us":3555,"wal-append.run_wall_time_us":1043501}
I20260709 13:17:46.655750  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:46.539902  3051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 3273) took 1054 ms. Trace:
I20260709 13:17:47.062294  3050 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:47.062417  3051 rpcz_store.cc:276] 0709 13:17:45.485058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.486185 (+  1127us) service_pool.cc:224] Handling call
0709 13:17:46.539664 (+1053479us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b540027c9d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:46.539823 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1543079168}
W20260709 13:17:46.567662  3092 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.026s	sys 0.016s
W20260709 13:17:46.775940  3194 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.012s	sys 0.027s
W20260709 13:17:47.063658  3092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.033s	sys 0.034s
W20260709 13:17:47.063855  3194 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.020s	sys 0.034s
W20260709 13:17:47.064965  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 597561us
I20260709 13:17:47.066051  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:46.530961  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:46.660590  3762 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:46.822180  3121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.000s	sys 0.031s
W20260709 13:17:47.094172  3121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.000s	sys 0.040s
W20260709 13:17:46.778227  3043 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.016s	sys 0.013s
W20260709 13:17:47.094985  3043 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.020s	sys 0.020s
I20260709 13:17:46.532426  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:46.758246  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:47.090612  3164 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:46.491201  3126 raft_consensus.cc:2393] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 22: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:46.471376 10506 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:17:46.828601  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.069505  3042 raft_consensus.cc:2393] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:46.533661  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:47.070297  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:46.719682 10639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.005s	sys 0.022s
W20260709 13:17:47.069527  3047 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.184s	user 0.015s	sys 0.038s
I20260709 13:17:46.466226 10626 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:47.072794  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 585723us
I20260709 13:17:47.089461  9256 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:47.087829  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:47.086110  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:46.491060  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:46.482774 10430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.008s	sys 0.024s
I20260709 13:17:47.112664  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:47.112851  9256 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:47.113369  3049 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:46.758780  9926 raft_consensus.cc:697] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:46.465256 10375 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:47.066887 10466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.304s	user 0.023s	sys 0.028s
I20260709 13:17:47.118661  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:47.097810  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:17:47.068392  3015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.993s	user 0.009s	sys 0.017s
I20260709 13:17:47.120451  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:46.512072 10287 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.616s
W20260709 13:17:47.098886  3119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.006s	sys 0.019s
W20260709 13:17:47.121929  3119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.007s	sys 0.019s
W20260709 13:17:47.093096  3048 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.015s	sys 0.009s
I20260709 13:17:47.099318 10627 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:17:47.100140  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 439611us
I20260709 13:17:47.122421  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:46.855182 10601 consensus_meta.cc:287] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.040s	user 0.012s	sys 0.000s
W20260709 13:17:47.059691  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 545647us
I20260709 13:17:46.702755 10592 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.820401 10563 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.482651 10515 raft_consensus.cc:740] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:46.490509 10456 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.150511  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:47.152308  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:47.159094  3191 raft_consensus.cc:2393] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:47.141875  3125 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
W20260709 13:17:47.168642  3198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.014s	sys 0.017s
W20260709 13:17:47.169054  3198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.014s	sys 0.017s
W20260709 13:17:47.172771  3117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.014s	sys 0.027s
W20260709 13:17:47.174525  3117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.014s	sys 0.027s
W20260709 13:17:47.324662  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.123839  3050 raft_consensus.cc:2410] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
W20260709 13:17:47.127146  3124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.018s	sys 0.026s
W20260709 13:17:47.322546  3045 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.990s	user 0.030s	sys 0.010s
W20260709 13:17:47.124095  3048 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.016s	sys 0.009s
I20260709 13:17:47.090119  3046 raft_consensus.cc:2410] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 23 because replica has last-logged OpId of term: 21 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 13:17:47.124742  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:47.132966  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:47.124711  3192 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 13:17:47.123034  3164 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:47.126840  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:47.119392  3193 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:47.128899  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:47.106233  3792 raft_consensus.cc:2410] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:17:47.112211  3797 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 22: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:47.137068  9256 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:47.237340 10287 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:46.737640 10431 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:47.168365 10478 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.026s	sys 0.023s
I20260709 13:17:46.655475 10366 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:47.163617 10456 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:47.106762 10460 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:17:46.510663 10414 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:47.112700 10430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.153s	user 0.013s	sys 0.045s
I20260709 13:17:47.118911 10466 raft_consensus.cc:3055] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:17:47.219717 10488 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.016s	sys 0.018s
I20260709 13:17:47.191459 10001 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:47.085688 10502 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:47.154763 10407 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:47.138952 10592 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:47.085887 10523 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:46.510686 10498 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:47.110981 10506 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:47.139390 10568 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.105988 10603 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:17:46.739117 10625 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.137656 10601 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:46.893443 10619 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:47.106647 10639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.007s	sys 0.033s
I20260709 13:17:47.348902  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:47.359714 10366 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:46.482252 10632 consensus_queue.cc:1048] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.622s
I20260709 13:17:47.377074 10568 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:47.414124  3123 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:47.416239 10601 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:47.416780 10568 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:47.346863  3165 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:47.363566 10502 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:47.419198 10375 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:47.362674 10001 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:47.366511  3791 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:47.421262 10612 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:47.195711  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:47.157495 10563 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:47.225581 10659 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:47.500448  3197 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
W20260709 13:17:47.267467 10649 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 13:17:47.267201 10648 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:17:47.512776 10627 raft_consensus.cc:697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:47.521183 10366 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:47.522006 10366 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:47.522560 10366 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:47.522915 10627 consensus_queue.cc:237] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:47.524039  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 374809us
I20260709 13:17:47.213495 10515 consensus_queue.cc:260] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:47.258924 10591 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:17:47.325707  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:47.328393  3045 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.030s	sys 0.011s
W20260709 13:17:47.322310  3015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.247s	user 0.009s	sys 0.018s
W20260709 13:17:47.328107  3124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.018s	sys 0.026s
W20260709 13:17:47.362058 10488 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.016s	sys 0.019s
I20260709 13:17:47.341609  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:47.199112 10656 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:47.530771  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1565) took 1261 ms. Trace:
I20260709 13:17:47.338168  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 3135) took 1023 ms. Trace:
I20260709 13:17:47.533167 10563 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:47.533105  3126 rpcz_store.cc:276] 0709 13:17:46.314796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.132637 (+817841us) service_pool.cc:224] Handling call
0709 13:17:47.337927 (+205290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:47.536145  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 3137) took 1220 ms. Trace:
I20260709 13:17:47.536545  3126 rpcz_store.cc:276] 0709 13:17:46.315456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.534714 (+1219258us) service_pool.cc:224] Handling call
0709 13:17:47.535322 (+   608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.535714 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.535745 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:47.535826 (+    81us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:47.535861 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.535923 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.536060 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:47.334748  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1382) took 1041 ms. Trace:
I20260709 13:17:47.368515 10592 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:47.327819  3050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 3612) took 1003 ms. Trace:
I20260709 13:17:47.538278  3793 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:47.538686  3050 rpcz_store.cc:276] 0709 13:17:46.324012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.117237 (+793225us) service_pool.cc:224] Handling call
0709 13:17:47.327480 (+210243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:47.540016  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:47.540390  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 1.47179e+06us
I20260709 13:17:47.541090  3793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 1005) took 1052 ms. Trace:
I20260709 13:17:47.367754 10523 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:47.542249 10523 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:47.543145 10523 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:47.345866  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3272) took 1504 ms. Trace:
I20260709 13:17:47.373102 10506 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:47.375618  3125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55318 (request call id 1374) took 1848 ms (client timeout 2197 ms). Trace:
I20260709 13:17:47.358726 10414 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:47.546662  3198 rpcz_store.cc:276] 0709 13:17:45.840865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.886778 (+ 45913us) service_pool.cc:224] Handling call
0709 13:17:45.887101 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:46.472872 (+585771us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:46.472905 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:46.473398 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:17:47.169551 (+696153us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:47.169613 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.169719 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:47.345095 (+175376us) raft_consensus.cc:1685] finished
0709 13:17:47.345144 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.345528 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":158970,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":9324,"thread_start_us":1265359,"threads_started":2,"wal-append.queue_time_us":792644}
I20260709 13:17:47.357061 10431 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:47.549942  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:47.505846 10662 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:47.551534  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:47.551470 10662 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:47.356624 10287 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:47.553009  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:47.554687 10287 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:47.360265 10466 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:47.412184 10625 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:47.226461  9926 consensus_queue.cc:237] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:47.345314  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 222193us
I20260709 13:17:47.359656 10456 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:47.199087 10654 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:47.560429 10466 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:47.399911  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:47.562507  3120 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 24.
I20260709 13:17:47.563102  3120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 3145) took 1106 ms. Trace:
I20260709 13:17:47.404407  3122 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:47.563578 10679 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:47.564507 10679 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:47.566793 10662 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:47.452864  3200 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:47.567253 10679 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:47.568224  3794 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 24.
I20260709 13:17:47.377136 10603 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.570047 10603 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:47.541570  3793 rpcz_store.cc:276] 0709 13:17:46.489155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.533335 (+ 44180us) service_pool.cc:224] Handling call
0709 13:17:47.540889 (+1007554us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54009aae54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:47.541027 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":998025088}
W20260709 13:17:47.453109  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 106777us
I20260709 13:17:47.364053 10407 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:47.574468  3165 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:47.478421 10001 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:47.576380 10407 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:47.501304 10659 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:47.447551 10664 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:47.578172 10664 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:47.579135 10659 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:47.579368 10466 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:47.486017 10502 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:47.580396 10502 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:47.580992 10664 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:47.582849 10396 raft_consensus.cc:3055] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:47.583351 10396 raft_consensus.cc:740] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:47.583570 10502 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:47.512738  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 362099us
I20260709 13:17:47.584009  3121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 3128) took 1756 ms. Trace:
I20260709 13:17:47.513444 10531 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:47.585408 10531 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:47.512260 10655 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:47.587154  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:47.587393 10655 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:47.588469 10680 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:47.589402 10680 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:47.591225  3165 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:47.592028 10650 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:47.592343 10680 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:47.592629 10650 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.593039 10680 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:47.593259 10650 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:47.277169 10626 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:47.526571 10591 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:47.645246 10591 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:47.558535 10425 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:47.566680  3164 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:47.647320  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 80879.8us
W20260709 13:17:47.648350 10671 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.136s	user 0.000s	sys 0.002s
I20260709 13:17:47.525835  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:47.649439 10664 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:47.650192 10655 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:47.650004 10502 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:17:47.592690 10595 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:47.537945  3119 rpcz_store.cc:276] 0709 13:17:46.293261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.293781 (+   520us) service_pool.cc:224] Handling call
0709 13:17:46.294188 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:46.294632 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:46.294670 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:46.295222 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 13:17:47.122404 (+827182us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:17:47.122449 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.122509 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:47.333980 (+211471us) raft_consensus.cc:1685] finished
0709 13:17:47.334036 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.334382 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2630,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":30934,"thread_start_us":826800,"threads_started":1,"wal-append.queue_time_us":955668}
I20260709 13:17:47.650025  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 3284) took 1136 ms. Trace:
I20260709 13:17:47.531167 10656 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:47.597499  3198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "f20672b2852447a6bc1e137c4dd40904"
 from {username='slave'} at 127.0.0.1:55558
W20260709 13:17:47.547605  3125 rpcz_store.cc:269] 0709 13:17:45.526638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.526862 (+   224us) service_pool.cc:224] Handling call
0709 13:17:47.375082 (+1848220us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54000a8f54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:47.375340 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3386479360}
I20260709 13:17:47.596582 10659 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:47.569361 10625 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:47.584826 10396 consensus_queue.cc:260] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:47.589550  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:47.563439  3120 rpcz_store.cc:276] 0709 13:17:46.456766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.336360 (+879594us) service_pool.cc:224] Handling call
0709 13:17:47.563040 (+226680us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:47.622030  3124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1381) took 1329 ms. Trace:
W20260709 13:17:47.626742 10667 log.cc:927] Time spent T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:17:47.627254  3050 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 24.
I20260709 13:17:47.662370 10396 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:47.663190  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:47.666074  3198 raft_consensus.cc:606] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Received request to transfer leadership to TS f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:47.666396  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:47.666764  3198 raft_consensus.cc:614] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:47.667490  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 3282) took 1154 ms. Trace:
I20260709 13:17:47.667708 10460 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:47.627281  9874 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:47.668462 10460 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:47.669215  9874 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:17:47.671759 10653 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.410s	user 0.000s	sys 0.001s
W20260709 13:17:47.668990  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 84197.9us
I20260709 13:17:47.672784 10684 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:17:47.667977  3044 rpcz_store.cc:276] 0709 13:17:46.513227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.665840 (+1152613us) service_pool.cc:224] Handling call
0709 13:17:47.667415 (+  1575us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:47.674659  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:17:47.635686  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.635711 10399 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:17:47.636711 10670 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:17:47.562516 10456 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:47.639585  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 3140) took 1322 ms. Trace:
I20260709 13:17:47.640544 10414 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:47.641232 10676 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.086s	user 0.001s	sys 0.001s
I20260709 13:17:47.584525  3121 rpcz_store.cc:276] 0709 13:17:45.827838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.897248 (+ 69410us) service_pool.cc:224] Handling call
0709 13:17:45.904079 (+  6831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:46.130844 (+226765us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:46.131159 (+   315us) log.cc:844] Serialized 14 byte log entry
0709 13:17:47.582368 (+1451209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:47.582796 (+   428us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:47.582928 (+   132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.583565 (+   637us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400319554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:47.583608 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.583799 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":179,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":149776,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":12607,"spinlock_wait_cycles":520738432,"thread_start_us":1365869,"threads_started":2,"wal-append.queue_time_us":1145118}
W20260709 13:17:47.356884 10478 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.026s	sys 0.024s
W20260709 13:17:47.653115  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 127217us
I20260709 13:17:47.683395  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3276) took 1841 ms. Trace:
I20260709 13:17:47.684119 10603 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:47.678469 10456 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:47.657426 10659 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:47.686954 10659 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:47.687649 10456 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:47.680012  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3606) took 1381 ms. Trace:
I20260709 13:17:47.689778 10563 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:17:47.688864  3045 rpcz_store.cc:276] 0709 13:17:46.298553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.298750 (+   197us) service_pool.cc:224] Handling call
0709 13:17:46.331046 (+ 32296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:46.331452 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:46.331766 (+   314us) log.cc:844] Serialized 14 byte log entry
0709 13:17:47.579017 (+1247251us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:47.579764 (+   747us) log.cc:844] Serialized 26 byte log entry
0709 13:17:47.580138 (+   374us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:47.580183 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.580266 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:47.679678 (+ 99412us) raft_consensus.cc:1685] finished
0709 13:17:47.679697 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.679938 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6951,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":6225,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":16843,"thread_start_us":1195444,"threads_started":1,"wal-append.queue_time_us":921053}
I20260709 13:17:47.691566 10563 consensus_queue.cc:1059] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:47.652328  3042 rpcz_store.cc:276] 0709 13:17:46.513800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.504459 (+990659us) service_pool.cc:224] Handling call
0709 13:17:47.649957 (+145498us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:47.680862 10399 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:47.692878  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:47.655838 10595 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.660065  3124 rpcz_store.cc:276] 0709 13:17:46.292897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.293026 (+   129us) service_pool.cc:224] Handling call
0709 13:17:46.325405 (+ 32379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:46.325954 (+   549us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:17:46.326284 (+   330us) log.cc:844] Serialized 14 byte log entry
0709 13:17:47.534773 (+1208489us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:47.535943 (+  1170us) log.cc:844] Serialized 26 byte log entry
0709 13:17:47.536224 (+   281us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:17:47.536274 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.536386 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:47.557383 (+ 20997us) raft_consensus.cc:1685] finished
0709 13:17:47.557401 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.621947 (+ 64546us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":143,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":12617,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":296,"thread_start_us":1207674,"threads_started":1,"wal-append.queue_time_us":954381}
I20260709 13:17:47.552124 10431 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:47.634804 10662 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:17:47.633980  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 88496us
I20260709 13:17:47.654139 10523 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:47.677356  3126 rpcz_store.cc:276] 0709 13:17:46.316990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.638178 (+1321188us) service_pool.cc:224] Handling call
0709 13:17:47.638755 (+   577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.639157 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.639185 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:47.639261 (+    76us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:47.639302 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.639383 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.639524 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:47.675974  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:47.656448  3200 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:47.691648  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:47.693722  3042 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:47.708156  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:47.678066  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3597) took 2060 ms. Trace:
I20260709 13:17:47.709847 10563 consensus_queue.cc:1243] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:17:47.710299  3050 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:47.710654 10483 raft_consensus.cc:3055] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:47.711315  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:47.712019  3165 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:47.712348 10414 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:17:47.712926  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:47.715216 10536 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:17:47.709507  3047 rpcz_store.cc:276] 0709 13:17:45.615248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.822770 (+207522us) service_pool.cc:224] Handling call
0709 13:17:45.823255 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:45.877324 (+ 54069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.877359 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:45.885470 (+  8111us) log.cc:844] Serialized 26 byte log entry
0709 13:17:47.105024 (+1219554us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:17:47.105067 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.105229 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:47.670761 (+565532us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:47.674738 (+  3977us) raft_consensus.cc:1685] finished
0709 13:17:47.674760 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.675025 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53497,"raft.queue_time_us":53640,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":7786,"spinlock_wait_cycles":27021696,"thread_start_us":1219154,"threads_started":1,"wal-append.queue_time_us":1347011}
I20260709 13:17:47.715682 10536 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.716140 10536 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:47.716480  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:47.717315  3047 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:47.710327 10662 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:47.719551 10656 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:47.719707  3794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 1004) took 1234 ms. Trace:
I20260709 13:17:47.720234  3794 rpcz_store.cc:276] 0709 13:17:46.484794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.532052 (+ 47258us) service_pool.cc:224] Handling call
0709 13:17:47.719497 (+1187445us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b5400494154. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:47.719628 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1079862528}
I20260709 13:17:47.720809 10657 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:17:47.721856  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:47.711663  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:47.556067  3048 rpcz_store.cc:276] 0709 13:17:46.265847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.266102 (+   255us) service_pool.cc:224] Handling call
0709 13:17:46.266521 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:46.266800 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:17:46.288029 (+ 21229us) log.cc:844] Serialized 14 byte log entry
0709 13:17:47.492577 (+1204548us) log.cc:844] Serialized 14 byte log entry
0709 13:17:47.518905 (+ 26328us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:47.520818 (+  1913us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:47.526286 (+  5468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.526417 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.526623 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":231625,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":58889,"raft.run_cpu_time_us":757,"raft.run_wall_time_us":56117,"thread_start_us":1201717,"threads_started":2,"wal-append.queue_time_us":992475}
I20260709 13:17:47.650676 10680 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:47.757880  3042 raft_consensus.cc:2410] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 25 because replica has last-logged OpId of term: 23 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
I20260709 13:17:47.758479  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:47.767522  3044 raft_consensus.cc:2368] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22.
I20260709 13:17:47.680024 10684 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.683883  3195 rpcz_store.cc:276] 0709 13:17:45.842072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.898930 (+ 56858us) service_pool.cc:224] Handling call
0709 13:17:45.899170 (+   240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:47.060629 (+1161459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.060672 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:47.061226 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:17:47.512930 (+451704us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:47.513002 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.513107 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:47.683004 (+169897us) raft_consensus.cc:1685] finished
0709 13:17:47.683025 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.683199 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":247726,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":117,"thread_start_us":1554284,"threads_started":2,"wal-append.queue_time_us":492723}
W20260709 13:17:47.770931  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 59064.9us
I20260709 13:17:47.714696 10414 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:47.701452 10595 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:47.774149 10603 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:47.782301  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 61085.5us
I20260709 13:17:47.782627  3047 raft_consensus.cc:2410] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 21 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:17:47.784757  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1379) took 1822 ms. Trace:
I20260709 13:17:47.711231 10483 raft_consensus.cc:740] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:47.790020  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:47.790197  3122 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:17:47.774562 10414 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:47.793346  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:47.791767  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 91373.3us
I20260709 13:17:47.785357  3123 rpcz_store.cc:276] 0709 13:17:45.962102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.962594 (+   492us) service_pool.cc:224] Handling call
0709 13:17:45.963058 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.414912 (+1451854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.734499 (+319587us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400189cd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:47.784675 (+ 50176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3335753472}
I20260709 13:17:47.758657 10366 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:47.703616 10001 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.788411 10662 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:47.796859 10414 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:47.793066 10431 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:17:47.813795 10523 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:17:47.833037 10483 consensus_queue.cc:260] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:47.834937 10483 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:47.839686  3045 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 13:17:47.840073  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:47.840473  3045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3614) took 1515 ms. Trace:
I20260709 13:17:47.840929  3045 rpcz_store.cc:276] 0709 13:17:46.324568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.774509 (+1449941us) service_pool.cc:224] Handling call
0709 13:17:47.822121 (+ 47612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.840162 (+ 18041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.840396 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:47.842139 10399 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:47.842284 10418 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:47.842935 10580 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.843134 10418 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:47.830509  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:47.840946  3044 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 24.
I20260709 13:17:47.859342  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2711) took 2259 ms. Trace:
I20260709 13:17:47.859889  3194 rpcz_store.cc:276] 0709 13:17:45.600283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.820645 (+220362us) service_pool.cc:224] Handling call
0709 13:17:45.874917 (+ 54272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.875189 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:17:45.888257 (+ 13068us) log.cc:844] Serialized 14 byte log entry
0709 13:17:46.096529 (+208272us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b1800380fe0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c3455 00007ff8303ab060 00007ff8303bd716 00007ff8303ce287 00007ff8303ce208
0709 13:17:47.533907 (+1437378us) log.cc:844] Serialized 14 byte log entry
0709 13:17:47.828587 (+294680us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:47.841883 (+ 13296us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:17:47.842013 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.844069 (+  2056us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.859147 (+ 15078us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":462742,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":6093,"raft.queue_time_us":190782,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":19272,"spinlock_wait_cycles":7369216,"thread_start_us":1684577,"threads_started":3}
W20260709 13:17:47.862601  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 55570.5us
I20260709 13:17:47.866811  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1383) took 1488 ms. Trace:
I20260709 13:17:47.867422  3117 rpcz_store.cc:276] 0709 13:17:46.293588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.295651 (+  2063us) service_pool.cc:224] Handling call
0709 13:17:46.296029 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:46.296418 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:46.296457 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:46.297011 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:17:47.325533 (+1028522us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:17:47.495899 (+170366us) log.cc:844] Serialized 14 byte log entry
0709 13:17:47.647438 (+151539us) spinlock_profiling.cc:243] Waited 5.93 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:47.654025 (+  6587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.658805 (+  4780us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:47.722903 (+ 64098us) raft_consensus.cc:1685] finished
0709 13:17:47.767252 (+ 44349us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.781701 (+ 14449us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96265,"prepare.queue_time_us":272348,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":145775,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":47739,"spinlock_wait_cycles":13631744,"thread_start_us":1069997,"threads_started":2,"wal-append.queue_time_us":1164988}
I20260709 13:17:47.869926  3042 raft_consensus.cc:2393] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 21: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:47.829584 10523 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.887823  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3607) took 1565 ms. Trace:
W20260709 13:17:47.891234  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 74165.4us
I20260709 13:17:47.892028  3048 raft_consensus.cc:1275] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:17:47.890026  3042 pending_rounds.cc:85] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 11
I20260709 13:17:47.897969  3048 pending_rounds.cc:85] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 9
I20260709 13:17:47.872293 10662 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:47.898139  3042 pending_rounds.cc:107] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:17:47.904197  3048 pending_rounds.cc:107] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 21.10
I20260709 13:17:47.916728  3048 raft_consensus.cc:2889] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:47.912699  3042 raft_consensus.cc:2889] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:47.918973  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.814288 10684 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:47.901242 10523 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:47.931056  3194 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:47.843712 10580 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:47.869968 10617 consensus_queue.cc:1059] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.036s
W20260709 13:17:47.923081  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.938292  3165 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:17:47.958851  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 369542us
I20260709 13:17:47.936705 10502 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:47.898696  3049 rpcz_store.cc:276] 0709 13:17:46.322435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.117306 (+794871us) service_pool.cc:224] Handling call
0709 13:17:47.117621 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.117844 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:47.496351 (+378507us) log.cc:844] Serialized 14 byte log entry
0709 13:17:47.811892 (+315541us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:47.831411 (+ 19519us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:47.884197 (+ 52786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.886154 (+  1957us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.887589 (+  1435us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":384582,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":8559,"raft.queue_time_us":11496,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":16999,"thread_start_us":412630,"threads_started":2,"wal-append.queue_time_us":337765}
I20260709 13:17:47.926930 10657 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:47.910238 10001 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:47.968880  3165 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:47.967340 10399 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.981349 10399 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:47.983799 10498 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:47.983978 10399 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:47.988350  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:47.989660  3051 raft_consensus.cc:2410] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 22 because replica has last-logged OpId of term: 20 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 16.
I20260709 13:17:47.993567  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:47.996902  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:48.001895 10673 log.cc:927] Time spent T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.501s	user 0.000s	sys 0.011s
I20260709 13:17:47.999589  3051 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:17:48.006441  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3618) took 1580 ms. Trace:
I20260709 13:17:48.006996  3048 rpcz_store.cc:276] 0709 13:17:46.426494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.777393 (+1350899us) service_pool.cc:224] Handling call
0709 13:17:47.808883 (+ 31490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.006130 (+197247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.006360 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:48.009922 10662 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:48.012231 10662 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:48.014065  3790 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:17:47.974246  3164 leader_election.cc:400] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 20. Current term is 21.
W20260709 13:17:48.015286  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:48.015913  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:48.016356  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:48.017309  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.015242  3164 leader_election.cc:403] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:48.017153 10657 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:48.019757 10684 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:48.020198  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.020988  3124 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
I20260709 13:17:48.021124 10657 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:48.021533 10418 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:48.023064 10502 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:48.023577 10502 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:48.024444  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 61225.6us
I20260709 13:17:48.024852 10664 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:48.025179  3165 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:48.026343 10655 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:48.026762 10655 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:48.027215 10655 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:48.028750  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 93125.8us
I20260709 13:17:48.029320 10654 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:17:48.030683 10651 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:48.031152  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:48.031550 10651 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:48.025290 10664 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:48.019724  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3609) took 1696 ms. Trace:
W20260709 13:17:47.989507 10450 consensus_meta.cc:287] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.583s	user 0.011s	sys 0.013s
I20260709 13:17:48.041599  3126 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 23. Current term is 24. Ops: [21.15-23.16]
I20260709 13:17:48.044337  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:48.048092  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:48.041980  3194 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:48.037763  3046 rpcz_store.cc:276] 0709 13:17:46.323093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.335106 (+1012013us) service_pool.cc:224] Handling call
0709 13:17:47.335953 (+   847us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:47.490307 (+154354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.490364 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:47.519781 (+ 29417us) log.cc:844] Serialized 26 byte log entry
0709 13:17:47.928972 (+409191us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:47.929028 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.929110 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:48.019421 (+ 90311us) raft_consensus.cc:1685] finished
0709 13:17:48.019442 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.019573 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19890,"raft.queue_time_us":61762,"raft.run_cpu_time_us":465,"raft.run_wall_time_us":19755,"thread_start_us":402715,"threads_started":2,"wal-append.queue_time_us":361187}
I20260709 13:17:48.051010  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:48.062311  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:48.039604 10664 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:48.062290  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.069065  3191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea"
dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
mode: GRACEFUL
new_leader_uuid: "aaf88538197a49adb8bcf3790309a67e"
 from {username='slave'} at 127.0.0.1:55558
I20260709 13:17:48.068374  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:48.071394  3197 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:17:48.050771 10603 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:48.074527  9256 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:48.075067 10603 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:48.074527  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.079824  3091 leader_election.cc:400] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22.
I20260709 13:17:48.075103  9256 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:48.080505 10595 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:48.081236  9256 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:48.052434 10366 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:48.082455  3090 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:48.082998 10679 consensus_queue.cc:1059] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:48.085318 10679 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:48.085664  3090 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:48.080441  3091 leader_election.cc:403] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:17:48.086377  3049 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 23.
W20260709 13:17:48.095836  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 43999.5us
I20260709 13:17:48.019695 10650 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:48.101341  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:48.062798 10680 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:48.069926 10478 raft_consensus.cc:3055] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:48.087239  9926 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.087718 10603 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:48.104555  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.104655  3191 raft_consensus.cc:606] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Received request to transfer leadership to TS aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:48.094937 10679 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.049981 10450 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:48.103302  9256 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:48.104378  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:48.130389 10478 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:17:48.142433 10699 log.cc:927] Time spent T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.050s	user 0.001s	sys 0.001s
I20260709 13:17:48.135617 10591 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:48.155808  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:48.156026  3191 raft_consensus.cc:614] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:48.159180 10628 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:17:48.159920  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:48.161828  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:48.170709  9256 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:48.162070  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.171773  3124 raft_consensus.cc:2410] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:17:48.171898  3120 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 24.
I20260709 13:17:48.154745  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.131395 10657 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:48.086654 10656 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
W20260709 13:17:48.151429  3761 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 2.197s (SENT) [suppressed 6 similar messages]
I20260709 13:17:48.150014 10679 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:48.184022  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:48.184770  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 119502us
I20260709 13:17:48.188405  3197 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:48.191587  3796 raft_consensus.cc:2368] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21.
I20260709 13:17:48.192377  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:17:48.196419  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.188767  3091 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:48.159972 10515 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:48.200232  3120 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:48.202495 10595 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:48.204977 10533 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:48.235962  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 49964.7us
W20260709 13:17:48.205554 10688 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.701s	user 0.000s	sys 0.008s
I20260709 13:17:48.206230  3164 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:48.214183 10523 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:48.228206  3121 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 24.
I20260709 13:17:48.229205  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:48.148006  9926 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:48.242054  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 156525us
I20260709 13:17:48.189663 10001 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:48.200265 10693 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:48.269358  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:48.247411 10563 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.272351  3090 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:48.247241 10603 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:48.241166 10628 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:17:48.282621  3046 raft_consensus.cc:1217] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 24 LEADER]: Deduplicated request from leader. Original: 21.15->[23.16-23.16]   Dedup: 23.16->[]
I20260709 13:17:48.303057  3046 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 24 LEADER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
W20260709 13:17:48.290819 10694 log.cc:927] Time spent T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:48.232620 10657 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:48.277805 10425 consensus_meta.cc:287] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.632s	user 0.017s	sys 0.000s
W20260709 13:17:48.314081  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 57297us
I20260709 13:17:48.271752 10580 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:48.311996 10628 consensus_queue.cc:1243] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer aaf88538197a49adb8bcf3790309a67e log is divergent from this leader: its last log entry 25.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:17:48.320320  3049 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:17:48.302034 10603 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:17:48.319778 10696 log.cc:927] Time spent T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:17:48.343341 10460 consensus_meta.cc:287] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.674s	user 0.012s	sys 0.004s
W20260709 13:17:48.344508 10536 consensus_meta.cc:287] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.628s	user 0.012s	sys 0.004s
I20260709 13:17:48.310634 10595 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:17:48.366545  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 94339.5us
W20260709 13:17:48.350674  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 199233us
I20260709 13:17:48.346499 10425 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:17:48.359424 10701 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:17:48.360247  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 154174us
I20260709 13:17:48.364109 10502 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:48.365027  3118 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:48.353581  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:48.365935  3043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1558) took 2660 ms. Trace:
I20260709 13:17:48.350209 10603 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:48.345523 10650 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609)
I20260709 13:17:48.379678  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:48.338654 10478 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:48.381243 10684 consensus_queue.cc:1059] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:17:48.381407 10478 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:48.381541  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:48.332665 10679 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:48.321296 10563 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:48.371637 10431 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.400133  3090 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:48.394266  3046 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:48.388814 10659 consensus_meta.cc:287] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.701s	user 0.018s	sys 0.000s
I20260709 13:17:48.372069  3043 rpcz_store.cc:276] 0709 13:17:45.688038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.068740 (+380702us) service_pool.cc:224] Handling call
0709 13:17:46.069130 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:47.095420 (+1026290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.095450 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:47.106700 (+ 11250us) log.cc:844] Serialized 26 byte log entry
0709 13:17:47.567691 (+460991us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:47.567760 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.567864 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:48.169704 (+601840us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:48.334311 (+164607us) raft_consensus.cc:1685] finished
0709 13:17:48.334339 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.348204 (+ 13865us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5381,"raft.queue_time_us":13201,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":15128,"spinlock_wait_cycles":50169216,"thread_start_us":1182213,"threads_started":2,"wal-append.queue_time_us":385887}
I20260709 13:17:48.379693 10657 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:48.367805 10460 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:48.369830 10536 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:48.377004 10656 consensus_queue.cc:1048] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:17:48.421620  3120 raft_consensus.cc:2410] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:17:48.392622 10450 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:48.423918 10618 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:48.424379 10619 raft_consensus.cc:3055] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:17:48.424899 10702 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:17:48.425236 10650 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:17:48.437031  3795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 999) took 1888 ms. Trace:
I20260709 13:17:48.391602 10001 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:17:48.405622 10663 raft_consensus.cc:3055] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:48.454612 10663 raft_consensus.cc:740] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:48.455638 10663 consensus_queue.cc:260] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:48.456611 10663 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:48.414628 10425 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.408954 10431 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:48.458097 10425 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:48.460809 10425 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:48.436867 10523 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:48.436915 10619 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:48.445253 10654 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 20. Current term is 21.
I20260709 13:17:48.446503  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3273) took 2605 ms. Trace:
W20260709 13:17:48.468046 10707 log.cc:927] Time spent T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:17:48.430276 10657 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:17:48.470072 10657 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:48.470503 10657 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:17:48.473883 10704 log.cc:927] Time spent T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:17:48.475601  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 75531.7us
I20260709 13:17:48.477118  3790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 887) took 2187 ms. Trace:
I20260709 13:17:48.477313  3042 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 17. (term mismatch)
I20260709 13:17:48.477991  3042 pending_rounds.cc:85] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 16
I20260709 13:17:48.477550  3790 rpcz_store.cc:276] 0709 13:17:46.289411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.325393 (+ 35982us) service_pool.cc:224] Handling call
0709 13:17:46.325661 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.014547 (+1688886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.476607 (+462060us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54005c0dd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:48.477032 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3881502592}
I20260709 13:17:48.478480  9926 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:48.478626  3042 pending_rounds.cc:107] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 20.17
I20260709 13:17:48.415874 10659 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:48.479156  3042 raft_consensus.cc:2889] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:48.480967 10659 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:48.462579  3196 rpcz_store.cc:276] 0709 13:17:45.841185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.893766 (+ 52581us) service_pool.cc:224] Handling call
0709 13:17:45.894027 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:46.489052 (+595025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:46.489086 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:47.597883 (+1108797us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b2c000fc108. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:17:47.598619 (+   736us) log.cc:844] Serialized 26 byte log entry
0709 13:17:47.886145 (+287526us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:47.887484 (+  1339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.360296 (+472812us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b54001b85d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:48.360372 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:48.446090 (+ 85718us) raft_consensus.cc:1685] finished
0709 13:17:48.446113 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.446295 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":242304,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":68,"spinlock_wait_cycles":49257216,"thread_start_us":856499,"threads_started":2,"wal-append.queue_time_us":558216}
I20260709 13:17:48.482638  3164 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:48.483533 10651 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:48.483881  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 48335.7us
I20260709 13:17:48.450201  3795 rpcz_store.cc:276] 0709 13:17:46.483125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.483286 (+   161us) service_pool.cc:224] Handling call
0709 13:17:47.569754 (+1086468us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b58000c4b98. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28ea22 00007ff8361a7c09 00007ff835301ee0 00007ff8353cb0ab 00007ff8353cb131 00007ff83538cfc0 00007ff835377929 00007ff8353773d2 00007ff82e8eebd4
0709 13:17:47.570218 (+   464us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:47.668541 (+ 98323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.668590 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:47.669478 (+   888us) log.cc:844] Serialized 52 byte log entry
0709 13:17:47.926624 (+257146us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:47.944133 (+ 17509us) log.cc:844] Serialized 14 byte log entry
0709 13:17:47.945725 (+  1592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.945845 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:48.361476 (+415631us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b1800434aa0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:17:48.370817 (+  9341us) raft_consensus.cc:1685] finished
0709 13:17:48.370848 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.371025 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90173,"prepare.queue_time_us":19104,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":99321,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":16821,"spinlock_wait_cycles":15022208,"thread_start_us":231467,"threads_started":1,"wal-append.queue_time_us":398886}
W20260709 13:17:48.486548  3118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 3134) took 2172 ms (client timeout 2117 ms). Trace:
W20260709 13:17:48.487040  3118 rpcz_store.cc:269] 0709 13:17:46.314388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.343333 (+ 28945us) service_pool.cc:224] Handling call
0709 13:17:48.486309 (+2142976us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b54004781d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:48.486451 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4387217664}
I20260709 13:17:48.489305 10531 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:48.489571  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:48.490209  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.489987 10531 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:48.491971 10619 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:48.493443 10619 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:17:48.497083  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.499773 10418 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:17:48.484213 10651 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:48.503856  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:48.507717  3049 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
W20260709 13:17:48.511703  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 130203us
W20260709 13:17:48.513665  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.518138  3043 raft_consensus.cc:2393] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 25: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:48.487772  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:48.435963 10618 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.509053  3165 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:48.449393 10684 raft_consensus.cc:3055] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:48.447422 10563 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:48.505703 10414 consensus_meta.cc:287] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.677s	user 0.010s	sys 0.005s
I20260709 13:17:48.543709  3196 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 22. Current term is 23. Ops: [22.17-22.17]
W20260709 13:17:48.544961  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:48.539743  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 63301.5us
I20260709 13:17:48.526796 10618 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:48.555135  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:48.555403  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:48.558817  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.532732 10684 raft_consensus.cc:740] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:48.539265  9926 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:48.542124 10651 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:48.565172  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:48.564136  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.567601  3090 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:48.566883  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:48.573359  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:48.574232  3197 raft_consensus.cc:2393] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:48.570609  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.573238  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.577979  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.578095  3123 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:48.541702 10414 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:48.581461  3122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 3144) took 2130 ms (client timeout 1775 ms). Trace:
W20260709 13:17:48.584718  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 97056.9us
I20260709 13:17:48.595348  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:48.582353  3122 rpcz_store.cc:269] 0709 13:17:46.450587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.475044 (+ 24457us) service_pool.cc:224] Handling call
0709 13:17:48.570510 (+2095466us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54000a8554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:48.581373 (+ 10863us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":728917888}
I20260709 13:17:48.578938 10612 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:17:48.585216 10680 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:48.577088 10651 raft_consensus.cc:697] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:48.585438 10659 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.610137  3790 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21. Ops: [20.17-20.17]
I20260709 13:17:48.616076  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:48.574975 10664 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:48.610882  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.618458  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:48.619864  3120 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:48.621131  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:48.624728  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.630379  3200 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 26.
I20260709 13:17:48.606726 10502 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:48.632870  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:48.606261 10418 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:48.634871  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.635332  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
W20260709 13:17:48.637717  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.641649  3049 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:48.638437  3198 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:48.637395  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:48.644853  3793 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:17:48.644860  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:48.638046  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:48.600493 10603 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:48.642235  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:48.644101  3795 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:48.651780  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:48.653345  3200 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21. Ops: [20.17-20.17]
W20260709 13:17:48.654245  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 92172.8us
I20260709 13:17:48.656653  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:48.657599  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:48.643707 10655 consensus_meta.cc:287] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.610s	user 0.015s	sys 0.000s
I20260709 13:17:48.663187  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.663625  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.665621  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:48.668735  3042 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 27.
I20260709 13:17:48.635418 10717 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:48.669917 10612 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:48.671336 10563 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:17:48.672341  3796 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 886) took 2380 ms (client timeout 2093 ms). Trace:
I20260709 13:17:48.683444  3046 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:48.647294 10460 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:48.638685 10659 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:48.690876  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 96669.5us
W20260709 13:17:48.682865  3796 rpcz_store.cc:269] 0709 13:17:46.289120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.300179 (+ 11059us) service_pool.cc:224] Handling call
0709 13:17:48.654072 (+2353893us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b5400653454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:48.669485 (+ 15413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4222915328}
I20260709 13:17:48.677277  3195 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
W20260709 13:17:48.676275 10706 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.320s	user 0.003s	sys 0.000s
I20260709 13:17:48.653229 10536 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:48.686482  3761 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:48.688750  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:48.693980  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:48.694022  3165 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:48.681241 10407 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:48.696714 10664 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:48.684692 10612 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:48.693900  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.706809  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:48.707975  3200 raft_consensus.cc:2410] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 24 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
I20260709 13:17:48.694150  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:48.703953  3197 raft_consensus.cc:2410] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:17:48.709472  3196 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 24.
I20260709 13:17:48.684484 10662 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:48.717293  3122 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:17:48.718811  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:48.719753  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:48.721048  3761 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:48.724291 10407 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:48.730965  3044 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 24. Current term is 25. Ops: []
I20260709 13:17:48.670290 10655 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:48.732409  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:48.728370  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 44950.8us
I20260709 13:17:48.641724 10684 consensus_queue.cc:260] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:48.711711 10612 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:48.712910 10531 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:48.738560  3195 raft_consensus.cc:2393] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 18: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:48.740746  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:48.747500  3090 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:48.701002 10418 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:48.749069  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:48.752588  3046 pending_rounds.cc:85] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 11
I20260709 13:17:48.753953  3046 pending_rounds.cc:107] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 25.12
I20260709 13:17:48.754271  3046 raft_consensus.cc:2889] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:48.738190 10717 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:48.754626  3194 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:48.766669  3120 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:48.767494  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:48.744016 10533 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:17:48.752417 10591 consensus_meta.cc:287] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.002s
W20260709 13:17:48.773869  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 79848.8us
I20260709 13:17:48.750671 10450 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:48.773077  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.754509 10536 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:48.797596 10536 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:48.797911  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:48.798117 10536 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:17:48.802237 10725 log.cc:927] Time spent T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:17:48.803227 10718 log.cc:927] Time spent T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:17:48.758214 10726 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:48.788096  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.805680  3118 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:48.766203 10684 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:48.770493 10414 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:48.790122  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.810375  3117 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 16.
I20260709 13:17:48.790338  3121 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 13:17:48.810892 10679 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:48.791041  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.812285  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:48.792387  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.818122  3120 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 24.
I20260709 13:17:48.818310 10431 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:48.719596 10651 consensus_queue.cc:237] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:48.795846  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:48.796705  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 49353.2us
I20260709 13:17:48.793385  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:48.754076 10662 raft_consensus.cc:697] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:48.820245  3123 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 21: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:48.819820  3042 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:48.769040  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:48.755810 10531 raft_consensus.cc:697] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:48.769357 10717 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:48.844156  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.846143  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:48.783058 10591 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22.
I20260709 13:17:48.862059  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.862478 10531 consensus_queue.cc:237] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:48.857462  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:48.863516 10662 consensus_queue.cc:237] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:48.864164  3198 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 24.
I20260709 13:17:48.867110  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:48.871781  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:48.872713  3043 raft_consensus.cc:2393] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 21: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:48.872263 10612 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:48.874383  3126 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:48.874639  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:48.875850  3091 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:48.875996  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.877054  3091 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:48.877285 10714 log.cc:927] Time spent T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.249s	user 0.001s	sys 0.001s
I20260709 13:17:48.877455  3117 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:17:48.782763 10460 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:17:48.820706 10450 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.878520 10450 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:48.852308  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:48.878983  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 135670us
I20260709 13:17:48.851799  3165 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:48.879671  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:48.861927 10721 consensus_queue.cc:1059] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:17:48.856025  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:48.873559  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:48.882472  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.834232 10717 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:48.895216  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:48.899446  3120 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:17:48.900544  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:48.896153  3117 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:17:48.902889  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:48.905298  3042 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 23. Current term is 24. Ops: []
I20260709 13:17:48.905432  3119 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 20. Current term is 21. Ops: []
W20260709 13:17:48.908567  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 52646.7us
I20260709 13:17:48.885950 10679 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:48.912652 10664 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:48.912938  3761 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:48.891669 10366 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:48.916615  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:48.914130  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:48.886212 10425 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:17:48.922631  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:48.915863 10466 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:17:48.913707  3090 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:48.921808  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 94597.2us
I20260709 13:17:48.927803  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:48.928725  3044 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 21: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:48.914173 10603 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:48.916077 10679 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:48.918733 10366 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.931664  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:48.937493  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.913507 10591 consensus_queue.cc:1059] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.023s
I20260709 13:17:48.942318  9256 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:48.922775 10425 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:48.925617 10719 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:17:48.926648 10466 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.944446 10001 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:48.943126 10366 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:48.947096  9874 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:48.942749  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:48.948087  3042 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:17:48.962751  3090 connection.cc:256] RPC call timeout handler was delayed by -1.621124072000157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
I20260709 13:17:48.927964 10460 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:48.936780 10679 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:48.957312 10425 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:17:48.959618 10478 consensus_meta.cc:287] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.578s	user 0.006s	sys 0.006s
I20260709 13:17:48.964430 10466 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:48.928642 10657 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:48.967618 10407 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:48.985019  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 57317.5us
I20260709 13:17:48.958705 10659 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:48.981806  3044 raft_consensus.cc:2410] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:17:48.948050 10483 consensus_queue.cc:1059] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 13:17:48.983093 10719 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.963989 10619 consensus_queue.cc:1059] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:17:48.981536 10460 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:49.028488  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.016141  3090 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:49.035096  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 94825.6us
I20260709 13:17:48.999540 10001 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:49.001709 10580 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.044793  3049 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 24.
W20260709 13:17:49.053702  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 45174.3us
I20260709 13:17:49.055675 10612 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:49.054215  3091 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:49.017340 10460 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:49.016640 10456 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:49.054940  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.000168 10536 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:49.072332  3164 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:49.006635 10407 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:49.036809 10719 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:49.068739 10659 raft_consensus.cc:2764] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:17:49.093421  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:49.084295 10603 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:17:49.108068  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:17:49.119724  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.107242  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:17:49.121826  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.041103 10735 consensus_queue.cc:1059] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.101s
I20260709 13:17:49.060083 10580 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:49.132483  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:49.138160  3790 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
W20260709 13:17:49.142385 10737 log.cc:927] Time spent T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:17:49.144765  3090 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:49.145912  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:49.147094  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:49.152107  3795 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:49.155300 10719 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:49.082921 10456 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:49.172782  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 117736us
I20260709 13:17:49.123579 10603 raft_consensus.cc:697] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 24 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:49.163394  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:49.192415  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:49.194007 10366 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:49.197573  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:49.198684  3198 raft_consensus.cc:1275] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:17:49.126001  9926 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:17:49.213162  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.215245  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:49.172164 10680 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:49.200038 10659 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:49.244405  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:49.247627  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:17:49.230728 10702 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:49.249723  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:49.253875  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:49.256685  3192 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 23: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:49.257428  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:49.261477  3195 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 23: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:49.267567  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:49.254367 10733 log.cc:927] Time spent T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.284s	user 0.000s	sys 0.002s
I20260709 13:17:49.272267  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:49.275779  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:49.277674  3196 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 24.
I20260709 13:17:49.157090 10001 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:49.257580 10657 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:49.285966  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:49.286979  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:49.289331  3192 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 24: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:49.288228  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:49.290275  3793 raft_consensus.cc:2410] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 25 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
W20260709 13:17:49.293659  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 73773.2us
W20260709 13:17:49.295934 10743 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:17:49.298535 10664 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:17:49.320895 10739 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.274s	user 0.001s	sys 0.001s
I20260709 13:17:49.305593  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:49.306063  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:49.320688  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:49.340574  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:49.341228  3117 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:17:49.327766 10740 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:17:49.343703  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:49.344597  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:49.346194  3793 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:49.349485  3198 raft_consensus.cc:1240] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:17:49.286082 10679 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:49.353922  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:49.335297 10483 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:49.355479  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:49.310603 10536 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:49.360973  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:49.361907  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:49.362470  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:49.363082  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:49.363730  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:49.364687  3192 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 24: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:49.364820 10580 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:49.365711  3192 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:49.369028 10456 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:49.369127 10618 consensus_meta.cc:287] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.802s	user 0.010s	sys 0.000s
I20260709 13:17:49.370044 10418 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:49.369884 10483 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:49.370502  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 223498us
I20260709 13:17:49.372162 10483 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:49.374691  3196 raft_consensus.cc:1240] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:49.377388 10627 raft_consensus.cc:3055] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:49.377843 10627 raft_consensus.cc:740] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:49.378942 10627 consensus_queue.cc:260] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:49.379967 10627 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:49.381163 10663 consensus_meta.cc:287] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.924s	user 0.009s	sys 0.005s
I20260709 13:17:49.363802  3193 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:49.373541  3090 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:49.417209  3122 raft_consensus.cc:1240] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:49.419456  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:49.377137 10717 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:49.350600 10407 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:49.431969  3121 raft_consensus.cc:1240] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:49.417385 10502 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:49.447569  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 96630.2us
I20260709 13:17:49.383538 10618 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:49.443678 10366 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:49.348250 10603 consensus_queue.cc:237] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:49.434089 10431 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:17:49.487706  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:49.436969 10655 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:49.484946  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:49.488390  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 114945us
W20260709 13:17:49.488442  3763 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.489604  3192 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:49.490227  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:49.492122  3050 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:49.496165  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:49.481789 10759 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:17:49.498261  3796 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 22: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:49.500823  3196 raft_consensus.cc:2393] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 16: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:17:49.503614 10753 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:17:49.508723 10618 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:49.494555 10450 consensus_meta.cc:287] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.612s	user 0.009s	sys 0.005s
I20260709 13:17:49.515672  3117 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 25.
I20260709 13:17:49.515856  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:49.487932 10431 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.456900 10407 consensus_queue.cc:1059] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 13:17:49.495599 10418 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:49.527539  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.521613  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:49.521649 10618 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:49.533915 10418 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:49.521256 10431 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:49.537922 10679 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:49.539521 10466 consensus_meta.cc:287] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.003s
I20260709 13:17:49.540079 10466 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:49.540885  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:49.542389  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:49.542572  9926 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:49.543116  9926 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:49.543641  9926 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:49.544680 10531 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:49.545260 10531 raft_consensus.cc:697] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:17:49.546625 10769 log.cc:927] Time spent T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:17:49.549569 10466 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:49.564479  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.522094 10450 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:49.566236 10722 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.899s	user 0.004s	sys 0.000s
I20260709 13:17:49.527514  3193 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:49.619930  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1574) took 1653 ms. Trace:
I20260709 13:17:49.620371  3048 rpcz_store.cc:276] 0709 13:17:47.966522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.472528 (+506006us) service_pool.cc:224] Handling call
0709 13:17:48.473089 (+   561us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:48.473678 (+   589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:48.473750 (+    72us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:48.474748 (+   998us) log.cc:844] Serialized 52 byte log entry
0709 13:17:48.536369 (+ 61621us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:17:48.539148 (+  2779us) log.cc:844] Serialized 14 byte log entry
0709 13:17:48.540867 (+  1719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.540970 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:49.557019 (+1016049us) spinlock_profiling.cc:243] Waited 6.25 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:49.619620 (+ 62601us) raft_consensus.cc:1685] finished
0709 13:17:49.619725 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.619872 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1390,"prepare.queue_time_us":2396,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":54,"raft.queue_time_us":5960,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":6191,"spinlock_wait_cycles":14369664,"thread_start_us":61046,"threads_started":1,"wal-append.queue_time_us":139263}
I20260709 13:17:49.621959 10618 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:49.621892  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 106307us
I20260709 13:17:49.624392  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:49.613404 10531 consensus_queue.cc:237] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:49.525966 10425 consensus_meta.cc:287] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
I20260709 13:17:49.627929  3090 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:49.633455  3050 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:49.651110  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:49.652851  3090 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:49.653535  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.651232  3165 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:49.662643  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:49.663264  3192 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:17:49.650635 10766 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.139s	user 0.000s	sys 0.009s
I20260709 13:17:49.626708 10450 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:49.657071 10628 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:49.658941 10663 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:49.671496 10679 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:17:49.678733  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:49.683486 10431 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:49.667286 10664 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:49.684794  3192 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 23.
I20260709 13:17:49.685155 10664 raft_consensus.cc:697] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:49.651950 10425 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:49.690572  3090 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:49.691701  3090 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:49.677076 10628 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:49.694679  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:49.700707  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:49.701144  9926 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:49.701624  3794 raft_consensus.cc:2410] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 23 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 13:17:49.710318  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:49.711829  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:49.712531  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:49.713831  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:49.714643  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 843787us
I20260709 13:17:49.715157  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:49.716125  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:49.716596  3119 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:17:49.716846  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.717675  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:49.713905  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:49.694214 10603 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:49.722097  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:49.722455  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:49.723086  3119 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:49.725392  3194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 1178) took 1188 ms. Trace:
I20260709 13:17:49.725248  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:49.725802  3194 rpcz_store.cc:276] 0709 13:17:48.536549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.537318 (+   769us) service_pool.cc:224] Handling call
0709 13:17:48.549764 (+ 12446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.766840 (+217076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.720798 (+953958us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54003ba454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:49.725333 (+  4535us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470449536}
I20260709 13:17:49.726881  3195 raft_consensus.cc:1240] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:49.698344 10679 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:49.728971  3126 raft_consensus.cc:2393] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 21: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:49.743224 10679 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.743846 10679 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:49.743965  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:49.745285  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:49.729266 10591 consensus_queue.cc:1048] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:49.704522 10663 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.730412 10680 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.730456  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:49.731835  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:49.724179  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34728 (request call id 1183) took 1154 ms. Trace:
I20260709 13:17:49.728456  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:49.740789  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.742133 10717 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:49.694954 10755 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:17:49.695412 10628 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:17:49.768458  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.764583  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:49.747411  3191 rpcz_store.cc:276] 0709 13:17:48.564773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.564921 (+   148us) service_pool.cc:224] Handling call
0709 13:17:49.705336 (+1140415us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b540013d3d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:49.718679 (+ 13343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1670641920}
I20260709 13:17:49.777084  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:49.781816  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:49.783380  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:49.784092  3051 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:49.789963  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:49.790761  3044 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:17:49.792984  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:49.796409  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 1184) took 1053 ms. Trace:
I20260709 13:17:49.797657  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:49.796842  3200 rpcz_store.cc:276] 0709 13:17:48.742809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.743008 (+   199us) service_pool.cc:224] Handling call
0709 13:17:48.753791 (+ 10783us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.825656 (+ 71865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:48.825711 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:48.848166 (+ 22455us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:48.848227 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.796177 (+947950us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b540002b7d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:49.796225 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.796343 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59767552}
I20260709 13:17:49.746372 10663 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:49.809965  9926 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:49.811741 10663 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:49.812366 10663 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:49.814476  3047 raft_consensus.cc:2393] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 23: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:49.801209  3195 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:49.812860  3791 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:49.813225  3120 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:49.816252  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:49.773725 10466 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:17:49.779083 10619 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:49.825253  3042 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 16.
I20260709 13:17:49.767318 10680 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:49.835649  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:49.836323  3793 raft_consensus.cc:1240] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:49.838689  3762 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:49.846966  3762 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:49.848037  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:17:49.851748  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 602083us
I20260709 13:17:49.852514  3125 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 25: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:49.797014 10664 consensus_queue.cc:237] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:49.858191 10771 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:17:49.862938 10431 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:49.863837 10478 raft_consensus.cc:3055] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:49.864368 10478 raft_consensus.cc:740] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:49.842084 10466 raft_consensus.cc:697] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 25 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:49.870304 10684 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:49.847724 10460 consensus_meta.cc:287] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.762s	user 0.015s	sys 0.003s
W20260709 13:17:49.883823  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 155449us
I20260709 13:17:49.849648 10483 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:49.886834  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:49.888232  3124 raft_consensus.cc:2393] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 21: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:17:49.888098  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 99030.8us
I20260709 13:17:49.892431  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:49.893074  3043 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:49.896687  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:49.897432  3043 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:17:49.870736 10466 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:49.865325 10478 consensus_queue.cc:260] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:49.903105  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:49.903815  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:49.910485  3125 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:49.886080 10460 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:49.919837  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:49.920547  3124 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:49.917790  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:49.902400 10425 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 28 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:49.925058  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 78212.3us
I20260709 13:17:49.926529  3762 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:49.928475  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3639) took 1188 ms. Trace:
I20260709 13:17:49.929047 10684 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:17:49.929899 10783 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.930068 10684 consensus_queue.cc:1059] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:17:49.930495 10783 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:49.931144 10414 raft_consensus.cc:3055] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:49.931290 10407 raft_consensus.cc:3055] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:17:49.931576 10414 raft_consensus.cc:740] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:49.931799 10407 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:49.932848 10783 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:49.928949  3046 rpcz_store.cc:276] 0709 13:17:48.740044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.740226 (+   182us) service_pool.cc:224] Handling call
0709 13:17:48.752389 (+ 12163us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:48.772463 (+ 20074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:48.772514 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:48.773327 (+   813us) log.cc:844] Serialized 52 byte log entry
0709 13:17:49.927839 (+1154512us) spinlock_profiling.cc:243] Waited 9.95 ms on lock 0x7b18003a0720. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82ff5b4bc 00007ff82d2a948b 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1
0709 13:17:49.928020 (+   181us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:49.928067 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.928142 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:49.928190 (+    48us) raft_consensus.cc:1685] finished
0709 13:17:49.928202 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.928419 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1272,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":45964,"spinlock_wait_cycles":22886784,"thread_start_us":38228,"threads_started":1,"wal-append.queue_time_us":117462}
I20260709 13:17:49.935501 10651 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.935711  3164 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:49.935922  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:49.932703 10414 consensus_queue.cc:260] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:49.936759  3118 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 23: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:49.937417 10414 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:49.936010 10651 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:49.932770 10407 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:49.937701  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:49.955842  3762 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:49.885715  3090 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:49.969079 10627 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:49.969377 10680 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:49.970542 10679 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:49.974828 10460 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:49.955502 10478 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:49.975258 10619 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:49.975963 10619 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:49.980161  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 94568.4us
I20260709 13:17:49.981089  3090 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:49.983245  3119 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:17:49.984714  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:49.937821 10783 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:49.985885 10425 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:49.986459  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:49.990782  3762 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:50.012771  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:49.991376 10657 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:50.014644  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:50.015691 10657 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:17:50.016779 10776 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:50.017273 10776 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:49.992906  3051 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:49.993939 10483 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:49.995025  3090 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:49.995652 10515 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:50.000046 10627 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:50.003454  3044 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 25.
I20260709 13:17:50.003633 10619 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.027513  3050 raft_consensus.cc:1240] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:50.027917 10619 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:50.005293 10679 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:49.939867 10651 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:50.009007 10001 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:50.011529 10786 log.cc:927] Time spent T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:17:50.029472 10001 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.031018  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:50.031769  3123 raft_consensus.cc:2368] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 21. Current term is 22.
I20260709 13:17:50.031805 10001 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:50.032492  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.032925  3123 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:17:49.952425 10777 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:17:50.051633  3123 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 28 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 27. Current term is 28. Ops: []
I20260709 13:17:50.052042  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:50.053058  3123 raft_consensus.cc:1275] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:17:50.053242 10628 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:50.054215  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:50.055413  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:50.056239  3797 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 21: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:50.033833  3090 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:50.034512 10515 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:50.034713 10734 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:17:50.068423  3043 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 28.
I20260709 13:17:50.035020  3790 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:17:50.025137 10483 raft_consensus.cc:697] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:50.035939  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:50.035969  3051 raft_consensus.cc:1240] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 24. Current term is 25. Ops: []
I20260709 13:17:50.073313  3046 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:17:50.068092 10580 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:50.044621  3125 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:50.047498  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:50.048586  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:50.049463  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:50.054461  3117 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 23: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:50.017621 10776 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:50.083617  3795 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:17:50.035228  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:50.070891  3090 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:50.052037 10460 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:17:50.086448  3792 raft_consensus.cc:2393] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 21: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:50.086455 10460 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.087893 10460 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:50.088152  3796 raft_consensus.cc:2468] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:50.088052  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:50.088999 10680 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:50.089432  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:50.040596  3124 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 25.
I20260709 13:17:50.090327 10659 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:50.089614 10580 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:50.090642  3090 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:50.091902 10659 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:17:50.072932 10735 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.010s	sys 0.015s
I20260709 13:17:50.091665 10536 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:17:50.094214 10483 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:50.096072  3051 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 18. Current term is 19. Ops: []
W20260709 13:17:50.095044 10735 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.011s	sys 0.016s
I20260709 13:17:50.098731 10779 consensus_queue.cc:1059] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:50.100063  3015 leader_election.cc:400] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21.
I20260709 13:17:50.100423  3015 leader_election.cc:403] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:50.100226 10735 consensus_queue.cc:1059] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:50.101577 10536 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21.
I20260709 13:17:50.100075 10780 raft_consensus.cc:3055] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:50.102593 10780 raft_consensus.cc:740] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:50.104542 10515 consensus_queue.cc:1059] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:50.105526  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1403) took 1027 ms. Trace:
I20260709 13:17:50.105914 10717 raft_consensus.cc:3055] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:50.105959  3122 rpcz_store.cc:276] 0709 13:17:49.078558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.079077 (+   519us) service_pool.cc:224] Handling call
0709 13:17:49.079360 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.417833 (+338473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.105270 (+687437us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b5400216e54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:50.105460 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776436096}
I20260709 13:17:50.108446  3091 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:50.108748 10478 consensus_queue.cc:1059] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:17:50.109944 10478 raft_consensus.cc:3055] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:50.110283 10478 raft_consensus.cc:740] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:50.111348 10603 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:50.111897 10603 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.111277 10478 consensus_queue.cc:260] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:50.112282 10603 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:50.113061 10478 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:50.116653 10679 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:50.117643  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:50.121130 10460 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.122890  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:17:50.131376  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 195699us
I20260709 13:17:50.132941  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:50.107199  3762 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:50.135843  3762 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:50.148859  3164 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:50.075928 10425 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:17:50.071770 10734 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:50.155268  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:50.106379 10717 raft_consensus.cc:740] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:50.156234  3125 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:50.156895  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:50.151182  3091 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:50.160913  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:50.161085  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:50.191951  3192 raft_consensus.cc:2393] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 23: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:50.162057  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:50.166283  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:50.150187 10726 raft_consensus.cc:3055] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:17:50.191054  3791 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:50.155624 10466 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:50.187939  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2727) took 1448 ms. Trace:
I20260709 13:17:50.156147 10684 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:17:50.198391  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 60281.3us
I20260709 13:17:50.199410  3047 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:50.201105  3762 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:50.198173  3197 rpcz_store.cc:276] 0709 13:17:48.739692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.739882 (+   190us) service_pool.cc:224] Handling call
0709 13:17:50.185562 (+1445680us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b540033e5d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:50.187877 (+  2315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1223195008}
I20260709 13:17:50.203363  3793 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 21. Current term is 22. Ops: [21.14-21.14]
W20260709 13:17:50.203580  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 62707.4us
I20260709 13:17:50.159168 10425 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:50.159708  3122 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
I20260709 13:17:50.163582 10734 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:17:50.196353  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 253891us
W20260709 13:17:50.231657  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 82898.1us
I20260709 13:17:50.234164  3164 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:50.236730 10657 consensus_queue.cc:1059] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:50.237913 10657 raft_consensus.cc:3055] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:50.238267 10657 raft_consensus.cc:740] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:50.239152 10657 consensus_queue.cc:260] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:50.240330 10657 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:50.211485 10425 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:50.197232 10726 raft_consensus.cc:740] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:50.208179 10618 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:50.246209 10618 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:50.246536 10726 consensus_queue.cc:260] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:50.247632 10726 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:50.250121 10788 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:17:50.201346 10628 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:50.251278 10628 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:17:50.251729 10628 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 28 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:50.251780 10533 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:50.252074 10776 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.252676 10533 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:50.252738 10628 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 27.13, Last appended by leader: 13, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.254354 10460 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:50.255246  3164 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:50.256044 10533 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:50.256070 10618 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:50.258630  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:50.259456  3124 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 25: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:50.261072  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:50.262657 10779 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:17:50.186455 10781 consensus_queue.cc:1059] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.084s
I20260709 13:17:50.265573 10603 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.266703 10781 raft_consensus.cc:3055] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:50.267081 10781 raft_consensus.cc:740] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:50.267853 10781 consensus_queue.cc:260] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:50.268684 10776 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:50.269080 10781 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:50.263675  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:50.270232  3794 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:50.264276 10717 consensus_queue.cc:260] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.255306  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:50.271579 10717 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:50.273655 10603 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:50.201511 10466 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.274662 10466 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:50.203298 10483 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:17:50.278182 10483 raft_consensus.cc:697] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 25 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:50.278861 10418 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:50.279201 10483 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:50.280829 10619 raft_consensus.cc:3055] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:50.281380 10619 raft_consensus.cc:740] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:17:50.283262  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:50.284369  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 48671.9us
I20260709 13:17:50.284992  3761 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:50.286222  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:50.288733  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 89664.3us
I20260709 13:17:50.289323  3799 raft_consensus.cc:2468] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:50.287122  3050 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:50.293123  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:50.286057  3164 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:50.296957  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:50.299064  3042 raft_consensus.cc:1275] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:17:50.300426  3164 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:50.302055  3051 raft_consensus.cc:1275] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:17:50.302642  3042 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 24. Current term is 25. Ops: []
I20260709 13:17:50.303943  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:50.304517  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:50.306486  3050 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:50.304826  3165 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:50.307912  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:50.308440  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:50.308665  3117 raft_consensus.cc:2393] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 25: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:50.311848  3042 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 27. Current term is 28. Ops: []
W20260709 13:17:50.312517  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.314234 10366 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:50.314795 10366 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.316859 10366 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:50.295090 10618 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:50.318233  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:50.318902  3124 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:50.312754 10418 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:17:50.322304 10619 consensus_queue.cc:260] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:50.323856 10619 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:50.288817 10790 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.326227 10790 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.337266  3124 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
I20260709 13:17:50.334342  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:50.332329  3048 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:17:50.335920  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:50.350337  3051 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:50.354583  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:50.358294  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:50.302100 10788 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:17:50.359530  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 55667.7us
I20260709 13:17:50.365128  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:50.368548  3164 leader_election.cc:400] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 21. Current term is 22.
I20260709 13:17:50.368940  3164 leader_election.cc:403] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:17:50.369920  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:50.371177  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:50.371765  3797 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:50.373031  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:50.349656 10502 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:50.375492  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:50.323237 10425 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.313362 10603 consensus_queue.cc:1059] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:17:50.383786  3796 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
I20260709 13:17:50.383261  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:50.374791 10366 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 27.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:17:50.361654 10418 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:17:50.412614  3050 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:50.394405 10425 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:50.413450 10603 raft_consensus.cc:3055] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:50.413971 10603 raft_consensus.cc:740] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:50.378605 10502 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.395794 10618 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:17:50.361439  9926 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:50.414776 10502 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:50.405645  3795 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:50.415189 10603 consensus_queue.cc:260] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.416641 10603 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:50.416409 10780 consensus_queue.cc:260] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.365515 10782 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:17:50.361843 10734 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.410971 10414 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:50.382890 10783 consensus_queue.cc:1059] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:17:50.422850 10783 raft_consensus.cc:3055] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:50.423422 10783 raft_consensus.cc:740] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:50.424917 10612 raft_consensus.cc:3055] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:50.424600 10783 consensus_queue.cc:260] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:50.413899  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:50.383215 10651 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:50.425386 10612 raft_consensus.cc:740] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:50.358444 10716 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:17:50.390965 10790 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:50.449863  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:50.450932  3195 raft_consensus.cc:2393] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 25: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:50.452204  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:50.437903 10414 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:50.453644 10414 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:50.454110 10612 consensus_queue.cc:260] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.455394 10612 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:50.454155 10414 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:50.461880 10783 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:50.413468 10466 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:50.469818  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:50.499941  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.509393  3192 raft_consensus.cc:1275] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:17:50.511433  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 97670.1us
I20260709 13:17:50.512426  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:50.437255 10780 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:50.517666  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:50.518332  3197 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:50.518074  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:50.532338  3797 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
W20260709 13:17:50.536036  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 151569us
I20260709 13:17:50.537329  3164 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:50.538118  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:50.541536  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:50.433991 10788 consensus_queue.cc:1048] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 13:17:50.542558  3192 raft_consensus.cc:2393] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 19: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:50.544494  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:50.558949  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:50.559791  3196 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 23: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:50.515316 10790 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:50.550729  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:50.569643  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:50.535650 10748 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:50.571058  3199 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:50.571985  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:50.572716  3191 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:50.569208  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:50.574005  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:50.576327  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:50.569221  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:50.579353  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:50.579293  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:50.582422  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:50.580159  3198 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:50.553805 10591 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.589942  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:50.590705  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:50.593565  3192 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 23: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:17:50.594368  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.567868 10366 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:17:50.597344  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:50.599289  3200 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:17:50.548332 10762 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 27.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:17:50.601649  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:50.630517  3192 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:50.608547  3797 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:50.579922 10425 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:50.630604  3046 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:17:50.602330  3198 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:17:50.637249  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.639109  3199 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:50.639771  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:50.640359  3797 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:50.642161  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:50.646742  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 56918.4us
I20260709 13:17:50.587311 10460 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:50.594755 10662 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:50.598902 10466 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:50.599789 10755 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:50.654726  3198 raft_consensus.cc:3055] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:17:50.653095  3761 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:50.654520  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:50.656574  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:50.562507 10798 consensus_queue.cc:1059] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 13:17:50.684751  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:50.662544  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:17:50.667418 10810 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:17:50.667861 10807 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:50.632145 10782 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:50.631947 10502 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:50.701839  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 48829.1us
I20260709 13:17:50.649987 10425 raft_consensus.cc:697] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 21 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:50.677574  3795 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 23: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:50.598712 10591 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.681783  3197 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
I20260709 13:17:50.691012  3797 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:50.682796  3198 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:50.584676 10790 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:50.672101 10734 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:50.705143  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:50.683986  3191 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:50.709365  3192 raft_consensus.cc:2468] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 25.
I20260709 13:17:50.718133  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:50.720176  3796 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
W20260709 13:17:50.722172  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.715361 10536 consensus_queue.cc:1059] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 13:17:50.726572 10662 raft_consensus.cc:3055] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:17:50.727829 10662 raft_consensus.cc:740] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 24 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:50.730090 10483 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.730785 10483 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:50.729357 10662 consensus_queue.cc:260] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:50.732918 10662 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:50.733301 10483 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:50.701489 10807 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:50.735874 10790 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:50.682156 10776 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:17:50.707844 10717 raft_consensus.cc:3055] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:50.736654  3198 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:50.703366 10580 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:50.694826 10612 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:50.715644 10684 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:17:50.738510 10619 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:17:50.750833  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.707794 10782 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.742000 10717 raft_consensus.cc:740] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:50.740259 10807 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:50.745196 10580 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:17:50.762971 10726 consensus_meta.cc:287] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.000s
I20260709 13:17:50.782366  3191 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
I20260709 13:17:50.746513 10612 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:50.796008 10580 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:50.810514 10502 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:50.810904 10775 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.813s	user 0.002s	sys 0.013s
I20260709 13:17:50.815004 10414 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.816524 10591 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:50.811496 10627 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:50.817624 10627 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:50.799688 10425 consensus_queue.cc:237] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:50.819952 10627 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:50.820904 10811 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:50.806434 10612 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:50.782760 10664 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:17:50.824420 10717 consensus_queue.cc:260] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:50.827862 10717 raft_consensus.cc:3060] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:50.830858 10460 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:50.839670 10414 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:50.843114 10777 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:50.843665 10777 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:17:50.851226 10407 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:50.855402 10782 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:50.865665  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 139444us
I20260709 13:17:50.870787  3121 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 25.
I20260709 13:17:50.873646  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:50.875310  3126 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
W20260709 13:17:50.874545  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 165922us
I20260709 13:17:50.879004  3122 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:17:50.879262  3042 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 27. Current term is 28. Ops: []
I20260709 13:17:50.884919  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:50.890322  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.895066  3126 raft_consensus.cc:2410] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
W20260709 13:17:50.876472 10775 log.cc:927] Time spent T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:17:50.897344  3790 raft_consensus.cc:1240] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 24. Current term is 25. Ops: []
I20260709 13:17:50.892109  3761 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:50.899001  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:50.884790  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 288020us
I20260709 13:17:50.895985  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:50.900282  3090 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:50.867740 10366 raft_consensus.cc:697] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:50.899685  3193 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:50.901290  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:50.905802  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:50.906437  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:50.908072  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:50.880645 10460 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:50.912614  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:50.909349  3042 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:17:50.906394  3049 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:50.911393  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:50.917379  3793 raft_consensus.cc:1240] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:17:50.910480  3090 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:50.918956  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.919354  3123 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:17:50.919909  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:50.920594  3192 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:50.920703  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:50.921895 10780 raft_consensus.cc:2764] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:17:50.923877  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:50.925052  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:50.925928  3197 raft_consensus.cc:2393] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 19: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:50.931265  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:50.909525 10663 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:50.933805  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:50.909301 10812 raft_consensus.cc:2804] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:50.934880 10812 raft_consensus.cc:697] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:50.935889 10812 consensus_queue.cc:237] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:50.898116 10563 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:17:50.942644 10456 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:50.943295 10456 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.945005  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:50.945673 10456 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:50.946198 10803 raft_consensus.cc:3055] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:17:50.946623 10803 raft_consensus.cc:740] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:50.947443 10803 consensus_queue.cc:260] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.948436 10803 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:50.912832 10460 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:50.954623 10460 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:50.955639 10777 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.958063 10823 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:50.958628 10823 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:50.960801 10823 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:50.962414  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:50.963989  3122 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:17:50.963076  3793 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:50.968712  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:50.973536  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 63139.7us
I20260709 13:17:50.975627  3090 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:50.976372  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:50.977311  3119 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
W20260709 13:17:50.979296  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.984498  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:50.985428  3046 raft_consensus.cc:3060] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:50.989467  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:50.990906  3044 raft_consensus.cc:2410] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:17:50.993682  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:50.973085  3091 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:50.993602  3191 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:17:50.995311  3191 pending_rounds.cc:85] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 13
I20260709 13:17:50.995698  3191 pending_rounds.cc:107] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:17:50.996224  3191 raft_consensus.cc:2889] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:50.997033  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:50.997891  3044 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:17:51.000618  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:51.003777  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 93604.7us
I20260709 13:17:51.007128  3049 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:51.004634  3165 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:50.902810 10627 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.075s
I20260709 13:17:51.022444  3049 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 26. Current term is 27. Ops: []
W20260709 13:17:51.023823 10797 log.cc:927] Time spent T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.475s	user 0.001s	sys 0.000s
I20260709 13:17:51.028677  9926 raft_consensus.cc:3055] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 27 LEADER]: Stepping down as leader of term 27
W20260709 13:17:51.019919 10651 consensus_meta.cc:287] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.001s
I20260709 13:17:51.030629 10790 raft_consensus.cc:3055] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:51.001281 10679 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:51.052011  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:51.058466  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 53922.3us
I20260709 13:17:51.055848  3762 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:51.033898 10779 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:50.996217 10780 consensus_queue.cc:1059] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:17:51.068948  3046 raft_consensus.cc:2468] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
W20260709 13:17:51.087456  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 151525us
I20260709 13:17:51.047051 10664 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:51.089882  3048 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 27 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 13:17:51.069485  9926 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:51.120427  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:51.120339  3042 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 24. Current term is 25. Ops: [24.12-24.12]
W20260709 13:17:51.094434  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 93916us
I20260709 13:17:51.124735  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:51.125528  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.048056 10483 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.046s
I20260709 13:17:51.128468  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:51.139189 10735 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:17:51.139083  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:51.066556 10777 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 27 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:51.083470 10790 raft_consensus.cc:740] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:51.087388 10779 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.062583 10612 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:51.090018 10655 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:17:51.088199 10651 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 21. Current term is 22.
I20260709 13:17:51.087093 10684 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:51.126314 10814 raft_consensus.cc:3055] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:51.196619  3090 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:51.134402 10776 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:17:51.122663 10679 raft_consensus.cc:697] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:51.135136 10781 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:51.192378  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 67213us
I20260709 13:17:51.208436 10781 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:51.150524 10478 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:17:51.210451 10822 log.cc:927] Time spent T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:17:51.211604  3164 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:51.212703 10782 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:51.213020  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.141790 10783 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 27.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:17:51.197136 10814 raft_consensus.cc:740] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:51.197005 10789 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:51.215909 10814 consensus_queue.cc:260] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:51.216661  3164 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:51.217228 10814 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:51.218036 10818 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:17:51.219509 10818 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:51.157876 10779 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:51.221485 10780 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:51.222194 10780 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:51.123409 10664 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:51.226109  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:51.227758 10664 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:51.228772 10780 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:51.205021 10663 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:51.093487 10820 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:51.201475  3090 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:51.203266  3047 raft_consensus.cc:1240] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:51.092729 10580 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:51.201475 10777 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:17:51.206287 10618 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.004s
I20260709 13:17:51.206815 10726 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:17:51.207338 10679 consensus_queue.cc:237] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:51.231451  3164 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:51.234206  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 97929.8us
I20260709 13:17:51.092118 10807 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:51.248920  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.259783  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:17:51.253700  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 115399us
I20260709 13:17:51.255800  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:51.257102  3164 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:51.260895  3793 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 16.
I20260709 13:17:51.264032  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:51.240211 10820 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.245289 10716 raft_consensus.cc:2804] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:17:51.270758  3790 raft_consensus.cc:1240] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:51.269531  3090 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:51.087769 10366 consensus_queue.cc:237] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:51.277875  3193 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 25.
I20260709 13:17:51.278475  3195 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:51.280114  3124 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:17:51.279163  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:51.285408  3015 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:51.285560  3090 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:51.288162  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:51.288776  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:51.266537 10783 raft_consensus.cc:2804] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:51.289855  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:51.291802  3124 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 28 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 27. Current term is 28. Ops: []
I20260709 13:17:51.242854 10782 consensus_queue.cc:1048] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:17:51.267867 10748 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:51.297629  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:51.267613 10603 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.272329 10664 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:51.262768 10684 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:17:51.275406 10820 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:51.302030  3117 raft_consensus.cc:2393] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:51.284008 10418 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.284538 10425 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:17:51.284919 10790 consensus_queue.cc:260] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:51.298141 10659 raft_consensus.cc:2804] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:51.313455 10815 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:51.316044 10580 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:51.287925 10716 raft_consensus.cc:697] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 25 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:17:51.326184  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.294569 10515 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:51.320241 10734 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:51.301852 10717 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:17:51.344198  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:51.323169 10502 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:51.349937 10659 raft_consensus.cc:697] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:17:51.445560  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 155979us
I20260709 13:17:51.453518  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:51.320555 10603 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:51.397360 10815 raft_consensus.cc:697] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:17:51.445892 10827 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:17:51.435974 10783 raft_consensus.cc:697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:51.468261  3164 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:51.339634 10418 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:51.444710 10612 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:51.472404  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:51.445979 10515 raft_consensus.cc:697] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:51.467160 10781 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:51.450742 10651 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
W20260709 13:17:51.478753 10407 consensus_meta.cc:287] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.004s
I20260709 13:17:51.447809 10502 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:51.491555  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:51.492435 10840 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:17:51.492610  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:51.478933 10664 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:51.496945 10840 raft_consensus.cc:697] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 25 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:51.497862 10418 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:51.498353 10832 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:17:51.498108 10840 consensus_queue.cc:237] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.11, Last appended by leader: 11, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:51.498569 10659 consensus_queue.cc:237] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:51.484306 10782 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:51.502421  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:51.503595  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:51.506520  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:51.484860 10612 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:51.510149  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:51.495765 10826 log.cc:927] Time spent T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 13:17:51.514932  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:51.517848 10779 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:51.516160  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:51.527751  3195 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:51.508801 10782 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.508016 10748 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:51.530550  3194 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:51.511461 10807 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:51.521615 10662 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.788s	user 0.012s	sys 0.001s
I20260709 13:17:51.492543 10841 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:17:51.513952 10612 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:51.517642  3015 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:51.537149  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:51.512810 10664 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:51.533481 10782 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:51.536938 10460 consensus_meta.cc:287] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.001s
I20260709 13:17:51.535310 10726 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.533892 10748 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:51.537597 10612 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:51.539554 10662 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:51.492986 10716 consensus_queue.cc:237] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:51.537045 10734 raft_consensus.cc:697] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:51.559362 10835 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:51.528486 10515 consensus_queue.cc:237] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:51.559921 10835 raft_consensus.cc:697] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:51.561878 10849 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:51.563576 10502 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:51.561087 10835 consensus_queue.cc:237] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:51.548766 10748 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:17:51.548090 10830 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.241s	user 0.001s	sys 0.001s
I20260709 13:17:51.574748  3791 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 24.
W20260709 13:17:51.554174 10833 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:17:51.529548 10783 consensus_queue.cc:237] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:51.547107 10460 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:51.583881  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:51.524068 10815 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:51.588503  3790 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:51.593694  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:51.594570  3042 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:51.592427  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:51.559952 10664 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:51.598361  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 115648us
I20260709 13:17:51.579663 10603 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:51.550112 10726 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:51.604202  3048 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:51.602792  3090 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:51.608599 10603 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:51.611770  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:51.611812 10603 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.612529 10603 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:51.612614  3122 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:17:51.613946  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:51.614830  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:51.615464  3126 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:51.619872 10848 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:51.620525 10848 raft_consensus.cc:697] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:51.621524 10848 consensus_queue.cc:237] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:51.623538 10831 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 13:17:51.625460 10847 log.cc:927] Time spent T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:17:51.625759  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:51.626327  3199 raft_consensus.cc:3060] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:17:51.627115 10845 log.cc:927] Time spent T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:17:51.634969 10460 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:51.635928 10820 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:51.637086  3197 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:17:51.593580 10839 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:51.618553  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:51.597826 10659 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.644176  3048 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 24.
I20260709 13:17:51.646520  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:51.604564 10779 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:51.652480 10659 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:51.660743 10659 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:51.661918  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:51.662552  3045 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:51.664762 10789 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:51.675366 10857 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 27.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 13:17:51.664815 10782 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:51.680160 10782 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:51.681026  3196 raft_consensus.cc:2393] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 18: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:51.683456  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:51.683820 10612 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:51.687335 10726 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:51.686072 10612 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:51.649691 10664 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:51.695688 10664 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.695883  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:51.681046  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.696766  3046 raft_consensus.cc:2410] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 26 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:17:51.697314 10836 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:51.697940 10836 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:51.699021  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:51.699769  3044 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 27: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:51.701081  3046 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:51.696079 10664 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:51.706071  3199 raft_consensus.cc:2468] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 24.
I20260709 13:17:51.706972  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:51.711529  3793 raft_consensus.cc:2410] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 26 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:17:51.651604 10627 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.654932 10788 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:51.717793  3051 raft_consensus.cc:1240] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:51.718211  3790 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:17:51.728812  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:51.729997  3200 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
W20260709 13:17:51.745855 10859 log.cc:927] Time spent T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:17:51.707945 10779 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:51.752007 10779 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:51.754086  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 53747.8us
I20260709 13:17:51.754901 10779 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:51.755007  3165 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:51.756623  3165 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:51.758100 10782 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:51.758050 10846 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:17:51.758953 10782 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:51.759469 10782 raft_consensus.cc:697] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:51.760435 10782 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:51.719852 10788 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:51.763664 10788 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:51.706065 10780 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:51.766163 10780 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:51.770107  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:51.771322 10748 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:51.774937  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 3328) took 1179 ms. Trace:
I20260709 13:17:51.775525  3195 rpcz_store.cc:276] 0709 13:17:50.595450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.595653 (+   203us) service_pool.cc:224] Handling call
0709 13:17:51.774673 (+1179020us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b54003ba954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:51.774857 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461387648}
I20260709 13:17:51.777850  3042 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:51.782531  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:51.784394  3045 raft_consensus.cc:2368] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 21. Current term is 22.
I20260709 13:17:51.786221  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:51.769418 10780 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:51.774542 10803 consensus_meta.cc:287] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.787s	user 0.010s	sys 0.004s
I20260709 13:17:51.798702  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:51.780821 10857 consensus_queue.cc:1243] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 28.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:17:51.810544  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:51.727100 10627 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:51.813666  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:51.814393  3122 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:51.816258  3044 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:51.710158 10734 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:51.825371 10836 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:51.807086 10803 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:51.831667  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:51.850075 10748 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:51.832836 10814 consensus_meta.cc:287] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.615s	user 0.006s	sys 0.006s
I20260709 13:17:51.851899  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:51.850448 10820 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:51.808463 10603 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:51.856933  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 123908us
I20260709 13:17:51.866247  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:51.866339  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:51.868057  3090 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:51.873659  3122 raft_consensus.cc:2468] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:51.878111  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:51.879102  3200 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:51.848088 10803 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:51.894210 10780 raft_consensus.cc:2804] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:17:51.896394  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:51.897699 10839 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:17:51.899219 10820 consensus_queue.cc:1059] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:51.900177 10820 raft_consensus.cc:3055] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:51.900535 10820 raft_consensus.cc:740] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:51.901571 10820 consensus_queue.cc:260] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:51.903234 10820 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:51.892064 10783 consensus_queue.cc:1059] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:17:51.908020 10783 raft_consensus.cc:3055] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:51.908561 10783 raft_consensus.cc:740] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:51.909417  3165 leader_election.cc:400] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 21. Current term is 22.
I20260709 13:17:51.912878  3791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 898) took 1559 ms. Trace:
I20260709 13:17:51.911463 10839 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:17:51.892246  3090 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:51.927462 10603 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:51.928339 10483 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:51.931212 10627 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:51.934549  3165 leader_election.cc:403] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:17:51.911878 10783 consensus_queue.cc:260] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:51.934077  3791 rpcz_store.cc:276] 0709 13:17:50.354069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.354282 (+   213us) service_pool.cc:224] Handling call
0709 13:17:51.912703 (+1558421us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54004be954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:51.912822 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2610965888}
W20260709 13:17:51.943493  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 61828.1us
W20260709 13:17:51.943531  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 403829us
I20260709 13:17:51.955749  3090 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:51.982666  3197 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 26. Current term is 27. Ops: []
I20260709 13:17:51.933485  9926 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 27.13, Last appended by leader: 13, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:51.970618 10839 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609) with higher term. Message: Invalid argument: T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 21. Current term is 22.
I20260709 13:17:51.989920  3048 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:17:51.954298 10483 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:51.950519 10814 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:51.991401 10814 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.991813 10814 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:51.992547 10483 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:51.936144 10780 raft_consensus.cc:697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 24 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:51.998359 10780 consensus_queue.cc:237] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.003265 10803 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:52.003185 10841 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:17:52.007123 10788 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:51.950830 10830 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:17:51.982856  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:51.935122 10618 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:52.015799  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 60137.2us
I20260709 13:17:52.027172  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:52.027534  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:52.027935  3197 raft_consensus.cc:2376] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22. Re-sending same reply.
I20260709 13:17:52.030660  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:52.031466  3049 raft_consensus.cc:2393] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 19: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:52.034725 10783 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:52.018262 10788 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:52.037511  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 54814.7us
I20260709 13:17:52.040450  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:52.040706  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.048413  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:52.052392  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:52.052511  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:52.053567  3199 raft_consensus.cc:2368] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 23. Current term is 24.
I20260709 13:17:52.025866 10603 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:52.029662 10627 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.064960  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:52.061924  3197 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:17:52.062319  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:52.065025  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:52.061585  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:52.071399  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.077041 10835 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.046110 10842 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.038908 10717 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:52.045953 10840 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:52.078789  3196 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 23: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:52.059643 10603 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:52.078804  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:52.029278 10716 consensus_queue.cc:1059] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 13:17:52.089960 10838 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:17:52.090890 10716 raft_consensus.cc:3055] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:52.091387 10716 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:52.086015 10840 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:52.092303 10716 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.093068 10840 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:52.032783 10815 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 26.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:17:52.094326 10815 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:17:52.094700 10815 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:52.095438 10815 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.096551 10815 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:17:52.093621 10716 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:52.029255 10618 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.108042 10618 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:52.074175 10627 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.085381  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:52.109823  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:52.077132 10777 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:52.110634 10627 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:52.111030 10777 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.086988 10717 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.120502  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:52.123836  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:52.125097  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:52.113636 10777 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:52.090046  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:52.129928 10874 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:17:52.131371  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.131700  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:52.132983 10807 consensus_queue.cc:1059] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:17:52.133903 10807 raft_consensus.cc:3055] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:52.134280 10807 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:52.135124  3091 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:52.135066 10807 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.137259 10603 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:52.137892  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:52.078672 10664 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.138152  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:52.147482  3197 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 20: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:52.137619  3195 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:17:52.138278  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 3345) took 1257 ms. Trace:
I20260709 13:17:52.149081  3047 rpcz_store.cc:276] 0709 13:17:50.880718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.880885 (+   167us) service_pool.cc:224] Handling call
0709 13:17:50.900839 (+ 19954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.242417 (+341578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.138052 (+895635us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54001d74d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:52.138217 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":694947072}
I20260709 13:17:52.143738  3196 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:17:52.079847 10788 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:52.147289  3051 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:52.137128  3042 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 24. Current term is 25. Ops: []
I20260709 13:17:52.150002  3121 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
I20260709 13:17:52.141503  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:52.154678  3196 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:17:52.155366  3015 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:52.156478  3091 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:52.158030  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:52.163857 10431 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:17:52.164149 10531 consensus_queue.cc:1059] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:52.081894 10835 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.144981 10515 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:52.173161  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:52.151160 10425 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.152894 10716 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.177892  3091 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:52.160543 10838 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:17:52.166853 10807 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:52.165359 10779 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:52.184293  3091 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:52.185621  3197 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 13:17:52.173110 10874 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:17:52.197154  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:52.187968  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:52.199026  3050 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 25.
I20260709 13:17:52.085875 10842 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.193511  3051 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:52.194526  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:52.187222  3043 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:17:52.151263 10456 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:17:52.159857 10788 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.175154 10655 raft_consensus.cc:3055] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:52.162969 10814 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.190346 10823 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.175338 10726 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:17:52.217087  3124 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
W20260709 13:17:52.142561 10776 consensus_queue.cc:1175] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "501fdf2af2bc4b0c971ae880e98f466b" responder_term: 22 status { last_received { term: 21 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:52.225538 10823 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.183468 10716 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.228794 10823 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:52.237136  3046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3"
dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
mode: GRACEFUL
new_leader_uuid: "f20672b2852447a6bc1e137c4dd40904"
 from {username='slave'} at 127.0.0.1:58046
I20260709 13:17:52.238087  3046 raft_consensus.cc:606] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 24 LEADER]: Received request to transfer leadership to TS f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:52.212592 10655 raft_consensus.cc:740] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:52.216003 10431 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:52.247221 10788 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:52.249205 10814 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:52.250453  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 66256.6us
I20260709 13:17:52.237022 10679 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:17:52.229714 10716 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:52.184638 10425 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.194389 10780 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.024s
I20260709 13:17:52.241573 10717 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:52.270179  3091 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:52.263623 10874 raft_consensus.cc:697] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 25 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:17:52.279299  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 113194us
I20260709 13:17:52.282122  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:52.289921  3196 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 25.
I20260709 13:17:52.292629  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:52.296749  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 100791us
I20260709 13:17:52.297876  3015 leader_election.cc:400] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 23. Current term is 24.
I20260709 13:17:52.298266  3015 leader_election.cc:403] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:17:52.300020  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:52.300854  3196 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:52.280532 10814 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:52.305420 10655 consensus_queue.cc:260] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.309298 10840 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.310350 10874 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.313781  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:52.313041 10880 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:17:52.323202 10414 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:52.326743 10425 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:52.328284  3791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703"
dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
mode: GRACEFUL
new_leader_uuid: "f20672b2852447a6bc1e137c4dd40904"
 from {username='slave'} at 127.0.0.1:43458
I20260709 13:17:52.328886  3791 raft_consensus.cc:606] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Received request to transfer leadership to TS f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:52.329228  3791 raft_consensus.cc:614] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:52.329857 10664 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:52.292102 10717 consensus_queue.cc:1059] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:17:52.331463 10842 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:52.318141 10887 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 23. Current term is 24.
W20260709 13:17:52.330068  3194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 3323) took 1765 ms (client timeout 1918 ms). Trace:
I20260709 13:17:52.332840  3195 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:17:52.333204 10655 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:52.323488 10821 consensus_queue.cc:1059] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:17:52.334815 10821 raft_consensus.cc:3055] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:52.335157 10821 raft_consensus.cc:740] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:52.335474  3090 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:52.335767  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:52.335963 10821 consensus_queue.cc:260] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.336983  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:52.337281 10821 raft_consensus.cc:3060] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:52.342082  3048 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 23: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
W20260709 13:17:52.332854  3194 rpcz_store.cc:269] 0709 13:17:50.564585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.569374 (+  4789us) service_pool.cc:224] Handling call
0709 13:17:52.329905 (+1760531us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b5400036954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:52.330014 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1456650624}
I20260709 13:17:52.346062  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:52.346654  3048 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:52.348348  3194 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:17:52.349294  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:52.349862  3194 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 18.
W20260709 13:17:52.355736  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.356760  3164 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:52.358678  3164 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:52.359655 10531 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:17:52.361145 10502 raft_consensus.cc:2804] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:52.361864 10502 raft_consensus.cc:697] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:52.363096 10502 consensus_queue.cc:237] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.364528  3200 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:52.374116  3194 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 24. Current term is 25. Ops: []
I20260709 13:17:52.371555 10834 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.377063 10834 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.379274 10679 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:17:52.351532 10835 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:52.379987 10679 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.380591 10679 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:17:52.380904  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:52.381592  3791 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:52.382107  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:52.382617  3790 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:52.382642  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:52.383831  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:52.384357  3049 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:52.385133  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:52.386279  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:52.387190 10717 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:52.387744 10717 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.388090  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:52.388633  3049 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:52.389171 10835 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.389784  3165 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:52.389758 10835 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:17:52.390761 10823 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:52.391162 10823 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.391518 10823 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:52.392232 10835 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:52.379469 10834 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:52.393930  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:52.398844 10726 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.400642 10814 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:17:52.401051 10726 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.402341  3196 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:52.408342  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:52.409562  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:52.412879  3049 raft_consensus.cc:2393] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 24: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:52.414215  3795 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:17:52.414839  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 87870.7us
I20260709 13:17:52.394232 10478 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.415530  3799 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:17:52.431063  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.431100  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:52.410449 10717 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:52.422847  3048 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:52.403976 10627 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:52.462297  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:52.421348  3791 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:17:52.482548  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:52.483292  3799 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:52.484027  3049 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:17:52.484663  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:52.487530  3792 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:17:52.430717 10835 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:52.491953  3792 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:17:52.461061 10663 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:52.494642  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:52.495654  3790 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:52.497102  3121 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:17:52.490700 10418 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.504900  3799 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:52.485813 10717 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:52.488718 10839 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.460700 10478 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.513433  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:52.511688  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:52.514333  3799 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
I20260709 13:17:52.510336  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:52.505790 10663 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:52.517928 10829 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 1.217s	user 0.003s	sys 0.003s
I20260709 13:17:52.511783 10717 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.519439  3050 raft_consensus.cc:3055] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:17:52.519588  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1424) took 1579 ms. Trace:
I20260709 13:17:52.519856  3050 raft_consensus.cc:740] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 24 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:52.509354 10418 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.520720  3050 consensus_queue.cc:260] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.522667 10418 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:52.523267 10418 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:52.523350  3794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 1027) took 1268 ms. Trace:
I20260709 13:17:52.523645 10418 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:52.523844  3794 rpcz_store.cc:276] 0709 13:17:51.254855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.255085 (+   230us) service_pool.cc:224] Handling call
0709 13:17:51.255385 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.180605 (+925220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.180658 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:52.180726 (+    68us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:17:52.180790 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.523108 (+342318us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b54006540d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:52.523157 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:52.523293 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2127127808}
I20260709 13:17:52.528046  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:52.529023  3117 raft_consensus.cc:2393] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 25: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:52.530138 10618 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.530781 10618 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.533188 10618 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:52.516088  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:17:52.520016  3123 rpcz_store.cc:276] 0709 13:17:50.940459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.940616 (+   157us) service_pool.cc:224] Handling call
0709 13:17:50.940974 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:50.941479 (+   505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:50.941508 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:50.942089 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:17:51.072270 (+130181us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:51.072311 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.072388 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:52.517191 (+1444803us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:52.519294 (+  2103us) raft_consensus.cc:1685] finished
0709 13:17:52.519316 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:52.519526 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6222,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":122,"spinlock_wait_cycles":7607040,"thread_start_us":129722,"threads_started":1,"wal-append.queue_time_us":320681}
W20260709 13:17:52.536032  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.536576  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:52.536963  3050 raft_consensus.cc:3060] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:52.541018 10478 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:52.541687 10478 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:52.542110 10478 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.542526 10478 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:52.486550 10627 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.550351  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:52.517557 10882 log.cc:927] Time spent T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:17:52.539034  3117 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:52.552567  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:52.553146 10679 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:52.559298  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.563629 10823 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.565469 10663 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:52.566233  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:52.597321  3195 raft_consensus.cc:2393] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 19: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:52.568607 10840 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:52.497088 10835 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.572477 10627 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:52.572897 10726 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:52.538081 10839 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.577483  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:52.578074 10603 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.583587  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:52.635782  3044 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:52.636472  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:52.636619  3799 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 13:17:52.585029  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:52.524140 10418 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:52.598919 10897 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.594887  3090 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:52.638594  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:52.638861  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:52.639076  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 44280.9us
W20260709 13:17:52.609201  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.640455  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:52.607298  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:52.641297  3121 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:52.630959  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:52.641932  3795 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:52.631922  3790 raft_consensus.cc:1240] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:52.634500  3197 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 21: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:52.633473  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:52.643378  3792 raft_consensus.cc:2393] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 23: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:52.585865  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:52.637413  3117 raft_consensus.cc:2410] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 24 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:17:52.624047  3050 raft_consensus.cc:1275] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:17:52.633287  3125 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 25.
I20260709 13:17:52.598963 10834 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.647413  3119 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:52.644574  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:52.648386  3125 raft_consensus.cc:1813] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Handling vote request from an unknown peer 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:52.649091  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:52.645541  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:52.646478  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1425) took 1391 ms. Trace:
I20260709 13:17:52.656050 10679 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:52.657550 10717 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:52.659155  3120 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:17:52.661240  3120 raft_consensus.cc:1240] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 25 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 24. Current term is 25. Ops: []
I20260709 13:17:52.662802  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:52.663713  3194 raft_consensus.cc:2410] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 24 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:17:52.666018  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:52.667253  3193 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
I20260709 13:17:52.633960 10627 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.668216  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:52.676342  3195 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 18.
I20260709 13:17:52.675740  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:52.668753  3125 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 22: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:52.669657  3123 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:52.677227  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:52.670370  3117 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:52.677783  3195 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:17:52.678610  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:52.650786  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 140523us
I20260709 13:17:52.681187  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:52.681787  3799 raft_consensus.cc:1813] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Handling vote request from an unknown peer 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:52.682022 10849 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:17:52.648499 10663 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:52.684882 10603 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:52.686046  3790 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 25 LEADER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 24. Current term is 25. Ops: []
I20260709 13:17:52.687140 10789 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:52.649958  3118 rpcz_store.cc:276] 0709 13:17:51.254769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.254962 (+   193us) service_pool.cc:224] Handling call
0709 13:17:51.255382 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:51.259248 (+  3866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:51.259279 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:52.121515 (+862236us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b2c00010988. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:17:52.121978 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:17:52.190656 (+ 68678us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:17:52.190692 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.190759 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:52.645003 (+454244us) raft_consensus.cc:1685] finished
0709 13:17:52.645022 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:52.646415 (+  1393us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3389,"raft.queue_time_us":3754,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":7668,"spinlock_wait_cycles":6870400,"thread_start_us":68270,"threads_started":1,"wal-append.queue_time_us":200459}
I20260709 13:17:52.690673  3117 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 24. Current term is 25. Ops: []
I20260709 13:17:52.691766  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:52.693146  3164 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:52.693177  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:52.674520  3049 raft_consensus.cc:3060] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:52.682228  3799 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 22: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:52.694873  3795 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:17:52.695676  3126 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 25. Current term is 26. Ops: []
I20260709 13:17:52.698149  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:52.698271  3090 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:52.698787  3050 raft_consensus.cc:1813] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Handling vote request from an unknown peer 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:52.701251  3124 raft_consensus.cc:1240] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:52.702557  3050 raft_consensus.cc:2393] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 22: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:52.695564  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:52.701346  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:52.706075  3120 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:52.707199  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:52.712371  3792 raft_consensus.cc:1275] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:52.713235  3123 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:17:52.652305 10782 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:52.648370 10897 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.724761  3121 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:17:52.717360  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:52.700349 10838 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:17:52.740707  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:52.744266  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:52.708412 10478 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.709388 10819 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:52.651859 10726 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.070s
I20260709 13:17:52.666865 10834 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.717576 10888 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:52.709393 10849 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:52.761186  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:52.731153 10663 raft_consensus.cc:697] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:52.741514 10515 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:17:52.790076  3195 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 26.
W20260709 13:17:52.784369  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 80281.6us
I20260709 13:17:52.731040 10886 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:52.813771  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:52.700696 10627 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.819427 10603 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.002s
W20260709 13:17:52.821393 10865 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.971s	user 0.003s	sys 0.006s
I20260709 13:17:52.822974 10897 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:52.824896  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:52.825673  3197 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:52.825937 10478 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:52.826833 10478 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.827446 10478 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.814213 10849 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:52.830571  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:52.831233 10849 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.831580 10663 consensus_queue.cc:237] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.739586 10782 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.813982 10717 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.834209 10717 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.835078 10782 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:52.826864  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:52.838376 10823 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:52.813993 10886 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.839234 10886 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:52.840734  3197 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:17:52.765491  3049 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:17:52.840915  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 143747us
I20260709 13:17:52.844063  3761 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:52.737914 10414 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:17:52.808238 10789 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:17:52.808421  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 47379.4us
I20260709 13:17:52.854943  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:52.809052  3794 raft_consensus.cc:2368] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 19. Current term is 20.
I20260709 13:17:52.794658 10885 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.026s
W20260709 13:17:52.810626 10896 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:17:52.798779 10888 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:52.815023  3090 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:52.767058 10619 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 13:17:52.806228 10840 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:52.803022 10456 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:52.860944  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 46003.2us
I20260709 13:17:52.861960  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:52.873413  3197 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:17:52.901252  3050 raft_consensus.cc:1240] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 24. Current term is 25. Ops: []
I20260709 13:17:52.902511 10835 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:52.903710 10834 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:52.814922 10425 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.050s
W20260709 13:17:52.908576  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 46694.4us
I20260709 13:17:52.863749 10888 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:52.862566 10414 consensus_queue.cc:1243] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer f20672b2852447a6bc1e137c4dd40904 log is divergent from this leader: its last log entry 24.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:17:52.912896  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:52.913923  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:52.929050  3123 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:52.914445 10878 log.cc:927] Time spent T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.697s	user 0.007s	sys 0.001s
I20260709 13:17:52.914775 10783 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:17:52.915665  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.915825 10418 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:52.913417 10478 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:52.907234 10782 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.917649  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:52.918927 10819 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:52.921839  3191 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:17:52.874150 10814 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:52.862785 10823 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:52.958972  3091 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:52.874518 10789 raft_consensus.cc:697] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:17:52.935285  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.860589 10655 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
W20260709 13:17:52.917479  3193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34728 (request call id 1202) took 1414 ms (client timeout 1626 ms). Trace:
W20260709 13:17:52.960424  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.926154 10902 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:17:52.945133 10627 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:52.964932  3123 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
W20260709 13:17:52.960227  3193 rpcz_store.cc:269] 0709 13:17:51.503151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.503335 (+   184us) service_pool.cc:224] Handling call
0709 13:17:52.917314 (+1413979us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54003bae54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:52.917428 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2658955008}
I20260709 13:17:52.895586 10456 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:52.971951  3091 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:52.974438  3195 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 23.
I20260709 13:17:52.976033  3762 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:52.984876  3091 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:52.941572 10783 raft_consensus.cc:697] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:17:52.995046  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 253859us
I20260709 13:17:52.985370 10779 raft_consensus.cc:2764] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
W20260709 13:17:53.006624  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.006690  3125 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260709 13:17:53.007450  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.983829 10814 raft_consensus.cc:697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:53.023597 10814 consensus_queue.cc:237] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:53.025570 10885 raft_consensus.cc:3055] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:17:53.026046 10885 raft_consensus.cc:740] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 25 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:17:53.010268  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.010756 10840 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:53.011641 10884 consensus_queue.cc:1048] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.004s
W20260709 13:17:53.012969 10904 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:17:52.995065 10883 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:53.008008 10908 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:17:53.016736 10839 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:52.997467 10663 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:17:52.991875 10815 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:53.017704 10418 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:53.019201  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:52.959702 10782 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:53.029881  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:53.030993  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:53.033417  3090 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:53.061380  3090 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:53.036980  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.039471  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:53.043676  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:53.065135  3051 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 23: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:53.049108  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:53.067122  3799 raft_consensus.cc:2410] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 24 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
W20260709 13:17:53.050158  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 74244.6us
I20260709 13:17:53.026919 10885 consensus_queue.cc:260] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 25.12, Last appended by leader: 12, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:53.074141  3090 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:52.996495 10902 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:17:53.088353  3762 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:53.093266  3762 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:53.093515 10478 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:53.098073 10618 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:53.098570 10618 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.098991 10618 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:53.101058 10478 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:17:53.102138 10842 raft_consensus.cc:3055] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:17:53.102617 10842 raft_consensus.cc:740] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:53.103442 10842 consensus_queue.cc:260] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:53.109243 10431 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:53.046811 10908 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.122145  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:53.123085  3194 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
W20260709 13:17:53.153807  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.058795 10838 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.070351 10619 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.088033 10603 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:17:53.087774 10884 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:17:53.119658 10803 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:17:53.202687  3123 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 23. Ops: []
I20260709 13:17:53.120062 10908 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:17:53.176649 10885 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:17:53.179406 10748 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.023s
W20260709 13:17:53.198503 10821 consensus_meta.cc:287] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.855s	user 0.011s	sys 0.000s
I20260709 13:17:53.052026 10883 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:53.176349 10835 consensus_queue.cc:1059] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:17:53.216490 10618 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:53.204090 10884 raft_consensus.cc:697] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 26 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:53.188071 10717 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:53.215493 10456 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:53.163017 10909 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.142s
I20260709 13:17:53.192444 10619 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:53.088591 10789 consensus_queue.cc:237] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:53.185542 10838 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:53.192970 10783 consensus_queue.cc:237] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:53.225870  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.209321 10840 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:53.311604 10814 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:53.317564 10814 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:53.259953 10912 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.312443  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:53.271359  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:53.321667  3799 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:53.238826 10884 consensus_queue.cc:237] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:53.331789 10838 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:53.310230 10502 consensus_queue.cc:1048] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:17:53.336004  3049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3690) took 1049 ms. Trace:
I20260709 13:17:53.336428  3049 rpcz_store.cc:276] 0709 13:17:52.286565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.488358 (+201793us) service_pool.cc:224] Handling call
0709 13:17:52.497783 (+  9425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.842284 (+344501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.335771 (+493487us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54001f5c54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:53.335946 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":406129408}
I20260709 13:17:53.238164 10618 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:53.335481 10912 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:53.340792 10912 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:53.277544 10842 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:53.345345  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:53.346163  3125 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:53.347235  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:53.350636  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.359814  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.360625  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 358026us
I20260709 13:17:53.366353  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:53.263094 10782 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:53.380504 10841 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:53.366415  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:53.288498 10619 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:53.387822  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:53.390914  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 314990us
W20260709 13:17:53.393653  3761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.008s	sys 0.028s
W20260709 13:17:53.395618  3761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.008s	sys 0.028s
W20260709 13:17:53.396245  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 552239us
I20260709 13:17:53.399279  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:53.400103  3047 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:53.465014  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.420682  3761 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:53.497454  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 76901.9us
I20260709 13:17:53.498461  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:53.498930  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.502822  3120 raft_consensus.cc:1275] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:17:53.504693  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:53.508028  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:17:53.512403  3164 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.132:43109 timed out after 2.157s (SENT) [suppressed 5 similar messages]
W20260709 13:17:53.512532  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.514433  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 110064us
I20260709 13:17:53.514578  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:53.515256  3791 raft_consensus.cc:2368] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20.
W20260709 13:17:53.521219  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 127814us
I20260709 13:17:53.527922  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:53.392699 10776 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:53.548550  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:53.550951  3799 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:17:53.404712 10502 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.553982  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:53.554637  3793 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.140s	sys 0.204s
I20260709 13:17:53.378080 10888 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:53.497277 10663 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.559121  3790 raft_consensus.cc:2376] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 24. Re-sending same reply.
I20260709 13:17:53.497602 10907 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:53.519452 10627 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:53.529222 10824 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.566006  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:53.579541  3799 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 18.
I20260709 13:17:53.394937 10726 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.157s
I20260709 13:17:53.527906 10915 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:53.589246 10915 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:53.589751 10915 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:53.594246 10782 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:53.594851 10782 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:53.595229 10790 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:53.596985 10782 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:53.529446 10716 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:53.389866 10841 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:53.547700 10679 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:53.583638  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:53.599563  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:53.603482  3050 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:53.605315  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 90210.6us
I20260709 13:17:53.567718 10907 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:53.622803  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 47698.4us
I20260709 13:17:53.635030  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:53.635564  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:53.555714 10776 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:53.604461 10903 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.642015  3796 raft_consensus.cc:2393] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 20: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:53.598686 10716 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:53.659958 10849 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:53.608392  3124 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:17:53.622166 10679 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:53.661603  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:53.664007 10849 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:53.664316 10679 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:53.567143 10502 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:53.666698 10502 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:53.666961  3015 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:53.671227 10849 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:53.672067 10849 raft_consensus.cc:697] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:53.673425 10849 consensus_queue.cc:237] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:53.682593  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:53.690977  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:53.694478  3090 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:53.702793  3050 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:53.702039  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:53.626955 10814 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:53.711359  3120 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:17:53.637413 10907 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:53.634181 10921 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:53.599635 10824 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:53.687638 10886 consensus_meta.cc:287] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.848s	user 0.012s	sys 0.002s
I20260709 13:17:53.640720 10779 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:53.736925  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:53.750690  3198 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:53.641095 10780 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.096s
I20260709 13:17:53.708902 10679 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:53.581525 10663 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:53.742367  3120 raft_consensus.cc:1240] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:53.650595 10536 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:53.685452 10726 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:53.733714 10627 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:53.798084 10627 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:53.800462 10627 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:53.802740  9926 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:17:53.803145 10824 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:53.805578 10823 consensus_meta.cc:287] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.837s	user 0.013s	sys 0.000s
I20260709 13:17:53.806335 10823 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:53.748607 10921 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:53.808012 10726 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:53.687386 10903 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:53.735488  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 223101us
I20260709 13:17:53.813683  3164 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:53.772781  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.741212 10840 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:53.708637 10838 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:17:53.791501 10776 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:53.792661  2940 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57750 (request call id 232) took 30931 ms (client timeout 15000 ms). Trace:
W20260709 13:17:53.794615 10925 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:17:53.794939 10874 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.822973  3790 raft_consensus.cc:2393] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 24: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:53.818138  3047 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:53.809702 10921 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:53.753365 10886 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:53.829700  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:53.892098  3047 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:17:53.893050  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:53.818106  3198 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:17:53.894899  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 1196) took 3262 ms. Trace:
I20260709 13:17:53.895323  3198 rpcz_store.cc:276] 0709 13:17:50.632332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.636685 (+  4353us) service_pool.cc:224] Handling call
0709 13:17:50.641792 (+  5107us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.666021 (+1024229us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b180029b740. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303ee646 00007ff83032858e 00007ff8303a9f9e 00007ff8303ab7de 00007ff8303b5b49 00007ff8303b6416 00007ff8303b2d8f 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4
0709 13:17:52.333307 (+667286us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b58002e9dd0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83030f0aa 00007ff830391447 00007ff8303a9fe7 00007ff8303ab7de 00007ff8303b5b49 00007ff8303b6416 00007ff8303b2d8f 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4
0709 13:17:53.750146 (+1416839us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b58002ea0d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83030f0aa 00007ff830391447 00007ff8303a9fe7 00007ff8303ab7de 00007ff8303b5b49 00007ff8303b6416 00007ff8303b2d8f 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4
0709 13:17:53.894677 (+144531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.894851 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2331460992}
I20260709 13:17:53.854626  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:53.823531  3164 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:53.907332  3047 raft_consensus.cc:1275] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:17:53.760659 10779 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:53.915807  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.943540  3015 leader_election.cc:400] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20.
I20260709 13:17:53.944110  3015 leader_election.cc:403] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:17:53.951242  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:53.952250  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:53.952438  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:53.952940  3198 raft_consensus.cc:3060] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:17:53.953051  3199 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:53.820212 10366 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:53.973493  3198 raft_consensus.cc:2468] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
I20260709 13:17:53.979506  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:53.980248  3198 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:17:53.972684  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:54.014787  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:54.058921  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.896785 10533 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.081187  3198 raft_consensus.cc:1275] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:17:54.095624  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:54.101626  3124 raft_consensus.cc:2393] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 20: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:17:54.102373  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 158979us
I20260709 13:17:54.103586  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:53.821928 10651 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.152s
I20260709 13:17:54.095247  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:53.822571 10840 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:54.079483 10922 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 13:17:53.970845 10823 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:17:54.150414  3799 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.006s	sys 0.008s
W20260709 13:17:54.162837  3799 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.006s	sys 0.008s
W20260709 13:17:54.150939  3119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.005s	sys 0.008s
W20260709 13:17:54.164037  3119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.005s	sys 0.008s
I20260709 13:17:53.892961 10874 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:54.079908 10780 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:54.079205 10888 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:54.165800  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:54.115836 10366 raft_consensus.cc:697] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:17:54.151783 10884 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.007s	sys 0.009s
W20260709 13:17:54.163034 10920 log.cc:927] Time spent T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:17:54.146289 10783 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.268507  3045 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
W20260709 13:17:54.275240  3122 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.006s	sys 0.045s
W20260709 13:17:54.276165  3122 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.007s	sys 0.045s
W20260709 13:17:54.260385 10884 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.007s	sys 0.010s
I20260709 13:17:54.182073 10916 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:54.189661 10841 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:54.252885 10838 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:17:54.273186 10478 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.027s	sys 0.037s
I20260709 13:17:54.131839 10533 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:54.274931 10888 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.302897  3199 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 20.
W20260709 13:17:54.287035 10849 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.007s	sys 0.037s
W20260709 13:17:54.319542  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 494680us
W20260709 13:17:54.297752 10924 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.510s	user 0.001s	sys 0.000s
W20260709 13:17:54.303296 10478 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.028s	sys 0.037s
I20260709 13:17:54.287413 10776 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:54.363441  3198 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 25.
I20260709 13:17:54.262890 10780 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:54.372298  3199 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:17:54.327795 10849 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.008s	sys 0.038s
I20260709 13:17:54.275477 10783 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:54.316634 10580 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20.
I20260709 13:17:54.306391 10841 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.414568  3792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 1313) took 1063 ms. Trace:
W20260709 13:17:54.415014  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 311547us
W20260709 13:17:54.401860 10938 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.123s	user 0.002s	sys 0.000s
I20260709 13:17:54.402253  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:54.403292 10932 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:17:54.404165 10886 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:54.404978  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:54.405848 10840 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:54.409276 10908 consensus_meta.cc:287] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.186s	user 0.007s	sys 0.005s
I20260709 13:17:54.292392 10916 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:54.379792 10502 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.410931  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:54.436503  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:54.437233  3051 raft_consensus.cc:2393] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 25: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:54.413228  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3342) took 2551 ms. Trace:
W20260709 13:17:54.386515 10930 log.cc:927] Time spent T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.566s	user 0.001s	sys 0.001s
I20260709 13:17:54.393914 10903 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:54.410527 10936 log.cc:927] Time spent T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
I20260709 13:17:54.437687  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:54.438162  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:54.437924  3191 rpcz_store.cc:276] 0709 13:17:51.861722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.861948 (+   226us) service_pool.cc:224] Handling call
0709 13:17:52.921399 (+1059451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.943374 (+ 21975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.413001 (+1469627us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003bae50. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:54.413162 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2408002048}
I20260709 13:17:54.359423 10838 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:54.455965 10838 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:54.458417 10838 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:54.382609 10776 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:54.415756  3792 rpcz_store.cc:276] 0709 13:17:53.351200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.351406 (+   206us) service_pool.cc:224] Handling call
0709 13:17:53.358895 (+  7489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:53.359702 (+   807us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:53.359736 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:53.360246 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:17:53.850452 (+490206us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:53.850505 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.850598 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:54.414291 (+563693us) raft_consensus.cc:1685] finished
0709 13:17:54.414318 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.414502 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8427,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":8330,"thread_start_us":489841,"threads_started":1,"wal-append.queue_time_us":998422}
I20260709 13:17:54.328682 10888 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:54.441682  3051 raft_consensus.cc:1275] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:17:54.468597  3051 pending_rounds.cc:85] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 9
I20260709 13:17:54.468901  3051 pending_rounds.cc:107] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:17:54.469142  3051 raft_consensus.cc:2889] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:54.445573  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2881) took 1198 ms. Trace:
I20260709 13:17:54.472270 10838 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:17:54.473287 10838 raft_consensus.cc:697] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 24 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:54.475529 10838 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:54.482818  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 44577.7us
I20260709 13:17:54.512108  3049 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:54.501868  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:54.424832 10841 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:54.499500 10779 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:54.387403 10366 consensus_queue.cc:237] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:54.440385 10580 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
W20260709 13:17:54.514977  3761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.008s	sys 0.011s
I20260709 13:17:54.532286  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:54.435976 10908 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:54.470396  3126 rpcz_store.cc:276] 0709 13:17:53.247161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.247420 (+   259us) service_pool.cc:224] Handling call
0709 13:17:53.247816 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:53.248335 (+   519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.248378 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:53.269536 (+ 21158us) log.cc:844] Serialized 26 byte log entry
0709 13:17:53.581406 (+311870us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:17:53.581451 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.581527 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:54.445369 (+863842us) raft_consensus.cc:1685] finished
0709 13:17:54.445389 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.445515 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6388,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"thread_start_us":311150,"threads_started":1,"wal-append.queue_time_us":469431}
W20260709 13:17:54.518561  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 197183us
W20260709 13:17:54.535796  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.447144 10502 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:54.515065 10663 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:54.542892  3761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.008s	sys 0.011s
I20260709 13:17:54.531889 10414 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:54.531563 10840 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:54.555796  3046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1619) took 1160 ms. Trace:
I20260709 13:17:54.534718 10619 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:54.554587  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 861094us
I20260709 13:17:54.563640  3046 rpcz_store.cc:276] 0709 13:17:53.395441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.397323 (+  1882us) service_pool.cc:224] Handling call
0709 13:17:53.397710 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:53.398127 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.398163 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:53.398758 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:17:53.812777 (+414019us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:53.812849 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.812930 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:54.555534 (+742604us) raft_consensus.cc:1685] finished
0709 13:17:54.555561 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.555700 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98762,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":17057,"thread_start_us":294012,"threads_started":1,"wal-append.queue_time_us":733266}
I20260709 13:17:54.566098  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:54.571630  3761 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:54.549981 10536 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:54.579361  3761 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:54.580688  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:54.582808  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:54.566008 10947 log.cc:927] Time spent T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:17:54.603399  3046 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 27.
I20260709 13:17:54.539012 10886 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:17:54.562635 10840 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.546612 10884 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:17:54.604792  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:54.574286 10619 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:54.562216 10414 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:54.660229 10940 log.cc:927] Time spent T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:17:54.606524 10783 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:54.615731 10840 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:54.686339  3042 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.019s	sys 0.036s
I20260709 13:17:54.806924 10502 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:54.705582  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 160000us
I20260709 13:17:54.786370 10943 consensus_queue.cc:1048] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:54.808185 10502 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:54.808888 10502 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:54.809055  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:54.786808  3761 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:17:54.788678 10959 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.122s	user 0.005s	sys 0.002s
I20260709 13:17:54.813184 10897 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:54.609148 10902 raft_consensus.cc:2804] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:54.788365  3790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 1038) took 1224 ms. Trace:
I20260709 13:17:54.814178  3790 rpcz_store.cc:276] 0709 13:17:53.563815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.564029 (+   214us) service_pool.cc:224] Handling call
0709 13:17:54.619687 (+1055658us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54004be954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:54.788300 (+168613us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489497472}
I20260709 13:17:54.814782 10962 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.815392 10962 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:54.819087 10962 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:54.792917 10580 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:54.822161 10948 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.275s	user 0.004s	sys 0.004s
I20260709 13:17:54.822572 10776 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:54.823851  3797 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 1041) took 1144 ms. Trace:
W20260709 13:17:54.821172  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.825052  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:54.789135 10916 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:54.789836 10952 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.827042  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:54.607043 10954 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.075s
I20260709 13:17:54.601794 10618 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:54.578295 10903 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:54.578498 10478 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.102s
I20260709 13:17:54.792511 10619 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:54.802567  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:54.805191 10780 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:54.795233 10951 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:53.822697  2940 rpcz_store.cc:269] 0709 13:17:22.860751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.861012 (+   261us) service_pool.cc:224] Handling call
0709 13:17:24.167635 (+1306623us) spinlock_profiling.cc:243] Waited 7.26 ms on lock 0x7b5400002490. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28f640 00007ff836166b76 00007ff836270c3e 00007ff8347312a4 00007ff834731232 00007ff834731161 00007ff8347310dc 00007ff834730392 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:53.792421 (+29624786us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:44.982261 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:45.165921 (+183660us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:45.182572 (+ 16651us) write_op.cc:435] Acquired schema lock
0709 13:17:45.182598 (+    26us) tablet.cc:662] Decoding operations
0709 13:17:45.253488 (+ 70890us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:45.253583 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:45.253615 (+    32us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:17:45.254742 (+  1127us) tablet.cc:701] Row locks acquired
0709 13:17:45.254805 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:17:45.254995 (+   190us) write_op.cc:270] Start()
0709 13:17:45.255160 (+   165us) write_op.cc:276] Timestamp: P: 1783603065254925 usec, L: 0
0709 13:17:45.255182 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:17:45.363185 (+108003us) log.cc:844] Serialized 5571 byte log entry
0709 13:17:45.500066 (+136881us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82d2a90ac 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b
0709 13:17:45.770977 (+270911us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b54000d98d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303aee28 00007ff833de9581 00007ff833de8d58 00007ff833ded9f1 00007ff833ded9a9 00007ff833ded939 00007ff833ded901 00007ff833decb2d 000000000038f354 000000000038f199
0709 13:17:47.278738 (+1507761us) op_driver.cc:464] REPLICATION: finished
0709 13:17:47.825274 (+546536us) write_op.cc:301] APPLY: starting
0709 13:17:47.828218 (+  2944us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:47.862184 (+ 33966us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:47.862249 (+    65us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:47.984685 (+122436us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:47.985191 (+   506us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0709 13:17:47.985253 (+    62us) write_op.cc:312] APPLY: finished
0709 13:17:47.992012 (+  6759us) log.cc:844] Serialized 129 byte log entry
0709 13:17:47.993402 (+  1390us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:47.993681 (+   279us) write_op.cc:454] Released schema lock
0709 13:17:47.993865 (+   184us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:48.000681 (+  6816us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:48.000730 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1155967,"reported_tablets":51,"spinlock_wait_cycles":16699648,"child_traces":[["op",{"apply.queue_time_us":506045,"apply.run_cpu_time_us":24964,"apply.run_wall_time_us":193128,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62675,"num_ops":14,"prepare.queue_time_us":282653,"prepare.run_cpu_time_us":108913,"prepare.run_wall_time_us":805338,"raft.queue_time_us":1221031,"raft.run_cpu_time_us":12862,"raft.run_wall_time_us":332288,"replication_time_us":2019620,"spinlock_wait_cycles":65434880,"thread_start_us":1939232,"threads_started":4,"wal-append.queue_time_us":330890,"wal-append.run_cpu_time_us":47226,"wal-append.run_wall_time_us":3282516}]]}
I20260709 13:17:54.846737  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:54.808387 10913 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 1.582s	user 0.011s	sys 0.000s
W20260709 13:17:54.787567 10907 consensus_meta.cc:287] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.039s	user 0.003s	sys 0.016s
I20260709 13:17:54.855788  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:54.856050 10907 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:54.857183  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:54.857432  3051 raft_consensus.cc:1240] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:54.789224 10963 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:54.789354 10967 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.858366 10776 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:54.858752 10967 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:54.858956 10776 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:54.861141 10776 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:54.861272 10967 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:54.821841 10502 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:54.790403 10888 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:54.824357  3797 rpcz_store.cc:276] 0709 13:17:53.679407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.681890 (+  2483us) service_pool.cc:224] Handling call
0709 13:17:53.682235 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:53.840857 (+158622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.840907 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:53.871123 (+ 30216us) log.cc:844] Serialized 26 byte log entry
0709 13:17:54.284554 (+413431us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:17:54.284595 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.284668 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:54.823652 (+538984us) raft_consensus.cc:1685] finished
0709 13:17:54.823672 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.823794 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118387,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":569646,"threads_started":2,"wal-append.queue_time_us":628266}
W20260709 13:17:54.791059 10935 log.cc:927] Time spent T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.250s	user 0.000s	sys 0.008s
I20260709 13:17:54.827806  3791 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:17:54.829782  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:54.831496  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:54.836843 10916 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:54.835408  3795 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:17:54.857334 10960 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.794663 10536 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:54.846742  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:54.884192  3123 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:54.804225  3165 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:54.829088 10679 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.847689  3164 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:54.813426 10874 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:54.828750 10488 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:54.808403 10943 consensus_queue.cc:1243] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:17:54.824340 10908 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:54.864216  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:54.823701 10414 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:54.798846 10885 consensus_meta.cc:287] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.585s	user 0.009s	sys 0.011s
I20260709 13:17:54.836053 10903 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:54.873790  3126 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
W20260709 13:17:54.803635 10915 consensus_meta.cc:287] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.213s	user 0.011s	sys 0.008s
I20260709 13:17:54.876308 10968 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:54.905714 10515 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.925396 10968 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:54.926246 10515 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:54.928310 10968 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:54.886054  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 56380.8us
I20260709 13:17:54.928987 10967 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:54.877882  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 3220) took 1367 ms. Trace:
I20260709 13:17:54.858404 10963 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:54.929507 10967 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:54.930353  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 126191us
W20260709 13:17:54.931128  9926 consensus_meta.cc:287] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.128s	user 0.011s	sys 0.006s
I20260709 13:17:54.931421  3165 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:54.931636 10963 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:54.932034 10967 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:54.932185 10963 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:54.932412  3192 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 28 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 27 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 13:17:54.923205 10903 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:54.830340 10580 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:54.877431 10907 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:54.918459  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:54.916589 10950 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.921792 10965 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:54.834372 10952 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:54.903524 10960 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:54.922508 10969 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:54.852618 10951 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:54.924258 10915 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:54.936578 10897 raft_consensus.cc:697] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:54.924634  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:54.982388  3123 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:17:54.925935 10841 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:54.928383 10515 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:54.929463  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 81872.5us
I20260709 13:17:54.934074  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:54.887349  3794 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43926 (request call id 1303) took 2286 ms (client timeout 2157 ms). Trace:
I20260709 13:17:54.861670 10776 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.914343  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:54.901613 10618 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:54.937973  3122 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 27.
I20260709 13:17:54.929636  3119 rpcz_store.cc:276] 0709 13:17:53.510214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.510414 (+   200us) service_pool.cc:224] Handling call
0709 13:17:53.510839 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:53.528989 (+ 18150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.529036 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:53.529638 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 13:17:54.164678 (+635040us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:54.164736 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.164841 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:54.877666 (+712825us) raft_consensus.cc:1685] finished
0709 13:17:54.877684 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.877827 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46284,"raft.queue_time_us":42941,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":3026,"thread_start_us":634551,"threads_started":1,"wal-append.queue_time_us":979248}
I20260709 13:17:54.933265 10488 raft_consensus.cc:697] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:54.941591 10902 raft_consensus.cc:697] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:54.935329 10788 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.966720 10961 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.967489 10971 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:54.913162 10679 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:54.969523 10965 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:54.976652 10580 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:54.905823 10536 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:54.981377 10969 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:54.919857 10840 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:55.068823  3791 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:55.071933  3193 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 15.
W20260709 13:17:55.073557  3794 rpcz_store.cc:269] 0709 13:17:52.600539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.600643 (+   104us) service_pool.cc:224] Handling call
0709 13:17:54.887109 (+2286466us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b5400484c54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:54.887272 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379383168}
I20260709 13:17:55.073259  3126 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
W20260709 13:17:55.075105  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 133966us
I20260709 13:17:55.076007  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:55.076817  3119 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:17:54.983799  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:55.078410  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:55.080641  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:55.068315 10901 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 2.267s	user 0.016s	sys 0.009s
I20260709 13:17:55.083315  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:55.076267  3126 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:17:55.084120  3797 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:17:55.085098  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:55.088872  3123 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 25.
I20260709 13:17:55.075201  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:55.091074  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3359) took 2716 ms. Trace:
I20260709 13:17:55.091573  3200 rpcz_store.cc:276] 0709 13:17:52.374835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.833116 (+458281us) service_pool.cc:224] Handling call
0709 13:17:52.833477 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:52.839663 (+  6186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.839702 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:52.840202 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:17:53.050794 (+210592us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:53.050835 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.050906 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:54.807766 (+1756860us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:55.077586 (+269820us) raft_consensus.cc:1685] finished
0709 13:17:55.077605 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.091006 (+ 13401us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5603,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":3942656,"thread_start_us":210141,"threads_started":1,"wal-append.queue_time_us":343638}
I20260709 13:17:55.046444 10663 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.097086  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:55.046247 10906 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:54.983780 10951 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:54.984484 10478 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:54.985827 10960 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:55.101167 10885 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:55.101651 10885 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:55.101517 10906 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:55.102070 10885 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:55.102586 10883 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:55.103808 10906 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:55.104362 10663 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:55.106149 10952 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:55.106554 10663 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:54.982460 10897 consensus_queue.cc:237] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:55.072283 10971 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.076242 10961 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:55.113444  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:55.114188  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:55.177271  3790 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:17:55.153496  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:55.134585  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 43586.3us
I20260709 13:17:55.176326  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:55.116669  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:55.183044  3200 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:55.087122 10366 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:55.153785  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.125208 10478 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:55.188308  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 92028.1us
I20260709 13:17:55.080518 10788 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:55.191514  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:55.174605 10899 log.cc:927] Time spent T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 2.363s	user 0.004s	sys 0.003s
I20260709 13:17:55.205916  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:55.206066  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:55.193229 10835 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:55.208063 10679 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:55.208065 10805 consensus_queue.cc:1048] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:17:54.969791 10950 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:55.206611  3790 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
W20260709 13:17:55.192941  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 125176us
I20260709 13:17:55.215253  3044 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 27. Current term is 28. Ops: []
I20260709 13:17:55.115170  3793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 1304) took 2514 ms. Trace:
I20260709 13:17:55.218128 10835 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:55.220580 10835 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:55.205350 10902 consensus_queue.cc:237] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:55.082654 10580 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.125s
I20260709 13:17:55.213284  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:55.123710 10969 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:55.159412 10965 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:55.173779 10488 consensus_queue.cc:237] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:55.239605  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3693) took 2945 ms. Trace:
I20260709 13:17:55.214658  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:55.246434  3048 rpcz_store.cc:276] 0709 13:17:52.294428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.486821 (+192393us) service_pool.cc:224] Handling call
0709 13:17:52.488158 (+  1337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:52.489847 (+  1689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.489893 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:52.501592 (+ 11699us) log.cc:844] Serialized 26 byte log entry
0709 13:17:52.599640 (+ 98048us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:52.599680 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.599742 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:55.061231 (+2461489us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:55.211358 (+150127us) raft_consensus.cc:1685] finished
0709 13:17:55.211393 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.239502 (+ 28109us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":994,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":3135,"spinlock_wait_cycles":100248960,"thread_start_us":14453,"threads_started":1,"wal-append.queue_time_us":167791}
I20260709 13:17:55.091136 10776 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:55.249253 10954 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:17:55.254443 10969 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:55.254873 10969 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.255224 10969 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:17:55.255883 10926 log.cc:927] Time spent T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 1.514s	user 0.002s	sys 0.011s
I20260709 13:17:55.244336 10951 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 13:17:55.262079 10985 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:17:55.262343  3165 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:55.263077 10619 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.263548 10619 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:55.263741 10967 consensus_queue.cc:1059] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:55.264667 10967 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:55.265040 10967 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.217442  3793 rpcz_store.cc:276] 0709 13:17:52.600809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.601043 (+   234us) service_pool.cc:224] Handling call
0709 13:17:52.601345 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:52.969972 (+368627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.970026 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:52.997118 (+ 27092us) log.cc:844] Serialized 26 byte log entry
0709 13:17:53.558570 (+561452us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:17:53.919457 (+360887us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.016470 (+ 97013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.114814 (+1098344us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b5400653454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:55.114863 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:55.114907 (+    44us) raft_consensus.cc:1685] finished
0709 13:17:55.114978 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.115099 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102995,"prepare.queue_time_us":884217,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":19054,"raft.queue_time_us":202384,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":44548,"spinlock_wait_cycles":497082624,"thread_start_us":967527,"threads_started":3,"wal-append.queue_time_us":673803}
I20260709 13:17:55.210255 10840 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:55.210325 10536 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:55.276566  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:55.262604 10985 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.245544 10835 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.266069  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:55.268733  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:55.269966  3043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:55.299373  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:55.270581  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 55997.2us
I20260709 13:17:55.301419  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:55.265409 10967 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:55.272873  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:55.231385 10805 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.194705  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:55.116281 10885 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:55.257967 10980 log.cc:927] Time spent T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:17:55.187191 10971 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:55.275815 10952 raft_consensus.cc:3055] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:55.308224  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 27 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:55.317631  3051 raft_consensus.cc:2410] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 27 because replica has last-logged OpId of term: 25 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
I20260709 13:17:55.309512  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:55.308367  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2775) took 1590 ms. Trace:
I20260709 13:17:55.304085  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:55.323506  3049 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:17:55.303170  9926 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:55.281092 10965 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:55.325507  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:55.323297  3197 rpcz_store.cc:276] 0709 13:17:53.705589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.705760 (+   171us) service_pool.cc:224] Handling call
0709 13:17:53.738294 (+ 32534us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:53.744465 (+  6171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.744495 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.158377 (+1413882us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b18001cc540. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2942a6 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a
0709 13:17:55.158838 (+   461us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b2c000fc108. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:17:55.159341 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:17:55.292946 (+133605us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:55.292989 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.293063 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:55.295669 (+  2606us) raft_consensus.cc:1685] finished
0709 13:17:55.295696 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.295852 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6348,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":4518,"spinlock_wait_cycles":9739392,"thread_start_us":133205,"threads_started":1,"wal-append.queue_time_us":134945}
I20260709 13:17:55.273898 10907 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.325974  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:55.299358 10985 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:17:55.358155  3193 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:55.361188  3046 raft_consensus.cc:2393] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 16: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:55.327857  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:55.366360  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:55.381623  3048 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:55.367861 10885 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:55.368516 10903 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:55.378813  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:55.317133 10952 raft_consensus.cc:740] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:55.396618  3797 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:55.316788 10619 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:55.395617  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:55.356366 10902 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.399191  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:55.313226 10805 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:55.411581  3197 raft_consensus.cc:2393] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 17: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:55.412428  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:55.307173 10835 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:55.394099  3051 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 21: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:55.413120  3796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 920) took 1892 ms. Trace:
I20260709 13:17:55.419697  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:55.419749  3796 rpcz_store.cc:276] 0709 13:17:53.520521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.520643 (+   122us) service_pool.cc:224] Handling call
0709 13:17:55.412896 (+1892253us) spinlock_profiling.cc:243] Waited 83.2 ms on lock 0x7b5400660154. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:55.413058 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191425280}
I20260709 13:17:55.418911  3048 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 22: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:55.433873  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:55.383577 10965 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:55.436488  3798 raft_consensus.cc:1275] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:17:55.385097 10907 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:55.407101 10478 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:55.490296 10907 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:55.501088  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:55.443282 10937 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.923s	user 0.000s	sys 0.003s
I20260709 13:17:55.438903  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:55.505590  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:55.506551  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:55.506798  3799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 1039) took 1922 ms. Trace:
I20260709 13:17:55.507220  3197 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:55.508191  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:55.509006  3197 raft_consensus.cc:2393] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:55.449219 10903 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:55.451138 10805 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:55.506265  3191 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 23.
I20260709 13:17:55.456182 10366 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.514052 10366 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:55.451303 10965 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:55.516821 10366 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:55.458220  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:55.518290  3048 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 25.
I20260709 13:17:55.519413  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:55.520128  3048 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 20.
I20260709 13:17:55.521085  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:55.460757  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:55.522292  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 61608.6us
I20260709 13:17:55.417918 10619 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:55.523720  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:55.523523 10619 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:55.524813 10883 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.525964 10906 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:55.526504 10906 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:55.526985 10906 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:17:55.457048  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.462106 10821 raft_consensus.cc:3055] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:55.531682 10821 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:55.532495 10821 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:55.533460 10821 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:55.525437 10883 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:55.535964 10883 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:55.536480 10883 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:55.463855 10942 log.cc:927] Time spent T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 1.103s	user 0.000s	sys 0.002s
I20260709 13:17:55.478436  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:55.539224  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3707) took 2102 ms. Trace:
I20260709 13:17:55.502497  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 3375) took 1364 ms. Trace:
I20260709 13:17:55.540205  3198 rpcz_store.cc:276] 0709 13:17:54.138450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.138803 (+   353us) service_pool.cc:224] Handling call
0709 13:17:55.502312 (+1363509us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54002bcad4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:55.502438 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268350720}
I20260709 13:17:55.507179  3799 rpcz_store.cc:276] 0709 13:17:53.584554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.584689 (+   135us) service_pool.cc:224] Handling call
0709 13:17:53.586790 (+  2101us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:53.587140 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.587170 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:53.587672 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:17:54.163596 (+575924us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:54.163654 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.163749 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:55.423065 (+1259316us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:55.506508 (+ 83443us) raft_consensus.cc:1685] finished
0709 13:17:55.506529 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.506741 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":59235,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":51784,"spinlock_wait_cycles":6853888,"thread_start_us":575453,"threads_started":1,"wal-append.queue_time_us":848044}
W20260709 13:17:55.542398  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.543291  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:55.543921  3198 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:17:55.544063  3799 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:55.481570 10776 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:55.539599  3042 rpcz_store.cc:276] 0709 13:17:53.436798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.671110 (+234312us) service_pool.cc:224] Handling call
0709 13:17:53.671412 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:53.671749 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.671789 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:53.672353 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 13:17:54.152137 (+479784us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:17:54.807573 (+655436us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.807755 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.807827 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:55.463286 (+655459us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:55.538946 (+ 75660us) raft_consensus.cc:1685] finished
0709 13:17:55.539043 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.539168 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":637760,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":15582,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":206,"spinlock_wait_cycles":11713280,"thread_start_us":1104234,"threads_started":2,"wal-append.queue_time_us":577196}
I20260709 13:17:55.546806  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:55.547508  3042 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:55.548512  3042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:55.549134  3042 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:17:55.549367 10885 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.549911 10885 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:55.545274  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:55.551986 10885 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:55.552776  3799 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:17:55.514283  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:55.557696  3191 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 23.
I20260709 13:17:55.566434 10969 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:55.572642 10969 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:55.539669  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:55.574806  3797 raft_consensus.cc:2393] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 24: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:17:55.576022  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:55.576984  3797 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:55.441288  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:55.587671  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 64031.4us
I20260709 13:17:55.459022 10835 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:55.521687  3048 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:55.447743 10971 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:55.666749  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 208964us
I20260709 13:17:55.460481 10985 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:55.718786  3196 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:17:55.707029  3165 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:55.725515  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:55.726368  3197 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
W20260709 13:17:55.877954  3195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34728 (request call id 1207) took 3017 ms (client timeout 1546 ms). Trace:
W20260709 13:17:55.878623  3195 rpcz_store.cc:269] 0709 13:17:52.703374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.813469 (+110095us) service_pool.cc:224] Handling call
0709 13:17:55.718083 (+2904614us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54001de054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:55.720203 (+  2120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367965952}
W20260709 13:17:55.880553  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 173604us
I20260709 13:17:55.886338  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:55.893404  3048 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:55.895215  3200 raft_consensus.cc:2368] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 22. Current term is 23.
I20260709 13:17:55.900115  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:55.411758 10902 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:55.895282 10782 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:55.946224 10782 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:55.946780 10782 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:55.897135 10679 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.954301 10679 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:55.958770  3048 raft_consensus.cc:1275] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:17:56.009011  3797 raft_consensus.cc:2468] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:17:55.893044 10916 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:17:55.945477  2934 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a641b8a516264234af4db10b1a0610f0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 501fdf2af2bc4b0c971ae880e98f466b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:55.916718 10805 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:56.104308  3191 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.016s	sys 0.075s
W20260709 13:17:56.106320  3191 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.016s	sys 0.075s
W20260709 13:17:56.094519  2934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 178372us
I20260709 13:17:55.960848 10835 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:56.120044  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 417596us
I20260709 13:17:56.013489 10679 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:56.013703 10619 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:56.147634 10805 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:56.164357 10902 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:56.143713  3016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:56.173869  3198 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.030s	sys 0.088s
W20260709 13:17:56.174952  3198 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.030s	sys 0.088s
I20260709 13:17:56.121374 10478 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:17:56.195140  3799 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.032s	sys 0.072s
W20260709 13:17:56.196733  3799 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.032s	sys 0.072s
W20260709 13:17:56.201462  3042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.022s	sys 0.085s
I20260709 13:17:56.165246 10805 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:56.154964 10821 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:56.202099  3042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.022s	sys 0.085s
I20260709 13:17:56.228404  3044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 3384) took 3686 ms. Trace:
I20260709 13:17:56.230765  3044 rpcz_store.cc:276] 0709 13:17:52.542072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.712473 (+170401us) service_pool.cc:224] Handling call
0709 13:17:55.211633 (+2499160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:55.215674 (+  4041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.228146 (+1012472us) spinlock_profiling.cc:243] Waited 2.5 s on lock 0x7b540027d3d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:56.228338 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5745899392}
I20260709 13:17:56.229017  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3333) took 4700 ms. Trace:
I20260709 13:17:56.232189  3192 rpcz_store.cc:276] 0709 13:17:51.506419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.506981 (+   562us) service_pool.cc:224] Handling call
0709 13:17:51.509447 (+  2466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.932843 (+3423396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.206078 (+1273235us) spinlock_profiling.cc:243] Waited 3.42 s on lock 0x7b54000429d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:56.206324 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7871195520}
I20260709 13:17:56.088199 10916 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:56.165562 10835 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:56.251180  3044 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 24 index: 12. (term mismatch)
I20260709 13:17:56.253695  3044 pending_rounds.cc:85] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Aborting all ops after (but not including) 11
I20260709 13:17:56.248840  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1440) took 2541 ms. Trace:
I20260709 13:17:56.271541  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:56.286049  3126 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 23.
I20260709 13:17:56.287555  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:56.288465  3126 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:56.285581  3798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 1042) took 2605 ms. Trace:
I20260709 13:17:56.293793  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:56.254197  3044 pending_rounds.cc:107] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Aborting uncommitted NO_OP operation due to leader change: 25.12
I20260709 13:17:56.294616  3119 raft_consensus.cc:2410] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 24 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:17:56.294678  3044 raft_consensus.cc:2889] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:56.296125  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.291491  3798 rpcz_store.cc:276] 0709 13:17:53.679876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.680042 (+   166us) service_pool.cc:224] Handling call
0709 13:17:55.418465 (+1738423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:55.438284 (+ 19819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.285164 (+846880us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b5400660150. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:56.285496 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3985697152}
W20260709 13:17:56.297362  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 486064us
I20260709 13:17:56.272363  3125 rpcz_store.cc:276] 0709 13:17:53.692064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.693031 (+   967us) service_pool.cc:224] Handling call
0709 13:17:53.693327 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.083085 (+389758us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:17:54.342457 (+259372us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.522970 (+180513us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:54.523030 (+    60us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:54.523084 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.231621 (+1708537us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b540011c1d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:56.231834 (+   213us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.232875 (+  1041us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":490959,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":1122,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":4907,"spinlock_wait_cycles":895595776,"thread_start_us":378126,"threads_started":2,"wal-append.queue_time_us":245972,"wal-append.run_cpu_time_us":8608,"wal-append.run_wall_time_us":1273418}
I20260709 13:17:56.304134  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:56.298358  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:56.268899 10814 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:56.305032  3125 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:56.311430  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:56.255975 10456 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:56.237681 10821 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:56.291035 10663 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.319504  3125 raft_consensus.cc:2368] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21.
I20260709 13:17:56.319375  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:56.338940  3119 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:17:56.320853  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:56.339994  3121 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 24.
I20260709 13:17:56.321523  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:56.345057  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:56.348107  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 461852us
W20260709 13:17:56.320570 10906 consensus_meta.cc:287] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.793s	user 0.014s	sys 0.000s
I20260709 13:17:56.350979  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:56.321485 10971 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:56.343283 10991 log.cc:927] Time spent T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 13:17:56.355623  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:56.363541  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:56.365217  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:56.368669 10994 log.cc:927] Time spent T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:17:56.369073 10835 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:56.369195 10995 log.cc:927] Time spent T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:17:56.399664  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:56.401878  3121 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:56.402316  3125 raft_consensus.cc:2393] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 23: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:56.346771 10985 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 28 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:56.362238 10906 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:56.315877 10814 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:56.343852 10663 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:56.379528 10782 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:56.410955  3047 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:56.412001 10821 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:56.412460 10782 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:56.414484 10803 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.415089 10803 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:56.417286 10803 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:56.321152 10456 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:56.388876  3119 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 26.
I20260709 13:17:56.355713  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:56.395218  3126 raft_consensus.cc:2468] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
I20260709 13:17:56.409857  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:56.442283  3121 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:56.442018  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 86386.2us
W20260709 13:17:56.410400  3045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 3361) took 4612 ms (client timeout 1642 ms). Trace:
W20260709 13:17:56.443634  3045 rpcz_store.cc:269] 0709 13:17:51.797944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.798349 (+   405us) service_pool.cc:224] Handling call
0709 13:17:56.410145 (+4611796us) spinlock_profiling.cc:243] Waited 2.47 s on lock 0x7b540004a1d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:56.410288 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5677882752}
I20260709 13:17:56.417644  3197 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:56.386176  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3386) took 1104 ms. Trace:
I20260709 13:17:56.421881 10835 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:56.423285 10848 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:56.423782 10790 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.424226 10929 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:56.452396 10848 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:56.452942 10992 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 1.135s	user 0.004s	sys 0.015s
W20260709 13:17:56.454074  3124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55318 (request call id 1437) took 2764 ms (client timeout 1887 ms). Trace:
I20260709 13:17:56.424654 10952 consensus_queue.cc:260] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:56.424958 10814 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:56.426705 10840 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:56.428117 10735 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:56.428799  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:56.429143  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 3387) took 1129 ms. Trace:
I20260709 13:17:56.467765  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:56.431447 10821 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.431924 10533 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:56.432675  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55318 (request call id 1442) took 2740 ms. Trace:
I20260709 13:17:56.469559  3117 rpcz_store.cc:276] 0709 13:17:53.692646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.693893 (+  1247us) service_pool.cc:224] Handling call
0709 13:17:53.694259 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.811753 (+117494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.811783 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:53.811836 (+    53us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:17:53.811872 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.432420 (+2620548us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54000ba4d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:56.432472 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.432614 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269502848}
I20260709 13:17:56.435433  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:56.443928  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:56.446103  3191 rpcz_store.cc:276] 0709 13:17:55.281482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.558565 (+277083us) service_pool.cc:224] Handling call
0709 13:17:55.558922 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:55.559298 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.559339 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.559812 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.109020 (+549208us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:56.109083 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.109187 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.379211 (+270024us) spinlock_profiling.cc:243] Waited 6.65 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:56.381387 (+  2176us) raft_consensus.cc:1685] finished
0709 13:17:56.381410 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.386080 (+  4670us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":438,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":79,"spinlock_wait_cycles":15291648,"thread_start_us":548690,"threads_started":1,"wal-append.queue_time_us":730917}
I20260709 13:17:56.422855 10906 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:56.451745 10918 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:56.451843 10790 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:56.454526  3124 rpcz_store.cc:269] 0709 13:17:53.689217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.701465 (+ 12248us) service_pool.cc:224] Handling call
0709 13:17:56.453829 (+2752364us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b5400477cd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:56.453997 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914491776}
I20260709 13:17:56.457705  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:56.464425  3047 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:17:56.431924 10663 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:56.453881 10835 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:56.490607  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:56.468241  3193 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.010s	sys 0.023s
I20260709 13:17:56.468248  3200 rpcz_store.cc:276] 0709 13:17:55.299466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.305230 (+  5764us) service_pool.cc:224] Handling call
0709 13:17:56.428927 (+1123697us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b5400035f54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:56.429089 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1234701696}
I20260709 13:17:56.473045  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:56.472460  3761 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:56.458395 10803 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:56.430738  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:56.533636  3049 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
I20260709 13:17:56.535449  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:56.494727  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3385) took 1215 ms. Trace:
I20260709 13:17:56.538546  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:56.532343  3121 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:56.491261  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 1218) took 1039 ms. Trace:
I20260709 13:17:56.539516  3191 rpcz_store.cc:276] 0709 13:17:55.451799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.482077 (+1030278us) service_pool.cc:224] Handling call
0709 13:17:56.490658 (+  8581us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.490875 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.490904 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:56.490968 (+    64us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:56.491002 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.491060 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.491188 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:56.539680  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:56.473387 10916 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:56.490036 10952 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:56.544065  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:56.542829  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:56.544981  3191 pending_rounds.cc:85] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 10
I20260709 13:17:56.452940 10929 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:56.545485  3191 pending_rounds.cc:107] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:17:56.545356  3051 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 23.
I20260709 13:17:56.469432 10840 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:56.479799 10821 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:56.472458 10735 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:56.562091 10998 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:17:56.563340  3042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 3418) took 1245 ms. Trace:
I20260709 13:17:56.563787  3042 rpcz_store.cc:276] 0709 13:17:55.318438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.560409 (+241971us) service_pool.cc:224] Handling call
0709 13:17:55.560772 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:55.561401 (+   629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.561427 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.561837 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.230827 (+668990us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:56.230869 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.230936 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.563081 (+332145us) raft_consensus.cc:1685] finished
0709 13:17:56.563105 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.563269 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":668702,"threads_started":1,"wal-append.queue_time_us":886782}
I20260709 13:17:56.551788  3191 raft_consensus.cc:2889] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:56.538815  3198 rpcz_store.cc:276] 0709 13:17:55.278990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.544979 (+265989us) service_pool.cc:224] Handling call
0709 13:17:55.555684 (+ 10705us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:55.555933 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:17:56.176180 (+620247us) log.cc:844] Serialized 14 byte log entry
0709 13:17:56.493421 (+317241us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:56.493492 (+    71us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:17:56.493560 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.494475 (+   915us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.494656 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":761128,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":408,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":14041,"thread_start_us":936287,"threads_started":2}
I20260709 13:17:56.542310 10803 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:56.550179  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
W20260709 13:17:56.563333 10999 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:17:56.547904  3049 raft_consensus.cc:3060] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:17:56.481823 10918 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:56.557116 10929 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:56.560381 10821 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:56.563393 10735 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:56.560540 10790 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:56.578435 10456 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:56.604982  3196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51716 (request call id 2771) took 3436 ms. Trace:
I20260709 13:17:56.605556  3196 rpcz_store.cc:276] 0709 13:17:53.168535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.172971 (+  4436us) service_pool.cc:224] Handling call
0709 13:17:55.718263 (+2545292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:55.719381 (+  1118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.604688 (+885307us) spinlock_profiling.cc:243] Waited 2.54 s on lock 0x7b54001de050. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:56.604906 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5852532992}
W20260709 13:17:56.665956  3797 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.013s	sys 0.013s
W20260709 13:17:56.666379  3797 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.013s	sys 0.013s
I20260709 13:17:56.666428  3044 raft_consensus.cc:1275] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:17:56.575618  3193 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.012s	sys 0.029s
I20260709 13:17:56.576833  3198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 1223) took 1123 ms. Trace:
I20260709 13:17:56.579500 10918 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:56.585387 10788 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:56.589931 10915 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:56.590647 10726 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:56.592113 10981 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 1.383s	user 0.013s	sys 0.003s
I20260709 13:17:56.668457  3198 rpcz_store.cc:276] 0709 13:17:55.453597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.572924 (+1119327us) service_pool.cc:224] Handling call
0709 13:17:56.576198 (+  3274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.576541 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.576565 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:56.576603 (+    38us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:56.576636 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.576688 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.576783 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:56.668848  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3389) took 1357 ms. Trace:
I20260709 13:17:56.695791  3193 rpcz_store.cc:276] 0709 13:17:55.311861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.582615 (+270754us) service_pool.cc:224] Handling call
0709 13:17:55.583012 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:55.583493 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.583532 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.584312 (+   780us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.668518 (+1084206us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:56.668559 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.668624 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.668667 (+    43us) raft_consensus.cc:1685] finished
0709 13:17:56.668678 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.668794 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17849,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":7164,"thread_start_us":1083774,"threads_started":1,"wal-append.queue_time_us":979166}
I20260709 13:17:56.609791 10848 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:56.669626 10834 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.009s	sys 0.018s
W20260709 13:17:56.672188  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 365463us
I20260709 13:17:56.665486 10456 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:56.702828  3090 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:56.673539  3799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 1324) took 1366 ms. Trace:
I20260709 13:17:56.676489  3049 raft_consensus.cc:2468] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 26.
W20260709 13:17:56.672953  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 419643us
W20260709 13:17:56.673934  3050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 3387) took 3638 ms (client timeout 1935 ms). Trace:
W20260709 13:17:56.705210  3050 rpcz_store.cc:269] 0709 13:17:53.028749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.029515 (+   766us) service_pool.cc:224] Handling call
0709 13:17:56.665823 (+3636308us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b54000c6054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:56.667521 (+  1698us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1252592000}
I20260709 13:17:56.704294  3799 rpcz_store.cc:276] 0709 13:17:55.307638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.556630 (+248992us) service_pool.cc:224] Handling call
0709 13:17:55.556966 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:55.566917 (+  9951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.566950 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.574445 (+  7495us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.198070 (+623625us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:56.198130 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.198237 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.673226 (+474989us) raft_consensus.cc:1685] finished
0709 13:17:56.673256 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.673460 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9114,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":623106,"threads_started":1,"wal-append.queue_time_us":782488}
I20260709 13:17:56.707094  3192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3398) took 1282 ms. Trace:
W20260709 13:17:56.702909 10834 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.010s	sys 0.018s
I20260709 13:17:56.672341 10790 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:56.717020 11002 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:17:56.742379 11002 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.710006 10679 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:56.716723  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
W20260709 13:17:56.744176  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 77732.8us
W20260709 13:17:56.748353  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.751020  3015 leader_election.cc:400] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21.
I20260709 13:17:56.751358  3015 leader_election.cc:403] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:17:56.752352  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:56.753510  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:56.755385  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:56.722622 10987 log.cc:927] Time spent T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 1.514s	user 0.007s	sys 0.009s
W20260709 13:17:56.744071 10967 consensus_meta.cc:287] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.442s	user 0.006s	sys 0.007s
W20260709 13:17:56.714000  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 241598us
I20260709 13:17:56.709882  3192 rpcz_store.cc:276] 0709 13:17:55.424685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.233386 (+808701us) service_pool.cc:224] Handling call
0709 13:17:56.233822 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.234109 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:17:56.483085 (+248976us) log.cc:844] Serialized 14 byte log entry
0709 13:17:56.706754 (+223669us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:56.706805 (+    51us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:56.706873 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.706937 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.707044 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":238,"prepare.queue_time_us":139752,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":71,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":5934,"thread_start_us":471722,"threads_started":2}
I20260709 13:17:56.759171  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:56.772581 10970 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:56.742776 11002 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:56.718479 10961 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:56.712534 10456 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:56.797478  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:56.704674 10726 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:17:56.745678 10679 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.804643 10726 consensus_queue.cc:1243] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer 501fdf2af2bc4b0c971ae880e98f466b log is divergent from this leader: its last log entry 22.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:17:56.804795 10679 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:56.722071 10835 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:56.800482  3761 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:56.746763 11009 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:56.748436 10929 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:56.756620 10848 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:17:56.801540  3762 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:56.828253 10929 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:56.834270 10971 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.834877 10971 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:56.834510 10929 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:56.838167 10971 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:56.760427 10909 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:56.847388  3797 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43926 (request call id 1325) took 1532 ms. Trace:
I20260709 13:17:56.847587  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:56.740037 10790 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:56.756543 10821 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619) with higher term. Message: Invalid argument: T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21.
W20260709 13:17:56.827042 11006 log.cc:927] Time spent T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:17:56.828186 11009 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:56.756407 11014 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.810768  3761 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:56.868201  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 57506.5us
I20260709 13:17:56.869019  3761 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:56.844436  3195 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.010s	sys 0.019s
W20260709 13:17:56.846467  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 69881.1us
I20260709 13:17:56.778789 10840 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:56.870476  3015 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:56.842082 10979 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.760715 10748 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:56.911788  3197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3397) took 1497 ms. Trace:
I20260709 13:17:56.912201  3197 rpcz_store.cc:276] 0709 13:17:55.414623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.904490 (+489867us) service_pool.cc:224] Handling call
0709 13:17:56.015427 (+110937us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.445603 (+430176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.911486 (+465883us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b54002bc5d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:56.911726 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":924432768}
I20260709 13:17:56.853171 10897 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:56.853186 10970 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:56.913964 10897 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.914194 10970 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.914496 10897 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:56.914723 10970 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:56.802582 11013 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.847882  3797 rpcz_store.cc:276] 0709 13:17:55.314839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.010398 (+695559us) service_pool.cc:224] Handling call
0709 13:17:56.010836 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.011095 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:17:56.011439 (+   344us) log.cc:844] Serialized 14 byte log entry
0709 13:17:56.842613 (+831174us) log.cc:844] Serialized 14 byte log entry
0709 13:17:56.847046 (+  4433us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:56.847095 (+    49us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:56.847145 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.847216 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.847335 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4184,"prepare.queue_time_us":1426,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":49,"raft.queue_time_us":51255,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"spinlock_wait_cycles":21211520,"thread_start_us":830522,"threads_started":2,"wal-append.queue_time_us":702100}
I20260709 13:17:56.917937 11013 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:56.920492 11013 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:56.909525 10950 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:56.870800  3195 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.010s	sys 0.019s
W20260709 13:17:56.847877  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 46382.6us
I20260709 13:17:56.927814 11013 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:56.931815 10929 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:56.848788 10834 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:17:56.876071  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:56.933578 10939 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:56.877574 10903 raft_consensus.cc:2804] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:56.935441  3792 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43908 (request call id 1045) took 3254 ms. Trace:
I20260709 13:17:56.879963 11014 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:56.935925 10834 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:56.936538 10834 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:56.846741 10716 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:56.880546  3047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35726 (request call id 3401) took 2699 ms. Trace:
I20260709 13:17:56.938005  3047 rpcz_store.cc:276] 0709 13:17:54.181538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.181883 (+   345us) service_pool.cc:224] Handling call
0709 13:17:56.410829 (+2228946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.536682 (+125853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.880341 (+343659us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b540004a1d0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:56.880486 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5125121920}
I20260709 13:17:56.882099 10456 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:56.847450 10478 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:56.939114  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:56.864080 10803 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:56.935495 10939 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:56.941027 10726 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:56.941253 10939 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:56.941622 10726 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:56.942461  3051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:56.942829  9926 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:56.943143  3051 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:56.882841 11021 raft_consensus.cc:2804] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:17:56.940285  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:56.882905 10979 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:56.886046  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:56.887266  3123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54688 (request call id 3230) took 2054 ms (client timeout 2236 ms). Trace:
I20260709 13:17:56.890337  3164 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:56.890529  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:56.890974 10874 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:56.891607  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:56.964552  3050 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:17:56.965444  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:56.966270  3050 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:56.967067  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 29 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:56.967746  3050 raft_consensus.cc:2410] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 29 because replica has last-logged OpId of term: 28 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 13.
I20260709 13:17:56.891816 10836 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:56.892345 10790 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:56.893950 10990 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 1.575s	user 0.006s	sys 0.021s
I20260709 13:17:56.894881  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3714) took 1574 ms. Trace:
I20260709 13:17:56.894959  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:56.896760  3200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 1220) took 1444 ms. Trace:
W20260709 13:17:56.899403  3046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35726 (request call id 3413) took 1632 ms (client timeout 1947 ms). Trace:
W20260709 13:17:56.977236  3091 connection.cc:256] RPC call timeout handler was delayed by -1.4686287560000437s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
W20260709 13:17:56.977483  3046 rpcz_store.cc:269] 0709 13:17:55.267350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.267465 (+   115us) service_pool.cc:224] Handling call
0709 13:17:56.899189 (+1631724us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b54003c4bd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:56.899321 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59546880}
W20260709 13:17:56.978150  3091 connection.cc:256] RPC call timeout handler was delayed by -1.4371572009999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
I20260709 13:17:56.800101 10967 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:56.903563  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:56.904309  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:56.905211  3124 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:56.986866  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:56.935849  3792 rpcz_store.cc:276] 0709 13:17:53.680929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.500320 (+819391us) service_pool.cc:224] Handling call
0709 13:17:54.505200 (+  4880us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:54.505696 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:17:54.991200 (+485504us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b18004948c0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c3455 00007ff833dab3c7 00007ff8303bd9a7 00007ff8303cd0bf 00007ff8303cd038
0709 13:17:55.313280 (+322080us) log.cc:844] Serialized 14 byte log entry
0709 13:17:55.721042 (+407762us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:56.932810 (+1211768us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b2c00047618. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82ecaca11 00007ff82ecbc372 00007ff8303eea01 00007ff8303b343a 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:17:56.933194 (+   384us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.933359 (+   165us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:17:56.933394 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.933476 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.935244 (+  1768us) raft_consensus.cc:1685] finished
0709 13:17:56.935266 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.935385 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6139,"prepare.queue_time_us":33968,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":7236,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":170674,"spinlock_wait_cycles":15946368,"thread_start_us":676255,"threads_started":2,"wal-append.queue_time_us":932626}
I20260709 13:17:56.943349  9926 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:56.884557 10883 consensus_meta.cc:287] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.348s	user 0.013s	sys 0.000s
I20260709 13:17:57.000344  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:56.944599  3047 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:17:56.950388  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:57.002782  3121 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
W20260709 13:17:56.952039  3123 rpcz_store.cc:269] 0709 13:17:54.832752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.983431 (+150679us) service_pool.cc:224] Handling call
0709 13:17:56.887094 (+1903663us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b54001c39d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:56.887206 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24734464}
I20260709 13:17:56.955232  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:57.003448  3051 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:17:56.955914  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:56.957827  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:56.958474  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:56.959206  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 1221) took 1506 ms. Trace:
W20260709 13:17:56.963476  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 73211.1us
I20260709 13:17:57.004776  3191 rpcz_store.cc:276] 0709 13:17:55.452839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.543034 (+1090195us) service_pool.cc:224] Handling call
0709 13:17:56.544748 (+  1714us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:56.573338 (+ 28590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.573386 (+    48us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:56.574262 (+   876us) log.cc:844] Serialized 78 byte log entry
0709 13:17:56.762921 (+188659us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:56.862767 (+ 99846us) log.cc:844] Serialized 14 byte log entry
0709 13:17:56.906426 (+ 43659us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b1800478420. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c6522 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:17:56.919378 (+ 12952us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b1800478420. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2c63f3 00007ff82d2c87c1 00007ff82d2c8779 00007ff82d2c8709 00007ff82d2c86d1 00007ff82d2c79cd 000000000038f354 000000000038f199 00007ff82d2a983a
0709 13:17:56.954493 (+ 35115us) log.cc:844] Serialized 14 byte log entry
0709 13:17:56.954801 (+   308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.954878 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.954919 (+    41us) raft_consensus.cc:1685] finished
0709 13:17:56.958873 (+  3954us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.959153 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79269,"prepare.queue_time_us":139842,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":11011,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":12873,"spinlock_wait_cycles":14058624,"thread_start_us":69064,"threads_started":1,"wal-append.queue_time_us":329863}
I20260709 13:17:56.969483  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:57.005405  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:57.007136  3050 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:57.007275  3196 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 24.
I20260709 13:17:57.008085  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:57.008658  3050 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:56.970801  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:57.012336  3119 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 25.
I20260709 13:17:56.971794  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:56.972549  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:56.971688  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:56.889961 11009 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:56.900151  3042 raft_consensus.cc:1240] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16. Ops: []
W20260709 13:17:56.978794  3091 connection.cc:256] RPC call timeout handler was delayed by -1.3638893219999773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23199999999999998s for a response
W20260709 13:17:57.018853  3091 connection.cc:256] RPC call timeout handler was delayed by -1.2633689270001014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
W20260709 13:17:57.019358  3091 connection.cc:256] RPC call timeout handler was delayed by -1.1852880859999004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
I20260709 13:17:56.975756  3048 rpcz_store.cc:276] 0709 13:17:55.320537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.960114 (+639577us) service_pool.cc:224] Handling call
0709 13:17:55.960572 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:55.963916 (+  3344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.964153 (+   237us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.965339 (+  1186us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.474343 (+509004us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:56.474414 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.474515 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.894656 (+420141us) raft_consensus.cc:1685] finished
0709 13:17:56.894681 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.894824 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":169,"raft.queue_time_us":1417,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":37373,"thread_start_us":319911,"threads_started":1,"wal-append.queue_time_us":595262}
I20260709 13:17:56.976280  3200 rpcz_store.cc:276] 0709 13:17:55.452468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.542653 (+1090185us) service_pool.cc:224] Handling call
0709 13:17:56.561227 (+ 18574us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:56.573192 (+ 11965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.573223 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:56.576951 (+  3728us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.751090 (+174139us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:17:56.814942 (+ 63852us) log.cc:844] Serialized 14 byte log entry
0709 13:17:56.826265 (+ 11323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.826348 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.896552 (+ 70204us) raft_consensus.cc:1685] finished
0709 13:17:56.896571 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.896695 (+   124us) inbound_call.cc:177] Queueing success response
0709 13:17:56.904204 (+  7509us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b48001b0258. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff8352dcaa1 00007ff8352d3b37 00007ff8352d39ca 00007ff8353cb26f 00007ff8353caf37 00007ff8353df55c 00007ff8353df508 00007ff8353df488 00007ff8353df443 00007ff8353de6ec 00007ff834308a96
Metrics: {"prepare.queue_time_us":112375,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":2525,"raft.run_cpu_time_us":2311,"raft.run_wall_time_us":337127,"spinlock_wait_cycles":4027136,"thread_start_us":156736,"threads_started":1,"wal-append.queue_time_us":314404}
I20260709 13:17:56.983174  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:56.984519  3197 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:57.021698  3122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54688 (request call id 3231) took 2188 ms. Trace:
I20260709 13:17:57.020062  3091 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:57.022258  3122 rpcz_store.cc:276] 0709 13:17:54.832925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.074480 (+241555us) service_pool.cc:224] Handling call
0709 13:17:55.093128 (+ 18648us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:55.107364 (+ 14236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.107397 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.107909 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 13:17:55.204462 (+ 96553us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:55.204502 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.619618 (+1415116us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b54003e7954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:56.619694 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.721878 (+102184us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:57.021425 (+299547us) raft_consensus.cc:1685] finished
0709 13:17:57.021456 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:57.021623 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":887,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"spinlock_wait_cycles":41942656,"thread_start_us":29895,"threads_started":1,"wal-append.queue_time_us":100174}
I20260709 13:17:57.024086  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:57.024722  3123 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
I20260709 13:17:57.027671  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:57.029605  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:57.030529  3047 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:57.025909  3091 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:57.031901  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:57.032516  3046 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 25.
I20260709 13:17:57.028573  3120 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:56.993856 10836 raft_consensus.cc:697] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:56.990458  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:56.991173  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:56.994078  3793 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 1053) took 1762 ms (client timeout 1899 ms). Trace:
I20260709 13:17:56.994725  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:56.995651  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:17:56.996714 11016 log.cc:927] Time spent T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.280s	user 0.001s	sys 0.001s
I20260709 13:17:56.975478 10950 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:56.975693 10903 raft_consensus.cc:697] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:56.985077 10663 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:56.999642  3797 raft_consensus.cc:1240] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:57.009456  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:57.016994  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:56.982708 11021 raft_consensus.cc:697] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 26 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:57.048727  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:57.049563  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:56.991748 10803 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:57.036567  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:57.054906  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:57.089216  3121 raft_consensus.cc:2393] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 26: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:57.019981 10431 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:17:56.988986  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:57.055102  3793 rpcz_store.cc:269] 0709 13:17:55.232212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.894730 (+1662518us) service_pool.cc:224] Handling call
0709 13:17:56.994031 (+ 99301us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:57.065999  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:57.070654  3124 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
I20260709 13:17:57.072716  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:57.074932  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:57.017365 10883 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:57.078023  3194 raft_consensus.cc:2393] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 21: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:57.019819 10962 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.094099  3122 raft_consensus.cc:2468] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:57.079960  3050 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:17:57.098711  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:56.973045 10874 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:57.019605 10627 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:57.084406  3193 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:57.000180 10916 consensus_queue.cc:1059] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.086s
I20260709 13:17:57.084275  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:57.084909  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:57.085135  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:17:57.087143  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 70225.7us
I20260709 13:17:57.109037  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:57.109841  3125 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:57.108918  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:57.111193  3790 raft_consensus.cc:2468] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:57.059883  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e"
I20260709 13:17:57.112505  3044 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:57.031860 10814 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:57.088811  3164 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:17:57.091471  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:57.091471  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:57.080688 11014 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:57.093858  3192 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:17:57.094244  3165 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:57.100155  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:57.100886  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:57.081912 10950 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:57.146005  3200 raft_consensus.cc:2410] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:17:57.093485  3123 raft_consensus.cc:2468] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:57.193790  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:57.195043  3121 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:17:57.155483  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 66734us
I20260709 13:17:57.193168  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:57.197813  3194 raft_consensus.cc:2393] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 23: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:57.119658  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:57.024535 10985 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:17:57.036401 10886 consensus_queue.cc:1048] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:17:57.033952 10970 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:57.094990 10782 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:57.099083 10533 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:57.200817  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 106676us
I20260709 13:17:57.202534  3195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 3396) took 1795 ms. Trace:
I20260709 13:17:57.272328  3195 rpcz_store.cc:276] 0709 13:17:55.407054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.929344 (+522290us) service_pool.cc:224] Handling call
0709 13:17:55.930214 (+   870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:55.930513 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:17:56.925958 (+995445us) log.cc:844] Serialized 14 byte log entry
0709 13:17:57.201599 (+275641us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:57.201668 (+    69us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:57.201728 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.202312 (+   584us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:57.202464 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1841,"prepare.queue_time_us":418103,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":5940,"thread_start_us":1149143,"threads_started":2}
I20260709 13:17:57.204864  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:57.208949  3048 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:57.092851 10849 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:57.113377 10888 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:17:57.099459 10960 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:57.102974 10929 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:57.205650  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 89428.7us
I20260709 13:17:57.278736  3121 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:17:57.232928  3044 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:17:57.279910  3048 raft_consensus.cc:1275] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:17:57.147897 11013 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:17:57.153236 11016 log.cc:927] Time spent T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:57.090167 10663 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:57.271895  3165 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:57.257658  3050 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 28.
W20260709 13:17:57.319500  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 47670.6us
I20260709 13:17:57.101963 10431 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:57.317246  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:57.317600  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:57.092340 10679 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:57.322665  3121 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:57.322873  3043 raft_consensus.cc:1240] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:57.200039 10950 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:57.201170 10952 raft_consensus.cc:2804] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:57.237391 10726 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:57.324277  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:57.091094 10803 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:57.206435 10972 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:57.235317 10783 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:57.328649  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 302824us
W20260709 13:17:57.316148  3015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.281718 10782 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:57.282968 10716 raft_consensus.cc:3055] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:57.341419  3195 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 26.
I20260709 13:17:57.324854 11013 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:57.114219 10962 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:57.353902  3091 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:57.371562  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "aaf88538197a49adb8bcf3790309a67e" is_pre_election: true
I20260709 13:17:57.373219  3049 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:57.353108  3118 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 25.
I20260709 13:17:57.269105 10907 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.076s
I20260709 13:17:57.113095 10918 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:57.143867 10627 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:57.344498  3121 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:57.406770  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:57.407827  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:57.408099  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:57.140966 10897 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:57.332954 10969 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:57.387452  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:57.360303 10782 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:57.285233 10533 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:57.323120 10960 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:57.371374 11013 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:57.329016 10836 consensus_queue.cc:237] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:57.359876 10716 raft_consensus.cc:740] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:57.423837  3121 raft_consensus.cc:2393] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 20: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:17:57.425238  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 49641.7us
I20260709 13:17:57.432456  3797 raft_consensus.cc:2468] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:17:57.422560  3796 raft_consensus.cc:2393] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 20: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:17:57.429601  3090 leader_election.cc:336] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Timed out: RequestConsensusVote RPC to 127.1.227.132:43109 timed out after 2.176s (SENT)
I20260709 13:17:57.441864  3090 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:57.449990  3795 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 24: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:57.334327 10903 consensus_queue.cc:237] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:57.452435  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:57.360249 10783 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:57.457227  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:57.418713 10431 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:57.460287  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:57.460042  3191 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:17:57.460618  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:57.423008 10969 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:17:57.468837  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 81440.1us
I20260709 13:17:57.340065 11021 consensus_queue.cc:237] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:57.468847  3193 raft_consensus.cc:2468] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
I20260709 13:17:57.474622  3124 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:17:57.476100  3120 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 22. Current term is 23. Ops: []
I20260709 13:17:57.450970 10734 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:57.463550  2943 catalog_manager.cc:5697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 5 to 11, VOTER 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) evicted. New cstate: current_term: 19 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:57.407006 10849 consensus_queue.cc:1059] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 13:17:57.469784  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:57.482193  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:57.472333 11026 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.387s	user 0.001s	sys 0.000s
I20260709 13:17:57.462484 10979 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:57.485128  3198 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 28.
I20260709 13:17:57.472976 10969 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
I20260709 13:17:57.510563  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:17:57.511667  1934 tablet_server.cc:179] TabletServer@127.1.227.129:0 shutting down...
I20260709 13:17:57.512462  2943 catalog_manager.cc:5697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 14 to 15, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 15 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:57.525348 10874 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:57.482937 11048 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:57.530962 10533 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:57.530687 11048 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:57.501453 11030 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.392s	user 0.001s	sys 0.000s
W20260709 13:17:57.490039 11027 log.cc:927] Time spent T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.386s	user 0.000s	sys 0.001s
W20260709 13:17:57.532431  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 103415us
W20260709 13:17:57.540699  9926 consensus_meta.cc:287] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.002s
I20260709 13:17:57.503816  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:57.480365 10456 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:17:57.548633  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 44951.6us
I20260709 13:17:57.548801  9926 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:57.549594  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:57.532778 10748 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:57.557991 10748 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:57.558382 10748 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:57.562319 10962 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:57.563511 10627 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:57.564240 10627 consensus_queue.cc:1059] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:57.564646 10663 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:57.566918 10918 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:57.567840  2943 catalog_manager.cc:5697] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 18 to 20, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 20 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:57.483186 10734 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.569705  2943 catalog_manager.cc:5697] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 15 to 23. New cstate: current_term: 23 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:57.572729  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:57.576432  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:57.577605  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:57.610908  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:57.573294  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 100874us
W20260709 13:17:57.572580 11002 consensus_meta.cc:287] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.751s	user 0.006s	sys 0.002s
I20260709 13:17:57.611930  9926 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:57.611003  2943 catalog_manager.cc:5697] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 15 to 20, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 20 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:57.615963  2943 catalog_manager.cc:5697] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:57.570493 11011 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:17:57.620131  3794 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.000s	sys 0.037s
W20260709 13:17:57.622241  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 202582us
W20260709 13:17:57.623364  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 301834us
W20260709 13:17:57.624532  3794 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.000s	sys 0.038s
I20260709 13:17:57.573825 10849 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:17:57.571411 10456 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:57.576747 10734 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:17:57.614540 11034 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:17:57.575594 10790 raft_consensus.cc:2764] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:17:57.575832 10918 raft_consensus.cc:3055] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:17:57.611657 11036 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:17:57.633379  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:57.615283 10874 raft_consensus.cc:2804] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:57.625802 10478 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:57.625834 11043 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:57.611956 10888 raft_consensus.cc:2804] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:57.645591  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:57.610649 10619 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:17:57.617626 11039 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
W20260709 13:17:57.617460 11033 log.cc:927] Time spent T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.252s	user 0.000s	sys 0.002s
I20260709 13:17:57.635946  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:57.643203  9926 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:57.618245 10970 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:57.659828  3165 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:57.626973 10679 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:57.647089 10918 raft_consensus.cc:740] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:57.632988 10456 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:17:57.687844  3761 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:57.632261 10849 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.708768  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:57.622836 11002 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:57.712001  9926 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:57.662361 10619 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:57.656087 10874 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:57.654524 10888 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:17:57.712215  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 52548.2us
I20260709 13:17:57.662863 10366 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:57.682883 10985 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:57.730386  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:57.711644 10849 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:17:57.782685  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 94942.9us
I20260709 13:17:57.782979  3793 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 24. Current term is 25. Ops: []
I20260709 13:17:57.702407 11037 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:17:57.663157 10726 consensus_queue.cc:1048] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.067s
I20260709 13:17:57.659336 10478 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:57.657840 11009 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.069s
W20260709 13:17:57.787333 10939 consensus_meta.cc:287] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.845s	user 0.008s	sys 0.009s
I20260709 13:17:57.732407 10874 raft_consensus.cc:3060] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:57.787607 10627 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:57.730166 10619 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:57.729475 10783 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:57.728344 10979 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.791105 10888 raft_consensus.cc:3060] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:57.790241 10960 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:17:57.799145 11055 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:17:57.814440 11050 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:17:57.788007 10985 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:57.804734 10939 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:57.798184 10918 consensus_queue.cc:260] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:57.820639 10979 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } attrs { replace: true } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:57.823850 10918 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:57.826275 11002 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:57.827535 11041 log.cc:927] Time spent T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.317s	user 0.002s	sys 0.002s
W20260709 13:17:57.832635 11049 log.cc:927] Time spent T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 13:17:57.863554 10944 raft_consensus.cc:3055] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:57.864218 10944 raft_consensus.cc:740] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:17:57.868368 11030 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.336s	user 0.002s	sys 0.000s
I20260709 13:17:57.888756 10967 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:57.906877 11035 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.477s	user 0.000s	sys 0.002s
W20260709 13:17:57.927136 11061 log.cc:927] Time spent T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:17:57.926222 10897 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:57.865412 10944 consensus_queue.cc:260] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:57.956576 10944 raft_consensus.cc:3060] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:58.063107  2943 catalog_manager.cc:5697] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 14 to 19. New cstate: current_term: 19 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:58.080084  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:58.088478  3048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 1635) took 1154 ms. Trace:
I20260709 13:17:58.089195  3048 rpcz_store.cc:276] 0709 13:17:56.933868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.325729 (+391861us) service_pool.cc:224] Handling call
0709 13:17:57.327603 (+  1874us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:57.329815 (+  2212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.329862 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:57.330760 (+   898us) log.cc:844] Serialized 26 byte log entry
0709 13:17:57.656021 (+325261us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:57.656061 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.656142 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.087711 (+431569us) raft_consensus.cc:1685] finished
0709 13:17:58.087791 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.088214 (+   423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8064,"thread_start_us":269105,"threads_started":1,"wal-append.queue_time_us":427705}
W20260709 13:17:58.154047  3091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.020s	sys 0.008s
W20260709 13:17:58.154778  3091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.020s	sys 0.008s
I20260709 13:17:58.156068  3165 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:17:58.156738  3119 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.011s	sys 0.018s
W20260709 13:17:58.157363  3119 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.011s	sys 0.018s
I20260709 13:17:58.159512  3165 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:58.160099  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2899) took 1793 ms. Trace:
I20260709 13:17:58.160533  3126 rpcz_store.cc:276] 0709 13:17:56.366260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.445464 (+ 79204us) service_pool.cc:224] Handling call
0709 13:17:56.445869 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:56.446278 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:17:56.724359 (+278081us) log.cc:844] Serialized 14 byte log entry
0709 13:17:56.776863 (+ 52504us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:56.798556 (+ 21693us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.798700 (+   144us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:56.798735 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.798803 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:57.868009 (+1069206us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b24001095c8. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d14c9c4 00007ff82d14aacb 00007ff82d305dc9 00007ff82d305a55 00007ff82d30509d 00007ff82ff3710e 00007ff82ff4e88c 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221
0709 13:17:58.159335 (+291326us) raft_consensus.cc:1685] finished
0709 13:17:58.159503 (+   168us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.159809 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6067,"prepare.queue_time_us":273278,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":22381,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":11395,"spinlock_wait_cycles":24936320,"thread_start_us":309984,"threads_started":2,"wal-append.queue_time_us":294535}
I20260709 13:17:58.163190  3123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2920) took 1130 ms. Trace:
I20260709 13:17:58.161216  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:58.169421  3125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2908) took 1202 ms. Trace:
I20260709 13:17:58.170019  3125 rpcz_store.cc:276] 0709 13:17:56.967153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.075929 (+108776us) service_pool.cc:224] Handling call
0709 13:17:57.076379 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.110327 (+ 33948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.168769 (+1058442us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b5400085554. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:58.169158 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75797760}
I20260709 13:17:58.172138  3118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54692 (request call id 2902) took 1268 ms. Trace:
I20260709 13:17:58.172761  3118 rpcz_store.cc:276] 0709 13:17:56.903066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.903290 (+   224us) service_pool.cc:224] Handling call
0709 13:17:58.171598 (+1268308us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b540045a1d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:58.171875 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":846093056}
I20260709 13:17:58.197640  3191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2803) took 1108 ms. Trace:
I20260709 13:17:58.198340  3191 rpcz_store.cc:276] 0709 13:17:57.089382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.089507 (+   125us) service_pool.cc:224] Handling call
0709 13:17:58.197037 (+1107530us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b5400177354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:58.197378 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":721205376}
I20260709 13:17:58.201792  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:58.201860  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51716 (request call id 2807) took 1055 ms. Trace:
I20260709 13:17:58.205323  3193 rpcz_store.cc:276] 0709 13:17:57.146694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.146878 (+   184us) service_pool.cc:224] Handling call
0709 13:17:58.201377 (+1054499us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b5400037354. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:58.201645 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":447184640}
W20260709 13:17:58.215148  3762 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.030s	sys 0.022s
W20260709 13:17:58.215752  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 429313us
W20260709 13:17:58.215775  3762 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.031s	sys 0.023s
W20260709 13:17:58.218585  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 582927us
I20260709 13:17:58.231927  3795 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43926 (request call id 1330) took 1197 ms. Trace:
I20260709 13:17:58.232611  3795 rpcz_store.cc:276] 0709 13:17:57.034173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.074618 (+ 40445us) service_pool.cc:224] Handling call
0709 13:17:58.231251 (+1156633us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54009aae54. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:58.231662 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":816783232}
I20260709 13:17:58.235280  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:58.235585  3793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 935) took 1163 ms. Trace:
I20260709 13:17:58.236202  3793 rpcz_store.cc:276] 0709 13:17:57.071843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.110568 (+ 38725us) service_pool.cc:224] Handling call
0709 13:17:57.192757 (+ 82189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.789844 (+597087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.234893 (+445049us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b54004be954. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:58.235340 (+   447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1356822400}
I20260709 13:17:58.238567  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:58.239363  3797 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 937) took 1160 ms (client timeout 1513 ms). Trace:
W20260709 13:17:58.239950  3797 rpcz_store.cc:269] 0709 13:17:57.079281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.080305 (+  1024us) service_pool.cc:224] Handling call
0709 13:17:58.238887 (+1158582us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b5400653454. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:58.239133 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529664896}
I20260709 13:17:58.241901  3796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 939) took 1142 ms. Trace:
I20260709 13:17:58.242506  3796 rpcz_store.cc:276] 0709 13:17:57.099363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.108385 (+  9022us) service_pool.cc:224] Handling call
0709 13:17:58.241310 (+1132925us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400660154. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:58.241640 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":523819776}
I20260709 13:17:57.791112  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:57.798290  9926 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:58.237224  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:58.288745 10823 raft_consensus.cc:2804] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:58.240466  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:57.784798 10366 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:58.291186  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:58.291627 11057 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:58.292214 11057 raft_consensus.cc:697] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
W20260709 13:17:58.276611 10903 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.011s	sys 0.010s
I20260709 13:17:58.232829  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:17:58.278249 10952 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.011s	sys 0.010s
I20260709 13:17:58.285933 10783 consensus_queue.cc:1048] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:58.288924  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:58.286053 10970 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:17:58.068365  2943 catalog_manager.cc:5697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:58.163957  3123 rpcz_store.cc:276] 0709 13:17:57.032157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.268659 (+236502us) service_pool.cc:224] Handling call
0709 13:17:57.268950 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.321908 (+ 52958us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:17:57.352643 (+ 30735us) log.cc:844] Serialized 14 byte log entry
0709 13:17:57.645863 (+293220us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:57.645917 (+    54us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:17:57.645966 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.162342 (+516376us) spinlock_profiling.cc:243] Waited 52.7 ms on lock 0x7b5400319054. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:58.162456 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.162888 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27493,"prepare.queue_time_us":11132,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":28747,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":40277,"spinlock_wait_cycles":121256192,"thread_start_us":298666,"threads_started":2,"wal-append.queue_time_us":461252}
W20260709 13:17:58.280328  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 200789us
W20260709 13:17:58.300097 10903 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.011s	sys 0.010s
W20260709 13:17:58.304996 10952 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.012s	sys 0.010s
I20260709 13:17:58.307015  3799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43922 (request call id 941) took 1113 ms. Trace:
I20260709 13:17:58.307484  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:58.305521 10952 raft_consensus.cc:697] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:58.293352 10366 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:58.307530  3799 rpcz_store.cc:276] 0709 13:17:57.192417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.790811 (+598394us) service_pool.cc:224] Handling call
0709 13:17:58.305704 (+514893us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:58.293505 10951 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:17:58.292883 10979 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:58.327708  2943 catalog_manager.cc:5697] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 20 to 23, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 23 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:58.328730 10939 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:58.336526 10823 raft_consensus.cc:697] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:58.342677 10823 consensus_queue.cc:237] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:58.325371 10627 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:58.359826  3798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 931) took 1337 ms. Trace:
I20260709 13:17:58.360883 10533 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:58.361819 10533 raft_consensus.cc:697] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:58.363226 10533 consensus_queue.cc:237] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:58.364331 10952 consensus_queue.cc:237] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:58.355732  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:58.375881 11048 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:58.299948 11057 consensus_queue.cc:237] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:58.298121 10897 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.073s
W20260709 13:17:58.382443  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 55819.8us
I20260709 13:17:58.371016 10951 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 28 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:58.318447 10651 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:17:58.388145  3796 raft_consensus.cc:1240] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:58.390133  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:58.391734 10963 consensus_queue.cc:1059] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
W20260709 13:17:58.413973  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 1.06004e+06us
I20260709 13:17:58.360437  3798 rpcz_store.cc:276] 0709 13:17:56.981713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.981951 (+   238us) service_pool.cc:224] Handling call
0709 13:17:56.996350 (+ 14399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:57.269517 (+273167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.269545 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:57.285907 (+ 16362us) log.cc:844] Serialized 26 byte log entry
0709 13:17:57.426424 (+140517us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:57.426509 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.426575 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:57.831839 (+405264us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:17:58.299837 (+467998us) raft_consensus.cc:1685] finished
0709 13:17:58.299891 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.313373 (+ 13482us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17430,"raft.queue_time_us":77793,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":8509,"spinlock_wait_cycles":310921984,"thread_start_us":395349,"threads_started":2,"wal-append.queue_time_us":194648}
I20260709 13:17:58.384078 11037 consensus_queue.cc:1059] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.102s
I20260709 13:17:58.438434  3191 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:58.443406  3797 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 942) took 1158 ms. Trace:
I20260709 13:17:58.401362 10790 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:58.476451  3119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2921) took 1430 ms. Trace:
I20260709 13:17:58.462838  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:58.476845 10790 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:58.472579  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:58.479266  3198 raft_consensus.cc:2410] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 13:17:58.401532 10960 consensus_queue.cc:1059] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.133s
I20260709 13:17:58.479911 10790 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:58.480644 10960 raft_consensus.cc:3055] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:58.481125 10960 raft_consensus.cc:740] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:58.474150  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:58.482462  3792 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 24: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:58.479187 10951 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:58.487319 10960 consensus_queue.cc:260] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:58.489108 10960 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:58.460600  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:58.399369  2943 catalog_manager.cc:5697] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:17:58.459005  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.503275  3191 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:58.454134  3797 rpcz_store.cc:276] 0709 13:17:57.280996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.241215 (+960219us) service_pool.cc:224] Handling call
0709 13:17:58.241878 (+   663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:58.242673 (+   795us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:17:58.243341 (+   668us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.372166 (+128825us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.414675 (+ 42509us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.431074 (+ 16399us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.438397 (+  7323us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:58.438466 (+    69us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:58.438529 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.438614 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.438777 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6978,"prepare.queue_time_us":27622,"prepare.run_cpu_time_us":207,"prepare.run_wall_time_us":2608,"raft.queue_time_us":20605,"spinlock_wait_cycles":11211008,"thread_start_us":105782,"threads_started":1}
I20260709 13:17:58.477073  3119 rpcz_store.cc:276] 0709 13:17:57.046205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.270653 (+224448us) service_pool.cc:224] Handling call
0709 13:17:57.322200 (+ 51547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.322437 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:17:58.158282 (+835845us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.458018 (+299736us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.475051 (+ 17033us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.475564 (+   513us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.475822 (+   258us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:58.475909 (+    87us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:58.475998 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.476151 (+   153us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.476392 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60050,"prepare.queue_time_us":50413,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":62827,"raft.run_cpu_time_us":591,"raft.run_wall_time_us":3342,"thread_start_us":1058701,"threads_started":3,"wal-append.queue_time_us":307381}
I20260709 13:17:58.418232 10627 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:58.532388  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 73069us
I20260709 13:17:58.543725  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:58.561054  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 227031us
W20260709 13:17:58.562629  3164 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 2.232s (SENT) [suppressed 28 similar messages]
W20260709 13:17:58.565353 10836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.984s	user 0.008s	sys 0.019s
W20260709 13:17:58.565922 10836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.009s	sys 0.019s
I20260709 13:17:58.566246  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:58.569355  3792 raft_consensus.cc:1240] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 22. Current term is 23. Ops: []
W20260709 13:17:58.576025 11075 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.099s	user 0.003s	sys 0.000s
I20260709 13:17:58.542412 10790 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:58.548381 10903 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:58.561390  3198 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 25.
W20260709 13:17:58.583469 10874 consensus_meta.cc:287] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.775s	user 0.015s	sys 0.000s
I20260709 13:17:58.566476  3091 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:58.591378  3798 raft_consensus.cc:1240] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:58.566040  2943 catalog_manager.cc:5697] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 18 to 19, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 19 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:58.590626  3195 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 19.
W20260709 13:17:58.604775  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 169438us
W20260709 13:17:58.611125 10969 consensus_meta.cc:287] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.039s	user 0.017s	sys 0.003s
I20260709 13:17:58.585659 10965 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:58.611785 10969 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:58.612205 10965 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:58.615432 10985 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:58.616304 10903 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:58.583850 10716 consensus_queue.cc:260] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:58.618769 10950 consensus_meta.cc:287] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.265s	user 0.006s	sys 0.015s
I20260709 13:17:58.618858 10716 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:58.619283 10903 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:58.619431 10950 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:58.623457  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:58.624857  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.626462 10478 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:58.626941 10790 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:58.625535  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:58.632778 10888 consensus_meta.cc:287] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.812s	user 0.011s	sys 0.006s
I20260709 13:17:58.632653  2943 catalog_manager.cc:5697] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 13 to 15, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 15 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:58.637161  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:58.627935  3796 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 943) took 1294 ms. Trace:
I20260709 13:17:58.642227  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:58.643973  3796 rpcz_store.cc:276] 0709 13:17:57.333558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.243713 (+910155us) service_pool.cc:224] Handling call
0709 13:17:58.305958 (+ 62245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:58.398348 (+ 92390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.626961 (+228613us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b5400541da0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff83032adc0 00007ff8303b6a02 00007ff8303b2dd6 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2
0709 13:17:58.627650 (+   689us) spinlock_profiling.cc:243] Waited 48.1 ms on lock 0x7b54005415d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b3e01 00007ff8303b283e 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:17:58.627843 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254752896}
I20260709 13:17:58.646955 10431 raft_consensus.cc:2764] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
W20260709 13:17:58.650398  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 144073us
I20260709 13:17:58.651459 11076 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:17:58.652071 11076 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:58.652551 11076 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:17:58.654608  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:58.655633  3118 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:58.657963  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:58.658843  3125 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:58.629873 11081 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:17:58.651902  3091 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:58.633520 10803 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:58.700402  3198 raft_consensus.cc:2368] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22.
W20260709 13:17:58.700984  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.701088  3797 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 23. Current term is 24. Ops: []
W20260709 13:17:58.701229 11075 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:58.705471  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:58.705634  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:58.710381  3192 raft_consensus.cc:1240] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: []
W20260709 13:17:58.712231  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 60523.2us
I20260709 13:17:58.688853 10903 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:58.725103  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:58.726339  3198 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 22: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:58.727454  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:58.729143  2943 catalog_manager.cc:5697] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 15 to 18, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 18 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:58.731146  2943 catalog_manager.cc:5697] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:58.734669 10679 consensus_queue.cc:1059] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:17:58.736183 10814 raft_consensus.cc:3055] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:17:58.736574 10814 raft_consensus.cc:740] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:58.737679 10814 consensus_queue.cc:260] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:58.733597 10886 consensus_queue.cc:1059] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 13:17:58.739991 10886 raft_consensus.cc:3055] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:58.740339 10886 raft_consensus.cc:740] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:17:58.741223 10944 consensus_meta.cc:287] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.779s	user 0.015s	sys 0.000s
I20260709 13:17:58.741331 10886 consensus_queue.cc:260] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:58.742493  3195 pending_rounds.cc:85] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 10
I20260709 13:17:58.742974  3195 pending_rounds.cc:107] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 22.11
I20260709 13:17:58.743033 10886 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:58.743479  3195 raft_consensus.cc:2889] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:58.746081  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:58.603996 10874 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:58.769944 10782 consensus_meta.cc:287] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 1.318s	user 0.018s	sys 0.000s
I20260709 13:17:58.770521 10782 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:58.773697 10788 raft_consensus.cc:3055] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:58.774436 10788 raft_consensus.cc:740] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:17:58.774878 10950 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:58.775480 10788 consensus_queue.cc:260] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:58.776944 10788 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:58.774442 10790 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:58.778142 10456 consensus_meta.cc:287] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.051s	user 0.006s	sys 0.007s
I20260709 13:17:58.778297  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:58.778611 10456 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:58.781222 10456 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:58.776990  3199 raft_consensus.cc:1240] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 23. Current term is 24. Ops: []
I20260709 13:17:58.782065 10883 consensus_queue.cc:1059] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.015s
I20260709 13:17:58.783605 10883 raft_consensus.cc:3055] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:17:58.784014 10883 raft_consensus.cc:740] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:58.784283  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:58.785228  3799 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 24: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:58.786826  3118 raft_consensus.cc:2410] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 24 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:17:58.684438 10888 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:58.793680 10849 consensus_meta.cc:287] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.001s	user 0.015s	sys 0.001s
I20260709 13:17:58.794293 10849 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:58.796833 10849 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:58.798013  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:58.807691 10790 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:58.808439 10790 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:58.810705 10790 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:58.810925 10814 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:58.812408 10969 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:17:58.813036  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 65093.7us
I20260709 13:17:58.816840 11048 raft_consensus.cc:3055] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:58.817344 11048 raft_consensus.cc:740] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:58.763399 10944 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:17:58.818503 11048 consensus_queue.cc:260] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:58.819387  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:58.820068 11048 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:58.821691  3091 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:58.822701  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.823189 10874 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:58.789515  2943 catalog_manager.cc:5697] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:58.824402  3090 leader_election.cc:336] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 1.620s (SENT)
W20260709 13:17:58.784139 10619 consensus_meta.cc:287] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.968s	user 0.001s	sys 0.010s
I20260709 13:17:58.773188 10782 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:58.803176 10431 raft_consensus.cc:2764] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:17:58.833963  3090 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:58.841051  3164 leader_election.cc:336] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 1.584s (SENT)
I20260709 13:17:58.846071  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:58.848909  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:58.844645  2943 catalog_manager.cc:5697] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 17 to 19, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 19 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:58.857337  3164 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:58.824923 10716 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:58.876535 10726 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.879375  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:58.879521 11009 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:58.879693  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:58.880165 11009 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:58.880657 11009 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:58.859053 10874 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:58.882313 10874 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:58.883062 10970 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:58.884115 10888 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:58.884413 10834 consensus_meta.cc:287] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 1.906s	user 0.016s	sys 0.005s
I20260709 13:17:58.785172 10883 consensus_queue.cc:260] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:58.829564 10903 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:58.885046 10834 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:58.885879 10883 raft_consensus.cc:3060] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:17:58.886003 11087 log.cc:927] Time spent T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:17:58.887485 10903 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:58.887710 10834 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:58.876560  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:58.882759 10918 consensus_meta.cc:287] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.976s	user 0.048s	sys 0.143s
I20260709 13:17:58.879565 10726 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:58.888522 10916 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:58.894731 11043 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.889974  3198 raft_consensus.cc:1240] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:58.881481  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:58.876645 10748 consensus_meta.cc:287] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.271s	user 0.009s	sys 0.012s
I20260709 13:17:58.899513 10716 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:58.859442 10627 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:58.849782 11081 consensus_queue.cc:1059] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.051s
I20260709 13:17:58.900388 10803 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:17:58.901420  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 77059.6us
I20260709 13:17:58.923643 10803 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:58.925873 11043 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:58.887590  3791 raft_consensus.cc:2393] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 25: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:58.904095  3125 raft_consensus.cc:2468] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 25.
I20260709 13:17:58.884513 10874 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:58.894224 10734 consensus_meta.cc:287] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 1.241s	user 0.002s	sys 0.012s
I20260709 13:17:58.880674  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:58.893389 11013 consensus_meta.cc:287] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 1.428s	user 0.018s	sys 0.028s
I20260709 13:17:58.909402  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:58.922279 10748 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:58.889127  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 98431.2us
I20260709 13:17:58.939241 11043 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:58.940038 10916 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:58.940529 10726 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:58.941339  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:58.942101 10944 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:58.943142 11076 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:58.947439  3194 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:58.841409 10619 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:58.927891 10950 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:58.976891 11013 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:58.980470 10803 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:58.981541  3192 raft_consensus.cc:1240] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:58.981947  3197 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:17:58.982379 10748 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:58.975469 10734 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:58.983810  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:58.985025 11081 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:58.985707 11081 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:58.988765 11009 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:58.985044 10734 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:58.993379  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:58.987944 11081 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:58.994452  2943 catalog_manager.cc:5697] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 14 to 17, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 17 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:17:58.997998 10965 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:17:58.999408  3198 raft_consensus.cc:1240] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 23. Current term is 24. Ops: []
I20260709 13:17:58.999172 10803 consensus_queue.cc:1048] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:58.999926  3091 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:59.002017 10874 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:17:59.002594 10803 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:59.002075 10726 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:59.004397 11076 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:59.004894 10836 raft_consensus.cc:3055] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:58.998436 10916 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:59.005348 10836 raft_consensus.cc:740] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:59.008906  3123 raft_consensus.cc:1240] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:59.007094  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:58.966634 10970 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:17:59.013808  3197 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:59.016614  3091 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:59.017899  3091 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:59.019343  3091 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:59.019582 10883 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:59.021777 10916 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:59.029848 10970 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:59.032263  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:59.038921  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 200986us
I20260709 13:17:59.026520 11009 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:59.029239 10883 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:59.043020  3791 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43908 (request call id 1059) took 2164 ms (client timeout 2030 ms). Trace:
W20260709 13:17:59.053210  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.047829  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:59.045181 11043 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:59.037070 11013 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:59.056186  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:17:59.047539  3791 rpcz_store.cc:269] 0709 13:17:56.876031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.876161 (+   130us) service_pool.cc:224] Handling call
0709 13:17:59.040644 (+2164483us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54005c0dd4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b72fa 00007ff835378b17 00007ff82e8f36d4 00007ff82e8f3662 00007ff82e8f3591 00007ff82e8f350c 00007ff82e8f27c2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:59.040844 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4450890496}
I20260709 13:17:59.060469  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:17:59.060519  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:59.062407  3198 raft_consensus.cc:2376] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23. Re-sending same reply.
I20260709 13:17:59.064535  3790 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 24. Current term is 25. Ops: []
I20260709 13:17:59.065609 10836 consensus_queue.cc:260] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:59.051667 10883 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:59.057835  3091 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:59.075062  3090 leader_election.cc:336] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Timed out: RequestConsensusVote RPC to 127.1.227.131:38665 timed out after 2.226s (SENT)
I20260709 13:17:59.056092 11043 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:59.058365 10874 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:17:59.079921  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:59.077111  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:59.084034  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:59.085099  3197 raft_consensus.cc:2368] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22.
I20260709 13:17:59.085526  3790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43922 (request call id 938) took 1997 ms. Trace:
I20260709 13:17:59.081820 11043 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:59.086978  3790 rpcz_store.cc:276] 0709 13:17:57.088307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.140845 (+ 52538us) service_pool.cc:224] Handling call
0709 13:17:59.064188 (+1923343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.065059 (+   871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.085337 (+ 20278us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54005c0dd0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031c571 00007ff8303b28ad 00007ff835377419 00007ff82e8eebd4 00007ff82e8eeb62 00007ff82e8eea91 00007ff82e8eea0c 00007ff82e8edcc2 00007ff82e6ee48c 00007ff82e6ed8c6 00007ff82e6ed26f
0709 13:17:59.085471 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4153638144}
I20260709 13:17:59.082768 10874 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.094331  3091 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:17:59.089516  3164 leader_election.cc:336] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 1.605s (SENT)
I20260709 13:17:59.095680  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:59.086889 10970 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:59.103875  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.088188 10836 raft_consensus.cc:3060] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:59.108069  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:59.096961 10874 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:17:59.102982 10619 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:59.112525  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 312948us
I20260709 13:17:59.105391 11013 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:59.106061 10965 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:59.110466 10726 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:59.105180 10916 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:17:59.118767  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 51475.1us
W20260709 13:17:59.116451  3762 leader_election.cc:336] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:59.121447  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:59.117156 11013 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.121243  3762 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:59.130076  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 61589.5us
I20260709 13:17:59.131147  3091 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:59.118903 10726 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:59.111166 10970 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:59.140707  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:59.143432  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 56818.9us
W20260709 13:17:59.145905  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.130147 11013 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:17:59.153667  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.134253 10726 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:59.155442  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:59.140223 10716 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:59.157961  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:59.159039  3125 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 22
W20260709 13:17:59.160414  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 44039.7us
I20260709 13:17:59.163154  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:59.182937 11093 log.cc:927] Time spent T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:17:59.150418 10897 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:59.185530  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:59.187361  3118 raft_consensus.cc:1240] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 24. Current term is 25. Ops: [24.17-24.17]
I20260709 13:17:59.156148 10886 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:17:59.189623  3794 raft_consensus.cc:1275] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
W20260709 13:17:59.189891  3164 leader_election.cc:336] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 1.617s (SENT)
I20260709 13:17:59.192392  3164 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:59.195050  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 66658.8us
I20260709 13:17:59.198727  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:59.200779  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:17:59.184224 10788 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:59.196803  3762 leader_election.cc:336] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:59.203881  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:59.194150 10886 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:59.205641  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 80692.1us
W20260709 13:17:59.206914 11096 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 13:17:59.207190  3017 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.204952 11076 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:17:59.207861 10970 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:59.195375 10965 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:17:59.214527  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:59.205478  3762 consensus_peers.cc:597] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:59.227005  3197 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:17:59.213702 10886 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:17:59.214409 10619 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:59.221801 10788 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:59.241268 10788 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:59.217808 11076 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:59.241943 11076 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:17:59.242038  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:59.238334  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:17:59.239059  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 77017.6us
W20260709 13:17:59.247591  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.258641  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:17:59.258845 11102 log.cc:927] Time spent T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:17:59.262841  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 45611.3us
I20260709 13:17:59.264065 10970 raft_consensus.cc:2804] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:59.267313 10970 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:17:59.264135  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:59.268118  3196 raft_consensus.cc:2393] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 24: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:59.270292 10970 raft_consensus.cc:3060] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:59.281505  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 57422us
W20260709 13:17:59.283109  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 53986.1us
W20260709 13:17:59.283658  3164 leader_election.cc:336] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 1.678s (SENT)
I20260709 13:17:59.246513 10619 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:17:59.297062  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.309525  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:59.296031 10619 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:59.310884  3091 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:59.311414  3125 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:17:59.315997 10883 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:59.318416 10883 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:59.319461  3090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.328493  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 59729.4us
W20260709 13:17:59.329491  3164 leader_election.cc:336] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 1.876s (SENT)
W20260709 13:17:59.331446  3164 leader_election.cc:336] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 1.905s (SENT)
W20260709 13:17:59.332813  3164 leader_election.cc:336] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 1.946s (SENT)
I20260709 13:17:59.333268  3164 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:59.339097  3119 raft_consensus.cc:1275] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:17:59.339778  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:59.340310  3118 raft_consensus.cc:1240] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 25. Current term is 26. Ops: []
I20260709 13:17:59.343427  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:59.352474  3126 raft_consensus.cc:2468] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 23.
W20260709 13:17:59.353981  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 55627.1us
W20260709 13:17:59.354837  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 48171.5us
I20260709 13:17:59.356158  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:59.357067  3117 raft_consensus.cc:1275] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:17:59.360997  3124 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:17:59.358953 10790 consensus_queue.cc:1059] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:17:59.371897  3761 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:59.366287 10965 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:59.352368 10726 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:59.359133 10944 consensus_queue.cc:1059] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
W20260709 13:17:59.382396  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 86558.5us
I20260709 13:17:59.375752 10883 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:59.389788  3125 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 23.
I20260709 13:17:59.387997 10790 raft_consensus.cc:3055] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:17:59.382156 11048 raft_consensus.cc:2804] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:17:59.390681  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 57908.8us
I20260709 13:17:59.388084 10918 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.397127  3091 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:59.388558  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:17:59.399957  3762 leader_election.cc:336] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:59.400460  3762 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:59.387682 10883 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:59.403342  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 47580.3us
I20260709 13:17:59.393316 10790 raft_consensus.cc:740] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:59.413329  3124 raft_consensus.cc:2468] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 25.
I20260709 13:17:59.404325 10883 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:59.392023 11043 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:59.392634 10886 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:59.392132 11037 consensus_queue.cc:1059] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.025s
I20260709 13:17:59.388253 10874 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:59.424818 10944 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:17:59.434067  3164 leader_election.cc:336] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 1.703s (SENT)
I20260709 13:17:59.437875  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:59.417430 10814 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:17:59.402148 10918 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:59.460875  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 61495.9us
I20260709 13:17:59.439291 10944 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:59.471037 10944 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:59.461611 10790 consensus_queue.cc:260] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:59.471724 10897 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:17:59.472285 10790 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:17:59.472908  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.462615  3762 leader_election.cc:336] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:59.438063 11081 raft_consensus.cc:3055] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:59.429128 10903 consensus_queue.cc:1059] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.032s
I20260709 13:17:59.456974 10965 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:59.478646  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:59.482236  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:59.463100 11048 raft_consensus.cc:697] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 25 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:59.476616 11037 raft_consensus.cc:3055] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:17:59.485554  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 86651.9us
I20260709 13:17:59.476912 11081 raft_consensus.cc:740] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:59.498898 10726 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:59.487339 10849 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:59.510624 10918 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:59.500977  3761 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:59.489814 11037 raft_consensus.cc:740] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:59.514585 10903 consensus_queue.cc:1048] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:17:59.517371 11110 raft_consensus.cc:3055] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:17:59.517875 11110 raft_consensus.cc:740] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:59.518821 11110 consensus_queue.cc:260] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:59.520961  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.523047  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:17:59.515045 11105 log.cc:927] Time spent T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:17:59.524988 10874 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 27 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:59.529377  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.487524 10782 consensus_queue.cc:1048] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.025s
I20260709 13:17:59.510751 11043 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:59.536361  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:59.538511  3761 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:59.515545 10478 consensus_queue.cc:1048] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 13:17:59.550755  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:59.552019  3123 raft_consensus.cc:2410] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:17:59.542403 10874 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:59.551446 10903 raft_consensus.cc:2804] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:59.567649  3124 raft_consensus.cc:1240] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 22. Current term is 23. Ops: []
W20260709 13:17:59.570355  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 47402.7us
I20260709 13:17:59.571363  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:59.568812 11109 raft_consensus.cc:2804] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:17:59.577418 11109 raft_consensus.cc:697] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 25 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:59.548897 10970 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:59.582126  3125 raft_consensus.cc:2368] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 22. Current term is 23.
I20260709 13:17:59.583043 10619 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:59.584539 10886 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:59.585211 10619 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:59.590799  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:59.590092  3762 consensus_peers.cc:597] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:59.585973 11013 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:59.595149  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:59.574754 10903 raft_consensus.cc:697] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
W20260709 13:17:59.594439  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 104134us
I20260709 13:17:59.581725 11109 consensus_queue.cc:237] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:59.599290  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:17:59.600462  3762 leader_election.cc:336] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:59.600983  3117 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
W20260709 13:17:59.603296  3762 consensus_peers.cc:597] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:59.567467 11048 consensus_queue.cc:237] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:59.605924  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 27 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:59.600696 10627 consensus_queue.cc:1059] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
W20260709 13:17:59.605300  3762 consensus_peers.cc:597] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:59.598450 11112 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:17:59.610320  3762 consensus_peers.cc:597] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:59.610630  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:59.611263  3197 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:59.613328  3196 raft_consensus.cc:1275] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:17:59.573585 11081 consensus_queue.cc:260] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:59.615707  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:59.612895 10903 consensus_queue.cc:237] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:59.616791 11112 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:59.618057 11081 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:59.619257  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:59.619869  3117 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 24.
I20260709 13:17:59.609370 10619 raft_consensus.cc:2804] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:59.586380 11037 consensus_queue.cc:260] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:59.625810  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:59.626199  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:59.627960  3195 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 24: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:59.628213  3117 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 23: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:17:59.628685 10782 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.629231 10782 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:59.629801  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:59.630415  3197 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:17:59.631282  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:59.631898  3193 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 23.
I20260709 13:17:59.632294 10782 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:59.630344  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:59.632756  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:59.633560  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:59.635519  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:17:59.635771  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:59.628427  3196 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:17:59.637279 11013 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:59.638626 11110 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:17:59.647456 10918 raft_consensus.cc:3055] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:59.648180 10918 raft_consensus.cc:740] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:17:59.652347  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:59.654089 10790 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:59.656325  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:17:59.656373 11112 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:59.658833  3119 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:59.658434  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:59.659902  3124 raft_consensus.cc:2410] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 24 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:17:59.658519  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:59.660574  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:59.660789  3126 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:59.661279  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:59.662220  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:59.662271 11013 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:59.663386 11009 consensus_queue.cc:1059] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:59.664240 11013 raft_consensus.cc:3055] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:59.664688 11013 raft_consensus.cc:740] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:59.665817 11013 consensus_queue.cc:260] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:59.653383  3197 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 24.
I20260709 13:17:59.669971  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:59.670785  3193 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 17.
I20260709 13:17:59.675597  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:59.610831 11076 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:17:59.663730  3762 consensus_peers.cc:597] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:59.678807  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 67823.4us
W20260709 13:17:59.679563  3762 leader_election.cc:336] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:59.624346 10619 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.686527  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:59.683490  3762 leader_election.cc:336] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:17:59.690465  3762 consensus_peers.cc:597] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:59.687798  3117 raft_consensus.cc:1240] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 23. Current term is 24. Ops: []
I20260709 13:17:59.691411 10619 raft_consensus.cc:3060] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:59.694054  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:59.687117 10874 raft_consensus.cc:2804] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:59.695015  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:59.695297 10874 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:17:59.695732 10874 raft_consensus.cc:3060] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:59.695564 10944 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:59.697942 10748 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:59.698616 10748 consensus_queue.cc:1059] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:17:59.699019  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:17:59.699491 10748 raft_consensus.cc:3055] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:17:59.699843 11112 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.700443  3090 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:17:59.700623 10814 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:59.701217 10814 raft_consensus.cc:697] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:59.700412 11112 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:59.701962 10886 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:59.702548 10886 raft_consensus.cc:697] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:17:59.703392 11112 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:59.703547 10886 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:59.699885 10748 raft_consensus.cc:740] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 24 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:17:59.709985  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:59.710081  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:59.712999  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:59.718196  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.649914 10918 consensus_queue.cc:260] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:59.677353 11013 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:59.789045  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.770130  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:17:59.709767  3762 consensus_peers.cc:597] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:59.789891  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 88848.9us
I20260709 13:17:59.697562  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:59.770757  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:59.771134  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:59.683135 10790 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.771354  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:59.771714  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:59.774194  3191 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 22. Current term is 23. Ops: []
W20260709 13:17:59.791159  3762 leader_election.cc:336] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:59.774710  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:59.778414  3119 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 23: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:17:59.789168  3200 raft_consensus.cc:2393] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 24: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:17:59.803879  3762 leader_election.cc:336] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:59.803897  3194 raft_consensus.cc:2393] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 20: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:17:59.702572 10814 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:59.770527  3164 leader_election.cc:336] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 1.560s (SENT)
I20260709 13:17:59.803067  3192 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:17:59.806761  3164 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:17:59.814194  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.817363  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 119937us
I20260709 13:17:59.818241  3090 leader_election.cc:400] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22.
I20260709 13:17:59.818706  3090 leader_election.cc:403] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:59.819355  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:59.821364  3195 raft_consensus.cc:1240] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:59.824203  3193 raft_consensus.cc:3060] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:17:59.817866  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:59.828264  3117 raft_consensus.cc:3060] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:59.838846  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:17:59.808741 10944 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:59.817971 10836 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.788887 10883 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:59.864625  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:17:59.825156 11037 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:59.818470 10849 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:17:59.820735 11112 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:17:59.809238 10790 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:59.823329 10970 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:17:59.869357  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:17:59.878811  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 108747us
I20260709 13:17:59.881357  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:59.845517 10782 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:17:59.858412 11009 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) with higher term. Message: Invalid argument: T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 21. Current term is 22.
I20260709 13:17:59.847836 10918 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:59.890594  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:59.894694  3761 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:17:59.897950  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 127446us
I20260709 13:17:59.898597  3122 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:17:59.900295  3090 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:59.887430 10944 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.867071 10834 consensus_queue.cc:1048] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 13:17:59.887548 11109 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:59.912611  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 29 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:59.871719 10836 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:17:59.893239 10903 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:17:59.909663  3762 leader_election.cc:336] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:59.884315 11112 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:17:59.917059  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.926925  3762 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:17:59.920737 11009 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:59.897176 10970 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.922001 11109 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:17:59.921983 10944 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:17:59.896391 11076 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 29 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:17:59.931734  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.944485  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 44788.4us
I20260709 13:17:59.915351 11111 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:17:59.950431  2934 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a641b8a516264234af4db10b1a0610f0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 501fdf2af2bc4b0c971ae880e98f466b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:17:59.951481  2934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 67733.4us
I20260709 13:17:59.950830  3120 raft_consensus.cc:1240] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 21. Current term is 22. Ops: []
I20260709 13:17:59.956589  3117 raft_consensus.cc:2468] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:17:59.886822 10748 consensus_queue.cc:260] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:59.906828 10619 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:59.939818 10834 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:59.943637 11109 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:17:59.978760 11114 log.cc:927] Time spent T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:18:00.008651  3126 raft_consensus.cc:2410] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:18:00.012172  3122 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 28.
I20260709 13:18:00.091042  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:17:59.988895  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:00.034499  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.997696  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:59.983944  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:00.105064  3118 raft_consensus.cc:2376] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23. Re-sending same reply.
I20260709 13:18:00.104907  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 27 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.035760  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:17:59.989392  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.111234  3193 raft_consensus.cc:2468] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 26.
I20260709 13:17:59.959586 10883 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:00.109402  3121 raft_consensus.cc:2376] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 28 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 28. Re-sending same reply.
W20260709 13:18:00.117597  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 169149us
I20260709 13:18:00.082288 10748 raft_consensus.cc:3060] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:00.122450  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.123637  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:17:59.982621  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:00.120716  3090 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:00.127890  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:00.131706  3119 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:18:00.136166  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:00.138131  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 185871us
I20260709 13:17:59.992324 10944 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:17:59.982147 10790 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:00.139552  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:00.143728  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
W20260709 13:18:00.144168 11115 log.cc:927] Time spent T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:18:00.144564  3117 raft_consensus.cc:2393] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 26: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:18:00.141862 10788 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.146081 10788 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:17:59.965086 10849 consensus_queue.cc:1059] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.173s
I20260709 13:18:00.148144 10788 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:00.153069  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.140545  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.142031  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.119135 11081 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.987202 10836 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:00.131916 11013 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:17:59.980134 11048 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.159s
I20260709 13:17:59.964174 10970 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.165627  3119 raft_consensus.cc:1240] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:00.175300  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.170095  3123 raft_consensus.cc:2468] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 24.
I20260709 13:18:00.172055  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:00.174643  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:18:00.179016  3762 leader_election.cc:336] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:00.176515  3790 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 16.
I20260709 13:18:00.182029  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:00.183990  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.169574 11013 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:00.204383  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:00.209985  3119 raft_consensus.cc:1240] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:00.208890  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:00.212982  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:18:00.208199 10874 consensus_meta.cc:287] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.512s	user 0.012s	sys 0.003s
I20260709 13:18:00.217311  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:00.216773  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 47259.9us
I20260709 13:18:00.221495  3119 raft_consensus.cc:1240] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 23. Current term is 24. Ops: [23.12-23.12]
I20260709 13:18:00.225188  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.228650  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.229521  3118 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 22: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:18:00.233047  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.233829  3118 raft_consensus.cc:2368] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for earlier term 25. Current term is 26.
I20260709 13:18:00.238227  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.245280  3196 pending_rounds.cc:85] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 9
I20260709 13:18:00.245620  3196 pending_rounds.cc:107] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:18:00.245877  3196 raft_consensus.cc:2889] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:00.242735  3090 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:00.251020 10884 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:00.258466 10790 raft_consensus.cc:3055] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:18:00.258998 10790 raft_consensus.cc:740] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 24 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:18:00.259910 10790 consensus_queue.cc:260] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:00.270922 10970 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:00.272416  3126 raft_consensus.cc:2468] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 17.
I20260709 13:18:00.182323 11081 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.267050 10790 raft_consensus.cc:3060] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:00.274777 11081 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:00.261813 10619 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:00.263439 10788 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.278781 10788 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.280907 10788 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:00.283659  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.284118  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.284770  3121 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 22: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:18:00.284965  3125 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 24: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:18:00.285938  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.286300  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.286706  3120 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:00.287047  3122 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 24: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
W20260709 13:18:00.289861  3164 leader_election.cc:336] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 2.110s (SENT)
I20260709 13:18:00.285987  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.290382  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:00.290989  3117 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 24: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:18:00.292001  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.292742  3122 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:00.293382  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.297510  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 27 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.293946 10788 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:00.294931  3122 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:18:00.209602 11013 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:00.295795  3126 raft_consensus.cc:1240] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 24. Current term is 25. Ops: []
W20260709 13:18:00.295699  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 115611us
I20260709 13:18:00.296429  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.306808  3125 raft_consensus.cc:2393] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 24: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:18:00.301311  3120 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 26.
W20260709 13:18:00.310698  3762 leader_election.cc:336] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:00.316102  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.340240  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:00.334961  3164 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:18:00.340962  3790 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:18:00.343317  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:00.347954  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:00.352545  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 27 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:00.353161  3192 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:18:00.250294 10874 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:00.354839  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.362104  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.374143  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:00.375002  3191 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:00.345450 11126 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:00.381642  3119 raft_consensus.cc:1275] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260709 13:18:00.394438  3014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:00.389037  3762 leader_election.cc:336] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:00.405205  3126 raft_consensus.cc:1275] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:18:00.408253  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:00.381248 11126 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:00.417843  3762 consensus_peers.cc:597] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:00.423413  3164 leader_election.cc:336] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 2.236s (SENT)
I20260709 13:18:00.423903  3164 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:00.431255  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:00.431798  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.431919  3193 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:00.434080  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.435029  3122 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:18:00.439340  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:00.440249  3194 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:18:00.447587  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.407630 10627 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 13:18:00.450644  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.422971 11126 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:00.455705  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:00.459452  3015 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:18:00.443449 10965 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:00.463830  3122 raft_consensus.cc:1275] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:18:00.467875  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.467823  3193 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
I20260709 13:18:00.474366 10836 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:00.479450 10836 raft_consensus.cc:697] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:18:00.480597 10836 consensus_queue.cc:237] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.483388 10897 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.484061 10897 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:00.485033 10814 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.485574 10814 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:00.487891 10814 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:00.487264 10897 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:00.489095  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:00.489837  3799 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:18:00.479488  3126 raft_consensus.cc:2468] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 24.
I20260709 13:18:00.494037  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:18:00.498487  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 84047.6us
W20260709 13:18:00.499094  3164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.499213  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:00.472267 10970 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:00.506690  3191 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:18:00.511600  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.506690 10849 raft_consensus.cc:2804] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:18:00.513034 11134 log.cc:927] Time spent T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:18:00.549150  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.551142  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.552798  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.554718  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.555662  3124 raft_consensus.cc:2376] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23. Re-sending same reply.
I20260709 13:18:00.557042  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.558049 10874 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:00.518720 11013 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.498483 11122 raft_consensus.cc:2804] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:00.522197  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.496584 11109 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:00.535394  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.568697  3118 raft_consensus.cc:2376] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21. Re-sending same reply.
I20260709 13:18:00.568610  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.536151  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 29 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.536972  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.558938 11112 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:00.538400  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.546892 10849 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:00.563498  3124 raft_consensus.cc:2393] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 23: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:18:00.564845  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.566250  3194 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 29.
I20260709 13:18:00.576020  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.570338  3125 raft_consensus.cc:2376] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 24. Re-sending same reply.
I20260709 13:18:00.537684  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.570744  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.573518  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:00.578783  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.574687  3121 raft_consensus.cc:2376] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 28 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 28. Re-sending same reply.
I20260709 13:18:00.578048  3126 raft_consensus.cc:2410] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:18:00.580962  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.582230  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.583213  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:00.583806  3124 raft_consensus.cc:1275] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:00.585009  3124 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 28 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 13:18:00.585992  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:00.586690  3191 raft_consensus.cc:2393] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 24: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:18:00.565284 10814 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.588312 10814 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:00.590960 10814 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:00.591593  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.592222  3117 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 28.
I20260709 13:18:00.594133  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.594874  3121 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 22: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:18:00.595098  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:00.596549  3124 raft_consensus.cc:1240] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 25. Current term is 26. Ops: []
I20260709 13:18:00.596652  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.602181  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:00.603180  3194 raft_consensus.cc:2410] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 25 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 13:18:00.602072  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.607908  3118 raft_consensus.cc:2410] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b for term 24 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
W20260709 13:18:00.610931  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 155844us
I20260709 13:18:00.616016  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:00.605837  3119 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:18:00.618479  3794 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:00.618696  3192 raft_consensus.cc:2410] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 27 because replica has last-logged OpId of term: 26 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 11.
I20260709 13:18:00.620798  3122 raft_consensus.cc:1240] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 23. Current term is 24. Ops: []
W20260709 13:18:00.623162 11138 log.cc:927] Time spent T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:18:00.617026 10874 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.624740 10874 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.567790 11122 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:00.625947 11122 raft_consensus.cc:3060] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:00.627055 10874 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:00.628746 11109 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:00.629626 10814 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:00.630252 10814 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.630937  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.631650  3124 raft_consensus.cc:2393] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 22: Already voted for candidate aaf88538197a49adb8bcf3790309a67e in this term.
I20260709 13:18:00.632342 10814 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:00.580478 10849 raft_consensus.cc:3060] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:00.616420  3762 consensus_peers.cc:597] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:00.648515  3164 leader_election.cc:336] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Timed out: RequestConsensusVote RPC to 127.1.227.130:38619 timed out after 1.518s (SENT)
I20260709 13:18:00.649180  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:00.649531  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:18:00.652153  3761 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.653879  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:00.654901 10814 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:00.655299 10814 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.655745 10814 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:00.522344 10836 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:18:00.660123  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.661396 11109 consensus_queue.cc:1048] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:18:00.661701 11141 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.187s	user 0.003s	sys 0.000s
I20260709 13:18:00.662654 10627 consensus_queue.cc:1048] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.004s
I20260709 13:18:00.665005 11013 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:00.675194  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.677106  3194 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:00.680680  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.684887  3123 raft_consensus.cc:2468] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:18:00.685802  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:00.688758  3793 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 24.
I20260709 13:18:00.691282 10627 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.691847 10627 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:00.694424  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 74886.5us
I20260709 13:18:00.698812  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.701682  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:00.703358  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:00.706687 11122 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.701208 11013 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.011s
I20260709 13:18:00.712625 10790 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.713773 11122 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:00.713187 10790 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.718021 10836 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:18:00.718098 11124 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:00.721642 10790 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:00.715119 10886 raft_consensus.cc:3055] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:00.721582 11124 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.722419 10886 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:18:00.718741 10836 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:00.723351 10886 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:00.724102 11124 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:00.724467 10836 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:00.724629 10886 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:00.725917 11112 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:00.735728 10874 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:00.736222 10874 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:18:00.736613 10874 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:00.742692  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:00.744356  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:00.746007 10627 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:00.748063 10965 consensus_queue.cc:1059] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:00.749297 11133 raft_consensus.cc:3055] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:00.749717 11133 raft_consensus.cc:740] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:00.750447 10965 consensus_queue.cc:1059] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:00.750777 11122 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:18:00.750654 11133 consensus_queue.cc:260] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.751430 10788 raft_consensus.cc:3055] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:00.751811 10788 raft_consensus.cc:740] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:00.752557  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:00.755120  3762 leader_election.cc:336] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:00.755174  3793 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:18:00.755254 10950 consensus_queue.cc:1059] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:00.756592 10788 consensus_queue.cc:260] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.759106 10782 consensus_queue.cc:1059] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:00.757807 10788 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:00.752000 11133 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:00.760130 10950 raft_consensus.cc:3055] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:00.762195 10950 raft_consensus.cc:740] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:00.759657  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:00.760679 10782 raft_consensus.cc:3055] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:00.765080 11125 consensus_queue.cc:1059] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:18:00.766806  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.767000 10782 raft_consensus.cc:740] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:00.767524  3117 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 26.
I20260709 13:18:00.767995 10782 consensus_queue.cc:260] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.769439 10782 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:00.771692 10790 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:00.771957 11013 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:00.772324 11126 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:00.763222 10950 consensus_queue.cc:260] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.767517 11125 raft_consensus.cc:3055] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:00.774186 11125 raft_consensus.cc:740] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:00.774560 10950 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:00.774654 11126 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:00.775130 11125 consensus_queue.cc:260] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.776464 11125 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:00.776409  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:00.758419 10836 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:00.766430  3164 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:00.793058  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:00.786957  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:00.802031 11126 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:00.801692 10849 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.803330 10834 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:18:00.803797 10834 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.804056 10849 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:00.804157 10834 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:18:00.804859  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:00.763830 11122 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:00.806457  3196 raft_consensus.cc:1240] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:18:00.807818  3193 raft_consensus.cc:3060] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:00.808857  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:00.809491  3197 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 23.
I20260709 13:18:00.810195  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:00.810788  3199 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:00.811837  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:00.812690  3200 raft_consensus.cc:2393] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:18:00.813704  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:18:00.814325  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.814380  3198 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
I20260709 13:18:00.815222 10814 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:00.817068  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:00.820873 10790 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:00.824177  3090 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:00.825129 10883 raft_consensus.cc:2804] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:18:00.825654 10883 raft_consensus.cc:697] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 26 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:18:00.826682 10883 consensus_queue.cc:237] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.833830  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:00.835144 11122 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:00.835568  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:00.836197  3796 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:00.837553 10965 consensus_queue.cc:1048] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:18:00.848019  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.817629 10814 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:00.850064  3796 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
W20260709 13:18:00.866668  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 147059us
I20260709 13:18:00.872009  3193 raft_consensus.cc:1275] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:18:00.875047  3199 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 24.
I20260709 13:18:00.877177  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:00.887573  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:18:00.888294  3163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.773867 10874 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:00.882576  3196 raft_consensus.cc:1240] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 26. Current term is 27. Ops: []
I20260709 13:18:00.883873  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:18:00.891096  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 57447.6us
I20260709 13:18:00.891389  3192 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 21.
I20260709 13:18:00.888229  3199 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 24.
I20260709 13:18:00.879801  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:00.888509  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:00.890255  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:00.892985  3197 raft_consensus.cc:1240] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:00.897065  3191 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 29 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 28. Current term is 29. Ops: []
I20260709 13:18:00.897646  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:00.897909  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:00.899349  3015 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:00.896965  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:18:00.896799  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 73289.6us
I20260709 13:18:00.904003  3015 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:00.903218  3198 raft_consensus.cc:2410] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:18:00.921895  3196 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:18:00.921540  3164 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:00.920382 11122 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:00.924619 11122 raft_consensus.cc:697] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:18:00.925205  3197 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:18:00.925786 11122 consensus_queue.cc:237] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.902074 10790 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:18:00.927618  2943 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49738 (request call id 153) took 19516 ms (client timeout 15000 ms). Trace:
I20260709 13:18:00.902235 10478 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:00.923051  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:00.934973  3199 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:00.901939 11126 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.936925 11126 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.942401 11081 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:18:00.929803 10619 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:00.942945 11081 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 29 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:18:00.943167 10619 raft_consensus.cc:697] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:18:00.943910 11081 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 28.14, Last appended by leader: 14, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.944041 10619 consensus_queue.cc:237] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:00.947186 10874 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:00.942049 10834 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:00.950601  3200 raft_consensus.cc:2410] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 24 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
W20260709 13:18:00.956079  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 109159us
I20260709 13:18:00.896193 11124 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:00.920558 10970 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.960022  3761 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:00.964851  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:00.959431  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:00.965608  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:00.947861  3165 leader_election.cc:336] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:00.958508 10788 raft_consensus.cc:2804] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:18:00.974187  3165 leader_election.cc:336] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:00.974848  3165 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:00.976244  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:18:00.979697  3165 leader_election.cc:336] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:00.980400  3165 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:00.980772  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.981420  3126 raft_consensus.cc:2468] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:18:00.983862  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:00.985961  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:00.990597  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:00.991541  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.992460  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:00.993773  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:00.992272 10748 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:18:01.015985  3015 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:18:01.038527  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:00.992817  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:01.039877  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:01.032099  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:01.041492  3199 raft_consensus.cc:2393] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 23: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:18:01.043599  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:01.044008  3195 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
W20260709 13:18:01.044669  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 54175.1us
I20260709 13:18:01.045722  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:01.046464  3120 raft_consensus.cc:2393] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 22: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:18:01.046386  3761 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:01.049475  3122 raft_consensus.cc:2393] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 26: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:18:00.964044 10886 consensus_queue.cc:1059] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
W20260709 13:18:00.928014  2943 rpcz_store.cc:269] 0709 13:17:41.410886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.411193 (+   307us) service_pool.cc:224] Handling call
0709 13:18:00.927500 (+19516307us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:59.405802 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:59.413761 (+  7959us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:59.413833 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:17:59.413887 (+    54us) tablet.cc:662] Decoding operations
0709 13:17:59.506571 (+ 92684us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:59.506747 (+   176us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:59.506781 (+    34us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:17:59.508545 (+  1764us) tablet.cc:701] Row locks acquired
0709 13:17:59.508613 (+    68us) write_op.cc:260] PREPARE: finished
0709 13:17:59.508836 (+   223us) write_op.cc:270] Start()
0709 13:17:59.509006 (+   170us) write_op.cc:276] Timestamp: P: 1783603079508771 usec, L: 0
0709 13:17:59.509049 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:17:59.526088 (+ 17039us) log.cc:844] Serialized 6728 byte log entry
0709 13:17:59.961067 (+434979us) op_driver.cc:464] REPLICATION: finished
0709 13:18:00.267575 (+306508us) write_op.cc:301] APPLY: starting
0709 13:18:00.267704 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:00.493139 (+225435us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:00.493247 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:00.737010 (+243763us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:00.737378 (+   368us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 13:18:00.737439 (+    61us) write_op.cc:312] APPLY: finished
0709 13:18:00.755580 (+ 18141us) log.cc:844] Serialized 156 byte log entry
0709 13:18:00.755785 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:00.755945 (+   160us) write_op.cc:454] Released schema lock
0709 13:18:00.756017 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:00.756601 (+   584us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:00.779522 (+ 22921us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1468776,"reported_tablets":28,"spinlock_wait_cycles":13696,"child_traces":[["op",{"apply.queue_time_us":293140,"apply.run_cpu_time_us":26952,"apply.run_wall_time_us":489014,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75221,"num_ops":17,"prepare.queue_time_us":213511,"prepare.run_cpu_time_us":44252,"prepare.run_wall_time_us":172826,"raft.queue_time_us":218347,"raft.run_cpu_time_us":14444,"raft.run_wall_time_us":260083,"replication_time_us":415633,"thread_start_us":508057,"threads_started":4,"wal-append.queue_time_us":75718}]]}
I20260709 13:18:00.988348 10478 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:01.072199  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 56315.3us
I20260709 13:18:00.996742 11124 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:18:00.977536 10814 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:18:01.074246  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 112972us
I20260709 13:18:01.077420 10790 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:18:01.082756 10790 raft_consensus.cc:697] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 26 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:18:01.083920  3164 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:01.079886 10950 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:01.085240  3164 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:00.988562 11125 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:01.078085  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:01.073283 10788 raft_consensus.cc:697] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:00.993356 10849 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:01.044600 11112 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:01.083673 10790 consensus_queue.cc:237] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.976915 10970 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:00.988758 10782 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:01.094833  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:01.071517 11048 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:01.102451  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 122798us
W20260709 13:18:01.108259  3165 leader_election.cc:336] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:01.108497  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:18:01.108738  3165 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:01.109679  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:01.081650 10814 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:01.134207  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 49015.4us
I20260709 13:18:01.090794 10884 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:01.100756 11124 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:18:01.142187  3165 leader_election.cc:336] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:01.157696  3165 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:01.112880 10944 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:01.144402 11160 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:18:01.095348 10883 consensus_queue.cc:1059] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 26.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:18:01.114857 10814 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:01.111503 11159 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:01.158988 10884 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:01.167958 10884 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:01.149475 11154 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:18:01.164649  3165 leader_election.cc:336] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:01.143988 10849 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:18:01.177314  3165 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:01.161891 10782 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:01.180546  3164 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:01.218163  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 171821us
W20260709 13:18:01.222361  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 112741us
I20260709 13:18:01.224191  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:01.225282  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:01.220561  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 189786us
I20260709 13:18:01.231719  3196 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:18:01.232358  3761 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:01.182886 10849 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.142575 10788 consensus_queue.cc:237] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:01.234691  3761 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:01.235589  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:01.237174  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:01.216089 10748 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:01.238320  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 73711.9us
W20260709 13:18:01.239423  3165 consensus_peers.cc:597] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:01.243765  3761 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:01.215106 11160 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:01.240100  3165 leader_election.cc:336] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:01.247085  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.222808 10918 consensus_queue.cc:1059] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:18:01.215843 10834 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:01.231405 11154 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:01.246132  3165 leader_election.cc:336] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:01.254808  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 74406.4us
I20260709 13:18:01.256098  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:01.241215 10849 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:18:01.245038 11109 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:01.240521 11048 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:18:01.252673  3165 consensus_peers.cc:597] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:01.245724 11164 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:01.276257 11149 log.cc:927] Time spent T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
W20260709 13:18:01.277202 11166 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:18:01.277928  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:01.279433 10970 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:01.279516 11157 log.cc:927] Time spent T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 13:18:01.280774 11162 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:18:01.282013 11154 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:01.282377 11173 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:01.282821 10834 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:01.289958  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 57743.3us
I20260709 13:18:01.290709 11165 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 28.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:01.252452 11172 raft_consensus.cc:3055] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 26 LEADER]: Stepping down as leader of term 26
W20260709 13:18:01.296893  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:01.382560  3091 leader_election.cc:336] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:01.383111  3091 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:18:01.300335  3762 leader_election.cc:336] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:01.383661  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 105868us
I20260709 13:18:01.305148 11048 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:18:01.310504  3165 leader_election.cc:336] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:01.384577  3165 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:01.384758  3164 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:01.385497  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 75029.7us
W20260709 13:18:01.386566  3165 consensus_peers.cc:597] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:01.387125  3165 leader_election.cc:336] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:01.387682  3165 leader_election.cc:336] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:01.285576 11126 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:01.316720 11009 raft_consensus.cc:3055] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:01.391729 11009 raft_consensus.cc:740] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:18:01.392635 11009 consensus_queue.cc:260] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:01.393934 11168 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:01.394691 11160 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:01.334561  2946 catalog_manager.cc:5697] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 14 to 16, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 16 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:01.396839  2946 catalog_manager.cc:5697] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 16 to 22, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 22 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:01.400096  2946 catalog_manager.cc:5697] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:01.336632 11124 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:01.337760 11169 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:18:01.337219  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 63138us
I20260709 13:18:01.337190 11122 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:01.344034 11109 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:01.403714  3164 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:01.329250 10849 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:01.403942 10782 consensus_queue.cc:1048] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:01.404702  3164 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:01.347548 10478 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:01.405895 10849 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 29 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:01.270648 10874 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:01.406536 11158 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:01.405902 11154 consensus_queue.cc:1059] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:01.407083 11158 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.407485 11158 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:01.407563 10883 raft_consensus.cc:3055] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:18:01.407997 11159 raft_consensus.cc:3055] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:18:01.408154 10883 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:18:01.408465 11159 raft_consensus.cc:740] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
W20260709 13:18:01.383934  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 83644.2us
W20260709 13:18:01.361639  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 117942us
I20260709 13:18:01.386109 11172 raft_consensus.cc:740] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:18:01.409415 11159 consensus_queue.cc:260] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:01.305369 10748 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:01.410341  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:01.410688 11159 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:01.410560 11172 consensus_queue.cc:260] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:01.411990 11172 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:18:01.413836 11013 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:01.415009 10478 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:01.378652 11173 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:01.415539 10478 raft_consensus.cc:697] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 24 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:18:01.407642 11154 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:01.389213 11048 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:01.416690 10478 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:01.415655 11173 raft_consensus.cc:3060] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:01.410910  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:01.419271 11165 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:01.422211 11168 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:01.378307 10950 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:01.430022 11009 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:01.409144 10883 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 28.14, Last appended by leader: 14, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:01.438947 10883 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:18:01.405757 10782 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:18:01.443585  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 55338.7us
W20260709 13:18:01.444867  3165 consensus_peers.cc:597] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:01.447644 11170 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:18:01.455587  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 44742.5us
I20260709 13:18:01.455948 10874 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:01.456548  3164 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:01.458333  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 75815.6us
I20260709 13:18:01.459147  3090 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:18:01.459112  3091 leader_election.cc:336] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:01.460947  3091 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:18:01.445644  3165 consensus_peers.cc:597] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:01.465297  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:01.466163  3126 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:18:01.470067  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 66548.5us
W20260709 13:18:01.468267  3165 consensus_peers.cc:597] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:01.478776  2946 catalog_manager.cc:5697] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 19 to 22, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 22 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:01.463349 10782 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:18:01.475078  3091 leader_election.cc:336] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:01.485770  3091 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:01.483924  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:18:01.482904  3165 leader_election.cc:336] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:01.487560  3165 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:01.489825  3165 leader_election.cc:336] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:01.490307  3165 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:01.477192 11165 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:18:01.463109 11109 consensus_queue.cc:1048] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.021s
W20260709 13:18:01.493275  3091 leader_election.cc:336] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:01.363931 11164 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:01.491686  2946 catalog_manager.cc:5697] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 12 to 15, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 15 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:01.483966 10619 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.500385  3126 raft_consensus.cc:2468] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 27.
W20260709 13:18:01.496960  3165 consensus_peers.cc:597] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:01.500196  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:01.500850  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:18:01.502883  3165 leader_election.cc:336] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:01.503321  3165 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:01.505292 11163 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:01.505913 11163 raft_consensus.cc:697] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:18:01.503121  3197 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 24.
I20260709 13:18:01.506845 11163 consensus_queue.cc:237] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:01.508483  2946 catalog_manager.cc:5697] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:01.488221 11124 raft_consensus.cc:2804] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:01.505784  3121 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
W20260709 13:18:01.563666  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 60810.4us
I20260709 13:18:01.493716  3091 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:01.473627 11158 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:01.517139  1934 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 3076)
I20260709 13:18:01.523648 10619 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:01.528635  2946 catalog_manager.cc:5697] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:01.493546 10950 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:01.478084 11122 consensus_queue.cc:1059] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.016s
W20260709 13:18:01.586143  2934 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a641b8a516264234af4db10b1a0610f0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 501fdf2af2bc4b0c971ae880e98f466b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:01.560209 11168 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.560612 10782 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:01.560734 11154 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:01.494405 10884 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:01.512223  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:01.597107  3126 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:18:01.598114  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:18:01.568745  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.559935  3164 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:01.569491  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:01.587270  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:01.588796  3197 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:01.591347  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:01.601816  3796 raft_consensus.cc:2368] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 26. Current term is 27.
I20260709 13:18:01.588765 10834 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.609864  3196 raft_consensus.cc:1240] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:18:01.563530 11124 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:01.609920  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 50106.9us
I20260709 13:18:01.615796  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:01.590143 11165 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:01.590296 11112 raft_consensus.cc:3055] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:01.589972 10970 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.610337  2946 catalog_manager.cc:5697] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:01.591814 10944 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.622260  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
W20260709 13:18:01.603169  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 109850us
W20260709 13:18:01.627895  3091 consensus_peers.cc:597] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:01.628750  3091 leader_election.cc:336] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:01.629129  3091 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:01.602810 11178 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.630807  3126 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 29.
I20260709 13:18:01.614998 11124 raft_consensus.cc:3060] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:01.615679 10790 raft_consensus.cc:3055] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:01.604140 10874 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:01.616739 10965 raft_consensus.cc:2804] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:18:01.633299  3091 leader_election.cc:336] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:01.648613  3091 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:18:01.646149  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 52805.4us
I20260709 13:18:01.650321  3761 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:01.626343 11122 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:18:01.624383 11112 raft_consensus.cc:740] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:18:01.598465 10814 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:01.668224 11173 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:01.668659 11186 raft_consensus.cc:2804] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:18:01.669283 11186 raft_consensus.cc:697] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 27 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:18:01.606201 11168 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:01.670205 11186 consensus_queue.cc:237] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:01.670854 10814 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:01.671482 11168 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:01.607817 10834 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:01.675150 11164 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:01.676399  3122 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:01.638021 10836 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:01.638816 11172 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:01.633571 11178 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:01.634935 10944 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:01.646122 10790 raft_consensus.cc:740] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:18:01.667291 10965 raft_consensus.cc:697] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:01.667223 11048 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:01.671770 11112 consensus_queue.cc:260] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:01.689284 10619 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:01.689774 11165 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:01.648422 10849 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:01.695164  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 61899.7us
W20260709 13:18:01.698258  3091 leader_election.cc:336] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:01.636317 10970 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:01.702203 10849 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:01.705190  3794 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Rejecting Update request from peer f20672b2852447a6bc1e137c4dd40904 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:01.654633 10874 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:01.706405  2946 catalog_manager.cc:5697] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 15 to 18, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 18 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
W20260709 13:18:01.705804  3091 consensus_peers.cc:597] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:01.715411  3091 leader_election.cc:336] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:01.717940  3799 raft_consensus.cc:2468] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:18:01.721961 10619 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.721951 11165 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:01.723954 10619 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:01.724251 11165 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:01.725540  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 109808us
I20260709 13:18:01.724666 10874 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:01.718564  3091 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:01.721508  2946 catalog_manager.cc:5697] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 14 to 15, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 15 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:01.727115  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:01.719128 10834 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:01.728765 10619 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:01.721019 11048 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:01.748250  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:01.729199 11165 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:18:01.756747  3091 leader_election.cc:336] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:01.761168  3091 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:01.760771  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:18:01.752149  3793 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:18:01.758412  2946 catalog_manager.cc:5697] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 12 to 21, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 21 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:01.764772 11163 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:01.762351 10619 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:01.725215 10790 consensus_queue.cc:260] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:01.767019 10790 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:01.767449 11158 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:01.769022 10970 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:01.754117 11177 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:18:01.771664 11177 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:01.745985 10965 consensus_queue.cc:237] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:01.796433  3091 leader_election.cc:336] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:01.797416  3091 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:01.798312 11165 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:01.799207 11173 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:01.729409 11122 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:18:01.747321 10874 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:01.809791  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:01.806859  2946 catalog_manager.cc:5697] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:01.758836 11172 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:18:01.807611  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 157353us
I20260709 13:18:01.820459  3193 raft_consensus.cc:1275] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:18:01.822441  3196 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:01.825073  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:01.826023  3198 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:01.828631 11178 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:01.838599  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:01.839536  3126 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 23.
I20260709 13:18:01.845682 10836 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:01.846789  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:01.847115  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:01.797668 10748 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:01.848119 10748 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.848327 11173 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:01.848501 10748 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:01.848882 11173 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:01.843391  2946 catalog_manager.cc:5697] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:01.849988 11177 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:01.814324 10970 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:01.861783  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 45304us
I20260709 13:18:01.868031  3198 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 25.
W20260709 13:18:01.814191  3091 leader_election.cc:336] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:01.869915  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 55967.4us
I20260709 13:18:01.813696 11164 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.883615  2946 catalog_manager.cc:5697] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 19 to 22, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 22 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:01.858085 11172 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.850584 10849 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:01.930606  3187 tablet_service.cc:1558] Processing DeleteTablet for tablet a1ccbbf27f0b436d8c79dfb6db7fc703 with delete_type TABLET_DATA_TOMBSTONED (TS 501fdf2af2bc4b0c971ae880e98f466b not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:60578
W20260709 13:18:01.934751  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 53310.5us
I20260709 13:18:01.857857 10970 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:01.944355  3091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:01.945669  3165 consensus_peers.cc:597] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:01.947502 11192 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.953184 11192 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:01.948154 11112 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:01.954958  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 72178.6us
I20260709 13:18:01.955497 11192 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:01.956473  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:01.948395 11196 consensus_queue.cc:1059] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:01.949476 10886 consensus_queue.cc:1048] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:01.958081  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:01.958658  3793 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:01.958873 11172 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:01.951269 11165 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:01.960958 11172 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:01.961933 11169 raft_consensus.cc:3055] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:01.962322 11169 raft_consensus.cc:740] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:18:01.963177 11169 consensus_queue.cc:260] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:01.964159 11169 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:01.949514  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 86026.2us
I20260709 13:18:01.965809 11009 consensus_queue.cc:1059] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:01.950446  3164 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:18:01.967306  3092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.972728  3197 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 29 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 28 index: 14. Preceding OpId from leader: term: 29 index: 15. (index mismatch)
I20260709 13:18:01.874872 10874 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.100s
I20260709 13:18:01.967038 11192 raft_consensus.cc:2804] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:01.983424  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:02.014634  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:02.015051 11192 raft_consensus.cc:697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:02.015266  3197 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:18:02.016028 11192 consensus_queue.cc:237] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:02.018162  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:01.984822  3793 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 25.
I20260709 13:18:01.985118  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:02.019456  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:02.020655  3193 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:18:01.992030 10944 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:02.020814  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:01.886101 11164 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:02.023686 11164 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:01.975557 10782 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.024682 10782 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:01.989100  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:18:01.989952  3165 leader_election.cc:336] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:02.026638  3165 consensus_peers.cc:597] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:02.027412  3165 leader_election.cc:336] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.027522 10782 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:02.028370  3165 consensus_peers.cc:597] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:01.991999  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:01.975277  3198 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:02.036695 10970 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:02.038375 11173 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:02.042059 11124 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:02.044968 11124 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:02.005334  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:02.005962  3015 leader_election.cc:400] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 26. Current term is 27.
I20260709 13:18:02.048626  3015 leader_election.cc:403] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:02.048036  3793 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:18:02.048666  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:02.049505  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 52893.8us
I20260709 13:18:02.049911  3126 raft_consensus.cc:2393] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 20: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:18:02.011390  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:02.050930  3191 raft_consensus.cc:2410] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:18:02.012494  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:18:02.014094 10883 consensus_meta.cc:287] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.006s
I20260709 13:18:02.053098 10790 raft_consensus.cc:3060] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Advancing to term 27
I20260709 13:18:02.054719 11167 raft_consensus.cc:3055] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:02.055099 11167 raft_consensus.cc:740] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:18:02.056114 11205 log.cc:927] Time spent T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:18:02.055917 11167 consensus_queue.cc:260] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:02.057222 11204 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:18:02.048741  3119 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 27.
I20260709 13:18:02.058100  3118 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 29 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 28 index: 14. Preceding OpId from leader: term: 29 index: 15. (index mismatch)
I20260709 13:18:02.057224 11167 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:01.967675  3761 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:18:02.062670  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 95060.8us
I20260709 13:18:02.078293 11194 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:02.069509  3015 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:02.099208  3126 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:18:02.103785  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:02.106310 11124 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:02.107122 11124 raft_consensus.cc:697] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:18:02.109853 11165 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.110416 11165 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:02.113768  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 44365us
I20260709 13:18:02.117359  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:18:02.096650 11154 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.119568 11154 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:02.096959 11112 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:02.125465 11112 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.117027  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:02.033545 10748 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:02.136209  3090 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:18:02.138705  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 109781us
I20260709 13:18:02.112697 11165 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:18:02.142467  3165 leader_election.cc:336] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.145123  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:02.145763  3124 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:18:02.147943  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:02.149210  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:02.134415 11112 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:02.151990  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:02.152493  3118 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 29 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 28. Current term is 29. Ops: [28.14-28.14]
I20260709 13:18:02.153825  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:02.161845  3119 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 24.
I20260709 13:18:02.154386  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:02.162642  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:02.156962  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:02.158473  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:02.163592  3120 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:18:02.164039  3117 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 24.
I20260709 13:18:02.160336  3164 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:02.155848  3200 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:18:02.162762  3123 raft_consensus.cc:1275] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:18:02.170047  3794 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:18:02.142565 11164 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:18:02.170553  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:02.142968 11167 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:02.144219 11163 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:02.128036 10874 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
W20260709 13:18:02.178534  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 61262us
I20260709 13:18:02.183765  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:02.184511  3192 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 24.
I20260709 13:18:02.189002  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:02.152258 11154 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:02.203513  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:02.206785  3191 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:18:02.169821 11125 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:18:02.211429  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:02.211869  3799 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:18:02.215461  3794 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
W20260709 13:18:02.214553  3762 leader_election.cc:336] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:02.229758  3091 leader_election.cc:336] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.230440  3091 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:18:02.227532  3762 leader_election.cc:336] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.233282  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:02.140555 11124 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:02.237627  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:18:02.231946  3091 consensus_peers.cc:597] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:02.239751  3091 leader_election.cc:336] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.240358  3091 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:18:02.242020  3091 leader_election.cc:336] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.242584  3091 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:02.188583 11163 raft_consensus.cc:697] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 25 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:18:02.189460 11164 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 29 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:18:02.244176  3790 raft_consensus.cc:2410] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:18:02.211110 10884 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:02.214147 11125 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.271540  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:02.273602  3091 consensus_peers.cc:597] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:02.274287  3091 leader_election.cc:336] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.262580  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:02.274963  3091 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:02.262887 10748 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:02.276028  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:02.276376 10950 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:02.276651 10883 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:02.276959 10950 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.276322 11164 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 26.13, Last appended by leader: 13, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:02.277529 10950 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:02.280776 10790 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 26. Current term is 27.
I20260709 13:18:02.252923 11122 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:18:02.236832 11172 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:02.287843  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:02.297394  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:02.203114 10836 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:18:02.244261 11165 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:02.302795  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:02.303632  3790 raft_consensus.cc:2393] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 17: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:18:02.257157 11188 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:18:02.255234 10884 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.236487 10849 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.066s
I20260709 13:18:02.274477 11125 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:18:02.289171 11133 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.325693  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:02.316219  3164 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:02.318614  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:18:02.256598 11167 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.067s
I20260709 13:18:02.304736 11009 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:18:02.324606 11208 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:18:02.352612  3195 raft_consensus.cc:2468] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 19.
W20260709 13:18:02.313290  3091 consensus_peers.cc:597] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:02.335917 11126 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:18:02.354372  3091 leader_election.cc:336] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.355685  3091 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:18:02.356832  3091 leader_election.cc:336] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.334513  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:02.348322 11219 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:02.327025 10884 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:18:02.334002 11210 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 13:18:02.357973  3165 leader_election.cc:336] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.371243  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:02.369606  3762 leader_election.cc:336] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.372586  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:02.373616  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:02.358430  3091 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:02.355460 11126 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.359551 11219 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.326923 11194 consensus_queue.cc:1048] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:18:02.304961 10965 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 26.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
W20260709 13:18:02.376150  3091 leader_election.cc:336] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.360144 11206 tablet_replica.cc:333] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:02.354411 11178 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:02.363772 11013 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:02.384181 10748 raft_consensus.cc:3060] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:02.378059  3762 consensus_peers.cc:597] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:02.378484  3165 leader_election.cc:336] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.332772 10874 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.035s
W20260709 13:18:02.402369  3762 consensus_peers.cc:597] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:02.355011 11164 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:02.368954 11220 log.cc:927] Time spent T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.059s	user 0.002s	sys 0.001s
I20260709 13:18:02.387526 10944 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
W20260709 13:18:02.389036  3091 leader_election.cc:336] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.394649  3165 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:02.369485 11009 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.335781 11133 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:02.418654  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:18:02.390785 11214 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
I20260709 13:18:02.381407 10619 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:02.392561 11206 raft_consensus.cc:2243] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:02.381868 11126 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:02.377288 10883 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:02.431727  3091 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:18:02.423399  3165 leader_election.cc:336] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.385058 11122 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:02.436754  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:02.384938 11219 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:02.376888 10970 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:18:02.392773 11178 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.445271  3165 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:02.393057 10950 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:02.451061  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 55952.7us
I20260709 13:18:02.445420 10814 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:02.459796  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 70794.3us
W20260709 13:18:02.460728  3091 leader_election.cc:336] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.461169  3091 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:18:02.462945  3091 leader_election.cc:336] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:02.463943  3091 leader_election.cc:336] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.372301 11163 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:02.450451 11159 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:02.426013 11009 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:02.426354 11164 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:02.464356  3091 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:02.454875 10883 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:02.471017  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:02.457588 11178 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:02.470532  3165 leader_election.cc:336] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.476920 11124 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:02.470593 10965 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:02.491325 10950 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:02.492995 11164 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:02.494227  3165 leader_election.cc:336] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.466281 11167 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:18:02.503551  3165 leader_election.cc:336] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:02.515403  3762 consensus_peers.cc:597] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:02.504436 11124 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:02.510697 11133 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:02.470515 11206 raft_consensus.cc:2272] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:02.544413 11013 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:02.532758 11225 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:18:02.532574 11222 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:02.502499 11194 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.466117 10814 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:02.567873  1934 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 3076)
I20260709 13:18:02.583175  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:02.583489  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 119558us
W20260709 13:18:02.584329  3091 leader_election.cc:336] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.584892  3091 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:02.594445  3761 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:02.603849  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:02.604553  3191 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:02.601969 10836 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.600723 11191 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:18:02.642190  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 125868us
I20260709 13:18:02.641957 10788 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:18:02.637574  3165 leader_election.cc:336] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.606312 10918 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.038s
I20260709 13:18:02.660796  3191 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 25.
W20260709 13:18:02.663065  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 76834.5us
W20260709 13:18:02.666834  3091 consensus_peers.cc:597] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:02.636432 11173 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:18:02.667487  3091 leader_election.cc:336] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:02.672406  3091 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:18:02.692564  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 97603.8us
I20260709 13:18:02.692997  3122 raft_consensus.cc:1275] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:18:02.668198 11009 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:02.643826 10836 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:02.699247  3761 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:02.692830 11173 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.668712 10788 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:02.713652  2934 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a641b8a516264234af4db10b1a0610f0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e9165fe61ab04bfb9a48889156d5c161 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:02.725220 11234 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:02.328369 11188 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:02.587769 11194 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:02.747493 10970 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.720674 11242 raft_consensus.cc:2804] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:18:02.767284  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 81471.8us
W20260709 13:18:02.755621 11223 log.cc:927] Time spent T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:18:02.756459 11172 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:02.760651 11230 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:02.755910 11159 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.726306 11173 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:02.761983 11124 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:02.749727 11013 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:18:02.810747  3118 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:02.764690 11176 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.027s
I20260709 13:18:02.819909 10884 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:02.820994 11233 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:18:02.822299 10884 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:02.829706  3118 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 25.
I20260709 13:18:02.831401 10788 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:02.776196 10970 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:02.833045 11125 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:02.783133 11215 log.cc:927] Time spent T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.215s	user 0.002s	sys 0.001s
I20260709 13:18:02.836175 11206 ts_tablet_manager.cc:1916] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:02.793143 11159 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:02.843892 11192 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:18:02.845696 11194 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:02.848331 11188 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:02.850741 10836 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:02.852913 11173 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:02.852679 11219 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:02.872540  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 105102us
W20260709 13:18:02.902540 11112 consensus_meta.cc:287] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.731s	user 0.013s	sys 0.000s
I20260709 13:18:02.861856 10748 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:02.904340 11126 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:02.932372  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:02.915845  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:02.919355  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:02.919435  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:02.857429 11125 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 28 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:02.926244  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 258760us
I20260709 13:18:02.930147  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:02.908411 11178 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:02.935268  3125 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 24. Current term is 25. Ops: [24.19-24.19]
I20260709 13:18:02.920521 11192 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:02.945621  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:02.966260  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:02.929809 10883 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.885286 11239 consensus_queue.cc:1048] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.102s
I20260709 13:18:02.975723  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:02.976425  3119 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:02.977319  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:02.977959  3124 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 24.
I20260709 13:18:02.942703 10836 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.975085  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:02.979125  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:02.969492 11242 raft_consensus.cc:697] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:18:03.003832 11192 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 28.14, Last appended by leader: 14, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:03.004937  3123 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 29 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 28. Current term is 29. Ops: [28.14-28.14]
I20260709 13:18:03.005681 11219 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:03.006356 11126 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:02.932111 11112 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:02.967770 11173 consensus_queue.cc:1059] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 23.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.044s
I20260709 13:18:03.011996 10836 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:02.979841 10883 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:03.022934  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:03.023233  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 48632.1us
I20260709 13:18:03.069872  3118 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 24.
I20260709 13:18:03.072911  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:18:03.025444  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 52255us
I20260709 13:18:03.040968  3120 raft_consensus.cc:1275] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:02.974234 11168 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.058738  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:02.982293  3124 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:18:02.978128  3091 consensus_peers.cc:597] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:03.059209  3165 leader_election.cc:336] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:03.022595 11124 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:03.100749  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:03.076094  3015 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:18:03.086160  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 108067us
I20260709 13:18:03.095233 11248 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:18:03.102911  3091 leader_election.cc:336] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:03.122737  3119 raft_consensus.cc:2468] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 25.
I20260709 13:18:03.082491 11192 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:18:03.115233  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:03.128767  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:03.130092 11159 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:03.083665 11125 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:03.115130 11164 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:03.098340 11168 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:03.154304  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:03.160912  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:03.166585  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:03.169950  3120 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:18:03.155812 11239 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:03.170334  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:03.170506  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:03.171387  3121 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 23: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:18:03.170780 11239 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:03.173967  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:03.180859  3791 raft_consensus.cc:2368] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 23. Current term is 24.
W20260709 13:18:03.182576  3166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.184357  3792 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:18:03.189335 11249 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.189996 11249 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:03.190783 11168 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:03.195966  3124 raft_consensus.cc:2468] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 28.
I20260709 13:18:03.141963 11125 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:03.193915  3165 consensus_peers.cc:597] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:03.168880 11164 raft_consensus.cc:697] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 25 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:18:03.172955 11124 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.155892 11242 consensus_queue.cc:237] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:03.187553 11188 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.186499 10849 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.230391 11176 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:03.231120  3762 consensus_peers.cc:597] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:03.231776 11272 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.212303 11178 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:03.242379 10836 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:03.246922  3762 leader_election.cc:336] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:03.248112  3762 leader_election.cc:336] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:03.261183  3762 leader_election.cc:336] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:03.233475 11112 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:03.225947 11124 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:03.262312  3165 leader_election.cc:336] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:03.270375  3165 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:18:03.271553  3165 leader_election.cc:336] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:03.229542 11188 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:03.233901 10849 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:03.232699 11272 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:03.279192 11256 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:03.312897 11124 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:03.299955 10883 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:03.283073 11164 consensus_queue.cc:237] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:03.346650 11188 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:03.354803 11239 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:03.346791 11262 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.337s	user 0.004s	sys 0.000s
I20260709 13:18:03.331589 10950 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:18:03.438771  3762 consensus_peers.cc:597] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:03.458717  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 98333.2us
I20260709 13:18:03.454847 10836 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.475113 10836 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:03.476291 11206 ts_tablet_manager.cc:1929] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.10
I20260709 13:18:03.477082 11206 log.cc:1199] T a1ccbbf27f0b436d8c79dfb6db7fc703 P 501fdf2af2bc4b0c971ae880e98f466b: Deleting WAL directory at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0/minicluster-data/ts-2-root/wals/a1ccbbf27f0b436d8c79dfb6db7fc703
I20260709 13:18:03.478348 11272 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:03.480806 11188 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.481395 11188 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:03.483690 11188 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:03.490437  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:03.492571 11126 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:03.493001 11126 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.493369 11126 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:03.493492  3164 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:03.494895 11158 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:03.495275 11158 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.495609 11158 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:03.497120 11228 consensus_queue.cc:1048] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:03.477617 10836 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:03.461124 10950 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:03.509598 11274 log.cc:927] Time spent T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:18:03.511039 10950 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:03.513479 11271 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.514479 11271 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:03.515379 11257 log.cc:927] Time spent T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.511s	user 0.001s	sys 0.009s
I20260709 13:18:03.516834 11271 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:03.519501  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:03.520555 10849 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:03.521787  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:03.522984  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:03.524171  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:03.526387  3164 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:03.527719  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:03.530454  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:03.517441 11271 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.532964  3792 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 24: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:18:03.534327  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:03.535808  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:03.536476  3119 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:03.537778  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:03.538388  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:03.538795  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:03.538970  3122 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:03.539974  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:03.540202  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:03.540805  3118 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 24.
I20260709 13:18:03.530519  3164 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:03.541767  3790 raft_consensus.cc:1275] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:03.526947 10748 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:18:03.532840 11273 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.308s	user 0.001s	sys 0.002s
I20260709 13:18:03.541324 10886 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:03.579885  1934 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 3076)
I20260709 13:18:03.528072 11124 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:03.526719 11177 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:03.608968  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 66837.5us
I20260709 13:18:03.624858  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:03.625927 11194 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:03.626340 11194 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:03.528199 11178 raft_consensus.cc:3060] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:03.565342 10836 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:03.630425 10836 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:03.532436 10950 raft_consensus.cc:2804] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:18:03.606876  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 59065.1us
I20260709 13:18:03.622578  3119 raft_consensus.cc:2468] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 25.
I20260709 13:18:03.626721 11194 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:18:03.555644  3091 leader_election.cc:336] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:03.527956 11196 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.084s
I20260709 13:18:03.546545 11248 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:03.537809 11271 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:03.641786 11248 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:03.612260 10788 raft_consensus.cc:2804] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 28 FOLLOWER]: Leader election won for term 28
W20260709 13:18:03.632059  3762 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 208 similar messages]
I20260709 13:18:03.636142  3126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2991) took 1169 ms. Trace:
I20260709 13:18:03.634341 10965 consensus_queue.cc:1048] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:18:03.637197 10814 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:03.623492 10886 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:03.638339 11013 raft_consensus.cc:493] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:18:03.652158  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e234b352c9c44269b88598c9ae245ab5" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:03.634759  3091 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:03.647125  3794 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:18:03.537849 11188 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:03.682984  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 50944.8us
I20260709 13:18:03.682780  3126 rpcz_store.cc:276] 0709 13:18:02.466816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.466997 (+   181us) service_pool.cc:224] Handling call
0709 13:18:02.467454 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:02.869398 (+401944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.869430 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:02.870100 (+   670us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.872338 (+  2238us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:02.872461 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.872660 (+   199us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:03.346018 (+473358us) spinlock_profiling.cc:243] Waited 7.33 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:18:03.634000 (+287982us) raft_consensus.cc:1685] finished
0709 13:18:03.634022 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.636048 (+  2026us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4551,"raft.queue_time_us":44368,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":9875,"spinlock_wait_cycles":16856832,"thread_start_us":396702,"threads_started":2,"wal-append.queue_time_us":98528}
W20260709 13:18:03.719352  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 163749us
W20260709 13:18:03.720809  3091 leader_election.cc:336] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:03.644136 11248 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:03.723536  3122 raft_consensus.cc:2468] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:18:03.681687 11177 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:03.741334  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 114746us
I20260709 13:18:03.721386  3091 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:18:03.730384  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 192698us
I20260709 13:18:03.673679 10950 raft_consensus.cc:697] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:03.745993  3015 leader_election.cc:400] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 23. Current term is 24.
I20260709 13:18:03.746399  3015 leader_election.cc:403] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:18:03.754361  3091 consensus_peers.cc:597] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:03.644250 11271 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:03.715529 11176 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.710922 10788 raft_consensus.cc:697] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 28 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:03.730584 10814 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:03.613174 11206 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60578 (request call id 9) took 1763 ms. Trace:
I20260709 13:18:03.651643 11126 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:03.756338 11173 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:03.760321 11188 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:18:03.826372  3164 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:03.827832  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:03.739710 11013 raft_consensus.cc:515] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:03.750531 11177 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:03.770309 11168 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:18:03.806532 10478 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.813058 11192 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:03.815187 11249 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:03.830753 11164 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.827440 11236 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:03.792835 11176 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:03.895723  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 52493.4us
I20260709 13:18:03.835740 11178 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:03.829180 11173 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:03.845779 11272 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:03.944733 10886 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:03.946148 11173 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:03.948293 11173 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.948803 11173 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:03.951612 11173 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:03.951926  3165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.954834 11013 leader_election.cc:290] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:03.955446 11013 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:18:03.955927 11013 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:03.958441  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 132180us
I20260709 13:18:03.854753 11239 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:03.908861 11228 raft_consensus.cc:2804] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:03.959967  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:03.908119 10748 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:03.854002 11194 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:03.968021  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:18:03.969652  3091 leader_election.cc:336] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:03.939460 11164 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:03.963060 10814 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:03.971238 10814 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:03.978174  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:03.853631 10478 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:03.987684 11194 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:03.839901 11271 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.134s
I20260709 13:18:03.989003 11126 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:03.843698 11168 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:03.995901  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:04.000034  3793 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:03.994407  3762 consensus_peers.cc:597] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:03.864478 11192 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:03.992074 11286 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.845713 10950 consensus_queue.cc:237] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:03.993891 11228 raft_consensus.cc:697] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 25 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:03.995543 11013 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:03.997400 10886 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:04.022084 10886 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:04.015657 11286 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.026798 11286 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:03.940760 10788 consensus_queue.cc:237] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 26.13, Last appended by leader: 13, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.027522 11228 consensus_queue.cc:237] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.020237 11168 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:03.999488 11196 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.020s
I20260709 13:18:03.774914 11206 rpcz_store.cc:276] 0709 13:18:01.889177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.930263 (+ 41086us) service_pool.cc:224] Handling call
0709 13:18:02.304109 (+373846us) ts_tablet_manager.cc:1151] Deleting tablet a1ccbbf27f0b436d8c79dfb6db7fc703
0709 13:18:02.326977 (+ 22868us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:18:03.285370 (+958393us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:03.476085 (+190715us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:03.569997 (+ 93912us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":339367,"thread_start_us":207875,"threads_started":1}
W20260709 13:18:04.032665  3762 leader_election.cc:336] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:04.037958  3793 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:18:03.992388 10748 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:03.991098 11239 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:04.035259  3762 leader_election.cc:336] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:04.046504  3091 leader_election.cc:336] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:04.052187 11280 log.cc:927] Time spent T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
W20260709 13:18:04.052868 11289 log.cc:927] Time spent T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:18:04.053682 11290 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:04.054426 11290 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:04.057334 11290 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:18:04.059280 11260 log.cc:927] Time spent T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 1.048s	user 0.000s	sys 0.004s
I20260709 13:18:04.060698  3164 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:04.074589  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:04.076716  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:04.077559  3792 raft_consensus.cc:2393] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 24: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:18:04.076903  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:04.078367  3119 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:04.080029  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:04.080701  3122 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 25.
I20260709 13:18:04.082852  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:04.084630  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:04.085261  3122 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 19.
W20260709 13:18:04.047786 11158 consensus_meta.cc:287] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.552s	user 0.010s	sys 0.003s
I20260709 13:18:04.096395  3119 raft_consensus.cc:2468] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 25.
I20260709 13:18:04.083532  3015 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:18:04.089857  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:04.046646 11192 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:04.103129  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:04.106083  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:04.100991 11158 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.068074 10478 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:04.069937 11154 raft_consensus.cc:2804] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:04.094723 10836 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.116143  3123 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 24.
I20260709 13:18:04.122658  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.123394  3197 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 29.
I20260709 13:18:04.125270 11241 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:04.125618 11124 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.125911 11241 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.126191 11124 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.128193 11241 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:04.128357 11124 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:04.136461  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:04.114060 10970 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:04.145522 11188 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for earlier term 23. Current term is 24.
W20260709 13:18:04.146251  3762 leader_election.cc:336] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:04.146802 10918 raft_consensus.cc:3055] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:18:04.147255 10918 raft_consensus.cc:740] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:18:04.148088 10918 consensus_queue.cc:260] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.19, Last appended by leader: 19, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:04.149176 10918 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:04.106340 11272 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:04.156010  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.156944  3200 raft_consensus.cc:2410] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:18:04.162638  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:04.167352  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:04.167582  3125 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:04.168220  3123 raft_consensus.cc:2393] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 24: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:18:04.171578  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.118263 11192 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:04.174351  3198 raft_consensus.cc:2393] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 22: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:18:04.173487 10814 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:04.180323  3117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54692 (request call id 2992) took 1713 ms. Trace:
I20260709 13:18:04.180750  3117 rpcz_store.cc:276] 0709 13:18:02.467194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.467645 (+   451us) service_pool.cc:224] Handling call
0709 13:18:02.481860 (+ 14215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:02.617306 (+135446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.617335 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:02.625036 (+  7701us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.869400 (+244364us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:02.869435 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.869526 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:03.514791 (+645265us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:18:04.179135 (+664344us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b2400109538. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d14c9c4 00007ff82d14aacb 00007ff82d305dc9 00007ff82d305a55 00007ff82d304fb0 00007ff82ff7b488 00007ff82ff7bbe8 00007ff82ff53398 00007ff82ff4e76a 00007ff82ff4dbb6
0709 13:18:04.180123 (+   988us) raft_consensus.cc:1685] finished
0709 13:18:04.180144 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:04.180270 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21960,"raft.queue_time_us":100389,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":8496,"spinlock_wait_cycles":58046976,"thread_start_us":311579,"threads_started":2,"wal-append.queue_time_us":297280}
I20260709 13:18:04.190323 10886 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:04.191960  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:04.193308  3799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:04.194495  3795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:04.191783  3796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:04.195724  3796 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 24.
I20260709 13:18:04.196272 11164 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:04.204861 11281 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:18:04.206132  3193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34728 (request call id 1267) took 1277 ms. Trace:
I20260709 13:18:04.206501  3193 rpcz_store.cc:276] 0709 13:18:02.929055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.930778 (+  1723us) service_pool.cc:224] Handling call
0709 13:18:02.931105 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:02.942804 (+ 11699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.942841 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:02.943276 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:18:03.518017 (+574741us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b18003860e0. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83618ede1 00007ff83619b5b1 00007ff82d2a8e07 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff82ff4d20b 00007ff82ff52d23 00007ff82ff530d1 00007ff83036ea0f
0709 13:18:03.756743 (+238726us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:18:03.756782 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.756850 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:04.204194 (+447344us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82ff4e86e 00007ff82ff4dbb6 00007ff82ff4d7d8 00007ff82ff57221 00007ff82ff571d9 00007ff82ff57169
0709 13:18:04.205868 (+  1674us) raft_consensus.cc:1685] finished
0709 13:18:04.205895 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:04.206040 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42004,"raft.queue_time_us":38252,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":3876,"spinlock_wait_cycles":9627264,"thread_start_us":238541,"threads_started":1,"wal-append.queue_time_us":922971}
W20260709 13:18:04.149730 11282 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.165s	user 0.002s	sys 0.000s
I20260709 13:18:04.150838 11239 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:04.212530  3762 leader_election.cc:336] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:04.151185 11125 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:04.123958 11154 raft_consensus.cc:697] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:04.167450 11177 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:04.223462  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.219790  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:04.240113  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:04.240741  3194 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:04.240854  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.152181 11158 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:04.234272  3195 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 29 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 28 index: 14. Preceding OpId from leader: term: 29 index: 14. (term mismatch)
I20260709 13:18:04.242230  3195 pending_rounds.cc:85] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 13
I20260709 13:18:04.242560  3195 pending_rounds.cc:107] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 28.14
I20260709 13:18:04.242815  3195 raft_consensus.cc:2889] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:04.236393  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.237797  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.171267 11272 raft_consensus.cc:697] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:18:04.273087  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 28 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.120476 10836 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.236450 11013 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.279204  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.280443 11167 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.281584 11248 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.282044 10883 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:04.282167 11236 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:18:04.284098  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 64424.3us
I20260709 13:18:04.284765 11168 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:04.214787 11192 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:04.287662 10748 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:04.293071  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:18:04.288381  3762 leader_election.cc:336] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:04.301322  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.302232  3197 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
I20260709 13:18:04.227679 10886 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:18:04.299160  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:04.237318 10814 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:04.304605  3197 raft_consensus.cc:1275] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:18:04.270854 11234 raft_consensus.cc:493] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:18:04.345638  3125 raft_consensus.cc:2468] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 25.
I20260709 13:18:04.309768  3164 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:04.349933  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.350827  3164 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:04.275511 11194 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:04.300309 11248 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.356729 11248 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:04.348860 10814 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.357779 11234 raft_consensus.cc:515] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:04.360002 10814 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:04.360535 11234 leader_election.cc:290] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:04.297549 11167 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:04.361241 11154 consensus_queue.cc:237] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.363549 11167 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:04.342170 11236 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.366436 10836 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:04.366783 11236 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:04.344189 10886 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:04.368227  3165 leader_election.cc:336] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:04.369303 10886 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:04.369839 10965 raft_consensus.cc:2804] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:04.344830 10883 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:04.370522 10965 raft_consensus.cc:697] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:04.371663 10965 consensus_queue.cc:237] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.372155 10883 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:04.344020 11241 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:04.373345 11241 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:04.376884  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.379844  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.384187  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:04.293211 11176 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:04.353204 11194 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:04.403399 11288 log.cc:927] Time spent T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.421s	user 0.002s	sys 0.000s
W20260709 13:18:04.409330  3165 leader_election.cc:336] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:04.411679  3165 leader_election.cc:336] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:04.413045  3165 leader_election.cc:336] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:04.413653  3165 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:04.389350  3090 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:04.346532  3194 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
W20260709 13:18:04.415539  3165 leader_election.cc:336] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:04.420333  3165 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:04.312566 11168 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:18:04.419211  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:04.374033 11241 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:04.384343 11164 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.387230 11158 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:04.411530 11290 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:04.295377 11013 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:04.447680  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.437002  3761 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:04.451730  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d12e7c2ef94802ad2c1a3390fe2a8e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.448571  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d08acccfb704a2cbd3aa420321f06d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:18:04.444193  3760 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.432729 11168 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:04.470556  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.435755 11284 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:04.423561 11295 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:04.455727  3200 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
W20260709 13:18:04.477299  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 89161.3us
I20260709 13:18:04.472754  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:04.431540 10788 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:04.475075  3164 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:04.475905  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:04.479441  3123 raft_consensus.cc:2410] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:18:04.477507  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.480334  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 28 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:04.481379  3122 raft_consensus.cc:2393] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 28: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:18:04.482339 11302 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:04.483618 10788 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.486321 10788 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:04.361260 11272 consensus_queue.cc:237] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:04.446177 11286 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:04.487510  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.494712  3090 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:04.435495 11294 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:04.489043  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.450790 11112 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:04.491012  3117 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 29 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 29 index: 14. (index mismatch)
I20260709 13:18:04.497295  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.467417 11173 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:04.474121 11290 raft_consensus.cc:697] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 24 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:04.499270 11304 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:04.451068 11164 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:04.500882  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.502282  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.499552 11112 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:04.517853  3090 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:04.495935 11158 raft_consensus.cc:2804] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:18:04.519836  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.522722 11251 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:04.525791  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:04.518038  3193 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:18:04.518544  3198 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:18:04.539487  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:04.540570  3122 raft_consensus.cc:2393] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 25: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:18:04.519194 11303 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:18:04.500258 11286 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.557688  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:04.567034 11164 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:04.550331 11303 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 29 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:04.570144 11303 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:18:04.556651  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:04.590274  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 59352.8us
I20260709 13:18:04.592288  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:04.608902  1934 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 3076)
I20260709 13:18:04.610100  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:04.531015 11158 raft_consensus.cc:697] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 25 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:04.611012  3122 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 24.
I20260709 13:18:04.614523  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:04.616770  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:04.621837  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:18:04.639751  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:04.618223 11196 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:04.643278  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:04.620934 10748 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:04.647883  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:04.648695  3123 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:18:04.651412  3119 raft_consensus.cc:2393] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 25: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:18:04.654592  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:04.644706  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 191913us
I20260709 13:18:04.656695  3761 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:04.658179  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:04.659060  3117 raft_consensus.cc:2410] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:18:04.661446  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:18:04.622852 11192 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:04.642915 11178 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:04.675187 11173 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:04.621150 11292 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:18:04.673199 10836 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:04.684567 11311 consensus_queue.cc:1048] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:18:04.684907 11300 log.cc:927] Time spent T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:18:04.685525  3761 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:04.672300 11301 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:18:04.681767 10748 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:04.696234  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:04.697162  3091 leader_election.cc:336] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:04.671753 10886 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:04.678543 11178 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.706202 11228 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:18:04.635658 11290 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:04.777485 11154 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.778131 11154 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.677475 11164 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:18:04.780265 11154 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:04.741318  3091 leader_election.cc:336] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:04.741731 11309 log.cc:927] Time spent T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:18:04.746363 10478 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:04.783407 11228 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:04.790588 11286 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:04.794339 11112 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:04.795233  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:04.796823  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:04.797401  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 30 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:04.797541  3797 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 25.
I20260709 13:18:04.798031  3117 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 29.
I20260709 13:18:04.801306  3120 raft_consensus.cc:1275] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 28 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
W20260709 13:18:04.746954 11297 log.cc:927] Time spent T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:18:04.802764  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:04.712035 11298 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:18:04.803848  3123 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 25: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:18:04.739846 10886 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.808848 10886 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:04.710734 11301 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:04.811623 11301 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:04.766078 11013 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:04.739843 11178 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:18:04.814667 11316 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:18:04.774791 11165 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:18:04.816622  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 360478us
I20260709 13:18:04.816922 11165 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:04.820011 11165 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:04.697866 10883 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:18:04.821251 10883 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:04.711205 10748 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.823884 10883 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:04.823925 10748 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:04.824450 10883 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.824981 10883 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.427943  2934 catalog_manager.cc:5028] TS 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): tablet a1ccbbf27f0b436d8c79dfb6db7fc703 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
W20260709 13:18:04.829499  2934 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 401543us
W20260709 13:18:04.830384  2934 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a641b8a516264234af4db10b1a0610f0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e9165fe61ab04bfb9a48889156d5c161 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:18:04.833509 11283 log.cc:927] Time spent T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.863s	user 0.001s	sys 0.003s
I20260709 13:18:04.785621 11228 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:04.834439 11293 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:04.835029 11293 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.841665  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:18:04.842748 11294 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:04.843392 11294 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:04.845625 11295 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:04.846113 11295 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:18:04.846479 11295 raft_consensus.cc:3060] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:18:04.846565  3762 consensus_peers.cc:597] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:04.850173  3091 leader_election.cc:336] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:04.694648 11304 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
W20260709 13:18:04.852922  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 167479us
I20260709 13:18:04.861625  3761 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:04.840873 11194 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:18:04.864326  3091 leader_election.cc:336] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:04.870090  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:04.837126 11293 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:04.875795  3119 raft_consensus.cc:2393] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 25: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:18:04.877985  3091 leader_election.cc:336] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:04.854354 11251 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:04.889025  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:18:04.883265  3091 leader_election.cc:336] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:04.890285  3091 leader_election.cc:336] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:04.892256  3091 leader_election.cc:336] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:04.894114 11230 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:04.873461 11239 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:04.691279 11158 consensus_queue.cc:237] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.896070  3122 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 22.
I20260709 13:18:04.880259 10886 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:04.901412  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 240039us
I20260709 13:18:04.908792  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:04.909861  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:04.911031  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:04.894622 11230 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.885035 11241 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.927600  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:04.908833 11272 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.931869  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:04.884526 11304 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:04.947033  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:04.915544 11230 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:04.956956  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:04.929669 11293 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.929598 11292 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.907884 10886 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.980345  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:04.985802  3122 raft_consensus.cc:2410] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e for term 28 because replica has last-logged OpId of term: 27 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 18.
W20260709 13:18:04.970628 11249 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.011s	sys 0.015s
I20260709 13:18:04.988865  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:04.990001  3793 raft_consensus.cc:2393] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 24: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:18:04.986981 11293 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:04.997159 11293 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:04.998095  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:04.999689  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:04.974268 10836 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:05.000708 10836 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:05.002920 10836 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:04.985816 11292 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:05.008783  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 143337us
I20260709 13:18:05.005471 11292 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:04.987883 11249 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.011s	sys 0.015s
I20260709 13:18:05.014915  3090 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:04.958508 11272 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:05.016705  3090 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:18:04.993801 10950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.004s	sys 0.037s
I20260709 13:18:05.016718  3793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:18:05.031162  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 53821.7us
I20260709 13:18:05.009656 10883 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:05.042193  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:05.021466 10950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.004s	sys 0.037s
I20260709 13:18:05.018723 11301 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:05.015218 11303 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:05.059396  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 26 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:05.065127  3191 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 25.
I20260709 13:18:05.036149 11159 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.061810  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:05.066105  3123 raft_consensus.cc:3060] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:18:05.068142 11324 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:18:05.069514 11312 log.cc:927] Time spent T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:18:05.070353 11320 log.cc:927] Time spent T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:18:05.064159  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 30 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:05.071784  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:05.072901  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:05.074121  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:18:05.074362 11331 log.cc:927] Time spent T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:18:05.077139 11272 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:05.077160 11159 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:05.079769 11159 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:05.080538  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172fb190a0d74cd292c08c451255bae2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:05.083338 11303 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 30 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:05.084043  3125 raft_consensus.cc:1240] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 30 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 29. Current term is 30. Ops: []
I20260709 13:18:05.050203 11165 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:05.098358  3126 raft_consensus.cc:1240] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 24. Current term is 25. Ops: [24.19-24.19]
I20260709 13:18:05.102295  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:05.104811  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:05.106762  3123 raft_consensus.cc:2468] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 24.
I20260709 13:18:05.081530 11230 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:05.112396 11230 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:05.085180 10748 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:05.114749 10748 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:05.115310  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:05.118206  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:05.117499  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:05.119632  3191 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:05.105075 11168 consensus_meta.cc:287] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b: Time spent flushing consensus metadata: real 0.617s	user 0.006s	sys 0.006s
I20260709 13:18:05.137444  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:05.150425 11241 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:05.151805 11304 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:18:05.154145  3762 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.170883  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 26 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:05.157327  3165 leader_election.cc:336] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:05.173202  3165 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.174721 11159 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:18:05.176311  3165 leader_election.cc:336] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:05.177248  3165 leader_election.cc:336] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:05.173277  3191 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
I20260709 13:18:05.165680  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:05.185262  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 336963us
I20260709 13:18:05.130065 10886 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:05.177630  3165 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:05.188346  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 171728us
I20260709 13:18:05.189019  3090 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:05.189666 11304 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:05.190124  3090 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:05.190526  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:05.191447  3165 leader_election.cc:336] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:05.191321  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.193090  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.193437  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:05.194375  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:05.195377  3165 consensus_peers.cc:597] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:05.195925 11256 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:18:05.197162  3165 leader_election.cc:336] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:05.202211  3193 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:18:05.201527  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:05.203634  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:05.202137  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:05.203085  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:05.204638  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.205101  3120 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:05.201719  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:05.205991  3123 raft_consensus.cc:2393] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 23: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:18:05.206427  3090 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:05.207047 11293 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:05.210215  3122 raft_consensus.cc:2393] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aaf88538197a49adb8bcf3790309a67e in current term 25: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:18:05.205618  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.167070 11168 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:05.211767  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.260445  3761 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.212466  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:05.348852  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 88548.6us
W20260709 13:18:05.360960  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 168522us
W20260709 13:18:05.353987  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 142285us
I20260709 13:18:05.371505  3164 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:05.371683  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.372781  3761 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:05.374056  3761 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.376014  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.350373  3120 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 23.
W20260709 13:18:05.299362 11329 log.cc:927] Time spent T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.214s	user 0.003s	sys 0.001s
I20260709 13:18:05.196749 10874 raft_consensus.cc:3060] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:18:05.368418 10478 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:05.397071  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:05.350445  3762 leader_election.cc:336] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:05.398705  3762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 55654.2us
I20260709 13:18:05.342782 11304 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.294530 10849 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.224915 11301 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.231592 11159 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:05.198352 11333 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:05.298489 11294 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:05.395916 11239 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:05.401535 11177 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:05.402194 11335 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:05.368518 10788 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:05.215975 11295 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:05.406873  3199 raft_consensus.cc:1240] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Rejecting Update request from peer e9165fe61ab04bfb9a48889156d5c161 for earlier term 25. Current term is 26. Ops: []
I20260709 13:18:05.201490 10886 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:18:05.297420 11326 log.cc:927] Time spent T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.211s	user 0.001s	sys 0.001s
W20260709 13:18:05.310036 11327 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.232s	user 0.002s	sys 0.000s
I20260709 13:18:05.406898  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:05.450157  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 51054.1us
I20260709 13:18:05.451521  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.452345 11333 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:05.413122  3090 leader_election.cc:304] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:05.454475 11013 raft_consensus.cc:2749] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:05.455842  3090 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:05.415910  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:05.453583 11333 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:05.413520  3091 leader_election.cc:336] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:05.417263  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:05.417407  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:05.214351 11230 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:05.426054  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:18:05.459560  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 46076.1us
W20260709 13:18:05.459952 11330 log.cc:927] Time spent T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.374s	user 0.002s	sys 0.002s
I20260709 13:18:05.461030 11013 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:05.462888  3091 leader_election.cc:336] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:05.463375  3091 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:18:05.467320  3762 consensus_peers.cc:597] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:05.400372 11293 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:05.396946 11192 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:18:05.468443 11192 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 29 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:05.468914 11192 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:18:05.469146 11013 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:05.470304  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:05.431173  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:05.395746 11323 raft_consensus.cc:2804] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:05.471962 11323 raft_consensus.cc:697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 24 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:18:05.422701 11228 consensus_queue.cc:1048] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:18:05.472826 11323 consensus_queue.cc:237] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:05.395596 11311 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:05.396050 11334 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.476667 11334 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:05.435050  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:18:05.476692  3762 consensus_peers.cc:597] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:05.209775 10748 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.217s
I20260709 13:18:05.300530 11178 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:05.439554 11168 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:05.453047  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.414386  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:05.369009 11272 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:05.214514 11321 raft_consensus.cc:3060] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:05.467549 11230 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:05.423038 11304 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:05.482811  3761 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.425374 10849 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:05.490379  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:05.490453  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.484942 11336 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:05.427369 11301 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:05.494513  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 103524us
I20260709 13:18:05.507891 11293 raft_consensus.cc:3060] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:05.509914 11272 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.510476 11272 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:05.512589 11272 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:05.516461  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.518692  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:05.528080  3122 raft_consensus.cc:1275] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:18:05.532176  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 51455.4us
I20260709 13:18:05.533898  3123 raft_consensus.cc:1275] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:18:05.535513  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:05.536643  3090 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:05.536842  3015 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:05.515990 11112 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:05.539535  3199 raft_consensus.cc:1240] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:05.539832 11336 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:18:05.543483 11301 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:05.540014 11272 consensus_queue.cc:1059] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 29.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:18:05.544811 11272 raft_consensus.cc:3055] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 29 LEADER]: Stepping down as leader of term 29
I20260709 13:18:05.545045 11178 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:05.545213 11272 raft_consensus.cc:740] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 29 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:18:05.517653 10748 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:18:05.553251  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:05.555313  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:05.557125  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.557545  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:05.560632  2943 catalog_manager.cc:5697] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 19 to 22, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 22 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:05.562356  3118 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 24. Current term is 25. Ops: []
I20260709 13:18:05.563442  2943 catalog_manager.cc:5697] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 23 to 25, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 25 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:18:05.553061  3165 leader_election.cc:336] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:05.565661  3165 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:05.566690  3165 leader_election.cc:336] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:05.567296  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.565467  2943 catalog_manager.cc:5697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.571935  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.572986  3120 raft_consensus.cc:1275] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 13:18:05.576772  3165 leader_election.cc:336] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:05.561520  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:05.586992  3125 raft_consensus.cc:1275] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:18:05.538384 11335 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:18:05.556468 11344 log.cc:927] Time spent T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 13:18:05.583467  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 46876us
I20260709 13:18:05.594628  3090 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:05.561827 11196 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.547024 11177 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:05.602248 11336 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:05.602464 11177 raft_consensus.cc:697] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:18:05.603497 11177 consensus_queue.cc:237] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:05.606616 11295 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:05.608409 11304 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:05.609411  1934 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 3076)
I20260709 13:18:05.612596 11334 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:05.618106 11196 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:05.618806 10849 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:05.619912  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:05.620307 11196 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:05.592473 10836 raft_consensus.cc:3060] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:05.590492 11192 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:05.623806 11192 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 30 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:05.594352 11164 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:18:05.628075  3792 raft_consensus.cc:2468] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 25.
I20260709 13:18:05.570526 11272 consensus_queue.cc:260] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 29.15, Last appended by leader: 15, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:05.593658 11303 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:05.600939  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 60669us
I20260709 13:18:05.640164  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:05.587396  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.580197 11292 raft_consensus.cc:3060] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:05.570716 11286 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:05.570474 11285 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:05.578641 11321 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:05.600626  3090 leader_election.cc:304] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:18:05.666702  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 66146.6us
I20260709 13:18:05.667475  3090 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:18:05.647151  3762 consensus_peers.cc:597] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:05.648130  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 60799.9us
I20260709 13:18:05.644287  3164 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:18:05.669077 11158 raft_consensus.cc:2804] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:05.649909  3798 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:18:05.654047  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:05.588101  3165 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.671356  3792 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:05.671658 11228 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:05.671756 11158 raft_consensus.cc:697] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:05.673192 11158 consensus_queue.cc:237] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:05.675577  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 98846.9us
W20260709 13:18:05.676329  3165 consensus_peers.cc:597] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:05.677016  3165 leader_election.cc:336] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:05.679984  3165 leader_election.cc:336] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:05.629694 11293 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:05.634336 11244 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:05.650596 11284 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:05.696519  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:05.697403  3797 raft_consensus.cc:2410] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for term 26 because replica has last-logged OpId of term: 24 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 18.
I20260709 13:18:05.689213 11286 consensus_queue.cc:1048] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:18:05.690562  2943 catalog_manager.cc:5697] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 12 to 18, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 18 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.682219  3165 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.684087  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.683362  3792 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 25.
I20260709 13:18:05.670665 11168 consensus_queue.cc:1048] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:18:05.685854 11350 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:05.699370 11228 consensus_queue.cc:1059] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 13:18:05.679348 11301 raft_consensus.cc:2749] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:05.714087  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:05.731033  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 51065.1us
W20260709 13:18:05.732107  3165 leader_election.cc:336] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:05.732651  3165 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:18:05.715982  3091 leader_election.cc:336] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:05.718664 10965 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:05.735363  3091 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:05.738452  3090 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:05.724833 11284 raft_consensus.cc:3060] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:05.750510 11294 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:05.751780 11294 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:18:05.752676 11294 consensus_queue.cc:1048] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:05.755367 10965 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:05.760869  3797 raft_consensus.cc:1240] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Rejecting Update request from peer 501fdf2af2bc4b0c971ae880e98f466b for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 13:18:05.763429 10965 consensus_queue.cc:1059] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:18:05.766065  3165 consensus_peers.cc:597] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:05.766963  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 51035us
I20260709 13:18:05.742156 11351 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:05.700078 11244 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:05.743314 11303 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:05.804602 11272 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:18:05.807653 11244 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:05.812913  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:05.814088  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:05.815322  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:05.816932  3192 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 30 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 29. Current term is 30. Ops: []
I20260709 13:18:05.792424 10874 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:18:05.836359 11284 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:05.792469 11196 consensus_queue.cc:1059] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 19.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:18:05.837759 11196 raft_consensus.cc:3055] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:05.838124 11196 raft_consensus.cc:740] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:18:05.840808 10836 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:18:05.841270  2946 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57732 (request call id 235) took 26150 ms (client timeout 15000 ms). Trace:
I20260709 13:18:05.734740 11286 consensus_queue.cc:1048] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:18:05.794377  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:05.794281  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:05.796066  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:05.862054  3199 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:05.796831  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:05.797930  3792 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:18:05.800098  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:05.811398 11351 raft_consensus.cc:697] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 25 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
W20260709 13:18:05.866707  3165 consensus_peers.cc:597] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:05.866356 11351 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:05.867148  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 78451.3us
W20260709 13:18:05.867798  3165 consensus_peers.cc:597] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:05.868304  3165 leader_election.cc:336] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:05.842546  2943 catalog_manager.cc:5697] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 15 to 20, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 20 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.848632  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.868678  3165 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:05.869154  3199 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 25.
I20260709 13:18:05.869918 11177 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:05.869489  2943 catalog_manager.cc:5697] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 21 to 23, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 23 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:05.870453 11286 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:05.870990  2943 catalog_manager.cc:5697] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 19 to 21, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 21 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:05.872386  2943 catalog_manager.cc:5697] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 15 to 17, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 17 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:18:05.850562  3762 leader_election.cc:336] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:05.876302 11292 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:05.838917 11196 consensus_queue.cc:260] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.8, Last appended by leader: 8, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:05.878688 11196 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:05.880071 11334 consensus_queue.cc:1059] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 29.14, Next index: 15, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:05.856258 11192 raft_consensus.cc:3055] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:18:05.881910 11192 raft_consensus.cc:740] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:05.882424  3015 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.882823 11192 consensus_queue.cc:260] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:05.883440 11178 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:05.884258 11192 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:05.884855  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:18:05.885918 10874 consensus_queue.cc:1175] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f20672b2852447a6bc1e137c4dd40904" responder_term: 19 status { last_received { term: 19 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 19 index: 8 } }
I20260709 13:18:05.886224  3015 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:18:05.862129  3124 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:05.892009 11311 consensus_queue.cc:1059] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: INVALID_TERM, Last received: 25.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:18:05.893080 11311 raft_consensus.cc:3055] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:18:05.893419 11311 raft_consensus.cc:740] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:18:05.893914 11284 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:05.894291 11311 consensus_queue.cc:260] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:05.897161 11311 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:05.898331  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:05.892190 11178 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:05.901667 11321 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:05.894578 11284 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 25 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:18:05.904044 11284 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:05.861305  2946 rpcz_store.cc:269] 0709 13:17:39.691347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.691631 (+   284us) service_pool.cc:224] Handling call
0709 13:18:05.841159 (+26149528us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:02.262850 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:02.263630 (+   780us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:02.263683 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:18:02.263710 (+    27us) tablet.cc:662] Decoding operations
0709 13:18:02.345944 (+ 82234us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:02.346049 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:02.346083 (+    34us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:18:02.347303 (+  1220us) tablet.cc:701] Row locks acquired
0709 13:18:02.347324 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:18:02.347487 (+   163us) write_op.cc:270] Start()
0709 13:18:02.347611 (+   124us) write_op.cc:276] Timestamp: P: 1783603082347434 usec, L: 0
0709 13:18:02.347631 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:18:02.348417 (+   786us) log.cc:844] Serialized 5620 byte log entry
0709 13:18:03.057992 (+709575us) op_driver.cc:464] REPLICATION: finished
0709 13:18:03.337265 (+279273us) write_op.cc:301] APPLY: starting
0709 13:18:03.337415 (+   150us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:03.347847 (+ 10432us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:03.347937 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:03.356617 (+  8680us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:03.356908 (+   291us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0709 13:18:03.356953 (+    45us) write_op.cc:312] APPLY: finished
0709 13:18:03.357353 (+   400us) log.cc:844] Serialized 129 byte log entry
0709 13:18:03.357534 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:03.357703 (+   169us) write_op.cc:454] Released schema lock
0709 13:18:03.357783 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:03.459675 (+101892us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:03.461200 (+  1525us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":81032,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":276355,"apply.run_cpu_time_us":22217,"apply.run_wall_time_us":103394,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62675,"num_ops":14,"prepare.queue_time_us":101261,"prepare.run_cpu_time_us":27747,"prepare.run_wall_time_us":327105,"raft.queue_time_us":124867,"raft.run_cpu_time_us":18228,"raft.run_wall_time_us":330225,"replication_time_us":626313,"spinlock_wait_cycles":77184,"thread_start_us":567977,"threads_started":4,"wal-append.queue_time_us":355995,"wal-append.run_cpu_time_us":8113,"wal-append.run_wall_time_us":1667075}]]}
I20260709 13:18:05.902033  2943 catalog_manager.cc:5697] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.912402  2943 catalog_manager.cc:5697] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.908560  3124 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 25.
W20260709 13:18:05.789422  3091 leader_election.cc:336] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:05.915728  3091 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:18:05.934692  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 145329us
W20260709 13:18:05.935563  3091 leader_election.cc:336] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:05.936085  3091 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:05.914464  2943 catalog_manager.cc:5697] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 15 to 23. New cstate: current_term: 23 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:05.944774  2943 catalog_manager.cc:5697] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 18 to 26. New cstate: current_term: 26 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:05.955835  3091 leader_election.cc:336] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:05.958417  3091 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
W20260709 13:18:05.964214  3091 leader_election.cc:336] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:05.963415  3762 consensus_peers.cc:597] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:05.967736  3091 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:05.965221  2943 catalog_manager.cc:5697] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 20 to 23, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 23 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:05.943424 11165 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:18:05.976900  3091 leader_election.cc:336] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:05.986233  3091 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:05.948262 10836 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.934098 11292 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:18:05.942416 11303 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:05.993084  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:05.994040  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:05.997097  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:05.998261  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01dd1f72eb8249a6adadee5f3509bcc2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:05.970435  2943 catalog_manager.cc:5697] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:06.051019  3126 raft_consensus.cc:1275] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:18:06.001686  3124 raft_consensus.cc:2393] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 25: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:18:06.054939  2943 catalog_manager.cc:5697] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 19 to 20, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 20 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:06.056743  2943 catalog_manager.cc:5697] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 18 to 19, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 19 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:06.059743  2943 catalog_manager.cc:5697] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 16 to 18, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 18 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:06.061553  2943 catalog_manager.cc:5697] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 22 to 25. New cstate: current_term: 25 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:06.063244  2943 catalog_manager.cc:5697] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 17 to 20, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 20 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.987774 11013 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
W20260709 13:18:06.065056  3165 leader_election.cc:336] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:06.067657  3165 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:06.003784  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:05.989378 11302 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:05.989696 11154 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:06.080677  2943 catalog_manager.cc:5697] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 12 to 16, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 16 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:05.983453 11352 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:18:06.071185 11355 log.cc:927] Time spent T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:18:06.081848 11345 log.cc:927] Time spent T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:18:06.078526 11334 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.999118 10836 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:06.090540 11154 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:06.204665 11154 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:06.211386 11334 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:06.215432 10836 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:06.213673 11334 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:06.095852 11295 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:18:06.298900 11357 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:18:06.249481 11352 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:06.249680 11013 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
W20260709 13:18:06.324793  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 268471us
I20260709 13:18:06.287915 11351 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:18:06.336469  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 273711us
W20260709 13:18:06.333626  3165 leader_election.cc:336] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:06.339139  3165 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
W20260709 13:18:06.343748  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 277079us
W20260709 13:18:06.342437  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 276680us
I20260709 13:18:06.355957  3119 raft_consensus.cc:1275] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:18:06.301648 11352 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:06.386027  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:06.321380 11013 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:06.391768 11364 log.cc:927] Time spent T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:18:06.374951 11158 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:06.398533 11365 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.399312 11365 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:06.402411 11365 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:06.341215 11351 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:06.404834  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 343556us
I20260709 13:18:06.416432  3090 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:06.423625  3792 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 13:18:06.426467  3195 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:18:06.414299 11359 log.cc:927] Time spent T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.144s	user 0.001s	sys 0.001s
I20260709 13:18:06.444391  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:06.446447  3091 leader_election.cc:336] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:06.447149  3091 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:06.438097 11336 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:06.439278 11271 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:06.436904 11228 consensus_queue.cc:1048] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
W20260709 13:18:06.464874  3762 consensus_peers.cc:597] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.482419 10965 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:18:06.466385 11271 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:06.498077 11177 raft_consensus.cc:3055] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 29 LEADER]: Stepping down as leader of term 29
I20260709 13:18:06.498593 11177 raft_consensus.cc:740] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 29 LEADER]: Becoming Follower/Learner. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:18:06.499419 11177 consensus_queue.cc:260] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 29.14, Last appended by leader: 14, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:06.508471 11271 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:18:06.516783 11196 consensus_meta.cc:287] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.000s
I20260709 13:18:06.528326 11013 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:06.530019  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:06.532672 11378 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:06.545037 11311 consensus_meta.cc:287] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161: Time spent flushing consensus metadata: real 0.647s	user 0.010s	sys 0.001s
I20260709 13:18:06.549099 10478 consensus_queue.cc:1048] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:06.553906 11351 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:06.568982 11304 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:06.569172 11177 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:18:06.571228  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:06.571544  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:18:06.579478 11367 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.191s	user 0.002s	sys 0.000s
W20260709 13:18:06.581418 11368 log.cc:927] Time spent T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.189s	user 0.000s	sys 0.002s
I20260709 13:18:06.589252  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:06.591336  3198 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:18:06.599381  3124 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:18:06.604102  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:06.610057  1934 thread.cc:527] Waited for 6000ms trying to join with heartbeat (tid 3076)
I20260709 13:18:06.610846  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:06.612038 11228 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:06.612612 11228 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:06.613317  3124 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:06.615486  3790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:06.617237 11228 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:06.618276  3195 raft_consensus.cc:1240] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 30 FOLLOWER]: Rejecting Update request from peer aaf88538197a49adb8bcf3790309a67e for earlier term 29. Current term is 30. Ops: []
I20260709 13:18:06.628770 11228 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:06.629492 11228 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:06.632088 11228 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:06.638901  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:06.643457  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:06.644717 11284 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:06.646920 11366 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:18:06.656705  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 203360us
I20260709 13:18:06.660317  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:06.662226  3122 raft_consensus.cc:1275] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 13:18:06.667526  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:06.668658  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0fe1dc34db4ff5b5d35916b8a84d4a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:06.680785 11295 consensus_queue.cc:1048] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:18:06.683509  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:06.658806 11271 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.015s
I20260709 13:18:06.664811 11284 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:18:06.707134 11365 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:18:06.709925 10849 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.713249 10849 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:06.713438 11333 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:18:06.716606 10849 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:06.724727  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:06.702708 10748 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:18:06.741672  3165 consensus_peers.cc:597] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.744354 11196 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.756910  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:18:06.763226  3165 leader_election.cc:336] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:06.728853 11293 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:06.763788  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:06.745038 11196 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:06.775637  3794 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
W20260709 13:18:06.791440  3165 consensus_peers.cc:597] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:06.804755 11391 log.cc:927] Time spent T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:18:06.805509 11381 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:18:06.806689 11390 log.cc:927] Time spent T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:18:06.832315  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:06.837949  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:06.843973  3165 leader_election.cc:336] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:06.844501  3165 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:06.769464 11159 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 13:18:06.858650  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:06.863507  3198 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 16. (term mismatch)
I20260709 13:18:06.864111  3198 pending_rounds.cc:85] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: Aborting all ops after (but not including) 15
I20260709 13:18:06.864398  3198 pending_rounds.cc:107] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: Aborting uncommitted NO_OP operation due to leader change: 24.16
I20260709 13:18:06.864701  3198 raft_consensus.cc:2889] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:06.867285  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:06.858090 11241 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:06.884621  3091 leader_election.cc:336] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:06.889858  3091 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:06.876298 11284 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:06.881475 10965 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:06.909610  3762 consensus_peers.cc:597] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:06.917250 11392 log.cc:927] Time spent T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:18:06.904906 11285 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:06.942441  3165 leader_election.cc:336] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:06.952399  3165 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:06.941641 11284 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.920008 10965 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:06.950233 11271 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:18:06.960397 11295 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:06.944408 11285 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:06.988281 11335 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.982463 11284 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:06.989758 11271 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:06.999624 11196 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:18:07.043957 11396 log.cc:927] Time spent T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 13:18:07.071893  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 78825.4us
I20260709 13:18:07.041849 11335 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:07.069171 10849 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:07.080387 11395 log.cc:927] Time spent T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:18:07.095049 11177 consensus_meta.cc:287] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.002s
W20260709 13:18:07.096757 11400 log.cc:927] Time spent T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:18:07.100762 10965 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:07.102716 11271 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:07.103137 11292 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.103747 11292 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:07.104933 11393 log.cc:927] Time spent T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
W20260709 13:18:07.107488 11402 log.cc:927] Time spent T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:18:07.086036 10849 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:07.123219 11335 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:07.123379  2934 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a641b8a516264234af4db10b1a0610f0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e9165fe61ab04bfb9a48889156d5c161 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:07.125010 11284 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:07.127481 11352 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:07.139760  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 245388us
W20260709 13:18:07.140076  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 255458us
I20260709 13:18:07.141333 11301 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:07.142164 11301 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:07.145815  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:07.152194 11165 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:07.152792 11165 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:07.164732  3165 leader_election.cc:336] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:07.165410  3165 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:07.169539  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:18:07.179035  3762 consensus_peers.cc:597] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:07.180316  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:07.183570  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:07.185416  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:18:07.189003  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 114938us
W20260709 13:18:07.190353  3165 consensus_peers.cc:597] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:07.197260  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:07.134689 11292 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:07.198100  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:18:07.198675  3762 consensus_peers.cc:597] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:07.197329  3165 consensus_peers.cc:597] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:07.199957  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:07.202770  3122 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 30.
I20260709 13:18:07.200858  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:07.178548 11165 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:07.204239  3165 consensus_peers.cc:597] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:07.211869  3165 consensus_peers.cc:597] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:07.205899  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:07.208979  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:07.187281 11416 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.216203  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:07.190239 11373 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:07.226559  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:18:07.227728  3091 leader_election.cc:336] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:07.195387 11284 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.230168 11420 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:07.197480 11272 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.233619  3091 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:07.235631  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:07.202286 10849 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:07.240028  3199 raft_consensus.cc:2393] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 20: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:18:07.240484 11284 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:07.243971 11420 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:07.250576  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 45423.8us
I20260709 13:18:07.235965  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:18:07.257366  3091 leader_election.cc:336] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:07.257897  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:07.258008  3091 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:07.266474 10849 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.267114 10849 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:07.258307 11422 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:07.269268 10849 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:07.272450 11284 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:07.274798 11420 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:07.279501  3196 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 29.
I20260709 13:18:07.261897 11350 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:07.270864 10849 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 30 FOLLOWER]: Leader pre-election won for term 31
W20260709 13:18:07.298336  3165 consensus_peers.cc:597] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:07.314141  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:07.315056  3123 raft_consensus.cc:2393] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 30: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:18:07.286597 11112 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.234412 11416 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:07.317539 11112 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:07.310123 10849 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.326606 10849 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:18:07.255213 11272 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:07.328953 11272 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:07.330274 11230 raft_consensus.cc:2955] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 25 LEADER]: Committing config change with OpId 19.12: config changed from index 9 to 12, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:18:07.338371 11406 log.cc:927] Time spent T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: Append to log took a long time: real 0.263s	user 0.004s	sys 0.000s
I20260709 13:18:07.344856 11285 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:07.296931  3197 raft_consensus.cc:2955] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 9 to 12, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:07.350015 11302 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:18:07.350750 11302 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:07.351687 11112 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:07.353081 11302 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:07.354367 11416 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:18:07.365944  3091 consensus_peers.cc:597] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:07.370602  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 101841us
I20260709 13:18:07.372555 11416 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:07.374521  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 63774.2us
I20260709 13:18:07.376446  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:07.380208  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:07.377403  3125 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 19.
W20260709 13:18:07.399900  3091 leader_election.cc:336] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:07.400605  3091 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:07.382689 11416 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:07.406773  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:07.383446 11293 raft_consensus.cc:493] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.415863  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:07.417481  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:07.418991  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:07.423025  3194 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 26: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:18:07.431418 11416 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:07.413646 11365 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:07.435108 11284 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:07.437901 11380 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:07.406572 11302 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:07.444981  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:07.415629 11293 raft_consensus.cc:515] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:07.446310  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:07.447045  3196 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 20.
I20260709 13:18:07.448096 11293 leader_election.cc:290] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:07.449841  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:07.440435 11380 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:07.451779  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:07.446372  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:07.461108 11380 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:07.463284  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:07.467271 11427 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:07.469911  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
W20260709 13:18:07.476490  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 57220.9us
W20260709 13:18:07.477214  3165 leader_election.cc:336] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:07.477633  3165 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:07.482745 11335 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:07.483296 11417 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:07.483312 11335 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.486078  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:07.489711  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:07.457106 11293 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:07.486171  3165 consensus_peers.cc:597] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:07.494993  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:18:07.497884  3091 leader_election.cc:336] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:07.497180  3126 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 25.
I20260709 13:18:07.500247 11335 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:07.501520  3165 leader_election.cc:336] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:07.511987  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:07.509145  3165 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:07.514413  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:07.518491  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:07.512169 11370 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:07.528851 10849 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:07.531162 10849 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 31 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:07.541777  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 29 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:07.539644 11285 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:07.541271  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:07.535400 11302 raft_consensus.cc:2749] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:07.545635 11407 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 29 FOLLOWER]: Advancing to term 30
W20260709 13:18:07.546674  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 45177.3us
I20260709 13:18:07.517184  3798 raft_consensus.cc:2955] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 9 to 12, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:07.551348  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ddfa6bafce4dcab37f071b34290125" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:07.552229  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 29 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:07.557137  3792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:07.580708  3792 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 26.
I20260709 13:18:07.568660  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:07.573205  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:07.594079  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:07.594476  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:07.595345  3117 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:18:07.600325  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:07.601097  3197 raft_consensus.cc:2393] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 30: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
W20260709 13:18:07.610592  1934 thread.cc:527] Waited for 7000ms trying to join with heartbeat (tid 3076)
I20260709 13:18:07.577878 11414 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.595489 11417 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.598148 11430 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:18:07.628052  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:07.622813  3090 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b
I20260709 13:18:07.631875  3117 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 31.
I20260709 13:18:07.632890  2943 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49738 (request call id 154) took 8345 ms. Trace:
I20260709 13:18:07.635118  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:07.637115  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:07.640103  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:07.633574  2943 rpcz_store.cc:276] 0709 13:17:59.276501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.169753 (+1893252us) service_pool.cc:224] Handling call
0709 13:18:07.622047 (+6452294us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:06.560457 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:06.561407 (+   950us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:06.561456 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:18:06.561470 (+    14us) tablet.cc:662] Decoding operations
0709 13:18:06.568730 (+  7260us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:06.568790 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:06.590030 (+ 21240us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:18:06.633394 (+ 43364us) tablet.cc:701] Row locks acquired
0709 13:18:06.633423 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:18:06.633618 (+   195us) write_op.cc:270] Start()
0709 13:18:06.639541 (+  5923us) write_op.cc:276] Timestamp: P: 1783603086633557 usec, L: 0
0709 13:18:06.641213 (+  1672us) op_driver.cc:348] REPLICATION: starting
0709 13:18:06.666533 (+ 25320us) log.cc:844] Serialized 7940 byte log entry
0709 13:18:07.083795 (+417262us) op_driver.cc:464] REPLICATION: finished
0709 13:18:07.127557 (+ 43762us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b4400022b4c. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d1ecc85 00007ff82d1ed6a2 00007ff82ff5f1db 00007ff82ff5aaaf 00007ff82d2a90ac 00007ff836103ab9 00007ff82d2c569b 00007ff82d2c393f 00007ff82d2c5c02 00007ff833de9ef0
0709 13:18:07.245120 (+117563us) write_op.cc:301] APPLY: starting
0709 13:18:07.245210 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:07.348361 (+103151us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:07.348401 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:07.501167 (+152766us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:07.501527 (+   360us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=0,mrs_lookups=0
0709 13:18:07.501577 (+    50us) write_op.cc:312] APPLY: finished
0709 13:18:07.502032 (+   455us) log.cc:844] Serialized 180 byte log entry
0709 13:18:07.502208 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:07.502415 (+   207us) write_op.cc:454] Released schema lock
0709 13:18:07.502473 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:07.523158 (+ 20685us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:07.523197 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":270698,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":158354,"apply.run_cpu_time_us":30984,"apply.run_wall_time_us":270311,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87767,"num_ops":20,"prepare.queue_time_us":226130,"prepare.run_cpu_time_us":26927,"prepare.run_wall_time_us":178632,"raft.queue_time_us":144927,"raft.run_cpu_time_us":9759,"raft.run_wall_time_us":126429,"replication_time_us":434267,"spinlock_wait_cycles":3499520,"thread_start_us":345074,"threads_started":4,"wal-append.queue_time_us":126544}]]}
I20260709 13:18:07.628548 11430 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.616504 11335 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:07.642200 11271 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:07.654140  2935 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 74048.5us
I20260709 13:18:07.640561 10748 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:07.637832 11350 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:07.655627 11350 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting leader election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:18:07.656101 11350 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:07.638370 11293 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:07.641366 11301 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:18:07.671190 11335 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:07.666620 11427 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.671367 11272 raft_consensus.cc:493] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.627741 11417 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:07.672729 11272 raft_consensus.cc:515] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:07.673167  3191 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 26.
I20260709 13:18:07.674401 11417 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:07.674922 11272 leader_election.cc:290] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:07.679977  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:07.645364 11430 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:18:07.619961 11414 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:07.684191  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:07.686035  3091 consensus_peers.cc:597] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:07.691833  3091 consensus_peers.cc:597] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:07.692667  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:07.672176 11427 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:07.700239  3091 consensus_peers.cc:597] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:07.705132 10748 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:18:07.709846  3015 leader_election.cc:304] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:07.695700 11414 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:07.720043 11427 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:07.718139  3015 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:07.726660 11416 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 31 FOLLOWER]: Leader election won for term 31
I20260709 13:18:07.727289 11416 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 31 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:18:07.728262 11416 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 29.15, Last appended by leader: 15, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:07.731738  3091 consensus_peers.cc:597] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:07.733704 11407 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:18:07.733948  2997 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:07.734411  2997 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:07.734449  3194 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 30 FOLLOWER]: Advancing to term 31
W20260709 13:18:07.734814  2997 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:07.742695 11435 log.cc:927] Time spent T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.006s
I20260709 13:18:07.721122 11335 raft_consensus.cc:2749] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:07.746536  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:07.747212  3197 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:07.747272  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:07.748440  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:07.749188  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:07.749609  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:07.746537  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:07.750552  3121 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:07.751011  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:07.756443  3194 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 31.
I20260709 13:18:07.758009  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fbe6f8795fb454182fceb2dad61e5c6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:07.759578  3197 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:18:07.779120 11292 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.779729 11292 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:18:07.780436 11430 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:07.781837  3797 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 27: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
W20260709 13:18:07.782945  3165 consensus_peers.cc:597] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:07.781324 11350 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:07.788122  3126 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 26.
I20260709 13:18:07.784968  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:07.794067  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:07.801553  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:07.802281  3194 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 in current term 26: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:18:07.797214  3121 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 21.
I20260709 13:18:07.804404  3791 raft_consensus.cc:2368] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 26. Current term is 27.
I20260709 13:18:07.789105 11292 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:07.789650 11335 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:07.805069  3165 consensus_peers.cc:597] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:07.805498 11335 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:07.807663 11335 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:07.808197 11335 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:07.809094  3015 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:07.811510  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:07.811691  3015 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:18:07.812779  3121 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:18:07.751425 11301 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:18:07.813351  3090 leader_election.cc:400] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 26. Current term is 27.
I20260709 13:18:07.812306  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:07.813769  3090 leader_election.cc:403] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260709 13:18:07.815796 11159 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:18:07.816212 11159 raft_consensus.cc:493] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.816535 11159 raft_consensus.cc:3060] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:18:07.817029  3091 consensus_peers.cc:597] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:07.819857  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:07.788946 11365 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.825116  3121 raft_consensus.cc:2468] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 27.
I20260709 13:18:07.808791 11430 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:07.828061 11336 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109) with higher term. Message: Invalid argument: T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate f20672b2852447a6bc1e137c4dd40904 for earlier term 26. Current term is 27.
I20260709 13:18:07.827698 11365 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:07.789602 11350 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: Requested vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:07.836619  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:07.840551  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:07.841285  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:07.838815  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:07.847301 11365 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:07.823573 11335 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:07.829399 11292 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:07.850032 11159 raft_consensus.cc:515] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:07.850517  3762 consensus_peers.cc:597] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:07.854377  3191 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 27: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:18:07.854346  3761 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:18:07.854802  3091 consensus_peers.cc:597] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:07.856333 11112 raft_consensus.cc:2804] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:18:07.856822 11112 raft_consensus.cc:697] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 27 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:18:07.857677 11112 consensus_queue.cc:237] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:07.862999  3762 consensus_peers.cc:597] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:07.863866 11292 raft_consensus.cc:697] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:18:07.865090 11292 consensus_queue.cc:237] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.8, Last appended by leader: 8, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:07.866532 11159 leader_election.cc:290] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:07.867831  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:07.869303  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2dc1155b33b4fbc830d189f5e109f78" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:07.877020  3121 raft_consensus.cc:2393] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 27: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
I20260709 13:18:07.867465  3015 leader_election.cc:304] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:07.879462 11416 raft_consensus.cc:2749] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:07.880366  3164 leader_election.cc:304] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:07.881467  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:07.882241 11407 raft_consensus.cc:2749] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:18:07.885952 11292 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:07.885895  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:07.888357  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:07.890255  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:07.890626  3165 consensus_peers.cc:597] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:07.891283 11292 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:07.892560  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:07.894490 11416 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:07.899477  2941 catalog_manager.cc:5697] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:07.934159  2941 catalog_manager.cc:5697] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 15 to 16, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 16 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:07.995692  3762 consensus_peers.cc:597] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:08.110518 11292 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.111403 11292 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:08.115388 11292 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:08.128448  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:08.166569  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:08.196835  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:08.203997 10849 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:08.230830 10849 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:08.232591 10849 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:08.248186  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:08.248484  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24410f20507a4acf874cdb6e84c306f6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:08.250942  3015 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:08.251931 11416 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:08.247179 10849 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:08.277525 11284 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.277571  3191 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
W20260709 13:18:08.278309  3762 consensus_peers.cc:597] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:08.278196 11284 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:08.280812 11284 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:08.286971  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 31 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:08.287699  3191 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 30.
I20260709 13:18:08.293296  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 31 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:08.294131  3117 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 30.
I20260709 13:18:08.291612  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e; no voters: 
I20260709 13:18:08.302048 11196 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 13:18:08.302496 11196 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.302882 11196 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:18:08.287237 11428 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.016s
I20260709 13:18:08.333204  3117 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 31 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 29 index: 15. Preceding OpId from leader: term: 31 index: 16. (index mismatch)
I20260709 13:18:08.335775 11196 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:08.338478  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 31 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:08.339110  3125 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:18:08.339715  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 31 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:08.340334  3192 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:18:08.351660 11293 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:18:08.359681  3194 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 31 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 29 index: 15. Preceding OpId from leader: term: 31 index: 16. (index mismatch)
I20260709 13:18:08.378041  3125 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 31.
I20260709 13:18:08.377375 11293 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 13:18:08.380052  3015 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:08.337970 11196 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 31 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:08.383023 10849 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 31 FOLLOWER]: Leader election won for term 31
I20260709 13:18:08.383575 10849 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 31 LEADER]: Becoming Leader. State: Replica: aaf88538197a49adb8bcf3790309a67e, State: Running, Role: LEADER
I20260709 13:18:08.383625  3192 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaf88538197a49adb8bcf3790309a67e in term 31.
I20260709 13:18:08.384550 10849 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 29.14, Last appended by leader: 14, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:08.396014  3165 consensus_peers.cc:597] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:08.554625 10849 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.556007 10849 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:08.559338  3165 consensus_peers.cc:597] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:08.572664  3125 raft_consensus.cc:1275] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 8. Preceding OpId from leader: term: 21 index: 9. (index mismatch)
W20260709 13:18:08.576172  3091 consensus_peers.cc:597] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:08.548640  3117 raft_consensus.cc:1275] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 13:18:08.582616 11428 consensus_queue.cc:1048] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 13:18:08.590922 11293 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:08.598712 10849 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:18:08.611294  1934 thread.cc:527] Waited for 8000ms trying to join with heartbeat (tid 3076)
I20260709 13:18:08.611505  3194 raft_consensus.cc:1275] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 19 index: 8. Preceding OpId from leader: term: 21 index: 9. (index mismatch)
I20260709 13:18:08.637106  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:08.661952 11164 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.662870 11164 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:08.673120  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:18:08.677678  3762 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 249 similar messages]
I20260709 13:18:08.678122  3111 tablet_service.cc:1558] Processing DeleteTablet for tablet fcf5db67d30f487d873766886c2ef408 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 8 (current committed config index is 12)) from {username='slave'} at 127.0.0.1:42724
W20260709 13:18:08.709472  3165 consensus_peers.cc:597] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:08.716933  3165 consensus_peers.cc:597] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:08.719465 11164 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:08.732396  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:08.732933 11293 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.734052 11284 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.733925 11293 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:08.734843 11284 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:08.736927 11293 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:08.740772  2934 catalog_manager.cc:5028] TS f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): tablet fcf5db67d30f487d873766886c2ef408 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
W20260709 13:18:08.711185  3762 consensus_peers.cc:597] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:08.733368  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:08.758667  2941 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57744 (request call id 245) took 62680 ms (client timeout 15000 ms). Trace:
I20260709 13:18:08.737454 11284 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:08.775272  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:18:08.778105  3762 consensus_peers.cc:597] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:08.778280 11196 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:18:08.779503 11196 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:08.787556  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:08.789337 11284 raft_consensus.cc:493] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.790123 11284 raft_consensus.cc:515] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:08.796973 11284 leader_election.cc:290] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:08.802462  3125 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 31 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 29 index: 14. Preceding OpId from leader: term: 31 index: 15. (index mismatch)
I20260709 13:18:08.817997  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:08.819427  2942 catalog_manager.cc:5697] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 19 to 20, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 20 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:08.821650  2942 catalog_manager.cc:5697] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 18 to 21, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 21 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
W20260709 13:18:08.759342  2941 rpcz_store.cc:269] 0709 13:17:06.077935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.081423 (+  3488us) service_pool.cc:224] Handling call
0709 13:18:08.758343 (+62676920us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:07.961005 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:07.961594 (+   589us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:07.961628 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:18:07.961648 (+    20us) tablet.cc:662] Decoding operations
0709 13:18:07.983037 (+ 21389us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:07.983123 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:07.983160 (+    37us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:07.983507 (+   347us) tablet.cc:701] Row locks acquired
0709 13:18:07.983525 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:18:07.983693 (+   168us) write_op.cc:270] Start()
0709 13:18:07.983846 (+   153us) write_op.cc:276] Timestamp: P: 1783603087983637 usec, L: 0
0709 13:18:07.983874 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:18:07.984590 (+   716us) log.cc:844] Serialized 924 byte log entry
0709 13:18:08.002616 (+ 18026us) op_driver.cc:464] REPLICATION: finished
0709 13:18:08.111824 (+109208us) write_op.cc:301] APPLY: starting
0709 13:18:08.112166 (+   342us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:08.125305 (+ 13139us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:08.127047 (+  1742us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:08.173565 (+ 46518us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:08.173783 (+   218us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:18:08.173836 (+    53us) write_op.cc:312] APPLY: finished
0709 13:18:08.186482 (+ 12646us) log.cc:844] Serialized 33 byte log entry
0709 13:18:08.187943 (+  1461us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:08.188052 (+   109us) write_op.cc:454] Released schema lock
0709 13:18:08.188092 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:08.188459 (+   367us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:08.188490 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2138,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":108356,"apply.run_cpu_time_us":9560,"apply.run_wall_time_us":76835,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8364,"num_ops":2,"prepare.queue_time_us":16992,"prepare.run_cpu_time_us":3046,"prepare.run_wall_time_us":23932,"replication_time_us":18567,"thread_start_us":10231,"threads_started":1}]]}
I20260709 13:18:08.829659  3111 tablet_service.cc:1558] Processing DeleteTablet for tablet fcf5db67d30f487d873766886c2ef408 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 8 (current committed config index is 12)) from {username='slave'} at 127.0.0.1:42724
I20260709 13:18:08.803802  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:08.834023  2934 catalog_manager.cc:5028] TS f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): tablet fcf5db67d30f487d873766886c2ef408 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:18:08.835253  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:08.836014 10849 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:08.833505 11196 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:18:08.840039  3165 consensus_peers.cc:597] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:08.845475  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348c9fe65bc24c3caf5c132e715a13ba" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:08.846860  2942 catalog_manager.cc:5697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 23 to 27. New cstate: current_term: 27 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:08.850626  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:08.859975 11196 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.860800 11196 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:08.863333 11196 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:08.866313  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d362d3e2ef4546ae699b5d8f4db504" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:08.867831  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:08.870922  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:08.872776 11292 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:08.876607  3015 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:08.877404 11196 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:08.880481  2944 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57744 (request call id 244) took 83317 ms (client timeout 15000 ms). Trace:
W20260709 13:18:08.881008  2944 rpcz_store.cc:269] 0709 13:16:45.563229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.563554 (+   325us) service_pool.cc:224] Handling call
0709 13:18:08.880292 (+83316738us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":198069,"reported_tablets":51}
I20260709 13:18:08.888336  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:08.849064  2942 catalog_manager.cc:5697] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 18 to 23, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 23 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:08.893020  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:08.895116 11196 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:08.895865  2942 catalog_manager.cc:5697] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 21 to 26. New cstate: current_term: 26 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:08.910764  2942 catalog_manager.cc:5697] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:08.900702  3015 leader_election.cc:304] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:08.913288  3165 consensus_peers.cc:597] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:08.913411 11196 raft_consensus.cc:2749] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:08.912599  2942 catalog_manager.cc:5697] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 16 to 21, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 21 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.936244  3191 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 31 FOLLOWER]: Refusing update from remote peer aaf88538197a49adb8bcf3790309a67e: Log matching property violated. Preceding OpId in replica: term: 29 index: 14. Preceding OpId from leader: term: 31 index: 15. (index mismatch)
I20260709 13:18:08.927450  2942 catalog_manager.cc:5697] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:08.937923  2942 catalog_manager.cc:5697] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 11 to 24, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 24 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:08.942502  2942 catalog_manager.cc:5697] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:08.946115 11196 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:08.944139  2942 catalog_manager.cc:5697] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 19 to 21, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 21 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.949020  2942 catalog_manager.cc:5697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:08.953730  2942 catalog_manager.cc:5697] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 15 to 17, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 17 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:08.979789  3165 consensus_peers.cc:597] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:08.987210  2942 catalog_manager.cc:5697] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 19 to 23, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 23 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:09.006304  2942 catalog_manager.cc:5697] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 22 to 23, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 23 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:09.013911  2942 catalog_manager.cc:5697] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 18 to 23. New cstate: current_term: 23 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:09.016386  2942 catalog_manager.cc:5697] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:09.146051 11292 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:09.146258  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet c0433e7a23a246a290c4170888e0d7ee: Illegal state: Replica 501fdf2af2bc4b0c971ae880e98f466b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 23 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:09.147037 11292 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:09.153656  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:09.155366 11292 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:09.157408  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c2f28b50c354b648096e08cf4f5d54a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:09.160723  3015 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:09.162983 11196 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:09.167263 11416 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.167976 11416 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:09.171902 11416 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:09.174058  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:09.178009  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0940cf459a7741b58bd85191d095a404" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:09.179738  3015 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:09.180940 11196 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:09.249828  3187 tablet_service.cc:1558] Processing DeleteTablet for tablet a1ccbbf27f0b436d8c79dfb6db7fc703 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:60578
W20260709 13:18:09.255856  2942 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57750 (request call id 233) took 18799 ms (client timeout 15000 ms). Trace:
W20260709 13:18:09.262151  3165 consensus_peers.cc:597] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:09.256187  2942 rpcz_store.cc:269] 0709 13:17:50.450045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.452120 (+  2075us) service_pool.cc:224] Handling call
0709 13:17:50.857627 (+405507us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b54000d98d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031d090 00007ff8303bbf3a 00007ff8361721cc 00007ff83627037e 00007ff8347312a4 00007ff834731232 00007ff834731161 00007ff8347310dc 00007ff834730392 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:18:09.249320 (+18391693us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:09.074758 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:09.075610 (+   852us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:09.075664 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:18:09.075684 (+    20us) tablet.cc:662] Decoding operations
0709 13:18:09.082727 (+  7043us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:09.082831 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:09.082864 (+    33us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:18:09.084499 (+  1635us) tablet.cc:701] Row locks acquired
0709 13:18:09.084559 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:18:09.084755 (+   196us) write_op.cc:270] Start()
0709 13:18:09.084906 (+   151us) write_op.cc:276] Timestamp: P: 1783603089084689 usec, L: 0
0709 13:18:09.084928 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:18:09.085722 (+   794us) log.cc:844] Serialized 6740 byte log entry
0709 13:18:09.140441 (+ 54719us) op_driver.cc:464] REPLICATION: finished
0709 13:18:09.142891 (+  2450us) write_op.cc:301] APPLY: starting
0709 13:18:09.143014 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:09.179323 (+ 36309us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:09.179470 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:09.202001 (+ 22531us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:09.202441 (+   440us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 13:18:09.202504 (+    63us) write_op.cc:312] APPLY: finished
0709 13:18:09.203010 (+   506us) log.cc:844] Serialized 156 byte log entry
0709 13:18:09.203951 (+   941us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:09.204142 (+   191us) write_op.cc:454] Released schema lock
0709 13:18:09.204224 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:09.204674 (+   450us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:09.204708 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":882070,"reported_tablets":51,"spinlock_wait_cycles":25081216,"child_traces":[["op",{"apply.queue_time_us":2112,"apply.run_cpu_time_us":26535,"apply.run_wall_time_us":61770,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75221,"num_ops":17,"prepare.queue_time_us":33426,"prepare.run_cpu_time_us":6187,"prepare.run_wall_time_us":47607,"replication_time_us":55316,"thread_start_us":33982,"threads_started":2}]]}
W20260709 13:18:09.289433  3165 consensus_peers.cc:597] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:09.291095  2941 catalog_manager.cc:5697] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 9 to 12, term changed from 18 to 25, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 25 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:18:09.293256  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 55172.9us
I20260709 13:18:09.300484  3117 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:18:09.294852  2941 catalog_manager.cc:5697] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 20 to 23, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 23 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:09.314497  2941 catalog_manager.cc:5697] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 21 to 25, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 25 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:09.322912  2941 catalog_manager.cc:5697] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 20 to 23, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 23 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:09.325002  2941 catalog_manager.cc:5697] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:09.328222  2941 catalog_manager.cc:5697] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:09.331522  2934 catalog_manager.cc:5028] TS 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): tablet a1ccbbf27f0b436d8c79dfb6db7fc703 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
W20260709 13:18:09.343185  3165 consensus_peers.cc:597] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:09.350256  3165 consensus_peers.cc:597] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:09.344818  2941 catalog_manager.cc:5697] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 22 to 25, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 25 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:09.356199  3091 consensus_peers.cc:597] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:09.358184 11416 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:09.358969 11416 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:09.361336 11416 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:09.362746  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:09.363170  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:09.365087  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:09.375525 11292 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:09.357051  2941 catalog_manager.cc:5697] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 15 to 17, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 17 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:09.387837  2941 catalog_manager.cc:5697] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 23 to 24, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 24 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:09.389932  2941 catalog_manager.cc:5697] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 22 to 25, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 25 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:09.392168  2941 catalog_manager.cc:5697] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 18 to 19, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 19 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:09.393854  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 57908.2us
I20260709 13:18:09.404188  3194 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:18:09.406571  3090 consensus_peers.cc:597] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 006a17784d3e4b139686bca788cab915. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:09.395349  2941 catalog_manager.cc:5697] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:09.408825  2941 catalog_manager.cc:5697] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 21 to 22, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 22 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:09.410602  2941 catalog_manager.cc:5697] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:09.412384  2941 catalog_manager.cc:5697] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 23 to 25, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 25 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:09.414067 11301 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:09.422140  2941 catalog_manager.cc:5697] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 20 to 21, leader changed from e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 21 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:09.437803 11416 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:09.438661 11416 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:09.441660  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:09.441159 11416 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:09.455891 11470 raft_consensus.cc:2955] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index -1 to 15, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:18:09.457149  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038f072ecdcc4679a46740d78fb0dbd7" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:09.457894 11416 raft_consensus.cc:493] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.458674 11416 raft_consensus.cc:515] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:09.459666  3194 raft_consensus.cc:2955] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index -1 to 15, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:18:09.461645 11416 leader_election.cc:290] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:09.462711  3015 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:09.463124  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:09.464659  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22edd8baac97497aad3f2c9971868c48" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:09.465986 11416 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:09.466591  3015 leader_election.cc:304] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:09.469029 11416 raft_consensus.cc:2749] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:09.469383  3165 consensus_peers.cc:597] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:09.531298 11416 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.532106 11416 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:09.538849 11416 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:09.545338  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:09.558279  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:09.561290  3015 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:09.562772 11196 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:09.571110  3762 consensus_peers.cc:597] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:09.599098 11196 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.599858 11196 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:09.602335 11196 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:18:09.606338  3762 consensus_peers.cc:597] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:09.611770  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:09.612792  1934 thread.cc:527] Waited for 9000ms trying to join with heartbeat (tid 3076)
I20260709 13:18:09.619093  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ccbbf27f0b436d8c79dfb6db7fc703" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:09.664172  3192 consensus_queue.cc:237] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:18:09.660115 11196 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.670553 11196 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:09.661232  3015 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:09.676474 11416 raft_consensus.cc:493] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.677240 11416 raft_consensus.cc:515] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:09.680963 11292 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:09.698828 11416 leader_election.cc:290] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:09.715866 11196 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:09.720208  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:09.730675  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:09.738108  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de94f7d51a554137acbf3110ce91f2fc" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:09.741086  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:18:09.756399  3762 consensus_peers.cc:597] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:09.762439  3165 consensus_peers.cc:597] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:09.777462  3164 consensus_peers.cc:597] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109): Couldn't send request to peer e9165fe61ab04bfb9a48889156d5c161. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e540d8ab4d64f8c8fd8c432fbc5ac3a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:09.788653  3117 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:18:09.790616 11413 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:18:09.808570  3165 consensus_peers.cc:597] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:09.825995 11413 raft_consensus.cc:2955] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 LEADER]: Committing config change with OpId 24.15: config changed from index -1 to 15, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:18:09.849056  3125 raft_consensus.cc:2955] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Committing config change with OpId 24.15: config changed from index -1 to 15, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
W20260709 13:18:09.862623  3091 consensus_peers.cc:597] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:09.867331  2997 auto_rebalancer.cc:629] Failed to schedule move for tablet f12375b5613c4d08b52a1a44ccb82294: Illegal state: Replica 501fdf2af2bc4b0c971ae880e98f466b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 26 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
W20260709 13:18:09.891886  3165 consensus_peers.cc:597] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:09.894106  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:09.895252 11292 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:09.900214  3015 leader_election.cc:304] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:09.943899 11292 raft_consensus.cc:2749] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:09.946079 11480 ts_tablet_manager.cc:933] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:09.948345  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 48240.2us
I20260709 13:18:09.980028  2941 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49738 (request call id 155) took 2082 ms. Trace:
W20260709 13:18:10.011129  3091 consensus_peers.cc:597] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:10.017727 11480 tablet_copy_client.cc:323] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.130:38619
I20260709 13:18:10.020613  3135 tablet_copy_service.cc:140] P f20672b2852447a6bc1e137c4dd40904: Received BeginTabletCopySession request for tablet 006a17784d3e4b139686bca788cab915 from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:55318)
I20260709 13:18:10.021425  3135 tablet_copy_service.cc:161] P f20672b2852447a6bc1e137c4dd40904: Beginning new tablet copy session on tablet 006a17784d3e4b139686bca788cab915 from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:55318: session id = e9165fe61ab04bfb9a48889156d5c161-006a17784d3e4b139686bca788cab915
I20260709 13:18:10.033180  3135 tablet_copy_source_session.cc:215] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:09.980664  2941 rpcz_store.cc:276] 0709 13:18:07.897864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.845101 (+947237us) service_pool.cc:224] Handling call
0709 13:18:09.979931 (+1134830us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:09.500588 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:09.501276 (+   688us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:09.501314 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:18:09.501335 (+    21us) tablet.cc:662] Decoding operations
0709 13:18:09.502732 (+  1397us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:09.502792 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:09.502838 (+    46us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:18:09.504067 (+  1229us) tablet.cc:701] Row locks acquired
0709 13:18:09.504086 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:18:09.504243 (+   157us) write_op.cc:270] Start()
0709 13:18:09.504361 (+   118us) write_op.cc:276] Timestamp: P: 1783603089504196 usec, L: 0
0709 13:18:09.504381 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:18:09.505126 (+   745us) log.cc:844] Serialized 6345 byte log entry
0709 13:18:09.518243 (+ 13117us) op_driver.cc:464] REPLICATION: finished
0709 13:18:09.518779 (+   536us) write_op.cc:301] APPLY: starting
0709 13:18:09.518882 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:09.624135 (+105253us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:09.624257 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:09.779897 (+155640us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:09.811907 (+ 32010us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 13:18:09.811967 (+    60us) write_op.cc:312] APPLY: finished
0709 13:18:09.812413 (+   446us) log.cc:844] Serialized 148 byte log entry
0709 13:18:09.812606 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:09.812794 (+   188us) write_op.cc:454] Released schema lock
0709 13:18:09.812849 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:09.856791 (+ 43942us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:09.856836 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":284,"apply.run_cpu_time_us":26654,"apply.run_wall_time_us":337930,"cfile_cache_hit":64,"cfile_cache_hit_bytes":66912,"num_ops":16,"prepare.queue_time_us":555,"prepare.run_cpu_time_us":4911,"prepare.run_wall_time_us":59375,"replication_time_us":13659}]]}
I20260709 13:18:10.112746 11480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006a17784d3e4b139686bca788cab915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:10.009029  2943 catalog_manager.cc:5697] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 20 to 23, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 23 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:10.118749  2943 catalog_manager.cc:5697] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 21 to 23, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 23 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:10.120234  2943 catalog_manager.cc:5697] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 15 to 23, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 23 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.153132  2943 catalog_manager.cc:5697] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.156245  2943 catalog_manager.cc:5697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 27 to 29, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 29 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:10.157920  2943 catalog_manager.cc:5697] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.159623  2943 catalog_manager.cc:5697] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 21 to 25, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 25 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.171898 11480 tablet_copy_client.cc:806] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:10.174527 11473 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:10.182873  3091 consensus_peers.cc:597] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:10.185405 11480 tablet_copy_client.cc:670] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:10.185302 11473 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:10.193526 11473 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:10.196147 11480 tablet_copy_client.cc:538] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:18:10.236604  3165 consensus_peers.cc:597] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:10.238415  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:10.241173  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:10.241679 11196 raft_consensus.cc:493] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.242288 11196 raft_consensus.cc:515] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:10.244448 11196 leader_election.cc:290] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:10.257368  3762 consensus_peers.cc:597] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:10.161156  2943 catalog_manager.cc:5697] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 20 to 22, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 22 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:10.261808 11480 tablet_bootstrap.cc:492] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
W20260709 13:18:10.292357  3165 consensus_peers.cc:597] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:10.302536  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:10.273438  2943 catalog_manager.cc:5697] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 20 to 28. New cstate: current_term: 28 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.311930  2943 catalog_manager.cc:5697] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 22 to 26, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 26 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:10.327539  2943 catalog_manager.cc:5697] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 24 to 25, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 25 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:10.317937 11196 raft_consensus.cc:493] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:10.331235 11196 raft_consensus.cc:515] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:10.333441 11196 leader_election.cc:290] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:10.329556  3015 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:10.335829 11196 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:10.304090  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d72320f324f482bb7e1e27290040a3d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:10.338866  2943 catalog_manager.cc:5697] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:10.350950  2943 catalog_manager.cc:5697] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 20 to 21, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 21 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.363595  2943 catalog_manager.cc:5697] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 15 to 18, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 18 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.359649  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:10.359190  3015 leader_election.cc:304] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:10.361724  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a958b84326034dfd93407cbe60f84548" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:10.376740 11473 raft_consensus.cc:2749] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:10.383540  2943 catalog_manager.cc:5697] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 18 to 24. New cstate: current_term: 24 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:10.394335  2943 catalog_manager.cc:5697] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
W20260709 13:18:10.397168  3762 consensus_peers.cc:597] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:10.397070  2943 catalog_manager.cc:5697] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 15 to 20, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 20 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:10.398569  2943 catalog_manager.cc:5697] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 17 to 21, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 21 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:10.399912  3091 consensus_peers.cc:597] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:10.406006  2943 catalog_manager.cc:5697] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 18 to 25, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 25 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.410856 11484 ts_tablet_manager.cc:933] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161: Initiating tablet copy from peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:10.416011  2943 catalog_manager.cc:5697] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:10.425809  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 49116.1us
I20260709 13:18:10.423353  2943 catalog_manager.cc:5697] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.436607  3015 leader_election.cc:304] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:10.444725 11196 raft_consensus.cc:2749] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:10.485368  3091 consensus_peers.cc:597] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:10.490870 11484 tablet_copy_client.cc:323] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Beginning tablet copy session from remote peer at address 127.1.227.131:38665
W20260709 13:18:10.494912  3091 consensus_peers.cc:597] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:10.496806  3210 tablet_copy_service.cc:140] P 501fdf2af2bc4b0c971ae880e98f466b: Received BeginTabletCopySession request for tablet 6e540d8ab4d64f8c8fd8c432fbc5ac3a from peer e9165fe61ab04bfb9a48889156d5c161 ({username='slave'} at 127.0.0.1:34728)
I20260709 13:18:10.497470  3210 tablet_copy_service.cc:161] P 501fdf2af2bc4b0c971ae880e98f466b: Beginning new tablet copy session on tablet 6e540d8ab4d64f8c8fd8c432fbc5ac3a from peer e9165fe61ab04bfb9a48889156d5c161 at {username='slave'} at 127.0.0.1:34728: session id = e9165fe61ab04bfb9a48889156d5c161-6e540d8ab4d64f8c8fd8c432fbc5ac3a
I20260709 13:18:10.506129 11196 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.506861 11196 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:10.509088 11196 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:10.517894 11480 tablet_bootstrap.cc:492] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=2 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:10.519054 11480 tablet_bootstrap.cc:492] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:18:10.519937 11480 ts_tablet_manager.cc:1403] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.258s	user 0.054s	sys 0.010s
I20260709 13:18:10.525925  3210 tablet_copy_source_session.cc:215] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:10.530794 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e540d8ab4d64f8c8fd8c432fbc5ac3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:10.539450 11196 raft_consensus.cc:493] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.540759 11196 raft_consensus.cc:515] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:10.545070 11196 leader_election.cc:290] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:10.551646 11480 raft_consensus.cc:359] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:18:10.552740 11480 raft_consensus.cc:740] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:18:10.553494 11480 consensus_queue.cc:260] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:18:10.572549 11480 ts_tablet_manager.cc:1434] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 13:18:10.574581  3135 tablet_copy_service.cc:342] P f20672b2852447a6bc1e137c4dd40904: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-006a17784d3e4b139686bca788cab915 received from {username='slave'} at 127.0.0.1:55318
I20260709 13:18:10.575121  3135 tablet_copy_service.cc:434] P f20672b2852447a6bc1e137c4dd40904: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-006a17784d3e4b139686bca788cab915 on tablet 006a17784d3e4b139686bca788cab915 with peer e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:10.577271  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:10.579356  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:10.585202  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:10.586988  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44281a32716140bc805b71db0e071122" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:10.588234 11196 raft_consensus.cc:493] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.588999 11196 raft_consensus.cc:515] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:10.591681 11196 leader_election.cc:290] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:10.610792  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:10.613236  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0bf95c7c28416eb4a727eac91af0d0" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:18:10.614467  1934 thread.cc:527] Waited for 10000ms trying to join with heartbeat (tid 3076)
I20260709 13:18:10.622267  3015 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:10.631042 11483 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:10.641453  3015 leader_election.cc:304] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:10.646930  3015 leader_election.cc:304] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:10.648334 11196 raft_consensus.cc:2749] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:10.648118 11292 raft_consensus.cc:2749] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:18:10.662282 11484 tablet_copy_client.cc:806] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:10.663082 11484 tablet_copy_client.cc:670] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:10.685377 11484 tablet_copy_client.cc:538] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:18:10.701547  3762 consensus_peers.cc:597] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:10.720304 11484 tablet_bootstrap.cc:492] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161: Bootstrap starting.
W20260709 13:18:10.795368  3165 consensus_peers.cc:597] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:10.819111  3794 raft_consensus.cc:1217] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [term 23 LEARNER]: Deduplicated request from leader. Original: 23.14->[23.15-23.15]   Dedup: 23.15->[]
I20260709 13:18:10.825127 11292 raft_consensus.cc:493] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.825910 11292 raft_consensus.cc:515] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:10.828730 11292 leader_election.cc:290] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:10.830590  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:10.833482  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe8825ca0db45529c5a46ef6e9ba53d" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:10.835239  3015 leader_election.cc:304] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:10.836277 11196 raft_consensus.cc:2749] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:10.870535  3762 consensus_peers.cc:597] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:10.886214  2941 catalog_manager.cc:5697] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:10.951201  3762 consensus_peers.cc:597] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:10.957636 11292 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.958400 11292 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:10.960961  3091 consensus_peers.cc:597] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:10.961301  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:10.962358 11292 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:10.962612  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e540d8ab4d64f8c8fd8c432fbc5ac3a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:10.964135  3015 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:10.965341 11196 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:10.972028 11196 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:10.972661 11196 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:10.975082 11196 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:10.982668  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:10.985540  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921c451a21e944ff8a8e6ec22207eca3" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:10.994730  3015 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:10.996961 11486 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:11.016978  2946 catalog_manager.cc:5697] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 15 to 19, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 19 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:11.027737  3165 consensus_peers.cc:597] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:11.030768  2946 catalog_manager.cc:5697] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 19 to 23, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 23 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:11.034272  2943 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57750 (request call id 234) took 4203 ms. Trace:
I20260709 13:18:11.034704  2943 rpcz_store.cc:276] 0709 13:18:06.831043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.666366 (+835323us) service_pool.cc:224] Handling call
0709 13:18:11.034194 (+3367828us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:10.571625 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:10.572231 (+   606us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:10.572263 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:18:10.572284 (+    21us) tablet.cc:662] Decoding operations
0709 13:18:10.595104 (+ 22820us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:10.595184 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:10.595214 (+    30us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:18:10.596705 (+  1491us) tablet.cc:701] Row locks acquired
0709 13:18:10.596725 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:18:10.596879 (+   154us) write_op.cc:270] Start()
0709 13:18:10.596999 (+   120us) write_op.cc:276] Timestamp: P: 1783603090596830 usec, L: 0
0709 13:18:10.597022 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:18:10.602329 (+  5307us) log.cc:844] Serialized 8294 byte log entry
0709 13:18:10.627870 (+ 25541us) op_driver.cc:464] REPLICATION: finished
0709 13:18:10.651630 (+ 23760us) write_op.cc:301] APPLY: starting
0709 13:18:10.651722 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:10.709236 (+ 57514us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:10.709356 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:10.845406 (+136050us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:10.845727 (+   321us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=0,mrs_lookups=0
0709 13:18:10.845800 (+    73us) write_op.cc:312] APPLY: finished
0709 13:18:10.846205 (+   405us) log.cc:844] Serialized 188 byte log entry
0709 13:18:10.846377 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:10.846553 (+   176us) write_op.cc:454] Released schema lock
0709 13:18:10.846621 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:10.886223 (+ 39602us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:10.886254 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15295,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":23509,"apply.run_cpu_time_us":30156,"apply.run_wall_time_us":234563,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91949,"num_ops":21,"prepare.queue_time_us":104661,"prepare.run_cpu_time_us":5532,"prepare.run_wall_time_us":38487,"replication_time_us":30686,"thread_start_us":104206,"threads_started":2}]]}
I20260709 13:18:11.044492 11484 tablet_bootstrap.cc:492] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:11.047684  2946 catalog_manager.cc:5697] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e reported cstate change: term changed from 14 to 21, leader changed from 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 21 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:11.045676 11484 tablet_bootstrap.cc:492] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161: Bootstrap complete.
I20260709 13:18:11.051069 11196 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.060920 11196 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:11.063464 11196 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:11.064119  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:11.064723 11484 ts_tablet_manager.cc:1403] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161: Time spent bootstrapping tablet: real 0.345s	user 0.055s	sys 0.008s
I20260709 13:18:11.068691  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:11.071028  3015 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:11.072188 11196 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:11.081621 11484 raft_consensus.cc:359] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:18:11.082794 11484 raft_consensus.cc:740] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Initialized, Role: LEARNER
I20260709 13:18:11.083724 11484 consensus_queue.cc:260] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
W20260709 13:18:11.118872  3165 consensus_peers.cc:597] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:11.119664 11484 ts_tablet_manager.cc:1434] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.000s
I20260709 13:18:11.121904  3210 tablet_copy_service.cc:342] P 501fdf2af2bc4b0c971ae880e98f466b: Request end of tablet copy session e9165fe61ab04bfb9a48889156d5c161-6e540d8ab4d64f8c8fd8c432fbc5ac3a received from {username='slave'} at 127.0.0.1:34728
I20260709 13:18:11.122383  3210 tablet_copy_service.cc:434] P 501fdf2af2bc4b0c971ae880e98f466b: ending tablet copy session e9165fe61ab04bfb9a48889156d5c161-6e540d8ab4d64f8c8fd8c432fbc5ac3a on tablet 6e540d8ab4d64f8c8fd8c432fbc5ac3a with peer e9165fe61ab04bfb9a48889156d5c161
W20260709 13:18:11.132520  3165 consensus_peers.cc:597] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:11.203751 11292 raft_consensus.cc:493] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.204360 11292 raft_consensus.cc:515] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:11.206465 11292 leader_election.cc:290] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:11.208361  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 29 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:11.208621  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f05b490add4820b03ca7600e7539ff" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 29 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:11.210619  3015 leader_election.cc:304] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:11.211546 11292 raft_consensus.cc:2749] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:18:11.247004  2946 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57732 (request call id 236) took 10431 ms. Trace:
I20260709 13:18:11.269017 11467 raft_consensus.cc:1064] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:18:11.275154 11467 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 13, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:11.247496  2946 rpcz_store.cc:276] 0709 13:18:00.815598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.956894 (+5141296us) service_pool.cc:224] Handling call
0709 13:18:11.246917 (+5290023us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:11.073359 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:11.074038 (+   679us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:11.074076 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:18:11.074098 (+    22us) tablet.cc:662] Decoding operations
0709 13:18:11.074738 (+   640us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:11.074803 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:11.074839 (+    36us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:18:11.075236 (+   397us) tablet.cc:701] Row locks acquired
0709 13:18:11.075258 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:18:11.075433 (+   175us) write_op.cc:270] Start()
0709 13:18:11.075560 (+   127us) write_op.cc:276] Timestamp: P: 1783603091075385 usec, L: 0
0709 13:18:11.075587 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:18:11.076342 (+   755us) log.cc:844] Serialized 1317 byte log entry
0709 13:18:11.078732 (+  2390us) op_driver.cc:464] REPLICATION: finished
0709 13:18:11.079262 (+   530us) write_op.cc:301] APPLY: starting
0709 13:18:11.079350 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:11.081447 (+  2097us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:11.081552 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:11.083774 (+  2222us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:11.084008 (+   234us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 13:18:11.084059 (+    51us) write_op.cc:312] APPLY: finished
0709 13:18:11.084306 (+   247us) log.cc:844] Serialized 41 byte log entry
0709 13:18:11.085365 (+  1059us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:11.085486 (+   121us) write_op.cc:454] Released schema lock
0709 13:18:11.085533 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:11.085946 (+   413us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:11.085986 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":92654,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":305,"apply.run_cpu_time_us":5778,"apply.run_wall_time_us":6635,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12546,"num_ops":3,"prepare.queue_time_us":117,"prepare.run_cpu_time_us":3306,"prepare.run_wall_time_us":11786,"replication_time_us":3012}]]}
I20260709 13:18:11.283951 11492 raft_consensus.cc:493] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.285036 11492 raft_consensus.cc:515] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:11.288929 11492 leader_election.cc:290] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:11.302281  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:11.303323  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4522a8737341bf9c2cb35d3d54f23b" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:11.320393  3015 leader_election.cc:304] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:11.321818 11196 raft_consensus.cc:2749] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:11.329918  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:11.330996  1934 tablet_replica.cc:333] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:11.332659  1934 raft_consensus.cc:2243] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:11.333244  1934 raft_consensus.cc:2272] T 006a17784d3e4b139686bca788cab915 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:11.335314  2935 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 77665.6us
I20260709 13:18:11.338173  3187 tablet_service.cc:1558] Processing DeleteTablet for tablet a1ccbbf27f0b436d8c79dfb6db7fc703 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:60578
W20260709 13:18:11.462015  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 54715.8us
I20260709 13:18:11.498679  2934 catalog_manager.cc:5028] TS 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): tablet a1ccbbf27f0b436d8c79dfb6db7fc703 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:18:11.498188  1934 tablet_replica.cc:333] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:11.502562  1934 raft_consensus.cc:2243] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:11.503146  1934 raft_consensus.cc:2272] T 1b0bf95c7c28416eb4a727eac91af0d0 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:11.516511  2945 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57750 (request call id 231) took 73733 ms (client timeout 15000 ms). Trace:
W20260709 13:18:11.517045  2945 rpcz_store.cc:269] 0709 13:16:57.734298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.743901 (+  9603us) service_pool.cc:224] Handling call
0709 13:16:58.299750 (+555849us) spinlock_profiling.cc:243] Waited 8.59 ms on lock 0x7b5400002490. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff82d14edb1 00007ff82d28eb71 00007ff82d28f0b2 00007ff836208a89 00007ff8361a0da6 00007ff836172088 00007ff83627037e 00007ff8347312a4 00007ff834731232 00007ff834731161 00007ff8347310dc
0709 13:18:11.430825 (+73131075us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44770,"reported_tablets":51,"spinlock_wait_cycles":19767552}
I20260709 13:18:11.522495  1934 tablet_replica.cc:333] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:11.524741  1934 raft_consensus.cc:2243] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:11.527347  1934 raft_consensus.cc:2272] T a1ccbbf27f0b436d8c79dfb6db7fc703 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:11.561507  2935 catalog_manager.cc:4755] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): ChangeConfig:REMOVE_PEER RPC failed for tablet a641b8a516264234af4db10b1a0610f0: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:11.579560 11196 raft_consensus.cc:493] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.580092 11196 raft_consensus.cc:515] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:11.581478 11196 leader_election.cc:290] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:11.585644  3791 raft_consensus.cc:1217] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [term 24 LEARNER]: Deduplicated request from leader. Original: 24.14->[24.15-24.15]   Dedup: 24.15->[]
I20260709 13:18:11.589468  3794 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [term 23 LEARNER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 13:18:11.621399  3762 consensus_peers.cc:597] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:11.636269  1934 tablet_replica.cc:333] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:11.637892  1934 raft_consensus.cc:2243] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:11.636353 11507 raft_consensus.cc:493] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.639428 11507 raft_consensus.cc:515] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:11.642110 11507 leader_election.cc:290] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:11.638429 11502 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:11.643617  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:11.644510  1934 raft_consensus.cc:2272] T e7ddfa6bafce4dcab37f071b34290125 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:11.648247  1934 tablet_replica.cc:333] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:11.650761  1934 raft_consensus.cc:2243] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:11.659621  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "717d128a6d6e4ec0b76d3993e4153a8a" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:11.662896  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:11.664359  3191 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 13:18:11.669837  3091 consensus_peers.cc:597] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:11.670295  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf5db67d30f487d873766886c2ef408" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:11.687901  3015 leader_election.cc:304] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:11.689754 11513 raft_consensus.cc:2749] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:11.692399  3015 leader_election.cc:304] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:11.693274 11509 raft_consensus.cc:2749] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:11.694571  1934 raft_consensus.cc:2272] T 24410f20507a4acf874cdb6e84c306f6 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:11.699384  1934 tablet_replica.cc:333] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:11.715785 11509 raft_consensus.cc:493] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.722078 11509 raft_consensus.cc:515] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:11.722738  3165 consensus_peers.cc:597] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:11.724165 11509 leader_election.cc:290] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:11.724875  3165 consensus_peers.cc:597] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:11.725819  1934 raft_consensus.cc:2243] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:18:11.726397  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:11.726706 11510 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:11.727162  1934 raft_consensus.cc:2272] T 7480597af1f341178e465e8723f7320e P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:11.730648  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb23f9b807d45969a33e8f37691eff6" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:11.731860  3015 leader_election.cc:304] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:11.732681 11509 raft_consensus.cc:2749] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:18:11.733211  2949 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57750 (request call id 230) took 94779 ms (client timeout 15000 ms). Trace:
W20260709 13:18:11.733628  2949 rpcz_store.cc:269] 0709 13:16:36.954284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.954555 (+   271us) service_pool.cc:224] Handling call
0709 13:18:11.733014 (+94778459us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":643637,"reported_tablets":51}
I20260709 13:18:11.759259  1934 tablet_replica.cc:333] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:11.763347  1934 raft_consensus.cc:2243] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:18:11.764183 11513 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.776546 11513 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:11.777650  1934 raft_consensus.cc:2272] T 4b83202a913e45d5830d2ecdfb5354c2 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:11.779021 11513 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:11.780349  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:11.781517  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d96dfe3b4fa4acbb1aac261f7ebf5ea" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:11.783061  3015 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:11.787014 11507 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:11.794076  1934 tablet_replica.cc:333] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:11.812798  1934 raft_consensus.cc:2243] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:18:11.822031  1934 raft_consensus.cc:2272] T 6707728696274f8cbf107e2a9fd20a2a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:11.824604  3165 consensus_peers.cc:597] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:11.836194  1934 tablet_replica.cc:333] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:11.839998  3187 tablet_service.cc:1558] Processing DeleteTablet for tablet a1ccbbf27f0b436d8c79dfb6db7fc703 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:60578
I20260709 13:18:11.840085  3181 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ee6c4dbcb7b45729d4e2bdcc3a09297 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:60578
I20260709 13:18:11.849023  1934 raft_consensus.cc:2243] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:11.850472  2934 catalog_manager.cc:5028] TS 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): tablet a1ccbbf27f0b436d8c79dfb6db7fc703 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:18:11.851562  1934 raft_consensus.cc:2272] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:11.851719  2934 catalog_manager.cc:5028] TS 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): tablet 0ee6c4dbcb7b45729d4e2bdcc3a09297 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
W20260709 13:18:11.841915  2940 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57744 (request call id 247) took 15572 ms (client timeout 15000 ms). Trace:
W20260709 13:18:11.861899  2940 rpcz_store.cc:269] 0709 13:17:56.269328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.290782 (+ 21454us) service_pool.cc:224] Handling call
0709 13:18:11.841671 (+15550889us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21535,"reported_tablets":51}
W20260709 13:18:11.864310  3165 consensus_peers.cc:597] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:11.867344  1934 tablet_replica.cc:333] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:11.868700  1934 raft_consensus.cc:2243] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:11.867962 11510 raft_consensus.cc:2955] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Committing config change with OpId 23.16: config changed from index 15 to 16, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:11.869724  1934 raft_consensus.cc:2272] T ae0fe1dc34db4ff5b5d35916b8a84d4a P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:11.872942  1934 tablet_replica.cc:333] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
W20260709 13:18:11.892331  3165 consensus_peers.cc:597] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:11.895942  3194 raft_consensus.cc:2955] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:11.902552  1934 raft_consensus.cc:2243] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:18:11.914815  1934 raft_consensus.cc:2272] T 4b91597ece9742ebad558605a654e02a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:11.914546  3794 raft_consensus.cc:2955] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:11.918154  1934 tablet_replica.cc:333] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:11.919103  1934 raft_consensus.cc:2243] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:11.919799  1934 raft_consensus.cc:2272] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:11.936151  3165 consensus_peers.cc:597] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:11.943248  1934 tablet_replica.cc:333] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:11.965826 11513 raft_consensus.cc:493] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.966475 11513 raft_consensus.cc:515] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:11.970679  3165 consensus_peers.cc:597] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:11.970693  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:11.972998 11513 leader_election.cc:290] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:11.975257  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5278ab37d43548b39aed98352e8b9e31" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:11.976734  3015 leader_election.cc:304] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:11.977672 11513 raft_consensus.cc:2749] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:12.002463  1934 raft_consensus.cc:2243] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:12.003509  1934 raft_consensus.cc:2272] T 22edd8baac97497aad3f2c9971868c48 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.006709  1934 tablet_replica.cc:333] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.007591  1934 raft_consensus.cc:2243] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:12.008262  1934 pending_rounds.cc:70] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Trying to abort 1 pending ops.
I20260709 13:18:12.008505  1934 pending_rounds.cc:77] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e: Aborting op as it isn't in flight: id { term: 22 index: 18 } timestamp: 7305638188312272896 op_type: NO_OP noop_request { }
I20260709 13:18:12.008950  1934 raft_consensus.cc:2889] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:18:12.009286  1934 raft_consensus.cc:2272] T 348c9fe65bc24c3caf5c132e715a13ba P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.012324  1934 tablet_replica.cc:333] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.013243  1934 raft_consensus.cc:2243] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:11.957698  2948 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57732 (request call id 231) took 119160 ms (client timeout 15000 ms). Trace:
W20260709 13:18:12.017156  2948 rpcz_store.cc:269] 0709 13:16:12.797825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.798225 (+   400us) service_pool.cc:224] Handling call
0709 13:18:11.957471 (+119159246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14429,"reported_tablets":51}
I20260709 13:18:12.063060  1934 raft_consensus.cc:2272] T 5278ab37d43548b39aed98352e8b9e31 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.066440  1934 tablet_replica.cc:333] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.067384 11509 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.067584  1934 raft_consensus.cc:2243] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:12.068544  1934 raft_consensus.cc:2272] T 2fbe6f8795fb454182fceb2dad61e5c6 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.068143 11509 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } }
I20260709 13:18:12.070977 11509 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:12.073180  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:12.073951  1934 tablet_replica.cc:333] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.075201  1934 raft_consensus.cc:2243] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:12.076928  1934 raft_consensus.cc:2272] T 1d72320f324f482bb7e1e27290040a3d P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.080878  1934 tablet_replica.cc:333] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.081830  1934 raft_consensus.cc:2243] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:12.082804  1934 raft_consensus.cc:2272] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.092226  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:12.099256  3015 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:12.100032  3015 raft_consensus.cc:2686] T 1e1474206f8d49e58df15541f5a5725e P aaf88538197a49adb8bcf3790309a67e: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:18:12.104940  3762 consensus_peers.cc:597] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:12.128469  3762 consensus_peers.cc:597] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:12.158035  1934 tablet_replica.cc:333] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.159193  1934 raft_consensus.cc:2243] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:18:12.182861  1934 raft_consensus.cc:2272] T f12375b5613c4d08b52a1a44ccb82294 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.186219  1934 tablet_replica.cc:333] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.195192  1934 raft_consensus.cc:2243] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:12.195984  1934 raft_consensus.cc:2272] T 921c451a21e944ff8a8e6ec22207eca3 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.213966  1934 tablet_replica.cc:333] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.215620  1934 raft_consensus.cc:2243] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:18:12.217027  1934 raft_consensus.cc:2272] T cf28784fe3e74ad5b9c56f1d28247222 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:12.219054  3091 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 112407us
I20260709 13:18:12.223861 11196 raft_consensus.cc:493] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:18:12.229523  1934 tablet_replica.cc:333] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.229359 11196 raft_consensus.cc:515] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:12.230698  1934 raft_consensus.cc:2243] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:12.231364  1934 raft_consensus.cc:2272] T bbb23f9b807d45969a33e8f37691eff6 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.231503 11196 leader_election.cc:290] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:12.256845  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:12.256990  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a33a25f4f3488ea9a2cec075aa10ce" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:12.263586  2941 catalog_manager.cc:5697] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index -1 to 15, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 23 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } } }
I20260709 13:18:12.281597  1934 tablet_replica.cc:333] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.289021  1934 raft_consensus.cc:2243] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:12.297253  1934 raft_consensus.cc:2272] T 0940cf459a7741b58bd85191d095a404 P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.305037  1934 tablet_replica.cc:333] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.322484  1934 raft_consensus.cc:2243] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:18:12.323762  1934 raft_consensus.cc:2272] T a28cf255dda74b44acbfc2fff2f8f950 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.352075  1934 tablet_replica.cc:333] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.353148  1934 raft_consensus.cc:2243] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 31 LEADER]: Raft consensus shutting down.
I20260709 13:18:12.354355  1934 raft_consensus.cc:2272] T efef22a7096a40bdb96063353ee98827 P aaf88538197a49adb8bcf3790309a67e [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.359597  1934 tablet_replica.cc:333] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.372298  1934 raft_consensus.cc:2243] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:12.373112  1934 pending_rounds.cc:70] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Trying to abort 1 pending ops.
I20260709 13:18:12.373420  1934 pending_rounds.cc:77] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e: Aborting op as it isn't in flight: id { term: 18 index: 10 } timestamp: 7305638184416256000 op_type: NO_OP noop_request { }
I20260709 13:18:12.373893  1934 raft_consensus.cc:2889] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:18:12.374307  1934 raft_consensus.cc:2272] T a958b84326034dfd93407cbe60f84548 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.377272  1934 tablet_replica.cc:333] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.386479  1934 raft_consensus.cc:2243] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:12.388387  1934 raft_consensus.cc:2272] T 60d362d3e2ef4546ae699b5d8f4db504 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.392416  1934 tablet_replica.cc:333] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.398633  1934 raft_consensus.cc:2243] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 31 LEADER]: Raft consensus shutting down.
I20260709 13:18:12.398324  2943 catalog_manager.cc:5697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 29 to 31. New cstate: current_term: 31 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:12.400454  2943 catalog_manager.cc:5697] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 26 to 31, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to aaf88538197a49adb8bcf3790309a67e (127.1.227.129). New cstate: current_term: 31 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:12.402058  2943 catalog_manager.cc:5697] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:12.403781  2941 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49738 (request call id 157) took 1474 ms. Trace:
I20260709 13:18:12.404448  1934 raft_consensus.cc:2272] T 1247b6af0f274b8c9d99b6be2d7fbc6b P aaf88538197a49adb8bcf3790309a67e [term 31 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:12.396505  3165 consensus_peers.cc:597] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:12.412637  3165 consensus_peers.cc:597] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:12.411871  2941 rpcz_store.cc:276] 0709 13:18:10.929436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.929612 (+   176us) service_pool.cc:224] Handling call
0709 13:18:12.403720 (+1474108us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:12.289194 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:12.291568 (+  2374us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:12.291601 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:18:12.291619 (+    18us) tablet.cc:662] Decoding operations
0709 13:18:12.291940 (+   321us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:12.292015 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:12.292056 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:12.292230 (+   174us) tablet.cc:701] Row locks acquired
0709 13:18:12.292249 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:18:12.292380 (+   131us) write_op.cc:270] Start()
0709 13:18:12.292483 (+   103us) write_op.cc:276] Timestamp: P: 1783603092292334 usec, L: 0
0709 13:18:12.292510 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:18:12.294016 (+  1506us) log.cc:844] Serialized 599 byte log entry
0709 13:18:12.359426 (+ 65410us) op_driver.cc:464] REPLICATION: finished
0709 13:18:12.370168 (+ 10742us) write_op.cc:301] APPLY: starting
0709 13:18:12.370253 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:12.379758 (+  9505us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:12.379856 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:12.380632 (+   776us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:12.380814 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:18:12.380859 (+    45us) write_op.cc:312] APPLY: finished
0709 13:18:12.381067 (+   208us) log.cc:844] Serialized 25 byte log entry
0709 13:18:12.387659 (+  6592us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:12.387737 (+    78us) write_op.cc:454] Released schema lock
0709 13:18:12.387776 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:12.399546 (+ 11770us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:12.399578 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":151690,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":10427,"apply.run_cpu_time_us":3417,"apply.run_wall_time_us":29321,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":21990,"prepare.run_cpu_time_us":6226,"prepare.run_wall_time_us":11541,"raft.queue_time_us":4466,"raft.run_cpu_time_us":7574,"raft.run_wall_time_us":12338,"replication_time_us":66706,"spinlock_wait_cycles":317696,"thread_start_us":43958,"threads_started":4,"wal-append.queue_time_us":5674}]]}
I20260709 13:18:12.419085 11503 raft_consensus.cc:1064] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b: attempting to promote NON_VOTER e9165fe61ab04bfb9a48889156d5c161 to VOTER
I20260709 13:18:12.421592 11503 consensus_queue.cc:237] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 13, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:12.435613  2943 catalog_manager.cc:5697] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
I20260709 13:18:12.437803  2943 catalog_manager.cc:5697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index -1 to 15, NON_VOTER e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) added. New cstate: current_term: 24 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: NON_VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260709 13:18:12.439877  2943 catalog_manager.cc:5697] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "aaf88538197a49adb8bcf3790309a67e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } }
W20260709 13:18:12.440852  3165 consensus_peers.cc:597] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:12.455653  3762 consensus_peers.cc:597] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:12.466617  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 55679us
I20260709 13:18:12.471758  3111 tablet_service.cc:1558] Processing DeleteTablet for tablet fcf5db67d30f487d873766886c2ef408 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 8 (current committed config index is 12)) from {username='slave'} at 127.0.0.1:42724
W20260709 13:18:12.477447  2947 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57744 (request call id 246) took 43226 ms (client timeout 15000 ms). Trace:
W20260709 13:18:12.477959  2947 rpcz_store.cc:269] 0709 13:17:29.251630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.251982 (+   352us) service_pool.cc:224] Handling call
0709 13:18:12.477152 (+43225170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":209616,"reported_tablets":51}
I20260709 13:18:12.483831  1934 tablet_replica.cc:333] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.492115  1934 raft_consensus.cc:2243] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:12.494635  3798 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [term 24 LEARNER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:18:12.502408 11504 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:12.502980  1934 raft_consensus.cc:2272] T d0547788d7204e17800f3e8d5ac0b20a P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.506078  3126 raft_consensus.cc:1275] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:18:12.516619  2943 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57750 (request call id 235) took 1382 ms. Trace:
I20260709 13:18:12.518368  1934 tablet_replica.cc:333] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.529951  2934 catalog_manager.cc:5028] TS f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): tablet fcf5db67d30f487d873766886c2ef408 (table test-workload [id=6a4c15ecf9bd413aafa8aa9399e9f90b]) successfully deleted
I20260709 13:18:12.530360 11503 consensus_queue.cc:1048] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:12.474644  3015 leader_election.cc:304] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:12.533640 11509 raft_consensus.cc:2749] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:12.535142  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 60572.7us
I20260709 13:18:12.528664  1934 raft_consensus.cc:2243] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:12.539650  1934 raft_consensus.cc:2272] T de94f7d51a554137acbf3110ce91f2fc P aaf88538197a49adb8bcf3790309a67e [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:12.540048  3762 consensus_peers.cc:597] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:12.517088  2943 rpcz_store.cc:276] 0709 13:18:11.134171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.134337 (+   166us) service_pool.cc:224] Handling call
0709 13:18:11.146433 (+ 12096us) spinlock_profiling.cc:243] Waited 8.68 ms on lock 0x7b54000d98d4. stack: 00007ff82d294343 00007ff82d294240 00007ff82cc231d4 00007ff836961304 00007ff836961299 00007ff83031d090 00007ff8303bbf3a 00007ff8361721cc 00007ff83627037e 00007ff8347312a4 00007ff834731232 00007ff834731161 00007ff8347310dc 00007ff834730392 00007ff82e6ee48c 00007ff82e6ed8c6
0709 13:18:12.516544 (+1370111us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:12.454237 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:12.454783 (+   546us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:12.454818 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:18:12.454836 (+    18us) tablet.cc:662] Decoding operations
0709 13:18:12.455632 (+   796us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:12.455697 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:12.455730 (+    33us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:18:12.456280 (+   550us) tablet.cc:701] Row locks acquired
0709 13:18:12.456300 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:18:12.456445 (+   145us) write_op.cc:270] Start()
0709 13:18:12.456558 (+   113us) write_op.cc:276] Timestamp: P: 1783603092456397 usec, L: 0
0709 13:18:12.456582 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:18:12.457227 (+   645us) log.cc:844] Serialized 2540 byte log entry
0709 13:18:12.460975 (+  3748us) op_driver.cc:464] REPLICATION: finished
0709 13:18:12.463484 (+  2509us) write_op.cc:301] APPLY: starting
0709 13:18:12.463603 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:12.468390 (+  4787us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:12.468490 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:12.473781 (+  5291us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:12.473988 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 13:18:12.474032 (+    44us) write_op.cc:312] APPLY: finished
0709 13:18:12.474279 (+   247us) log.cc:844] Serialized 65 byte log entry
0709 13:18:12.482193 (+  7914us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:12.482320 (+   127us) write_op.cc:454] Released schema lock
0709 13:18:12.482369 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:12.487928 (+  5559us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:12.487967 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28971,"reported_tablets":18,"spinlock_wait_cycles":19974528,"child_traces":[["op",{"apply.queue_time_us":2289,"apply.run_cpu_time_us":9130,"apply.run_wall_time_us":24409,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25092,"num_ops":6,"prepare.queue_time_us":829,"prepare.run_cpu_time_us":3278,"prepare.run_wall_time_us":15715,"replication_time_us":4253}]]}
I20260709 13:18:12.574293  1934 tablet_replica.cc:333] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.575337  1934 raft_consensus.cc:2243] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:12.576037  1934 raft_consensus.cc:2272] T f9bcd8873c04459f9a1652eaf201375c P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.584286  2941 catalog_manager.cc:5697] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 15 to 16, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:12.593146  1934 tablet_replica.cc:333] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.594151  1934 raft_consensus.cc:2243] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:12.595347  1934 raft_consensus.cc:2272] T 12725e4e41614e1292b974e17635f758 P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.596977 11407 raft_consensus.cc:2955] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index 15 to 16, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:12.613031  1934 tablet_replica.cc:333] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.622406  1934 raft_consensus.cc:2243] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:12.623312  3126 raft_consensus.cc:2955] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 15 to 16, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:12.629463  1934 pending_rounds.cc:70] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: Trying to abort 2 pending ops.
I20260709 13:18:12.629860  1934 pending_rounds.cc:77] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: Aborting op as it isn't in flight: id { term: 22 index: 11 } timestamp: 7305638157377191936 op_type: NO_OP noop_request { }
I20260709 13:18:12.630327  1934 raft_consensus.cc:2889] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:18:12.630669  1934 pending_rounds.cc:77] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e: Aborting op as it isn't in flight: id { term: 20 index: 10 } timestamp: 7305638113475952640 op_type: NO_OP noop_request { }
I20260709 13:18:12.630993  1934 raft_consensus.cc:2889] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:18:12.631336  1934 raft_consensus.cc:2272] T aef26e81d3be4bc0883542eb71924948 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.634238  1934 tablet_replica.cc:333] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.635063  1934 raft_consensus.cc:2243] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:12.635641  1934 raft_consensus.cc:2272] T 717d128a6d6e4ec0b76d3993e4153a8a P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.660061  1934 tablet_replica.cc:333] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.664288  2945 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57744 (request call id 248) took 1007 ms. Trace:
I20260709 13:18:12.664793  2945 rpcz_store.cc:276] 0709 13:18:11.657101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.657240 (+   139us) service_pool.cc:224] Handling call
0709 13:18:12.664222 (+1006982us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9154,"reported_tablets":51}
I20260709 13:18:12.668828 11509 raft_consensus.cc:493] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.669466 11509 raft_consensus.cc:515] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:12.672109 11509 leader_election.cc:290] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:12.673974  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:12.674814  1934 raft_consensus.cc:2243] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:18:12.678046  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ee6c4dbcb7b45729d4e2bdcc3a09297" candidate_uuid: "aaf88538197a49adb8bcf3790309a67e" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:12.679325  1934 raft_consensus.cc:2272] T c0433e7a23a246a290c4170888e0d7ee P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.679880  3015 leader_election.cc:304] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aaf88538197a49adb8bcf3790309a67e; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:12.681645 11509 raft_consensus.cc:2749] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:12.682260  1934 tablet_replica.cc:333] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.683188  1934 raft_consensus.cc:2243] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:12.689169  3798 raft_consensus.cc:2955] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 15 to 16, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:18:12.707188  3165 consensus_peers.cc:597] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:12.707476  2945 catalog_manager.cc:5697] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: config changed from index 15 to 16, e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:12.711082  1934 raft_consensus.cc:2272] T 9c2f28b50c354b648096e08cf4f5d54a P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.716531  1934 tablet_replica.cc:333] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.717393  1934 raft_consensus.cc:2243] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:12.726461  1934 raft_consensus.cc:2272] T ca4522a8737341bf9c2cb35d3d54f23b P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.742090  1934 tablet_replica.cc:333] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.743431  1934 raft_consensus.cc:2243] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:12.744957  1934 raft_consensus.cc:2272] T a641b8a516264234af4db10b1a0610f0 P aaf88538197a49adb8bcf3790309a67e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.747814  1934 tablet_replica.cc:333] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.753085 11467 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:12.753697 11467 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:12.756176 11467 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:12.748643  1934 raft_consensus.cc:2243] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:12.766105  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:12.773499  1934 raft_consensus.cc:2272] T 201b46c47dd4427db5220d8cfaf02883 P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.776755  1934 tablet_replica.cc:333] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.783416  3117 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:12.783808  3126 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:12.795351  3794 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:18:12.797636 11502 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:18:12.798070  3165 consensus_peers.cc:597] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:12.806373  1934 raft_consensus.cc:2243] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:18:12.790628  3091 consensus_peers.cc:597] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:12.808530  1934 raft_consensus.cc:2272] T dab74aefe0d74cf5b7b691b15690a40b P aaf88538197a49adb8bcf3790309a67e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.816516  3192 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:18:12.824919 11502 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:18:12.827615  3091 consensus_peers.cc:597] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:12.828292  3091 consensus_peers.cc:597] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:12.828883  3091 leader_election.cc:336] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:12.829339  3091 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:12.844213 11502 raft_consensus.cc:2749] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:12.847318  1934 tablet_replica.cc:333] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.848467  1934 raft_consensus.cc:2243] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:12.850924  1934 pending_rounds.cc:70] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Trying to abort 1 pending ops.
I20260709 13:18:12.858152 11502 raft_consensus.cc:2955] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Committing config change with OpId 23.17: config changed from index 16 to 17, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:12.861801  3794 raft_consensus.cc:2955] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:12.870857  1934 pending_rounds.cc:77] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e: Aborting op as it isn't in flight: id { term: 24 index: 17 } timestamp: 7305638194328121344 op_type: NO_OP noop_request { }
I20260709 13:18:12.871157 11512 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:12.871649  1934 raft_consensus.cc:2889] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:18:12.874598  1934 raft_consensus.cc:2272] T 1a367b51f1ce4b0197b9dadabe52be32 P aaf88538197a49adb8bcf3790309a67e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.871832 11512 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:12.880762 11512 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:12.883025  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:12.883770  3126 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 25.
I20260709 13:18:12.885026  3164 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:12.885944 11503 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:12.886399 11503 raft_consensus.cc:493] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:12.886795 11503 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:12.890228 11504 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:12.890865 11504 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:12.892922  3798 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:18:12.894800  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:12.894945 11508 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 13:18:12.894752 11504 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:12.907578  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:12.909243  3194 raft_consensus.cc:2955] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:12.914533  3192 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:18:12.917956  2945 catalog_manager.cc:5697] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 16 to 17, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New cstate: current_term: 23 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:12.921624 11508 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:12.922551  3164 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:12.924062 11511 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:12.925048  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 006a17784d3e4b139686bca788cab915 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:12.932402  1934 tablet_replica.cc:333] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.933423  1934 raft_consensus.cc:2243] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:12.935294  3762 consensus_peers.cc:597] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:12.959743  1934 raft_consensus.cc:2272] T fcf5db67d30f487d873766886c2ef408 P aaf88538197a49adb8bcf3790309a67e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.944036 11503 raft_consensus.cc:515] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:12.979658 11503 leader_election.cc:290] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:12.981463  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6707728696274f8cbf107e2a9fd20a2a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:12.982268  3117 raft_consensus.cc:3060] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:12.983866  1934 tablet_replica.cc:333] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:12.984784  1934 raft_consensus.cc:2243] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:12.985347  1934 pending_rounds.cc:70] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Trying to abort 1 pending ops.
I20260709 13:18:12.985602  1934 pending_rounds.cc:77] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e: Aborting op as it isn't in flight: id { term: 23 index: 11 } timestamp: 7305638128081244160 op_type: NO_OP noop_request { }
I20260709 13:18:12.988126  1934 raft_consensus.cc:2889] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:18:12.988516  1934 raft_consensus.cc:2272] T d5f05b490add4820b03ca7600e7539ff P aaf88538197a49adb8bcf3790309a67e [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:12.995500 11467 raft_consensus.cc:2955] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 25 LEADER]: Committing config change with OpId 25.15: config changed from index 12 to 15, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:12.997620  3794 raft_consensus.cc:2955] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Committing config change with OpId 25.15: config changed from index 12 to 15, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:13.006135 11508 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.006858 11508 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.007755  1934 tablet_replica.cc:333] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:13.008698  1934 raft_consensus.cc:2243] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:13.009296  1934 raft_consensus.cc:2272] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P aaf88538197a49adb8bcf3790309a67e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:13.009783 11508 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:13.011054  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1e1474206f8d49e58df15541f5a5725e with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:18:13.015641  3091 leader_election.cc:336] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:13.020808 11519 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.021684  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:13.021974 11519 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:13.026273 11519 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:13.029366  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:13.031196  1934 tablet_replica.cc:333] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:13.037664  1934 raft_consensus.cc:2243] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:13.038468  1934 raft_consensus.cc:2272] T 1c7972fb78be427daa0baf637a4c17d1 P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:13.033767  3762 leader_election.cc:336] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:13.046108  3761 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:13.047021 11517 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:13.047873  1934 tablet_replica.cc:333] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:13.048779  1934 raft_consensus.cc:2243] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:13.020309  3165 leader_election.cc:336] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:13.058962  3165 leader_election.cc:336] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:13.059303  2935 catalog_manager.cc:4755] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 006a17784d3e4b139686bca788cab915: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 13:18:13.053666  3091 consensus_peers.cc:597] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:13.060446  1934 raft_consensus.cc:2272] T 3fe8825ca0db45529c5a46ef6e9ba53d P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:13.063593  1934 tablet_replica.cc:333] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:13.064420  1934 raft_consensus.cc:2243] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:13.065012  1934 raft_consensus.cc:2272] T 96a33a25f4f3488ea9a2cec075aa10ce P aaf88538197a49adb8bcf3790309a67e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:13.080173  1934 tablet_replica.cc:333] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:13.080957  1934 raft_consensus.cc:2243] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:13.081696  1934 raft_consensus.cc:2272] T 44281a32716140bc805b71db0e071122 P aaf88538197a49adb8bcf3790309a67e [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:13.083616  3117 raft_consensus.cc:2468] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 26.
I20260709 13:18:13.090116  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:13.090819  3194 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 23.
I20260709 13:18:13.091698  3164 leader_election.cc:304] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:13.092052  3191 raft_consensus.cc:2955] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Committing config change with OpId 25.15: config changed from index 12 to 15, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:13.084642  1934 tablet_replica.cc:333] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:13.084784  3090 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:13.095693  2945 catalog_manager.cc:5697] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 reported cstate change: config changed from index 12 to 15, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New cstate: current_term: 25 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:13.097708  3165 consensus_peers.cc:597] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:13.097898 11508 raft_consensus.cc:2749] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:13.097909 11503 raft_consensus.cc:2804] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:18:13.099345 11503 raft_consensus.cc:697] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 26 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:13.100217 11503 consensus_queue.cc:237] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.101590  1934 raft_consensus.cc:2243] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:18:13.103188  1934 raft_consensus.cc:2272] T be0f43de06b240e69f5f94ca88c7b321 P aaf88538197a49adb8bcf3790309a67e [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:13.105901  3165 leader_election.cc:336] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:13.120234  3091 consensus_peers.cc:597] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:13.131763  1934 tablet_replica.cc:333] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:13.137938  1934 raft_consensus.cc:2243] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:13.139189  1934 raft_consensus.cc:2272] T f2254b0c561f4240a9199d1c203568ac P aaf88538197a49adb8bcf3790309a67e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:13.137239  2945 catalog_manager.cc:5697] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 25 to 26, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 26 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.146530  1934 tablet_replica.cc:333] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: stopping tablet replica
I20260709 13:18:13.147373  1934 raft_consensus.cc:2243] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:13.148526  1934 pending_rounds.cc:70] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Trying to abort 1 pending ops.
I20260709 13:18:13.149463  1934 pending_rounds.cc:77] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e: Aborting op as it isn't in flight: id { term: 20 index: 15 } timestamp: 7305638180867702784 op_type: NO_OP noop_request { }
I20260709 13:18:13.149941  1934 raft_consensus.cc:2889] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:18:13.150321  1934 raft_consensus.cc:2272] T 038f072ecdcc4679a46740d78fb0dbd7 P aaf88538197a49adb8bcf3790309a67e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:13.160321 11503 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.160916 11503 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:13.167714  3091 consensus_peers.cc:597] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:13.171718 11503 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:13.174000  3165 leader_election.cc:336] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:13.180338  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:13.181054  3126 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:18:13.182109  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:13.183787 11407 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:13.184147 11407 raft_consensus.cc:493] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.184511 11407 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:18:13.188524  3147 debug-util.cc:398] Leaking SignalData structure 0x7b08001b2660 after lost signal to thread 1937
W20260709 13:18:13.189824  3147 debug-util.cc:398] Leaking SignalData structure 0x7b080005af20 after lost signal to thread 2983
W20260709 13:18:13.190481  3147 debug-util.cc:398] Leaking SignalData structure 0x7b080005a840 after lost signal to thread 3075
W20260709 13:18:13.191738  3147 debug-util.cc:398] Leaking SignalData structure 0x7b080008f300 after lost signal to thread 3150
I20260709 13:18:13.196333 11407 raft_consensus.cc:515] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:13.198837  3147 debug-util.cc:398] Leaking SignalData structure 0x7b08000dcc60 after lost signal to thread 3224
W20260709 13:18:13.209384  3147 debug-util.cc:398] Leaking SignalData structure 0x7b0800389a40 after lost signal to thread 3823
W20260709 13:18:13.210510  3147 debug-util.cc:398] Leaking SignalData structure 0x7b0800389300 after lost signal to thread 11492
I20260709 13:18:13.212319  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7480597af1f341178e465e8723f7320e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:13.213011  3126 raft_consensus.cc:3060] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:18:13.213409  3165 leader_election.cc:336] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:13.228999 11407 leader_election.cc:290] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:13.231734  3126 raft_consensus.cc:2468] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 24.
I20260709 13:18:13.244053 11407 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.244767 11407 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.250788  3164 leader_election.cc:304] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:18:13.251785  3165 leader_election.cc:336] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:13.252206 11503 raft_consensus.cc:2804] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:13.252777 11503 raft_consensus.cc:697] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 24 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:13.253804 11503 consensus_queue.cc:237] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.259995 11407 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:13.261577 11467 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.262254 11467 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:13.267060  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:13.259899  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:13.267760  3191 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:18:13.272255  3164 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:13.274842 11407 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:13.275751 11467 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:13.281772  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:13.282743  3794 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:18:13.284091  3090 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:13.284610 11467 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.288151 11467 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.288656 11531 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:13.289120 11531 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.289502 11531 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:13.290444 11467 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:13.297560 11407 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.299268  2945 catalog_manager.cc:5697] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 23 to 24, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 24 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.298126 11407 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.303757  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:13.304382  3191 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 25.
I20260709 13:18:13.308703  3090 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:13.309587 11511 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.310160 11511 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.310326 11531 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:13.312312 11511 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:13.318672 11407 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:13.317695 11467 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:13.319880 11467 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.320438 11467 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:13.320925 11531 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:13.326135  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:13.326763  3794 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:13.346179  3794 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 24.
I20260709 13:18:13.348778  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:13.350622  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:13.354090 11517 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.354949 11517 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:13.345103 11467 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.356482  3126 raft_consensus.cc:2393] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 26: Already voted for candidate f20672b2852447a6bc1e137c4dd40904 in this term.
I20260709 13:18:13.357309 11517 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:13.361508  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:13.364290  3192 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:13.359187  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:13.372534  3091 leader_election.cc:336] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:13.378964 11508 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.379562 11508 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.383652  3192 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 24.
I20260709 13:18:13.384521 11531 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.384928 11508 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:13.385082 11531 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.387212 11531 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:13.378695 11467 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:13.389544  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b91597ece9742ebad558605a654e02a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:13.390174  3194 raft_consensus.cc:3060] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:18:13.390399  3091 leader_election.cc:336] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:13.391136  3091 leader_election.cc:336] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:13.402637  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:13.403643  3194 raft_consensus.cc:2468] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 26.
I20260709 13:18:13.403014  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:13.404779  3197 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 26.
W20260709 13:18:13.406829  3091 leader_election.cc:336] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:13.414984  3091 leader_election.cc:336] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:13.419342  3091 leader_election.cc:336] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:13.423470  3090 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:13.424939  3090 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:13.426193  3090 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:13.427057 11508 raft_consensus.cc:2749] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 13:18:13.427498  3090 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:13.427891 11508 raft_consensus.cc:2804] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:18:13.428480 11508 raft_consensus.cc:697] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 26 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:18:13.428642 11531 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:13.429877 11467 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:18:13.429550 11508 consensus_queue.cc:237] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.430310 11467 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.430744 11467 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:18:13.432890  3165 leader_election.cc:336] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:13.433426  3165 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:13.434275 11511 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:18:13.438283  3762 consensus_peers.cc:597] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:13.439019  3762 leader_election.cc:336] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:13.439443  3762 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:13.440402 11517 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:18:13.442725  3165 leader_election.cc:336] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:13.443233  3165 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:13.448513  3165 consensus_peers.cc:597] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:13.448014 11511 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:13.453711 11467 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.459537  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12375b5613c4d08b52a1a44ccb82294" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:13.460141  3197 raft_consensus.cc:3060] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:18:13.481144  3197 raft_consensus.cc:2468] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 27.
I20260709 13:18:13.482240  3090 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:18:13.484370  3762 consensus_peers.cc:597] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:13.487013  2945 catalog_manager.cc:5697] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 25 to 26, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 26 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.483445 11508 raft_consensus.cc:2804] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:18:13.497246 11503 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.497467 11508 raft_consensus.cc:697] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 27 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:18:13.497869 11503 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.498476 11508 consensus_queue.cc:237] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.483181 11467 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 27 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:13.503501 11503 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:13.504608  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:13.508509  3762 consensus_peers.cc:597] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:13.515415  3091 leader_election.cc:336] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:13.515372  3165 leader_election.cc:336] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:13.516852  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:13.517838 11503 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 13:18:13.503049 11531 raft_consensus.cc:697] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 24 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:18:13.531862 11531 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:13.556519  3165 consensus_peers.cc:597] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:13.588670 11531 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.589346 11531 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.592082 11531 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:13.592657 11531 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.593194 11531 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.593829  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:13.595116  3197 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:18:13.597106  3090 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:13.596691  2945 catalog_manager.cc:5697] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 23 to 24, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 24 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:13.597863  3091 leader_election.cc:336] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:13.598984 11508 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:13.599357 11508 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.599761 11508 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:13.599596  2945 catalog_manager.cc:5697] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 26 to 27, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 27 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.600310  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:13.607924 11531 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:13.613915  3091 leader_election.cc:336] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:13.614456  3091 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:13.615309 11531 raft_consensus.cc:2749] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:13.617784 11508 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:13.632373  3091 leader_election.cc:336] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:13.634681  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28784fe3e74ad5b9c56f1d28247222" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:13.635330  3197 raft_consensus.cc:3060] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:13.636369 11508 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:13.642513  3197 raft_consensus.cc:2468] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:18:13.643908  3090 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:13.645395 11531 raft_consensus.cc:2804] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:13.645954 11531 raft_consensus.cc:697] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:18:13.646979 11531 consensus_queue.cc:237] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.674024  2945 catalog_manager.cc:5697] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 22 to 23, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 23 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.681393 11531 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.682049 11531 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:13.684208 11531 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:18:13.690114  3091 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111) [suppressed 373 similar messages]
I20260709 13:18:13.690611  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:13.691264  3794 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 25.
I20260709 13:18:13.692386  3090 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:13.694062 11508 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:13.694463 11508 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.694841 11508 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:18:13.697206  3165 consensus_peers.cc:597] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:13.698007 11502 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.698550 11502 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.700515 11502 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:13.701949  3123 raft_consensus.cc:1275] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
W20260709 13:18:13.702230  3091 leader_election.cc:336] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:13.702976 11517 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.703527 11517 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:13.704612 11503 consensus_queue.cc:1048] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:18:13.708379  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:13.709069  3197 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 31.
I20260709 13:18:13.709549  3126 raft_consensus.cc:1275] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 13:18:13.712340  3091 leader_election.cc:336] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:13.713573  3762 leader_election.cc:336] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:13.715355  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:13.715809 11503 consensus_queue.cc:1048] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:13.716246 11531 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 13:18:13.716722 11531 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 31 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.717115 11531 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:18:13.717549 11517 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:13.719559  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:13.720371  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:13.724311  3761 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:13.727969 11407 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.728549 11407 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.730456 11517 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:13.730564 11407 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:13.735631 11508 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:13.739396  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:13.740159  3126 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 20.
I20260709 13:18:13.742375 11508 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:13.743105  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a28cf255dda74b44acbfc2fff2f8f950" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:13.744837  3794 raft_consensus.cc:3060] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:13.751037 11511 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.751675 11511 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.752961  3794 raft_consensus.cc:2468] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 26.
I20260709 13:18:13.753916 11511 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:13.754819  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:13.756367  3090 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:13.756909 11531 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.757261 11502 raft_consensus.cc:2804] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:18:13.758708  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:13.761104 11407 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:13.761492 11407 raft_consensus.cc:493] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.761842 11407 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:13.758057 11502 raft_consensus.cc:697] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 26 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:18:13.771600 11407 raft_consensus.cc:515] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:13.795706  3165 leader_election.cc:336] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:13.796905 11407 leader_election.cc:290] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:13.800096  3165 consensus_peers.cc:597] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:13.806350 11502 consensus_queue.cc:237] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:13.811936 11538 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.812683 11538 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:13.825791 11538 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:13.827069  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:13.827069 11531 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 32 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:13.827869  3794 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 17.
W20260709 13:18:13.842338  3762 consensus_peers.cc:597] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:13.861263  3091 leader_election.cc:336] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:13.870666  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0547788d7204e17800f3e8d5ac0b20a" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:13.871285  3123 raft_consensus.cc:3060] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:13.874605  3165 leader_election.cc:336] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:13.875126  3165 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:13.878777  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:13.879938 11503 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:13.880962  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efef22a7096a40bdb96063353ee98827" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:13.881561  3194 raft_consensus.cc:3060] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:18:13.887153  3194 raft_consensus.cc:2468] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 32.
W20260709 13:18:13.895246  3091 leader_election.cc:336] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 32 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:13.902324  3123 raft_consensus.cc:2468] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:18:13.896481 11503 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 31 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.904533 11503 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.906787 11503 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:13.899945 11545 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.909718 11545 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:13.912113 11545 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:13.919211  3762 leader_election.cc:336] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:13.920370  3091 leader_election.cc:336] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:13.921643  3090 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:13.923028 11554 raft_consensus.cc:2804] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 32 FOLLOWER]: Leader election won for term 32
I20260709 13:18:13.920482  3164 leader_election.cc:304] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:13.920853  3091 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:13.921713  2941 catalog_manager.cc:5697] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 25 to 26, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 26 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.926352 11552 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:13.926818 11503 raft_consensus.cc:2804] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:13.927414 11503 raft_consensus.cc:697] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:13.928426 11502 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.928390 11503 consensus_queue.cc:237] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.929015 11502 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.929987 11554 raft_consensus.cc:697] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 32 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:18:13.931073  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:13.930904 11554 consensus_queue.cc:237] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 31.15, Last appended by leader: 15, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.931742 11502 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:13.932909  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:13.933440  3165 consensus_peers.cc:597] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:13.933512  3123 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 31.
W20260709 13:18:13.935909  3165 leader_election.cc:336] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:13.938673  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:13.939797 11519 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:13.941210  3164 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:13.942319 11548 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 13:18:13.942698 11548 raft_consensus.cc:493] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 31 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.943027 11548 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:18:13.948729  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:13.949402  3191 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
I20260709 13:18:13.952664  3090 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:18:13.953188  3091 consensus_peers.cc:597] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:13.953507 11502 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:13.954102 11502 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:13.954548 11502 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:13.962397 11548 raft_consensus.cc:515] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:13.964510  3165 consensus_peers.cc:597] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:13.966293  3165 leader_election.cc:336] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:13.971517 11502 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:13.971921  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1247b6af0f274b8c9d99b6be2d7fbc6b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:13.982502  3123 raft_consensus.cc:3060] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:18:13.965170 11548 leader_election.cc:290] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 32 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:13.995551  3165 consensus_peers.cc:597] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:13.995682 11502 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:13.992614  3123 raft_consensus.cc:2468] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 32.
W20260709 13:18:13.993144  3091 consensus_peers.cc:597] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:14.002406  3091 leader_election.cc:336] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:14.007767  2941 catalog_manager.cc:5697] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 20 to 21, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 21 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:14.027006  3164 leader_election.cc:304] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:14.028128 11504 raft_consensus.cc:2804] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 32 FOLLOWER]: Leader election won for term 32
I20260709 13:18:14.028826 11504 raft_consensus.cc:697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 32 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:14.029853 11504 consensus_queue.cc:237] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 31.16, Last appended by leader: 16, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:14.032511  2945 catalog_manager.cc:5697] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 31 to 32, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 32 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.036851  3191 raft_consensus.cc:1275] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:18:14.044127  3794 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:18:14.045679  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0433e7a23a246a290c4170888e0d7ee" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:14.046315  3191 raft_consensus.cc:3060] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:14.047780 11554 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:14.055958 11502 consensus_queue.cc:1048] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:14.058600 11503 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:14.059286 11503 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:14.064909  3165 leader_election.cc:336] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 32 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:14.066039  3191 raft_consensus.cc:2468] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 24.
I20260709 13:18:14.067386 11519 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:14.068050 11519 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:14.073103 11407 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:14.073688 11407 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:14.076982 11407 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:14.077936  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:14.078616  3798 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
I20260709 13:18:14.080010 11519 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:14.081254  3164 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:18:14.081911 11503 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:14.087877  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:14.094175  3126 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 21.
W20260709 13:18:14.098238  3762 leader_election.cc:336] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:14.088428  3165 consensus_peers.cc:597] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:14.087956  2945 catalog_manager.cc:5697] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 31 to 32, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 32 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:14.084126  3090 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:14.092650 11504 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:14.104417  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:14.106050 11554 raft_consensus.cc:2804] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:14.108459 11554 raft_consensus.cc:697] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 24 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:18:14.109097  3194 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 13:18:14.109268  3165 leader_election.cc:336] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:14.109450 11554 consensus_queue.cc:237] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:14.111747  3191 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
W20260709 13:18:14.111999  3165 consensus_peers.cc:597] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:14.115953  3091 leader_election.cc:336] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:14.119091  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:14.112475 11504 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:14.120772 11504 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:14.121347 11407 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:14.123478  3191 raft_consensus.cc:1275] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:18:14.127332 11502 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:18:14.127772  3165 leader_election.cc:336] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:14.127353  3761 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:18:14.128571  3165 consensus_peers.cc:597] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:14.129801 11519 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:14.130236 11519 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:14.130795 11519 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:14.121757 11407 raft_consensus.cc:493] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:14.131773 11407 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:14.132706 11552 consensus_queue.cc:1048] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:14.130162 11548 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:14.134140 11548 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:14.137341 11548 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:14.142257  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:14.143850  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
I20260709 13:18:14.144500  3117 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:18:14.143000  3791 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 17.
I20260709 13:18:14.144878 11407 raft_consensus.cc:515] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:14.159442  3164 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
W20260709 13:18:14.164073  3165 leader_election.cc:336] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:14.168835 11407 leader_election.cc:290] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:14.171217 11503 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:14.171685 11503 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:14.172084 11503 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:14.173815 11504 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:14.176129 11504 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:14.179107  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:14.182495  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bcd8873c04459f9a1652eaf201375c" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:14.183094  3126 raft_consensus.cc:3060] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:14.208617 11517 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:14.209327 11517 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:14.212189 11517 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:14.218778  3117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904" is_pre_election: true
W20260709 13:18:14.218951  3762 leader_election.cc:336] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:14.224339  3761 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:14.224805  2941 catalog_manager.cc:5697] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 23 to 24, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 24 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.225871 11545 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:14.233958 11504 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:14.234694 11504 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:14.236856 11504 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:14.240579  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:18:14.244652  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 50529.9us
W20260709 13:18:14.245857  3091 consensus_peers.cc:597] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:14.245066  3126 raft_consensus.cc:2468] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 22.
I20260709 13:18:14.248778 11503 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:14.249634 11519 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:14.260283 11503 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:14.266055  3126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f20672b2852447a6bc1e137c4dd40904"
I20260709 13:18:14.269253  3126 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:14.271467 11519 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:14.269345  3791 raft_consensus.cc:2393] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 501fdf2af2bc4b0c971ae880e98f466b in current term 22: Already voted for candidate e9165fe61ab04bfb9a48889156d5c161 in this term.
W20260709 13:18:14.276374  3762 leader_election.cc:336] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:14.282300  3126 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
W20260709 13:18:14.266366  3091 consensus_peers.cc:597] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:14.251964  3165 leader_election.cc:336] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:14.306455  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 57033.5us
I20260709 13:18:14.308074  3164 leader_election.cc:304] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:18:14.309027  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 51608.3us
I20260709 13:18:14.310496 11504 raft_consensus.cc:2804] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:14.311033 11503 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:14.311642 11503 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:14.312028  3091 consensus_peers.cc:597] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:14.314927  1934 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 3072)
I20260709 13:18:14.311074 11504 raft_consensus.cc:697] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 22 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:14.316650 11504 consensus_queue.cc:237] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.9, Last appended by leader: 9, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:14.319945 11503 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:14.321175  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:14.321974  3194 raft_consensus.cc:2393] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e9165fe61ab04bfb9a48889156d5c161 in current term 22: Already voted for candidate 501fdf2af2bc4b0c971ae880e98f466b in this term.
I20260709 13:18:14.325798  3193 raft_consensus.cc:1275] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:18:14.332782 11519 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:14.333680 11519 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:14.336010 11519 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:14.338496  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a641b8a516264234af4db10b1a0610f0" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:14.339165  3794 raft_consensus.cc:3060] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:14.350781 11551 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:14.351385 11551 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:14.353796  3762 leader_election.cc:336] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:14.358659  3091 leader_election.cc:336] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:14.359344  3117 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:14.359004  2945 catalog_manager.cc:5697] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 21 to 22, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 22 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:14.360245 11551 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:14.361479  3797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:14.362226  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:14.362998  3798 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 22.
I20260709 13:18:14.362200  3797 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:18:14.364491  3090 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:14.365638 11551 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:14.366020 11551 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:14.366400 11551 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:14.369035  3794 raft_consensus.cc:2468] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 18.
I20260709 13:18:14.376365  3164 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:18:14.377298 11504 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:14.377836 11504 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:14.378185 11504 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:14.377033 11551 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:14.389998 11504 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:14.390589  3797 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:18:14.392102 11504 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:14.392882  3164 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: 
I20260709 13:18:14.393721 11548 raft_consensus.cc:2804] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:14.394853 11502 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
W20260709 13:18:14.403756  3091 leader_election.cc:336] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:14.396308  3165 leader_election.cc:336] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:14.398448  3791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0f43de06b240e69f5f94ca88c7b321" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:14.406091 11551 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:14.406383  3791 raft_consensus.cc:3060] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:14.405767  3165 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:14.409368  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dab74aefe0d74cf5b7b691b15690a40b" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:14.410056  3794 raft_consensus.cc:3060] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:14.394375 11548 raft_consensus.cc:697] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:14.414645 11548 consensus_queue.cc:237] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:14.415205 11551 raft_consensus.cc:2955] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index 9 to 16, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:14.419617 11407 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:14.420002  3797 raft_consensus.cc:2955] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 9 to 16, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:14.427836  3798 raft_consensus.cc:1275] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:18:14.429839 11552 consensus_queue.cc:1048] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:18:14.435488  3791 raft_consensus.cc:2468] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20672b2852447a6bc1e137c4dd40904 in term 23.
W20260709 13:18:14.436127  2935 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 93578.2us
I20260709 13:18:14.437853  3761 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:14.439237 11517 raft_consensus.cc:2749] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:14.440932  3117 raft_consensus.cc:1275] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:14.451686  3090 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e
W20260709 13:18:14.452836  3091 consensus_peers.cc:597] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:14.457854 11502 raft_consensus.cc:2804] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:14.458467 11502 raft_consensus.cc:697] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Becoming Leader. State: Replica: f20672b2852447a6bc1e137c4dd40904, State: Running, Role: LEADER
I20260709 13:18:14.459380 11502 consensus_queue.cc:237] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:14.469359 11552 consensus_queue.cc:1048] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:18:14.478864  3762 consensus_peers.cc:597] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:14.475976  2943 catalog_manager.cc:5697] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 17 to 18, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 18 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.483215 11548 consensus_queue.cc:1048] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:14.500263  3194 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:18:14.501452  3794 raft_consensus.cc:2468] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 24.
I20260709 13:18:14.509459  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:14.510284  3195 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 21.
W20260709 13:18:14.512328  2935 catalog_manager.cc:4755] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1e1474206f8d49e58df15541f5a5725e: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:14.535172  3164 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:18:14.549125  3165 leader_election.cc:336] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:14.550603  3193 raft_consensus.cc:1275] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 32 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 31 index: 15. Preceding OpId from leader: term: 32 index: 16. (index mismatch)
I20260709 13:18:14.549719  3165 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:14.574994  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4b83202a913e45d5830d2ecdfb5354c2 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:14.567714  2945 catalog_manager.cc:5697] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 reported cstate change: term changed from 22 to 23, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to f20672b2852447a6bc1e137c4dd40904 (127.1.227.130). New cstate: current_term: 23 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.547248 11504 raft_consensus.cc:2804] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:18:14.606348  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 57235.2us
W20260709 13:18:14.607245  3165 leader_election.cc:336] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:14.607457 11573 raft_consensus.cc:2749] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:14.600979  2941 catalog_manager.cc:5697] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 9 to 16, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New cstate: current_term: 24 leader_uuid: "f20672b2852447a6bc1e137c4dd40904" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
W20260709 13:18:14.618201  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:43109, user_credentials={real_user=slave}} blocked reactor thread for 52896.6us
I20260709 13:18:14.624313 11531 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:14.642392 11538 consensus_queue.cc:1048] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:14.641548 11504 raft_consensus.cc:697] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 24 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:14.646184 11504 consensus_queue.cc:237] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:14.668357  3761 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:14.669229 11519 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:14.669620  3117 raft_consensus.cc:1275] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 32 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 31 index: 16. Preceding OpId from leader: term: 32 index: 17. (index mismatch)
I20260709 13:18:14.669662 11519 raft_consensus.cc:493] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting leader election (detected failure of leader aaf88538197a49adb8bcf3790309a67e)
I20260709 13:18:14.670547 11519 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:14.677343  3091 consensus_peers.cc:597] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:14.680790  3165 leader_election.cc:336] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:14.681898  3165 consensus_peers.cc:597] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:14.682379  3165 leader_election.cc:336] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:14.683904  3165 consensus_peers.cc:597] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:14.684703  3165 consensus_peers.cc:597] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:14.705621  3762 consensus_peers.cc:597] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:14.713622  3192 raft_consensus.cc:1275] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:18:14.719961 11552 consensus_queue.cc:1048] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
W20260709 13:18:14.755043  3165 consensus_peers.cc:597] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:14.755682  3165 consensus_peers.cc:597] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:14.760033  3165 consensus_peers.cc:597] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:14.790673  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 72603.6us
I20260709 13:18:14.710448 11519 raft_consensus.cc:515] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:14.803094  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 94393.5us
I20260709 13:18:14.805344 11407 consensus_queue.cc:1048] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:18:14.800836  3195 raft_consensus.cc:2955] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 9 to 16, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:14.829347 11519 leader_election.cc:290] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:14.846043  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2254b0c561f4240a9199d1c203568ac" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:14.846696  3194 raft_consensus.cc:3060] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:14.857081  3194 raft_consensus.cc:2468] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:18:14.889814  3794 raft_consensus.cc:1275] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Refusing update from remote peer f20672b2852447a6bc1e137c4dd40904: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:18:14.891698 11551 consensus_queue.cc:1048] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:18:14.904337  3091 consensus_peers.cc:597] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:14.905884  3164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 101362us
I20260709 13:18:14.919754  3761 leader_election.cc:304] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:18:14.925077 11577 raft_consensus.cc:2804] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:14.925657 11577 raft_consensus.cc:697] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:18:14.926484 11577 consensus_queue.cc:237] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:14.938457  3117 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:14.941622  3126 raft_consensus.cc:1275] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 21 index: 9. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 13:18:14.945294  2941 catalog_manager.cc:5697] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 23 to 24, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 24 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.950733 11575 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:18:14.954547  3762 leader_election.cc:336] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:14.954840 11581 consensus_queue.cc:1048] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:18:14.958413  3165 consensus_peers.cc:597] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:14.965042  2945 catalog_manager.cc:5697] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 21 to 22, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 22 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:15.032831  3165 consensus_peers.cc:597] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:15.040611  3165 consensus_peers.cc:597] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:15.046111  3794 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:15.061766 11581 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:18:15.065424  3091 consensus_peers.cc:597] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:15.070900  3165 consensus_peers.cc:597] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:15.080650  3794 raft_consensus.cc:1275] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:18:15.094146 11573 consensus_queue.cc:1048] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:18:15.166365  3165 consensus_peers.cc:597] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:15.198940  3165 consensus_peers.cc:597] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:15.203955  3165 consensus_peers.cc:597] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:15.206669  3091 consensus_peers.cc:597] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:15.247654  3762 consensus_peers.cc:597] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:15.282925  2938 maintenance_manager.cc:419] P fc4fb08aba024155968fdc88910f61d7: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033388
W20260709 13:18:15.315444  1934 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 3072)
W20260709 13:18:15.362330  3091 consensus_peers.cc:597] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:15.375560  3762 consensus_peers.cc:597] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:15.393795  3762 consensus_peers.cc:597] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:15.445906  3091 consensus_peers.cc:597] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:15.459981  3762 consensus_peers.cc:597] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:15.463172  3199 raft_consensus.cc:1275] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:18:15.464921 11583 consensus_queue.cc:1048] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:15.481534  2937 maintenance_manager.cc:643] P fc4fb08aba024155968fdc88910f61d7: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.197s	user 0.042s	sys 0.003s Metrics: {"bytes_written":8202,"delete_count":0,"lbm_write_time_us":1133,"lbm_writes_lt_1ms":7,"reinsert_count":0,"update_count":327}
I20260709 13:18:15.503103  2938 maintenance_manager.cc:419] P fc4fb08aba024155968fdc88910f61d7: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.350963
W20260709 13:18:15.559860  2935 catalog_manager.cc:4755] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1e1474206f8d49e58df15541f5a5725e: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:15.587057  3091 consensus_peers.cc:597] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:15.635772  3091 consensus_peers.cc:597] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:15.683982  3165 consensus_peers.cc:597] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:15.796106  3762 consensus_peers.cc:597] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:15.911887  3762 consensus_peers.cc:597] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:18:15.987264  2937 maintenance_manager.cc:643] P fc4fb08aba024155968fdc88910f61d7: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.483s	user 0.130s	sys 0.007s Metrics: {"cfile_cache_miss":8,"cfile_cache_miss_bytes":29014,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":32012,"dirs.run_cpu_time_us":299,"dirs.run_wall_time_us":300,"lbm_read_time_us":25324,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":23,"lbm_write_time_us":10956,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":11,"peak_mem_usage":580528,"reinsert_count":0,"thread_start_us":32404,"threads_started":1,"update_count":327}
W20260709 13:18:16.000594  3165 consensus_peers.cc:597] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:16.013988  3762 consensus_peers.cc:597] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:16.048689  3165 consensus_peers.cc:597] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:16.075264  3165 consensus_peers.cc:597] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:16.142398 11517 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.143046 11517 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:16.145766 11517 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:16.147290  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:16.147987  3195 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 22.
I20260709 13:18:16.149578  3761 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
W20260709 13:18:16.150147  3762 leader_election.cc:336] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:16.150417 11517 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:16.151532 11517 raft_consensus.cc:493] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.151932 11517 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:16.173957  3165 consensus_peers.cc:597] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:16.180028 11517 raft_consensus.cc:515] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:16.186079 11517 leader_election.cc:290] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 election: Requested vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:16.188951  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12725e4e41614e1292b974e17635f758" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:16.189613  3199 raft_consensus.cc:3060] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:16.192322  3762 leader_election.cc:336] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:16.200052  3199 raft_consensus.cc:2468] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 23.
I20260709 13:18:16.202374  3761 leader_election.cc:304] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:16.203966 11583 raft_consensus.cc:2804] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:16.204480 11583 raft_consensus.cc:697] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 23 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:18:16.205405 11583 consensus_queue.cc:237] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:16.243247  2943 catalog_manager.cc:5697] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 21 to 23, leader changed from aaf88538197a49adb8bcf3790309a67e (127.1.227.129) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 23 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:16.315964  1934 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 3072)
W20260709 13:18:16.445286  3091 consensus_peers.cc:597] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:16.489661  3165 consensus_peers.cc:597] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:16.545886  3091 consensus_peers.cc:597] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:16.571065  3165 consensus_peers.cc:597] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:16.571738  3165 consensus_peers.cc:597] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:16.595249  3762 consensus_peers.cc:597] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:16.741153  3762 consensus_peers.cc:597] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:16.751312  3165 consensus_peers.cc:597] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:16.769541  3762 consensus_peers.cc:597] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:18:16.824025  3195 raft_consensus.cc:1275] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:18:16.826265 11583 consensus_queue.cc:1048] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:18:16.827986  3091 consensus_peers.cc:597] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:16.838475  3091 consensus_peers.cc:597] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:16.881866  3165 consensus_peers.cc:597] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:16.884914  3165 consensus_peers.cc:597] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:16.895731  3165 consensus_peers.cc:597] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:16.909777  3091 consensus_peers.cc:597] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:16.922242  3165 consensus_peers.cc:597] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:16.939715  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:38619, user_credentials={real_user=slave}} blocked reactor thread for 47705us
W20260709 13:18:16.967650  3762 consensus_peers.cc:597] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:16.994195  3165 consensus_peers.cc:597] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:17.062191  2935 catalog_manager.cc:4755] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4b83202a913e45d5830d2ecdfb5354c2: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:17.075866  3091 consensus_peers.cc:597] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:17.125221  3165 consensus_peers.cc:597] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:17.125939  3165 consensus_peers.cc:597] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:17.130451  3165 consensus_peers.cc:597] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:17.220122  3165 consensus_peers.cc:597] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:17.316501  1934 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 3072)
W20260709 13:18:17.488577  3165 consensus_peers.cc:597] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:17.514277  3091 consensus_peers.cc:597] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:17.557715  3091 consensus_peers.cc:597] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:17.575933  3762 consensus_peers.cc:597] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:17.588631  3165 consensus_peers.cc:597] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:17.655972  3091 consensus_peers.cc:597] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:17.719161  3165 consensus_peers.cc:597] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:17.731470  3165 consensus_peers.cc:597] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:17.778311  3762 consensus_peers.cc:597] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:17.789163  3091 consensus_peers.cc:597] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:17.826534  3165 consensus_peers.cc:597] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:17.889199  1934 tablet_server.cc:196] TabletServer@127.1.227.129:0 shutdown complete.
W20260709 13:18:17.897511  3762 consensus_peers.cc:597] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:17.927363  3165 consensus_peers.cc:597] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:18.093875  3091 consensus_peers.cc:597] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:18.037956  3165 consensus_peers.cc:597] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:18.100072  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 62151.9us
W20260709 13:18:18.114078  3091 consensus_peers.cc:597] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:18.238073  3762 consensus_peers.cc:597] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:18:18.249899  1934 tablet_server.cc:179] TabletServer@127.1.227.130:0 shutting down...
W20260709 13:18:18.250114  3091 consensus_peers.cc:597] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:18.277437  3761 consensus_peers.cc:597] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.291826  3761 consensus_peers.cc:597] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.296103  3164 consensus_peers.cc:597] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.298724  3164 consensus_peers.cc:597] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.303824  3165 consensus_peers.cc:597] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:18.302704  3164 consensus_peers.cc:597] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.342669  3164 consensus_peers.cc:597] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.350611  3164 consensus_peers.cc:597] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.360119  3165 consensus_peers.cc:597] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:18.366885  3762 consensus_peers.cc:597] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:18.381865  3164 consensus_peers.cc:597] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.390220  3762 consensus_peers.cc:597] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:18.393877  3164 consensus_peers.cc:597] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.394610  3164 consensus_peers.cc:597] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.453152  3164 consensus_peers.cc:597] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.462919  3164 consensus_peers.cc:597] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.476080  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:18:18.480770  3164 consensus_peers.cc:597] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.486078  1934 tablet_replica.cc:333] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:18.487185  1934 raft_consensus.cc:2243] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:18.487331  3164 consensus_peers.cc:597] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.487893  1934 raft_consensus.cc:2272] T e7ddfa6bafce4dcab37f071b34290125 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:18.486024  3762 consensus_peers.cc:597] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:18:18.492045  1934 tablet_replica.cc:333] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:18.494323  1934 raft_consensus.cc:2243] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.497085  1934 raft_consensus.cc:2272] T a2dc1155b33b4fbc830d189f5e109f78 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.500990  1934 tablet_replica.cc:333] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:18.501865  1934 raft_consensus.cc:2243] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.503293  1934 raft_consensus.cc:2272] T a1ccbbf27f0b436d8c79dfb6db7fc703 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.506028  1934 tablet_replica.cc:333] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:18.506836  1934 raft_consensus.cc:2243] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.507473  1934 raft_consensus.cc:2272] T 1b0bf95c7c28416eb4a727eac91af0d0 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.521354  1934 tablet_replica.cc:333] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
W20260709 13:18:18.524197  3165 consensus_peers.cc:597] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:18.527321  3164 consensus_peers.cc:597] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.531183  1934 raft_consensus.cc:2243] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:18:18.538895  3761 consensus_peers.cc:597] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.537072  1934 raft_consensus.cc:2272] T 24410f20507a4acf874cdb6e84c306f6 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.542626  1934 tablet_replica.cc:333] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:18.543696  1934 raft_consensus.cc:2243] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:18:18.549393  3164 consensus_peers.cc:597] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.554524  3165 consensus_peers.cc:597] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:18.556366  3164 consensus_peers.cc:597] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.560400  3761 consensus_peers.cc:597] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.566473  3089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:18.571874  3164 consensus_peers.cc:597] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.573374  3164 consensus_peers.cc:597] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.624904  1934 raft_consensus.cc:2272] T cf43b3ddced94b0395a3a79080ce0ed5 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.630798  1934 tablet_replica.cc:333] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:18.633414  1934 raft_consensus.cc:2243] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.637681  1934 raft_consensus.cc:2272] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.642524  1934 tablet_replica.cc:333] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:18.712693  1934 raft_consensus.cc:2243] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:18:18.724035  3091 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111) [suppressed 514 similar messages]
W20260709 13:18:18.771567  3761 consensus_peers.cc:597] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.791371  3761 consensus_peers.cc:597] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.791617  1934 raft_consensus.cc:2272] T 006a17784d3e4b139686bca788cab915 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:18.792248  3761 consensus_peers.cc:597] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.794770  3761 consensus_peers.cc:597] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.787384  3091 consensus_peers.cc:597] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:18.804188  3761 consensus_peers.cc:597] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.798277  1934 tablet_replica.cc:333] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:18.811738  1934 raft_consensus.cc:2243] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.821540  1934 raft_consensus.cc:2272] T ae0fe1dc34db4ff5b5d35916b8a84d4a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:18.814504  3164 consensus_peers.cc:597] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.830717  3164 consensus_peers.cc:597] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.832267  3164 consensus_peers.cc:597] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.833175  3164 consensus_peers.cc:597] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:18.842160  3164 consensus_peers.cc:597] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.852001  1934 tablet_replica.cc:333] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:18.855619  1934 raft_consensus.cc:2243] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:18:18.867897  1934 raft_consensus.cc:2272] T 4b91597ece9742ebad558605a654e02a P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.879340  1934 tablet_replica.cc:333] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
W20260709 13:18:18.886415  3091 consensus_peers.cc:597] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:18.893435  1934 raft_consensus.cc:2243] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.900827  1934 raft_consensus.cc:2272] T 01dd1f72eb8249a6adadee5f3509bcc2 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.905313  1934 tablet_replica.cc:333] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:18.912978  1934 raft_consensus.cc:2243] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.914659  1934 raft_consensus.cc:2272] T 6707728696274f8cbf107e2a9fd20a2a P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:18.922737  3165 consensus_peers.cc:597] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:18.930143  3165 consensus_peers.cc:597] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:18.944063  1934 tablet_replica.cc:333] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:18.945704  1934 raft_consensus.cc:2243] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.948360  1934 raft_consensus.cc:2272] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.954352  1934 tablet_replica.cc:333] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
W20260709 13:18:18.956467  3164 consensus_peers.cc:597] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.967216  1934 raft_consensus.cc:2243] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.968400  1934 raft_consensus.cc:2272] T 22edd8baac97497aad3f2c9971868c48 P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.972736  1934 tablet_replica.cc:333] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:18.975625  1934 raft_consensus.cc:2243] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.976691  1934 raft_consensus.cc:2272] T 172fb190a0d74cd292c08c451255bae2 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.988114  1934 tablet_replica.cc:333] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:18.990886  1934 raft_consensus.cc:2243] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.992076  1934 raft_consensus.cc:2272] T 5278ab37d43548b39aed98352e8b9e31 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.011067  1934 tablet_replica.cc:333] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.024564  1934 raft_consensus.cc:2243] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.027349  1934 raft_consensus.cc:2272] T 2fbe6f8795fb454182fceb2dad61e5c6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:19.038117  3762 consensus_peers.cc:597] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:18:19.051545  1934 tablet_replica.cc:333] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.052815  1934 raft_consensus.cc:2243] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.054126  1934 raft_consensus.cc:2272] T 1d72320f324f482bb7e1e27290040a3d P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.061326  1934 tablet_replica.cc:333] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.072739  1934 raft_consensus.cc:2243] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:18:19.083796  1934 raft_consensus.cc:2272] T 1e1474206f8d49e58df15541f5a5725e P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.091044  1934 tablet_replica.cc:333] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.092250  1934 raft_consensus.cc:2243] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:18:19.104715  1934 raft_consensus.cc:2272] T f12375b5613c4d08b52a1a44ccb82294 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.108214  1934 tablet_replica.cc:333] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.109323  1934 raft_consensus.cc:2243] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.114516  1934 raft_consensus.cc:2272] T e234b352c9c44269b88598c9ae245ab5 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.119293  1934 tablet_replica.cc:333] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.124411  1934 raft_consensus.cc:2243] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.127086  1934 raft_consensus.cc:2272] T e1d12e7c2ef94802ad2c1a3390fe2a8e P f20672b2852447a6bc1e137c4dd40904 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.130949  1934 tablet_replica.cc:333] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.143752  1934 raft_consensus.cc:2243] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.144675  1934 raft_consensus.cc:2272] T 7480597af1f341178e465e8723f7320e P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.147976  1934 tablet_replica.cc:333] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
W20260709 13:18:19.157099  3165 consensus_peers.cc:597] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:19.157778  1934 raft_consensus.cc:2243] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:18:19.161996  1934 raft_consensus.cc:2272] T 0940cf459a7741b58bd85191d095a404 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.165268  1934 tablet_replica.cc:333] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.170266  1934 raft_consensus.cc:2243] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:18:19.188746  1934 raft_consensus.cc:2272] T a28cf255dda74b44acbfc2fff2f8f950 P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.189941 11616 raft_consensus.cc:493] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:19.190788 11616 raft_consensus.cc:515] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:19.192716  1934 tablet_replica.cc:333] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.194078  1934 raft_consensus.cc:2243] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.194924  1934 raft_consensus.cc:2272] T bbb23f9b807d45969a33e8f37691eff6 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.198565  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef26e81d3be4bc0883542eb71924948" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
W20260709 13:18:19.200206  3091 leader_election.cc:336] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:19.201432  3090 leader_election.cc:304] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:19.202471 11615 raft_consensus.cc:2749] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:19.207304 11616 leader_election.cc:290] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:19.225449  3762 consensus_peers.cc:597] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:19.229558  2935 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 60363.1us
I20260709 13:18:19.256155 11615 raft_consensus.cc:493] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:19.256899 11615 raft_consensus.cc:515] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:19.218333  1934 tablet_replica.cc:333] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.259927  1934 raft_consensus.cc:2243] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 25 LEADER]: Raft consensus shutting down.
W20260709 13:18:19.261441  2935 catalog_manager.cc:4755] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4b83202a913e45d5830d2ecdfb5354c2: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:19.263212 11615 leader_election.cc:290] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:19.268721  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7972fb78be427daa0baf637a4c17d1" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:19.269837  1934 raft_consensus.cc:2272] T 921c451a21e944ff8a8e6ec22207eca3 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.270156 11604 raft_consensus.cc:493] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e9165fe61ab04bfb9a48889156d5c161)
I20260709 13:18:19.270937 11604 raft_consensus.cc:515] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:19.271914  3091 leader_election.cc:336] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:19.272426  3091 leader_election.cc:304] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:19.273281  1934 tablet_replica.cc:333] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.274147  1934 raft_consensus.cc:2243] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:18:19.274682 11615 raft_consensus.cc:2749] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:19.275417  1934 raft_consensus.cc:2272] T 85059665c6234a2a8380bebb4790b5cb P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.276005 11604 leader_election.cc:290] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:19.275962  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a367b51f1ce4b0197b9dadabe52be32" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:19.278442  1934 tablet_replica.cc:333] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.279678  1934 raft_consensus.cc:2243] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:18:19.280943  3091 leader_election.cc:336] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:19.281548  3091 leader_election.cc:304] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: aaf88538197a49adb8bcf3790309a67e, e9165fe61ab04bfb9a48889156d5c161
I20260709 13:18:19.282444 11604 raft_consensus.cc:2749] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:19.281133  1934 raft_consensus.cc:2272] T cf28784fe3e74ad5b9c56f1d28247222 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.293915  1934 tablet_replica.cc:333] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.294862  1934 raft_consensus.cc:2243] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 32 LEADER]: Raft consensus shutting down.
I20260709 13:18:19.299543  1934 raft_consensus.cc:2272] T efef22a7096a40bdb96063353ee98827 P f20672b2852447a6bc1e137c4dd40904 [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.303092  1934 tablet_replica.cc:333] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.302915 11604 raft_consensus.cc:493] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
W20260709 13:18:19.310792  3165 consensus_peers.cc:597] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:19.321638 11604 raft_consensus.cc:515] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:19.324281 11604 leader_election.cc:290] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:19.313300  3762 consensus_peers.cc:597] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:19.321439  1934 raft_consensus.cc:2243] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.325690  1934 raft_consensus.cc:2272] T 1247b6af0f274b8c9d99b6be2d7fbc6b P f20672b2852447a6bc1e137c4dd40904 [term 32 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:19.330623  3091 leader_election.cc:336] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:19.339555  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201b46c47dd4427db5220d8cfaf02883" candidate_uuid: "f20672b2852447a6bc1e137c4dd40904" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:19.341817  3090 leader_election.cc:304] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20672b2852447a6bc1e137c4dd40904; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:19.343091 11604 raft_consensus.cc:2749] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:19.352335  3165 consensus_peers.cc:597] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:19.353202  1934 tablet_replica.cc:333] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.355047  1934 raft_consensus.cc:2243] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.356073  1934 raft_consensus.cc:2272] T d0547788d7204e17800f3e8d5ac0b20a P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.359699  1934 tablet_replica.cc:333] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.361486  1934 raft_consensus.cc:2243] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.362596  1934 raft_consensus.cc:2272] T de94f7d51a554137acbf3110ce91f2fc P f20672b2852447a6bc1e137c4dd40904 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.367321  1934 tablet_replica.cc:333] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.368422  1934 raft_consensus.cc:2243] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.369701  1934 raft_consensus.cc:2272] T d5f05b490add4820b03ca7600e7539ff P f20672b2852447a6bc1e137c4dd40904 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.373443  1934 tablet_replica.cc:333] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.374568  1934 raft_consensus.cc:2243] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.375507  1934 raft_consensus.cc:2272] T 0d08acccfb704a2cbd3aa420321f06d0 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.379663  1934 tablet_replica.cc:333] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.380774  1934 raft_consensus.cc:2243] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.381717  1934 raft_consensus.cc:2272] T 60d362d3e2ef4546ae699b5d8f4db504 P f20672b2852447a6bc1e137c4dd40904 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.385569  1934 tablet_replica.cc:333] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.386497  1934 raft_consensus.cc:2243] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.388278  1934 raft_consensus.cc:2272] T aef26e81d3be4bc0883542eb71924948 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.392457  1934 tablet_replica.cc:333] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
W20260709 13:18:19.392707  3762 consensus_peers.cc:597] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:18:19.393463  1934 raft_consensus.cc:2243] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:18:19.394883  1934 raft_consensus.cc:2272] T 4b83202a913e45d5830d2ecdfb5354c2 P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.399149  1934 tablet_replica.cc:333] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.400283  1934 raft_consensus.cc:2243] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.402798  1934 raft_consensus.cc:2272] T 717d128a6d6e4ec0b76d3993e4153a8a P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.407860  1934 tablet_replica.cc:333] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.408916  1934 raft_consensus.cc:2243] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:18:19.410601  1934 raft_consensus.cc:2272] T c0433e7a23a246a290c4170888e0d7ee P f20672b2852447a6bc1e137c4dd40904 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.414970  1934 tablet_replica.cc:333] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.415970  1934 raft_consensus.cc:2243] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.417366  1934 raft_consensus.cc:2272] T f9bcd8873c04459f9a1652eaf201375c P f20672b2852447a6bc1e137c4dd40904 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.421490  1934 tablet_replica.cc:333] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.422426  1934 raft_consensus.cc:2243] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.424194  1934 raft_consensus.cc:2272] T ca4522a8737341bf9c2cb35d3d54f23b P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.433568  1934 tablet_replica.cc:333] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
W20260709 13:18:19.434281  3165 consensus_peers.cc:597] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:18:19.434609  1934 raft_consensus.cc:2243] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.435737  1934 raft_consensus.cc:2272] T a641b8a516264234af4db10b1a0610f0 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.439278  1934 tablet_replica.cc:333] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.440343  1934 raft_consensus.cc:2243] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.441147  1934 raft_consensus.cc:2272] T 201b46c47dd4427db5220d8cfaf02883 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.448908  1934 tablet_replica.cc:333] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.449977  1934 raft_consensus.cc:2243] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.451040  1934 raft_consensus.cc:2272] T 1a367b51f1ce4b0197b9dadabe52be32 P f20672b2852447a6bc1e137c4dd40904 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.454917  1934 tablet_replica.cc:333] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.455967  1934 raft_consensus.cc:2243] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.457023  1934 raft_consensus.cc:2272] T a958b84326034dfd93407cbe60f84548 P f20672b2852447a6bc1e137c4dd40904 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.464301  1934 tablet_replica.cc:333] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.467721  1934 raft_consensus.cc:2243] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:19.470003  1934 raft_consensus.cc:2272] T 038f072ecdcc4679a46740d78fb0dbd7 P f20672b2852447a6bc1e137c4dd40904 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.477953  1934 tablet_replica.cc:333] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.478916  1934 raft_consensus.cc:2243] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.479905  1934 raft_consensus.cc:2272] T 1c7972fb78be427daa0baf637a4c17d1 P f20672b2852447a6bc1e137c4dd40904 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:19.487234  3165 consensus_peers.cc:597] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:18:19.487983  1934 tablet_replica.cc:333] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.488971  1934 raft_consensus.cc:2243] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.490020  1934 raft_consensus.cc:2272] T 44281a32716140bc805b71db0e071122 P f20672b2852447a6bc1e137c4dd40904 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.492957 11583 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:19.494848 11583 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:19.517537  3761 leader_election.cc:336] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:19.518399  3762 leader_election.cc:336] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:19.518978  3762 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:19.520115 11614 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:18:19.508595  3165 consensus_peers.cc:597] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:18:19.523411 11583 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:19.534634  3165 consensus_peers.cc:597] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:18:19.527807  1934 tablet_replica.cc:333] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904: stopping tablet replica
I20260709 13:18:19.538277  1934 raft_consensus.cc:2243] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:18:19.537300  3165 consensus_peers.cc:597] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:19.620079  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:44609, user_credentials={real_user=slave}} blocked reactor thread for 82828us
I20260709 13:18:19.580087  1934 raft_consensus.cc:2272] T be0f43de06b240e69f5f94ca88c7b321 P f20672b2852447a6bc1e137c4dd40904 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.670161 11614 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:19.670854 11614 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:19.673314 11614 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:19.678052  3761 leader_election.cc:336] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:19.684448  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:19.693181  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:19.695675 11614 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:19.710032  3165 consensus_peers.cc:597] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:18:19.725461 11574 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:19.726168 11574 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:19.728543 11574 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:19.732718 11574 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:18:19.734532  3164 leader_election.cc:336] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:19.735699 11574 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:19.738554  3165 leader_election.cc:336] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:19.739135  3165 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:19.740691 11609 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:19.741693  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:18:19.742062  3164 leader_election.cc:336] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:19.742673 11574 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:19.744596  3164 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:19.746122 11574 raft_consensus.cc:2749] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:19.784198  3197 consensus_queue.cc:237] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:19.821661  3165 consensus_peers.cc:597] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:19.830749  3794 raft_consensus.cc:1275] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:18:19.831421  3165 consensus_peers.cc:597] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:19.832582 11609 consensus_queue.cc:1048] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:18:19.848731  3164 consensus_peers.cc:597] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:19.872289 11609 raft_consensus.cc:2955] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 4 to 14, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:19.875159  3794 raft_consensus.cc:2955] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 4 to 14, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:19.881167 11579 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:19.881824 11579 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:19.883862 11579 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:19.885259  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:19.885982  3798 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 23.
I20260709 13:18:19.888284  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:18:19.889101 11574 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:19.889485 11574 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:19.889904 11574 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:18:19.890854  3164 leader_election.cc:336] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:19.905042  2934 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a641b8a516264234af4db10b1a0610f0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
I20260709 13:18:19.906024 11574 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:19.908253 11574 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
W20260709 13:18:19.913707  3164 leader_election.cc:336] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:19.914114  3798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf43b3ddced94b0395a3a79080ce0ed5" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161"
I20260709 13:18:19.914706  3798 raft_consensus.cc:3060] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:19.925598  3798 raft_consensus.cc:2468] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501fdf2af2bc4b0c971ae880e98f466b in term 24.
I20260709 13:18:19.938339  2941 catalog_manager.cc:5697] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: config changed from index 4 to 14, VOTER aaf88538197a49adb8bcf3790309a67e (127.1.227.129) evicted. New cstate: current_term: 18 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } } }
I20260709 13:18:19.944034  3164 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:19.945966 11574 raft_consensus.cc:2804] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:19.946529 11574 raft_consensus.cc:697] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 LEADER]: Becoming Leader. State: Replica: 501fdf2af2bc4b0c971ae880e98f466b, State: Running, Role: LEADER
I20260709 13:18:19.947659 11574 consensus_queue.cc:237] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:19.991178  3762 consensus_peers.cc:597] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:20.004396 11574 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:20.004999 11574 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:20.007095 11574 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:20.011777  3165 leader_election.cc:336] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:20.029709  3164 leader_election.cc:336] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:20.030563  3164 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:20.033177 11605 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:18:20.036110  3165 consensus_peers.cc:597] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:20.055783  3165 consensus_peers.cc:597] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:20.134863  3165 consensus_peers.cc:597] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:20.177420  2943 catalog_manager.cc:5697] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b reported cstate change: term changed from 23 to 24, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131). New cstate: current_term: 24 leader_uuid: "501fdf2af2bc4b0c971ae880e98f466b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:20.261356  3165 consensus_peers.cc:597] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:18:20.284837 11624 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:18:20.285033  2935 catalog_manager.cc:4755] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet a641b8a516264234af4db10b1a0610f0: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:20.285555 11624 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:20.287806 11624 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:20.294278  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:18:20.300858  3164 leader_election.cc:336] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:20.301880  3164 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:20.303867 11624 raft_consensus.cc:2749] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:20.323422 11614 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:20.324018 11614 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:20.326130 11614 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:20.327586  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:20.328293  3197 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 23.
I20260709 13:18:20.331912 11583 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:18:20.332624  3761 leader_election.cc:336] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:20.332533 11583 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:20.333491  3761 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:20.339547 11583 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:20.340179 11583 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:20.340576 11583 raft_consensus.cc:493] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:20.340916 11583 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:18:20.353061  3762 leader_election.cc:336] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:20.359436 11624 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:20.360010 11624 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:20.361114 11605 raft_consensus.cc:493] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:20.361642 11605 raft_consensus.cc:515] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:20.362152 11609 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:20.362749 11609 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:20.363559 11624 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:20.363790 11605 leader_election.cc:290] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:20.364138 11624 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:20.364607 11624 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:20.364953 11609 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:20.367792 11624 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:20.368116  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
I20260709 13:18:20.372081 11583 raft_consensus.cc:515] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:20.373777  3164 leader_election.cc:336] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
W20260709 13:18:20.374500  3165 leader_election.cc:336] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:20.374820 11583 leader_election.cc:290] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:20.374990  3165 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:20.375944  3165 leader_election.cc:336] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:20.375967 11579 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:20.377342  3164 leader_election.cc:336] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:20.378818  3164 leader_election.cc:304] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:20.379997 11579 raft_consensus.cc:2749] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:18:20.380142  3164 leader_election.cc:336] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:20.380607  3164 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:20.379330  3165 leader_election.cc:336] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:20.381600 11579 raft_consensus.cc:2749] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:20.389912  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006a17784d3e4b139686bca788cab915" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:20.390559  3197 raft_consensus.cc:3060] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:18:20.391578  3761 leader_election.cc:336] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:20.392776  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:20.392284  3164 leader_election.cc:336] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:20.394797  3164 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:20.395411 11630 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:20.396512 11579 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:18:20.400960  3761 leader_election.cc:336] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
W20260709 13:18:20.409608  3762 consensus_peers.cc:597] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:18:20.417565 11579 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:20.418181 11579 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:20.419452  3197 raft_consensus.cc:2468] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 24.
I20260709 13:18:20.420171 11579 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:20.429998  3164 leader_election.cc:336] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:20.447479  3761 leader_election.cc:304] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:20.449261 11583 raft_consensus.cc:2804] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:20.449724 11583 raft_consensus.cc:697] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [term 24 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:18:20.450579 11583 consensus_queue.cc:237] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:20.459372 11579 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:20.459980 11579 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:20.462028 11579 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:20.475895  2943 catalog_manager.cc:5697] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 23 to 24, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 24 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:20.482153  3165 leader_election.cc:336] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:20.482679  3165 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:20.483501 11605 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:20.485188  3794 raft_consensus.cc:1275] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Refusing update from remote peer 501fdf2af2bc4b0c971ae880e98f466b: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:18:20.487807 11605 consensus_queue.cc:1048] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:18:20.489002  3164 leader_election.cc:336] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:20.509994 11583 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:20.510563 11583 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:20.512496 11583 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:20.517975  3165 leader_election.cc:336] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:20.519098  3761 leader_election.cc:336] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:20.519285  3165 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:20.527892 11605 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:20.536806  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:20.537580  3197 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 25.
I20260709 13:18:20.543540  3761 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:20.544502 11583 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:20.544864 11583 raft_consensus.cc:493] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:20.545209 11583 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:18:20.542460  3165 consensus_peers.cc:597] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:20.570050  3165 consensus_peers.cc:597] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:20.571683  3762 consensus_peers.cc:597] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:18:20.572183 11583 raft_consensus.cc:515] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:20.580248 11583 leader_election.cc:290] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:20.583566 11605 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:20.584286 11605 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:20.595674 11605 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132:43109)
I20260709 13:18:20.607198  3794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "501fdf2af2bc4b0c971ae880e98f466b" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e9165fe61ab04bfb9a48889156d5c161" is_pre_election: true
W20260709 13:18:20.610404  3761 leader_election.cc:336] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:20.607765  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1474206f8d49e58df15541f5a5725e" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:20.612124  3195 raft_consensus.cc:3060] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:20.629992  3195 raft_consensus.cc:2468] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 26.
W20260709 13:18:20.639219  3164 consensus_peers.cc:597] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:20.641170  3164 leader_election.cc:336] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:20.642164  3761 leader_election.cc:304] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:20.644644  3164 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: e9165fe61ab04bfb9a48889156d5c161, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:20.645303 11583 raft_consensus.cc:2804] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:18:20.639307  3762 consensus_peers.cc:597] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:18:20.645815 11583 raft_consensus.cc:697] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 26 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:18:20.646806 11583 consensus_queue.cc:237] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:20.648159 11635 raft_consensus.cc:2749] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:18:20.676115  3164 consensus_peers.cc:597] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:20.686172  2943 catalog_manager.cc:5697] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 25 to 26, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 26 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.688970 11630 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:20.689565 11630 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:20.692152  3164 consensus_peers.cc:597] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:20.694561 11630 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:20.697904  3762 leader_election.cc:336] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:20.701627  3761 leader_election.cc:336] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:20.702083  3761 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:20.703250 11630 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:20.721843 11636 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:20.722451 11636 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:20.724722 11636 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:20.729946  3165 leader_election.cc:336] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:20.735430 11614 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:20.736078 11614 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:20.739403 11614 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:20.750610  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:20.751323  3195 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 24.
I20260709 13:18:20.760288 11630 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:20.760937 11630 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:20.756362  3761 leader_election.cc:336] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:20.764851  3761 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:20.766016 11583 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:20.766463 11583 raft_consensus.cc:493] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:20.766870 11583 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:18:20.771446 11639 log.cc:927] Time spent T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:18:20.801672  3762 consensus_peers.cc:597] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:18:20.790397 11605 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
W20260709 13:18:20.791199  3164 leader_election.cc:336] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:20.801831 11630 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:20.803014  3164 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:20.802999 11605 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
W20260709 13:18:20.804359  3164 consensus_peers.cc:597] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:20.805686 11605 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:20.806075 11609 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 13:18:20.784590 11583 raft_consensus.cc:515] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:20.813977  3165 leader_election.cc:336] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:20.815049 11583 leader_election.cc:290] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:20.830364  3164 consensus_peers.cc:597] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:20.830997  3164 leader_election.cc:336] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:20.831405  3164 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:20.832173 11605 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:18:20.832662  3761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:38665, user_credentials={real_user=slave}} blocked reactor thread for 67880.4us
I20260709 13:18:20.837131  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b" is_pre_election: true
I20260709 13:18:20.839079  3195 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 25.
I20260709 13:18:20.840201  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b83202a913e45d5830d2ecdfb5354c2" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
I20260709 13:18:20.840819  3197 raft_consensus.cc:3060] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:20.848419  3197 raft_consensus.cc:2468] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 25.
W20260709 13:18:20.849166  3762 consensus_peers.cc:597] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:18:20.859088  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:18:20.875440  3761 leader_election.cc:304] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: 
I20260709 13:18:20.876645 11642 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:20.877446 11642 raft_consensus.cc:493] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting leader election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:20.878008 11642 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:18:20.891929  3164 consensus_peers.cc:597] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:20.895354 11641 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:20.895644 11583 raft_consensus.cc:2804] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:20.896140 11583 raft_consensus.cc:697] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 25 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:18:20.896026 11641 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:20.897156 11583 consensus_queue.cc:237] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:20.898981 11641 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:20.905468  3762 leader_election.cc:336] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:20.907124  3761 leader_election.cc:336] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:20.916211  2943 catalog_manager.cc:5697] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 24 to 25, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 25 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:20.935667  3164 consensus_peers.cc:597] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:20.950260  3761 leader_election.cc:336] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:20.960824 11642 raft_consensus.cc:515] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:20.966886  3761 consensus_peers.cc:597] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:20.970716  3164 consensus_peers.cc:597] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:20.983125  3164 consensus_peers.cc:597] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:20.985306  3761 leader_election.cc:336] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:20.985888  3761 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:20.986727 11642 leader_election.cc:290] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 election: Requested vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:20.986888  3761 consensus_peers.cc:597] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:20.987159 11641 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:20.987629  3761 consensus_peers.cc:597] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:20.988077  3761 consensus_peers.cc:597] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:20.999120  3164 consensus_peers.cc:597] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:21.001931  3761 leader_election.cc:336] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:21.026096  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85059665c6234a2a8380bebb4790b5cb" candidate_uuid: "e9165fe61ab04bfb9a48889156d5c161" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "501fdf2af2bc4b0c971ae880e98f466b"
W20260709 13:18:21.026633  3165 consensus_peers.cc:597] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:18:21.026839  3197 raft_consensus.cc:3060] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:21.031178  3195 raft_consensus.cc:1275] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
W20260709 13:18:21.034520  3164 consensus_peers.cc:597] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:21.036852  3197 raft_consensus.cc:2468] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9165fe61ab04bfb9a48889156d5c161 in term 26.
W20260709 13:18:21.058331  3761 consensus_peers.cc:597] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:21.060906 11642 consensus_queue.cc:1048] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:18:21.062140  3762 consensus_peers.cc:597] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:21.063413  3165 consensus_peers.cc:597] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:18:21.064646  3761 leader_election.cc:304] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b, e9165fe61ab04bfb9a48889156d5c161; no voters: f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:21.065485 11642 raft_consensus.cc:2804] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:18:21.066156 11642 raft_consensus.cc:697] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 26 LEADER]: Becoming Leader. State: Replica: e9165fe61ab04bfb9a48889156d5c161, State: Running, Role: LEADER
I20260709 13:18:21.067185 11642 consensus_queue.cc:237] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:21.082911  3164 consensus_peers.cc:597] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:21.097643  3761 consensus_peers.cc:597] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:21.104907  3761 consensus_peers.cc:597] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:21.119020  3199 raft_consensus.cc:1275] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
W20260709 13:18:21.122090  3164 consensus_peers.cc:597] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:21.137645  3164 consensus_peers.cc:597] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:21.124733  2941 catalog_manager.cc:5697] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 reported cstate change: term changed from 25 to 26, leader changed from f20672b2852447a6bc1e137c4dd40904 (127.1.227.130) to e9165fe61ab04bfb9a48889156d5c161 (127.1.227.132). New cstate: current_term: 26 leader_uuid: "e9165fe61ab04bfb9a48889156d5c161" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:21.134410  3761 consensus_peers.cc:597] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:21.125160  3165 consensus_peers.cc:597] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:18:21.145464 11583 consensus_queue.cc:1048] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:18:21.157435  3164 consensus_peers.cc:597] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:21.185712 11583 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:21.186558 11583 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:21.189232 11583 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:21.200881  3761 leader_election.cc:336] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
W20260709 13:18:21.203894  3762 leader_election.cc:336] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:21.204964  3762 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:21.209147 11583 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:18:21.231191  3761 consensus_peers.cc:597] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:21.234176  3164 consensus_peers.cc:597] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:21.286281  3164 consensus_peers.cc:597] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:21.290482  3762 consensus_peers.cc:597] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:21.297111  3761 consensus_peers.cc:597] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:21.302918  3165 consensus_peers.cc:597] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:21.313601  3761 consensus_peers.cc:597] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:21.322830  3164 consensus_peers.cc:597] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:21.335922  3164 consensus_peers.cc:597] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:21.370548  3164 consensus_peers.cc:597] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:21.380229  3164 consensus_peers.cc:597] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:21.395915  3761 consensus_peers.cc:597] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:21.406157  3193 raft_consensus.cc:1275] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:18:21.428081 11583 consensus_queue.cc:1048] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:18:21.440863 11636 raft_consensus.cc:493] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:21.441676 11636 raft_consensus.cc:515] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:21.444170 11636 leader_election.cc:290] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:21.496176  2935 catalog_manager.cc:4755] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet a641b8a516264234af4db10b1a0610f0: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:21.501236  3164 consensus_peers.cc:597] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:21.505842  3165 leader_election.cc:336] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:21.536258  1934 tablet_server.cc:196] TabletServer@127.1.227.130:0 shutdown complete.
W20260709 13:18:21.574867  3164 consensus_peers.cc:597] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:21.609108  3762 consensus_peers.cc:597] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:18:21.614713  3193 raft_consensus.cc:1275] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Refusing update from remote peer e9165fe61ab04bfb9a48889156d5c161: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
W20260709 13:18:21.636653  3164 leader_election.cc:336] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:21.638870  3164 leader_election.cc:304] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:21.640283  3165 consensus_peers.cc:597] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:18:21.641528 11605 raft_consensus.cc:2749] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:21.664603 11583 consensus_queue.cc:1048] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:18:21.667203  3761 consensus_peers.cc:597] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:21.734944  3165 consensus_peers.cc:597] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:21.802644  3165 consensus_peers.cc:597] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:21.804606  3165 consensus_peers.cc:597] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:21.843178  3762 consensus_peers.cc:597] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:21.948101 11640 raft_consensus.cc:493] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:21.948815 11640 raft_consensus.cc:515] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:21.952669 11640 leader_election.cc:290] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:21.952935  3165 consensus_peers.cc:597] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:18:21.962527 11640 raft_consensus.cc:493] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:21.963340 11640 raft_consensus.cc:515] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:21.966616 11640 leader_election.cc:290] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:21.969672  3165 leader_election.cc:336] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:21.976181  3164 leader_election.cc:336] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:21.976797  3164 leader_election.cc:304] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:21.977907 11640 raft_consensus.cc:2749] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:18:22.015929  3165 leader_election.cc:336] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:22.032500  3164 leader_election.cc:336] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:22.033177  3164 leader_election.cc:304] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:22.037675 11605 raft_consensus.cc:2749] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:22.045470  3762 consensus_peers.cc:597] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:22.063309  3165 consensus_peers.cc:597] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:22.069931  3165 consensus_peers.cc:597] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:22.111832  3165 consensus_peers.cc:597] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:18:22.188416 11605 raft_consensus.cc:493] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:22.194875 11605 raft_consensus.cc:515] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:22.198100 11605 leader_election.cc:290] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:22.202220  3164 leader_election.cc:336] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
W20260709 13:18:22.202831  3165 leader_election.cc:336] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:22.203399  3165 leader_election.cc:304] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:22.204417  1934 tablet_server.cc:179] TabletServer@127.1.227.131:0 shutting down...
I20260709 13:18:22.205410 11605 raft_consensus.cc:2749] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:18:22.210453  3761 consensus_peers.cc:597] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:22.224506  3164 consensus_peers.cc:597] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:22.280539  3761 consensus_peers.cc:597] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.288697 11642 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:22.289335 11642 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:22.301723  3762 leader_election.cc:336] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:22.305702 11642 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:22.315353  3761 leader_election.cc:336] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:22.315814  3761 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:22.317060 11642 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:22.319875  3165 consensus_peers.cc:597] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:22.338421  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:22.339986  1934 tablet_replica.cc:333] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.340927  1934 raft_consensus.cc:2243] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.342716  1934 raft_consensus.cc:2272] T a2dc1155b33b4fbc830d189f5e109f78 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.355199  1934 tablet_replica.cc:333] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.356070  1934 raft_consensus.cc:2243] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.357193  1934 raft_consensus.cc:2272] T e7ddfa6bafce4dcab37f071b34290125 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.361559  1934 tablet_replica.cc:333] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.362474  1934 raft_consensus.cc:2243] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.363130  1934 raft_consensus.cc:2272] T 24410f20507a4acf874cdb6e84c306f6 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.372125  1934 tablet_replica.cc:333] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.373173  1934 raft_consensus.cc:2243] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.374372  1934 raft_consensus.cc:2272] T cf43b3ddced94b0395a3a79080ce0ed5 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.391930  1934 tablet_replica.cc:333] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.392787  1934 raft_consensus.cc:2243] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:22.396101  3165 consensus_peers.cc:597] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:22.396814  3165 consensus_peers.cc:597] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:18:22.399114  1934 raft_consensus.cc:2272] T 4b83202a913e45d5830d2ecdfb5354c2 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.409473  1934 tablet_replica.cc:333] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.410596  1934 raft_consensus.cc:2243] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.410570 11605 raft_consensus.cc:493] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:22.412045  1934 raft_consensus.cc:2272] T 006a17784d3e4b139686bca788cab915 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.411952 11605 raft_consensus.cc:515] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:22.415346 11605 leader_election.cc:290] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:22.418144  1934 tablet_replica.cc:333] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.419193  1934 raft_consensus.cc:2243] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.421166  1934 raft_consensus.cc:2272] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.423928  1934 tablet_replica.cc:333] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.424719  1934 raft_consensus.cc:2243] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.425715  1934 raft_consensus.cc:2272] T ae0fe1dc34db4ff5b5d35916b8a84d4a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.428524  1934 tablet_replica.cc:333] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.429273  1934 raft_consensus.cc:2243] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:22.431391  3165 consensus_peers.cc:597] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:22.438897  3164 leader_election.cc:336] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
W20260709 13:18:22.440507  3761 consensus_peers.cc:597] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.441444  1934 raft_consensus.cc:2272] T 4b91597ece9742ebad558605a654e02a P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.444273  1934 tablet_replica.cc:333] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.445101  1934 raft_consensus.cc:2243] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.446239  1934 raft_consensus.cc:2272] T 01dd1f72eb8249a6adadee5f3509bcc2 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.448879  1934 tablet_replica.cc:333] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.449636  1934 raft_consensus.cc:2243] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.450891  1934 raft_consensus.cc:2272] T 6707728696274f8cbf107e2a9fd20a2a P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:22.453037  3165 consensus_peers.cc:597] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:22.453512  3165 leader_election.cc:336] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:22.453915  3165 leader_election.cc:304] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:22.456606 11605 raft_consensus.cc:2749] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:22.470221  1934 tablet_replica.cc:333] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.471698  1934 raft_consensus.cc:2243] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.472756  1934 raft_consensus.cc:2272] T e234b352c9c44269b88598c9ae245ab5 P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:22.473104  3762 consensus_peers.cc:597] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:22.476287  1934 tablet_replica.cc:333] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.477171  1934 raft_consensus.cc:2243] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.480393  1934 raft_consensus.cc:2272] T e1d12e7c2ef94802ad2c1a3390fe2a8e P 501fdf2af2bc4b0c971ae880e98f466b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.481652 11605 raft_consensus.cc:493] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 32 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:22.482146 11605 raft_consensus.cc:515] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:22.482992  1934 tablet_replica.cc:333] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.483843  1934 raft_consensus.cc:2243] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.483917 11605 leader_election.cc:290] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:22.484944  1934 raft_consensus.cc:2272] T 22edd8baac97497aad3f2c9971868c48 P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.496335  1934 tablet_replica.cc:333] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.497112  1934 raft_consensus.cc:2243] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.498558  1934 raft_consensus.cc:2272] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.501534  1934 tablet_replica.cc:333] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.502364  1934 raft_consensus.cc:2243] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.503080  1934 raft_consensus.cc:2272] T 172fb190a0d74cd292c08c451255bae2 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.517882  1934 tablet_replica.cc:333] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.518846  1934 raft_consensus.cc:2243] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:18:22.526718  3164 leader_election.cc:336] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:22.527298  1934 raft_consensus.cc:2272] T 348c9fe65bc24c3caf5c132e715a13ba P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:22.529429  3165 leader_election.cc:336] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:22.529938  3165 leader_election.cc:304] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:22.533025  1934 tablet_replica.cc:333] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.533944  1934 raft_consensus.cc:2243] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.534961  1934 raft_consensus.cc:2272] T 5278ab37d43548b39aed98352e8b9e31 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.542332 11605 raft_consensus.cc:2749] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 13:18:22.542394  1934 tablet_replica.cc:333] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.543949  1934 raft_consensus.cc:2243] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:18:22.549065  3761 consensus_peers.cc:597] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.549872  1934 raft_consensus.cc:2272] T 1d72320f324f482bb7e1e27290040a3d P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:22.549811  3761 consensus_peers.cc:597] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:22.552237  3761 consensus_peers.cc:597] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:22.552835  3761 consensus_peers.cc:597] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.552922  1934 tablet_replica.cc:333] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
W20260709 13:18:22.553402  3761 consensus_peers.cc:597] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.555707  1934 raft_consensus.cc:2243] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.556870  1934 raft_consensus.cc:2272] T 7480597af1f341178e465e8723f7320e P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.562924 11642 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:22.563537 11642 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:22.565666 11642 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:22.569901  1934 tablet_replica.cc:333] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.569864 11605 raft_consensus.cc:493] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:22.570626 11605 raft_consensus.cc:515] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:22.571049  1934 raft_consensus.cc:2243] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:22.571794  3165 consensus_peers.cc:597] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:22.572155  1934 raft_consensus.cc:2272] T 1e1474206f8d49e58df15541f5a5725e P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.572607 11605 leader_election.cc:290] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:22.574301  3762 leader_election.cc:336] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:22.575331  1934 tablet_replica.cc:333] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.576226  1934 raft_consensus.cc:2243] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.576849  1934 raft_consensus.cc:2272] T f12375b5613c4d08b52a1a44ccb82294 P 501fdf2af2bc4b0c971ae880e98f466b [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:22.577260  3164 leader_election.cc:336] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
W20260709 13:18:22.587733  3761 consensus_peers.cc:597] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.589413  1934 tablet_replica.cc:333] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.590353  1934 raft_consensus.cc:2243] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.591562  1934 raft_consensus.cc:2272] T d0547788d7204e17800f3e8d5ac0b20a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:22.591996  3165 leader_election.cc:336] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:22.592478  3165 leader_election.cc:304] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
W20260709 13:18:22.593907  2935 catalog_manager.cc:4755] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet a641b8a516264234af4db10b1a0610f0: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:22.594715  3761 consensus_peers.cc:597] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:22.598222  3761 leader_election.cc:336] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:22.598730  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:22.599614 11642 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:22.602005 11605 raft_consensus.cc:2749] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:22.605225  1934 tablet_replica.cc:333] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
W20260709 13:18:22.605842  3165 consensus_peers.cc:597] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:22.606122  1934 raft_consensus.cc:2243] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.607121  1934 raft_consensus.cc:2272] T 85059665c6234a2a8380bebb4790b5cb P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.610560  1934 tablet_replica.cc:333] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.611521  1934 raft_consensus.cc:2243] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.612298  1934 raft_consensus.cc:2272] T cf28784fe3e74ad5b9c56f1d28247222 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.615223  1934 tablet_replica.cc:333] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.615859 11605 raft_consensus.cc:493] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:22.616091  1934 raft_consensus.cc:2243] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.616412 11605 raft_consensus.cc:515] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } }
I20260709 13:18:22.617446  1934 raft_consensus.cc:2272] T bbb23f9b807d45969a33e8f37691eff6 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.618763 11605 leader_election.cc:290] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:22.623826  1934 tablet_replica.cc:333] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.624711  1934 raft_consensus.cc:2243] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:22.625454  3164 leader_election.cc:336] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:22.626297  1934 raft_consensus.cc:2272] T 0940cf459a7741b58bd85191d095a404 P 501fdf2af2bc4b0c971ae880e98f466b [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:22.628028  3165 leader_election.cc:336] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:22.628474  3165 leader_election.cc:304] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 501fdf2af2bc4b0c971ae880e98f466b; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:22.629164 11605 raft_consensus.cc:2749] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:22.629594  1934 tablet_replica.cc:333] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.630415  1934 raft_consensus.cc:2243] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.631052  1934 raft_consensus.cc:2272] T efef22a7096a40bdb96063353ee98827 P 501fdf2af2bc4b0c971ae880e98f466b [term 32 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:22.632673  3761 consensus_peers.cc:597] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.633917  1934 tablet_replica.cc:333] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.634860  1934 raft_consensus.cc:2243] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 32 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.636250  1934 raft_consensus.cc:2272] T 1247b6af0f274b8c9d99b6be2d7fbc6b P 501fdf2af2bc4b0c971ae880e98f466b [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.639225  1934 tablet_replica.cc:333] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.640113  1934 raft_consensus.cc:2243] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.641469  1934 raft_consensus.cc:2272] T 1c7972fb78be427daa0baf637a4c17d1 P 501fdf2af2bc4b0c971ae880e98f466b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.645823  1934 tablet_replica.cc:333] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.646670  1934 raft_consensus.cc:2243] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.647562  1934 raft_consensus.cc:2272] T 3fe8825ca0db45529c5a46ef6e9ba53d P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.658030  1934 tablet_replica.cc:333] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.659005  1934 raft_consensus.cc:2243] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.660080  1934 raft_consensus.cc:2272] T 96a33a25f4f3488ea9a2cec075aa10ce P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.663069  1934 tablet_replica.cc:333] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.663950  1934 raft_consensus.cc:2243] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.664795  1934 raft_consensus.cc:2272] T f2254b0c561f4240a9199d1c203568ac P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.686677  1934 tablet_replica.cc:333] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.687634  1934 raft_consensus.cc:2243] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.689013  1934 raft_consensus.cc:2272] T d5f05b490add4820b03ca7600e7539ff P 501fdf2af2bc4b0c971ae880e98f466b [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.692013  1934 tablet_replica.cc:333] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.692878  1934 raft_consensus.cc:2243] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.693593  1934 raft_consensus.cc:2272] T 0d08acccfb704a2cbd3aa420321f06d0 P 501fdf2af2bc4b0c971ae880e98f466b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.696309  1934 tablet_replica.cc:333] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.697181  1934 raft_consensus.cc:2243] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.698459  1934 raft_consensus.cc:2272] T a958b84326034dfd93407cbe60f84548 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.702431  1934 tablet_replica.cc:333] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.704650  1934 raft_consensus.cc:2243] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.705844  1934 raft_consensus.cc:2272] T 9c2f28b50c354b648096e08cf4f5d54a P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:22.708002  3761 consensus_peers.cc:597] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.709373  1934 tablet_replica.cc:333] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.710327  1934 raft_consensus.cc:2243] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.711548  1934 raft_consensus.cc:2272] T ca4522a8737341bf9c2cb35d3d54f23b P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.714548  1934 tablet_replica.cc:333] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.715389  1934 raft_consensus.cc:2243] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.716562  1934 raft_consensus.cc:2272] T a641b8a516264234af4db10b1a0610f0 P 501fdf2af2bc4b0c971ae880e98f466b [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:22.720964  3165 consensus_peers.cc:597] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:22.726420  1934 tablet_replica.cc:333] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.727470  1934 raft_consensus.cc:2243] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.728781  1934 raft_consensus.cc:2272] T 201b46c47dd4427db5220d8cfaf02883 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.729705 11614 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:22.730336 11614 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:22.732743 11614 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:22.744690  3761 leader_election.cc:336] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
W20260709 13:18:22.745659  3762 leader_election.cc:336] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:22.746160  3762 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:22.751302 11642 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:22.757364  1934 tablet_replica.cc:333] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.758425  1934 raft_consensus.cc:2243] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.759861  1934 raft_consensus.cc:2272] T dab74aefe0d74cf5b7b691b15690a40b P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.765307  1934 tablet_replica.cc:333] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.766239  1934 raft_consensus.cc:2243] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.767100  1934 raft_consensus.cc:2272] T fcf5db67d30f487d873766886c2ef408 P 501fdf2af2bc4b0c971ae880e98f466b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.770124  1934 tablet_replica.cc:333] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.771092  1934 raft_consensus.cc:2243] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.771828  1934 raft_consensus.cc:2272] T 921c451a21e944ff8a8e6ec22207eca3 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.774703  1934 tablet_replica.cc:333] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.775592  1934 raft_consensus.cc:2243] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.777012  1934 raft_consensus.cc:2272] T aef26e81d3be4bc0883542eb71924948 P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.781368  1934 tablet_replica.cc:333] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.782306  1934 raft_consensus.cc:2243] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.783105  1934 raft_consensus.cc:2272] T c0433e7a23a246a290c4170888e0d7ee P 501fdf2af2bc4b0c971ae880e98f466b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.786139  1934 tablet_replica.cc:333] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.787106  1934 raft_consensus.cc:2243] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.788506  1934 raft_consensus.cc:2272] T 717d128a6d6e4ec0b76d3993e4153a8a P 501fdf2af2bc4b0c971ae880e98f466b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.791373  1934 tablet_replica.cc:333] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.792246  1934 raft_consensus.cc:2243] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.793637  1934 raft_consensus.cc:2272] T f9bcd8873c04459f9a1652eaf201375c P 501fdf2af2bc4b0c971ae880e98f466b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.796762  1934 tablet_replica.cc:333] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.804590  1934 raft_consensus.cc:2243] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.805636  1934 raft_consensus.cc:2272] T 12725e4e41614e1292b974e17635f758 P 501fdf2af2bc4b0c971ae880e98f466b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.819285  1934 tablet_replica.cc:333] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b: stopping tablet replica
I20260709 13:18:22.820266  1934 raft_consensus.cc:2243] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.821583  1934 raft_consensus.cc:2272] T 60d362d3e2ef4546ae699b5d8f4db504 P 501fdf2af2bc4b0c971ae880e98f466b [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:22.919137  3762 consensus_peers.cc:597] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:22.947551  3762 consensus_peers.cc:597] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:23.086256  3761 consensus_peers.cc:597] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:23.279414  3762 consensus_peers.cc:597] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:23.300827  3762 consensus_peers.cc:597] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:23.311822 11642 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:23.312443 11642 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:23.314847 11642 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:23.321873  3761 leader_election.cc:336] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111)
W20260709 13:18:23.322422  3762 leader_election.cc:336] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:23.322875  3762 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:23.325479 11642 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:23.328964  3762 consensus_peers.cc:597] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:23.342731  3761 consensus_peers.cc:597] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:23.361568 11642 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:23.362386 11642 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:23.370576 11642 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:23.375845  3761 leader_election.cc:336] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
W20260709 13:18:23.392114  3761 leader_election.cc:336] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111)
I20260709 13:18:23.392711  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:23.394850 11642 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:23.448139 11642 raft_consensus.cc:493] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:23.448757 11642 raft_consensus.cc:515] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:23.461405  3762 leader_election.cc:336] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:23.463598 11642 leader_election.cc:290] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:23.465154  3761 leader_election.cc:336] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:23.467128  3761 leader_election.cc:304] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:23.469380 11614 raft_consensus.cc:2749] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:18:23.498699  3761 consensus_peers.cc:597] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:23.541523  3761 consensus_peers.cc:597] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:23.593145  3761 consensus_peers.cc:597] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:23.616804  3762 consensus_peers.cc:597] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:23.617995  3761 consensus_peers.cc:597] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:23.641460  3761 consensus_peers.cc:597] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:23.642115  3761 consensus_peers.cc:597] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:23.657570  3762 consensus_peers.cc:597] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:23.661269  3761 consensus_peers.cc:597] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:23.688117  3761 consensus_peers.cc:597] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:23.698084 11642 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:23.698695 11642 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:23.701114 11642 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:23.710882  3761 leader_election.cc:336] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
W20260709 13:18:23.712961  3761 leader_election.cc:336] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111)
I20260709 13:18:23.713485  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:23.714926 11642 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:18:23.739118  3761 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111) [suppressed 731 similar messages]
W20260709 13:18:23.773239  3761 consensus_peers.cc:597] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:23.845407 11642 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:23.846037 11642 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:23.860783  3761 leader_election.cc:336] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111)
W20260709 13:18:23.862089  3762 leader_election.cc:336] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:23.863847  3762 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:23.863317 11642 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:23.864876 11614 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:23.885778 11642 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:23.887835 11642 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:23.890568 11642 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:23.901144  3761 leader_election.cc:336] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
W20260709 13:18:23.902006  3761 leader_election.cc:336] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111)
I20260709 13:18:23.902482  3761 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:23.903693 11642 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:23.918201 11642 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:23.918778 11642 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:23.921128 11642 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
I20260709 13:18:23.931576 11642 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:23.932278 11642 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:23.934782 11642 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:23.935518  3761 leader_election.cc:336] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
W20260709 13:18:23.937608  3761 leader_election.cc:336] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111)
I20260709 13:18:23.938084  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:23.949966 11642 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:23.963305 11642 raft_consensus.cc:493] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:23.964005 11642 raft_consensus.cc:515] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:23.967358 11614 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:23.967974 11614 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:23.970110 11614 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:23.980841  3762 leader_election.cc:336] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:23.983522 11642 leader_election.cc:290] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
I20260709 13:18:23.987942 11614 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:23.995671 11614 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:23.993991  3762 leader_election.cc:336] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:24.000129 11614 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:24.008703  3762 leader_election.cc:336] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:24.007546  3761 leader_election.cc:336] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
W20260709 13:18:24.010735  3761 leader_election.cc:336] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111)
I20260709 13:18:24.011798  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:24.014405 11614 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:24.027359 11642 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:24.028064 11642 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:24.032159 11642 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:24.038481  3762 leader_election.cc:336] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:24.058342  3761 leader_election.cc:336] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111)
I20260709 13:18:24.058935  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:24.059816 11642 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:18:24.061156  3761 leader_election.cc:336] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111)
I20260709 13:18:24.061681  3761 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:24.062420 11642 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:18:24.065819  3761 leader_election.cc:336] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:24.066299  3761 leader_election.cc:304] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:24.067022 11642 raft_consensus.cc:2749] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:24.067873  3761 consensus_peers.cc:597] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.068334  3761 leader_election.cc:336] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
W20260709 13:18:24.074441  3761 leader_election.cc:336] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111)
I20260709 13:18:24.075012  3761 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:24.075834 11642 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:18:24.093932  3762 consensus_peers.cc:597] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:24.230086  3761 consensus_peers.cc:597] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.426636  3761 consensus_peers.cc:597] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.638914  3761 consensus_peers.cc:597] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.642931  3761 consensus_peers.cc:597] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.705880  2935 catalog_manager.cc:4755] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet a641b8a516264234af4db10b1a0610f0: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:24.750638  3762 consensus_peers.cc:597] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:24.764582 11663 raft_consensus.cc:493] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:24.765170 11663 raft_consensus.cc:515] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:24.767546 11663 leader_election.cc:290] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:24.773329  3762 consensus_peers.cc:597] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:24.773941  3762 leader_election.cc:336] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:24.786556  3761 leader_election.cc:336] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:24.787240  3761 leader_election.cc:304] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:24.789058 11663 raft_consensus.cc:2749] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:18:24.801522  3762 consensus_peers.cc:597] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:24.850296  3761 consensus_peers.cc:597] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:24.890120 11663 raft_consensus.cc:493] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:24.890690 11663 raft_consensus.cc:515] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:24.899040  3762 leader_election.cc:336] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:24.902247 11663 leader_election.cc:290] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:24.903195  3761 consensus_peers.cc:597] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.905879  3761 consensus_peers.cc:597] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.910658  3761 leader_election.cc:336] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111)
I20260709 13:18:24.914556  3761 leader_election.cc:304] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:24.915477 11663 raft_consensus.cc:2749] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:24.916616  3761 consensus_peers.cc:597] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.968711  3761 consensus_peers.cc:597] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:25.070674  3761 consensus_peers.cc:597] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:25.074412  3761 consensus_peers.cc:597] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:25.120554 11642 raft_consensus.cc:493] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:25.121109 11642 raft_consensus.cc:515] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:25.123293 11642 leader_election.cc:290] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:25.135108  3761 leader_election.cc:336] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
W20260709 13:18:25.136184  3761 leader_election.cc:336] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111)
I20260709 13:18:25.136682  3761 leader_election.cc:304] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:25.137529 11642 raft_consensus.cc:2749] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:25.244081  3761 consensus_peers.cc:597] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:25.315893  3762 consensus_peers.cc:597] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:25.503262 11642 raft_consensus.cc:493] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f20672b2852447a6bc1e137c4dd40904)
I20260709 13:18:25.504212 11642 raft_consensus.cc:515] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:25.506765 11642 leader_election.cc:290] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619)
W20260709 13:18:25.514168  3762 leader_election.cc:336] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:25.521346  3761 consensus_peers.cc:597] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 -> Peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Couldn't send request to peer 501fdf2af2bc4b0c971ae880e98f466b. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:25.522063  3761 leader_election.cc:336] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:25.522548  3761 leader_election.cc:304] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:25.523361 11642 raft_consensus.cc:2749] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:25.552274  3761 consensus_peers.cc:597] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:25.601227  3762 consensus_peers.cc:597] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:18:25.666898  3761 consensus_peers.cc:597] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:25.689062  3762 consensus_peers.cc:597] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:18:25.689219 11665 raft_consensus.cc:493] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:25.689922 11665 raft_consensus.cc:515] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:25.692303 11665 leader_election.cc:290] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:25.702080  3761 leader_election.cc:336] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
W20260709 13:18:25.702903  3761 leader_election.cc:336] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111)
I20260709 13:18:25.703367  3761 leader_election.cc:304] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:25.704236 11665 raft_consensus.cc:2749] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:18:25.726629  3762 consensus_peers.cc:597] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:25.734061 11665 raft_consensus.cc:493] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:25.734655 11665 raft_consensus.cc:515] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:25.736977 11665 leader_election.cc:290] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:25.748471  3762 consensus_peers.cc:597] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:18:25.751036  3761 leader_election.cc:336] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:25.761332 11665 raft_consensus.cc:493] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:25.761965 11665 raft_consensus.cc:515] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:25.764149 11665 leader_election.cc:290] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:25.769279  3762 leader_election.cc:336] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:25.770877  3761 leader_election.cc:336] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111)
I20260709 13:18:25.771587  3761 leader_election.cc:304] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:25.772498 11665 raft_consensus.cc:2749] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:18:25.780634  3761 leader_election.cc:336] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111)
I20260709 13:18:25.785202  3761 leader_election.cc:304] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:25.786211 11665 raft_consensus.cc:2749] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:25.812875 11665 raft_consensus.cc:493] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:25.813423 11665 raft_consensus.cc:515] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:25.815775 11665 leader_election.cc:290] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:25.823616  3761 leader_election.cc:336] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
W20260709 13:18:25.825604  3761 leader_election.cc:336] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111)
I20260709 13:18:25.826169  3761 leader_election.cc:304] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:25.827059 11665 raft_consensus.cc:2749] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:25.842053  1934 tablet_server.cc:196] TabletServer@127.1.227.131:0 shutdown complete.
I20260709 13:18:25.883388 11665 raft_consensus.cc:493] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:25.884018 11665 raft_consensus.cc:515] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:25.888517 11665 leader_election.cc:290] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:25.892699  3761 consensus_peers.cc:597] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:25.894667  3762 leader_election.cc:336] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:25.907541  3761 leader_election.cc:336] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111)
I20260709 13:18:25.908129  3761 leader_election.cc:304] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:25.909482 11665 raft_consensus.cc:2749] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:25.918701 11665 raft_consensus.cc:493] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:25.919301 11665 raft_consensus.cc:515] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } attrs { replace: true } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:25.936156  3761 leader_election.cc:336] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
I20260709 13:18:25.937507 11665 leader_election.cc:290] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:25.940315  3762 leader_election.cc:336] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:25.942384  3762 leader_election.cc:304] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: aaf88538197a49adb8bcf3790309a67e, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:25.945760 11665 raft_consensus.cc:2749] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:18:25.946771  3761 leader_election.cc:336] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111)
W20260709 13:18:25.957814  3761 consensus_peers.cc:597] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:26.076854  3761 consensus_peers.cc:597] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:26.080348  3761 consensus_peers.cc:597] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:26.086009  3761 consensus_peers.cc:597] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:26.118216  3762 consensus_peers.cc:597] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:18:26.140895 11665 raft_consensus.cc:493] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:26.141496 11665 raft_consensus.cc:515] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f20672b2852447a6bc1e137c4dd40904" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38619 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
I20260709 13:18:26.143744 11665 leader_election.cc:290] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:26.149807  3761 consensus_peers.cc:597] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:26.157564  3761 leader_election.cc:336] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111)
W20260709 13:18:26.159540  3761 leader_election.cc:336] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111)
I20260709 13:18:26.160043  3761 leader_election.cc:304] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, f20672b2852447a6bc1e137c4dd40904
I20260709 13:18:26.167101 11664 raft_consensus.cc:2749] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:26.177062  3761 consensus_peers.cc:597] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:26.166308  1934 tablet_server.cc:179] TabletServer@127.1.227.132:0 shutting down...
W20260709 13:18:26.197862  3761 consensus_peers.cc:597] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:26.227651 11664 raft_consensus.cc:493] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 501fdf2af2bc4b0c971ae880e98f466b)
I20260709 13:18:26.228299 11664 raft_consensus.cc:515] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "aaf88538197a49adb8bcf3790309a67e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 44609 } } peers { permanent_uuid: "501fdf2af2bc4b0c971ae880e98f466b" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 38665 } } peers { permanent_uuid: "e9165fe61ab04bfb9a48889156d5c161" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 43109 } attrs { promote: false } }
W20260709 13:18:26.242213  3761 consensus_peers.cc:597] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:26.243634 11664 leader_election.cc:290] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609), 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665)
W20260709 13:18:26.253382  3762 leader_election.cc:336] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:26.262844  3761 leader_election.cc:336] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 501fdf2af2bc4b0c971ae880e98f466b (127.1.227.131:38665): Network error: Client connection negotiation failed: client connection to 127.1.227.131:38665: connect: Connection refused (error 111)
I20260709 13:18:26.263500  3761 leader_election.cc:304] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9165fe61ab04bfb9a48889156d5c161; no voters: 501fdf2af2bc4b0c971ae880e98f466b, aaf88538197a49adb8bcf3790309a67e
I20260709 13:18:26.264496 11664 raft_consensus.cc:2749] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:18:26.265633  3761 consensus_peers.cc:597] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 -> Peer f20672b2852447a6bc1e137c4dd40904 (127.1.227.130:38619): Couldn't send request to peer f20672b2852447a6bc1e137c4dd40904. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:38619: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:26.275084  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:26.276176  1934 tablet_replica.cc:333] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.277381  1934 raft_consensus.cc:2243] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:26.278235  1934 raft_consensus.cc:2272] T 6e540d8ab4d64f8c8fd8c432fbc5ac3a P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.281836  1934 tablet_replica.cc:333] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.282874  1934 raft_consensus.cc:2243] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:18:26.284605  1934 raft_consensus.cc:2272] T 4b83202a913e45d5830d2ecdfb5354c2 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.293646  1934 tablet_replica.cc:333] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.294860  1934 raft_consensus.cc:2243] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:18:26.296614  1934 raft_consensus.cc:2272] T 1e1474206f8d49e58df15541f5a5725e P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.300285  1934 tablet_replica.cc:333] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.301563  1934 raft_consensus.cc:2243] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:26.302539  1934 raft_consensus.cc:2272] T a1ccbbf27f0b436d8c79dfb6db7fc703 P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.306257  1934 tablet_replica.cc:333] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.307240  1934 raft_consensus.cc:2243] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:18:26.311817  3762 consensus_peers.cc:597] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 -> Peer aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): Couldn't send request to peer aaf88538197a49adb8bcf3790309a67e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:26.318216  1934 raft_consensus.cc:2272] T fcf5db67d30f487d873766886c2ef408 P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.321669  1934 tablet_replica.cc:333] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.322985  1934 raft_consensus.cc:2243] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:18:26.324414  1934 raft_consensus.cc:2272] T a2dc1155b33b4fbc830d189f5e109f78 P e9165fe61ab04bfb9a48889156d5c161 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.327705  1934 tablet_replica.cc:333] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.328725  1934 raft_consensus.cc:2243] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:18:26.332739  1934 raft_consensus.cc:2272] T 85059665c6234a2a8380bebb4790b5cb P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.338661  1934 tablet_replica.cc:333] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.339632  1934 raft_consensus.cc:2243] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:26.340380  1934 raft_consensus.cc:2272] T a28cf255dda74b44acbfc2fff2f8f950 P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.343573  1934 tablet_replica.cc:333] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.344527  1934 raft_consensus.cc:2243] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:18:26.345908  1934 raft_consensus.cc:2272] T 0ee6c4dbcb7b45729d4e2bdcc3a09297 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.349027  1934 tablet_replica.cc:333] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.350050  1934 raft_consensus.cc:2243] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:18:26.351353  1934 raft_consensus.cc:2272] T 3fe8825ca0db45529c5a46ef6e9ba53d P e9165fe61ab04bfb9a48889156d5c161 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.357270  1934 tablet_replica.cc:333] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.360618  1934 raft_consensus.cc:2243] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:26.361985  1934 raft_consensus.cc:2272] T 96a33a25f4f3488ea9a2cec075aa10ce P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.365623  1934 tablet_replica.cc:333] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.366819  1934 raft_consensus.cc:2243] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:26.367578  1934 raft_consensus.cc:2272] T cf43b3ddced94b0395a3a79080ce0ed5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.370656  1934 tablet_replica.cc:333] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.371546  1934 raft_consensus.cc:2243] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:26.372283  1934 raft_consensus.cc:2272] T 348c9fe65bc24c3caf5c132e715a13ba P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.375375  1934 tablet_replica.cc:333] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.376300  1934 raft_consensus.cc:2243] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:26.377532  1934 raft_consensus.cc:2272] T 0d08acccfb704a2cbd3aa420321f06d0 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.380544  1934 tablet_replica.cc:333] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.381419  1934 raft_consensus.cc:2243] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:26.382146  1934 raft_consensus.cc:2272] T be0f43de06b240e69f5f94ca88c7b321 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.385535  1934 tablet_replica.cc:333] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.386449  1934 raft_consensus.cc:2243] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:18:26.387701  1934 raft_consensus.cc:2272] T 44281a32716140bc805b71db0e071122 P e9165fe61ab04bfb9a48889156d5c161 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.390882  1934 tablet_replica.cc:333] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.391741  1934 raft_consensus.cc:2243] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:18:26.392967  1934 raft_consensus.cc:2272] T 1a367b51f1ce4b0197b9dadabe52be32 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.396013  1934 tablet_replica.cc:333] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.396855  1934 raft_consensus.cc:2243] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:26.397529  1934 raft_consensus.cc:2272] T 5d96dfe3b4fa4acbb1aac261f7ebf5ea P e9165fe61ab04bfb9a48889156d5c161 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.405061  1934 tablet_replica.cc:333] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.406066  1934 raft_consensus.cc:2243] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:26.406863  1934 raft_consensus.cc:2272] T e234b352c9c44269b88598c9ae245ab5 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.409992  1934 tablet_replica.cc:333] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.410992  1934 raft_consensus.cc:2243] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:18:26.412333  1934 raft_consensus.cc:2272] T 1b0bf95c7c28416eb4a727eac91af0d0 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.415688  1934 tablet_replica.cc:333] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.416605  1934 raft_consensus.cc:2243] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:26.417279  1934 raft_consensus.cc:2272] T 038f072ecdcc4679a46740d78fb0dbd7 P e9165fe61ab04bfb9a48889156d5c161 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.420428  1934 tablet_replica.cc:333] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.421242  1934 raft_consensus.cc:2243] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:18:26.422577  1934 raft_consensus.cc:2272] T f2254b0c561f4240a9199d1c203568ac P e9165fe61ab04bfb9a48889156d5c161 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.425719  1934 tablet_replica.cc:333] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.426683  1934 raft_consensus.cc:2243] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:26.427466  1934 raft_consensus.cc:2272] T a641b8a516264234af4db10b1a0610f0 P e9165fe61ab04bfb9a48889156d5c161 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.430747  1934 tablet_replica.cc:333] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.431638  1934 raft_consensus.cc:2243] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:26.432323  1934 raft_consensus.cc:2272] T 9c2f28b50c354b648096e08cf4f5d54a P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.435269  1934 tablet_replica.cc:333] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.436087  1934 raft_consensus.cc:2243] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:26.439484  1934 raft_consensus.cc:2272] T dab74aefe0d74cf5b7b691b15690a40b P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.445273  1934 tablet_replica.cc:333] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.446231  1934 raft_consensus.cc:2243] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:26.447084  1934 raft_consensus.cc:2272] T e1d12e7c2ef94802ad2c1a3390fe2a8e P e9165fe61ab04bfb9a48889156d5c161 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.450068  1934 tablet_replica.cc:333] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.450896  1934 raft_consensus.cc:2243] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:26.451778  1934 raft_consensus.cc:2272] T 01dd1f72eb8249a6adadee5f3509bcc2 P e9165fe61ab04bfb9a48889156d5c161 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.454696  1934 tablet_replica.cc:333] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.455673  1934 raft_consensus.cc:2243] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:18:26.457165  1934 raft_consensus.cc:2272] T 006a17784d3e4b139686bca788cab915 P e9165fe61ab04bfb9a48889156d5c161 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.460608  1934 tablet_replica.cc:333] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.461439  1934 raft_consensus.cc:2243] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:18:26.462664  1934 raft_consensus.cc:2272] T 172fb190a0d74cd292c08c451255bae2 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.465368  1934 tablet_replica.cc:333] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.466187  1934 raft_consensus.cc:2243] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:26.467448  1934 raft_consensus.cc:2272] T 2fbe6f8795fb454182fceb2dad61e5c6 P e9165fe61ab04bfb9a48889156d5c161 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.470346  1934 tablet_replica.cc:333] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.471208  1934 raft_consensus.cc:2243] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:18:26.472447  1934 raft_consensus.cc:2272] T de94f7d51a554137acbf3110ce91f2fc P e9165fe61ab04bfb9a48889156d5c161 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.475427  1934 tablet_replica.cc:333] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161: stopping tablet replica
I20260709 13:18:26.476147  1934 raft_consensus.cc:2243] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:18:26.477427  1934 raft_consensus.cc:2272] T 12725e4e41614e1292b974e17635f758 P e9165fe61ab04bfb9a48889156d5c161 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:27.561702  1934 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 3820)
I20260709 13:18:28.146142  1934 tablet_server.cc:196] TabletServer@127.1.227.132:0 shutdown complete.
I20260709 13:18:28.206161  1934 master.cc:562] Master@127.1.227.190:44821 shutting down...
W20260709 13:18:28.241823  2997 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:18:28.242259  2997 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:18:28.242477  2997 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:18:28.812556  2980 debug-util.cc:398] Leaking SignalData structure 0x7b0800172340 after lost signal to thread 1937
W20260709 13:18:28.813797  2980 debug-util.cc:398] Leaking SignalData structure 0x7b0800065e60 after lost signal to thread 2983
W20260709 13:18:28.842608  2935 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111) [suppressed 238 similar messages]
W20260709 13:18:28.846828  2935 catalog_manager.cc:4755] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet a641b8a516264234af4db10b1a0610f0: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:30.030565  2935 catalog_manager.cc:4755] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1e1474206f8d49e58df15541f5a5725e: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
W20260709 13:18:31.618197  2935 catalog_manager.cc:4755] TS aaf88538197a49adb8bcf3790309a67e (127.1.227.129:44609): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4b83202a913e45d5830d2ecdfb5354c2: Network error: Client connection negotiation failed: client connection to 127.1.227.129:44609: connect: Connection refused (error 111)
I20260709 13:18:31.838517  1934 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:31.839803  1934 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:31.840277  1934 tablet_replica.cc:333] T 00000000000000000000000000000000 P fc4fb08aba024155968fdc88910f61d7: stopping tablet replica
I20260709 13:18:32.044451  1934 master.cc:584] Master@127.1.227.190:44821 shutdown complete.
I20260709 13:18:32.099725  1934 test_util.cc:182] -----------------------------------------------
I20260709 13:18:32.099977  1934 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602825662285-1934-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (262651 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:18:32.103963  1934 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.227.190:43207
I20260709 13:18:32.105155  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:32.112324 11674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:32.112324 11675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:32.113492 11677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:32.114001  1934 server_base.cc:1061] running on GCE node
I20260709 13:18:32.118062  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:32.118283  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:32.118505  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603112118465 us; error 0 us; skew 500 ppm
I20260709 13:18:32.119096  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:32.122233  1934 webserver.cc:533] Webserver started at http://127.1.227.190:45675/ using document root <none> and password file <none>
I20260709 13:18:32.122820  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:32.123026  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:32.123365  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:32.124768  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/master-0-root/instance:
uuid: "496d0644345c4a18bdbd5b9f5e543741"
format_stamp: "Formatted at 2026-07-09 13:18:32 on dist-test-slave-lfdf"
I20260709 13:18:32.129935  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:18:32.133689 11682 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:32.134665  1934 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:18:32.134984  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/master-0-root
uuid: "496d0644345c4a18bdbd5b9f5e543741"
format_stamp: "Formatted at 2026-07-09 13:18:32 on dist-test-slave-lfdf"
I20260709 13:18:32.135414  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:32.160382  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:32.161703  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:32.202746  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.190:43207
I20260709 13:18:32.202910 11733 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.190:43207 every 8 connection(s)
I20260709 13:18:32.207083 11734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:32.219650 11734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741: Bootstrap starting.
I20260709 13:18:32.224632 11734 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:32.229549 11734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741: No bootstrap required, opened a new log
I20260709 13:18:32.232123 11734 raft_consensus.cc:359] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "496d0644345c4a18bdbd5b9f5e543741" member_type: VOTER }
I20260709 13:18:32.232621 11734 raft_consensus.cc:385] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:32.232952 11734 raft_consensus.cc:740] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 496d0644345c4a18bdbd5b9f5e543741, State: Initialized, Role: FOLLOWER
I20260709 13:18:32.233683 11734 consensus_queue.cc:260] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "496d0644345c4a18bdbd5b9f5e543741" member_type: VOTER }
I20260709 13:18:32.234328 11734 raft_consensus.cc:399] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:18:32.234570 11734 raft_consensus.cc:493] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:18:32.234917 11734 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:32.240559 11734 raft_consensus.cc:515] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "496d0644345c4a18bdbd5b9f5e543741" member_type: VOTER }
I20260709 13:18:32.241209 11734 leader_election.cc:304] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 496d0644345c4a18bdbd5b9f5e543741; no voters: 
I20260709 13:18:32.242551 11734 leader_election.cc:290] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:18:32.242931 11737 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:32.244560 11737 raft_consensus.cc:697] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741 [term 1 LEADER]: Becoming Leader. State: Replica: 496d0644345c4a18bdbd5b9f5e543741, State: Running, Role: LEADER
I20260709 13:18:32.245411 11737 consensus_queue.cc:237] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "496d0644345c4a18bdbd5b9f5e543741" member_type: VOTER }
I20260709 13:18:32.245918 11734 sys_catalog.cc:565] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:18:32.254748 11739 sys_catalog.cc:455] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 496d0644345c4a18bdbd5b9f5e543741. Latest consensus state: current_term: 1 leader_uuid: "496d0644345c4a18bdbd5b9f5e543741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "496d0644345c4a18bdbd5b9f5e543741" member_type: VOTER } }
I20260709 13:18:32.255142 11738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "496d0644345c4a18bdbd5b9f5e543741" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "496d0644345c4a18bdbd5b9f5e543741" member_type: VOTER } }
I20260709 13:18:32.255700 11739 sys_catalog.cc:458] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741 [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:32.255874 11738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741 [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:32.257503 11747 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:18:32.262742 11747 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:18:32.263832  1934 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:18:32.272800 11747 catalog_manager.cc:1383] Generated new cluster ID: 94d4181477d54d0a8bb631d5c8030675
I20260709 13:18:32.273177 11747 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:18:32.300365 11747 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:18:32.301661 11747 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:18:32.317656 11747 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741: Generated new TSK 0
I20260709 13:18:32.318367 11747 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:18:32.331190  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:32.338254 11755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:32.339277 11756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:32.341612 11758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:32.342336  1934 server_base.cc:1061] running on GCE node
I20260709 13:18:32.344609  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:32.344810  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:32.345018  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603112345002 us; error 0 us; skew 500 ppm
I20260709 13:18:32.345660  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:32.348600  1934 webserver.cc:533] Webserver started at http://127.1.227.129:37251/ using document root <none> and password file <none>
I20260709 13:18:32.349126  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:32.349314  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:32.349598  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:32.350910  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-0-root/instance:
uuid: "bdbe2261c337471ea4d0c980ebb80c72"
format_stamp: "Formatted at 2026-07-09 13:18:32 on dist-test-slave-lfdf"
I20260709 13:18:32.355710  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:18:32.359721 11763 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:32.360760  1934 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:18:32.361164  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-0-root
uuid: "bdbe2261c337471ea4d0c980ebb80c72"
format_stamp: "Formatted at 2026-07-09 13:18:32 on dist-test-slave-lfdf"
I20260709 13:18:32.361527  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:32.373948  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:32.375327  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:32.377053  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:32.379772  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:32.380040  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:32.380311  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:32.380520  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:32.432044  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.129:37961
I20260709 13:18:32.432161 11825 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.129:37961 every 8 connection(s)
I20260709 13:18:32.437520  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:32.446170 11830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:32.448401 11831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:32.452913  1934 server_base.cc:1061] running on GCE node
W20260709 13:18:32.453235 11833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:32.455680  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:32.455940  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:32.456169  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603112456149 us; error 0 us; skew 500 ppm
I20260709 13:18:32.456787  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:32.459476 11826 heartbeater.cc:344] Connected to a master server at 127.1.227.190:43207
I20260709 13:18:32.459879 11826 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:32.460067  1934 webserver.cc:533] Webserver started at http://127.1.227.130:34061/ using document root <none> and password file <none>
I20260709 13:18:32.460719  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:32.460906  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:32.460813 11826 heartbeater.cc:507] Master 127.1.227.190:43207 requested a full tablet report, sending...
I20260709 13:18:32.461359  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:32.463030  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-1-root/instance:
uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
format_stamp: "Formatted at 2026-07-09 13:18:32 on dist-test-slave-lfdf"
I20260709 13:18:32.463882 11699 ts_manager.cc:194] Registered new tserver with Master: bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:32.465906 11699 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35088
I20260709 13:18:32.468499  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:18:32.472757 11838 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:32.474000  1934 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:18:32.474329  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-1-root
uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
format_stamp: "Formatted at 2026-07-09 13:18:32 on dist-test-slave-lfdf"
I20260709 13:18:32.474642  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:32.488554  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:32.489889  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:32.491484  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:32.493885  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:32.494117  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:32.494369  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:32.494545  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:32.543375  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.130:43333
I20260709 13:18:32.543509 11900 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.130:43333 every 8 connection(s)
I20260709 13:18:32.548730  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:32.558521 11904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:32.560545 11907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:32.560680 11905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:32.564380  1934 server_base.cc:1061] running on GCE node
I20260709 13:18:32.564759 11901 heartbeater.cc:344] Connected to a master server at 127.1.227.190:43207
I20260709 13:18:32.565285 11901 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:32.565475  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:32.565819  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:32.565982  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603112565969 us; error 0 us; skew 500 ppm
I20260709 13:18:32.566318 11901 heartbeater.cc:507] Master 127.1.227.190:43207 requested a full tablet report, sending...
I20260709 13:18:32.566596  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:32.569121 11699 ts_manager.cc:194] Registered new tserver with Master: 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:32.570293  1934 webserver.cc:533] Webserver started at http://127.1.227.131:34897/ using document root <none> and password file <none>
I20260709 13:18:32.571116  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:32.571377  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:32.571416 11699 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35104
I20260709 13:18:32.571827  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:32.573663  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-2-root/instance:
uuid: "04f862d1b8824d7a81daa0cad52c5843"
format_stamp: "Formatted at 2026-07-09 13:18:32 on dist-test-slave-lfdf"
I20260709 13:18:32.578750  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:18:32.582587 11912 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:32.583438  1934 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:18:32.583783  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-2-root
uuid: "04f862d1b8824d7a81daa0cad52c5843"
format_stamp: "Formatted at 2026-07-09 13:18:32 on dist-test-slave-lfdf"
I20260709 13:18:32.584038  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:32.601634  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:32.603026  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:32.604764  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:32.607349  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:32.607558  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:32.607853  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:32.608026  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:32.654664  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.131:35995
I20260709 13:18:32.654778 11974 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.131:35995 every 8 connection(s)
I20260709 13:18:32.660591  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:32.670133 11978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:32.670220 11979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:32.673946 11981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:32.674731 11975 heartbeater.cc:344] Connected to a master server at 127.1.227.190:43207
I20260709 13:18:32.674952  1934 server_base.cc:1061] running on GCE node
I20260709 13:18:32.675179 11975 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:32.676155 11975 heartbeater.cc:507] Master 127.1.227.190:43207 requested a full tablet report, sending...
I20260709 13:18:32.676287  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:32.676700  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:32.676960  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603112676943 us; error 0 us; skew 500 ppm
I20260709 13:18:32.677667  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:32.678447 11699 ts_manager.cc:194] Registered new tserver with Master: 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:32.680033 11699 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35108
I20260709 13:18:32.680787  1934 webserver.cc:533] Webserver started at http://127.1.227.132:41039/ using document root <none> and password file <none>
I20260709 13:18:32.681500  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:32.681682  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:32.681994  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:32.683118  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-3-root/instance:
uuid: "1f7178f720eb4090a3593087331b82e9"
format_stamp: "Formatted at 2026-07-09 13:18:32 on dist-test-slave-lfdf"
I20260709 13:18:32.688383  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:18:32.692210 11986 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:32.693168  1934 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:18:32.693559  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-3-root
uuid: "1f7178f720eb4090a3593087331b82e9"
format_stamp: "Formatted at 2026-07-09 13:18:32 on dist-test-slave-lfdf"
I20260709 13:18:32.693957  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:32.709231  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:32.710732  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:32.712442  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:32.715080  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:32.715342  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:32.715621  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:32.715829  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:32.763942  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.132:38909
I20260709 13:18:32.764019 12048 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.132:38909 every 8 connection(s)
I20260709 13:18:32.780256 12049 heartbeater.cc:344] Connected to a master server at 127.1.227.190:43207
I20260709 13:18:32.780685 12049 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:32.781494 12049 heartbeater.cc:507] Master 127.1.227.190:43207 requested a full tablet report, sending...
I20260709 13:18:32.783599 11699 ts_manager.cc:194] Registered new tserver with Master: 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:32.784382  1934 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016703304s
I20260709 13:18:32.785081 11699 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35110
I20260709 13:18:32.815991 11699 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35126:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:18:33.068610 11791 tablet_service.cc:1511] Processing CreateTablet for tablet 43a598cfbb3c457eb5a8c9801d421a01 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:18:33.070348 11791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a598cfbb3c457eb5a8c9801d421a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.070794 11789 tablet_service.cc:1511] Processing CreateTablet for tablet 72e185eb05f14f19978919c9f8e5906e (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:18:33.072361 11789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72e185eb05f14f19978919c9f8e5906e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.072667 11790 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4646ce4a654acda4a5971dbefc623f (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:18:33.073247 11788 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd960dbe5b2404bbec84f15a3cc69f1 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:18:33.074275 11790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4646ce4a654acda4a5971dbefc623f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.074936 11788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd960dbe5b2404bbec84f15a3cc69f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.080935 11787 tablet_service.cc:1511] Processing CreateTablet for tablet ecf7f7f507dd4bd797a1b9a3a85b82fe (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:18:33.083058 11787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf7f7f507dd4bd797a1b9a3a85b82fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.084340 11786 tablet_service.cc:1511] Processing CreateTablet for tablet e3fc72a3f0044004b68c29cd9bdbf7d2 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:18:33.086052 11786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3fc72a3f0044004b68c29cd9bdbf7d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.098167 11785 tablet_service.cc:1511] Processing CreateTablet for tablet 47f5c73ecd474b45ae6c27ca1f1046a1 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:18:33.100673 11784 tablet_service.cc:1511] Processing CreateTablet for tablet cdcb9800b8894d978568cd9ad81bdd31 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:18:33.102345 11785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47f5c73ecd474b45ae6c27ca1f1046a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.106061 12014 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4646ce4a654acda4a5971dbefc623f (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:18:33.109889 11939 tablet_service.cc:1511] Processing CreateTablet for tablet 72e185eb05f14f19978919c9f8e5906e (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:18:33.110739 12014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4646ce4a654acda4a5971dbefc623f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.111663 11939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72e185eb05f14f19978919c9f8e5906e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.111450 11935 tablet_service.cc:1511] Processing CreateTablet for tablet 8d51c27f1d494f64980afcf1b0f89fff (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:18:33.112195 11938 tablet_service.cc:1511] Processing CreateTablet for tablet 1b38c8234f5f433bb73bb44a0950731d (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:18:33.113104 11935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d51c27f1d494f64980afcf1b0f89fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.114198 11784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdcb9800b8894d978568cd9ad81bdd31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.114871 11940 tablet_service.cc:1511] Processing CreateTablet for tablet 43a598cfbb3c457eb5a8c9801d421a01 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:18:33.115188 11937 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd960dbe5b2404bbec84f15a3cc69f1 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:18:33.116308 11940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a598cfbb3c457eb5a8c9801d421a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.116585 11933 tablet_service.cc:1511] Processing CreateTablet for tablet e4fab9357d5e4c8093e8d5482cb5ed2b (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:18:33.115170 11934 tablet_service.cc:1511] Processing CreateTablet for tablet 47f5c73ecd474b45ae6c27ca1f1046a1 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:18:33.117974 11936 tablet_service.cc:1511] Processing CreateTablet for tablet e3fc72a3f0044004b68c29cd9bdbf7d2 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:18:33.119047 11937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd960dbe5b2404bbec84f15a3cc69f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.120105 11936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3fc72a3f0044004b68c29cd9bdbf7d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.122126 11938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b38c8234f5f433bb73bb44a0950731d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.123888 12013 tablet_service.cc:1511] Processing CreateTablet for tablet 72e185eb05f14f19978919c9f8e5906e (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:18:33.125507 12013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72e185eb05f14f19978919c9f8e5906e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.133183 12008 tablet_service.cc:1511] Processing CreateTablet for tablet cdcb9800b8894d978568cd9ad81bdd31 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:18:33.136210 11783 tablet_service.cc:1511] Processing CreateTablet for tablet e4fab9357d5e4c8093e8d5482cb5ed2b (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:18:33.139220 11782 tablet_service.cc:1511] Processing CreateTablet for tablet f59c45da3f3f43a5b793c3305865da17 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:18:33.127446 12011 tablet_service.cc:1511] Processing CreateTablet for tablet ecf7f7f507dd4bd797a1b9a3a85b82fe (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:18:33.125362 12012 tablet_service.cc:1511] Processing CreateTablet for tablet 1b38c8234f5f433bb73bb44a0950731d (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:18:33.127400 12007 tablet_service.cc:1511] Processing CreateTablet for tablet e4fab9357d5e4c8093e8d5482cb5ed2b (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:18:33.128893 12010 tablet_service.cc:1511] Processing CreateTablet for tablet e3fc72a3f0044004b68c29cd9bdbf7d2 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:18:33.129586 12006 tablet_service.cc:1511] Processing CreateTablet for tablet bce4185998b54aa3900c8c3e9a09d72c (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:18:33.131076 12009 tablet_service.cc:1511] Processing CreateTablet for tablet 8d51c27f1d494f64980afcf1b0f89fff (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:18:33.143887 11783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4fab9357d5e4c8093e8d5482cb5ed2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.131716 11932 tablet_service.cc:1511] Processing CreateTablet for tablet bce4185998b54aa3900c8c3e9a09d72c (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:18:33.145536 11932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce4185998b54aa3900c8c3e9a09d72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.153301 11933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4fab9357d5e4c8093e8d5482cb5ed2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.154255 11934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47f5c73ecd474b45ae6c27ca1f1046a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.154960 12008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdcb9800b8894d978568cd9ad81bdd31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.155737 12012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b38c8234f5f433bb73bb44a0950731d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.156410 12006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce4185998b54aa3900c8c3e9a09d72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.157255 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf7f7f507dd4bd797a1b9a3a85b82fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.153357 11782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f59c45da3f3f43a5b793c3305865da17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.158156 12010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3fc72a3f0044004b68c29cd9bdbf7d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.158905 12007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4fab9357d5e4c8093e8d5482cb5ed2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.160223 12009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d51c27f1d494f64980afcf1b0f89fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.237602 12005 tablet_service.cc:1511] Processing CreateTablet for tablet b8f1d538ab1446f182128209d64b34be (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:18:33.240777 12068 tablet_bootstrap.cc:492] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:33.241183 12005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f1d538ab1446f182128209d64b34be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.252213 11940 tablet_service.cc:1511] Processing CreateTablet for tablet 095174060bff4a6b8f891f171bb9cd10 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:18:33.253688 11940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 095174060bff4a6b8f891f171bb9cd10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.254972 11865 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4646ce4a654acda4a5971dbefc623f (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:18:33.256493 11865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4646ce4a654acda4a5971dbefc623f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.259043 11864 tablet_service.cc:1511] Processing CreateTablet for tablet 1b38c8234f5f433bb73bb44a0950731d (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:18:33.263006 11862 tablet_service.cc:1511] Processing CreateTablet for tablet ecf7f7f507dd4bd797a1b9a3a85b82fe (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:18:33.267027 11860 tablet_service.cc:1511] Processing CreateTablet for tablet 47f5c73ecd474b45ae6c27ca1f1046a1 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
W20260709 13:18:33.271018 11746 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:33.272951 11859 tablet_service.cc:1511] Processing CreateTablet for tablet cdcb9800b8894d978568cd9ad81bdd31 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:18:33.237848 11938 tablet_service.cc:1511] Processing CreateTablet for tablet f59c45da3f3f43a5b793c3305865da17 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:18:33.275624 11858 tablet_service.cc:1511] Processing CreateTablet for tablet bce4185998b54aa3900c8c3e9a09d72c (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:18:33.278066 11857 tablet_service.cc:1511] Processing CreateTablet for tablet f59c45da3f3f43a5b793c3305865da17 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:18:33.265434 11861 tablet_service.cc:1511] Processing CreateTablet for tablet 8d51c27f1d494f64980afcf1b0f89fff (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:18:33.261548 11863 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd960dbe5b2404bbec84f15a3cc69f1 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:18:33.281054 11866 tablet_service.cc:1511] Processing CreateTablet for tablet 43a598cfbb3c457eb5a8c9801d421a01 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:18:33.315253 11938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f59c45da3f3f43a5b793c3305865da17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.314905 12007 tablet_service.cc:1511] Processing CreateTablet for tablet 095174060bff4a6b8f891f171bb9cd10 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:18:33.316244 12007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 095174060bff4a6b8f891f171bb9cd10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.294646 11864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b38c8234f5f433bb73bb44a0950731d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.311321 12068 tablet_bootstrap.cc:654] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:33.332213 11858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce4185998b54aa3900c8c3e9a09d72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.334112 11860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47f5c73ecd474b45ae6c27ca1f1046a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.337888 11861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d51c27f1d494f64980afcf1b0f89fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.338577 11862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf7f7f507dd4bd797a1b9a3a85b82fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.339452 11866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a598cfbb3c457eb5a8c9801d421a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.347345 11933 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab10d5ae5884d03b62499dd736e479e (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:18:33.347817 11935 tablet_service.cc:1511] Processing CreateTablet for tablet e6bd1a63e0aa46edbdec80ed32e8b876 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:18:33.347996 12011 tablet_service.cc:1511] Processing CreateTablet for tablet edba2429705947968300245b7a6049e1 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:18:33.349093 11933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab10d5ae5884d03b62499dd736e479e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.349323 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edba2429705947968300245b7a6049e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.311256 11783 tablet_service.cc:1511] Processing CreateTablet for tablet 095174060bff4a6b8f891f171bb9cd10 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:18:33.349601 11787 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab10d5ae5884d03b62499dd736e479e (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:18:33.350349 11783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 095174060bff4a6b8f891f171bb9cd10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.323041 11786 tablet_service.cc:1511] Processing CreateTablet for tablet b8f1d538ab1446f182128209d64b34be (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:18:33.351780 11786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f1d538ab1446f182128209d64b34be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.354300 11857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f59c45da3f3f43a5b793c3305865da17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.354868 12005 tablet_service.cc:1511] Processing CreateTablet for tablet e6bd1a63e0aa46edbdec80ed32e8b876 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:18:33.355695 11863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd960dbe5b2404bbec84f15a3cc69f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.356237 12005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6bd1a63e0aa46edbdec80ed32e8b876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.361949 11935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6bd1a63e0aa46edbdec80ed32e8b876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.366019 11859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdcb9800b8894d978568cd9ad81bdd31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.374467 11787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab10d5ae5884d03b62499dd736e479e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.388765 12069 tablet_bootstrap.cc:492] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:33.378720 12070 tablet_bootstrap.cc:492] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:33.403153 11790 tablet_service.cc:1511] Processing CreateTablet for tablet edba2429705947968300245b7a6049e1 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:18:33.405067 11790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edba2429705947968300245b7a6049e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.435166 12070 tablet_bootstrap.cc:654] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:33.439985 11936 tablet_service.cc:1511] Processing CreateTablet for tablet 5dd6d52d3b2649de89e331bbb75335a0 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:18:33.452610 11936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dd6d52d3b2649de89e331bbb75335a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.456306 11935 tablet_service.cc:1511] Processing CreateTablet for tablet be30dd74fd8242ba879069e4eec26f16 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:18:33.458037 11935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be30dd74fd8242ba879069e4eec26f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.463025 11791 tablet_service.cc:1511] Processing CreateTablet for tablet 5f3910c15d144fd09ea36bd9f5344eef (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:18:33.461141 12008 tablet_service.cc:1511] Processing CreateTablet for tablet be30dd74fd8242ba879069e4eec26f16 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:18:33.469007 11826 heartbeater.cc:499] Master 127.1.227.190:43207 was elected leader, sending a full tablet report...
I20260709 13:18:33.469859 12008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be30dd74fd8242ba879069e4eec26f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.443315 11789 tablet_service.cc:1511] Processing CreateTablet for tablet 5dd6d52d3b2649de89e331bbb75335a0 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:18:33.451403 12069 tablet_bootstrap.cc:654] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:33.442762 12012 tablet_service.cc:1511] Processing CreateTablet for tablet 5dd6d52d3b2649de89e331bbb75335a0 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:18:33.485191 12072 tablet_bootstrap.cc:492] T 8d4646ce4a654acda4a5971dbefc623f P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:33.487737 11860 tablet_service.cc:1511] Processing CreateTablet for tablet b8f1d538ab1446f182128209d64b34be (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:18:33.489238 11860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f1d538ab1446f182128209d64b34be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.498214 11791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f3910c15d144fd09ea36bd9f5344eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.504390 11937 tablet_service.cc:1511] Processing CreateTablet for tablet 5f3910c15d144fd09ea36bd9f5344eef (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:18:33.505977 11937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f3910c15d144fd09ea36bd9f5344eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.506464 11789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dd6d52d3b2649de89e331bbb75335a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.515568 12072 tablet_bootstrap.cc:654] T 8d4646ce4a654acda4a5971dbefc623f P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:33.535081 12012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dd6d52d3b2649de89e331bbb75335a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.535524 12011 tablet_service.cc:1511] Processing CreateTablet for tablet 58f5eb834fe84f7cadb173cc0fc58b2f (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:18:33.540302 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f5eb834fe84f7cadb173cc0fc58b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.541687 11865 tablet_service.cc:1511] Processing CreateTablet for tablet e6bd1a63e0aa46edbdec80ed32e8b876 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:18:33.543347 11865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6bd1a63e0aa46edbdec80ed32e8b876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.543632 11864 tablet_service.cc:1511] Processing CreateTablet for tablet be30dd74fd8242ba879069e4eec26f16 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:18:33.545128 11864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be30dd74fd8242ba879069e4eec26f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.543370 11857 tablet_service.cc:1511] Processing CreateTablet for tablet edba2429705947968300245b7a6049e1 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:18:33.547451 11857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edba2429705947968300245b7a6049e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.547574 11862 tablet_service.cc:1511] Processing CreateTablet for tablet 5f3910c15d144fd09ea36bd9f5344eef (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:18:33.560384 11862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f3910c15d144fd09ea36bd9f5344eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.564788 11783 tablet_service.cc:1511] Processing CreateTablet for tablet 58f5eb834fe84f7cadb173cc0fc58b2f (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:18:33.565678 11935 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9288763b344f2fb95940d6a0ce7bcd (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:18:33.566578 11783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f5eb834fe84f7cadb173cc0fc58b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.567063 11935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9288763b344f2fb95940d6a0ce7bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.570823 11863 tablet_service.cc:1511] Processing CreateTablet for tablet 58f5eb834fe84f7cadb173cc0fc58b2f (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:18:33.572428 11863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f5eb834fe84f7cadb173cc0fc58b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.575477 11901 heartbeater.cc:499] Master 127.1.227.190:43207 was elected leader, sending a full tablet report...
I20260709 13:18:33.577418 12068 tablet_bootstrap.cc:492] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:33.577975 12068 ts_tablet_manager.cc:1403] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.338s	user 0.006s	sys 0.026s
I20260709 13:18:33.580994 12068 raft_consensus.cc:359] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:33.541640 11858 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab10d5ae5884d03b62499dd736e479e (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:18:33.597461 11858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab10d5ae5884d03b62499dd736e479e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.594926 12068 raft_consensus.cc:385] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:33.613724 11859 tablet_service.cc:1511] Processing CreateTablet for tablet 653023e6fbaf4ab0869ab68cd9436f6d (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:18:33.616240 11859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 653023e6fbaf4ab0869ab68cd9436f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.610215 11789 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9288763b344f2fb95940d6a0ce7bcd (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:18:33.617234 11789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9288763b344f2fb95940d6a0ce7bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.618757 11933 tablet_service.cc:1511] Processing CreateTablet for tablet 653023e6fbaf4ab0869ab68cd9436f6d (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:18:33.620090 11933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 653023e6fbaf4ab0869ab68cd9436f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.620814 12008 tablet_service.cc:1511] Processing CreateTablet for tablet 653023e6fbaf4ab0869ab68cd9436f6d (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:18:33.622160 12008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 653023e6fbaf4ab0869ab68cd9436f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.631008 11866 tablet_service.cc:1511] Processing CreateTablet for tablet 78f88cc1e70b4b88986a3ff6b79770f7 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:18:33.632632 11866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78f88cc1e70b4b88986a3ff6b79770f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.628520 11791 tablet_service.cc:1511] Processing CreateTablet for tablet 78f88cc1e70b4b88986a3ff6b79770f7 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:18:33.634747 11791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78f88cc1e70b4b88986a3ff6b79770f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.601481 12068 raft_consensus.cc:740] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:33.642448 12068 consensus_queue.cc:260] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:33.649664 12072 tablet_bootstrap.cc:492] T 8d4646ce4a654acda4a5971dbefc623f P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:33.650362 12072 ts_tablet_manager.cc:1403] T 8d4646ce4a654acda4a5971dbefc623f P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.166s	user 0.015s	sys 0.002s
I20260709 13:18:33.650118 11937 tablet_service.cc:1511] Processing CreateTablet for tablet 78f88cc1e70b4b88986a3ff6b79770f7 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:18:33.651515 11937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78f88cc1e70b4b88986a3ff6b79770f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.651317 12012 tablet_service.cc:1511] Processing CreateTablet for tablet 7991b50605d0412aa1b3b5e79de17e01 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:18:33.653432 12012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7991b50605d0412aa1b3b5e79de17e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.661978 12072 raft_consensus.cc:359] T 8d4646ce4a654acda4a5971dbefc623f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:33.662894 12072 raft_consensus.cc:385] T 8d4646ce4a654acda4a5971dbefc623f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:33.663275 12072 raft_consensus.cc:740] T 8d4646ce4a654acda4a5971dbefc623f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:33.664311 12072 consensus_queue.cc:260] T 8d4646ce4a654acda4a5971dbefc623f P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:33.665144 11783 tablet_service.cc:1511] Processing CreateTablet for tablet 7991b50605d0412aa1b3b5e79de17e01 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:18:33.667253 11783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7991b50605d0412aa1b3b5e79de17e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.672470 12069 tablet_bootstrap.cc:492] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:33.673187 12069 ts_tablet_manager.cc:1403] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.285s	user 0.023s	sys 0.010s
I20260709 13:18:33.665972 12007 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9288763b344f2fb95940d6a0ce7bcd (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:18:33.676400 12007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9288763b344f2fb95940d6a0ce7bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.682875 11975 heartbeater.cc:499] Master 127.1.227.190:43207 was elected leader, sending a full tablet report...
I20260709 13:18:33.695829 11857 tablet_service.cc:1511] Processing CreateTablet for tablet 7991b50605d0412aa1b3b5e79de17e01 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:18:33.697510 11857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7991b50605d0412aa1b3b5e79de17e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.714731 11935 tablet_service.cc:1511] Processing CreateTablet for tablet df332d97fcd742e3b0f2024da1850b81 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:18:33.716194 11935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df332d97fcd742e3b0f2024da1850b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.718418 12072 ts_tablet_manager.cc:1434] T 8d4646ce4a654acda4a5971dbefc623f P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.003s
I20260709 13:18:33.720489 12068 ts_tablet_manager.cc:1434] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.142s	user 0.034s	sys 0.005s
I20260709 13:18:33.734609 12068 tablet_bootstrap.cc:492] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:33.727942 12070 tablet_bootstrap.cc:492] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:33.734725 12008 tablet_service.cc:1511] Processing CreateTablet for tablet df332d97fcd742e3b0f2024da1850b81 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:18:33.735267 12070 ts_tablet_manager.cc:1403] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.357s	user 0.014s	sys 0.005s
I20260709 13:18:33.736074 12008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df332d97fcd742e3b0f2024da1850b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.731729 11791 tablet_service.cc:1511] Processing CreateTablet for tablet df332d97fcd742e3b0f2024da1850b81 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:18:33.737686 11791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df332d97fcd742e3b0f2024da1850b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.738534 12070 raft_consensus.cc:359] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:33.739389 12070 raft_consensus.cc:385] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:33.739751 12070 raft_consensus.cc:740] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:33.740543 12070 consensus_queue.cc:260] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:33.725831 12072 tablet_bootstrap.cc:492] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:33.742906 12069 raft_consensus.cc:359] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:33.749919 12069 raft_consensus.cc:385] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:33.756291 12049 heartbeater.cc:499] Master 127.1.227.190:43207 was elected leader, sending a full tablet report...
I20260709 13:18:33.756640 12069 raft_consensus.cc:740] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:33.754640 11933 tablet_service.cc:1511] Processing CreateTablet for tablet d53b944cce3847bb8f603d0c64c6ae28 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:18:33.757395 12069 consensus_queue.cc:260] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:33.752452 11864 tablet_service.cc:1511] Processing CreateTablet for tablet d53b944cce3847bb8f603d0c64c6ae28 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:18:33.758685 11933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53b944cce3847bb8f603d0c64c6ae28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.755756 12070 ts_tablet_manager.cc:1434] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:18:33.763319 12070 tablet_bootstrap.cc:492] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:33.763942 12011 tablet_service.cc:1511] Processing CreateTablet for tablet d53b944cce3847bb8f603d0c64c6ae28 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:18:33.765358 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53b944cce3847bb8f603d0c64c6ae28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.770361 12072 tablet_bootstrap.cc:654] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:33.772161 12050 tablet.cc:2406] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:18:33.776028 12068 tablet_bootstrap.cc:654] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:33.782081 12070 tablet_bootstrap.cc:654] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:33.786494 12078 raft_consensus.cc:493] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.787267 12078 raft_consensus.cc:515] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:33.792393 12068 tablet_bootstrap.cc:492] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:33.797341 12068 ts_tablet_manager.cc:1403] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.008s
I20260709 13:18:33.803156 12068 raft_consensus.cc:359] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:33.799865 12070 tablet_bootstrap.cc:492] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:33.799172 12069 ts_tablet_manager.cc:1434] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.126s	user 0.009s	sys 0.000s
I20260709 13:18:33.807302 12070 ts_tablet_manager.cc:1403] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.001s
I20260709 13:18:33.808039 12069 tablet_bootstrap.cc:492] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:33.810719 12070 raft_consensus.cc:359] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:33.811602 12070 raft_consensus.cc:385] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:33.811604 12068 raft_consensus.cc:385] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:33.812165 12070 raft_consensus.cc:740] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:33.813781 12078 leader_election.cc:290] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:33.816763 12070 consensus_queue.cc:260] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:33.815758 12069 tablet_bootstrap.cc:654] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:33.816202 12068 raft_consensus.cc:740] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:33.820019 12070 ts_tablet_manager.cc:1434] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:18:33.821127 12070 tablet_bootstrap.cc:492] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:33.820758 12068 consensus_queue.cc:260] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:33.823314 12068 ts_tablet_manager.cc:1434] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:18:33.827402 11864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53b944cce3847bb8f603d0c64c6ae28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.827565 12068 tablet_bootstrap.cc:492] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:33.828517 12070 tablet_bootstrap.cc:654] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:33.832168 12072 tablet_bootstrap.cc:492] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:33.832854 12072 ts_tablet_manager.cc:1403] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.107s	user 0.007s	sys 0.014s
I20260709 13:18:33.838601 12072 raft_consensus.cc:359] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:33.847983 12072 raft_consensus.cc:385] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:33.848630 12072 raft_consensus.cc:740] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:33.849885 12072 consensus_queue.cc:260] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:33.850418 11791 tablet_service.cc:1511] Processing CreateTablet for tablet 5595bb972e3e4574a1df19295132c9ae (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:18:33.853153 11933 tablet_service.cc:1511] Processing CreateTablet for tablet 5595bb972e3e4574a1df19295132c9ae (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:18:33.859124 11933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5595bb972e3e4574a1df19295132c9ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.859270 11791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5595bb972e3e4574a1df19295132c9ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.855315 11863 tablet_service.cc:1511] Processing CreateTablet for tablet 5595bb972e3e4574a1df19295132c9ae (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:18:33.857357 12076 raft_consensus.cc:493] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.871620 12076 raft_consensus.cc:515] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:33.873808 11783 tablet_service.cc:1511] Processing CreateTablet for tablet 25353af0207b4ec1959e0795ded4946c (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:18:33.875267 11783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25353af0207b4ec1959e0795ded4946c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.881595 11863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5595bb972e3e4574a1df19295132c9ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.895417 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4646ce4a654acda4a5971dbefc623f" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:33.895607 12008 tablet_service.cc:1511] Processing CreateTablet for tablet 25353af0207b4ec1959e0795ded4946c (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:18:33.897001 12008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25353af0207b4ec1959e0795ded4946c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.877918 12076 leader_election.cc:290] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
W20260709 13:18:33.904728 11989 leader_election.cc:343] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:33.911158 11937 tablet_service.cc:1511] Processing CreateTablet for tablet ea431ab44bd54c398da2f3469ac6685a (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:18:33.920455 11789 tablet_service.cc:1511] Processing CreateTablet for tablet ea431ab44bd54c398da2f3469ac6685a (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:18:33.921397 11858 tablet_service.cc:1511] Processing CreateTablet for tablet 55421cf4fed64db6bb366de566968fd9 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:18:33.945407 11858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55421cf4fed64db6bb366de566968fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.922250 12068 tablet_bootstrap.cc:654] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:33.922477 12011 tablet_service.cc:1511] Processing CreateTablet for tablet ea431ab44bd54c398da2f3469ac6685a (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:18:33.926492 11935 tablet_service.cc:1511] Processing CreateTablet for tablet 55421cf4fed64db6bb366de566968fd9 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:18:33.950563 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea431ab44bd54c398da2f3469ac6685a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.932111 12007 tablet_service.cc:1511] Processing CreateTablet for tablet 55421cf4fed64db6bb366de566968fd9 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:18:33.951913 12007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55421cf4fed64db6bb366de566968fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.951711 11864 tablet_service.cc:1511] Processing CreateTablet for tablet 52b7a6ebef9c43598294f430c70b2fb5 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:18:33.953025 11864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b7a6ebef9c43598294f430c70b2fb5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:33.953830 11989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:37961, user_credentials={real_user=slave}} blocked reactor thread for 49350us
I20260709 13:18:33.954802 11790 tablet_service.cc:1511] Processing CreateTablet for tablet 52b7a6ebef9c43598294f430c70b2fb5 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:18:33.943809 11937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea431ab44bd54c398da2f3469ac6685a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.944005 11789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea431ab44bd54c398da2f3469ac6685a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.957257 11936 tablet_service.cc:1511] Processing CreateTablet for tablet 52b7a6ebef9c43598294f430c70b2fb5 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:18:33.960089 11866 tablet_service.cc:1511] Processing CreateTablet for tablet 25353af0207b4ec1959e0795ded4946c (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:18:33.960686 12012 tablet_service.cc:1511] Processing CreateTablet for tablet 9cc9444f841f4d768a714f7462f1cf6e (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:18:33.961558 11866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25353af0207b4ec1959e0795ded4946c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.962015 12012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cc9444f841f4d768a714f7462f1cf6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.962471 12072 ts_tablet_manager.cc:1434] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.129s	user 0.009s	sys 0.000s
I20260709 13:18:33.968820 11935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55421cf4fed64db6bb366de566968fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.972416 12070 tablet_bootstrap.cc:492] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:33.973066 12070 ts_tablet_manager.cc:1403] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.152s	user 0.034s	sys 0.030s
I20260709 13:18:33.976794 12070 raft_consensus.cc:359] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:33.977537 12070 raft_consensus.cc:385] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:33.977881 12070 raft_consensus.cc:740] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:33.978206 11936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b7a6ebef9c43598294f430c70b2fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.978840 12070 consensus_queue.cc:260] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:33.981281 12070 ts_tablet_manager.cc:1434] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:18:33.968760 11790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b7a6ebef9c43598294f430c70b2fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.982314 12070 tablet_bootstrap.cc:492] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:33.992874 11786 tablet_service.cc:1511] Processing CreateTablet for tablet 9cc9444f841f4d768a714f7462f1cf6e (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:18:33.994182 12076 raft_consensus.cc:493] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.994554 11786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cc9444f841f4d768a714f7462f1cf6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.994992 12076 raft_consensus.cc:515] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:33.998636 12076 leader_election.cc:290] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:34.022109 11938 tablet_service.cc:1511] Processing CreateTablet for tablet f4758afc104744a481a25b59661b80fe (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:18:34.031898 11938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4758afc104744a481a25b59661b80fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.033979 12072 tablet_bootstrap.cc:492] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:34.035584 12069 tablet_bootstrap.cc:492] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:34.036158 12069 ts_tablet_manager.cc:1403] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.228s	user 0.026s	sys 0.047s
I20260709 13:18:34.052249 12078 raft_consensus.cc:493] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.052963 12078 raft_consensus.cc:515] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:34.052373 12069 raft_consensus.cc:359] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:34.054018 12069 raft_consensus.cc:385] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:34.054387 12069 raft_consensus.cc:740] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:34.055243 12069 consensus_queue.cc:260] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:34.059226 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b38c8234f5f433bb73bb44a0950731d" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:34.059942 12069 ts_tablet_manager.cc:1434] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.002s
I20260709 13:18:34.061077 12069 tablet_bootstrap.cc:492] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:34.064190 12082 raft_consensus.cc:493] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.064715 12078 leader_election.cc:290] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:34.064795 12082 raft_consensus.cc:515] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:34.066597 12070 tablet_bootstrap.cc:654] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:34.066730 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fab9357d5e4c8093e8d5482cb5ed2b" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
W20260709 13:18:34.069123 11989 leader_election.cc:343] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.070055 12082 leader_election.cc:290] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:34.088083 11791 tablet_service.cc:1511] Processing CreateTablet for tablet f4758afc104744a481a25b59661b80fe (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:18:34.094660 12077 raft_consensus.cc:493] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.095405 12077 raft_consensus.cc:515] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:34.098062 11857 tablet_service.cc:1511] Processing CreateTablet for tablet ab5a46f525fd42468f042b3d38985f42 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:18:34.099030 12005 tablet_service.cc:1511] Processing CreateTablet for tablet f4758afc104744a481a25b59661b80fe (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:18:34.099606 11857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab5a46f525fd42468f042b3d38985f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.100638 12005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4758afc104744a481a25b59661b80fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.102597 12077 leader_election.cc:290] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:34.103988 11863 tablet_service.cc:1511] Processing CreateTablet for tablet 9cc9444f841f4d768a714f7462f1cf6e (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:18:34.105363 11863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cc9444f841f4d768a714f7462f1cf6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.102675 11791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4758afc104744a481a25b59661b80fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.103531 11933 tablet_service.cc:1511] Processing CreateTablet for tablet ab5a46f525fd42468f042b3d38985f42 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:18:34.115209 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4646ce4a654acda4a5971dbefc623f" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:34.116122 11876 raft_consensus.cc:2468] T 8d4646ce4a654acda4a5971dbefc623f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 0.
I20260709 13:18:34.129005 11933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab5a46f525fd42468f042b3d38985f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.130864 12011 tablet_service.cc:1511] Processing CreateTablet for tablet ab5a46f525fd42468f042b3d38985f42 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:18:34.132977 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab5a46f525fd42468f042b3d38985f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.147856 12070 tablet_bootstrap.cc:492] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:34.148475 12070 ts_tablet_manager.cc:1403] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.166s	user 0.012s	sys 0.010s
I20260709 13:18:34.149277 12069 tablet_bootstrap.cc:654] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:34.151947 12070 raft_consensus.cc:359] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:34.152762 12070 raft_consensus.cc:385] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:34.153065 12070 raft_consensus.cc:740] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:34.154037 12070 consensus_queue.cc:260] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:34.154258 11790 tablet_service.cc:1511] Processing CreateTablet for tablet bb8e389bf22e48259f4d63c2c12f4713 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:18:34.155630 11790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb8e389bf22e48259f4d63c2c12f4713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.166365 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a598cfbb3c457eb5a8c9801d421a01" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
W20260709 13:18:34.168215 11915 leader_election.cc:343] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.159709 12070 ts_tablet_manager.cc:1434] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
W20260709 13:18:34.175539 11916 leader_election.cc:343] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.180056 12072 tablet_bootstrap.cc:654] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:34.182552 11858 tablet_service.cc:1511] Processing CreateTablet for tablet bb8e389bf22e48259f4d63c2c12f4713 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:18:34.183928 11858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb8e389bf22e48259f4d63c2c12f4713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.190303 11935 tablet_service.cc:1511] Processing CreateTablet for tablet bb8e389bf22e48259f4d63c2c12f4713 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:18:34.191567 12009 tablet_service.cc:1511] Processing CreateTablet for tablet 59a9704b659947e6988fc29f5296ec73 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:18:34.194387 11859 tablet_service.cc:1511] Processing CreateTablet for tablet 59a9704b659947e6988fc29f5296ec73 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:18:34.195894 11859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59a9704b659947e6988fc29f5296ec73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.195573 11938 tablet_service.cc:1511] Processing CreateTablet for tablet d52730cf917140dfaced7ad6cf28f5f7 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:18:34.197069 11935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb8e389bf22e48259f4d63c2c12f4713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.194859 12068 tablet_bootstrap.cc:492] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:34.202270 12068 ts_tablet_manager.cc:1403] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.375s	user 0.025s	sys 0.021s
I20260709 13:18:34.203131 11938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52730cf917140dfaced7ad6cf28f5f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.205706 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fab9357d5e4c8093e8d5482cb5ed2b" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:34.206168 11786 tablet_service.cc:1511] Processing CreateTablet for tablet 59a9704b659947e6988fc29f5296ec73 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 13:18:34.207482 11989 leader_election.cc:343] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.208182 11989 leader_election.cc:304] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:34.209594 12078 raft_consensus.cc:2749] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:34.213554 12070 tablet_bootstrap.cc:492] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:34.215392 12068 raft_consensus.cc:359] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:34.220990 12009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59a9704b659947e6988fc29f5296ec73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.227422 11786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59a9704b659947e6988fc29f5296ec73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.239111 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fc72a3f0044004b68c29cd9bdbf7d2" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:34.239831 12082 raft_consensus.cc:493] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.240442 12082 raft_consensus.cc:515] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
W20260709 13:18:34.241041 11767 leader_election.cc:343] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.229450 12068 raft_consensus.cc:385] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:34.242376 12068 raft_consensus.cc:740] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:34.243499 12068 consensus_queue.cc:260] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:34.248756 12082 leader_election.cc:290] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:34.250547 12007 tablet_service.cc:1511] Processing CreateTablet for tablet d52730cf917140dfaced7ad6cf28f5f7 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:18:34.254354 12007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52730cf917140dfaced7ad6cf28f5f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.268334 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fc72a3f0044004b68c29cd9bdbf7d2" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:34.268942 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd960dbe5b2404bbec84f15a3cc69f1" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
W20260709 13:18:34.270694 11766 leader_election.cc:343] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.271234 11766 leader_election.cc:304] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdbe2261c337471ea4d0c980ebb80c72; no voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:34.273936 12082 raft_consensus.cc:2749] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:34.275866 11746 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:18:34.276823 11766 leader_election.cc:343] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.284587 11790 tablet_service.cc:1511] Processing CreateTablet for tablet d52730cf917140dfaced7ad6cf28f5f7 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:18:34.285257 11866 tablet_service.cc:1511] Processing CreateTablet for tablet 56ac6eddb0d84b0f921015c7d71e77a2 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:18:34.286162 11790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52730cf917140dfaced7ad6cf28f5f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.287576 11866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56ac6eddb0d84b0f921015c7d71e77a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.288506 11933 tablet_service.cc:1511] Processing CreateTablet for tablet 56ac6eddb0d84b0f921015c7d71e77a2 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:18:34.289780 11933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56ac6eddb0d84b0f921015c7d71e77a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.297241 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b38c8234f5f433bb73bb44a0950731d" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:34.298163 11989 leader_election.cc:304] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:34.309065 12078 raft_consensus.cc:2804] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:34.309520 12078 raft_consensus.cc:493] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.310074 12078 raft_consensus.cc:3060] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:34.301414 11875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a598cfbb3c457eb5a8c9801d421a01" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:34.307047 12068 ts_tablet_manager.cc:1434] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.104s	user 0.002s	sys 0.006s
W20260709 13:18:34.317864 11915 leader_election.cc:343] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.319339 11915 leader_election.cc:304] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:34.321954 12076 raft_consensus.cc:2749] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:34.324036 11915 leader_election.cc:343] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.324558 11915 leader_election.cc:304] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:34.324287 11783 tablet_service.cc:1511] Processing CreateTablet for tablet fa6ff283134a4463af9ad09ed3ac81ce (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:18:34.325935 11783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa6ff283134a4463af9ad09ed3ac81ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.327013 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f5c73ecd474b45ae6c27ca1f1046a1" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
W20260709 13:18:34.330127 11841 leader_election.cc:343] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.331691 12076 raft_consensus.cc:2749] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:34.332880 12068 tablet_bootstrap.cc:492] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:34.337023 11875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd960dbe5b2404bbec84f15a3cc69f1" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:34.338162 12072 tablet_bootstrap.cc:492] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
W20260709 13:18:34.338542 11766 leader_election.cc:343] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.339068 11766 leader_election.cc:304] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdbe2261c337471ea4d0c980ebb80c72; no voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:34.340162 12082 raft_consensus.cc:2749] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:34.342600 11859 tablet_service.cc:1511] Processing CreateTablet for tablet fa6ff283134a4463af9ad09ed3ac81ce (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:18:34.342903 11935 tablet_service.cc:1511] Processing CreateTablet for tablet fa6ff283134a4463af9ad09ed3ac81ce (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:18:34.343839 12069 tablet_bootstrap.cc:492] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:34.344033 11859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa6ff283134a4463af9ad09ed3ac81ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.344420 12069 ts_tablet_manager.cc:1403] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.284s	user 0.020s	sys 0.000s
I20260709 13:18:34.338706 12072 ts_tablet_manager.cc:1403] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.328s	user 0.026s	sys 0.010s
I20260709 13:18:34.345827 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f5c73ecd474b45ae6c27ca1f1046a1" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
W20260709 13:18:34.347373 11841 leader_election.cc:343] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.347926 11841 leader_election.cc:304] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:34.348178 12069 raft_consensus.cc:359] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:34.348415 12072 raft_consensus.cc:359] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:34.348783 12077 raft_consensus.cc:2749] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:34.349221 12072 raft_consensus.cc:385] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:34.350029 12072 raft_consensus.cc:740] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:34.350492 12011 tablet_service.cc:1511] Processing CreateTablet for tablet 56ac6eddb0d84b0f921015c7d71e77a2 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:18:34.344646 11935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa6ff283134a4463af9ad09ed3ac81ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.351884 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56ac6eddb0d84b0f921015c7d71e77a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.353116 12007 tablet_service.cc:1511] Processing CreateTablet for tablet dac39fc7f83141e0887192bc70b641b6 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:18:34.337093 12078 raft_consensus.cc:515] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:34.349084 12069 raft_consensus.cc:385] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:34.354713 12069 raft_consensus.cc:740] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:34.354996 12007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dac39fc7f83141e0887192bc70b641b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.355648 12069 consensus_queue.cc:260] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:34.356968 12070 tablet_bootstrap.cc:654] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:34.354077 12072 consensus_queue.cc:260] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:34.361456 11786 tablet_service.cc:1511] Processing CreateTablet for tablet dac39fc7f83141e0887192bc70b641b6 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:18:34.362972 11786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dac39fc7f83141e0887192bc70b641b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.366621 11863 tablet_service.cc:1511] Processing CreateTablet for tablet dac39fc7f83141e0887192bc70b641b6 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:18:34.368182 11863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dac39fc7f83141e0887192bc70b641b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.370950 12068 tablet_bootstrap.cc:654] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:34.371079 12072 ts_tablet_manager.cc:1434] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:18:34.374787 12072 tablet_bootstrap.cc:492] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:34.375152 12069 ts_tablet_manager.cc:1434] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.001s
I20260709 13:18:34.377406 12078 leader_election.cc:290] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:34.379103 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4646ce4a654acda4a5971dbefc623f" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:34.379480 11875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4646ce4a654acda4a5971dbefc623f" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:34.380096 11875 raft_consensus.cc:3060] T 8d4646ce4a654acda4a5971dbefc623f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:34.382102 12072 tablet_bootstrap.cc:654] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:34.384629 11989 leader_election.cc:343] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.387769 11875 raft_consensus.cc:2468] T 8d4646ce4a654acda4a5971dbefc623f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:34.389099 11989 leader_election.cc:304] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:34.379652 12078 raft_consensus.cc:493] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.390476 12078 raft_consensus.cc:515] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:34.393977 12069 tablet_bootstrap.cc:492] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:34.393852 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e185eb05f14f19978919c9f8e5906e" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
W20260709 13:18:34.396075 11989 leader_election.cc:343] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.408260 11938 tablet_service.cc:1511] Processing CreateTablet for tablet 276261d09b63498f8b2902647b4e2b4a (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:18:34.409706 11938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 276261d09b63498f8b2902647b4e2b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.416002 12009 tablet_service.cc:1511] Processing CreateTablet for tablet 276261d09b63498f8b2902647b4e2b4a (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:18:34.419768 12009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 276261d09b63498f8b2902647b4e2b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.423049 11783 tablet_service.cc:1511] Processing CreateTablet for tablet 276261d09b63498f8b2902647b4e2b4a (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:18:34.423929 11859 tablet_service.cc:1511] Processing CreateTablet for tablet 9c44d39672a741709a46194020f68692 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:18:34.425503 11859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c44d39672a741709a46194020f68692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.424394 11783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 276261d09b63498f8b2902647b4e2b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.439040 11935 tablet_service.cc:1511] Processing CreateTablet for tablet 9c44d39672a741709a46194020f68692 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:18:34.440040 11935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c44d39672a741709a46194020f68692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.442498 12070 tablet_bootstrap.cc:492] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:34.443094 12070 ts_tablet_manager.cc:1403] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.230s	user 0.008s	sys 0.006s
I20260709 13:18:34.447867 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e185eb05f14f19978919c9f8e5906e" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:34.449010 12072 tablet_bootstrap.cc:492] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:34.449569 12072 ts_tablet_manager.cc:1403] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.012s
I20260709 13:18:34.451213 12068 tablet_bootstrap.cc:492] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:34.451756 12068 ts_tablet_manager.cc:1403] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.119s	user 0.016s	sys 0.000s
W20260709 13:18:34.452204 11989 leader_election.cc:343] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.452316 12077 raft_consensus.cc:493] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.452745 11989 leader_election.cc:304] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:34.452869 12077 raft_consensus.cc:515] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:34.450840 12005 tablet_service.cc:1511] Processing CreateTablet for tablet 9c44d39672a741709a46194020f68692 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:18:34.452750 12072 raft_consensus.cc:359] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:34.459059 12072 raft_consensus.cc:385] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:34.458695 12070 raft_consensus.cc:359] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:34.459380 12072 raft_consensus.cc:740] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:34.459597 12070 raft_consensus.cc:385] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:34.460011 12070 raft_consensus.cc:740] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:34.460189 12072 consensus_queue.cc:260] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:34.460774 12070 consensus_queue.cc:260] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:34.462771 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b38c8234f5f433bb73bb44a0950731d" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:34.471112 11949 raft_consensus.cc:2468] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 0.
I20260709 13:18:34.471547 12005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c44d39672a741709a46194020f68692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.453766 12078 leader_election.cc:290] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:34.461210 12077 leader_election.cc:290] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:34.477947 11841 leader_election.cc:304] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:34.480752 11866 tablet_service.cc:1511] Processing CreateTablet for tablet 5d66e54a11a44e09b15744ecdc4ae226 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:18:34.482223 11866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d66e54a11a44e09b15744ecdc4ae226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.486929 11790 tablet_service.cc:1511] Processing CreateTablet for tablet 5d66e54a11a44e09b15744ecdc4ae226 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:18:34.488583 11790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d66e54a11a44e09b15744ecdc4ae226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.490561 12077 raft_consensus.cc:2804] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:34.491089 12077 raft_consensus.cc:493] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.491456 12077 raft_consensus.cc:3060] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:34.494313 12069 tablet_bootstrap.cc:654] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:34.497334 12107 raft_consensus.cc:2804] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:34.500537 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b38c8234f5f433bb73bb44a0950731d" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
W20260709 13:18:34.502748 11842 leader_election.cc:343] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.506578 12068 raft_consensus.cc:359] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:34.507417 12068 raft_consensus.cc:385] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:34.507738 12068 raft_consensus.cc:740] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:34.508641 12078 raft_consensus.cc:2749] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:34.509081 12068 consensus_queue.cc:260] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:34.509541 12107 raft_consensus.cc:697] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Becoming Leader. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Running, Role: LEADER
I20260709 13:18:34.510697 12107 consensus_queue.cc:237] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:34.511539 12068 ts_tablet_manager.cc:1434] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.002s
I20260709 13:18:34.539268 12068 tablet_bootstrap.cc:492] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:34.541579 11935 tablet_service.cc:1511] Processing CreateTablet for tablet 5d66e54a11a44e09b15744ecdc4ae226 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:18:34.542955 11935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d66e54a11a44e09b15744ecdc4ae226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.545893 12072 ts_tablet_manager.cc:1434] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.096s	user 0.015s	sys 0.014s
I20260709 13:18:34.551309 12076 raft_consensus.cc:493] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.551869 12076 raft_consensus.cc:515] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:34.553964 12076 leader_election.cc:290] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:34.556794 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fab9357d5e4c8093e8d5482cb5ed2b" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:34.557641 11801 raft_consensus.cc:2468] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 0.
I20260709 13:18:34.559757 11915 leader_election.cc:304] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:34.560222 12005 tablet_service.cc:1511] Processing CreateTablet for tablet bc8dab527d374a47b91239feea9d8b3a (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:18:34.560956 12076 raft_consensus.cc:2804] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:34.561583 12076 raft_consensus.cc:493] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.561816 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fab9357d5e4c8093e8d5482cb5ed2b" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:34.562106 12076 raft_consensus.cc:3060] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:34.562287 12072 tablet_bootstrap.cc:492] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:34.562628 12024 raft_consensus.cc:2468] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 0.
I20260709 13:18:34.565546 12108 raft_consensus.cc:493] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.566155 12108 raft_consensus.cc:515] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:34.568446 12108 leader_election.cc:290] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:34.569473 12070 ts_tablet_manager.cc:1434] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.126s	user 0.008s	sys 0.004s
I20260709 13:18:34.569813 11866 tablet_service.cc:1511] Processing CreateTablet for tablet bc8dab527d374a47b91239feea9d8b3a (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:18:34.569841 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59c45da3f3f43a5b793c3305865da17" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:34.570710 12072 tablet_bootstrap.cc:654] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:34.571444 11866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc8dab527d374a47b91239feea9d8b3a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:34.572273 11841 leader_election.cc:343] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.571990 12077 raft_consensus.cc:515] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:34.575022 11938 tablet_service.cc:1511] Processing CreateTablet for tablet 30bf1f22d4f144109fe8d089d54dd5e6 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:18:34.577255 12077 leader_election.cc:290] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:34.578125 11938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30bf1f22d4f144109fe8d089d54dd5e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.578600 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b38c8234f5f433bb73bb44a0950731d" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:34.573589 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59c45da3f3f43a5b793c3305865da17" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
W20260709 13:18:34.580169 11842 leader_election.cc:343] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:34.580906 11841 leader_election.cc:343] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.576610 11699 catalog_manager.cc:5697] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f7178f720eb4090a3593087331b82e9 (127.1.227.132). New cstate: current_term: 1 leader_uuid: "1f7178f720eb4090a3593087331b82e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:34.582155 12111 raft_consensus.cc:493] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.582777 12111 raft_consensus.cc:515] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:34.562449 12005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc8dab527d374a47b91239feea9d8b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.570636 12070 tablet_bootstrap.cc:492] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:34.576717 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b38c8234f5f433bb73bb44a0950731d" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:34.586385 11949 raft_consensus.cc:3060] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:34.592137 12011 tablet_service.cc:1511] Processing CreateTablet for tablet 30bf1f22d4f144109fe8d089d54dd5e6 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:18:34.581435 11841 leader_election.cc:304] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:34.594343 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f1d538ab1446f182128209d64b34be" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:34.594532 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30bf1f22d4f144109fe8d089d54dd5e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:34.596478 11989 leader_election.cc:343] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.599390 12111 leader_election.cc:290] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:34.600950 11875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f1d538ab1446f182128209d64b34be" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
W20260709 13:18:34.603194 11989 leader_election.cc:343] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.604173 11989 leader_election.cc:304] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:34.605991 11786 tablet_service.cc:1511] Processing CreateTablet for tablet 30bf1f22d4f144109fe8d089d54dd5e6 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:18:34.607645 11786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30bf1f22d4f144109fe8d089d54dd5e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.609994 12077 raft_consensus.cc:2749] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:34.610765 12111 raft_consensus.cc:2749] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:34.612943 12069 tablet_bootstrap.cc:492] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:34.613564 12069 ts_tablet_manager.cc:1403] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.220s	user 0.011s	sys 0.005s
I20260709 13:18:34.616685 12068 tablet_bootstrap.cc:654] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:34.621197 11863 tablet_service.cc:1511] Processing CreateTablet for tablet e38fc17625bd4a30b79f4a0bc2f8bf39 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:18:34.622874 11863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e38fc17625bd4a30b79f4a0bc2f8bf39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.626153 11933 tablet_service.cc:1511] Processing CreateTablet for tablet e38fc17625bd4a30b79f4a0bc2f8bf39 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:18:34.627722 11933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e38fc17625bd4a30b79f4a0bc2f8bf39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.628327 11949 raft_consensus.cc:2468] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:34.629823 11841 leader_election.cc:304] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:34.631227 12077 raft_consensus.cc:2804] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:34.631811 12077 raft_consensus.cc:697] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Becoming Leader. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
I20260709 13:18:34.632771 12077 consensus_queue.cc:237] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:34.575780 11783 tablet_service.cc:1511] Processing CreateTablet for tablet bc8dab527d374a47b91239feea9d8b3a (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:18:34.634882 11783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc8dab527d374a47b91239feea9d8b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.638062 12009 tablet_service.cc:1511] Processing CreateTablet for tablet e38fc17625bd4a30b79f4a0bc2f8bf39 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:18:34.640090 12009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e38fc17625bd4a30b79f4a0bc2f8bf39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.644218 12070 tablet_bootstrap.cc:654] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:34.650451 12111 raft_consensus.cc:493] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.651098 12111 raft_consensus.cc:515] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:34.655458 12111 leader_election.cc:290] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:34.656471 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fc72a3f0044004b68c29cd9bdbf7d2" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:34.656915 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fc72a3f0044004b68c29cd9bdbf7d2" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:34.657533 11801 raft_consensus.cc:2468] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 0.
W20260709 13:18:34.658919 11989 leader_election.cc:343] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.659190 12076 raft_consensus.cc:515] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:34.659952 11989 leader_election.cc:304] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 04f862d1b8824d7a81daa0cad52c5843
I20260709 13:18:34.661201 12111 raft_consensus.cc:2804] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:34.661624 12111 raft_consensus.cc:493] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.662038 12111 raft_consensus.cc:3060] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:34.617343 12069 raft_consensus.cc:359] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:34.666100 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fab9357d5e4c8093e8d5482cb5ed2b" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:34.666464 12069 raft_consensus.cc:385] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:34.666880 12069 raft_consensus.cc:740] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:34.666996 11801 raft_consensus.cc:3060] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:34.667243 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fab9357d5e4c8093e8d5482cb5ed2b" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:34.668025 12024 raft_consensus.cc:3060] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:34.667868 12069 consensus_queue.cc:260] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:34.677136 11791 tablet_service.cc:1511] Processing CreateTablet for tablet d55c8d664ee74f0fbb31693f1b398fba (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:18:34.667263 12076 leader_election.cc:290] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:34.678831 11791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55c8d664ee74f0fbb31693f1b398fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.679550 12069 ts_tablet_manager.cc:1434] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 13:18:34.680821 12069 tablet_bootstrap.cc:492] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:34.694036 11801 raft_consensus.cc:2468] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:34.702507 12024 raft_consensus.cc:2468] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:34.706367 11916 leader_election.cc:304] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: 
I20260709 13:18:34.707309 12076 raft_consensus.cc:2804] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:34.715783 11697 catalog_manager.cc:5697] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130). New cstate: current_term: 1 leader_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:34.718917 11859 tablet_service.cc:1511] Processing CreateTablet for tablet d55c8d664ee74f0fbb31693f1b398fba (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:18:34.719081 11864 tablet_service.cc:1511] Processing CreateTablet for tablet 86477bbe25284503970ce70bb1e26190 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:18:34.737290 11933 tablet_service.cc:1511] Processing CreateTablet for tablet d55c8d664ee74f0fbb31693f1b398fba (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:18:34.737344 11783 tablet_service.cc:1511] Processing CreateTablet for tablet 86477bbe25284503970ce70bb1e26190 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:18:34.738752 11783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86477bbe25284503970ce70bb1e26190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.738843 11933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55c8d664ee74f0fbb31693f1b398fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.731724 11790 tablet_service.cc:1511] Processing CreateTablet for tablet 1ad333631d4d40a38cada3a3b76f5e52 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:18:34.722268 12007 tablet_service.cc:1511] Processing CreateTablet for tablet 86477bbe25284503970ce70bb1e26190 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:18:34.742414 11790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ad333631d4d40a38cada3a3b76f5e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.742914 12007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86477bbe25284503970ce70bb1e26190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.743577 12008 tablet_service.cc:1511] Processing CreateTablet for tablet eeda29dd1f464af4b5c86ee8ec5bffc4 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:18:34.744805 12008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeda29dd1f464af4b5c86ee8ec5bffc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.746212 12111 raft_consensus.cc:515] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:34.732316 12082 raft_consensus.cc:493] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.747877 12082 raft_consensus.cc:515] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:34.748469 12111 leader_election.cc:290] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:34.730684 11859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55c8d664ee74f0fbb31693f1b398fba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.727303 12072 tablet_bootstrap.cc:492] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:34.754005 12011 tablet_service.cc:1511] Processing CreateTablet for tablet 1ad333631d4d40a38cada3a3b76f5e52 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:18:34.755093 12082 leader_election.cc:290] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:34.755412 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ad333631d4d40a38cada3a3b76f5e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.755335 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fc72a3f0044004b68c29cd9bdbf7d2" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:34.756225 11801 raft_consensus.cc:3060] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:34.756546 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fc72a3f0044004b68c29cd9bdbf7d2" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:34.758342 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7f7f507dd4bd797a1b9a3a85b82fe" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:34.729451 11858 tablet_service.cc:1511] Processing CreateTablet for tablet eeda29dd1f464af4b5c86ee8ec5bffc4 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:18:34.760473 11875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7f7f507dd4bd797a1b9a3a85b82fe" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
W20260709 13:18:34.762042 11989 leader_election.cc:343] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.731448 11937 tablet_service.cc:1511] Processing CreateTablet for tablet eeda29dd1f464af4b5c86ee8ec5bffc4 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 13:18:34.770854 11767 leader_election.cc:343] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.771849 11937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeda29dd1f464af4b5c86ee8ec5bffc4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:34.773985 11766 leader_election.cc:343] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.774530 11766 leader_election.cc:304] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:34.774648 11786 tablet_service.cc:1511] Processing CreateTablet for tablet eece1e771a0341b1bebc6fde110e6f8a (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:18:34.725706 11936 tablet_service.cc:1511] Processing CreateTablet for tablet 1ad333631d4d40a38cada3a3b76f5e52 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:18:34.775491 12082 raft_consensus.cc:2749] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:34.782883 11786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eece1e771a0341b1bebc6fde110e6f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.783704 11936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ad333631d4d40a38cada3a3b76f5e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.770007 12072 ts_tablet_manager.cc:1403] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.208s	user 0.043s	sys 0.065s
I20260709 13:18:34.791926 12069 tablet_bootstrap.cc:654] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:34.794703 11864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86477bbe25284503970ce70bb1e26190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.799602 11866 tablet_service.cc:1511] Processing CreateTablet for tablet eece1e771a0341b1bebc6fde110e6f8a (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:18:34.801054 11866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eece1e771a0341b1bebc6fde110e6f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.789335 12072 raft_consensus.cc:359] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:34.813438 11858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeda29dd1f464af4b5c86ee8ec5bffc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.794585 12076 raft_consensus.cc:697] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:34.820017 11801 raft_consensus.cc:2468] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:34.815860 12072 raft_consensus.cc:385] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:34.821957 12072 raft_consensus.cc:740] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:34.822063 11989 leader_election.cc:304] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 04f862d1b8824d7a81daa0cad52c5843
I20260709 13:18:34.822971 12111 raft_consensus.cc:2804] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:34.822829 12072 consensus_queue.cc:260] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:34.823514 12111 raft_consensus.cc:697] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Becoming Leader. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Running, Role: LEADER
I20260709 13:18:34.824417 12111 consensus_queue.cc:237] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:34.825479 12072 ts_tablet_manager.cc:1434] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.039s	user 0.000s	sys 0.005s
I20260709 13:18:34.836441 11933 tablet_service.cc:1511] Processing CreateTablet for tablet eece1e771a0341b1bebc6fde110e6f8a (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:18:34.836861 12070 tablet_bootstrap.cc:492] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:34.837504 12070 ts_tablet_manager.cc:1403] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.267s	user 0.012s	sys 0.024s
I20260709 13:18:34.837881 11933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eece1e771a0341b1bebc6fde110e6f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.840848 12070 raft_consensus.cc:359] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:34.843225 12011 tablet_service.cc:1511] Processing CreateTablet for tablet 678fcf88b458421b960351bc865762c6 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:18:34.858428 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 678fcf88b458421b960351bc865762c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.845347 11783 tablet_service.cc:1511] Processing CreateTablet for tablet 678fcf88b458421b960351bc865762c6 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:18:34.849987 12118 raft_consensus.cc:493] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.850457 12076 consensus_queue.cc:237] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:34.850980 12068 tablet_bootstrap.cc:492] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:34.854897 11863 tablet_service.cc:1511] Processing CreateTablet for tablet 678fcf88b458421b960351bc865762c6 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:18:34.859835 11783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 678fcf88b458421b960351bc865762c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.857978 12070 raft_consensus.cc:385] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:34.863096 12118 raft_consensus.cc:515] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:34.875603 12118 leader_election.cc:290] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:34.875275 12005 tablet_service.cc:1511] Processing CreateTablet for tablet 34e862ca999046aca1a257edebcdfea3 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:18:34.877120 12005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e862ca999046aca1a257edebcdfea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.880496 11875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d51c27f1d494f64980afcf1b0f89fff" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:34.882243 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d51c27f1d494f64980afcf1b0f89fff" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:34.883219 11933 tablet_service.cc:1511] Processing CreateTablet for tablet 34e862ca999046aca1a257edebcdfea3 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 13:18:34.884373 11916 leader_election.cc:343] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.886065 11863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 678fcf88b458421b960351bc865762c6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:34.886019 11915 leader_election.cc:343] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:34.886831 11915 leader_election.cc:304] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:34.887876 12118 raft_consensus.cc:2749] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:34.884395 11933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e862ca999046aca1a257edebcdfea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.895354 12072 tablet_bootstrap.cc:492] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:34.872798 12068 ts_tablet_manager.cc:1403] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.334s	user 0.014s	sys 0.022s
I20260709 13:18:34.908468 12072 tablet_bootstrap.cc:654] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:34.908775 12068 raft_consensus.cc:359] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:34.873020 12070 raft_consensus.cc:740] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:34.910624 12070 consensus_queue.cc:260] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:34.910888 11790 tablet_service.cc:1511] Processing CreateTablet for tablet 34e862ca999046aca1a257edebcdfea3 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:18:34.912215 11790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e862ca999046aca1a257edebcdfea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.913196 12070 ts_tablet_manager.cc:1434] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.075s	user 0.004s	sys 0.002s
I20260709 13:18:34.914290 12070 tablet_bootstrap.cc:492] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:34.919453 11857 tablet_service.cc:1511] Processing CreateTablet for tablet 765b55f8e8d24e2a9fa6860917b6c5d5 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:18:34.920825 11857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 765b55f8e8d24e2a9fa6860917b6c5d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.922806 12007 tablet_service.cc:1511] Processing CreateTablet for tablet 765b55f8e8d24e2a9fa6860917b6c5d5 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:18:34.924134 12007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 765b55f8e8d24e2a9fa6860917b6c5d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.909615 12068 raft_consensus.cc:385] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:34.927349 12068 raft_consensus.cc:740] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:34.928081 12068 consensus_queue.cc:260] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:34.929983 12068 ts_tablet_manager.cc:1434] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:18:34.931013 12068 tablet_bootstrap.cc:492] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:34.940423 11936 tablet_service.cc:1511] Processing CreateTablet for tablet 765b55f8e8d24e2a9fa6860917b6c5d5 (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:18:34.942396 11936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 765b55f8e8d24e2a9fa6860917b6c5d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.943789 11786 tablet_service.cc:1511] Processing CreateTablet for tablet 4b8ca7758d7240519907444b2ba2c15f (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:18:34.951306 11697 catalog_manager.cc:5697] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:34.951310 12069 tablet_bootstrap.cc:492] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:34.960249 12069 ts_tablet_manager.cc:1403] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.280s	user 0.033s	sys 0.019s
I20260709 13:18:34.962298 12072 tablet_bootstrap.cc:492] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:34.962109 11935 tablet_service.cc:1511] Processing CreateTablet for tablet 4b8ca7758d7240519907444b2ba2c15f (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:18:34.962901 12072 ts_tablet_manager.cc:1403] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.101s	user 0.026s	sys 0.005s
I20260709 13:18:34.963376 11935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b8ca7758d7240519907444b2ba2c15f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.963825 12069 raft_consensus.cc:359] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:34.964712 12069 raft_consensus.cc:385] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:34.965044 12069 raft_consensus.cc:740] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:34.965238 11864 tablet_service.cc:1511] Processing CreateTablet for tablet 4b8ca7758d7240519907444b2ba2c15f (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:18:34.975654 11864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b8ca7758d7240519907444b2ba2c15f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.981989 11697 catalog_manager.cc:5697] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f7178f720eb4090a3593087331b82e9 (127.1.227.132). New cstate: current_term: 1 leader_uuid: "1f7178f720eb4090a3593087331b82e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:34.985421 12011 tablet_service.cc:1511] Processing CreateTablet for tablet 9780438f22284df785414db0646df50e (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:18:34.986714 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9780438f22284df785414db0646df50e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.987835 12068 tablet_bootstrap.cc:654] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:34.991888 11786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b8ca7758d7240519907444b2ba2c15f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.985999 12069 consensus_queue.cc:260] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.004362 12069 ts_tablet_manager.cc:1434] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.044s	user 0.003s	sys 0.004s
I20260709 13:18:35.005452 12069 tablet_bootstrap.cc:492] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:35.007966 12070 tablet_bootstrap.cc:654] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.016705 12069 tablet_bootstrap.cc:654] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:34.998878 12072 raft_consensus.cc:359] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.020955 12082 raft_consensus.cc:493] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.029457 12011 tablet_service.cc:1511] Processing CreateTablet for tablet 83da445e9a4d483e8d2504e806a4461b (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
W20260709 13:18:35.030062 11989 consensus_peers.cc:597] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:35.031073 11859 tablet_service.cc:1511] Processing CreateTablet for tablet 9780438f22284df785414db0646df50e (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:18:35.033236 12072 raft_consensus.cc:385] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.033823 12072 raft_consensus.cc:740] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.031139 11786 tablet_service.cc:1511] Processing CreateTablet for tablet 9780438f22284df785414db0646df50e (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:18:35.032459 12082 raft_consensus.cc:515] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.032758 11933 tablet_service.cc:1511] Processing CreateTablet for tablet 83da445e9a4d483e8d2504e806a4461b (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:18:35.040139 11933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83da445e9a4d483e8d2504e806a4461b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:35.042090 11875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f5c73ecd474b45ae6c27ca1f1046a1" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:35.042834 11875 raft_consensus.cc:2468] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:35.044394 11766 leader_election.cc:304] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:35.048213 12111 consensus_queue.cc:1048] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:35.034264 11859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9780438f22284df785414db0646df50e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:35.050422 12068 tablet_bootstrap.cc:492] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:35.051083 12068 ts_tablet_manager.cc:1403] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.120s	user 0.014s	sys 0.012s
I20260709 13:18:35.055154 12011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83da445e9a4d483e8d2504e806a4461b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:35.058705 12082 leader_election.cc:290] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:35.062081 12082 raft_consensus.cc:2804] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:35.065291 12082 raft_consensus.cc:493] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.066725 12082 raft_consensus.cc:3060] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.067550 12072 consensus_queue.cc:260] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.061605 12068 raft_consensus.cc:359] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:35.075930 12068 raft_consensus.cc:385] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.076326 12068 raft_consensus.cc:740] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.034209 11790 tablet_service.cc:1511] Processing CreateTablet for tablet 83da445e9a4d483e8d2504e806a4461b (DEFAULT_TABLE table=test-workload [id=cfd27a8a35214c60a15369cf1748cae7]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:18:35.077819 12072 ts_tablet_manager.cc:1434] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.115s	user 0.007s	sys 0.007s
I20260709 13:18:35.064852 11786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9780438f22284df785414db0646df50e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:35.077986 12068 consensus_queue.cc:260] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:35.081127 12068 ts_tablet_manager.cc:1434] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 13:18:35.082296 11790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83da445e9a4d483e8d2504e806a4461b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:35.082697 12072 tablet_bootstrap.cc:492] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:35.083987 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f5c73ecd474b45ae6c27ca1f1046a1" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
W20260709 13:18:35.085824 11766 leader_election.cc:343] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:35.075541 12069 tablet_bootstrap.cc:492] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:35.096760 12111 raft_consensus.cc:493] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.097333 12111 raft_consensus.cc:515] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.099526 12111 leader_election.cc:290] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:35.100261 12070 tablet_bootstrap.cc:492] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:35.100806 12070 ts_tablet_manager.cc:1403] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.187s	user 0.008s	sys 0.006s
I20260709 13:18:35.101423 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7f7f507dd4bd797a1b9a3a85b82fe" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:35.102167 11801 raft_consensus.cc:2468] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 0.
I20260709 13:18:35.102726 12069 ts_tablet_manager.cc:1403] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.097s	user 0.002s	sys 0.011s
I20260709 13:18:35.103292 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7f7f507dd4bd797a1b9a3a85b82fe" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:35.104128 11876 raft_consensus.cc:2468] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 0.
I20260709 13:18:35.105942 11989 leader_election.cc:304] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:35.109928 12107 raft_consensus.cc:2804] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:35.110361 12107 raft_consensus.cc:493] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.110688 12107 raft_consensus.cc:3060] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.112135 12069 raft_consensus.cc:359] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.110702 12068 tablet_bootstrap.cc:492] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:35.116513 12082 raft_consensus.cc:515] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.118641 12107 raft_consensus.cc:515] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.124687 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7f7f507dd4bd797a1b9a3a85b82fe" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:35.125409 11801 raft_consensus.cc:3060] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.128557 12068 tablet_bootstrap.cc:654] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.130324 12070 raft_consensus.cc:359] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.131023 12107 leader_election.cc:290] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:35.131186 12070 raft_consensus.cc:385] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.121006 12069 raft_consensus.cc:385] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.134176 12070 raft_consensus.cc:740] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.135140 12070 consensus_queue.cc:260] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.132489 12072 tablet_bootstrap.cc:654] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.133546 12077 raft_consensus.cc:493] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.136399 12077 raft_consensus.cc:515] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.137233 11801 raft_consensus.cc:2468] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:35.132310 11875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7f7f507dd4bd797a1b9a3a85b82fe" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:35.138626 11875 raft_consensus.cc:3060] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.138722 12070 ts_tablet_manager.cc:1434] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:18:35.139447 12082 leader_election.cc:290] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:35.139822 12070 tablet_bootstrap.cc:492] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:35.134310 12069 raft_consensus.cc:740] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.141325 12069 consensus_queue.cc:260] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.142526 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f5c73ecd474b45ae6c27ca1f1046a1" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:35.143064 12077 leader_election.cc:290] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:35.143783 12069 ts_tablet_manager.cc:1434] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260709 13:18:35.145907 12107 raft_consensus.cc:493] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.147665 12076 raft_consensus.cc:493] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.150048 12107 raft_consensus.cc:515] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.150941 11874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f5c73ecd474b45ae6c27ca1f1046a1" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:35.151661 11874 raft_consensus.cc:3060] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.151794 11989 leader_election.cc:304] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:35.151819 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd960dbe5b2404bbec84f15a3cc69f1" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:35.154942 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4185998b54aa3900c8c3e9a09d72c" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:35.155265 12107 leader_election.cc:290] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
W20260709 13:18:35.148432 11766 leader_election.cc:343] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:35.156562 12107 raft_consensus.cc:2804] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:35.157361 12107 raft_consensus.cc:697] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Becoming Leader. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Running, Role: LEADER
I20260709 13:18:35.158556 12107 consensus_queue.cc:237] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.150858 12076 raft_consensus.cc:515] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:35.157388 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd960dbe5b2404bbec84f15a3cc69f1" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:35.160281 11874 raft_consensus.cc:2468] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:35.160895 11801 raft_consensus.cc:2468] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 0.
I20260709 13:18:35.162273 12076 leader_election.cc:290] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:35.162845 12072 tablet_bootstrap.cc:492] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:35.149391 11875 raft_consensus.cc:2468] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:35.163579 12072 ts_tablet_manager.cc:1403] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.081s	user 0.004s	sys 0.009s
I20260709 13:18:35.164961 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095174060bff4a6b8f891f171bb9cd10" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
W20260709 13:18:35.166518 11916 leader_election.cc:343] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:35.166576 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4185998b54aa3900c8c3e9a09d72c" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:35.147948 12069 tablet_bootstrap.cc:492] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:35.178650 12068 tablet_bootstrap.cc:492] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
W20260709 13:18:35.167394 11989 leader_election.cc:343] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:35.180447 12068 ts_tablet_manager.cc:1403] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.006s
I20260709 13:18:35.168013 11841 leader_election.cc:304] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:35.183166 12069 tablet_bootstrap.cc:654] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:35.183369 11841 leader_election.cc:343] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:35.168304 11766 leader_election.cc:304] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72; no voters: 04f862d1b8824d7a81daa0cad52c5843
I20260709 13:18:35.185328 12082 raft_consensus.cc:2804] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:35.185031 12068 raft_consensus.cc:359] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:35.185935 12082 raft_consensus.cc:697] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:35.187206 12070 tablet_bootstrap.cc:654] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.187050 12082 consensus_queue.cc:237] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
W20260709 13:18:35.170563 11842 consensus_peers.cc:597] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Couldn't send request to peer 1f7178f720eb4090a3593087331b82e9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:35.174926 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095174060bff4a6b8f891f171bb9cd10" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:35.192016 12077 raft_consensus.cc:2804] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:35.186072 12068 raft_consensus.cc:385] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.192432 12077 raft_consensus.cc:493] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.193151 12077 raft_consensus.cc:3060] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:35.193660 11915 leader_election.cc:343] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:35.174906 12072 raft_consensus.cc:359] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.194195 11915 leader_election.cc:304] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:35.194686 12072 raft_consensus.cc:385] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.195016 12072 raft_consensus.cc:740] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.195467 12076 raft_consensus.cc:2749] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:35.196888 12070 tablet_bootstrap.cc:492] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:35.196744 12072 consensus_queue.cc:260] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.197373 12070 ts_tablet_manager.cc:1403] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.001s
W20260709 13:18:35.199499 11989 leader_election.cc:343] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:35.200109 11989 leader_election.cc:304] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:35.197880 12068 raft_consensus.cc:740] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.202231 12111 raft_consensus.cc:2749] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:35.202409 12069 tablet_bootstrap.cc:492] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:35.206199 12068 consensus_queue.cc:260] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:35.213708 12070 raft_consensus.cc:359] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.214872 12070 raft_consensus.cc:385] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.215221 12070 raft_consensus.cc:740] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.215544 12068 ts_tablet_manager.cc:1434] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.005s
I20260709 13:18:35.216135 12070 consensus_queue.cc:260] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.209102 12077 raft_consensus.cc:515] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.210558 12069 ts_tablet_manager.cc:1403] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.004s
I20260709 13:18:35.218822 12070 ts_tablet_manager.cc:1434] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:18:35.219869 12070 tablet_bootstrap.cc:492] T 1b38c8234f5f433bb73bb44a0950731d P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:35.221204 12076 raft_consensus.cc:493] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.212316 12140 consensus_queue.cc:1048] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:35.221717 12076 raft_consensus.cc:515] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:35.224433 12076 leader_election.cc:290] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:35.224823 12069 raft_consensus.cc:359] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.226887 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fc72a3f0044004b68c29cd9bdbf7d2" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:35.227669 12077 leader_election.cc:290] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:35.226409 11697 catalog_manager.cc:5697] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f7178f720eb4090a3593087331b82e9 (127.1.227.132). New cstate: current_term: 1 leader_uuid: "1f7178f720eb4090a3593087331b82e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:35.227674 11801 raft_consensus.cc:2393] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04f862d1b8824d7a81daa0cad52c5843 in current term 1: Already voted for candidate 1f7178f720eb4090a3593087331b82e9 in this term.
I20260709 13:18:35.225574 12069 raft_consensus.cc:385] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.229447 12069 raft_consensus.cc:740] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.229818 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd960dbe5b2404bbec84f15a3cc69f1" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:35.230579 11800 raft_consensus.cc:3060] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.230316 12069 consensus_queue.cc:260] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.233397 12072 ts_tablet_manager.cc:1434] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.069s	user 0.018s	sys 0.007s
I20260709 13:18:35.232831 11699 catalog_manager.cc:5697] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:35.234040 12069 ts_tablet_manager.cc:1434] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:18:35.234697 12072 tablet_bootstrap.cc:492] T 8d51c27f1d494f64980afcf1b0f89fff P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:35.235085 12069 tablet_bootstrap.cc:492] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:35.235646 12082 raft_consensus.cc:493] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.236231 12082 raft_consensus.cc:515] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.238891 12082 leader_election.cc:290] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:35.240891 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdcb9800b8894d978568cd9ad81bdd31" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:35.242079 12072 tablet_bootstrap.cc:654] T 8d51c27f1d494f64980afcf1b0f89fff P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.242275 12069 tablet_bootstrap.cc:654] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:35.242655 11767 leader_election.cc:343] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:35.244581 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdcb9800b8894d978568cd9ad81bdd31" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:35.245079 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd960dbe5b2404bbec84f15a3cc69f1" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:35.245249 11876 raft_consensus.cc:2468] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:35.246580 11766 leader_election.cc:304] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:35.247844 12082 raft_consensus.cc:2804] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:35.248221 12082 raft_consensus.cc:493] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.248565 12082 raft_consensus.cc:3060] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:35.249588 11841 leader_election.cc:343] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:35.250723 12068 tablet_bootstrap.cc:492] T bce4185998b54aa3900c8c3e9a09d72c P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:35.255600 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fc72a3f0044004b68c29cd9bdbf7d2" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:35.256633 12082 raft_consensus.cc:515] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.257989 11916 leader_election.cc:304] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:35.260123 12076 raft_consensus.cc:3060] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.262300 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdcb9800b8894d978568cd9ad81bdd31" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:35.263128 11876 raft_consensus.cc:3060] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.262339 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdcb9800b8894d978568cd9ad81bdd31" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
W20260709 13:18:35.268016 11767 leader_election.cc:343] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:35.278877 11746 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:35.282377 11800 raft_consensus.cc:2468] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:35.282763 12118 consensus_queue.cc:1048] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:35.286801 12070 tablet_bootstrap.cc:654] T 1b38c8234f5f433bb73bb44a0950731d P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.262553 12082 leader_election.cc:290] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:35.283936 11876 raft_consensus.cc:2468] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:35.294564 12076 raft_consensus.cc:2749] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:35.288512 11841 leader_election.cc:304] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72; no voters: 04f862d1b8824d7a81daa0cad52c5843
I20260709 13:18:35.301435 12142 raft_consensus.cc:2804] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:35.302367 12142 raft_consensus.cc:697] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Becoming Leader. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
I20260709 13:18:35.303658 12142 consensus_queue.cc:237] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.306299 11766 leader_election.cc:304] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:35.308501 12082 raft_consensus.cc:2804] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:35.309267 12082 raft_consensus.cc:697] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:35.313771 12107 raft_consensus.cc:493] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.317194 12107 raft_consensus.cc:515] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.319298 12107 leader_election.cc:290] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:35.320129 12069 tablet_bootstrap.cc:492] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:35.320626 12069 ts_tablet_manager.cc:1403] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.086s	user 0.034s	sys 0.016s
I20260709 13:18:35.323297 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d51c27f1d494f64980afcf1b0f89fff" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:35.324445 11950 raft_consensus.cc:2468] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 0.
I20260709 13:18:35.323722 12069 raft_consensus.cc:359] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:35.325933 12069 raft_consensus.cc:385] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.326330 12069 raft_consensus.cc:740] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.328881 12069 consensus_queue.cc:260] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:35.327072 12076 raft_consensus.cc:493] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.332898 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d51c27f1d494f64980afcf1b0f89fff" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:35.330613 12082 consensus_queue.cc:237] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.335346 11989 leader_election.cc:304] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: 
I20260709 13:18:35.338155 12111 raft_consensus.cc:2804] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:35.338532 12111 raft_consensus.cc:493] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.338737 12072 tablet_bootstrap.cc:492] T 8d51c27f1d494f64980afcf1b0f89fff P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:35.338953 12111 raft_consensus.cc:3060] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.339251 12072 ts_tablet_manager.cc:1403] T 8d51c27f1d494f64980afcf1b0f89fff P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.105s	user 0.041s	sys 0.050s
I20260709 13:18:35.334993 12076 raft_consensus.cc:515] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:35.342648 12072 raft_consensus.cc:359] T 8d51c27f1d494f64980afcf1b0f89fff P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.343367 12072 raft_consensus.cc:385] T 8d51c27f1d494f64980afcf1b0f89fff P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:18:35.338594 12144 log.cc:927] Time spent T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:18:35.343688 12072 raft_consensus.cc:740] T 8d51c27f1d494f64980afcf1b0f89fff P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.344537 12069 ts_tablet_manager.cc:1434] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.004s
W20260709 13:18:35.343557 11989 leader_election.cc:343] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:35.347440 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e185eb05f14f19978919c9f8e5906e" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:35.348167 12069 tablet_bootstrap.cc:492] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:35.348464 12107 consensus_queue.cc:1048] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:35.346091 12076 leader_election.cc:290] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:35.348104 11800 raft_consensus.cc:2468] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 0.
I20260709 13:18:35.344592 12072 consensus_queue.cc:260] T 8d51c27f1d494f64980afcf1b0f89fff P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.353366 12072 ts_tablet_manager.cc:1434] T 8d51c27f1d494f64980afcf1b0f89fff P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:18:35.359015 12072 tablet_bootstrap.cc:492] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:35.354310 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e185eb05f14f19978919c9f8e5906e" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:35.360383 12111 raft_consensus.cc:515] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.361023 11915 leader_election.cc:304] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:35.360410 12023 raft_consensus.cc:2468] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 0.
I20260709 13:18:35.362048 12118 raft_consensus.cc:2804] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:35.362593 12118 raft_consensus.cc:493] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.362962 12118 raft_consensus.cc:3060] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.363749 12111 leader_election.cc:290] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:35.366386 12072 tablet_bootstrap.cc:654] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.368425 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d51c27f1d494f64980afcf1b0f89fff" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:35.369138 11950 raft_consensus.cc:3060] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.378152 12069 tablet_bootstrap.cc:654] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.379066 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d51c27f1d494f64980afcf1b0f89fff" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:35.383697 11876 raft_consensus.cc:3060] T 8d51c27f1d494f64980afcf1b0f89fff P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.395735 12111 consensus_queue.cc:1048] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:35.396883 12118 raft_consensus.cc:515] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:35.398341 11699 catalog_manager.cc:5697] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130). New cstate: current_term: 1 leader_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:35.406759 12118 leader_election.cc:290] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:35.406978 12070 tablet_bootstrap.cc:492] T 1b38c8234f5f433bb73bb44a0950731d P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:35.412828 12070 ts_tablet_manager.cc:1403] T 1b38c8234f5f433bb73bb44a0950731d P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.193s	user 0.015s	sys 0.004s
I20260709 13:18:35.411550 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e185eb05f14f19978919c9f8e5906e" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:35.418330 11801 raft_consensus.cc:3060] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.418849 12070 raft_consensus.cc:359] T 1b38c8234f5f433bb73bb44a0950731d P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.419571 12070 raft_consensus.cc:385] T 1b38c8234f5f433bb73bb44a0950731d P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.431365 12129 raft_consensus.cc:493] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.432459 12068 tablet_bootstrap.cc:654] T bce4185998b54aa3900c8c3e9a09d72c P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.432785 12129 raft_consensus.cc:515] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.435956 12070 raft_consensus.cc:740] T 1b38c8234f5f433bb73bb44a0950731d P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.437129 12070 consensus_queue.cc:260] T 1b38c8234f5f433bb73bb44a0950731d P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.443027 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4646ce4a654acda4a5971dbefc623f" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:35.444970 11875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4646ce4a654acda4a5971dbefc623f" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:35.445637 12070 ts_tablet_manager.cc:1434] T 1b38c8234f5f433bb73bb44a0950731d P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.003s
I20260709 13:18:35.446862 12070 tablet_bootstrap.cc:492] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:35.449219 12129 leader_election.cc:290] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:35.448886 12120 consensus_queue.cc:1048] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:35.449064 11766 leader_election.cc:304] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:35.456127 11876 raft_consensus.cc:2468] T 8d51c27f1d494f64980afcf1b0f89fff P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:35.457037 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e185eb05f14f19978919c9f8e5906e" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:35.457705 12023 raft_consensus.cc:3060] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.463791 12070 tablet_bootstrap.cc:654] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.459455 11950 raft_consensus.cc:2468] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:35.452023 11697 catalog_manager.cc:5697] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:35.460316 11989 leader_election.cc:304] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:35.460497 12129 raft_consensus.cc:2749] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:35.481228 11801 raft_consensus.cc:2468] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:35.482470 12132 raft_consensus.cc:2804] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:35.487457 12072 tablet_bootstrap.cc:492] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:35.483125 12132 raft_consensus.cc:697] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Becoming Leader. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Running, Role: LEADER
I20260709 13:18:35.488354 12072 ts_tablet_manager.cc:1403] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.133s	user 0.008s	sys 0.013s
I20260709 13:18:35.488718 12132 consensus_queue.cc:237] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.483121 11915 leader_election.cc:304] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:35.495611 12069 tablet_bootstrap.cc:492] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:35.496155 12069 ts_tablet_manager.cc:1403] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.148s	user 0.015s	sys 0.018s
I20260709 13:18:35.498239 12152 raft_consensus.cc:2804] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:35.498898 12152 raft_consensus.cc:697] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:35.499826 12152 consensus_queue.cc:237] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:35.505564 12069 raft_consensus.cc:359] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.506383 12069 raft_consensus.cc:385] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.506704 12069 raft_consensus.cc:740] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.507411 12069 consensus_queue.cc:260] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.514799 12069 ts_tablet_manager.cc:1434] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:18:35.515776 12069 tablet_bootstrap.cc:492] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:35.515592 12072 raft_consensus.cc:359] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.516492 12072 raft_consensus.cc:385] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.516775 12072 raft_consensus.cc:740] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.517482 12072 consensus_queue.cc:260] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.517839 12023 raft_consensus.cc:2468] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:35.523087 12072 ts_tablet_manager.cc:1434] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:18:35.524013 12072 tablet_bootstrap.cc:492] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:35.528578 12068 tablet_bootstrap.cc:492] T bce4185998b54aa3900c8c3e9a09d72c P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:35.529349 12068 ts_tablet_manager.cc:1403] T bce4185998b54aa3900c8c3e9a09d72c P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.279s	user 0.010s	sys 0.010s
I20260709 13:18:35.532126 11801 raft_consensus.cc:3060] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.532972 12068 raft_consensus.cc:359] T bce4185998b54aa3900c8c3e9a09d72c P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.532485 11697 catalog_manager.cc:5697] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:35.536099 12068 raft_consensus.cc:385] T bce4185998b54aa3900c8c3e9a09d72c P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.536471 12068 raft_consensus.cc:740] T bce4185998b54aa3900c8c3e9a09d72c P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.538570 12072 tablet_bootstrap.cc:654] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.537477 12068 consensus_queue.cc:260] T bce4185998b54aa3900c8c3e9a09d72c P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.546973 12068 ts_tablet_manager.cc:1434] T bce4185998b54aa3900c8c3e9a09d72c P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.001s
I20260709 13:18:35.548153 12068 tablet_bootstrap.cc:492] T e6bd1a63e0aa46edbdec80ed32e8b876 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:35.558215 11699 catalog_manager.cc:5697] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f7178f720eb4090a3593087331b82e9 (127.1.227.132). New cstate: current_term: 1 leader_uuid: "1f7178f720eb4090a3593087331b82e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:35.561079 12069 tablet_bootstrap.cc:654] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.567503 12068 tablet_bootstrap.cc:654] T e6bd1a63e0aa46edbdec80ed32e8b876 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.568354 12070 tablet_bootstrap.cc:492] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:35.568872 12070 ts_tablet_manager.cc:1403] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.122s	user 0.011s	sys 0.004s
I20260709 13:18:35.572691 12070 raft_consensus.cc:359] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.573397 12070 raft_consensus.cc:385] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.573675 12070 raft_consensus.cc:740] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.580950 12070 consensus_queue.cc:260] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.581453 12068 tablet_bootstrap.cc:492] T e6bd1a63e0aa46edbdec80ed32e8b876 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:35.582067 12068 ts_tablet_manager.cc:1403] T e6bd1a63e0aa46edbdec80ed32e8b876 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.007s
I20260709 13:18:35.583354 12070 ts_tablet_manager.cc:1434] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:18:35.577066 12072 tablet_bootstrap.cc:492] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:35.584396 12072 ts_tablet_manager.cc:1403] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.002s
I20260709 13:18:35.584722 12068 raft_consensus.cc:359] T e6bd1a63e0aa46edbdec80ed32e8b876 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.585445 12068 raft_consensus.cc:385] T e6bd1a63e0aa46edbdec80ed32e8b876 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.585813 12068 raft_consensus.cc:740] T e6bd1a63e0aa46edbdec80ed32e8b876 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.586136 12070 tablet_bootstrap.cc:492] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:35.586515 12068 consensus_queue.cc:260] T e6bd1a63e0aa46edbdec80ed32e8b876 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.588495 12068 ts_tablet_manager.cc:1434] T e6bd1a63e0aa46edbdec80ed32e8b876 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:18:35.575919 12069 tablet_bootstrap.cc:492] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:35.589691 12072 raft_consensus.cc:359] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.590405 12069 ts_tablet_manager.cc:1403] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.003s
I20260709 13:18:35.590608 12072 raft_consensus.cc:385] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.591019 12072 raft_consensus.cc:740] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.591835 12072 consensus_queue.cc:260] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.593261 12068 tablet_bootstrap.cc:492] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:35.594247 12072 ts_tablet_manager.cc:1434] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:18:35.597295 12072 tablet_bootstrap.cc:492] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:35.600102 12140 raft_consensus.cc:493] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.600309 12069 raft_consensus.cc:359] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.601114 12069 raft_consensus.cc:385] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.600807 12140 raft_consensus.cc:515] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.601423 12069 raft_consensus.cc:740] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.602223 12069 consensus_queue.cc:260] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.603394 12140 leader_election.cc:290] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:35.604370 12069 ts_tablet_manager.cc:1434] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:18:35.605400 12069 tablet_bootstrap.cc:492] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:35.605778 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a598cfbb3c457eb5a8c9801d421a01" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:35.606148 11799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a598cfbb3c457eb5a8c9801d421a01" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:35.606606 11948 raft_consensus.cc:2468] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 0.
I20260709 13:18:35.606846 11799 raft_consensus.cc:2468] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 0.
I20260709 13:18:35.607955 12068 tablet_bootstrap.cc:654] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.608074 11841 leader_election.cc:304] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:35.604390 12072 tablet_bootstrap.cc:654] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.610939 12070 tablet_bootstrap.cc:654] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.613669 12132 consensus_queue.cc:1048] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:35.621353 12069 tablet_bootstrap.cc:654] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.623304 12142 raft_consensus.cc:2804] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:35.623843 12142 raft_consensus.cc:493] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.624225 12142 raft_consensus.cc:3060] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.631125 12068 tablet_bootstrap.cc:492] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:35.631717 12068 ts_tablet_manager.cc:1403] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.001s
I20260709 13:18:35.633994 12132 consensus_queue.cc:1048] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:35.634932 12068 raft_consensus.cc:359] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.636029 12068 raft_consensus.cc:385] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.636344 12068 raft_consensus.cc:740] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.637236 12068 consensus_queue.cc:260] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.639909 12068 ts_tablet_manager.cc:1434] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:18:35.646338 12068 tablet_bootstrap.cc:492] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:35.653843 12068 tablet_bootstrap.cc:654] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.652812 12142 raft_consensus.cc:515] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.672360 12069 tablet_bootstrap.cc:492] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:35.672932 12069 ts_tablet_manager.cc:1403] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.015s
I20260709 13:18:35.673343 12142 leader_election.cc:290] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:35.675411 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a598cfbb3c457eb5a8c9801d421a01" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:35.675772 12069 raft_consensus.cc:359] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.684963 12069 raft_consensus.cc:385] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.685315 12069 raft_consensus.cc:740] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.676321 11948 raft_consensus.cc:3060] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.686110 12069 consensus_queue.cc:260] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.687392 12068 tablet_bootstrap.cc:492] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:35.688174 12068 ts_tablet_manager.cc:1403] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.008s
I20260709 13:18:35.688346 12069 ts_tablet_manager.cc:1434] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:18:35.689462 12069 tablet_bootstrap.cc:492] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:35.682279 12070 tablet_bootstrap.cc:492] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:35.682809 12082 consensus_queue.cc:1048] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:35.691696 12070 ts_tablet_manager.cc:1403] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.106s	user 0.009s	sys 0.032s
I20260709 13:18:35.691349 12068 raft_consensus.cc:359] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.692235 12068 raft_consensus.cc:385] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.692603 12068 raft_consensus.cc:740] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.693516 12068 consensus_queue.cc:260] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.695518 12069 tablet_bootstrap.cc:654] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.683635 11799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a598cfbb3c457eb5a8c9801d421a01" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:35.684087 12072 tablet_bootstrap.cc:492] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:35.696396 11799 raft_consensus.cc:3060] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.696537 12072 ts_tablet_manager.cc:1403] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.099s	user 0.007s	sys 0.029s
I20260709 13:18:35.699543 12072 raft_consensus.cc:359] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.700194 12072 raft_consensus.cc:385] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.700455 12072 raft_consensus.cc:740] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.701301 12068 ts_tablet_manager.cc:1434] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:18:35.701119 12072 consensus_queue.cc:260] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.702498 12068 tablet_bootstrap.cc:492] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:35.703430 12072 ts_tablet_manager.cc:1434] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:18:35.704464 12072 tablet_bootstrap.cc:492] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:35.707037 11948 raft_consensus.cc:2468] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:35.708487 11841 leader_election.cc:304] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:35.710644 12068 tablet_bootstrap.cc:654] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.694835 12070 raft_consensus.cc:359] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.712707 12072 tablet_bootstrap.cc:654] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.712778 12070 raft_consensus.cc:385] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.713267 12070 raft_consensus.cc:740] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.714174 12129 raft_consensus.cc:493] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.714653 12140 raft_consensus.cc:2804] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:35.714742 12129 raft_consensus.cc:515] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.715430 12140 raft_consensus.cc:697] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Becoming Leader. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
I20260709 13:18:35.716391 12140 consensus_queue.cc:237] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.716956 12069 tablet_bootstrap.cc:492] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:35.717240 12129 leader_election.cc:290] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:35.717607 12069 ts_tablet_manager.cc:1403] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:18:35.720875 12068 tablet_bootstrap.cc:492] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:35.721606 12068 ts_tablet_manager.cc:1403] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.001s
I20260709 13:18:35.723390 12070 consensus_queue.cc:260] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.725713 12068 raft_consensus.cc:359] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.726819 12068 raft_consensus.cc:385] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.727255 12068 raft_consensus.cc:740] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.734879 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59c45da3f3f43a5b793c3305865da17" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:35.734671 12068 consensus_queue.cc:260] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.736403 11950 raft_consensus.cc:2468] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:35.730067 12070 ts_tablet_manager.cc:1434] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 13:18:35.736884 11875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59c45da3f3f43a5b793c3305865da17" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:35.740003 12068 ts_tablet_manager.cc:1434] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:18:35.741291 12070 tablet_bootstrap.cc:492] T e6bd1a63e0aa46edbdec80ed32e8b876 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:35.742161 11766 leader_election.cc:304] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:35.744274 12069 raft_consensus.cc:359] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.745041 12069 raft_consensus.cc:385] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.745342 12069 raft_consensus.cc:740] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.731060 11799 raft_consensus.cc:2468] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:35.746138 12069 consensus_queue.cc:260] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.748458 12069 ts_tablet_manager.cc:1434] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.000s
I20260709 13:18:35.749423 12069 tablet_bootstrap.cc:492] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:35.750223 12082 raft_consensus.cc:2804] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:35.750662 12082 raft_consensus.cc:493] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.751003 12082 raft_consensus.cc:3060] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.754364 12142 consensus_queue.cc:1048] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:35.753429 11698 catalog_manager.cc:5697] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130). New cstate: current_term: 1 leader_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:35.742298 11875 raft_consensus.cc:2468] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:35.763231 11948 raft_consensus.cc:3060] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.763800 12070 tablet_bootstrap.cc:654] T e6bd1a63e0aa46edbdec80ed32e8b876 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.764601 12082 raft_consensus.cc:515] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.765483 12068 tablet_bootstrap.cc:492] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:35.778008 12069 tablet_bootstrap.cc:654] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.779212 12068 tablet_bootstrap.cc:654] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.780647 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59c45da3f3f43a5b793c3305865da17" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:35.781332 11876 raft_consensus.cc:3060] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.782728 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59c45da3f3f43a5b793c3305865da17" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:35.782923 11949 raft_consensus.cc:3060] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.783349 11950 raft_consensus.cc:3060] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.786722 12068 tablet_bootstrap.cc:492] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:35.788450 12068 ts_tablet_manager.cc:1403] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 13:18:35.788730 12023 raft_consensus.cc:3060] T 1b38c8234f5f433bb73bb44a0950731d P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.791529 12068 raft_consensus.cc:359] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.792336 12068 raft_consensus.cc:385] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.792631 12068 raft_consensus.cc:740] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.793467 12068 consensus_queue.cc:260] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.799937 12068 ts_tablet_manager.cc:1434] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:18:35.799997 11950 raft_consensus.cc:2468] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:35.800998 12068 tablet_bootstrap.cc:492] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:35.802706 12072 tablet_bootstrap.cc:492] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:35.803210 12072 ts_tablet_manager.cc:1403] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.022s
I20260709 13:18:35.803730 12142 consensus_queue.cc:1048] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:35.814500 12082 leader_election.cc:290] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:35.815200 12082 consensus_queue.cc:1048] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:35.819219 12072 raft_consensus.cc:359] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.820043 12072 raft_consensus.cc:385] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.820323 12072 raft_consensus.cc:740] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.825078 11766 leader_election.cc:304] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:35.827253 12082 raft_consensus.cc:2804] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:35.832103 12070 tablet_bootstrap.cc:492] T e6bd1a63e0aa46edbdec80ed32e8b876 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:35.833946 12070 ts_tablet_manager.cc:1403] T e6bd1a63e0aa46edbdec80ed32e8b876 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.003s
I20260709 13:18:35.827854 12082 raft_consensus.cc:697] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:35.834164 12129 raft_consensus.cc:493] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.835106 12082 consensus_queue.cc:237] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.832523 12182 consensus_queue.cc:1048] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:18:35.821188 12072 consensus_queue.cc:260] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.834767 12129 raft_consensus.cc:515] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.844789 12152 raft_consensus.cc:493] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.845378 12152 raft_consensus.cc:515] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.848305 12024 raft_consensus.cc:3060] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.848453 12129 leader_election.cc:290] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:35.850286 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be30dd74fd8242ba879069e4eec26f16" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:35.851641 11875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be30dd74fd8242ba879069e4eec26f16" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
W20260709 13:18:35.853449 11916 leader_election.cc:343] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:35.856062 11915 leader_election.cc:343] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:35.856541 11915 leader_election.cc:304] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:35.857432 12076 raft_consensus.cc:2749] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:35.858237 12152 leader_election.cc:290] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:35.860131 11875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab10d5ae5884d03b62499dd736e479e" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:35.862159 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab10d5ae5884d03b62499dd736e479e" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:35.862738 12070 raft_consensus.cc:359] T e6bd1a63e0aa46edbdec80ed32e8b876 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.863582 12070 raft_consensus.cc:385] T e6bd1a63e0aa46edbdec80ed32e8b876 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.853245 11876 raft_consensus.cc:2468] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:35.863873 12070 raft_consensus.cc:740] T e6bd1a63e0aa46edbdec80ed32e8b876 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
W20260709 13:18:35.863675 11766 leader_election.cc:343] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:35.865274 12072 ts_tablet_manager.cc:1434] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
W20260709 13:18:35.865757 11766 leader_election.cc:343] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:35.866242 11766 leader_election.cc:304] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdbe2261c337471ea4d0c980ebb80c72; no voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:35.866724 12072 tablet_bootstrap.cc:492] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:35.867048 12070 consensus_queue.cc:260] T e6bd1a63e0aa46edbdec80ed32e8b876 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.869333 12070 ts_tablet_manager.cc:1434] T e6bd1a63e0aa46edbdec80ed32e8b876 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.003s
I20260709 13:18:35.870508 12070 tablet_bootstrap.cc:492] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:35.874855 12068 tablet_bootstrap.cc:654] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.877367 12070 tablet_bootstrap.cc:654] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.877367 12072 tablet_bootstrap.cc:654] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.882227 12182 consensus_queue.cc:1048] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:18:35.892432 12068 tablet_bootstrap.cc:492] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:35.893512 12185 raft_consensus.cc:2749] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:35.895115 12068 ts_tablet_manager.cc:1403] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.094s	user 0.014s	sys 0.000s
I20260709 13:18:35.897797 12186 raft_consensus.cc:493] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.898356 12186 raft_consensus.cc:515] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.901021 12069 tablet_bootstrap.cc:492] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:35.901532 12069 ts_tablet_manager.cc:1403] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.152s	user 0.008s	sys 0.004s
I20260709 13:18:35.905311 12068 raft_consensus.cc:359] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.905893 12069 raft_consensus.cc:359] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:35.906478 12068 raft_consensus.cc:385] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.906612 12069 raft_consensus.cc:385] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.906998 12069 raft_consensus.cc:740] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.907770 12069 consensus_queue.cc:260] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:35.906864 12068 raft_consensus.cc:740] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.909345 12068 consensus_queue.cc:260] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:35.911906 12186 leader_election.cc:290] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:35.914561 12069 ts_tablet_manager.cc:1434] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:18:35.916325 12069 tablet_bootstrap.cc:492] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:35.912886 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f1d538ab1446f182128209d64b34be" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:35.919271 12023 raft_consensus.cc:2468] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:35.918756 11698 catalog_manager.cc:5697] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:35.921905 11875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f1d538ab1446f182128209d64b34be" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:35.923273 12072 tablet_bootstrap.cc:492] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:35.923768 12072 ts_tablet_manager.cc:1403] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.057s	user 0.014s	sys 0.003s
I20260709 13:18:35.923923 11767 leader_election.cc:304] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:35.923305 12142 raft_consensus.cc:493] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.925295 12142 raft_consensus.cc:515] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.926663 12072 raft_consensus.cc:359] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.927384 12142 leader_election.cc:290] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:35.927577 12186 raft_consensus.cc:2804] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:35.928025 12186 raft_consensus.cc:493] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.928390 12068 ts_tablet_manager.cc:1434] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:18:35.928364 12186 raft_consensus.cc:3060] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.929673 12068 tablet_bootstrap.cc:492] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:35.930994 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4185998b54aa3900c8c3e9a09d72c" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:35.931831 12023 raft_consensus.cc:2468] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 0.
I20260709 13:18:35.927352 12072 raft_consensus.cc:385] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:35.933141 11842 leader_election.cc:304] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:35.933357 12072 raft_consensus.cc:740] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:35.930922 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4185998b54aa3900c8c3e9a09d72c" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:35.934468 11948 raft_consensus.cc:2468] T bce4185998b54aa3900c8c3e9a09d72c P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 0.
I20260709 13:18:35.934300 12072 consensus_queue.cc:260] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.934930 12142 raft_consensus.cc:2804] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:35.935348 12142 raft_consensus.cc:493] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.935696 12142 raft_consensus.cc:3060] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.936352 12186 raft_consensus.cc:515] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.937762 12072 ts_tablet_manager.cc:1434] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
W20260709 13:18:35.937634 11766 leader_election.cc:343] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:35.940742 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f1d538ab1446f182128209d64b34be" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:35.941355 12023 raft_consensus.cc:3060] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.944783 12072 tablet_bootstrap.cc:492] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:35.948743 12142 raft_consensus.cc:515] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.952138 12069 tablet_bootstrap.cc:654] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.955577 12023 raft_consensus.cc:2468] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:35.956987 11767 leader_election.cc:304] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:35.957912 12185 raft_consensus.cc:2804] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:35.958408 12185 raft_consensus.cc:697] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:35.959206 12185 consensus_queue.cc:237] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:35.961180 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4185998b54aa3900c8c3e9a09d72c" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:35.961877 11948 raft_consensus.cc:3060] T bce4185998b54aa3900c8c3e9a09d72c P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.962376 12068 tablet_bootstrap.cc:654] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.968638 12072 tablet_bootstrap.cc:654] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:35.970809 12142 leader_election.cc:290] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:35.970559 12107 consensus_queue.cc:1048] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:35.969578 11948 raft_consensus.cc:2468] T bce4185998b54aa3900c8c3e9a09d72c P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:35.971971 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce4185998b54aa3900c8c3e9a09d72c" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:35.972471 11841 leader_election.cc:304] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:35.972975 12022 raft_consensus.cc:3060] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:35.973387 12142 raft_consensus.cc:2804] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:35.974215 12142 raft_consensus.cc:697] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Becoming Leader. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
I20260709 13:18:35.975114 12142 consensus_queue.cc:237] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:35.975517 12182 raft_consensus.cc:493] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.976111 12182 raft_consensus.cc:515] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:35.980504 12182 leader_election.cc:290] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:35.980420 12186 leader_election.cc:290] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:35.989967 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095174060bff4a6b8f891f171bb9cd10" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:35.990731 11948 raft_consensus.cc:2468] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:35.995254 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f1d538ab1446f182128209d64b34be" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:35.991180 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095174060bff4a6b8f891f171bb9cd10" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:36.001031 11766 leader_election.cc:304] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:36.003571 12069 tablet_bootstrap.cc:492] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:36.006062 12193 raft_consensus.cc:2804] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:36.006577 12193 raft_consensus.cc:493] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.006397 12152 consensus_queue.cc:1048] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:36.007050 12193 raft_consensus.cc:3060] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.006136 12069 ts_tablet_manager.cc:1403] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.091s	user 0.009s	sys 0.018s
W20260709 13:18:36.009176 11766 leader_election.cc:343] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:36.013652 12022 raft_consensus.cc:2468] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
W20260709 13:18:36.015646 11767 leader_election.cc:343] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:36.021082 12070 tablet_bootstrap.cc:492] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:36.022030 12070 ts_tablet_manager.cc:1403] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.152s	user 0.009s	sys 0.008s
I20260709 13:18:36.024657 12193 raft_consensus.cc:515] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.026063 12069 raft_consensus.cc:359] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:36.027878 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095174060bff4a6b8f891f171bb9cd10" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:36.028542 11950 raft_consensus.cc:3060] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.028519 12193 leader_election.cc:290] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:36.029825 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095174060bff4a6b8f891f171bb9cd10" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:36.030006 12140 raft_consensus.cc:493] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.026834 12069 raft_consensus.cc:385] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.030648 12140 raft_consensus.cc:515] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:36.034051 12140 leader_election.cc:290] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:36.031073 12069 raft_consensus.cc:740] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.043107 12140 raft_consensus.cc:493] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.044338 12069 consensus_queue.cc:260] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:36.045246 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edba2429705947968300245b7a6049e1" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:36.046408 12022 raft_consensus.cc:2468] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 0.
I20260709 13:18:36.046650 12069 ts_tablet_manager.cc:1434] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:18:36.043767 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edba2429705947968300245b7a6049e1" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:36.047755 11801 raft_consensus.cc:2468] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 0.
I20260709 13:18:36.047816 12069 tablet_bootstrap.cc:492] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:36.047955 11950 raft_consensus.cc:2468] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:36.049513 11841 leader_election.cc:304] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:36.049722 11766 leader_election.cc:304] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:36.043743 12140 raft_consensus.cc:515] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:36.051301 12185 raft_consensus.cc:2804] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:36.052321 12185 raft_consensus.cc:697] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:36.051338 12077 raft_consensus.cc:2804] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:36.054342 12077 raft_consensus.cc:493] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.054876 12077 raft_consensus.cc:3060] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.055471 12140 leader_election.cc:290] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:36.057523 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6bd1a63e0aa46edbdec80ed32e8b876" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:36.058466 12022 raft_consensus.cc:2468] T e6bd1a63e0aa46edbdec80ed32e8b876 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 0.
I20260709 13:18:36.062842 11842 leader_election.cc:304] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:36.053680 12185 consensus_queue.cc:237] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.070909 12140 raft_consensus.cc:2804] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:36.071439 12140 raft_consensus.cc:493] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.071868 12140 raft_consensus.cc:3060] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.069125 12152 consensus_queue.cc:1048] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:18:36.078189 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6bd1a63e0aa46edbdec80ed32e8b876" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:36.079089 11950 raft_consensus.cc:2468] T e6bd1a63e0aa46edbdec80ed32e8b876 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 0.
I20260709 13:18:36.099566 12069 tablet_bootstrap.cc:654] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.101327 12070 raft_consensus.cc:359] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.102560 12070 raft_consensus.cc:385] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.103009 12070 raft_consensus.cc:740] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.109447 12068 tablet_bootstrap.cc:492] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:36.110146 12068 ts_tablet_manager.cc:1403] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.181s	user 0.018s	sys 0.002s
I20260709 13:18:36.113306 12068 raft_consensus.cc:359] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:36.114455 12068 raft_consensus.cc:385] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.114888 12068 raft_consensus.cc:740] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.115736 12077 raft_consensus.cc:515] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:36.115931 12068 consensus_queue.cc:260] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:36.121104 12070 consensus_queue.cc:260] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.120669 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edba2429705947968300245b7a6049e1" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:36.124742 12111 consensus_queue.cc:1048] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:36.124965 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edba2429705947968300245b7a6049e1" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:36.125188 11801 raft_consensus.cc:3060] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.125682 12022 raft_consensus.cc:3060] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.120747 11694 catalog_manager.cc:5697] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.130657 12023 raft_consensus.cc:3060] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.114292 12140 raft_consensus.cc:515] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:36.139032 12070 ts_tablet_manager.cc:1434] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.117s	user 0.008s	sys 0.000s
I20260709 13:18:36.140177 12070 tablet_bootstrap.cc:492] T be30dd74fd8242ba879069e4eec26f16 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:36.137784 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6bd1a63e0aa46edbdec80ed32e8b876" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:36.142455 12024 raft_consensus.cc:3060] T e6bd1a63e0aa46edbdec80ed32e8b876 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.144098 12140 leader_election.cc:290] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:36.147915 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6bd1a63e0aa46edbdec80ed32e8b876" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:36.148749 11948 raft_consensus.cc:3060] T e6bd1a63e0aa46edbdec80ed32e8b876 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.147814 11698 catalog_manager.cc:5697] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130). New cstate: current_term: 1 leader_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.149845 12070 tablet_bootstrap.cc:654] T be30dd74fd8242ba879069e4eec26f16 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.150815 12068 ts_tablet_manager.cc:1434] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
I20260709 13:18:36.158494 12068 tablet_bootstrap.cc:492] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:36.163194 12024 raft_consensus.cc:2468] T e6bd1a63e0aa46edbdec80ed32e8b876 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:36.165297 11842 leader_election.cc:304] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:36.166352 12140 raft_consensus.cc:2804] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:36.166934 12140 raft_consensus.cc:697] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Becoming Leader. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
I20260709 13:18:36.167500 11801 raft_consensus.cc:2468] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:36.167886 12140 consensus_queue.cc:237] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:36.169847 11841 leader_election.cc:304] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:36.169513 12077 leader_election.cc:290] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:36.170981 12142 raft_consensus.cc:2804] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:36.171689 12142 raft_consensus.cc:697] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Becoming Leader. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
I20260709 13:18:36.172677 12142 consensus_queue.cc:237] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:36.177450 12068 tablet_bootstrap.cc:654] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.177260 11948 raft_consensus.cc:2468] T e6bd1a63e0aa46edbdec80ed32e8b876 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:36.167845 12023 raft_consensus.cc:2468] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:36.209635 12072 tablet_bootstrap.cc:492] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:36.210284 12072 ts_tablet_manager.cc:1403] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.266s	user 0.020s	sys 0.013s
I20260709 13:18:36.198007 12022 raft_consensus.cc:2468] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:36.222433 12072 raft_consensus.cc:359] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:36.223788 12072 raft_consensus.cc:385] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.224663 12072 raft_consensus.cc:740] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.225967 12072 consensus_queue.cc:260] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:36.230767 12072 ts_tablet_manager.cc:1434] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 13:18:36.232002 12077 consensus_queue.cc:1048] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:36.225021 11697 catalog_manager.cc:5697] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:36.232978 12072 tablet_bootstrap.cc:492] T 5f3910c15d144fd09ea36bd9f5344eef P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:36.237429 12076 raft_consensus.cc:493] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.238039 12076 raft_consensus.cc:515] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:36.240254 12076 leader_election.cc:290] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:36.242090 11799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab10d5ae5884d03b62499dd736e479e" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:36.242425 12069 tablet_bootstrap.cc:492] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:36.242892 12069 ts_tablet_manager.cc:1403] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.195s	user 0.016s	sys 0.012s
I20260709 13:18:36.245160 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab10d5ae5884d03b62499dd736e479e" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:36.245873 12069 raft_consensus.cc:359] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:36.242799 11799 raft_consensus.cc:2468] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 0.
I20260709 13:18:36.246654 12069 raft_consensus.cc:385] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.246975 12069 raft_consensus.cc:740] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.247718 12069 consensus_queue.cc:260] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:36.247797 12072 tablet_bootstrap.cc:654] T 5f3910c15d144fd09ea36bd9f5344eef P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.248003 11915 leader_election.cc:304] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:36.250437 12068 tablet_bootstrap.cc:492] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:36.257941 12068 ts_tablet_manager.cc:1403] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.100s	user 0.020s	sys 0.002s
I20260709 13:18:36.257941 12076 raft_consensus.cc:2804] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:36.259815 12076 raft_consensus.cc:493] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.260229 12076 raft_consensus.cc:3060] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.261263 12068 raft_consensus.cc:359] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.262120 12068 raft_consensus.cc:385] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.262439 12068 raft_consensus.cc:740] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.262512 12077 consensus_queue.cc:1048] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:36.263454 12068 consensus_queue.cc:260] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.255282 12069 ts_tablet_manager.cc:1434] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.001s
I20260709 13:18:36.265820 12068 ts_tablet_manager.cc:1434] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:18:36.266333 12069 tablet_bootstrap.cc:492] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:36.266947 12068 tablet_bootstrap.cc:492] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:36.269011 12076 raft_consensus.cc:515] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:36.273367 12069 tablet_bootstrap.cc:654] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.278350 12068 tablet_bootstrap.cc:654] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:36.278246 11915 leader_election.cc:343] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:36.277915 11696 catalog_manager.cc:5697] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130). New cstate: current_term: 1 leader_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.277845 12076 leader_election.cc:290] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:36.280448 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab10d5ae5884d03b62499dd736e479e" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:36.281265 11801 raft_consensus.cc:3060] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.280359 11696 catalog_manager.cc:5697] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130). New cstate: current_term: 1 leader_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:36.282622 12193 consensus_queue.cc:1048] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:36.284593 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab10d5ae5884d03b62499dd736e479e" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:36.296298 12072 tablet_bootstrap.cc:492] T 5f3910c15d144fd09ea36bd9f5344eef P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:36.296900 12072 ts_tablet_manager.cc:1403] T 5f3910c15d144fd09ea36bd9f5344eef P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.000s
I20260709 13:18:36.297821 12070 tablet_bootstrap.cc:492] T be30dd74fd8242ba879069e4eec26f16 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:36.299098 12070 ts_tablet_manager.cc:1403] T be30dd74fd8242ba879069e4eec26f16 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.159s	user 0.018s	sys 0.000s
I20260709 13:18:36.299985 12072 raft_consensus.cc:359] T 5f3910c15d144fd09ea36bd9f5344eef P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:36.305059 12140 raft_consensus.cc:493] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.309218 12072 raft_consensus.cc:385] T 5f3910c15d144fd09ea36bd9f5344eef P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.309598 12072 raft_consensus.cc:740] T 5f3910c15d144fd09ea36bd9f5344eef P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.309458 12140 raft_consensus.cc:515] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:36.310683 12072 consensus_queue.cc:260] T 5f3910c15d144fd09ea36bd9f5344eef P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:36.312769 12140 leader_election.cc:290] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:36.313074 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be30dd74fd8242ba879069e4eec26f16" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:36.312830 12072 ts_tablet_manager.cc:1434] T 5f3910c15d144fd09ea36bd9f5344eef P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:18:36.313829 11948 raft_consensus.cc:2468] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 0.
I20260709 13:18:36.314815 12072 tablet_bootstrap.cc:492] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:36.315172 11841 leader_election.cc:304] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
W20260709 13:18:36.316671 11915 leader_election.cc:343] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:36.304457 11801 raft_consensus.cc:2468] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:36.317857 12070 raft_consensus.cc:359] T be30dd74fd8242ba879069e4eec26f16 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:36.318575 12070 raft_consensus.cc:385] T be30dd74fd8242ba879069e4eec26f16 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.318722 11915 leader_election.cc:304] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:36.319574 12077 raft_consensus.cc:2804] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:36.320039 12077 raft_consensus.cc:493] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.320434 12077 raft_consensus.cc:3060] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.321895 12118 raft_consensus.cc:493] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.322400 12118 raft_consensus.cc:515] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.324563 12076 raft_consensus.cc:2804] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:36.324644 12118 leader_election.cc:290] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:36.325323 12076 raft_consensus.cc:697] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:36.325584 12070 raft_consensus.cc:740] T be30dd74fd8242ba879069e4eec26f16 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.327229 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd6d52d3b2649de89e331bbb75335a0" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:36.327754 12076 consensus_queue.cc:237] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
W20260709 13:18:36.328882 11916 leader_election.cc:343] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:36.315184 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be30dd74fd8242ba879069e4eec26f16" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:36.336391 12072 tablet_bootstrap.cc:654] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.339591 12077 raft_consensus.cc:515] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:36.346899 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd6d52d3b2649de89e331bbb75335a0" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:36.347263 12068 tablet_bootstrap.cc:492] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:36.350751 12068 ts_tablet_manager.cc:1403] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.084s	user 0.018s	sys 0.009s
I20260709 13:18:36.351626 12070 consensus_queue.cc:260] T be30dd74fd8242ba879069e4eec26f16 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:36.354045 12023 raft_consensus.cc:2468] T be30dd74fd8242ba879069e4eec26f16 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 0.
I20260709 13:18:36.356534 12193 consensus_queue.cc:1048] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:36.363906 12070 ts_tablet_manager.cc:1434] T be30dd74fd8242ba879069e4eec26f16 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
W20260709 13:18:36.364470 11915 leader_election.cc:343] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:36.368394 12070 tablet_bootstrap.cc:492] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:36.372565 12068 raft_consensus.cc:359] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.373450 12068 raft_consensus.cc:385] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.373701 12072 tablet_bootstrap.cc:492] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:36.373725 12068 raft_consensus.cc:740] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.374387 12072 ts_tablet_manager.cc:1403] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.005s
I20260709 13:18:36.375415 12068 consensus_queue.cc:260] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.378203 12072 raft_consensus.cc:359] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:36.378764 12068 ts_tablet_manager.cc:1434] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.004s
I20260709 13:18:36.379004 12072 raft_consensus.cc:385] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.379401 12072 raft_consensus.cc:740] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.380162 12072 consensus_queue.cc:260] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:36.379777 12068 tablet_bootstrap.cc:492] T 653023e6fbaf4ab0869ab68cd9436f6d P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:36.386786 12072 ts_tablet_manager.cc:1434] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:18:36.387719 12072 tablet_bootstrap.cc:492] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
W20260709 13:18:36.375874 11746 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:36.390681 12077 leader_election.cc:290] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:36.392000 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be30dd74fd8242ba879069e4eec26f16" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:36.392688 12023 raft_consensus.cc:3060] T be30dd74fd8242ba879069e4eec26f16 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.393128 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be30dd74fd8242ba879069e4eec26f16" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:36.393729 11950 raft_consensus.cc:3060] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.397324 12072 tablet_bootstrap.cc:654] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.371433 11915 leader_election.cc:304] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:36.412225 12070 tablet_bootstrap.cc:654] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.405567 12077 raft_consensus.cc:493] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.413779 12068 tablet_bootstrap.cc:654] T 653023e6fbaf4ab0869ab68cd9436f6d P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.406473 12076 raft_consensus.cc:2749] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:36.413450 12077 raft_consensus.cc:515] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:36.416625 12077 leader_election.cc:290] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:36.418264 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f1d538ab1446f182128209d64b34be" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:36.419094 12022 raft_consensus.cc:2393] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7283c2ba87e94087b9ac5dcb372c4e1d in current term 1: Already voted for candidate bdbe2261c337471ea4d0c980ebb80c72 in this term.
W20260709 13:18:36.409439 11915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:37961, user_credentials={real_user=slave}} blocked reactor thread for 45062.7us
I20260709 13:18:36.420601 11799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f1d538ab1446f182128209d64b34be" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:36.430395 11950 raft_consensus.cc:2468] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:36.433468 12069 tablet_bootstrap.cc:492] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:36.441951 12069 ts_tablet_manager.cc:1403] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.176s	user 0.020s	sys 0.006s
I20260709 13:18:36.441843 11841 leader_election.cc:304] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:36.443528 11841 leader_election.cc:304] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:36.444401 12077 raft_consensus.cc:3060] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.445474 12140 raft_consensus.cc:2804] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:36.446293 12140 raft_consensus.cc:697] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Becoming Leader. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
I20260709 13:18:36.447425 12140 consensus_queue.cc:237] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:36.453687 12023 raft_consensus.cc:2468] T be30dd74fd8242ba879069e4eec26f16 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:36.452996 12069 raft_consensus.cc:359] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.457754 12069 raft_consensus.cc:385] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.458436 12069 raft_consensus.cc:740] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.460599 12069 consensus_queue.cc:260] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.461720 12077 raft_consensus.cc:2749] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:36.463172 12069 ts_tablet_manager.cc:1434] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:18:36.466100 12072 tablet_bootstrap.cc:492] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:36.466220 12069 tablet_bootstrap.cc:492] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:36.466634 12072 ts_tablet_manager.cc:1403] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.000s
I20260709 13:18:36.470109 12072 raft_consensus.cc:359] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:36.470997 12072 raft_consensus.cc:385] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.469987 11699 catalog_manager.cc:5697] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:36.471288 12072 raft_consensus.cc:740] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.472843 12072 consensus_queue.cc:260] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:36.478878 12068 tablet_bootstrap.cc:492] T 653023e6fbaf4ab0869ab68cd9436f6d P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:36.479696 12068 ts_tablet_manager.cc:1403] T 653023e6fbaf4ab0869ab68cd9436f6d P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.100s	user 0.029s	sys 0.027s
I20260709 13:18:36.483564 12068 raft_consensus.cc:359] T 653023e6fbaf4ab0869ab68cd9436f6d P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:36.491077 12070 tablet_bootstrap.cc:492] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:36.491114 12068 raft_consensus.cc:385] T 653023e6fbaf4ab0869ab68cd9436f6d P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.491621 12070 ts_tablet_manager.cc:1403] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.124s	user 0.015s	sys 0.013s
I20260709 13:18:36.491776 12068 raft_consensus.cc:740] T 653023e6fbaf4ab0869ab68cd9436f6d P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.492080 12072 ts_tablet_manager.cc:1434] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:18:36.493003 12072 tablet_bootstrap.cc:492] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:36.492652 12068 consensus_queue.cc:260] T 653023e6fbaf4ab0869ab68cd9436f6d P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:36.494817 12068 ts_tablet_manager.cc:1434] T 653023e6fbaf4ab0869ab68cd9436f6d P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:18:36.494678 12070 raft_consensus.cc:359] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.495075 12069 tablet_bootstrap.cc:654] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.495434 12070 raft_consensus.cc:385] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.504050 12212 consensus_queue.cc:1048] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:36.504688 12072 tablet_bootstrap.cc:654] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.504649 12070 raft_consensus.cc:740] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.495802 12068 tablet_bootstrap.cc:492] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:36.505645 12070 consensus_queue.cc:260] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.507989 12070 ts_tablet_manager.cc:1434] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:18:36.511495 12070 tablet_bootstrap.cc:492] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:36.512423 12069 tablet_bootstrap.cc:492] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:36.512987 12069 ts_tablet_manager.cc:1403] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.047s	user 0.004s	sys 0.009s
I20260709 13:18:36.513216 12068 tablet_bootstrap.cc:654] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.515928 12069 raft_consensus.cc:359] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:36.519666 12069 raft_consensus.cc:385] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.520177 12069 raft_consensus.cc:740] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.519205 12072 tablet_bootstrap.cc:492] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:36.521415 12072 ts_tablet_manager.cc:1403] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.002s
I20260709 13:18:36.524343 12140 raft_consensus.cc:493] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.524871 12068 tablet_bootstrap.cc:492] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:36.524835 12140 raft_consensus.cc:515] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:36.525506 12068 ts_tablet_manager.cc:1403] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.003s
I20260709 13:18:36.525406 12069 consensus_queue.cc:260] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:36.528283 12069 ts_tablet_manager.cc:1434] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.005s
I20260709 13:18:36.528811 12186 consensus_queue.cc:1048] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:36.530640 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653023e6fbaf4ab0869ab68cd9436f6d" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:36.530961 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653023e6fbaf4ab0869ab68cd9436f6d" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:36.529522 12072 raft_consensus.cc:359] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:36.531330 11950 raft_consensus.cc:2468] T 653023e6fbaf4ab0869ab68cd9436f6d P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 0.
I20260709 13:18:36.531347 12068 raft_consensus.cc:359] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.532603 12068 raft_consensus.cc:385] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.532909 12068 raft_consensus.cc:740] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.532760 11841 leader_election.cc:304] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:36.531672 12072 raft_consensus.cc:385] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.529832 12140 leader_election.cc:290] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:36.533962 12072 raft_consensus.cc:740] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.534068 12212 raft_consensus.cc:2804] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:36.534559 12212 raft_consensus.cc:493] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.534929 12212 raft_consensus.cc:3060] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.534747 12072 consensus_queue.cc:260] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:36.536675 12070 tablet_bootstrap.cc:654] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.537032 12072 ts_tablet_manager.cc:1434] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:18:36.538137 12072 tablet_bootstrap.cc:492] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
W20260709 13:18:36.539111 11842 leader_election.cc:343] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:36.540035 12069 tablet_bootstrap.cc:492] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:36.538183 11699 catalog_manager.cc:5697] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130). New cstate: current_term: 1 leader_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.546149 12068 consensus_queue.cc:260] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.548511 12072 tablet_bootstrap.cc:654] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.555313 12068 ts_tablet_manager.cc:1434] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:18:36.556406 12068 tablet_bootstrap.cc:492] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:36.556560 12142 consensus_queue.cc:1048] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:36.564487 12068 tablet_bootstrap.cc:654] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.569303 12182 consensus_queue.cc:1048] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:36.578140 12182 consensus_queue.cc:1048] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:36.549173 12070 tablet_bootstrap.cc:492] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:36.550014 12186 raft_consensus.cc:493] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.552743 12069 tablet_bootstrap.cc:654] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.586705 12186 raft_consensus.cc:515] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.589260 12186 leader_election.cc:290] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:36.590027 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd6d52d3b2649de89e331bbb75335a0" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:36.590327 12068 tablet_bootstrap.cc:492] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:36.590775 11949 raft_consensus.cc:2468] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:36.591092 12068 ts_tablet_manager.cc:1403] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.011s
I20260709 13:18:36.590317 12070 ts_tablet_manager.cc:1403] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.079s	user 0.015s	sys 0.004s
I20260709 13:18:36.592530 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd6d52d3b2649de89e331bbb75335a0" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:36.593055 11766 leader_election.cc:304] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:36.593487 12023 raft_consensus.cc:2468] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:36.596725 12193 raft_consensus.cc:2804] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:36.597154 12193 raft_consensus.cc:493] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.597494 12193 raft_consensus.cc:3060] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.603217 12068 raft_consensus.cc:359] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:36.604105 12068 raft_consensus.cc:385] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.604411 12068 raft_consensus.cc:740] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.605269 12068 consensus_queue.cc:260] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:36.607441 12068 ts_tablet_manager.cc:1434] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:18:36.595193 12070 raft_consensus.cc:359] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:36.609476 12070 raft_consensus.cc:385] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.609869 12070 raft_consensus.cc:740] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.610440 12193 raft_consensus.cc:515] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.610795 12070 consensus_queue.cc:260] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:36.573514 12212 raft_consensus.cc:515] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:36.631179 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd6d52d3b2649de89e331bbb75335a0" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:36.631903 12023 raft_consensus.cc:3060] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.633857 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653023e6fbaf4ab0869ab68cd9436f6d" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:36.634012 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653023e6fbaf4ab0869ab68cd9436f6d" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:36.634578 11947 raft_consensus.cc:3060] T 653023e6fbaf4ab0869ab68cd9436f6d P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:36.635604 11842 leader_election.cc:343] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:36.627457 12068 tablet_bootstrap.cc:492] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:36.622821 12186 raft_consensus.cc:493] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.615422 12076 raft_consensus.cc:493] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.630748 12193 leader_election.cc:290] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:36.638430 12186 raft_consensus.cc:515] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:36.640694 12070 ts_tablet_manager.cc:1434] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:18:36.641152 12186 leader_election.cc:290] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:36.638031 12212 leader_election.cc:290] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:36.642660 12070 tablet_bootstrap.cc:492] T 653023e6fbaf4ab0869ab68cd9436f6d P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:36.642777 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f5eb834fe84f7cadb173cc0fc58b2f" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:36.643447 12024 raft_consensus.cc:2468] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:36.644516 11767 leader_election.cc:304] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:36.644865 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f5eb834fe84f7cadb173cc0fc58b2f" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:36.645414 12186 raft_consensus.cc:2804] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:36.645814 12186 raft_consensus.cc:493] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.646242 12186 raft_consensus.cc:3060] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.645879 12076 raft_consensus.cc:515] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
W20260709 13:18:36.646459 11766 leader_election.cc:343] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:36.648718 12076 leader_election.cc:290] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:36.614740 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd6d52d3b2649de89e331bbb75335a0" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:36.650195 12070 tablet_bootstrap.cc:654] T 653023e6fbaf4ab0869ab68cd9436f6d P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.650460 11949 raft_consensus.cc:3060] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.651377 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3910c15d144fd09ea36bd9f5344eef" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:36.652046 11876 raft_consensus.cc:2468] T 5f3910c15d144fd09ea36bd9f5344eef P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 0.
I20260709 13:18:36.653354 11915 leader_election.cc:304] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:36.657142 11947 raft_consensus.cc:2468] T 653023e6fbaf4ab0869ab68cd9436f6d P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:36.657541 11799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3910c15d144fd09ea36bd9f5344eef" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:36.659250 12212 consensus_queue.cc:1048] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:36.661949 12193 consensus_queue.cc:1048] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:36.662683 12118 raft_consensus.cc:2804] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:36.668524 12118 raft_consensus.cc:493] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.669046 12118 raft_consensus.cc:3060] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.664438 12069 tablet_bootstrap.cc:492] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:36.666136 11799 raft_consensus.cc:2468] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 0.
I20260709 13:18:36.676411 12069 ts_tablet_manager.cc:1403] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.137s	user 0.010s	sys 0.006s
I20260709 13:18:36.678265 12068 tablet_bootstrap.cc:654] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.678982 12069 raft_consensus.cc:359] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.679644 12069 raft_consensus.cc:385] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.679898 12069 raft_consensus.cc:740] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.680217 12072 tablet_bootstrap.cc:492] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:36.680740 12072 ts_tablet_manager.cc:1403] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.143s	user 0.012s	sys 0.019s
I20260709 13:18:36.680667 12069 consensus_queue.cc:260] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.683148 12069 ts_tablet_manager.cc:1434] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:18:36.684078 12069 tablet_bootstrap.cc:492] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:36.684643 12072 raft_consensus.cc:359] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:36.687323 12072 raft_consensus.cc:385] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.688505 11841 leader_election.cc:304] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:36.687652 12072 raft_consensus.cc:740] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.691215 12077 raft_consensus.cc:2804] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:36.695050 12077 raft_consensus.cc:697] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Becoming Leader. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
I20260709 13:18:36.695948 12077 consensus_queue.cc:237] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:36.699004 11949 raft_consensus.cc:2468] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:36.693327 12072 consensus_queue.cc:260] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:36.703159 12072 ts_tablet_manager.cc:1434] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 13:18:36.710537 12118 raft_consensus.cc:515] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:36.712749 12118 leader_election.cc:290] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:36.716398 12212 consensus_queue.cc:1048] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:36.717975 12186 raft_consensus.cc:515] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:36.721060 12069 tablet_bootstrap.cc:654] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.725160 12186 leader_election.cc:290] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:36.726496 11766 leader_election.cc:304] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:36.726833 12023 raft_consensus.cc:2468] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:36.736161 12072 tablet_bootstrap.cc:492] T 78f88cc1e70b4b88986a3ff6b79770f7 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:36.730012 12140 consensus_queue.cc:1048] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:18:36.732309 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3910c15d144fd09ea36bd9f5344eef" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:36.729800 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f5eb834fe84f7cadb173cc0fc58b2f" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:36.743160 12186 raft_consensus.cc:2804] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:36.759589 12186 raft_consensus.cc:697] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:36.757566 12019 raft_consensus.cc:3060] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.761252 12186 consensus_queue.cc:237] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.757589 11876 raft_consensus.cc:3060] T 5f3910c15d144fd09ea36bd9f5344eef P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.771487 12072 tablet_bootstrap.cc:654] T 78f88cc1e70b4b88986a3ff6b79770f7 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.772166 11875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f5eb834fe84f7cadb173cc0fc58b2f" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:36.772971 11875 raft_consensus.cc:3060] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.779107 11799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3910c15d144fd09ea36bd9f5344eef" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:36.780171 11799 raft_consensus.cc:3060] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.793329 12070 tablet_bootstrap.cc:492] T 653023e6fbaf4ab0869ab68cd9436f6d P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:36.793960 12070 ts_tablet_manager.cc:1403] T 653023e6fbaf4ab0869ab68cd9436f6d P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.152s	user 0.022s	sys 0.014s
I20260709 13:18:36.794363 12068 tablet_bootstrap.cc:492] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:36.795099 12068 ts_tablet_manager.cc:1403] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.187s	user 0.014s	sys 0.048s
I20260709 13:18:36.809456 11875 raft_consensus.cc:2468] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:36.792682 12077 raft_consensus.cc:493] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.811956 12142 raft_consensus.cc:493] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.818306 12142 raft_consensus.cc:515] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:36.812053 12077 raft_consensus.cc:515] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:36.827675 12077 leader_election.cc:290] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:36.822367 12068 raft_consensus.cc:359] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:36.792219 12118 raft_consensus.cc:493] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.834291 12076 raft_consensus.cc:493] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.835587 12068 raft_consensus.cc:385] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.821419 12142 leader_election.cc:290] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:36.837697 12068 raft_consensus.cc:740] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.847831 12068 consensus_queue.cc:260] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:36.836630 11874 raft_consensus.cc:3060] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.847710 12076 raft_consensus.cc:515] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.863065 12072 tablet_bootstrap.cc:492] T 78f88cc1e70b4b88986a3ff6b79770f7 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:36.862787 12070 raft_consensus.cc:359] T 653023e6fbaf4ab0869ab68cd9436f6d P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:36.863432 12076 leader_election.cc:290] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:36.863592 12072 ts_tablet_manager.cc:1403] T 78f88cc1e70b4b88986a3ff6b79770f7 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.014s
I20260709 13:18:36.863651 12070 raft_consensus.cc:385] T 653023e6fbaf4ab0869ab68cd9436f6d P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.864377 12070 raft_consensus.cc:740] T 653023e6fbaf4ab0869ab68cd9436f6d P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:36.866348 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df332d97fcd742e3b0f2024da1850b81" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:36.866835 12072 raft_consensus.cc:359] T 78f88cc1e70b4b88986a3ff6b79770f7 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:36.867597 12072 raft_consensus.cc:385] T 78f88cc1e70b4b88986a3ff6b79770f7 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:36.867861 12072 raft_consensus.cc:740] T 78f88cc1e70b4b88986a3ff6b79770f7 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
W20260709 13:18:36.868094 11916 leader_election.cc:343] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:36.868497 12072 consensus_queue.cc:260] T 78f88cc1e70b4b88986a3ff6b79770f7 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:36.865332 12070 consensus_queue.cc:260] T 653023e6fbaf4ab0869ab68cd9436f6d P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:36.837126 12118 raft_consensus.cc:515] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.874740 11699 catalog_manager.cc:5697] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:36.874040 12076 consensus_queue.cc:1048] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:18:36.871721 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df332d97fcd742e3b0f2024da1850b81" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:36.885594 11766 leader_election.cc:304] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:36.887856 12111 raft_consensus.cc:493] T 653023e6fbaf4ab0869ab68cd9436f6d P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.891745 12111 raft_consensus.cc:515] T 653023e6fbaf4ab0869ab68cd9436f6d P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:36.888134 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7991b50605d0412aa1b3b5e79de17e01" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:36.895222 12182 raft_consensus.cc:2804] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:36.895800 12182 raft_consensus.cc:697] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:36.896687 12182 consensus_queue.cc:237] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
W20260709 13:18:36.893496 11915 leader_election.cc:343] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:36.898910 12077 consensus_queue.cc:1048] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:36.899931 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab10d5ae5884d03b62499dd736e479e" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:36.902281 11798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7991b50605d0412aa1b3b5e79de17e01" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:36.903043 11797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab10d5ae5884d03b62499dd736e479e" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:36.904672 12111 leader_election.cc:290] T 653023e6fbaf4ab0869ab68cd9436f6d P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:36.907060 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653023e6fbaf4ab0869ab68cd9436f6d" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:36.907939 11949 raft_consensus.cc:2393] T 653023e6fbaf4ab0869ab68cd9436f6d P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f7178f720eb4090a3593087331b82e9 in current term 1: Already voted for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in this term.
I20260709 13:18:36.910071 12193 raft_consensus.cc:493] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.910605 12193 raft_consensus.cc:515] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:36.911561 11876 raft_consensus.cc:2468] T 5f3910c15d144fd09ea36bd9f5344eef P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:36.898850 11915 leader_election.cc:304] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:36.912714 12193 leader_election.cc:290] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:36.913162 12076 raft_consensus.cc:2749] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:36.876085 12068 ts_tablet_manager.cc:1434] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.081s	user 0.002s	sys 0.009s
I20260709 13:18:36.914961 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9288763b344f2fb95940d6a0ce7bcd" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:36.915051 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9288763b344f2fb95940d6a0ce7bcd" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:36.915758 12068 tablet_bootstrap.cc:492] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:36.920488 12072 ts_tablet_manager.cc:1434] T 78f88cc1e70b4b88986a3ff6b79770f7 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.001s
I20260709 13:18:36.921963 11949 raft_consensus.cc:2468] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:36.924635 12118 leader_election.cc:290] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:36.925904 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9288763b344f2fb95940d6a0ce7bcd" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
W20260709 13:18:36.928368 11916 leader_election.cc:343] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:36.929801 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9288763b344f2fb95940d6a0ce7bcd" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
W20260709 13:18:36.925971 11767 leader_election.cc:343] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:36.933338 11799 raft_consensus.cc:2468] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
W20260709 13:18:36.932235 11842 leader_election.cc:343] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:36.926741 12068 tablet_bootstrap.cc:654] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:36.935598 11766 leader_election.cc:304] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:36.929875 12019 raft_consensus.cc:2468] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:36.937085 11801 raft_consensus.cc:2468] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 0.
I20260709 13:18:36.937680 12072 tablet_bootstrap.cc:492] T d53b944cce3847bb8f603d0c64c6ae28 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:36.938118 12070 ts_tablet_manager.cc:1434] T 653023e6fbaf4ab0869ab68cd9436f6d P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.144s	user 0.007s	sys 0.001s
I20260709 13:18:36.947613 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "653023e6fbaf4ab0869ab68cd9436f6d" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:36.960446 12070 tablet_bootstrap.cc:492] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
W20260709 13:18:36.959679 11841 leader_election.cc:343] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:36.973351 12069 tablet_bootstrap.cc:492] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:36.974128 12069 ts_tablet_manager.cc:1403] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.290s	user 0.033s	sys 0.034s
I20260709 13:18:36.967155 12185 raft_consensus.cc:2804] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:36.975620 12185 raft_consensus.cc:493] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.975625 11915 leader_election.cc:304] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:36.976155 12185 raft_consensus.cc:3060] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.976866 12118 raft_consensus.cc:2804] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:36.977542 12118 raft_consensus.cc:697] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:36.987929 11915 leader_election.cc:304] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:36.990792 12076 raft_consensus.cc:2804] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:36.991271 12076 raft_consensus.cc:493] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.991647 12076 raft_consensus.cc:3060] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:36.992182 11841 leader_election.cc:304] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
W20260709 13:18:36.993304 11841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:37961, user_credentials={real_user=slave}} blocked reactor thread for 49900.6us
I20260709 13:18:36.991660 12118 consensus_queue.cc:237] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.005332 12069 raft_consensus.cc:359] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.006068 12120 raft_consensus.cc:493] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.006181 12069 raft_consensus.cc:385] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.006639 12069 raft_consensus.cc:740] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.006743 12120 raft_consensus.cc:515] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.007493 12140 raft_consensus.cc:2749] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:37.008502 12069 consensus_queue.cc:260] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.008688 12076 raft_consensus.cc:515] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.009070 12120 leader_election.cc:290] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:36.946990 11694 catalog_manager.cc:5697] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130). New cstate: current_term: 1 leader_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:37.013846 12069 ts_tablet_manager.cc:1434] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:18:37.014971 12069 tablet_bootstrap.cc:492] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:37.015414 12140 consensus_queue.cc:1048] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:37.016959 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f88cc1e70b4b88986a3ff6b79770f7" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:37.017647 11801 raft_consensus.cc:2468] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 0.
I20260709 13:18:37.015693 11841 leader_election.cc:304] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:37.018909 11915 leader_election.cc:304] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:37.021448 12120 raft_consensus.cc:2804] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:37.021880 12120 raft_consensus.cc:493] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.021267 11697 catalog_manager.cc:5697] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:37.022225 12120 raft_consensus.cc:3060] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:37.024200 12248 raft_consensus.cc:2749] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:37.010468 12185 raft_consensus.cc:515] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.030016 12069 tablet_bootstrap.cc:654] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.036626 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9288763b344f2fb95940d6a0ce7bcd" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
W20260709 13:18:37.038480 11916 leader_election.cc:343] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:37.050065 12070 tablet_bootstrap.cc:654] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.051712 12072 tablet_bootstrap.cc:654] T d53b944cce3847bb8f603d0c64c6ae28 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.038807 12118 consensus_queue.cc:1048] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:18:37.062804 11989 leader_election.cc:304] T 653023e6fbaf4ab0869ab68cd9436f6d P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:37.064350 12111 raft_consensus.cc:3060] T 653023e6fbaf4ab0869ab68cd9436f6d P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:37.054472 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9288763b344f2fb95940d6a0ce7bcd" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:37.066375 11948 raft_consensus.cc:2393] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bdbe2261c337471ea4d0c980ebb80c72 in current term 1: Already voted for candidate 04f862d1b8824d7a81daa0cad52c5843 in this term.
I20260709 13:18:37.067750 12069 tablet_bootstrap.cc:492] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:37.068296 12069 ts_tablet_manager.cc:1403] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.001s
I20260709 13:18:37.074304 12111 raft_consensus.cc:2749] T 653023e6fbaf4ab0869ab68cd9436f6d P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:37.074398 12069 raft_consensus.cc:359] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:37.076683 12069 raft_consensus.cc:385] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.077040 12069 raft_consensus.cc:740] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.079686 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f88cc1e70b4b88986a3ff6b79770f7" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:37.075656 12120 raft_consensus.cc:515] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.080503 11876 raft_consensus.cc:2468] T 78f88cc1e70b4b88986a3ff6b79770f7 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 0.
I20260709 13:18:37.082033 12120 leader_election.cc:290] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:37.081934 12069 consensus_queue.cc:260] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:37.083557 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f88cc1e70b4b88986a3ff6b79770f7" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:37.084161 11801 raft_consensus.cc:3060] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:37.084568 12069 ts_tablet_manager.cc:1434] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:18:37.089052 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9288763b344f2fb95940d6a0ce7bcd" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:37.090363 12068 tablet_bootstrap.cc:492] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:37.090945 12068 ts_tablet_manager.cc:1403] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.175s	user 0.010s	sys 0.016s
I20260709 13:18:37.081897 12185 leader_election.cc:290] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:37.096501 11801 raft_consensus.cc:2468] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:37.097442 12069 tablet_bootstrap.cc:492] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
W20260709 13:18:37.091679 11767 leader_election.cc:343] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:37.099706 11767 leader_election.cc:304] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdbe2261c337471ea4d0c980ebb80c72; no voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:37.101073 12186 raft_consensus.cc:2749] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:37.102289 12072 tablet_bootstrap.cc:492] T d53b944cce3847bb8f603d0c64c6ae28 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:37.102847 12072 ts_tablet_manager.cc:1403] T d53b944cce3847bb8f603d0c64c6ae28 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.166s	user 0.009s	sys 0.007s
I20260709 13:18:37.102895 12068 raft_consensus.cc:359] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.102953 12077 consensus_queue.cc:1048] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:37.104274 12068 raft_consensus.cc:385] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.104383 11915 leader_election.cc:304] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:37.104732 12068 raft_consensus.cc:740] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.105645 12068 consensus_queue.cc:260] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.106624 12120 raft_consensus.cc:2804] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:37.107431 12120 raft_consensus.cc:697] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:37.108330 12068 ts_tablet_manager.cc:1434] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 13:18:37.109570 12068 tablet_bootstrap.cc:492] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
W20260709 13:18:37.114681 12250 log.cc:927] Time spent T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72: Append to log took a long time: real 0.135s	user 0.000s	sys 0.005s
I20260709 13:18:37.114880 12072 raft_consensus.cc:359] T d53b944cce3847bb8f603d0c64c6ae28 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:37.115940 12072 raft_consensus.cc:385] T d53b944cce3847bb8f603d0c64c6ae28 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.116191 12076 leader_election.cc:290] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:37.116271 12072 raft_consensus.cc:740] T d53b944cce3847bb8f603d0c64c6ae28 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.117259 12072 consensus_queue.cc:260] T d53b944cce3847bb8f603d0c64c6ae28 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:37.118696 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9288763b344f2fb95940d6a0ce7bcd" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:37.119467 11800 raft_consensus.cc:2393] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 04f862d1b8824d7a81daa0cad52c5843 in current term 1: Already voted for candidate bdbe2261c337471ea4d0c980ebb80c72 in this term.
I20260709 13:18:37.119918 12072 ts_tablet_manager.cc:1434] T d53b944cce3847bb8f603d0c64c6ae28 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:18:37.121079 12072 tablet_bootstrap.cc:492] T 5595bb972e3e4574a1df19295132c9ae P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:37.121248 11915 leader_election.cc:304] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:37.123157 12068 tablet_bootstrap.cc:654] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.123579 12118 raft_consensus.cc:2749] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:37.129052 12072 tablet_bootstrap.cc:654] T 5595bb972e3e4574a1df19295132c9ae P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.141181 11874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f88cc1e70b4b88986a3ff6b79770f7" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:37.141978 11874 raft_consensus.cc:3060] T 78f88cc1e70b4b88986a3ff6b79770f7 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:37.108361 12120 consensus_queue.cc:237] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.147985 12069 tablet_bootstrap.cc:654] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.151363 12070 tablet_bootstrap.cc:492] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:37.151881 12070 ts_tablet_manager.cc:1403] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.192s	user 0.007s	sys 0.014s
I20260709 13:18:37.168540 11874 raft_consensus.cc:2468] T 78f88cc1e70b4b88986a3ff6b79770f7 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:37.179606 12256 raft_consensus.cc:493] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.180205 12256 raft_consensus.cc:515] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:37.183094 12256 leader_election.cc:290] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:37.184656 12070 raft_consensus.cc:359] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:37.185989 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53b944cce3847bb8f603d0c64c6ae28" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
W20260709 13:18:37.187901 11916 leader_election.cc:343] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:37.185580 12070 raft_consensus.cc:385] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.189560 12070 raft_consensus.cc:740] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.191905 12068 tablet_bootstrap.cc:492] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:37.192497 12068 ts_tablet_manager.cc:1403] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.083s	user 0.030s	sys 0.029s
I20260709 13:18:37.192807 12248 consensus_queue.cc:1048] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:37.196662 12068 raft_consensus.cc:359] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:37.197549 12068 raft_consensus.cc:385] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.197984 12068 raft_consensus.cc:740] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.199287 12068 consensus_queue.cc:260] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:37.202495 12068 ts_tablet_manager.cc:1434] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:18:37.203800 12068 tablet_bootstrap.cc:492] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:37.203558 12070 consensus_queue.cc:260] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:37.207110 12069 tablet_bootstrap.cc:492] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:37.207695 12069 ts_tablet_manager.cc:1403] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.116s	user 0.008s	sys 0.009s
I20260709 13:18:37.209658 12186 consensus_queue.cc:1048] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:37.211140 12068 tablet_bootstrap.cc:654] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.211721 11694 catalog_manager.cc:5697] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.218290 12185 raft_consensus.cc:493] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.219121 12185 raft_consensus.cc:515] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:37.222664 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7991b50605d0412aa1b3b5e79de17e01" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:37.223194 12185 leader_election.cc:290] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:37.223385 12019 raft_consensus.cc:2468] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:37.224838 11767 leader_election.cc:304] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:37.224275 11694 catalog_manager.cc:5697] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.225855 12185 raft_consensus.cc:2804] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:37.226315 12185 raft_consensus.cc:493] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.226764 12185 raft_consensus.cc:3060] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:37.228929 12072 tablet_bootstrap.cc:492] T 5595bb972e3e4574a1df19295132c9ae P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:37.229516 12072 ts_tablet_manager.cc:1403] T 5595bb972e3e4574a1df19295132c9ae P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.109s	user 0.015s	sys 0.000s
I20260709 13:18:37.230021 12068 tablet_bootstrap.cc:492] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:37.230602 12068 ts_tablet_manager.cc:1403] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.000s
I20260709 13:18:37.223843 12070 ts_tablet_manager.cc:1434] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 13:18:37.236706 11874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53b944cce3847bb8f603d0c64c6ae28" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:37.237692 12070 tablet_bootstrap.cc:492] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:37.237758 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7991b50605d0412aa1b3b5e79de17e01" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:37.238395 12182 consensus_queue.cc:1048] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:37.244464 12070 tablet_bootstrap.cc:654] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.248042 12069 raft_consensus.cc:359] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.248795 12069 raft_consensus.cc:385] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.249068 12069 raft_consensus.cc:740] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.238816 11874 raft_consensus.cc:2468] T d53b944cce3847bb8f603d0c64c6ae28 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 0.
I20260709 13:18:37.239713 12185 raft_consensus.cc:515] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:37.253767 11876 raft_consensus.cc:2468] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:37.249698 12069 consensus_queue.cc:260] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.259792 11915 leader_election.cc:304] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:37.262022 12069 ts_tablet_manager.cc:1434] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:18:37.268504 12069 tablet_bootstrap.cc:492] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:37.271704 12256 raft_consensus.cc:493] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.272333 12256 raft_consensus.cc:515] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.266497 12076 raft_consensus.cc:2804] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:37.276336 12077 consensus_queue.cc:1048] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:37.277753 12068 raft_consensus.cc:359] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.281487 12068 raft_consensus.cc:385] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.281708 12068 raft_consensus.cc:740] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.274802 12256 leader_election.cc:290] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:37.283383 12069 tablet_bootstrap.cc:654] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.278522 12072 raft_consensus.cc:359] T 5595bb972e3e4574a1df19295132c9ae P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.282714 12068 consensus_queue.cc:260] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.287977 12072 raft_consensus.cc:385] T 5595bb972e3e4574a1df19295132c9ae P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.288583 12072 raft_consensus.cc:740] T 5595bb972e3e4574a1df19295132c9ae P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.289324 12072 consensus_queue.cc:260] T 5595bb972e3e4574a1df19295132c9ae P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.276865 12076 raft_consensus.cc:493] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.290397 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5595bb972e3e4574a1df19295132c9ae" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:37.296656 12076 raft_consensus.cc:3060] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:37.292162 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7991b50605d0412aa1b3b5e79de17e01" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:37.299718 12024 raft_consensus.cc:3060] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:37.302639 12068 ts_tablet_manager.cc:1434] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 13:18:37.303830 12256 raft_consensus.cc:493] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.304334 12256 raft_consensus.cc:515] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
W20260709 13:18:37.305979 11915 leader_election.cc:343] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:37.306759 12256 leader_election.cc:290] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:37.308058 12024 raft_consensus.cc:2468] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:37.309414 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4758afc104744a481a25b59661b80fe" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
W20260709 13:18:37.315459 11915 leader_election.cc:343] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:37.323176 12072 ts_tablet_manager.cc:1434] T 5595bb972e3e4574a1df19295132c9ae P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.093s	user 0.006s	sys 0.000s
I20260709 13:18:37.324777 12072 tablet_bootstrap.cc:492] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:37.290488 12185 leader_election.cc:290] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:37.341924 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4758afc104744a481a25b59661b80fe" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:37.351439 11767 leader_election.cc:304] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
W20260709 13:18:37.358906 11916 leader_election.cc:343] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:37.359748 11916 leader_election.cc:304] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:37.361532 12256 raft_consensus.cc:2749] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:37.369462 12068 tablet_bootstrap.cc:492] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:37.356057 12185 raft_consensus.cc:2804] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:37.389647 12185 raft_consensus.cc:697] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:37.390645 12185 consensus_queue.cc:237] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:37.388978 12076 raft_consensus.cc:515] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:37.396090 12076 leader_election.cc:290] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:37.409226 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7991b50605d0412aa1b3b5e79de17e01" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:37.412222 12186 consensus_queue.cc:1048] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:18:37.409226 11874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5595bb972e3e4574a1df19295132c9ae" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:37.415344 11873 raft_consensus.cc:3060] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:37.414764 12068 tablet_bootstrap.cc:654] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.431377 11874 raft_consensus.cc:2468] T 5595bb972e3e4574a1df19295132c9ae P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 0.
I20260709 13:18:37.436931 11873 raft_consensus.cc:2468] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:37.447100 12076 raft_consensus.cc:493] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.447870 12076 raft_consensus.cc:515] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:37.452970 12069 tablet_bootstrap.cc:492] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:37.453519 12069 ts_tablet_manager.cc:1403] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.185s	user 0.048s	sys 0.078s
W20260709 13:18:37.440977 11989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:37961, user_credentials={real_user=slave}} blocked reactor thread for 79315.1us
I20260709 13:18:37.468740 12069 raft_consensus.cc:359] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.469519 12072 tablet_bootstrap.cc:654] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.469707 12069 raft_consensus.cc:385] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.470227 12069 raft_consensus.cc:740] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.470919 12070 tablet_bootstrap.cc:492] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:37.471485 12070 ts_tablet_manager.cc:1403] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.234s	user 0.017s	sys 0.045s
I20260709 13:18:37.471304 12069 consensus_queue.cc:260] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.473121 12069 ts_tablet_manager.cc:1434] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.002s
I20260709 13:18:37.475052 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53b944cce3847bb8f603d0c64c6ae28" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
W20260709 13:18:37.476723 11916 leader_election.cc:343] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:37.474547 12070 raft_consensus.cc:359] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.477756 12070 raft_consensus.cc:385] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.478083 12070 raft_consensus.cc:740] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.478967 12070 consensus_queue.cc:260] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.479415 12076 leader_election.cc:290] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:37.481231 12070 ts_tablet_manager.cc:1434] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:18:37.482241 12070 tablet_bootstrap.cc:492] T d53b944cce3847bb8f603d0c64c6ae28 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:37.489470 12069 tablet_bootstrap.cc:492] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:37.495154 12070 tablet_bootstrap.cc:654] T d53b944cce3847bb8f603d0c64c6ae28 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.500200 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55421cf4fed64db6bb366de566968fd9" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:37.502565 12068 tablet_bootstrap.cc:492] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:37.503084 12068 ts_tablet_manager.cc:1403] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.134s	user 0.040s	sys 0.004s
W20260709 13:18:37.503748 11916 leader_election.cc:343] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:37.509809 12068 raft_consensus.cc:359] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.512471 12068 raft_consensus.cc:385] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.512759 12068 raft_consensus.cc:740] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.518175 12068 consensus_queue.cc:260] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.519892 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53b944cce3847bb8f603d0c64c6ae28" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:37.520553 11873 raft_consensus.cc:3060] T d53b944cce3847bb8f603d0c64c6ae28 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:37.521106 12186 consensus_queue.cc:1048] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:37.523628 12068 ts_tablet_manager.cc:1434] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:18:37.524717 12068 tablet_bootstrap.cc:492] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:37.527276 12069 tablet_bootstrap.cc:654] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.528015 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55421cf4fed64db6bb366de566968fd9" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:37.528855 11694 catalog_manager.cc:5697] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:37.531275 11915 leader_election.cc:304] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:37.532248 12256 raft_consensus.cc:2804] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:37.532616 12256 raft_consensus.cc:493] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.532927 12256 raft_consensus.cc:3060] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:37.536448 12072 tablet_bootstrap.cc:492] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:37.538182 12072 ts_tablet_manager.cc:1403] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.214s	user 0.020s	sys 0.004s
I20260709 13:18:37.540380 12256 raft_consensus.cc:515] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.542585 12076 consensus_queue.cc:1048] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:37.544450 12256 leader_election.cc:290] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:37.551944 11873 raft_consensus.cc:2468] T d53b944cce3847bb8f603d0c64c6ae28 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
W20260709 13:18:37.542726 11915 leader_election.cc:343] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:37.572009 11915 leader_election.cc:304] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d
W20260709 13:18:37.557904 11746 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:37.560138 12068 tablet_bootstrap.cc:654] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.541477 12072 raft_consensus.cc:359] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:37.581162 12072 raft_consensus.cc:385] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.582576 12072 raft_consensus.cc:740] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.583252 12072 consensus_queue.cc:260] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:37.584925 12072 ts_tablet_manager.cc:1434] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.000s
I20260709 13:18:37.585764 12072 tablet_bootstrap.cc:492] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
W20260709 13:18:37.587538 11915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:43333, user_credentials={real_user=slave}} blocked reactor thread for 44843us
I20260709 13:18:37.574923 12076 raft_consensus.cc:2749] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:37.604112 12072 tablet_bootstrap.cc:654] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.623607 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5595bb972e3e4574a1df19295132c9ae" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:37.624390 11801 raft_consensus.cc:3060] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:37.627251 12069 tablet_bootstrap.cc:492] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:37.633414 11915 leader_election.cc:304] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:37.633939 12069 ts_tablet_manager.cc:1403] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.145s	user 0.030s	sys 0.019s
I20260709 13:18:37.634479 12256 raft_consensus.cc:2804] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:37.634994 12256 raft_consensus.cc:697] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:37.635805 12256 consensus_queue.cc:237] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:37.641937 12070 tablet_bootstrap.cc:492] T d53b944cce3847bb8f603d0c64c6ae28 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:37.642462 12070 ts_tablet_manager.cc:1403] T d53b944cce3847bb8f603d0c64c6ae28 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.160s	user 0.020s	sys 0.026s
I20260709 13:18:37.642292 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5595bb972e3e4574a1df19295132c9ae" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:37.643064 11873 raft_consensus.cc:3060] T 5595bb972e3e4574a1df19295132c9ae P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:37.644882 11801 raft_consensus.cc:2468] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:37.645109 12070 raft_consensus.cc:359] T d53b944cce3847bb8f603d0c64c6ae28 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:37.650353 12069 raft_consensus.cc:359] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.663154 12069 raft_consensus.cc:385] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.663480 12069 raft_consensus.cc:740] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.664417 12069 consensus_queue.cc:260] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.657675 11915 leader_election.cc:304] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:37.657318 12076 consensus_queue.cc:1048] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:18:37.668525 12076 raft_consensus.cc:2804] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:37.669052 12076 raft_consensus.cc:697] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:37.669903 12076 consensus_queue.cc:237] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.675945 12069 ts_tablet_manager.cc:1434] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:18:37.662724 12070 raft_consensus.cc:385] T d53b944cce3847bb8f603d0c64c6ae28 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.676863 12070 raft_consensus.cc:740] T d53b944cce3847bb8f603d0c64c6ae28 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.676563 11694 catalog_manager.cc:5697] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:37.677611 12070 consensus_queue.cc:260] T d53b944cce3847bb8f603d0c64c6ae28 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:37.679064 11873 raft_consensus.cc:2468] T 5595bb972e3e4574a1df19295132c9ae P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:37.680682 12256 consensus_queue.cc:1048] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:37.687582 12193 raft_consensus.cc:493] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.688134 12193 raft_consensus.cc:515] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.692102 12185 raft_consensus.cc:493] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.692803 12185 raft_consensus.cc:515] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.695508 12185 leader_election.cc:290] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:37.698899 12069 tablet_bootstrap.cc:492] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:37.700819 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df332d97fcd742e3b0f2024da1850b81" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:37.702658 12193 leader_election.cc:290] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
W20260709 13:18:37.704447 11767 leader_election.cc:343] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:37.679708 12070 ts_tablet_manager.cc:1434] T d53b944cce3847bb8f603d0c64c6ae28 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.000s
I20260709 13:18:37.712122 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b7a6ebef9c43598294f430c70b2fb5" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:37.713872 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df332d97fcd742e3b0f2024da1850b81" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:37.714509 11948 raft_consensus.cc:2468] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
W20260709 13:18:37.715507 11766 leader_election.cc:343] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:37.716437 11766 leader_election.cc:304] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:37.718282 12185 raft_consensus.cc:2804] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:37.718730 12185 raft_consensus.cc:493] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.718986 12070 tablet_bootstrap.cc:492] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:37.719069 12185 raft_consensus.cc:3060] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:37.726399 12070 tablet_bootstrap.cc:654] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.730446 12185 raft_consensus.cc:515] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.733685 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df332d97fcd742e3b0f2024da1850b81" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:37.734418 11948 raft_consensus.cc:3060] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:37.741178 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b7a6ebef9c43598294f430c70b2fb5" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:37.741607 12069 tablet_bootstrap.cc:654] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.744704 11948 raft_consensus.cc:2468] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:37.747632 11766 leader_election.cc:304] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:37.748750 12193 raft_consensus.cc:2804] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:18:37.750870 11766 leader_election.cc:343] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:37.751441 11766 leader_election.cc:304] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdbe2261c337471ea4d0c980ebb80c72; no voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:37.753355 12182 raft_consensus.cc:2749] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:37.754647 12193 raft_consensus.cc:697] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:37.756290 12069 tablet_bootstrap.cc:492] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:37.755970 12193 consensus_queue.cc:237] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.756805 12069 ts_tablet_manager.cc:1403] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.058s	user 0.007s	sys 0.008s
I20260709 13:18:37.760542 12185 leader_election.cc:290] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:37.761222 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df332d97fcd742e3b0f2024da1850b81" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
W20260709 13:18:37.767416 11767 leader_election.cc:343] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:37.759764 12069 raft_consensus.cc:359] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.771158 12070 tablet_bootstrap.cc:492] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:37.771706 12070 ts_tablet_manager.cc:1403] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.000s
I20260709 13:18:37.774708 12070 raft_consensus.cc:359] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.775590 12070 raft_consensus.cc:385] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.775925 12070 raft_consensus.cc:740] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.769435 12069 raft_consensus.cc:385] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.776921 12069 raft_consensus.cc:740] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.777237 12256 consensus_queue.cc:1048] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:37.777760 12069 consensus_queue.cc:260] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.778910 12070 consensus_queue.cc:260] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.789242 12072 tablet_bootstrap.cc:492] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:37.789896 12072 ts_tablet_manager.cc:1403] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.204s	user 0.030s	sys 0.028s
I20260709 13:18:37.792059 12069 ts_tablet_manager.cc:1434] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:18:37.793107 12069 tablet_bootstrap.cc:492] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:37.795630 12068 tablet_bootstrap.cc:492] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:37.796141 12068 ts_tablet_manager.cc:1403] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.272s	user 0.043s	sys 0.015s
I20260709 13:18:37.802899 12068 raft_consensus.cc:359] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.803639 12068 raft_consensus.cc:385] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.803900 12068 raft_consensus.cc:740] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.804565 12068 consensus_queue.cc:260] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.792712 12072 raft_consensus.cc:359] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:37.806125 12072 raft_consensus.cc:385] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.806249 12256 raft_consensus.cc:493] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.806448 12072 raft_consensus.cc:740] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.806883 12256 raft_consensus.cc:515] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.807590 12070 ts_tablet_manager.cc:1434] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:18:37.808235 12273 raft_consensus.cc:493] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.808715 12273 raft_consensus.cc:515] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.809160 12256 leader_election.cc:290] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:37.810235 12072 consensus_queue.cc:260] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:37.812386 12072 ts_tablet_manager.cc:1434] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.001s
I20260709 13:18:37.813344 12072 tablet_bootstrap.cc:492] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:37.813253 12273 leader_election.cc:290] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:37.814795 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df332d97fcd742e3b0f2024da1850b81" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:37.815598 11949 raft_consensus.cc:2393] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f7178f720eb4090a3593087331b82e9 in current term 1: Already voted for candidate bdbe2261c337471ea4d0c980ebb80c72 in this term.
I20260709 13:18:37.815442 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea431ab44bd54c398da2f3469ac6685a" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:37.817504 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea431ab44bd54c398da2f3469ac6685a" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:37.818022 12070 tablet_bootstrap.cc:492] T ea431ab44bd54c398da2f3469ac6685a P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:37.818828 12068 ts_tablet_manager.cc:1434] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
W20260709 13:18:37.819005 11916 leader_election.cc:343] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:37.819831 12068 tablet_bootstrap.cc:492] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:37.820084 11799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df332d97fcd742e3b0f2024da1850b81" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:37.816099 11800 raft_consensus.cc:2468] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 0.
I20260709 13:18:37.821655 11989 leader_election.cc:304] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:37.822312 11915 leader_election.cc:304] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:37.822809 12273 raft_consensus.cc:3060] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:37.823508 12256 raft_consensus.cc:2804] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:37.823911 12070 tablet_bootstrap.cc:654] T ea431ab44bd54c398da2f3469ac6685a P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.828410 12072 tablet_bootstrap.cc:654] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.823992 12256 raft_consensus.cc:493] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.829123 12256 raft_consensus.cc:3060] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:37.833232 12068 tablet_bootstrap.cc:654] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.836582 12069 tablet_bootstrap.cc:654] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.836632 12273 raft_consensus.cc:2749] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:37.851177 12256 raft_consensus.cc:515] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.852895 12248 raft_consensus.cc:493] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.854162 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea431ab44bd54c398da2f3469ac6685a" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
W20260709 13:18:37.855635 11916 leader_election.cc:343] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:37.853601 12248 raft_consensus.cc:515] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:37.864199 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea431ab44bd54c398da2f3469ac6685a" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:37.864912 11801 raft_consensus.cc:3060] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:37.867188 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55421cf4fed64db6bb366de566968fd9" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:37.867137 11699 catalog_manager.cc:5697] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.874218 12070 tablet_bootstrap.cc:492] T ea431ab44bd54c398da2f3469ac6685a P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
W20260709 13:18:37.871201 11842 leader_election.cc:343] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:37.870467 12256 leader_election.cc:290] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:37.874794 12070 ts_tablet_manager.cc:1403] T ea431ab44bd54c398da2f3469ac6685a P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.003s
I20260709 13:18:37.877415 11801 raft_consensus.cc:2468] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:37.879173 11915 leader_election.cc:304] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:37.879962 12256 raft_consensus.cc:2804] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:37.880486 12290 raft_consensus.cc:493] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.880693 12256 raft_consensus.cc:697] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:37.881134 12290 raft_consensus.cc:515] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.881633 12256 consensus_queue.cc:237] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.885800 12070 raft_consensus.cc:359] T ea431ab44bd54c398da2f3469ac6685a P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.886610 12070 raft_consensus.cc:385] T ea431ab44bd54c398da2f3469ac6685a P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.886963 12070 raft_consensus.cc:740] T ea431ab44bd54c398da2f3469ac6685a P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.890087 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55421cf4fed64db6bb366de566968fd9" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:37.892817 11948 raft_consensus.cc:2468] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 0.
I20260709 13:18:37.890699 12273 raft_consensus.cc:493] T d53b944cce3847bb8f603d0c64c6ae28 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.867268 12248 leader_election.cc:290] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:37.893927 12273 raft_consensus.cc:515] T d53b944cce3847bb8f603d0c64c6ae28 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:37.886952 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b7a6ebef9c43598294f430c70b2fb5" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:37.895252 11801 raft_consensus.cc:2468] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 0.
I20260709 13:18:37.896256 12273 leader_election.cc:290] T d53b944cce3847bb8f603d0c64c6ae28 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:37.898789 12290 leader_election.cc:290] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:37.900051 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53b944cce3847bb8f603d0c64c6ae28" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:37.902683 11915 leader_election.cc:304] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:37.898636 12193 consensus_queue.cc:1048] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:37.905247 12290 raft_consensus.cc:2804] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:37.905634 12290 raft_consensus.cc:493] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.906015 12290 raft_consensus.cc:3060] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:37.909420 12072 tablet_bootstrap.cc:492] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:37.909969 12072 ts_tablet_manager.cc:1403] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.097s	user 0.018s	sys 0.028s
I20260709 13:18:37.912833 12072 raft_consensus.cc:359] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.913494 12072 raft_consensus.cc:385] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.914291 12290 raft_consensus.cc:515] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.915720 12068 tablet_bootstrap.cc:492] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:37.916213 12068 ts_tablet_manager.cc:1403] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.097s	user 0.033s	sys 0.011s
I20260709 13:18:37.916307 12290 leader_election.cc:290] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:37.918835 12068 raft_consensus.cc:359] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.919488 12068 raft_consensus.cc:385] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.919745 12068 raft_consensus.cc:740] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.920564 12068 consensus_queue.cc:260] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.922206 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b7a6ebef9c43598294f430c70b2fb5" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:37.922763 12068 ts_tablet_manager.cc:1434] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:18:37.923012 11801 raft_consensus.cc:3060] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:37.923718 12068 tablet_bootstrap.cc:492] T ab5a46f525fd42468f042b3d38985f42 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:37.926335 12072 raft_consensus.cc:740] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.927260 12072 consensus_queue.cc:260] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:37.931510 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b7a6ebef9c43598294f430c70b2fb5" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:37.936785 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b7a6ebef9c43598294f430c70b2fb5" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:37.938346 12072 ts_tablet_manager.cc:1434] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.006s
I20260709 13:18:37.939337 12072 tablet_bootstrap.cc:492] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:37.937697 11694 catalog_manager.cc:5697] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.943995 11841 leader_election.cc:304] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:37.944890 12248 raft_consensus.cc:2804] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:37.944818 12193 consensus_queue.cc:1048] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:37.945550 12248 raft_consensus.cc:493] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.946008 12248 raft_consensus.cc:3060] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:37.946909 12072 tablet_bootstrap.cc:654] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.947158 12069 tablet_bootstrap.cc:492] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:37.954119 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53b944cce3847bb8f603d0c64c6ae28" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:37.955090 12069 ts_tablet_manager.cc:1403] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.162s	user 0.007s	sys 0.009s
I20260709 13:18:37.955947 12068 tablet_bootstrap.cc:654] T ab5a46f525fd42468f042b3d38985f42 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:37.956380 12273 raft_consensus.cc:493] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.956923 12273 raft_consensus.cc:515] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.959309 12273 leader_election.cc:290] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
W20260709 13:18:37.959339 11915 leader_election.cc:343] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:37.960899 12070 consensus_queue.cc:260] T ea431ab44bd54c398da2f3469ac6685a P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:37.962325 11799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9288763b344f2fb95940d6a0ce7bcd" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
W20260709 13:18:37.962414 11915 leader_election.cc:343] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:37.963239 11799 raft_consensus.cc:2393] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f7178f720eb4090a3593087331b82e9 in current term 1: Already voted for candidate bdbe2261c337471ea4d0c980ebb80c72 in this term.
I20260709 13:18:37.966912 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9288763b344f2fb95940d6a0ce7bcd" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:37.967389 11801 raft_consensus.cc:2468] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:37.967751 11948 raft_consensus.cc:2393] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f7178f720eb4090a3593087331b82e9 in current term 1: Already voted for candidate 04f862d1b8824d7a81daa0cad52c5843 in this term.
I20260709 13:18:37.966849 12070 ts_tablet_manager.cc:1434] T ea431ab44bd54c398da2f3469ac6685a P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.000s
I20260709 13:18:37.970094 12070 tablet_bootstrap.cc:492] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:37.960395 11873 raft_consensus.cc:2393] T d53b944cce3847bb8f603d0c64c6ae28 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f7178f720eb4090a3593087331b82e9 in current term 1: Already voted for candidate 04f862d1b8824d7a81daa0cad52c5843 in this term.
I20260709 13:18:37.971585 12069 raft_consensus.cc:359] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:37.973683 12069 raft_consensus.cc:385] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:37.974045 12069 raft_consensus.cc:740] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:37.974766 12069 consensus_queue.cc:260] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:37.971148 11915 leader_election.cc:304] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:38.002318 12273 raft_consensus.cc:493] T ea431ab44bd54c398da2f3469ac6685a P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.005856 12069 ts_tablet_manager.cc:1434] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:18:38.008502 12069 tablet_bootstrap.cc:492] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:37.994503 11989 leader_election.cc:304] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:37.995390 12248 raft_consensus.cc:515] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:38.006959 12273 raft_consensus.cc:515] T ea431ab44bd54c398da2f3469ac6685a P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:38.013568 12273 leader_election.cc:290] T ea431ab44bd54c398da2f3469ac6685a P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:38.023089 11989 leader_election.cc:304] T d53b944cce3847bb8f603d0c64c6ae28 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:38.022787 11698 catalog_manager.cc:5697] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.009073 12256 raft_consensus.cc:2804] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:38.023540 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea431ab44bd54c398da2f3469ac6685a" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:38.035331 11801 raft_consensus.cc:2393] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f7178f720eb4090a3593087331b82e9 in current term 1: Already voted for candidate 04f862d1b8824d7a81daa0cad52c5843 in this term.
I20260709 13:18:38.017001 12273 raft_consensus.cc:3060] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:38.037202 12068 tablet_bootstrap.cc:492] T ab5a46f525fd42468f042b3d38985f42 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:38.038091 12068 ts_tablet_manager.cc:1403] T ab5a46f525fd42468f042b3d38985f42 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.115s	user 0.011s	sys 0.016s
I20260709 13:18:38.029470 12111 raft_consensus.cc:3060] T d53b944cce3847bb8f603d0c64c6ae28 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:38.041523 12256 raft_consensus.cc:697] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:38.043426 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea431ab44bd54c398da2f3469ac6685a" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:38.044390 12256 consensus_queue.cc:237] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:38.045365 11989 leader_election.cc:304] T ea431ab44bd54c398da2f3469ac6685a P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:38.052199 12072 tablet_bootstrap.cc:492] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:38.052863 12072 ts_tablet_manager.cc:1403] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.114s	user 0.009s	sys 0.020s
I20260709 13:18:38.055986 12072 raft_consensus.cc:359] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:38.056710 12072 raft_consensus.cc:385] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.056461 12068 raft_consensus.cc:359] T ab5a46f525fd42468f042b3d38985f42 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:38.057067 12072 raft_consensus.cc:740] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.057248 12068 raft_consensus.cc:385] T ab5a46f525fd42468f042b3d38985f42 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.057600 12068 raft_consensus.cc:740] T ab5a46f525fd42468f042b3d38985f42 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.058713 12072 consensus_queue.cc:260] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:38.058862 12068 consensus_queue.cc:260] T ab5a46f525fd42468f042b3d38985f42 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:38.062894 12068 ts_tablet_manager.cc:1434] T ab5a46f525fd42468f042b3d38985f42 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.024s	user 0.001s	sys 0.004s
I20260709 13:18:38.063748 12304 raft_consensus.cc:3060] T ea431ab44bd54c398da2f3469ac6685a P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:38.067286 12111 raft_consensus.cc:2749] T d53b944cce3847bb8f603d0c64c6ae28 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:38.071141 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55421cf4fed64db6bb366de566968fd9" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:38.071830 11948 raft_consensus.cc:3060] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:38.072331 12072 ts_tablet_manager.cc:1434] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:18:38.068121 12069 tablet_bootstrap.cc:654] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:38.067288 12068 tablet_bootstrap.cc:492] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:38.069157 12070 tablet_bootstrap.cc:654] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:38.077099 12072 tablet_bootstrap.cc:492] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:38.105361 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55421cf4fed64db6bb366de566968fd9" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:38.106791 12273 raft_consensus.cc:2749] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:38.118227 11842 leader_election.cc:343] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:38.110558 11948 raft_consensus.cc:2468] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:38.098340 12248 leader_election.cc:290] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:38.151293 12072 tablet_bootstrap.cc:654] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:38.150337 12068 tablet_bootstrap.cc:654] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:38.151031 12300 log.cc:927] Time spent T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:18:38.160873 12069 tablet_bootstrap.cc:492] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:38.161516 12069 ts_tablet_manager.cc:1403] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.154s	user 0.026s	sys 0.010s
I20260709 13:18:38.172036 12256 consensus_queue.cc:1048] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:38.174885 12256 consensus_queue.cc:1048] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:38.176970 12069 raft_consensus.cc:359] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:38.178126 12069 raft_consensus.cc:385] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.178577 12069 raft_consensus.cc:740] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.181440 12069 consensus_queue.cc:260] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:38.183858 12070 tablet_bootstrap.cc:492] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:38.184381 12070 ts_tablet_manager.cc:1403] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.215s	user 0.004s	sys 0.014s
I20260709 13:18:38.194335 12185 consensus_queue.cc:1048] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:38.197396 12304 raft_consensus.cc:2749] T ea431ab44bd54c398da2f3469ac6685a P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:38.212793 11699 catalog_manager.cc:5697] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.216874 12068 tablet_bootstrap.cc:492] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:38.217604 12068 ts_tablet_manager.cc:1403] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.151s	user 0.020s	sys 0.008s
I20260709 13:18:38.221546 12068 raft_consensus.cc:359] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:38.222548 12068 raft_consensus.cc:385] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.222888 12068 raft_consensus.cc:740] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.223802 12068 consensus_queue.cc:260] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:38.227844 12069 ts_tablet_manager.cc:1434] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 13:18:38.228955 12069 tablet_bootstrap.cc:492] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:38.232038 12068 ts_tablet_manager.cc:1434] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:18:38.233294 12068 tablet_bootstrap.cc:492] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:38.237576 12070 raft_consensus.cc:359] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:38.238925 12070 raft_consensus.cc:385] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.239291 12070 raft_consensus.cc:740] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.240337 12070 consensus_queue.cc:260] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:38.243835 12070 ts_tablet_manager.cc:1434] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.001s
I20260709 13:18:38.240420 12254 raft_consensus.cc:493] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.244861 12254 raft_consensus.cc:515] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:38.248385 12254 leader_election.cc:290] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:38.249177 11841 leader_election.cc:304] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:38.251844 12254 raft_consensus.cc:2804] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:38.252336 12070 tablet_bootstrap.cc:492] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:38.252697 12254 raft_consensus.cc:697] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Becoming Leader. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
I20260709 13:18:38.253695 12254 consensus_queue.cc:237] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:38.261003 12185 consensus_queue.cc:1048] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:38.263952 12072 tablet_bootstrap.cc:492] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:38.264745 12072 ts_tablet_manager.cc:1403] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.191s	user 0.017s	sys 0.027s
I20260709 13:18:38.268401 12069 tablet_bootstrap.cc:654] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:38.276193 12182 raft_consensus.cc:493] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.276815 12182 raft_consensus.cc:515] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:38.279050 12182 leader_election.cc:290] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:38.280952 12254 raft_consensus.cc:493] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.285444 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cc9444f841f4d768a714f7462f1cf6e" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:38.287503 12023 raft_consensus.cc:2468] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:38.296627 12068 tablet_bootstrap.cc:654] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:38.296073 11767 leader_election.cc:304] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:38.288882 12254 raft_consensus.cc:515] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:38.305469 12185 raft_consensus.cc:2804] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:38.305975 12185 raft_consensus.cc:493] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.305999 12248 raft_consensus.cc:493] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.306293 12185 raft_consensus.cc:3060] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:38.306679 12248 raft_consensus.cc:515] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:38.307193 12254 leader_election.cc:290] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:38.308113 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25353af0207b4ec1959e0795ded4946c" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:38.308568 12072 raft_consensus.cc:359] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:38.309304 12248 leader_election.cc:290] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:38.309350 12072 raft_consensus.cc:385] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.312027 12072 raft_consensus.cc:740] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.314006 12289 raft_consensus.cc:493] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.314709 12289 raft_consensus.cc:515] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:38.319326 12289 leader_election.cc:290] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:38.319432 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52730cf917140dfaced7ad6cf28f5f7" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
W20260709 13:18:38.310977 11842 leader_election.cc:343] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:38.328744 12185 raft_consensus.cc:515] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
W20260709 13:18:38.323129 11916 leader_election.cc:343] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:38.332124 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cc9444f841f4d768a714f7462f1cf6e" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:38.332949 12022 raft_consensus.cc:3060] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:38.334820 12070 tablet_bootstrap.cc:654] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:38.342381 11796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8e389bf22e48259f4d63c2c12f4713" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:38.324590 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52730cf917140dfaced7ad6cf28f5f7" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:38.324636 12069 tablet_bootstrap.cc:492] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:38.345237 12069 ts_tablet_manager.cc:1403] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.117s	user 0.023s	sys 0.009s
I20260709 13:18:38.350550 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab5a46f525fd42468f042b3d38985f42" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:38.349721 11698 catalog_manager.cc:5697] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130). New cstate: current_term: 1 leader_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.350955 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8e389bf22e48259f4d63c2c12f4713" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:38.351651 11948 raft_consensus.cc:2468] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 0.
W20260709 13:18:38.351893 11915 leader_election.cc:343] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:38.352283 11842 leader_election.cc:343] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:38.352409 11915 leader_election.cc:304] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:38.354475 12022 raft_consensus.cc:2468] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:38.355858 12120 raft_consensus.cc:2749] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:38.362313 11767 leader_election.cc:304] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:38.363528 12318 raft_consensus.cc:2804] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:38.364231 12318 raft_consensus.cc:697] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:38.365319 12318 consensus_queue.cc:237] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:38.360643 12185 leader_election.cc:290] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:38.370416 12072 consensus_queue.cc:260] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:38.372715 12072 ts_tablet_manager.cc:1434] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.108s	user 0.009s	sys 0.000s
I20260709 13:18:38.349028 12069 raft_consensus.cc:359] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:38.375852 12069 raft_consensus.cc:385] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.376179 12069 raft_consensus.cc:740] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.376858 12069 consensus_queue.cc:260] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:38.377688 12120 consensus_queue.cc:1048] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:38.379026 12069 ts_tablet_manager.cc:1434] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:18:38.380062 12069 tablet_bootstrap.cc:492] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:38.386467 11796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25353af0207b4ec1959e0795ded4946c" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:38.389370 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab5a46f525fd42468f042b3d38985f42" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:38.390260 11948 raft_consensus.cc:2468] T ab5a46f525fd42468f042b3d38985f42 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 0.
I20260709 13:18:38.392673 12069 tablet_bootstrap.cc:654] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:38.393667 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cc9444f841f4d768a714f7462f1cf6e" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:38.405368 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cc9444f841f4d768a714f7462f1cf6e" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:38.406138 12289 consensus_queue.cc:1048] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:38.422149 12072 tablet_bootstrap.cc:492] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:38.426990 12070 tablet_bootstrap.cc:492] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:38.427811 12070 ts_tablet_manager.cc:1403] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.176s	user 0.013s	sys 0.008s
I20260709 13:18:38.435253 12070 raft_consensus.cc:359] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:38.435981 12070 raft_consensus.cc:385] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.436266 12070 raft_consensus.cc:740] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.439779 12070 consensus_queue.cc:260] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:38.442006 12070 ts_tablet_manager.cc:1434] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:18:38.445276 12070 tablet_bootstrap.cc:492] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:38.451313 12070 tablet_bootstrap.cc:654] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:38.477655 11766 leader_election.cc:343] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:38.478049 12069 tablet_bootstrap.cc:492] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:38.478849 12069 ts_tablet_manager.cc:1403] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.007s
W20260709 13:18:38.479211 11766 leader_election.cc:343] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:38.479370 12290 consensus_queue.cc:1048] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:38.481973 12290 consensus_queue.cc:1048] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:38.488552 11841 leader_election.cc:343] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:38.494360 12072 tablet_bootstrap.cc:654] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:38.502671 12069 raft_consensus.cc:359] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:38.503476 12069 raft_consensus.cc:385] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.503780 12069 raft_consensus.cc:740] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.506426 12069 consensus_queue.cc:260] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:38.510561 12069 ts_tablet_manager.cc:1434] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.002s
I20260709 13:18:38.511847 12069 tablet_bootstrap.cc:492] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:38.513978 12185 raft_consensus.cc:493] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.514595 12185 raft_consensus.cc:515] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:38.517385 12182 raft_consensus.cc:493] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.517525 12185 leader_election.cc:290] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:38.517927 12182 raft_consensus.cc:515] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:38.520190 12182 leader_election.cc:290] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:38.520277 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4758afc104744a481a25b59661b80fe" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:38.521000 11947 raft_consensus.cc:2468] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:38.523126 11766 leader_election.cc:304] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:38.523985 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8e389bf22e48259f4d63c2c12f4713" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:38.524686 11947 raft_consensus.cc:2468] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:38.524887 12069 tablet_bootstrap.cc:654] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:38.525525 12193 raft_consensus.cc:2804] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:38.525691 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4758afc104744a481a25b59661b80fe" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:38.526033 12193 raft_consensus.cc:493] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.526463 12193 raft_consensus.cc:3060] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:38.527390 11841 leader_election.cc:343] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:38.534268 11698 catalog_manager.cc:5697] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:38.527338 11767 leader_election.cc:343] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:38.536305 12290 consensus_queue.cc:1048] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:38.530882 11841 leader_election.cc:304] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:38.539083 12072 tablet_bootstrap.cc:492] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:38.540182 11766 leader_election.cc:304] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:38.544447 12254 raft_consensus.cc:2749] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:38.546525 12185 raft_consensus.cc:2804] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:38.547154 12185 raft_consensus.cc:493] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.546633 12070 tablet_bootstrap.cc:492] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:38.547763 12185 raft_consensus.cc:3060] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:38.547976 12070 ts_tablet_manager.cc:1403] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.103s	user 0.015s	sys 0.013s
I20260709 13:18:38.549121 12069 tablet_bootstrap.cc:492] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:38.549842 12069 ts_tablet_manager.cc:1403] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.002s
I20260709 13:18:38.550872 12070 raft_consensus.cc:359] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:38.551625 12070 raft_consensus.cc:385] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.551911 12070 raft_consensus.cc:740] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.552670 12070 consensus_queue.cc:260] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:38.554020 12072 ts_tablet_manager.cc:1403] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.180s	user 0.014s	sys 0.000s
I20260709 13:18:38.555477 12070 ts_tablet_manager.cc:1434] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:38.546995 11841 leader_election.cc:304] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:38.545761 12068 tablet_bootstrap.cc:492] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:38.556322 12248 raft_consensus.cc:2804] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:38.556455 12068 ts_tablet_manager.cc:1403] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.323s	user 0.049s	sys 0.051s
I20260709 13:18:38.556757 12248 raft_consensus.cc:493] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.557190 12248 raft_consensus.cc:3060] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:38.563341 12069 raft_consensus.cc:359] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:38.564126 12069 raft_consensus.cc:385] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.564134 12072 raft_consensus.cc:359] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:38.564744 12069 raft_consensus.cc:740] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.565114 12072 raft_consensus.cc:385] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.565420 12072 raft_consensus.cc:740] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.565671 12069 consensus_queue.cc:260] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:38.566308 12068 raft_consensus.cc:359] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:38.565932 12193 raft_consensus.cc:515] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:38.569061 12072 consensus_queue.cc:260] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:38.567041 12068 raft_consensus.cc:385] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.568521 12069 ts_tablet_manager.cc:1434] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:18:38.570142 12068 raft_consensus.cc:740] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.571290 12069 tablet_bootstrap.cc:492] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:38.571194 12068 consensus_queue.cc:260] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:38.572068 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4758afc104744a481a25b59661b80fe" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:38.572785 11947 raft_consensus.cc:3060] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:38.579124 12069 tablet_bootstrap.cc:654] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:38.580736 12072 ts_tablet_manager.cc:1434] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:18:38.581811 12072 tablet_bootstrap.cc:492] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:38.562915 12185 raft_consensus.cc:515] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:38.582731 12193 leader_election.cc:290] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:38.586298 12185 leader_election.cc:290] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:38.590883 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8e389bf22e48259f4d63c2c12f4713" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:38.591763 11948 raft_consensus.cc:3060] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:38.591823 11947 raft_consensus.cc:2468] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:38.573529 12068 ts_tablet_manager.cc:1434] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.001s
I20260709 13:18:38.597674 12068 tablet_bootstrap.cc:492] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:38.605659 11766 leader_election.cc:304] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:38.606264 12069 tablet_bootstrap.cc:492] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:38.606849 12069 ts_tablet_manager.cc:1403] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.013s
I20260709 13:18:38.607738 12185 raft_consensus.cc:2804] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:38.610198 12069 raft_consensus.cc:359] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:38.610894 12069 raft_consensus.cc:385] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.611155 12069 raft_consensus.cc:740] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.611980 12069 consensus_queue.cc:260] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:38.614265 12069 ts_tablet_manager.cc:1434] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:18:38.615218 12069 tablet_bootstrap.cc:492] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:38.617213 12185 raft_consensus.cc:697] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:38.618467 12185 consensus_queue.cc:237] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:38.604151 11948 raft_consensus.cc:2468] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:38.621407 12069 tablet_bootstrap.cc:654] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:38.621547 11766 leader_election.cc:304] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
W20260709 13:18:38.622390 11841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:35995, user_credentials={real_user=slave}} blocked reactor thread for 75475.3us
I20260709 13:18:38.623736 12068 tablet_bootstrap.cc:654] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:38.623556 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4758afc104744a481a25b59661b80fe" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:38.624076 12193 raft_consensus.cc:2804] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:38.624712 12193 raft_consensus.cc:697] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:38.625691 12193 consensus_queue.cc:237] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:38.627049 12022 raft_consensus.cc:3060] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:38.628536 12072 tablet_bootstrap.cc:654] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:38.635962 12182 raft_consensus.cc:493] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.636650 12182 raft_consensus.cc:515] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:38.640795 12182 leader_election.cc:290] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:38.641206 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52730cf917140dfaced7ad6cf28f5f7" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:38.640838 12069 tablet_bootstrap.cc:492] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:38.642684 12069 ts_tablet_manager.cc:1403] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.009s
W20260709 13:18:38.643260 11767 leader_election.cc:343] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:38.645650 12068 tablet_bootstrap.cc:492] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:38.570590 12248 raft_consensus.cc:515] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:38.646044 12069 raft_consensus.cc:359] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:38.648926 12069 raft_consensus.cc:385] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.649255 12069 raft_consensus.cc:740] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.650084 12069 consensus_queue.cc:260] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:38.652748 12069 ts_tablet_manager.cc:1434] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:18:38.653015 12072 tablet_bootstrap.cc:492] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:38.653541 12072 ts_tablet_manager.cc:1403] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.005s
I20260709 13:18:38.645328 12022 raft_consensus.cc:2468] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:38.656386 12069 tablet_bootstrap.cc:492] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:38.645390 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52730cf917140dfaced7ad6cf28f5f7" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:38.658092 11948 raft_consensus.cc:2468] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:38.661687 11766 leader_election.cc:304] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:38.662752 12182 raft_consensus.cc:2804] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:38.663190 12182 raft_consensus.cc:493] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.646298 12068 ts_tablet_manager.cc:1403] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.005s
I20260709 13:18:38.663663 12182 raft_consensus.cc:3060] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:38.669399 12072 raft_consensus.cc:359] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:38.670295 12072 raft_consensus.cc:385] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.670603 12072 raft_consensus.cc:740] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.666584 12068 raft_consensus.cc:359] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:38.671787 12068 raft_consensus.cc:385] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.672108 12068 raft_consensus.cc:740] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.672575 12182 raft_consensus.cc:515] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:38.646804 12070 tablet_bootstrap.cc:492] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:38.673482 12072 consensus_queue.cc:260] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:38.678339 12072 ts_tablet_manager.cc:1434] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
W20260709 13:18:38.678815 11841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:35995, user_credentials={real_user=slave}} blocked reactor thread for 55568.7us
I20260709 13:18:38.676484 12069 tablet_bootstrap.cc:654] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:38.676708 12068 consensus_queue.cc:260] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:38.679314 12182 leader_election.cc:290] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:38.679804 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52730cf917140dfaced7ad6cf28f5f7" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:38.680308 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52730cf917140dfaced7ad6cf28f5f7" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:38.682619 12072 tablet_bootstrap.cc:492] T 56ac6eddb0d84b0f921015c7d71e77a2 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:38.690341 12021 raft_consensus.cc:3060] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:38.691064 12068 ts_tablet_manager.cc:1434] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:18:38.691926 12068 tablet_bootstrap.cc:492] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:38.692858 11948 raft_consensus.cc:3060] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:38.696337 12248 leader_election.cc:290] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:38.696973 11841 leader_election.cc:304] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:38.697888 12248 raft_consensus.cc:2804] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:38.698271 12248 raft_consensus.cc:493] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.698606 12248 raft_consensus.cc:3060] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:38.712982 11767 leader_election.cc:343] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:38.715018 11948 raft_consensus.cc:2468] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:38.714807 12307 consensus_queue.cc:1048] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:38.716264 11766 leader_election.cc:304] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:38.716856 12072 tablet_bootstrap.cc:654] T 56ac6eddb0d84b0f921015c7d71e77a2 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:38.722853 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8e389bf22e48259f4d63c2c12f4713" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:38.723574 11876 raft_consensus.cc:2393] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bdbe2261c337471ea4d0c980ebb80c72 in current term 1: Already voted for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in this term.
I20260709 13:18:38.724282 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8e389bf22e48259f4d63c2c12f4713" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:38.724929 11873 raft_consensus.cc:2393] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdbe2261c337471ea4d0c980ebb80c72 in current term 1: Already voted for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in this term.
I20260709 13:18:38.732009 12254 raft_consensus.cc:493] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.732733 12254 raft_consensus.cc:515] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:38.739830 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8e389bf22e48259f4d63c2c12f4713" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:38.735314 11698 catalog_manager.cc:5697] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.736358 12193 raft_consensus.cc:2804] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:38.753142 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8e389bf22e48259f4d63c2c12f4713" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:38.754822 12254 leader_election.cc:290] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:38.757890 12193 raft_consensus.cc:697] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:38.762547 12193 consensus_queue.cc:237] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:38.768086 12068 tablet_bootstrap.cc:654] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:38.769795 11948 raft_consensus.cc:2393] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7283c2ba87e94087b9ac5dcb372c4e1d in current term 1: Already voted for candidate bdbe2261c337471ea4d0c980ebb80c72 in this term.
I20260709 13:18:38.773306 12070 tablet_bootstrap.cc:654] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:38.774930 12069 tablet_bootstrap.cc:492] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:38.775332 12069 ts_tablet_manager.cc:1403] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.122s	user 0.018s	sys 0.019s
I20260709 13:18:38.778879 11876 raft_consensus.cc:3060] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:38.786238 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b7a6ebef9c43598294f430c70b2fb5" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
W20260709 13:18:38.786850 11746 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:38.780416 12248 raft_consensus.cc:515] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:38.796816 12182 raft_consensus.cc:493] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.807578 11796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b7a6ebef9c43598294f430c70b2fb5" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:38.796656 12273 raft_consensus.cc:493] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7283c2ba87e94087b9ac5dcb372c4e1d)
I20260709 13:18:38.807571 12182 raft_consensus.cc:515] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:38.828276 12273 raft_consensus.cc:515] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:38.843977 12254 raft_consensus.cc:493] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.844250 12248 leader_election.cc:290] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:38.844668 12254 raft_consensus.cc:515] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:38.846954 12254 leader_election.cc:290] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:38.850427 12182 leader_election.cc:290] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:38.851285 12069 raft_consensus.cc:359] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:38.852025 12069 raft_consensus.cc:385] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.852320 12069 raft_consensus.cc:740] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.852679 12273 leader_election.cc:290] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:38.853021 12069 consensus_queue.cc:260] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:38.856446 12069 ts_tablet_manager.cc:1434] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.081s	user 0.003s	sys 0.004s
I20260709 13:18:38.858052 12069 tablet_bootstrap.cc:492] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:38.852047 12068 tablet_bootstrap.cc:492] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:38.861979 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55421cf4fed64db6bb366de566968fd9" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:38.862597 12068 ts_tablet_manager.cc:1403] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.171s	user 0.016s	sys 0.006s
I20260709 13:18:38.862907 11948 raft_consensus.cc:2468] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:38.864601 11989 leader_election.cc:304] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: 
I20260709 13:18:38.865697 12273 raft_consensus.cc:2804] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:38.853794 12070 tablet_bootstrap.cc:492] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:38.866113 12273 raft_consensus.cc:493] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7283c2ba87e94087b9ac5dcb372c4e1d)
I20260709 13:18:38.866530 12273 raft_consensus.cc:3060] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:38.866710 12070 ts_tablet_manager.cc:1403] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.220s	user 0.016s	sys 0.009s
I20260709 13:18:38.874416 12068 raft_consensus.cc:359] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:38.875175 12068 raft_consensus.cc:385] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.875449 12068 raft_consensus.cc:740] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.875530 12072 tablet_bootstrap.cc:492] T 56ac6eddb0d84b0f921015c7d71e77a2 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:38.876138 12072 ts_tablet_manager.cc:1403] T 56ac6eddb0d84b0f921015c7d71e77a2 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.194s	user 0.013s	sys 0.006s
I20260709 13:18:38.875609 12273 raft_consensus.cc:515] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:38.879325 12070 raft_consensus.cc:359] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:38.880376 12072 raft_consensus.cc:359] T 56ac6eddb0d84b0f921015c7d71e77a2 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:38.881002 12070 raft_consensus.cc:385] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.881063 12072 raft_consensus.cc:385] T 56ac6eddb0d84b0f921015c7d71e77a2 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:38.881374 12070 raft_consensus.cc:740] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.881424 12072 raft_consensus.cc:740] T 56ac6eddb0d84b0f921015c7d71e77a2 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:38.881500 12273 leader_election.cc:290] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:38.882431 12072 consensus_queue.cc:260] T 56ac6eddb0d84b0f921015c7d71e77a2 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:38.883574 12068 consensus_queue.cc:260] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:38.884843 12072 ts_tablet_manager.cc:1434] T 56ac6eddb0d84b0f921015c7d71e77a2 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
W20260709 13:18:38.938503 11842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:38909, user_credentials={real_user=slave}} blocked reactor thread for 105449us
W20260709 13:18:38.846974 11841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:37961, user_credentials={real_user=slave}} blocked reactor thread for 65959.9us
I20260709 13:18:38.944039 11841 leader_election.cc:304] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:38.950973 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9288763b344f2fb95940d6a0ce7bcd" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:38.953616 12068 ts_tablet_manager.cc:1434] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.001s
I20260709 13:18:38.956923 12185 raft_consensus.cc:493] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.957267 12072 tablet_bootstrap.cc:492] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:38.956831 12068 tablet_bootstrap.cc:492] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:38.953297 11948 raft_consensus.cc:2468] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:38.962929 12307 raft_consensus.cc:2749] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:38.971068 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cc9444f841f4d768a714f7462f1cf6e" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:38.882936 12069 tablet_bootstrap.cc:654] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:38.976987 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab5a46f525fd42468f042b3d38985f42" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:38.983819 12076 consensus_queue.cc:1048] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:38.985287 11950 raft_consensus.cc:3060] T ab5a46f525fd42468f042b3d38985f42 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:38.977972 12185 raft_consensus.cc:515] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:38.990592 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab5a46f525fd42468f042b3d38985f42" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:38.992622 12185 leader_election.cc:290] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:38.978581 12193 raft_consensus.cc:493] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.981135 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9288763b344f2fb95940d6a0ce7bcd" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:38.994346 12024 raft_consensus.cc:2468] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:38.995959 12193 raft_consensus.cc:515] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:39.004190 12193 leader_election.cc:290] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:38.998368 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55421cf4fed64db6bb366de566968fd9" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:38.885761 12070 consensus_queue.cc:260] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:39.007115 12336 raft_consensus.cc:493] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.014668 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cc9444f841f4d768a714f7462f1cf6e" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:39.019196 12021 raft_consensus.cc:2393] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7283c2ba87e94087b9ac5dcb372c4e1d in current term 1: Already voted for candidate bdbe2261c337471ea4d0c980ebb80c72 in this term.
I20260709 13:18:39.020071 12070 ts_tablet_manager.cc:1434] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.153s	user 0.006s	sys 0.002s
I20260709 13:18:39.008739 12336 raft_consensus.cc:515] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:39.026371 12070 tablet_bootstrap.cc:492] T ab5a46f525fd42468f042b3d38985f42 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:39.026762 12336 leader_election.cc:290] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:39.034258 12304 raft_consensus.cc:493] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.029487 12076 raft_consensus.cc:493] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.035122 12304 raft_consensus.cc:515] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:39.035962 12076 raft_consensus.cc:515] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:39.038096 12304 leader_election.cc:290] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:39.039533 12076 leader_election.cc:290] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:39.044122 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a9704b659947e6988fc29f5296ec73" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:39.041725 12068 tablet_bootstrap.cc:654] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:39.051182 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25353af0207b4ec1959e0795ded4946c" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:39.054845 12021 raft_consensus.cc:2468] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:39.059115 12353 raft_consensus.cc:493] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.059741 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56ac6eddb0d84b0f921015c7d71e77a2" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:39.060202 12353 raft_consensus.cc:515] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:39.060693 11876 raft_consensus.cc:2468] T 56ac6eddb0d84b0f921015c7d71e77a2 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 0.
I20260709 13:18:39.063504 11841 leader_election.cc:304] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
W20260709 13:18:39.065105 11842 leader_election.cc:343] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:39.068810 12307 raft_consensus.cc:2749] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:39.069273 11796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25353af0207b4ec1959e0795ded4946c" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:39.070032 11796 raft_consensus.cc:2468] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 0.
I20260709 13:18:39.070744 12024 raft_consensus.cc:1240] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Rejecting Update request from peer 7283c2ba87e94087b9ac5dcb372c4e1d for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:39.081813 12070 tablet_bootstrap.cc:654] T ab5a46f525fd42468f042b3d38985f42 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:39.082647 12353 leader_election.cc:290] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
W20260709 13:18:39.084481 11842 leader_election.cc:343] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:39.084199 11989 leader_election.cc:304] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:39.086042 12072 tablet_bootstrap.cc:654] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:39.086310 12273 raft_consensus.cc:2804] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:39.086916 12273 raft_consensus.cc:493] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.087329 12273 raft_consensus.cc:3060] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:39.087265 11697 catalog_manager.cc:5697] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.095759 11948 raft_consensus.cc:3060] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.110464 11767 leader_election.cc:304] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:39.111670 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6ff283134a4463af9ad09ed3ac81ce" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:39.112195 12351 raft_consensus.cc:2804] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:39.112610 11949 raft_consensus.cc:2468] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:39.113032 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56ac6eddb0d84b0f921015c7d71e77a2" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:39.112704 12351 raft_consensus.cc:493] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.114897 12351 raft_consensus.cc:3060] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:39.123358 11916 leader_election.cc:343] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:39.123617 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55421cf4fed64db6bb366de566968fd9" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:39.127169 11766 leader_election.cc:304] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:39.129140 12352 raft_consensus.cc:2804] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:39.129814 12352 raft_consensus.cc:493] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.130229 12352 raft_consensus.cc:3060] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:39.092101 11697 catalog_manager.cc:5697] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.133216 11767 leader_election.cc:304] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:39.136165 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a9704b659947e6988fc29f5296ec73" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:39.136935 12185 raft_consensus.cc:2804] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:39.137578 12185 raft_consensus.cc:493] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.138082 12185 raft_consensus.cc:3060] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:39.142197 12318 consensus_queue.cc:1048] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:39.148231 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55421cf4fed64db6bb366de566968fd9" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
W20260709 13:18:39.163048 11767 leader_election.cc:343] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:39.165668 12248 consensus_queue.cc:1059] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:39.168031 12336 raft_consensus.cc:3055] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:39.168664 12336 raft_consensus.cc:740] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
I20260709 13:18:39.170212 12193 consensus_queue.cc:1048] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:39.170073 12336 consensus_queue.cc:260] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:39.172055 12336 raft_consensus.cc:3060] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.175671 11950 raft_consensus.cc:2468] T ab5a46f525fd42468f042b3d38985f42 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:39.198523 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25353af0207b4ec1959e0795ded4946c" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:39.202755 11876 raft_consensus.cc:2468] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 0.
I20260709 13:18:39.207775 11915 leader_election.cc:304] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:39.210678 12068 tablet_bootstrap.cc:492] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:39.211886 12068 ts_tablet_manager.cc:1403] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.256s	user 0.046s	sys 0.030s
I20260709 13:18:39.210862 12256 raft_consensus.cc:2804] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:39.212898 12256 raft_consensus.cc:493] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.214250 12256 raft_consensus.cc:3060] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:39.225028 12353 consensus_queue.cc:1048] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:39.232975 12069 tablet_bootstrap.cc:492] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:39.233777 12069 ts_tablet_manager.cc:1403] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.376s	user 0.017s	sys 0.002s
I20260709 13:18:39.235909 12070 tablet_bootstrap.cc:492] T ab5a46f525fd42468f042b3d38985f42 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:39.236510 12070 ts_tablet_manager.cc:1403] T ab5a46f525fd42468f042b3d38985f42 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.211s	user 0.010s	sys 0.008s
I20260709 13:18:39.240813 12068 raft_consensus.cc:359] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:39.261638 12068 raft_consensus.cc:385] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:39.264364 12068 raft_consensus.cc:740] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:39.232721 12256 raft_consensus.cc:515] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:39.266369 12072 tablet_bootstrap.cc:492] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:39.236583 11948 raft_consensus.cc:2468] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 2.
I20260709 13:18:39.273451 11841 leader_election.cc:304] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:39.275276 11947 raft_consensus.cc:1240] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Rejecting Update request from peer 7283c2ba87e94087b9ac5dcb372c4e1d for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:39.236742 12076 raft_consensus.cc:493] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.239084 11796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a9704b659947e6988fc29f5296ec73" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:39.238497 12353 consensus_queue.cc:1048] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:18:39.288877 12352 raft_consensus.cc:515] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:39.290313 12185 raft_consensus.cc:515] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:39.291783 12352 leader_election.cc:290] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:39.292191 12182 consensus_queue.cc:1048] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:39.293246 12185 leader_election.cc:290] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:39.293999 12072 ts_tablet_manager.cc:1403] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.408s	user 0.015s	sys 0.003s
I20260709 13:18:39.294502 12069 raft_consensus.cc:359] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:39.293939 11796 raft_consensus.cc:2468] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 0.
I20260709 13:18:39.243690 12351 raft_consensus.cc:515] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:39.295390 12069 raft_consensus.cc:385] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:39.296586 12069 raft_consensus.cc:740] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:39.296603 12070 raft_consensus.cc:359] T ab5a46f525fd42468f042b3d38985f42 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:39.282471 12068 consensus_queue.cc:260] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:39.298162 12070 raft_consensus.cc:385] T ab5a46f525fd42468f042b3d38985f42 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:39.236972 12273 raft_consensus.cc:515] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:39.299199 12307 raft_consensus.cc:3060] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:39.300534 12273 leader_election.cc:290] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:39.301385 12351 leader_election.cc:290] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:39.298738 12070 raft_consensus.cc:740] T ab5a46f525fd42468f042b3d38985f42 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:39.303251 12070 consensus_queue.cc:260] T ab5a46f525fd42468f042b3d38985f42 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:39.303557 12072 raft_consensus.cc:359] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:39.304347 12072 raft_consensus.cc:385] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:39.304672 12072 raft_consensus.cc:740] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:39.305236 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25353af0207b4ec1959e0795ded4946c" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:39.309160 12021 raft_consensus.cc:2393] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bdbe2261c337471ea4d0c980ebb80c72 in current term 1: Already voted for candidate 1f7178f720eb4090a3593087331b82e9 in this term.
I20260709 13:18:39.311259 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9288763b344f2fb95940d6a0ce7bcd" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:39.311942 11945 raft_consensus.cc:3060] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.312420 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6ff283134a4463af9ad09ed3ac81ce" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:39.313068 11948 raft_consensus.cc:3060] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:39.319669 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9288763b344f2fb95940d6a0ce7bcd" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:39.320462 12021 raft_consensus.cc:3060] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.322400 11945 raft_consensus.cc:2468] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 2.
I20260709 13:18:39.281268 12076 raft_consensus.cc:515] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:39.327204 12070 ts_tablet_manager.cc:1434] T ab5a46f525fd42468f042b3d38985f42 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.001s
I20260709 13:18:39.306507 12072 consensus_queue.cc:260] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:39.307655 12069 consensus_queue.cc:260] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:39.329615 11948 raft_consensus.cc:2468] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:39.331161 11766 leader_election.cc:304] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
W20260709 13:18:39.330108 11841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:37961, user_credentials={real_user=slave}} blocked reactor thread for 56764.6us
I20260709 13:18:39.341758 11841 leader_election.cc:304] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:39.342260 12352 raft_consensus.cc:2804] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:39.342793 12352 raft_consensus.cc:697] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 2 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:39.343261 12248 raft_consensus.cc:2804] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:39.343693 12248 raft_consensus.cc:493] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.344162 12248 raft_consensus.cc:3060] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:39.343747 12352 consensus_queue.cc:237] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:39.346199 12353 raft_consensus.cc:493] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.339556 12068 ts_tablet_manager.cc:1434] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.127s	user 0.010s	sys 0.002s
I20260709 13:18:39.334970 12256 leader_election.cc:290] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:39.361569 11766 leader_election.cc:304] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:39.366429 12068 tablet_bootstrap.cc:492] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:39.346709 12353 raft_consensus.cc:515] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:39.369009 12076 leader_election.cc:290] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:39.372154 12307 raft_consensus.cc:2749] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:39.372371 12345 raft_consensus.cc:493] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.372514 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25353af0207b4ec1959e0795ded4946c" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:39.330410 11989 leader_election.cc:304] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:39.373136 12345 raft_consensus.cc:515] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:39.374419 12273 raft_consensus.cc:2804] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:18:39.374529 11989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.131:35995, user_credentials={real_user=slave}} blocked reactor thread for 44226.9us
I20260709 13:18:39.375141 12273 raft_consensus.cc:697] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [term 2 LEADER]: Becoming Leader. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Running, Role: LEADER
I20260709 13:18:39.375643 12345 leader_election.cc:290] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:39.376381 12273 consensus_queue.cc:237] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:39.377401 11796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25353af0207b4ec1959e0795ded4946c" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:39.373504 12193 raft_consensus.cc:2804] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:39.392764 12193 raft_consensus.cc:697] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:39.394815 12070 tablet_bootstrap.cc:492] T 59a9704b659947e6988fc29f5296ec73 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:39.373569 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6ff283134a4463af9ad09ed3ac81ce" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:39.395490 11872 raft_consensus.cc:2468] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:39.373504 11873 raft_consensus.cc:2468] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:39.402840 12072 ts_tablet_manager.cc:1434] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.003s
W20260709 13:18:39.409101 11842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.409991 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56ac6eddb0d84b0f921015c7d71e77a2" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:39.414713 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "276261d09b63498f8b2902647b4e2b4a" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:39.415345 11800 raft_consensus.cc:2468] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 0.
I20260709 13:18:39.418874 12068 tablet_bootstrap.cc:654] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:39.405177 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "276261d09b63498f8b2902647b4e2b4a" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:39.425314 12353 leader_election.cc:290] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:39.420670 11796 raft_consensus.cc:2393] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f7178f720eb4090a3593087331b82e9 in current term 1: Already voted for candidate bdbe2261c337471ea4d0c980ebb80c72 in this term.
I20260709 13:18:39.422465 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a9704b659947e6988fc29f5296ec73" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:39.440269 12069 ts_tablet_manager.cc:1434] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.206s	user 0.007s	sys 0.003s
W20260709 13:18:39.444360 11916 leader_election.cc:343] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:39.437045 12193 consensus_queue.cc:237] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:39.450172 11875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25353af0207b4ec1959e0795ded4946c" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:39.450232 11874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6ff283134a4463af9ad09ed3ac81ce" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:39.456581 11875 raft_consensus.cc:3060] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:39.456945 11874 raft_consensus.cc:3060] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:39.461972 11915 leader_election.cc:304] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:39.476374 12076 raft_consensus.cc:2804] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:39.476859 12076 raft_consensus.cc:493] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.477344 12076 raft_consensus.cc:3060] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:39.479116 12069 tablet_bootstrap.cc:492] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:39.481356 12072 tablet_bootstrap.cc:492] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
W20260709 13:18:39.482815 11767 consensus_peers.cc:597] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 -> Peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Couldn't send request to peer 1f7178f720eb4090a3593087331b82e9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:39.483914 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac39fc7f83141e0887192bc70b641b6" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:39.486614 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac39fc7f83141e0887192bc70b641b6" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:39.489097 11841 leader_election.cc:304] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:39.490005 12336 raft_consensus.cc:2804] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:39.490630 12336 raft_consensus.cc:697] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Becoming Leader. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
W20260709 13:18:39.491829 11767 leader_election.cc:343] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:39.491768 12336 consensus_queue.cc:237] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:39.493149 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56ac6eddb0d84b0f921015c7d71e77a2" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:39.493844 11869 raft_consensus.cc:3060] T 56ac6eddb0d84b0f921015c7d71e77a2 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:39.500289 11916 leader_election.cc:343] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:39.505756 12070 tablet_bootstrap.cc:654] T 59a9704b659947e6988fc29f5296ec73 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:39.528550 11875 raft_consensus.cc:2468] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:39.528721 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25353af0207b4ec1959e0795ded4946c" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:39.529546 11873 raft_consensus.cc:2393] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f7178f720eb4090a3593087331b82e9 in current term 1: Already voted for candidate bdbe2261c337471ea4d0c980ebb80c72 in this term.
I20260709 13:18:39.523509 12182 consensus_queue.cc:1048] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:18:39.540973 12072 tablet_bootstrap.cc:654] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:39.544474 12068 tablet_bootstrap.cc:492] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:39.545061 12068 ts_tablet_manager.cc:1403] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.185s	user 0.014s	sys 0.009s
I20260709 13:18:39.514482 12021 raft_consensus.cc:2468] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 2.
W20260709 13:18:39.548749 11766 leader_election.cc:343] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:39.549252 11766 leader_election.cc:304] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:39.517486 12248 raft_consensus.cc:515] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:39.553711 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6ff283134a4463af9ad09ed3ac81ce" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:39.556317 11948 raft_consensus.cc:2393] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7283c2ba87e94087b9ac5dcb372c4e1d in current term 1: Already voted for candidate bdbe2261c337471ea4d0c980ebb80c72 in this term.
I20260709 13:18:39.565506 11869 raft_consensus.cc:2468] T 56ac6eddb0d84b0f921015c7d71e77a2 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:39.553905 12193 raft_consensus.cc:2749] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:39.579110 11872 raft_consensus.cc:2393] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdbe2261c337471ea4d0c980ebb80c72 in current term 1: Already voted for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in this term.
I20260709 13:18:39.582026 12068 raft_consensus.cc:359] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:39.584007 12068 raft_consensus.cc:385] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:39.584404 12068 raft_consensus.cc:740] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:39.552660 12185 consensus_queue.cc:1048] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:18:39.585328 12068 consensus_queue.cc:260] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:39.589339 12068 ts_tablet_manager.cc:1434] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.003s
I20260709 13:18:39.591449 12068 tablet_bootstrap.cc:492] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:39.600886 11796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6ff283134a4463af9ad09ed3ac81ce" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:39.615882 12068 tablet_bootstrap.cc:654] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:39.622263 12069 tablet_bootstrap.cc:654] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:39.624225 12273 raft_consensus.cc:493] T ab5a46f525fd42468f042b3d38985f42 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.624342 12248 leader_election.cc:290] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:39.672426 12070 tablet_bootstrap.cc:492] T 59a9704b659947e6988fc29f5296ec73 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:39.673027 12070 ts_tablet_manager.cc:1403] T 59a9704b659947e6988fc29f5296ec73 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.278s	user 0.009s	sys 0.007s
I20260709 13:18:39.640404 12273 raft_consensus.cc:515] T ab5a46f525fd42468f042b3d38985f42 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:39.677266 12273 leader_election.cc:290] T ab5a46f525fd42468f042b3d38985f42 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:39.668937 11694 catalog_manager.cc:5697] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 reported cstate change: term changed from 1 to 2, leader changed from 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130) to 1f7178f720eb4090a3593087331b82e9 (127.1.227.132). New cstate: current_term: 2 leader_uuid: "1f7178f720eb4090a3593087331b82e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.667706 11874 raft_consensus.cc:2468] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
W20260709 13:18:39.667338 11842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:38909, user_credentials={real_user=slave}} blocked reactor thread for 135221us
W20260709 13:18:39.700057 11841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:35995, user_credentials={real_user=slave}} blocked reactor thread for 172550us
I20260709 13:18:39.712292 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab5a46f525fd42468f042b3d38985f42" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:39.713194 11947 raft_consensus.cc:2393] T ab5a46f525fd42468f042b3d38985f42 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f7178f720eb4090a3593087331b82e9 in current term 1: Already voted for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in this term.
I20260709 13:18:39.719126 12120 raft_consensus.cc:493] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.719722 12120 raft_consensus.cc:515] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:39.728843 11915 leader_election.cc:304] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:39.746946 11841 leader_election.cc:304] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:39.753989 11766 leader_election.cc:304] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:39.756593 11766 leader_election.cc:304] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:39.756647 12070 raft_consensus.cc:359] T 59a9704b659947e6988fc29f5296ec73 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:39.757552 12070 raft_consensus.cc:385] T 59a9704b659947e6988fc29f5296ec73 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:39.757941 12070 raft_consensus.cc:740] T 59a9704b659947e6988fc29f5296ec73 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:39.749970 11989 leader_election.cc:304] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:39.750208 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a9704b659947e6988fc29f5296ec73" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:39.770562 12375 raft_consensus.cc:2804] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:39.754767 12345 raft_consensus.cc:2749] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:39.768726 12193 raft_consensus.cc:2804] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:39.780059 12111 raft_consensus.cc:2749] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:39.781870 12193 raft_consensus.cc:697] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:39.783545 12375 raft_consensus.cc:697] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:39.784493 12375 consensus_queue.cc:237] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:39.783013 12193 consensus_queue.cc:237] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:39.769315 12182 raft_consensus.cc:3060] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:39.782543 11876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab5a46f525fd42468f042b3d38985f42" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:39.789724 12076 raft_consensus.cc:515] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:39.803902 12070 consensus_queue.cc:260] T 59a9704b659947e6988fc29f5296ec73 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:39.817294 12068 tablet_bootstrap.cc:492] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:39.821103 12068 ts_tablet_manager.cc:1403] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.230s	user 0.030s	sys 0.032s
I20260709 13:18:39.826977 12070 ts_tablet_manager.cc:1434] T 59a9704b659947e6988fc29f5296ec73 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.154s	user 0.012s	sys 0.000s
I20260709 13:18:39.822376 12019 raft_consensus.cc:3060] T 59a9704b659947e6988fc29f5296ec73 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:39.837430 11800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a9704b659947e6988fc29f5296ec73" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
W20260709 13:18:39.832561 11989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:43333, user_credentials={real_user=slave}} blocked reactor thread for 46896.9us
I20260709 13:18:39.853570 12070 tablet_bootstrap.cc:492] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:39.867748 12076 leader_election.cc:290] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:39.874042 12182 raft_consensus.cc:2749] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:39.874326 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "276261d09b63498f8b2902647b4e2b4a" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:39.878094 12069 tablet_bootstrap.cc:492] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:39.878706 12069 ts_tablet_manager.cc:1403] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.400s	user 0.019s	sys 0.005s
I20260709 13:18:39.880949 11989 leader_election.cc:304] T ab5a46f525fd42468f042b3d38985f42 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:39.881942 12361 raft_consensus.cc:3060] T ab5a46f525fd42468f042b3d38985f42 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:39.888744 12072 tablet_bootstrap.cc:492] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:39.889314 12072 ts_tablet_manager.cc:1403] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.417s	user 0.006s	sys 0.015s
I20260709 13:18:39.926185 12120 leader_election.cc:290] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
W20260709 13:18:39.931022 11989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:43333, user_credentials={real_user=slave}} blocked reactor thread for 50167.4us
I20260709 13:18:39.947402 12072 raft_consensus.cc:359] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:39.948475 12072 raft_consensus.cc:385] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:39.948846 12072 raft_consensus.cc:740] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:39.949827 12072 consensus_queue.cc:260] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
W20260709 13:18:39.952699 11916 leader_election.cc:343] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:39.952924 12019 raft_consensus.cc:2468] T 59a9704b659947e6988fc29f5296ec73 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:39.953704 12072 ts_tablet_manager.cc:1434] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.064s	user 0.013s	sys 0.001s
I20260709 13:18:39.956413 12069 raft_consensus.cc:359] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:39.957636 12069 raft_consensus.cc:385] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:39.961979 12120 raft_consensus.cc:493] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.962658 12120 raft_consensus.cc:515] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:39.965111 12120 leader_election.cc:290] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:39.957955 12069 raft_consensus.cc:740] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:39.971249 12069 consensus_queue.cc:260] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:39.972817 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c44d39672a741709a46194020f68692" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:39.977317 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38fc17625bd4a30b79f4a0bc2f8bf39" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:39.985306 12379 consensus_queue.cc:1048] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:18:39.986891 11916 leader_election.cc:343] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:39.990186 12069 ts_tablet_manager.cc:1434] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.111s	user 0.012s	sys 0.000s
I20260709 13:18:39.991472 12069 tablet_bootstrap.cc:492] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:39.997893 12068 raft_consensus.cc:359] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:39.998723 12068 raft_consensus.cc:385] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:39.999018 12068 raft_consensus.cc:740] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:39.999750 12068 consensus_queue.cc:260] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:40.001487 12068 ts_tablet_manager.cc:1434] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.180s	user 0.009s	sys 0.000s
W20260709 13:18:40.002311 11916 leader_election.cc:343] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:40.002909 12068 tablet_bootstrap.cc:492] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:40.019223 11842 leader_election.cc:304] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:40.020462 12336 raft_consensus.cc:2804] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:40.021036 12336 raft_consensus.cc:697] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Becoming Leader. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
I20260709 13:18:40.022171 12336 consensus_queue.cc:237] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:40.032187 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38fc17625bd4a30b79f4a0bc2f8bf39" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:40.032895 11798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "276261d09b63498f8b2902647b4e2b4a" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:40.033601 11798 raft_consensus.cc:3060] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:40.036422 11915 leader_election.cc:343] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:40.037142 11915 leader_election.cc:304] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:40.041923 12290 raft_consensus.cc:2749] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:40.039888 12361 raft_consensus.cc:2749] T ab5a46f525fd42468f042b3d38985f42 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:40.059713 12068 tablet_bootstrap.cc:654] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:40.061594 11800 raft_consensus.cc:2468] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
W20260709 13:18:40.049530 11989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:37961, user_credentials={real_user=slave}} blocked reactor thread for 46027us
I20260709 13:18:40.082219 12072 tablet_bootstrap.cc:492] T dac39fc7f83141e0887192bc70b641b6 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:40.092013 12070 tablet_bootstrap.cc:654] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:40.218652 11798 raft_consensus.cc:2468] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:40.287793 12070 tablet_bootstrap.cc:492] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:40.288348 12070 ts_tablet_manager.cc:1403] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.444s	user 0.032s	sys 0.032s
I20260709 13:18:40.291440 12070 raft_consensus.cc:359] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:40.292116 12070 raft_consensus.cc:385] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:40.292461 12070 raft_consensus.cc:740] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:40.293098 12070 consensus_queue.cc:260] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:40.295945 12070 ts_tablet_manager.cc:1434] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:18:40.299285 12070 tablet_bootstrap.cc:492] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:40.306087 12070 tablet_bootstrap.cc:654] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:40.315878 12070 tablet_bootstrap.cc:492] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:40.316380 12070 ts_tablet_manager.cc:1403] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.002s
I20260709 13:18:40.318169 12290 raft_consensus.cc:493] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.318765 12290 raft_consensus.cc:515] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:40.319160 12070 raft_consensus.cc:359] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:40.320160 12070 raft_consensus.cc:385] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:40.320469 12070 raft_consensus.cc:740] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:40.321185 12290 leader_election.cc:290] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:40.321201 12070 consensus_queue.cc:260] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:40.323760 12070 ts_tablet_manager.cc:1434] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:18:40.324761 12070 tablet_bootstrap.cc:492] T 56ac6eddb0d84b0f921015c7d71e77a2 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:40.332685 12070 tablet_bootstrap.cc:654] T 56ac6eddb0d84b0f921015c7d71e77a2 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:40.336863 12394 log.cc:927] Time spent T ab5a46f525fd42468f042b3d38985f42 P 04f862d1b8824d7a81daa0cad52c5843: Append to log took a long time: real 0.195s	user 0.002s	sys 0.000s
I20260709 13:18:40.338071 12070 tablet_bootstrap.cc:492] T 56ac6eddb0d84b0f921015c7d71e77a2 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:40.338703 12070 ts_tablet_manager.cc:1403] T 56ac6eddb0d84b0f921015c7d71e77a2 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.003s
I20260709 13:18:40.341702 12070 raft_consensus.cc:359] T 56ac6eddb0d84b0f921015c7d71e77a2 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:40.342346 12069 tablet_bootstrap.cc:700] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72: Time spent opening tablet: real 0.230s	user 0.005s	sys 0.003s
I20260709 13:18:40.342430 12070 raft_consensus.cc:385] T 56ac6eddb0d84b0f921015c7d71e77a2 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:40.342988 12070 raft_consensus.cc:740] T 56ac6eddb0d84b0f921015c7d71e77a2 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:40.343243 12069 tablet_bootstrap.cc:654] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:40.343667 12070 consensus_queue.cc:260] T 56ac6eddb0d84b0f921015c7d71e77a2 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:40.344256 12068 tablet_bootstrap.cc:492] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:40.344889 12068 ts_tablet_manager.cc:1403] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.342s	user 0.014s	sys 0.004s
I20260709 13:18:40.346349 12070 ts_tablet_manager.cc:1434] T 56ac6eddb0d84b0f921015c7d71e77a2 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:18:40.347500 12070 tablet_bootstrap.cc:492] T 9c44d39672a741709a46194020f68692 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:40.349531 12068 raft_consensus.cc:359] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:40.350672 12068 raft_consensus.cc:385] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:40.351531 12068 raft_consensus.cc:740] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:40.352540 12068 consensus_queue.cc:260] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:40.355466 12068 ts_tablet_manager.cc:1434] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:18:40.355713 12070 tablet_bootstrap.cc:654] T 9c44d39672a741709a46194020f68692 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:40.356855 12068 tablet_bootstrap.cc:492] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:40.365576 12068 tablet_bootstrap.cc:654] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:40.369266 12070 tablet_bootstrap.cc:492] T 9c44d39672a741709a46194020f68692 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:40.369998 12070 ts_tablet_manager.cc:1403] T 9c44d39672a741709a46194020f68692 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.006s
I20260709 13:18:40.385462 12070 raft_consensus.cc:359] T 9c44d39672a741709a46194020f68692 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:40.386397 12070 raft_consensus.cc:385] T 9c44d39672a741709a46194020f68692 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:40.386399 11947 raft_consensus.cc:1275] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Refusing update from remote peer 1f7178f720eb4090a3593087331b82e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:40.387169 12070 raft_consensus.cc:740] T 9c44d39672a741709a46194020f68692 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:40.387645 12069 tablet_bootstrap.cc:492] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:40.388190 12069 ts_tablet_manager.cc:1403] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.397s	user 0.010s	sys 0.011s
I20260709 13:18:40.388056 12070 consensus_queue.cc:260] T 9c44d39672a741709a46194020f68692 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:40.390130 12307 raft_consensus.cc:493] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.390738 12070 ts_tablet_manager.cc:1434] T 9c44d39672a741709a46194020f68692 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:18:40.390640 12307 raft_consensus.cc:515] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:40.392017 12070 tablet_bootstrap.cc:492] T 276261d09b63498f8b2902647b4e2b4a P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:40.392311 12396 consensus_queue.cc:1048] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:40.392776 12307 leader_election.cc:290] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:40.395203 12068 tablet_bootstrap.cc:492] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:40.395789 12068 ts_tablet_manager.cc:1403] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.003s
I20260709 13:18:40.385613 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c44d39672a741709a46194020f68692" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:40.391571 12069 raft_consensus.cc:359] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:40.401232 12069 raft_consensus.cc:385] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:40.403492 11869 raft_consensus.cc:1275] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Refusing update from remote peer 1f7178f720eb4090a3593087331b82e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:40.404443 11871 raft_consensus.cc:2468] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 0.
I20260709 13:18:40.406795 12070 tablet_bootstrap.cc:654] T 276261d09b63498f8b2902647b4e2b4a P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:40.401577 12069 raft_consensus.cc:740] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:40.418476 12069 consensus_queue.cc:260] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:40.418934 12068 raft_consensus.cc:359] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:40.419731 12068 raft_consensus.cc:385] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:40.419966 12068 raft_consensus.cc:740] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:40.417297 12396 consensus_queue.cc:1048] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:18:40.429493 11948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c44d39672a741709a46194020f68692" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:40.430254 11948 raft_consensus.cc:2468] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 0.
I20260709 13:18:40.430974 12069 ts_tablet_manager.cc:1434] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.002s
I20260709 13:18:40.434859 12069 tablet_bootstrap.cc:492] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:40.437911 12024 raft_consensus.cc:3060] T 56ac6eddb0d84b0f921015c7d71e77a2 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:40.458003 12352 consensus_queue.cc:1048] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:40.461884 12068 consensus_queue.cc:260] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:40.465523 12069 tablet_bootstrap.cc:654] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:40.467146 12120 consensus_queue.cc:1048] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:40.469441 12068 ts_tablet_manager.cc:1434] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 13:18:40.470737 12068 tablet_bootstrap.cc:492] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:40.472196 11841 leader_election.cc:304] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:40.474713 12307 raft_consensus.cc:2804] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:40.475275 12307 raft_consensus.cc:493] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.475629 12307 raft_consensus.cc:3060] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:40.479305 12120 raft_consensus.cc:493] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.489363 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c44d39672a741709a46194020f68692" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:40.490216 12021 raft_consensus.cc:2468] T 9c44d39672a741709a46194020f68692 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 0.
I20260709 13:18:40.493245 12016 raft_consensus.cc:3060] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:40.479887 12120 raft_consensus.cc:515] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:40.531852 12017 raft_consensus.cc:1275] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:18:40.544101 12120 leader_election.cc:290] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:40.546324 12379 consensus_queue.cc:1048] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:40.555990 11915 leader_election.cc:304] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:40.564219 11915 leader_election.cc:304] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:40.561916 12120 raft_consensus.cc:2804] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:40.578527 12120 raft_consensus.cc:493] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.598572 12070 tablet_bootstrap.cc:492] T 276261d09b63498f8b2902647b4e2b4a P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:40.599956 12070 ts_tablet_manager.cc:1403] T 276261d09b63498f8b2902647b4e2b4a P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.208s	user 0.016s	sys 0.019s
I20260709 13:18:40.594296 12120 raft_consensus.cc:3060] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:40.613500 12307 raft_consensus.cc:515] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:40.615581 11950 raft_consensus.cc:1275] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:18:40.616149 12307 leader_election.cc:290] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:40.622192 12068 tablet_bootstrap.cc:654] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:40.608486 12416 raft_consensus.cc:2804] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:40.629385 12069 tablet_bootstrap.cc:492] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:40.630137 12069 ts_tablet_manager.cc:1403] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.196s	user 0.016s	sys 0.012s
I20260709 13:18:40.641981 12182 consensus_queue.cc:1048] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:40.637889 12416 raft_consensus.cc:697] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:40.632998 12019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c44d39672a741709a46194020f68692" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:40.645714 11796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf1f22d4f144109fe8d089d54dd5e6" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:40.646281 12019 raft_consensus.cc:3060] T 9c44d39672a741709a46194020f68692 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:40.632241 11916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:38909, user_credentials={real_user=slave}} blocked reactor thread for 55891us
I20260709 13:18:40.664392 12120 raft_consensus.cc:515] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:40.665480 12070 raft_consensus.cc:359] T 276261d09b63498f8b2902647b4e2b4a P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:40.666236 12070 raft_consensus.cc:385] T 276261d09b63498f8b2902647b4e2b4a P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:40.666910 12120 leader_election.cc:290] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:40.668090 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c44d39672a741709a46194020f68692" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:40.666584 12070 raft_consensus.cc:740] T 276261d09b63498f8b2902647b4e2b4a P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:40.670380 12070 consensus_queue.cc:260] T 276261d09b63498f8b2902647b4e2b4a P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:40.671738 12072 tablet_bootstrap.cc:654] T dac39fc7f83141e0887192bc70b641b6 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:40.672642 12019 raft_consensus.cc:2468] T 9c44d39672a741709a46194020f68692 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:40.673420 12070 ts_tablet_manager.cc:1434] T 276261d09b63498f8b2902647b4e2b4a P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.000s
I20260709 13:18:40.674598 12070 tablet_bootstrap.cc:492] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:40.674880 11842 leader_election.cc:304] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:40.677729 12248 raft_consensus.cc:2804] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:40.644663 12416 consensus_queue.cc:237] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:40.678452 12248 raft_consensus.cc:697] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Becoming Leader. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
I20260709 13:18:40.679906 12248 consensus_queue.cc:237] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:40.651713 12307 consensus_queue.cc:1048] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 13:18:40.696043 11797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55c8d664ee74f0fbb31693f1b398fba" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:40.699963 12416 raft_consensus.cc:493] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.700551 12416 raft_consensus.cc:515] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:40.703039 12069 raft_consensus.cc:359] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:40.704025 12069 raft_consensus.cc:385] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:40.704356 12069 raft_consensus.cc:740] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:40.710297 12069 consensus_queue.cc:260] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:40.702908 12416 leader_election.cc:290] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:40.717316 11794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d66e54a11a44e09b15744ecdc4ae226" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
W20260709 13:18:40.719413 11915 leader_election.cc:343] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:40.720368 11915 leader_election.cc:343] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:40.718103 11794 raft_consensus.cc:2468] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 0.
I20260709 13:18:40.730669 12069 ts_tablet_manager.cc:1434] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.100s	user 0.002s	sys 0.006s
I20260709 13:18:40.731999 11694 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35110 (request call id 58) took 1245 ms. Trace:
I20260709 13:18:40.732733 12069 tablet_bootstrap.cc:492] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:40.737205 12318 consensus_queue.cc:1048] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:40.737692 11746 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:40.739398 11699 catalog_manager.cc:5697] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130). New cstate: current_term: 1 leader_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:40.742158 11698 catalog_manager.cc:5697] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 0 to 2, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 2 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:40.751255 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c44d39672a741709a46194020f68692" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:40.752780 11915 leader_election.cc:304] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:40.764076 11950 raft_consensus.cc:2393] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7283c2ba87e94087b9ac5dcb372c4e1d in current term 1: Already voted for candidate 04f862d1b8824d7a81daa0cad52c5843 in this term.
I20260709 13:18:40.764627 12384 consensus_queue.cc:1048] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:18:40.766258 12023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf1f22d4f144109fe8d089d54dd5e6" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:40.760380 12416 raft_consensus.cc:2804] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:40.796446 12069 tablet_bootstrap.cc:654] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:40.796964 11916 leader_election.cc:343] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:40.797708 12351 raft_consensus.cc:493] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.798313 12351 raft_consensus.cc:515] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:40.797576 11916 leader_election.cc:304] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:40.803996 12380 raft_consensus.cc:2749] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:40.800763 12351 leader_election.cc:290] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:40.784310 12416 raft_consensus.cc:493] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.815487 12070 tablet_bootstrap.cc:654] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:40.820319 12416 raft_consensus.cc:3060] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:40.850421 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c44d39672a741709a46194020f68692" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:40.732455 11694 rpcz_store.cc:276] 0709 13:18:39.486572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.498517 (+ 11945us) service_pool.cc:224] Handling call
0709 13:18:40.731900 (+1233383us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:39.775394 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:39.797515 (+ 22121us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:39.797579 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:18:39.797607 (+    28us) tablet.cc:662] Decoding operations
0709 13:18:39.804827 (+  7220us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:39.804907 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:39.804944 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:39.805155 (+   211us) tablet.cc:701] Row locks acquired
0709 13:18:39.805174 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:18:39.805338 (+   164us) write_op.cc:270] Start()
0709 13:18:39.805465 (+   127us) write_op.cc:276] Timestamp: P: 1783603119805282 usec, L: 0
0709 13:18:39.805493 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:18:39.808080 (+  2587us) log.cc:844] Serialized 540 byte log entry
0709 13:18:39.875447 (+ 67367us) op_driver.cc:464] REPLICATION: finished
0709 13:18:40.009210 (+133763us) write_op.cc:301] APPLY: starting
0709 13:18:40.009310 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:40.009422 (+   112us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:40.009545 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:40.010024 (+   479us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:40.010212 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:40.010266 (+    54us) write_op.cc:312] APPLY: finished
0709 13:18:40.010475 (+   209us) log.cc:844] Serialized 22 byte log entry
0709 13:18:40.010675 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:40.010773 (+    98us) write_op.cc:454] Released schema lock
0709 13:18:40.010823 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:40.011216 (+   393us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:40.011253 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16260,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":133453,"apply.run_cpu_time_us":1846,"apply.run_wall_time_us":1982,"num_ops":1,"prepare.queue_time_us":57952,"prepare.run_cpu_time_us":3396,"prepare.run_wall_time_us":57966,"replication_time_us":69724,"thread_start_us":103589,"threads_started":2}]]}
I20260709 13:18:40.864499 11915 leader_election.cc:304] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:40.880306 12072 tablet_bootstrap.cc:492] T dac39fc7f83141e0887192bc70b641b6 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:40.885316 12072 ts_tablet_manager.cc:1403] T dac39fc7f83141e0887192bc70b641b6 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.806s	user 0.030s	sys 0.014s
I20260709 13:18:40.875600 11875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d66e54a11a44e09b15744ecdc4ae226" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:40.892521 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55c8d664ee74f0fbb31693f1b398fba" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
W20260709 13:18:40.895182 11915 leader_election.cc:343] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:40.886920 12380 raft_consensus.cc:2749] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:18:40.896565 11915 leader_election.cc:343] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:40.897101 11915 leader_election.cc:304] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:40.899706 12380 raft_consensus.cc:2749] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:40.900324 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8dab527d374a47b91239feea9d8b3a" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:40.887013 12111 raft_consensus.cc:493] T 276261d09b63498f8b2902647b4e2b4a P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.879644 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8dab527d374a47b91239feea9d8b3a" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
W20260709 13:18:40.865665 11767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:38909, user_credentials={real_user=slave}} blocked reactor thread for 57550.2us
I20260709 13:18:40.916610 12068 tablet_bootstrap.cc:492] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:40.918762 12068 ts_tablet_manager.cc:1403] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.448s	user 0.026s	sys 0.014s
I20260709 13:18:40.918115 12111 raft_consensus.cc:515] T 276261d09b63498f8b2902647b4e2b4a P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:40.932454 12111 leader_election.cc:290] T 276261d09b63498f8b2902647b4e2b4a P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
W20260709 13:18:40.935336 12424 log.cc:927] Time spent T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:18:40.940539 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "276261d09b63498f8b2902647b4e2b4a" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:40.942174 12273 raft_consensus.cc:493] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.942879 12273 raft_consensus.cc:515] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:40.945039 12273 leader_election.cc:290] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:40.946203 11794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "276261d09b63498f8b2902647b4e2b4a" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:40.946069 12416 raft_consensus.cc:515] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:40.947232 11794 raft_consensus.cc:2393] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f7178f720eb4090a3593087331b82e9 in current term 1: Already voted for candidate 04f862d1b8824d7a81daa0cad52c5843 in this term.
I20260709 13:18:40.948390 12416 leader_election.cc:290] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:40.952692 11989 leader_election.cc:304] T 276261d09b63498f8b2902647b4e2b4a P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:40.960093 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d66e54a11a44e09b15744ecdc4ae226" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:40.960508 11794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac39fc7f83141e0887192bc70b641b6" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:40.961270 11794 raft_consensus.cc:2468] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 0.
I20260709 13:18:40.963608 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac39fc7f83141e0887192bc70b641b6" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
W20260709 13:18:40.965312 11915 leader_election.cc:343] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:40.961125 12068 raft_consensus.cc:359] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:40.967437 12068 raft_consensus.cc:385] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:40.967756 12068 raft_consensus.cc:740] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:40.974798 12182 raft_consensus.cc:493] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.975605 12397 raft_consensus.cc:3060] T 276261d09b63498f8b2902647b4e2b4a P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:40.975378 12182 raft_consensus.cc:515] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:40.977715 12182 leader_election.cc:290] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:40.979257 11794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d66e54a11a44e09b15744ecdc4ae226" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
W20260709 13:18:40.979980 11766 leader_election.cc:343] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:40.980924 11794 raft_consensus.cc:3060] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:40.980237 12318 consensus_queue.cc:1048] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:18:40.986054 12376 raft_consensus.cc:493] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.986668 12376 raft_consensus.cc:515] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:40.988881 12376 leader_election.cc:290] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:40.990517 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf1f22d4f144109fe8d089d54dd5e6" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:40.991369 11947 raft_consensus.cc:2468] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:40.992596 11796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6ff283134a4463af9ad09ed3ac81ce" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:40.971482 12068 consensus_queue.cc:260] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:40.994437 11766 leader_election.cc:304] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:40.995198 12318 raft_consensus.cc:2804] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:40.995594 12318 raft_consensus.cc:493] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.995944 12318 raft_consensus.cc:3060] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:40.996595 12068 ts_tablet_manager.cc:1434] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.001s
I20260709 13:18:40.998596 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6ff283134a4463af9ad09ed3ac81ce" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:40.998884 12381 consensus_queue.cc:1048] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:41.002242 11794 raft_consensus.cc:2468] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:41.003405 12068 tablet_bootstrap.cc:492] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:40.973685 11989 leader_election.cc:304] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
W20260709 13:18:41.014570 12423 log.cc:927] Time spent T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:18:41.016436 12273 raft_consensus.cc:2804] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:41.017017 12273 raft_consensus.cc:493] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.017401 12273 raft_consensus.cc:3060] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:41.011571 11915 leader_election.cc:304] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:41.019927 12068 tablet_bootstrap.cc:654] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:41.024004 11915 leader_election.cc:304] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:41.007315 12429 consensus_queue.cc:1048] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.092s
I20260709 13:18:41.028532 12375 raft_consensus.cc:2749] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:41.030400 12376 raft_consensus.cc:2804] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:41.090291 12376 raft_consensus.cc:697] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
W20260709 13:18:41.049190 12425 log.cc:927] Time spent T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:18:41.097385 12069 tablet_bootstrap.cc:492] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:41.098008 12069 ts_tablet_manager.cc:1403] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.366s	user 0.023s	sys 0.022s
I20260709 13:18:41.091241 12376 consensus_queue.cc:237] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:41.111757 12070 tablet_bootstrap.cc:492] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:41.112360 12070 ts_tablet_manager.cc:1403] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.438s	user 0.029s	sys 0.032s
W20260709 13:18:41.123099 11989 leader_election.cc:343] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:41.117449 12070 raft_consensus.cc:359] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:41.124727 12070 raft_consensus.cc:385] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:41.125046 12070 raft_consensus.cc:740] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:41.136828 12070 consensus_queue.cc:260] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:41.152550 12072 raft_consensus.cc:359] T dac39fc7f83141e0887192bc70b641b6 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:41.153250 12072 raft_consensus.cc:385] T dac39fc7f83141e0887192bc70b641b6 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:41.153585 12072 raft_consensus.cc:740] T dac39fc7f83141e0887192bc70b641b6 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:41.157720 12072 consensus_queue.cc:260] T dac39fc7f83141e0887192bc70b641b6 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:41.101306 12318 raft_consensus.cc:515] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:41.160061 12072 ts_tablet_manager.cc:1434] T dac39fc7f83141e0887192bc70b641b6 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.274s	user 0.009s	sys 0.000s
I20260709 13:18:41.163811 12070 ts_tablet_manager.cc:1434] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.051s	user 0.010s	sys 0.000s
I20260709 13:18:41.166412 12072 tablet_bootstrap.cc:492] T 5d66e54a11a44e09b15744ecdc4ae226 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:41.168372 12069 raft_consensus.cc:359] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:41.169202 12069 raft_consensus.cc:385] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:41.170500 12396 raft_consensus.cc:493] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.171110 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf1f22d4f144109fe8d089d54dd5e6" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:41.171080 12396 raft_consensus.cc:515] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:41.171857 11950 raft_consensus.cc:3060] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:41.172243 11767 leader_election.cc:343] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:41.172797 11767 leader_election.cc:304] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:41.174029 12396 leader_election.cc:290] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:41.169627 12069 raft_consensus.cc:740] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:41.176551 12069 consensus_queue.cc:260] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:41.183779 12185 raft_consensus.cc:2749] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:41.183799 11822 debug-util.cc:398] Leaking SignalData structure 0x7b080038c300 after lost signal to thread 1937
W20260709 13:18:41.185267 11822 debug-util.cc:398] Leaking SignalData structure 0x7b08002e3360 after lost signal to thread 11733
I20260709 13:18:41.160468 12397 raft_consensus.cc:2749] T 276261d09b63498f8b2902647b4e2b4a P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:41.213512 12072 tablet_bootstrap.cc:654] T 5d66e54a11a44e09b15744ecdc4ae226 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:41.215920 12069 ts_tablet_manager.cc:1434] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.118s	user 0.007s	sys 0.000s
I20260709 13:18:41.219414 12273 raft_consensus.cc:515] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:41.220148 11950 raft_consensus.cc:2468] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:41.230171 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf1f22d4f144109fe8d089d54dd5e6" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:41.230966 12016 raft_consensus.cc:2468] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:41.236440 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf1f22d4f144109fe8d089d54dd5e6" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:41.238184 12068 tablet_bootstrap.cc:492] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:41.238834 12068 ts_tablet_manager.cc:1403] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.236s	user 0.012s	sys 0.034s
I20260709 13:18:41.241338 12273 leader_election.cc:290] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
W20260709 13:18:41.237495 11822 debug-util.cc:398] Leaking SignalData structure 0x7b08004116e0 after lost signal to thread 11825
W20260709 13:18:41.242458 11822 debug-util.cc:398] Leaking SignalData structure 0x7b0800280240 after lost signal to thread 11826
W20260709 13:18:41.243685 11822 debug-util.cc:398] Leaking SignalData structure 0x7b0800275520 after lost signal to thread 11900
W20260709 13:18:41.243988 11822 debug-util.cc:398] Leaking SignalData structure 0x7b0800305280 after lost signal to thread 11901
I20260709 13:18:41.244746 11875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac39fc7f83141e0887192bc70b641b6" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
W20260709 13:18:41.245116 11822 debug-util.cc:398] Leaking SignalData structure 0x7b0800335360 after lost signal to thread 11974
I20260709 13:18:41.245424 11875 raft_consensus.cc:3060] T dac39fc7f83141e0887192bc70b641b6 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:41.248092 11797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac39fc7f83141e0887192bc70b641b6" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:41.248731 11797 raft_consensus.cc:3060] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:41.248513 11796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf1f22d4f144109fe8d089d54dd5e6" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:41.249648 11796 raft_consensus.cc:2393] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f7178f720eb4090a3593087331b82e9 in current term 1: Already voted for candidate bdbe2261c337471ea4d0c980ebb80c72 in this term.
I20260709 13:18:41.250808 12022 raft_consensus.cc:3060] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:41.252110 12290 consensus_queue.cc:1048] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:41.254309 12381 consensus_queue.cc:1048] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:41.249583 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf1f22d4f144109fe8d089d54dd5e6" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:41.256768 11945 raft_consensus.cc:2393] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f7178f720eb4090a3593087331b82e9 in current term 1: Already voted for candidate bdbe2261c337471ea4d0c980ebb80c72 in this term.
I20260709 13:18:41.256713 12069 tablet_bootstrap.cc:492] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:41.257493 11698 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35088 (request call id 65) took 1696 ms. Trace:
I20260709 13:18:41.259863 11766 leader_election.cc:304] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:41.260973 11699 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35104 (request call id 62) took 1134 ms. Trace:
I20260709 13:18:41.261420 11989 leader_election.cc:304] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:41.267808 12351 raft_consensus.cc:2804] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:41.268664 12351 raft_consensus.cc:697] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:41.269860 12351 consensus_queue.cc:237] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:41.269547 12068 raft_consensus.cc:359] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:41.271353 12068 raft_consensus.cc:385] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:41.271622 12068 raft_consensus.cc:740] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:41.265712 11697 catalog_manager.cc:5697] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:41.257936 11698 rpcz_store.cc:276] 0709 13:18:39.561300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.573015 (+ 11715us) service_pool.cc:224] Handling call
0709 13:18:41.257433 (+1684418us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:40.747269 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:40.751605 (+  4336us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:40.751638 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:18:40.751655 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:40.753841 (+  2186us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:40.754883 (+  1042us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:40.759334 (+  4451us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:40.767692 (+  8358us) tablet.cc:701] Row locks acquired
0709 13:18:40.767713 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:18:40.767854 (+   141us) write_op.cc:270] Start()
0709 13:18:40.767971 (+   117us) write_op.cc:276] Timestamp: P: 1783603120767816 usec, L: 0
0709 13:18:40.767999 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:18:40.768644 (+   645us) log.cc:844] Serialized 540 byte log entry
0709 13:18:40.863205 (+ 94561us) op_driver.cc:464] REPLICATION: finished
0709 13:18:41.131511 (+268306us) write_op.cc:301] APPLY: starting
0709 13:18:41.134481 (+  2970us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:41.139691 (+  5210us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:41.183128 (+ 43437us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:41.253928 (+ 70800us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:41.254112 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:41.254162 (+    50us) write_op.cc:312] APPLY: finished
0709 13:18:41.254381 (+   219us) log.cc:844] Serialized 22 byte log entry
0709 13:18:41.254583 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:41.254662 (+    79us) write_op.cc:454] Released schema lock
0709 13:18:41.254704 (+    42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":280281,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":238274,"num_ops":1,"prepare.queue_time_us":2278,"prepare.run_cpu_time_us":2741,"prepare.run_wall_time_us":21630,"replication_time_us":95050,"thread_start_us":158591,"threads_started":1}]]}
I20260709 13:18:41.281183 12070 tablet_bootstrap.cc:492] T 1ad333631d4d40a38cada3a3b76f5e52 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:41.272271 12068 consensus_queue.cc:260] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:41.261360 11699 rpcz_store.cc:276] 0709 13:18:40.127108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.296855 (+169747us) service_pool.cc:224] Handling call
0709 13:18:41.260915 (+964060us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:40.769084 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:40.769636 (+   552us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:40.769666 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:18:40.769680 (+    14us) tablet.cc:662] Decoding operations
0709 13:18:40.770040 (+   360us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:40.770100 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:40.770126 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:40.770326 (+   200us) tablet.cc:701] Row locks acquired
0709 13:18:40.770339 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:18:40.770485 (+   146us) write_op.cc:270] Start()
0709 13:18:40.770602 (+   117us) write_op.cc:276] Timestamp: P: 1783603120770436 usec, L: 0
0709 13:18:40.770622 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:18:40.779624 (+  9002us) log.cc:844] Serialized 540 byte log entry
0709 13:18:41.090305 (+310681us) op_driver.cc:464] REPLICATION: finished
0709 13:18:41.180156 (+ 89851us) write_op.cc:301] APPLY: starting
0709 13:18:41.180243 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:41.180346 (+   103us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:41.180447 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:41.180676 (+   229us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:41.180827 (+   151us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:41.180871 (+    44us) write_op.cc:312] APPLY: finished
0709 13:18:41.181053 (+   182us) log.cc:844] Serialized 22 byte log entry
0709 13:18:41.181208 (+   155us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:41.181274 (+    66us) write_op.cc:454] Released schema lock
0709 13:18:41.181313 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:41.181643 (+   330us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:41.181674 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":438664,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":88408,"apply.run_cpu_time_us":1486,"apply.run_wall_time_us":1486,"num_ops":1,"prepare.queue_time_us":16561,"prepare.run_cpu_time_us":2536,"prepare.run_wall_time_us":17916,"replication_time_us":270828,"thread_start_us":40963,"threads_started":1}]]}
I20260709 13:18:41.295806 12069 tablet_bootstrap.cc:654] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:41.289642 11697 catalog_manager.cc:5697] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:41.290518 11822 debug-util.cc:398] Leaking SignalData structure 0x7b08003bd480 after lost signal to thread 12048
I20260709 13:18:41.315819 11875 raft_consensus.cc:2468] T dac39fc7f83141e0887192bc70b641b6 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:41.323329 12070 tablet_bootstrap.cc:654] T 1ad333631d4d40a38cada3a3b76f5e52 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:41.333540 11989 leader_election.cc:304] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:41.340180 12068 ts_tablet_manager.cc:1434] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.101s	user 0.007s	sys 0.001s
I20260709 13:18:41.343387 12397 raft_consensus.cc:2804] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:41.346436 12418 raft_consensus.cc:493] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.402417 12068 tablet_bootstrap.cc:492] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:41.364955 12397 raft_consensus.cc:697] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Becoming Leader. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Running, Role: LEADER
I20260709 13:18:41.365267 12022 raft_consensus.cc:2468] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:41.411119 12273 raft_consensus.cc:2749] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:41.399748 12318 leader_election.cc:290] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:41.368880 12418 raft_consensus.cc:515] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:41.443226 12397 consensus_queue.cc:237] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:41.436079 11797 raft_consensus.cc:2468] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:41.462507 12416 consensus_queue.cc:1048] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:18:41.468029 12442 log.cc:927] Time spent T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:18:41.475360 12072 tablet_bootstrap.cc:492] T 5d66e54a11a44e09b15744ecdc4ae226 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:41.475924 12072 ts_tablet_manager.cc:1403] T 5d66e54a11a44e09b15744ecdc4ae226 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.310s	user 0.009s	sys 0.017s
I20260709 13:18:41.488574 12418 leader_election.cc:290] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:41.488942 12069 tablet_bootstrap.cc:492] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:41.489773 12069 ts_tablet_manager.cc:1403] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.233s	user 0.029s	sys 0.033s
I20260709 13:18:41.491880 12248 consensus_queue.cc:1048] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:41.496783 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad333631d4d40a38cada3a3b76f5e52" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:41.504083 12072 raft_consensus.cc:359] T 5d66e54a11a44e09b15744ecdc4ae226 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:41.504859 12072 raft_consensus.cc:385] T 5d66e54a11a44e09b15744ecdc4ae226 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:41.505141 12072 raft_consensus.cc:740] T 5d66e54a11a44e09b15744ecdc4ae226 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:41.505827 12072 consensus_queue.cc:260] T 5d66e54a11a44e09b15744ecdc4ae226 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:41.508158 12072 ts_tablet_manager.cc:1434] T 5d66e54a11a44e09b15744ecdc4ae226 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:18:41.509332 12072 tablet_bootstrap.cc:492] T bc8dab527d374a47b91239feea9d8b3a P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:41.493455 12069 raft_consensus.cc:359] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:41.514029 12069 raft_consensus.cc:385] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:41.514348 12069 raft_consensus.cc:740] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:41.530750 12069 consensus_queue.cc:260] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:41.531530 11801 raft_consensus.cc:2468] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 0.
W20260709 13:18:41.542374 12448 log.cc:927] Time spent T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72: Append to log took a long time: real 0.141s	user 0.004s	sys 0.000s
I20260709 13:18:41.556259 12068 tablet_bootstrap.cc:654] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:41.556730 11915 leader_election.cc:304] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:41.561307 12376 raft_consensus.cc:2804] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:41.561728 12376 raft_consensus.cc:493] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.562083 12376 raft_consensus.cc:3060] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:41.557557 12069 ts_tablet_manager.cc:1434] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 13:18:41.573817 12069 tablet_bootstrap.cc:492] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
W20260709 13:18:41.574156 12440 log.cc:927] Time spent T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843: Append to log took a long time: real 0.222s	user 0.003s	sys 0.000s
I20260709 13:18:41.577646 12376 raft_consensus.cc:515] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:41.583052 12072 tablet_bootstrap.cc:654] T bc8dab527d374a47b91239feea9d8b3a P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:41.594249 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad333631d4d40a38cada3a3b76f5e52" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:41.600217 12069 tablet_bootstrap.cc:654] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:41.602927 12070 tablet_bootstrap.cc:492] T 1ad333631d4d40a38cada3a3b76f5e52 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:41.626163 12070 ts_tablet_manager.cc:1403] T 1ad333631d4d40a38cada3a3b76f5e52 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.412s	user 0.016s	sys 0.019s
I20260709 13:18:41.627907 11874 raft_consensus.cc:3060] T 5d66e54a11a44e09b15744ecdc4ae226 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:41.604984 11694 catalog_manager.cc:5697] T 59a9704b659947e6988fc29f5296ec73 P 1f7178f720eb4090a3593087331b82e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130). New cstate: current_term: 1 leader_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } }
I20260709 13:18:41.609193 12416 raft_consensus.cc:493] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:41.632334 11916 leader_election.cc:343] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:41.632069 12416 raft_consensus.cc:515] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:41.632159 11694 catalog_manager.cc:5697] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } }
I20260709 13:18:41.634150 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad333631d4d40a38cada3a3b76f5e52" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:41.636720 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eece1e771a0341b1bebc6fde110e6f8a" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:41.637205 12068 tablet_bootstrap.cc:492] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:41.637684 12068 ts_tablet_manager.cc:1403] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.269s	user 0.011s	sys 0.002s
W20260709 13:18:41.641052 11916 leader_election.cc:343] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:41.638449 12070 raft_consensus.cc:359] T 1ad333631d4d40a38cada3a3b76f5e52 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:41.642324 12070 raft_consensus.cc:385] T 1ad333631d4d40a38cada3a3b76f5e52 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:41.642079 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eece1e771a0341b1bebc6fde110e6f8a" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:41.642746 12070 raft_consensus.cc:740] T 1ad333631d4d40a38cada3a3b76f5e52 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:41.643603 12070 consensus_queue.cc:260] T 1ad333631d4d40a38cada3a3b76f5e52 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
W20260709 13:18:41.648015 11915 leader_election.cc:343] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:41.634917 12416 leader_election.cc:290] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:41.651387 12433 raft_consensus.cc:493] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.652652 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad333631d4d40a38cada3a3b76f5e52" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:41.653898 11801 raft_consensus.cc:3060] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:41.654328 12376 leader_election.cc:290] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:41.651959 12433 raft_consensus.cc:515] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:41.659108 12433 leader_election.cc:290] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:41.662626 12068 raft_consensus.cc:359] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:41.663676 12068 raft_consensus.cc:385] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:41.665108 11801 raft_consensus.cc:2468] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:41.666610 11915 leader_election.cc:304] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:41.664026 12068 raft_consensus.cc:740] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:41.667413 12070 ts_tablet_manager.cc:1434] T 1ad333631d4d40a38cada3a3b76f5e52 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.003s
W20260709 13:18:41.679244 11915 leader_election.cc:343] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:41.680423 11915 leader_election.cc:304] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:41.680807 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86477bbe25284503970ce70bb1e26190" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:41.680704 12070 tablet_bootstrap.cc:492] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:41.673022 12068 consensus_queue.cc:260] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:41.672502 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86477bbe25284503970ce70bb1e26190" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:41.670182 12416 raft_consensus.cc:2804] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:41.697606 11697 catalog_manager.cc:5697] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } }
I20260709 13:18:41.701246 11697 catalog_manager.cc:5697] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:41.695982 12418 consensus_queue.cc:1048] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:18:41.704991 12416 raft_consensus.cc:697] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
W20260709 13:18:41.696774 11766 leader_election.cc:343] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:41.692149 12290 raft_consensus.cc:2749] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:41.716269 12416 consensus_queue.cc:237] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:41.720572 12068 ts_tablet_manager.cc:1434] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.000s
W20260709 13:18:41.724362 11767 leader_election.cc:343] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:41.724694 12069 tablet_bootstrap.cc:492] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:41.728013 12069 ts_tablet_manager.cc:1403] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.164s	user 0.014s	sys 0.009s
I20260709 13:18:41.726995 12068 tablet_bootstrap.cc:492] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:41.731184 11697 catalog_manager.cc:5697] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130). New cstate: current_term: 1 leader_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } }
I20260709 13:18:41.719427 12376 consensus_queue.cc:1048] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:18:41.741379 12069 raft_consensus.cc:359] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:41.742086 12069 raft_consensus.cc:385] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:41.742311 12069 raft_consensus.cc:740] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:41.743005 12069 consensus_queue.cc:260] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:41.733444 11767 leader_election.cc:304] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:41.755703 12429 raft_consensus.cc:2749] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:41.771880 12069 ts_tablet_manager.cc:1434] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:18:41.773109 12069 tablet_bootstrap.cc:492] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:41.774845 12072 tablet_bootstrap.cc:492] T bc8dab527d374a47b91239feea9d8b3a P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:41.775414 12072 ts_tablet_manager.cc:1403] T bc8dab527d374a47b91239feea9d8b3a P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.266s	user 0.017s	sys 0.031s
I20260709 13:18:41.776894 12068 tablet_bootstrap.cc:654] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:41.793164 12433 consensus_queue.cc:1048] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:41.796561 12070 tablet_bootstrap.cc:654] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:41.796281 11699 catalog_manager.cc:5697] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:41.797887 12376 raft_consensus.cc:493] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.800379 12376 raft_consensus.cc:515] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:41.803447 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda29dd1f464af4b5c86ee8ec5bffc4" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
W20260709 13:18:41.805022 11915 leader_election.cc:343] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:41.808005 12072 raft_consensus.cc:359] T bc8dab527d374a47b91239feea9d8b3a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:41.808949 12072 raft_consensus.cc:385] T bc8dab527d374a47b91239feea9d8b3a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:41.809250 12072 raft_consensus.cc:740] T bc8dab527d374a47b91239feea9d8b3a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
W20260709 13:18:41.823885 11746 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:41.826435 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda29dd1f464af4b5c86ee8ec5bffc4" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
W20260709 13:18:41.828271 11916 leader_election.cc:343] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:41.823838 12070 tablet_bootstrap.cc:492] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:41.828763 11916 leader_election.cc:304] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:41.829819 12418 raft_consensus.cc:2749] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:41.830565 12070 ts_tablet_manager.cc:1403] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.150s	user 0.010s	sys 0.003s
I20260709 13:18:41.831033 12376 leader_election.cc:290] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:41.836113 12070 raft_consensus.cc:359] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:41.847818 12070 raft_consensus.cc:385] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:41.848181 12070 raft_consensus.cc:740] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:41.848824 12069 tablet_bootstrap.cc:654] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:41.848978 12070 consensus_queue.cc:260] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:41.845566 12072 consensus_queue.cc:260] T bc8dab527d374a47b91239feea9d8b3a P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:41.851820 12070 ts_tablet_manager.cc:1434] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:18:41.853111 12070 tablet_bootstrap.cc:492] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:41.853443 12072 ts_tablet_manager.cc:1434] T bc8dab527d374a47b91239feea9d8b3a P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 13:18:41.854549 12072 tablet_bootstrap.cc:492] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:41.860227 12070 tablet_bootstrap.cc:654] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:41.864468 12072 tablet_bootstrap.cc:654] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:41.864022 11694 catalog_manager.cc:5697] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f7178f720eb4090a3593087331b82e9 (127.1.227.132). New cstate: current_term: 1 leader_uuid: "1f7178f720eb4090a3593087331b82e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:41.872285 12182 consensus_queue.cc:1048] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:41.881459 12070 tablet_bootstrap.cc:492] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:41.882193 12070 ts_tablet_manager.cc:1403] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.005s
I20260709 13:18:41.886197 12070 raft_consensus.cc:359] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:41.887076 12070 raft_consensus.cc:385] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:41.887399 12070 raft_consensus.cc:740] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:41.888137 12070 consensus_queue.cc:260] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:41.893154 12111 raft_consensus.cc:493] T 1ad333631d4d40a38cada3a3b76f5e52 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.893795 12111 raft_consensus.cc:515] T 1ad333631d4d40a38cada3a3b76f5e52 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:41.895040 12070 ts_tablet_manager.cc:1434] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:18:41.896119 12070 tablet_bootstrap.cc:492] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:41.896756 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad333631d4d40a38cada3a3b76f5e52" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:41.913054 12072 tablet_bootstrap.cc:492] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:41.915625 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad333631d4d40a38cada3a3b76f5e52" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:41.916458 11801 raft_consensus.cc:2393] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f7178f720eb4090a3593087331b82e9 in current term 1: Already voted for candidate 04f862d1b8824d7a81daa0cad52c5843 in this term.
I20260709 13:18:41.917649 11989 leader_election.cc:304] T 1ad333631d4d40a38cada3a3b76f5e52 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:41.918568 12273 raft_consensus.cc:3060] T 1ad333631d4d40a38cada3a3b76f5e52 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:41.921990 12070 tablet_bootstrap.cc:654] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:41.925354 12111 leader_election.cc:290] T 1ad333631d4d40a38cada3a3b76f5e52 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:41.926301 12068 tablet_bootstrap.cc:492] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:41.926810 12068 ts_tablet_manager.cc:1403] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.201s	user 0.015s	sys 0.004s
I20260709 13:18:41.929015 12273 raft_consensus.cc:2749] T 1ad333631d4d40a38cada3a3b76f5e52 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:41.913635 12072 ts_tablet_manager.cc:1403] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.059s	user 0.021s	sys 0.000s
I20260709 13:18:41.933120 12376 raft_consensus.cc:493] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.929431 12068 raft_consensus.cc:359] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:41.933674 12376 raft_consensus.cc:515] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:41.934196 11696 catalog_manager.cc:5697] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:41.937233 11874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38fc17625bd4a30b79f4a0bc2f8bf39" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
W20260709 13:18:41.939276 11915 leader_election.cc:343] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:41.940099 12072 raft_consensus.cc:359] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:41.933698 12068 raft_consensus.cc:385] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:41.941044 12072 raft_consensus.cc:385] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:41.944036 12068 raft_consensus.cc:740] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:41.944274 12072 raft_consensus.cc:740] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:41.946420 12072 consensus_queue.cc:260] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:41.947789 12070 tablet_bootstrap.cc:492] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:41.945235 12068 consensus_queue.cc:260] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:41.948321 12070 ts_tablet_manager.cc:1403] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.018s
I20260709 13:18:41.951571 12068 ts_tablet_manager.cc:1434] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:18:41.954136 12070 raft_consensus.cc:359] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:41.954895 12070 raft_consensus.cc:385] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:41.955019 12072 ts_tablet_manager.cc:1434] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:18:41.960047 12068 tablet_bootstrap.cc:492] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:41.960990 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38fc17625bd4a30b79f4a0bc2f8bf39" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:41.955214 12070 raft_consensus.cc:740] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:41.961714 12020 raft_consensus.cc:2468] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 0.
I20260709 13:18:41.962584 12070 consensus_queue.cc:260] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:41.963449 11916 leader_election.cc:304] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:41.964695 12418 raft_consensus.cc:2804] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:41.965049 12418 raft_consensus.cc:493] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.965404 12418 raft_consensus.cc:3060] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:41.969053 12068 tablet_bootstrap.cc:654] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:41.978924 12418 raft_consensus.cc:515] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:41.981495 12376 leader_election.cc:290] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:41.983220 12070 ts_tablet_manager.cc:1434] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:18:41.984344 12070 tablet_bootstrap.cc:492] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:41.989630 12072 tablet_bootstrap.cc:492] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:41.992506 11874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38fc17625bd4a30b79f4a0bc2f8bf39" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:41.993163 11874 raft_consensus.cc:3060] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:41.995117 12069 tablet_bootstrap.cc:492] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:42.009320 12069 ts_tablet_manager.cc:1403] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.236s	user 0.020s	sys 0.009s
I20260709 13:18:42.010778 11874 raft_consensus.cc:2468] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:42.011960 11915 leader_election.cc:304] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:42.002298 12072 tablet_bootstrap.cc:654] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:42.003639 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38fc17625bd4a30b79f4a0bc2f8bf39" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:42.021420 12020 raft_consensus.cc:3060] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:42.005239 12070 tablet_bootstrap.cc:654] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:42.004966 12273 consensus_queue.cc:1048] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:41.999001 12418 leader_election.cc:290] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:42.016672 12375 raft_consensus.cc:2804] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:42.026683 12375 raft_consensus.cc:697] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:42.027298 12068 tablet_bootstrap.cc:492] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:42.027804 12068 ts_tablet_manager.cc:1403] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.075s	user 0.008s	sys 0.010s
I20260709 13:18:42.027572 12375 consensus_queue.cc:237] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:42.030566 12068 raft_consensus.cc:359] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:42.031265 12068 raft_consensus.cc:385] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:42.031562 12068 raft_consensus.cc:740] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:42.041996 12068 consensus_queue.cc:260] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:42.044552 12068 ts_tablet_manager.cc:1434] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:18:42.045768 12068 tablet_bootstrap.cc:492] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
I20260709 13:18:42.042371 12020 raft_consensus.cc:2468] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:42.053427 12273 consensus_queue.cc:1048] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:42.042725 12069 raft_consensus.cc:359] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:42.056716 12069 raft_consensus.cc:385] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:42.057016 12069 raft_consensus.cc:740] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:42.058465 12070 tablet_bootstrap.cc:492] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:42.059222 12070 ts_tablet_manager.cc:1403] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.002s
I20260709 13:18:42.059871 12069 consensus_queue.cc:260] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:42.063800 12068 tablet_bootstrap.cc:654] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:42.066027 12069 ts_tablet_manager.cc:1434] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.001s
I20260709 13:18:42.067232 12069 tablet_bootstrap.cc:492] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:42.080746 12070 raft_consensus.cc:359] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:42.095286 12273 raft_consensus.cc:493] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.103808 12273 raft_consensus.cc:515] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:42.106137 12273 leader_election.cc:290] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:42.106858 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8dab527d374a47b91239feea9d8b3a" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:42.107647 11801 raft_consensus.cc:2468] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 0.
I20260709 13:18:42.109028 11989 leader_election.cc:304] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:42.110057 12273 raft_consensus.cc:2804] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:42.110579 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8dab527d374a47b91239feea9d8b3a" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:42.111181 12273 raft_consensus.cc:493] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.102145 11694 catalog_manager.cc:5697] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:42.111459 11872 raft_consensus.cc:2468] T bc8dab527d374a47b91239feea9d8b3a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 0.
I20260709 13:18:42.111742 12273 raft_consensus.cc:3060] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:42.111493 12070 raft_consensus.cc:385] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:42.119194 12070 raft_consensus.cc:740] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:42.120018 12070 consensus_queue.cc:260] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:42.121840 12070 ts_tablet_manager.cc:1434] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.000s
I20260709 13:18:42.124943 12069 tablet_bootstrap.cc:654] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:42.126107 12070 tablet_bootstrap.cc:492] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:42.137374 12070 tablet_bootstrap.cc:654] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:42.143857 12429 raft_consensus.cc:493] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.144524 12429 raft_consensus.cc:515] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:42.150919 12400 raft_consensus.cc:493] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.151502 12400 raft_consensus.cc:515] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:42.127166 12273 raft_consensus.cc:515] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:42.152091 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678fcf88b458421b960351bc865762c6" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:42.153710 12400 leader_election.cc:290] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
W20260709 13:18:42.153858 11767 leader_election.cc:343] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:42.154197 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678fcf88b458421b960351bc865762c6" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:42.159798 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda29dd1f464af4b5c86ee8ec5bffc4" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:42.160454 11945 raft_consensus.cc:2468] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 0.
W20260709 13:18:42.161906 11766 leader_election.cc:343] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:42.162374 11766 leader_election.cc:304] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:42.164779 12182 raft_consensus.cc:2749] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:42.169625 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda29dd1f464af4b5c86ee8ec5bffc4" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:42.152087 12429 leader_election.cc:290] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:42.173880 11989 leader_election.cc:304] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: 
I20260709 13:18:42.179085 12111 raft_consensus.cc:2804] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:42.179572 12111 raft_consensus.cc:493] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.179848 12111 raft_consensus.cc:3060] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:42.182889 11989 leader_election.cc:343] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:42.193670 11796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8dab527d374a47b91239feea9d8b3a" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:42.194345 11796 raft_consensus.cc:3060] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:42.195734 12273 leader_election.cc:290] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:42.204207 12111 raft_consensus.cc:515] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:42.209760 11874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda29dd1f464af4b5c86ee8ec5bffc4" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:42.211643 12070 tablet_bootstrap.cc:492] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:42.212188 12070 ts_tablet_manager.cc:1403] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.003s
I20260709 13:18:42.213989 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8dab527d374a47b91239feea9d8b3a" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:42.214607 11872 raft_consensus.cc:3060] T bc8dab527d374a47b91239feea9d8b3a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:42.222292 11872 raft_consensus.cc:2468] T bc8dab527d374a47b91239feea9d8b3a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:42.224591 12072 tablet_bootstrap.cc:492] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:42.225261 12072 ts_tablet_manager.cc:1403] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.236s	user 0.014s	sys 0.003s
I20260709 13:18:42.227624 12418 consensus_queue.cc:1048] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:42.231335 12070 raft_consensus.cc:359] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
W20260709 13:18:42.231736 11989 leader_election.cc:343] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:42.232292 12070 raft_consensus.cc:385] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:42.232717 12070 raft_consensus.cc:740] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:42.235482 11796 raft_consensus.cc:2468] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:42.229025 12072 raft_consensus.cc:359] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:42.237286 11989 leader_election.cc:304] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:42.237320 12072 raft_consensus.cc:385] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:42.238117 12072 raft_consensus.cc:740] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:42.239198 12273 raft_consensus.cc:2804] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:42.238956 12072 consensus_queue.cc:260] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:42.239698 12273 raft_consensus.cc:697] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Becoming Leader. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Running, Role: LEADER
I20260709 13:18:42.240746 12072 ts_tablet_manager.cc:1434] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:18:42.241852 12072 tablet_bootstrap.cc:492] T 86477bbe25284503970ce70bb1e26190 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:42.248189 12072 tablet_bootstrap.cc:654] T 86477bbe25284503970ce70bb1e26190 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:42.233487 12070 consensus_queue.cc:260] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:42.240571 12273 consensus_queue.cc:237] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:42.264277 12375 raft_consensus.cc:493] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.264883 12375 raft_consensus.cc:515] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:42.273626 12375 leader_election.cc:290] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:42.276573 11796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e862ca999046aca1a257edebcdfea3" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
W20260709 13:18:42.278050 11915 leader_election.cc:343] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:42.305711 12182 raft_consensus.cc:493] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.300486 12375 raft_consensus.cc:493] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.296500 12111 leader_election.cc:290] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:42.306546 12182 raft_consensus.cc:515] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:42.312165 12375 raft_consensus.cc:515] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:42.336293 12400 raft_consensus.cc:493] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.340162 12070 ts_tablet_manager.cc:1434] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.128s	user 0.016s	sys 0.022s
I20260709 13:18:42.338929 12400 raft_consensus.cc:515] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:42.345192 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda29dd1f464af4b5c86ee8ec5bffc4" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:42.352454 11945 raft_consensus.cc:3060] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:42.354460 12400 leader_election.cc:290] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:42.358883 12182 leader_election.cc:290] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:42.366591 12375 leader_election.cc:290] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:42.366689 12072 tablet_bootstrap.cc:492] T 86477bbe25284503970ce70bb1e26190 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:42.370503 12072 ts_tablet_manager.cc:1403] T 86477bbe25284503970ce70bb1e26190 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.129s	user 0.017s	sys 0.007s
I20260709 13:18:42.344233 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e862ca999046aca1a257edebcdfea3" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:42.384418 12068 tablet_bootstrap.cc:492] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
I20260709 13:18:42.385182 12068 ts_tablet_manager.cc:1403] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.340s	user 0.054s	sys 0.041s
I20260709 13:18:42.386631 12069 tablet_bootstrap.cc:492] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:42.387221 12069 ts_tablet_manager.cc:1403] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.320s	user 0.015s	sys 0.027s
I20260709 13:18:42.390017 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ca7758d7240519907444b2ba2c15f" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:42.390141 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55c8d664ee74f0fbb31693f1b398fba" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:42.391110 11949 raft_consensus.cc:2468] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:42.390077 12489 raft_consensus.cc:493] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.392751 12489 raft_consensus.cc:515] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:42.394327 11793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678fcf88b458421b960351bc865762c6" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:42.395103 11793 raft_consensus.cc:2468] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 0.
I20260709 13:18:42.395251 12489 leader_election.cc:290] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:42.398036 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678fcf88b458421b960351bc865762c6" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:42.388343 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55c8d664ee74f0fbb31693f1b398fba" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
W20260709 13:18:42.402599 11766 leader_election.cc:343] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:42.403227 12068 raft_consensus.cc:359] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:42.404040 12068 raft_consensus.cc:385] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:42.404325 12068 raft_consensus.cc:740] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:42.405035 12068 consensus_queue.cc:260] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:42.406844 12069 raft_consensus.cc:359] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:42.407706 12069 raft_consensus.cc:385] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:42.408042 12069 raft_consensus.cc:740] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:42.412299 11796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ca7758d7240519907444b2ba2c15f" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:42.399583 12072 raft_consensus.cc:359] T 86477bbe25284503970ce70bb1e26190 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:42.414104 12072 raft_consensus.cc:385] T 86477bbe25284503970ce70bb1e26190 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:42.414409 12072 raft_consensus.cc:740] T 86477bbe25284503970ce70bb1e26190 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:42.415076 12072 consensus_queue.cc:260] T 86477bbe25284503970ce70bb1e26190 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:42.411106 12069 consensus_queue.cc:260] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:42.420883 12068 ts_tablet_manager.cc:1434] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
I20260709 13:18:42.421607 12072 ts_tablet_manager.cc:1434] T 86477bbe25284503970ce70bb1e26190 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:18:42.426510 12072 tablet_bootstrap.cc:492] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:42.431291 12069 ts_tablet_manager.cc:1434] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 13:18:42.432471 12069 tablet_bootstrap.cc:492] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:42.436785 12072 tablet_bootstrap.cc:654] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:42.421424 11945 raft_consensus.cc:2468] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:42.443398 12068 tablet_bootstrap.cc:492] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843: Bootstrap starting.
W20260709 13:18:42.448352 11915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:37961, user_credentials={real_user=slave}} blocked reactor thread for 59069.9us
I20260709 13:18:42.454798 11989 leader_election.cc:304] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:42.457297 12491 raft_consensus.cc:2804] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:42.457919 12491 raft_consensus.cc:493] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.458384 12491 raft_consensus.cc:3060] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:42.458673 11916 leader_election.cc:343] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:42.459226 11916 leader_election.cc:304] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:42.461406 12375 raft_consensus.cc:2749] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:42.462093 12375 consensus_queue.cc:1048] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:42.463457 12070 tablet_bootstrap.cc:492] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
W20260709 13:18:42.468940 11989 leader_election.cc:343] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:42.470209 11989 leader_election.cc:304] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:42.471544 12400 raft_consensus.cc:2804] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:42.472215 12400 raft_consensus.cc:697] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Becoming Leader. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Running, Role: LEADER
I20260709 13:18:42.474334 11796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86477bbe25284503970ce70bb1e26190" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:42.473225 12400 consensus_queue.cc:237] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:42.475603 11796 raft_consensus.cc:2468] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 0.
I20260709 13:18:42.478664 11766 leader_election.cc:304] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:42.480163 12433 raft_consensus.cc:2804] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:42.480578 12433 raft_consensus.cc:493] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.480921 12433 raft_consensus.cc:3060] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:42.482700 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86477bbe25284503970ce70bb1e26190" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:42.483384 11870 raft_consensus.cc:2468] T 86477bbe25284503970ce70bb1e26190 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 0.
I20260709 13:18:42.489462 12068 tablet_bootstrap.cc:654] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:42.492842 11989 leader_election.cc:304] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:42.524477 12273 raft_consensus.cc:2804] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:42.524952 12273 raft_consensus.cc:493] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.525337 12273 raft_consensus.cc:3060] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:42.527081 12182 raft_consensus.cc:493] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.527740 12182 raft_consensus.cc:515] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:42.529256 12376 consensus_queue.cc:1048] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:42.530555 12182 leader_election.cc:290] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
W20260709 13:18:42.511268 11915 leader_election.cc:343] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:42.539835 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eece1e771a0341b1bebc6fde110e6f8a" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:42.519695 12069 tablet_bootstrap.cc:654] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:42.540616 11868 raft_consensus.cc:2468] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:42.489729 12433 raft_consensus.cc:515] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:42.532807 11694 catalog_manager.cc:5697] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f7178f720eb4090a3593087331b82e9 (127.1.227.132). New cstate: current_term: 1 leader_uuid: "1f7178f720eb4090a3593087331b82e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:42.549470 12433 leader_election.cc:290] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:42.569834 12072 tablet_bootstrap.cc:492] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:42.573411 12072 ts_tablet_manager.cc:1403] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.147s	user 0.018s	sys 0.008s
I20260709 13:18:42.519294 12070 tablet_bootstrap.cc:654] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:42.548538 12491 raft_consensus.cc:515] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:42.576193 11766 leader_election.cc:304] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:42.587154 12433 raft_consensus.cc:2804] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:42.587738 12433 raft_consensus.cc:493] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.588201 12433 raft_consensus.cc:3060] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:42.597151 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eece1e771a0341b1bebc6fde110e6f8a" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:42.598246 11949 raft_consensus.cc:2468] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:42.600332 12491 leader_election.cc:290] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:42.601475 11796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678fcf88b458421b960351bc865762c6" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:42.602451 11796 raft_consensus.cc:3060] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:42.611835 11875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55c8d664ee74f0fbb31693f1b398fba" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:42.632965 12273 raft_consensus.cc:515] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:42.643302 12273 leader_election.cc:290] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:42.641844 12433 raft_consensus.cc:515] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:42.643801 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55c8d664ee74f0fbb31693f1b398fba" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:42.644771 11793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86477bbe25284503970ce70bb1e26190" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:42.644879 11949 raft_consensus.cc:3060] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:42.645450 11793 raft_consensus.cc:3060] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:42.646921 12433 leader_election.cc:290] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:42.649202 12072 raft_consensus.cc:359] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:42.649725 12072 raft_consensus.cc:385] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:42.650100 12072 raft_consensus.cc:740] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:42.650907 12072 consensus_queue.cc:260] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
W20260709 13:18:42.659037 11915 leader_election.cc:343] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:42.659520 11915 leader_election.cc:304] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:42.657204 11949 raft_consensus.cc:2468] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:42.667398 11698 catalog_manager.cc:5697] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f7178f720eb4090a3593087331b82e9 (127.1.227.132). New cstate: current_term: 1 leader_uuid: "1f7178f720eb4090a3593087331b82e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:42.670801 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678fcf88b458421b960351bc865762c6" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:42.671145 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eece1e771a0341b1bebc6fde110e6f8a" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:42.671810 11950 raft_consensus.cc:3060] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:42.666576 11766 leader_election.cc:343] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:42.662371 12495 raft_consensus.cc:2749] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:42.675247 12072 ts_tablet_manager.cc:1434] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.101s	user 0.004s	sys 0.003s
I20260709 13:18:42.681527 12068 tablet_bootstrap.cc:492] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843: No bootstrap required, opened a new log
W20260709 13:18:42.681840 11989 leader_election.cc:343] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:42.682338 12068 ts_tablet_manager.cc:1403] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843: Time spent bootstrapping tablet: real 0.239s	user 0.024s	sys 0.046s
I20260709 13:18:42.666383 12290 raft_consensus.cc:493] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.687268 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86477bbe25284503970ce70bb1e26190" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:42.688009 11870 raft_consensus.cc:3060] T 86477bbe25284503970ce70bb1e26190 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:42.688653 12290 raft_consensus.cc:515] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:42.691883 11950 raft_consensus.cc:2468] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:42.696517 12069 tablet_bootstrap.cc:492] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:42.697118 12069 ts_tablet_manager.cc:1403] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.265s	user 0.055s	sys 0.034s
I20260709 13:18:42.702088 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eece1e771a0341b1bebc6fde110e6f8a" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:42.702817 11869 raft_consensus.cc:3060] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:42.683060 11796 raft_consensus.cc:2468] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:42.713831 11766 leader_election.cc:304] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:42.715580 12433 raft_consensus.cc:2804] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:42.716621 12433 raft_consensus.cc:697] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:42.716683 12290 leader_election.cc:290] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:42.718350 11989 leader_election.cc:304] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:42.718894 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765b55f8e8d24e2a9fa6860917b6c5d5" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:42.719231 12491 raft_consensus.cc:2804] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:42.719755 12491 raft_consensus.cc:697] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Becoming Leader. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Running, Role: LEADER
I20260709 13:18:42.722198 11793 raft_consensus.cc:2468] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:42.720577 12491 consensus_queue.cc:237] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
W20260709 13:18:42.721280 11916 leader_election.cc:343] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:42.727298 12072 tablet_bootstrap.cc:492] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:42.732384 11766 leader_election.cc:304] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:42.725975 12069 raft_consensus.cc:359] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:42.734030 12069 raft_consensus.cc:385] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:42.734333 12069 raft_consensus.cc:740] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:42.733227 12193 raft_consensus.cc:2804] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:42.734853 11989 leader_election.cc:304] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:42.736511 12273 raft_consensus.cc:2804] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:42.736351 12068 raft_consensus.cc:359] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:42.737493 12193 raft_consensus.cc:697] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:42.737572 12273 raft_consensus.cc:697] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Becoming Leader. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Running, Role: LEADER
I20260709 13:18:42.738436 12193 consensus_queue.cc:237] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:42.738787 12273 consensus_queue.cc:237] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:42.744211 11869 raft_consensus.cc:2468] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:42.746604 12069 consensus_queue.cc:260] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:42.737227 12068 raft_consensus.cc:385] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:42.747794 12068 raft_consensus.cc:740] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Initialized, Role: FOLLOWER
I20260709 13:18:42.720016 12433 consensus_queue.cc:237] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:42.748883 11870 raft_consensus.cc:2468] T 86477bbe25284503970ce70bb1e26190 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:42.752856 12072 tablet_bootstrap.cc:654] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:42.754019 12068 consensus_queue.cc:260] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:42.759686 12069 ts_tablet_manager.cc:1434] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.002s
I20260709 13:18:42.760800 12069 tablet_bootstrap.cc:492] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:42.776278 12070 tablet_bootstrap.cc:492] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:42.776984 12070 ts_tablet_manager.cc:1403] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.314s	user 0.020s	sys 0.037s
I20260709 13:18:42.781644 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765b55f8e8d24e2a9fa6860917b6c5d5" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:42.781461 12070 raft_consensus.cc:359] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:42.783569 12070 raft_consensus.cc:385] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:42.783913 12070 raft_consensus.cc:740] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:42.784789 12070 consensus_queue.cc:260] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:42.786870 12070 ts_tablet_manager.cc:1434] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:18:42.787703 12068 ts_tablet_manager.cc:1434] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843: Time spent starting tablet: real 0.105s	user 0.005s	sys 0.002s
I20260709 13:18:42.787930 12070 tablet_bootstrap.cc:492] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:42.805163 11694 catalog_manager.cc:5697] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f7178f720eb4090a3593087331b82e9 (127.1.227.132). New cstate: current_term: 1 leader_uuid: "1f7178f720eb4090a3593087331b82e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:42.805575 12489 consensus_queue.cc:1048] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:18:42.807520 12070 tablet_bootstrap.cc:654] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:42.803304 12069 tablet_bootstrap.cc:654] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:42.843755 12418 consensus_queue.cc:1048] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:18:42.854903 11766 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:35995, user_credentials={real_user=slave}} blocked reactor thread for 53523.9us
W20260709 13:18:42.875279 11915 leader_election.cc:343] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:42.877125 11915 leader_election.cc:304] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:42.878448 12495 raft_consensus.cc:2749] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:42.899251 11746 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:42.902199 12072 tablet_bootstrap.cc:492] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:42.902956 12072 ts_tablet_manager.cc:1403] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.176s	user 0.012s	sys 0.006s
I20260709 13:18:42.921096 12491 consensus_queue.cc:1048] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:42.921871 12072 raft_consensus.cc:359] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:42.922608 12072 raft_consensus.cc:385] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:42.922838 12072 raft_consensus.cc:740] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:42.925309 12072 consensus_queue.cc:260] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:42.928443 12072 ts_tablet_manager.cc:1434] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:18:42.929811 12072 tablet_bootstrap.cc:492] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:42.939893 11874 raft_consensus.cc:3060] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:42.941175 12072 tablet_bootstrap.cc:654] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.009518 12069 tablet_bootstrap.cc:492] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:43.010144 12069 ts_tablet_manager.cc:1403] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.250s	user 0.013s	sys 0.010s
I20260709 13:18:43.012194 12489 consensus_queue.cc:1048] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:43.013264 12069 raft_consensus.cc:359] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:43.014161 12069 raft_consensus.cc:385] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.014452 12069 raft_consensus.cc:740] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.016880 12069 consensus_queue.cc:260] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:43.017889 11699 catalog_manager.cc:5697] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.020996 11699 catalog_manager.cc:5697] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.023504 12069 ts_tablet_manager.cc:1434] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:18:43.045181 11698 catalog_manager.cc:5697] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f7178f720eb4090a3593087331b82e9 (127.1.227.132). New cstate: current_term: 1 leader_uuid: "1f7178f720eb4090a3593087331b82e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.074175 12182 raft_consensus.cc:493] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.050696 12489 consensus_queue.cc:1048] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 13:18:43.074982 12182 raft_consensus.cc:515] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:43.078469 12379 raft_consensus.cc:493] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.079030 12379 raft_consensus.cc:515] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:43.081213 12379 leader_election.cc:290] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:43.082093 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e862ca999046aca1a257edebcdfea3" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:43.082530 12182 leader_election.cc:290] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:43.084769 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda29dd1f464af4b5c86ee8ec5bffc4" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
W20260709 13:18:43.086863 11767 leader_election.cc:343] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:43.107322 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda29dd1f464af4b5c86ee8ec5bffc4" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:43.110935 11841 leader_election.cc:304] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:43.112627 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e862ca999046aca1a257edebcdfea3" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:43.113361 11945 raft_consensus.cc:2468] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:43.118350 11766 leader_election.cc:304] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:43.130148 12182 raft_consensus.cc:2804] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:43.130686 12182 raft_consensus.cc:493] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.131088 12182 raft_consensus.cc:3060] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.135385 12069 tablet_bootstrap.cc:492] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:43.187335 12070 tablet_bootstrap.cc:492] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:43.188199 12070 ts_tablet_manager.cc:1403] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.401s	user 0.035s	sys 0.010s
I20260709 13:18:43.198521 12290 raft_consensus.cc:493] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.204051 12290 raft_consensus.cc:515] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:43.207525 12182 raft_consensus.cc:515] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:43.212816 12193 consensus_queue.cc:1048] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:43.214748 12453 raft_consensus.cc:2749] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:43.215557 12429 raft_consensus.cc:493] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.216655 12429 raft_consensus.cc:515] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:43.218791 12429 leader_election.cc:290] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:43.221050 12072 tablet_bootstrap.cc:492] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:43.221586 12072 ts_tablet_manager.cc:1403] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.292s	user 0.027s	sys 0.019s
I20260709 13:18:43.226354 12489 raft_consensus.cc:493] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.226976 12489 raft_consensus.cc:515] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:43.228525 12069 tablet_bootstrap.cc:654] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.229192 12489 leader_election.cc:290] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:43.232144 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ca7758d7240519907444b2ba2c15f" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:43.232815 11950 raft_consensus.cc:2468] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:43.232985 12072 raft_consensus.cc:359] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:43.233409 11872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ca7758d7240519907444b2ba2c15f" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:43.233880 12072 raft_consensus.cc:385] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.234201 12072 raft_consensus.cc:740] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.235082 12072 consensus_queue.cc:260] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:43.239136 12290 leader_election.cc:290] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:43.241780 12070 raft_consensus.cc:359] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:43.242552 12070 raft_consensus.cc:385] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.242837 12070 raft_consensus.cc:740] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.243501 12070 consensus_queue.cc:260] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:43.249778 12072 ts_tablet_manager.cc:1434] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
W20260709 13:18:43.251624 11989 consensus_peers.cc:597] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 -> Peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Couldn't send request to peer 7283c2ba87e94087b9ac5dcb372c4e1d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:43.257149 12182 leader_election.cc:290] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:43.251345 12072 tablet_bootstrap.cc:492] T 678fcf88b458421b960351bc865762c6 P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:43.262012 11874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765b55f8e8d24e2a9fa6860917b6c5d5" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:43.262750 12489 consensus_queue.cc:1048] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:43.263505 11874 raft_consensus.cc:2468] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 0.
I20260709 13:18:43.266343 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83da445e9a4d483e8d2504e806a4461b" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:43.270161 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765b55f8e8d24e2a9fa6860917b6c5d5" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:43.271986 12070 ts_tablet_manager.cc:1434] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.001s
I20260709 13:18:43.272264 12491 consensus_queue.cc:1048] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:43.273218 12070 tablet_bootstrap.cc:492] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
I20260709 13:18:43.280737 12069 tablet_bootstrap.cc:492] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:43.281294 12069 ts_tablet_manager.cc:1403] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.159s	user 0.014s	sys 0.000s
W20260709 13:18:43.281141 11916 leader_election.cc:343] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:43.271075 11947 raft_consensus.cc:2468] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 0.
I20260709 13:18:43.285076 12069 raft_consensus.cc:359] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:43.286018 12069 raft_consensus.cc:385] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.286475 12069 raft_consensus.cc:740] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.289315 12069 consensus_queue.cc:260] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:43.292877 11989 leader_election.cc:304] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:43.303514 12273 consensus_queue.cc:1048] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:43.304204 12069 ts_tablet_manager.cc:1434] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:18:43.296345 12489 raft_consensus.cc:2804] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:18:43.311105 11766 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:43333, user_credentials={real_user=slave}} blocked reactor thread for 57954us
W20260709 13:18:43.313187 11766 leader_election.cc:343] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:43.324147 12069 tablet_bootstrap.cc:492] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:43.312871 12489 raft_consensus.cc:493] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.333356 11874 raft_consensus.cc:3060] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.323515 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e862ca999046aca1a257edebcdfea3" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:43.327819 12489 raft_consensus.cc:3060] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.362221 12070 tablet_bootstrap.cc:654] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.365789 12072 tablet_bootstrap.cc:654] T 678fcf88b458421b960351bc865762c6 P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.350869 11945 raft_consensus.cc:3060] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.370018 11794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83da445e9a4d483e8d2504e806a4461b" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:43.385000 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e862ca999046aca1a257edebcdfea3" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:43.390774 12491 raft_consensus.cc:493] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.391304 12491 raft_consensus.cc:515] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:43.393401 12491 leader_election.cc:290] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:43.397023 11795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9780438f22284df785414db0646df50e" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:43.397817 11795 raft_consensus.cc:2468] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 0.
I20260709 13:18:43.400579 12069 tablet_bootstrap.cc:654] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.401980 11989 leader_election.cc:304] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:43.402925 12273 raft_consensus.cc:2804] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:43.403398 12273 raft_consensus.cc:493] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.403723 12273 raft_consensus.cc:3060] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:43.405162 11767 leader_election.cc:343] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:43.437619 11766 leader_election.cc:304] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:43.460099 12532 consensus_queue.cc:1048] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:43.464390 12512 raft_consensus.cc:2804] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:43.464812 12512 raft_consensus.cc:493] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.465152 12512 raft_consensus.cc:3060] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.475935 12273 raft_consensus.cc:515] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
W20260709 13:18:43.483940 11915 leader_election.cc:343] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:43.484706 11915 leader_election.cc:304] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:43.469898 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9780438f22284df785414db0646df50e" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:43.502763 12273 leader_election.cc:290] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
W20260709 13:18:43.508213 11767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:38909, user_credentials={real_user=slave}} blocked reactor thread for 44156.9us
I20260709 13:18:43.510883 12375 raft_consensus.cc:2749] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:43.534364 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9780438f22284df785414db0646df50e" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:43.535900 11945 raft_consensus.cc:2468] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:43.537120 12489 raft_consensus.cc:515] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:43.544872 12453 raft_consensus.cc:493] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.545614 12453 raft_consensus.cc:515] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
W20260709 13:18:43.555816 11915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:37961, user_credentials={real_user=slave}} blocked reactor thread for 71928.4us
W20260709 13:18:43.560484 11766 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:43333, user_credentials={real_user=slave}} blocked reactor thread for 47772.9us
I20260709 13:18:43.596786 12069 tablet_bootstrap.cc:492] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72: No bootstrap required, opened a new log
I20260709 13:18:43.597622 12069 ts_tablet_manager.cc:1403] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.283s	user 0.019s	sys 0.006s
W20260709 13:18:43.599887 11767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:38909, user_credentials={real_user=slave}} blocked reactor thread for 44141us
I20260709 13:18:43.609076 12072 tablet_bootstrap.cc:492] T 678fcf88b458421b960351bc865762c6 P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:43.609684 12072 ts_tablet_manager.cc:1403] T 678fcf88b458421b960351bc865762c6 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.359s	user 0.020s	sys 0.011s
I20260709 13:18:43.612798 12539 consensus_queue.cc:1048] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:18:43.610409 12538 consensus_queue.cc:1048] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:18:43.620903 12072 raft_consensus.cc:359] T 678fcf88b458421b960351bc865762c6 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:43.621719 12072 raft_consensus.cc:385] T 678fcf88b458421b960351bc865762c6 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.622035 12072 raft_consensus.cc:740] T 678fcf88b458421b960351bc865762c6 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.624221 12070 tablet_bootstrap.cc:492] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:43.624820 12070 ts_tablet_manager.cc:1403] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.352s	user 0.016s	sys 0.024s
I20260709 13:18:43.634740 12489 leader_election.cc:290] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:43.636206 12070 raft_consensus.cc:359] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:43.636955 12070 raft_consensus.cc:385] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.637226 12070 raft_consensus.cc:740] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.641058 12069 raft_consensus.cc:359] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:43.642257 12069 raft_consensus.cc:385] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.642598 12069 raft_consensus.cc:740] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.643239 12069 consensus_queue.cc:260] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:43.645280 12512 raft_consensus.cc:515] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:43.648160 12512 leader_election.cc:290] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:43.650233 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ca7758d7240519907444b2ba2c15f" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:43.635215 12072 consensus_queue.cc:260] T 678fcf88b458421b960351bc865762c6 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:43.653192 11796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9780438f22284df785414db0646df50e" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
I20260709 13:18:43.654332 11796 raft_consensus.cc:3060] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.654131 12070 consensus_queue.cc:260] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:43.653692 12072 ts_tablet_manager.cc:1434] T 678fcf88b458421b960351bc865762c6 P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.044s	user 0.003s	sys 0.003s
I20260709 13:18:43.657902 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55c8d664ee74f0fbb31693f1b398fba" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:43.657994 12072 tablet_bootstrap.cc:492] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:43.641649 12453 leader_election.cc:290] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
W20260709 13:18:43.670804 11766 leader_election.cc:343] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:43.674348 11766 leader_election.cc:304] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:43.675067 12182 raft_consensus.cc:2804] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:43.675503 12182 raft_consensus.cc:697] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:43.676246 12182 consensus_queue.cc:237] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:43.680498 12069 ts_tablet_manager.cc:1434] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.082s	user 0.004s	sys 0.002s
I20260709 13:18:43.683115 11795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55c8d664ee74f0fbb31693f1b398fba" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:43.685037 12070 ts_tablet_manager.cc:1434] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.002s
I20260709 13:18:43.684981 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ca7758d7240519907444b2ba2c15f" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:43.690321 11949 raft_consensus.cc:3060] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.694787 11841 leader_election.cc:304] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:43.699608 11949 raft_consensus.cc:2468] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
W20260709 13:18:43.666712 11989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:43333, user_credentials={real_user=slave}} blocked reactor thread for 119784us
I20260709 13:18:43.707852 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765b55f8e8d24e2a9fa6860917b6c5d5" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:43.708520 11869 raft_consensus.cc:3060] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.718114 12072 tablet_bootstrap.cc:654] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:43.772644 11767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:38909, user_credentials={real_user=slave}} blocked reactor thread for 44856.4us
W20260709 13:18:43.773566 11989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:37961, user_credentials={real_user=slave}} blocked reactor thread for 44928.2us
I20260709 13:18:43.779091 11869 raft_consensus.cc:2468] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:43.781155 12070 tablet_bootstrap.cc:492] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9: Bootstrap starting.
W20260709 13:18:43.776954 11989 leader_election.cc:343] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:43.783408 11989 leader_election.cc:343] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:43.785719 11989 leader_election.cc:304] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
W20260709 13:18:43.786150 12533 log.cc:927] Time spent T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:43.809680 11766 leader_election.cc:304] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:43.788466 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765b55f8e8d24e2a9fa6860917b6c5d5" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:43.825677 12182 raft_consensus.cc:2804] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:43.830470 12182 raft_consensus.cc:697] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:43.831349 12182 consensus_queue.cc:237] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:43.832481 11796 raft_consensus.cc:2468] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:43.825158 11869 raft_consensus.cc:3060] T 678fcf88b458421b960351bc865762c6 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.807339 12489 raft_consensus.cc:2804] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:43.836206 12489 raft_consensus.cc:697] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Becoming Leader. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Running, Role: LEADER
I20260709 13:18:43.837139 12489 consensus_queue.cc:237] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:18:43.839395 11949 raft_consensus.cc:3060] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.811385 12453 raft_consensus.cc:2749] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:43.861182 11949 raft_consensus.cc:2468] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:43.895576 11989 leader_election.cc:304] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:43.899341 12400 raft_consensus.cc:2804] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:43.899883 12400 raft_consensus.cc:697] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Becoming Leader. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Running, Role: LEADER
I20260709 13:18:43.900734 12400 consensus_queue.cc:237] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:43.954413 12070 tablet_bootstrap.cc:654] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.963642 12524 raft_consensus.cc:493] T 678fcf88b458421b960351bc865762c6 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f7178f720eb4090a3593087331b82e9)
I20260709 13:18:43.964468 12524 raft_consensus.cc:515] T 678fcf88b458421b960351bc865762c6 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:43.965886 12072 tablet_bootstrap.cc:492] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:43.966468 12072 ts_tablet_manager.cc:1403] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.309s	user 0.014s	sys 0.002s
I20260709 13:18:43.969194 12072 raft_consensus.cc:359] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:43.989931 12072 raft_consensus.cc:385] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.990281 12072 raft_consensus.cc:740] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
W20260709 13:18:43.985617 11766 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:35995, user_credentials={real_user=slave}} blocked reactor thread for 56325.1us
I20260709 13:18:43.993673 12072 consensus_queue.cc:260] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:44.009820 12550 raft_consensus.cc:493] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.010390 12550 raft_consensus.cc:515] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:44.012771 12550 leader_election.cc:290] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:44.010370 12072 ts_tablet_manager.cc:1434] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:18:44.017256 12072 tablet_bootstrap.cc:492] T 9780438f22284df785414db0646df50e P 7283c2ba87e94087b9ac5dcb372c4e1d: Bootstrap starting.
I20260709 13:18:44.023713 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678fcf88b458421b960351bc865762c6" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:44.028865 11698 catalog_manager.cc:5697] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:44.032747 11746 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:44.048727 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83da445e9a4d483e8d2504e806a4461b" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:44.049703 11949 raft_consensus.cc:2468] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 0.
I20260709 13:18:44.052083 12072 tablet_bootstrap.cc:654] T 9780438f22284df785414db0646df50e P 7283c2ba87e94087b9ac5dcb372c4e1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.027518 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83da445e9a4d483e8d2504e806a4461b" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
W20260709 13:18:44.056668 11767 leader_election.cc:343] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:44.063503 11796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678fcf88b458421b960351bc865762c6" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:44.075649 11766 leader_election.cc:304] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:44.078655 12193 raft_consensus.cc:2804] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:44.079049 12193 raft_consensus.cc:493] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.079362 12193 raft_consensus.cc:3060] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.096522 12070 tablet_bootstrap.cc:492] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9: No bootstrap required, opened a new log
I20260709 13:18:44.097113 12070 ts_tablet_manager.cc:1403] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9: Time spent bootstrapping tablet: real 0.374s	user 0.010s	sys 0.009s
I20260709 13:18:44.100682 12070 raft_consensus.cc:359] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:44.101667 12070 raft_consensus.cc:385] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.102313 12070 raft_consensus.cc:740] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.105629 12070 consensus_queue.cc:260] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:44.112903 12524 leader_election.cc:290] T 678fcf88b458421b960351bc865762c6 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:44.101017 12400 raft_consensus.cc:493] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.121209 12070 ts_tablet_manager.cc:1434] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
W20260709 13:18:44.128008 11841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:37961, user_credentials={real_user=slave}} blocked reactor thread for 60020.1us
I20260709 13:18:44.131364 12072 tablet_bootstrap.cc:492] T 9780438f22284df785414db0646df50e P 7283c2ba87e94087b9ac5dcb372c4e1d: No bootstrap required, opened a new log
I20260709 13:18:44.131928 12072 ts_tablet_manager.cc:1403] T 9780438f22284df785414db0646df50e P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent bootstrapping tablet: real 0.115s	user 0.012s	sys 0.003s
I20260709 13:18:44.139139 12072 raft_consensus.cc:359] T 9780438f22284df785414db0646df50e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:44.139843 12072 raft_consensus.cc:385] T 9780438f22284df785414db0646df50e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.140084 12072 raft_consensus.cc:740] T 9780438f22284df785414db0646df50e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Initialized, Role: FOLLOWER
W20260709 13:18:44.120450 11842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:38909, user_credentials={real_user=slave}} blocked reactor thread for 47421.6us
I20260709 13:18:44.124271 12400 raft_consensus.cc:515] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:44.140714 12072 consensus_queue.cc:260] T 9780438f22284df785414db0646df50e P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:44.141480 12193 raft_consensus.cc:515] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:44.149159 12543 raft_consensus.cc:493] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.150174 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83da445e9a4d483e8d2504e806a4461b" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:44.152241 11947 raft_consensus.cc:3060] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.152308 12193 leader_election.cc:290] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:44.153918 12072 ts_tablet_manager.cc:1434] T 9780438f22284df785414db0646df50e P 7283c2ba87e94087b9ac5dcb372c4e1d: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:18:44.154048 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83da445e9a4d483e8d2504e806a4461b" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:44.150602 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e862ca999046aca1a257edebcdfea3" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:44.156782 11950 raft_consensus.cc:2393] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f7178f720eb4090a3593087331b82e9 in current term 1: Already voted for candidate bdbe2261c337471ea4d0c980ebb80c72 in this term.
I20260709 13:18:44.151412 11795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e862ca999046aca1a257edebcdfea3" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:44.149768 12543 raft_consensus.cc:515] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:44.161886 12016 raft_consensus.cc:3060] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.162956 12565 raft_consensus.cc:493] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.163511 12565 raft_consensus.cc:515] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:44.165782 12565 leader_election.cc:290] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:44.161610 12543 leader_election.cc:290] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:44.170477 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83da445e9a4d483e8d2504e806a4461b" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:44.173216 11989 leader_election.cc:304] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:44.174502 11795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83da445e9a4d483e8d2504e806a4461b" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:44.182955 11841 leader_election.cc:304] T 678fcf88b458421b960351bc865762c6 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:44.183434 12543 raft_consensus.cc:3060] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.183761 11795 raft_consensus.cc:2393] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f7178f720eb4090a3593087331b82e9 in current term 1: Already voted for candidate bdbe2261c337471ea4d0c980ebb80c72 in this term.
I20260709 13:18:44.193308 12543 raft_consensus.cc:2749] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:44.195930 11989 leader_election.cc:304] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:44.149528 12400 leader_election.cc:290] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:44.199571 12016 raft_consensus.cc:2468] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:44.200101 12491 raft_consensus.cc:2749] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:44.202411 11767 leader_election.cc:304] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:18:44.203229 12182 raft_consensus.cc:2804] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:44.203709 12182 raft_consensus.cc:697] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:18:44.204352 12182 consensus_queue.cc:237] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:44.204820 12565 raft_consensus.cc:2749] T 678fcf88b458421b960351bc865762c6 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:44.211796 11795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ca7758d7240519907444b2ba2c15f" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:44.211977 11949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ca7758d7240519907444b2ba2c15f" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:44.212814 11949 raft_consensus.cc:2393] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7283c2ba87e94087b9ac5dcb372c4e1d in current term 1: Already voted for candidate bdbe2261c337471ea4d0c980ebb80c72 in this term.
I20260709 13:18:44.221246 11947 raft_consensus.cc:2468] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 1.
I20260709 13:18:44.222718 12512 consensus_queue.cc:1048] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:44.233039 12512 consensus_queue.cc:1048] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:44.235003 11841 leader_election.cc:304] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:44.235190 11869 raft_consensus.cc:3060] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.251947 12565 raft_consensus.cc:2749] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:44.265074 12400 consensus_queue.cc:1048] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:44.268859 12182 consensus_queue.cc:1048] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:18:44.313932 12193 consensus_queue.cc:1048] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:44.323905 11695 catalog_manager.cc:5697] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 7283c2ba87e94087b9ac5dcb372c4e1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f7178f720eb4090a3593087331b82e9 (127.1.227.132). New cstate: current_term: 1 leader_uuid: "1f7178f720eb4090a3593087331b82e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } }
I20260709 13:18:44.329810 12548 consensus_queue.cc:1048] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:44.340647 12564 raft_consensus.cc:493] T 9780438f22284df785414db0646df50e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.341168 12564 raft_consensus.cc:515] T 9780438f22284df785414db0646df50e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:44.343724 12564 leader_election.cc:290] T 9780438f22284df785414db0646df50e P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:44.347999 11696 catalog_manager.cc:5697] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f7178f720eb4090a3593087331b82e9 (127.1.227.132). New cstate: current_term: 1 leader_uuid: "1f7178f720eb4090a3593087331b82e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:44.349879 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9780438f22284df785414db0646df50e" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:44.355178 11801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9780438f22284df785414db0646df50e" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72" is_pre_election: true
I20260709 13:18:44.356127 11801 raft_consensus.cc:2393] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7283c2ba87e94087b9ac5dcb372c4e1d in current term 1: Already voted for candidate 1f7178f720eb4090a3593087331b82e9 in this term.
I20260709 13:18:44.372612 12491 consensus_queue.cc:1048] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:44.375341 11841 leader_election.cc:304] T 9780438f22284df785414db0646df50e P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:44.375483 11695 catalog_manager.cc:5697] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } }
I20260709 13:18:44.388753 11694 catalog_manager.cc:5697] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:44.394187 12565 raft_consensus.cc:3060] T 9780438f22284df785414db0646df50e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.436538 12565 raft_consensus.cc:2749] T 9780438f22284df785414db0646df50e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:44.445971 12491 consensus_queue.cc:1048] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:44.819697 12512 consensus_queue.cc:1048] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:18:44.837668 12512 consensus_queue.cc:1048] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:45.536285  1934 tablet_server.cc:179] TabletServer@127.1.227.129:0 shutting down...
W20260709 13:18:45.574012 11841 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 13:18:45.589572 11841 consensus_peers.cc:597] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.590327 11841 consensus_peers.cc:597] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.599471 11989 consensus_peers.cc:597] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.616552 11989 consensus_peers.cc:597] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.627592  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:45.628811  1934 tablet_replica.cc:333] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.629709  1934 raft_consensus.cc:2243] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.630878  1934 raft_consensus.cc:2272] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.633350  1934 tablet_replica.cc:333] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.634145  1934 raft_consensus.cc:2243] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.634968  1934 raft_consensus.cc:2272] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.637008  1934 tablet_replica.cc:333] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.637714  1934 raft_consensus.cc:2243] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.638269  1934 raft_consensus.cc:2272] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.641157  1934 tablet_replica.cc:333] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.642355  1934 raft_consensus.cc:2243] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.643095  1934 raft_consensus.cc:2272] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.646257  1934 tablet_replica.cc:333] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.647135  1934 raft_consensus.cc:2243] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.648017  1934 raft_consensus.cc:2272] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.660527 11915 consensus_peers.cc:597] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.665800  1934 tablet_replica.cc:333] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.667994  1934 raft_consensus.cc:2243] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.668641  1934 raft_consensus.cc:2272] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.676654  1934 tablet_replica.cc:333] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.677493  1934 raft_consensus.cc:2243] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.678083  1934 raft_consensus.cc:2272] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.679749 11915 consensus_peers.cc:597] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.682240  1934 tablet_replica.cc:333] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.683068  1934 raft_consensus.cc:2243] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.684063  1934 raft_consensus.cc:2272] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.687266  1934 tablet_replica.cc:333] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.687934  1934 raft_consensus.cc:2243] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:45.688153 11915 consensus_peers.cc:597] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.688400  1934 raft_consensus.cc:2272] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.691680  1934 tablet_replica.cc:333] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.692575  1934 raft_consensus.cc:2243] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.693683  1934 raft_consensus.cc:2272] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.695941  1934 tablet_replica.cc:333] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.696672  1934 raft_consensus.cc:2243] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.697192  1934 raft_consensus.cc:2272] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.701769  1934 tablet_replica.cc:333] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.703035  1934 raft_consensus.cc:2243] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.704495  1934 raft_consensus.cc:2272] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.708146 11915 consensus_peers.cc:597] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.710153  1934 tablet_replica.cc:333] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.710978  1934 raft_consensus.cc:2243] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.711548  1934 raft_consensus.cc:2272] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.713675  1934 tablet_replica.cc:333] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.714361  1934 raft_consensus.cc:2243] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.714874  1934 raft_consensus.cc:2272] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.717043  1934 tablet_replica.cc:333] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.717859  1934 raft_consensus.cc:2243] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.718911  1934 raft_consensus.cc:2272] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.721381  1934 tablet_replica.cc:333] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.722252  1934 raft_consensus.cc:2243] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.723204  1934 raft_consensus.cc:2272] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.725606  1934 tablet_replica.cc:333] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.726254  1934 raft_consensus.cc:2243] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.726758  1934 raft_consensus.cc:2272] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.729264  1934 tablet_replica.cc:333] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.730214  1934 raft_consensus.cc:2243] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.731240  1934 raft_consensus.cc:2272] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.734277  1934 tablet_replica.cc:333] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.735069  1934 raft_consensus.cc:2243] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.735997  1934 raft_consensus.cc:2272] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.738850  1934 tablet_replica.cc:333] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.739854  1934 raft_consensus.cc:2243] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.740959  1934 raft_consensus.cc:2272] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.743160  1934 tablet_replica.cc:333] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.743956  1934 raft_consensus.cc:2243] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.744510  1934 raft_consensus.cc:2272] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.747074  1934 tablet_replica.cc:333] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.747905  1934 raft_consensus.cc:2243] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.748497  1934 raft_consensus.cc:2272] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.748947 11989 consensus_peers.cc:597] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.751814  1934 tablet_replica.cc:333] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.752844  1934 raft_consensus.cc:2243] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.753949  1934 raft_consensus.cc:2272] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.756754  1934 tablet_replica.cc:333] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.757448  1934 raft_consensus.cc:2243] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.758371  1934 raft_consensus.cc:2272] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.760680  1934 tablet_replica.cc:333] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.761298  1934 raft_consensus.cc:2243] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.762197  1934 raft_consensus.cc:2272] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.764653  1934 tablet_replica.cc:333] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.765249  1934 raft_consensus.cc:2243] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.765748  1934 raft_consensus.cc:2272] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.768280  1934 tablet_replica.cc:333] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.768953  1934 raft_consensus.cc:2243] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.769876  1934 raft_consensus.cc:2272] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.772310  1934 tablet_replica.cc:333] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.772955  1934 raft_consensus.cc:2243] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.774055  1934 raft_consensus.cc:2272] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.776881  1934 tablet_replica.cc:333] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.777621  1934 raft_consensus.cc:2243] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.778249  1934 raft_consensus.cc:2272] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.781026  1934 tablet_replica.cc:333] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.781694  1934 raft_consensus.cc:2243] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.782300  1934 raft_consensus.cc:2272] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.783223 11915 consensus_peers.cc:597] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.785449  1934 tablet_replica.cc:333] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.786425  1934 raft_consensus.cc:2243] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.786984  1934 raft_consensus.cc:2272] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.789594  1934 tablet_replica.cc:333] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.790505  1934 raft_consensus.cc:2243] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.791100  1934 raft_consensus.cc:2272] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.794005  1934 tablet_replica.cc:333] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.794804  1934 raft_consensus.cc:2243] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.795883  1934 raft_consensus.cc:2272] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.796344 11989 consensus_peers.cc:597] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.798414  1934 tablet_replica.cc:333] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.799378  1934 raft_consensus.cc:2243] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.800508  1934 raft_consensus.cc:2272] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.803728  1934 tablet_replica.cc:333] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.804610  1934 raft_consensus.cc:2243] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.805776  1934 raft_consensus.cc:2272] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.806066 11989 consensus_peers.cc:597] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.808594  1934 tablet_replica.cc:333] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.809477  1934 raft_consensus.cc:2243] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.810058  1934 raft_consensus.cc:2272] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.813015  1934 tablet_replica.cc:333] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.813827  1934 raft_consensus.cc:2243] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.814433  1934 raft_consensus.cc:2272] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.817394  1934 tablet_replica.cc:333] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.818253  1934 raft_consensus.cc:2243] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.818802  1934 raft_consensus.cc:2272] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.822070  1934 tablet_replica.cc:333] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.822736  1934 raft_consensus.cc:2243] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.823712  1934 raft_consensus.cc:2272] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.824807 11915 consensus_peers.cc:597] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.826130  1934 tablet_replica.cc:333] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.826962  1934 raft_consensus.cc:2243] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.827859  1934 raft_consensus.cc:2272] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.830294  1934 tablet_replica.cc:333] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.831007  1934 raft_consensus.cc:2243] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.831928  1934 raft_consensus.cc:2272] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.834530  1934 tablet_replica.cc:333] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.835143  1934 raft_consensus.cc:2243] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.835666  1934 raft_consensus.cc:2272] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.837997  1934 tablet_replica.cc:333] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.838562  1934 raft_consensus.cc:2243] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.839360  1934 raft_consensus.cc:2272] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.842025  1934 tablet_replica.cc:333] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.842777  1934 raft_consensus.cc:2243] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.843351  1934 raft_consensus.cc:2272] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.845587  1934 tablet_replica.cc:333] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72: stopping tablet replica
I20260709 13:18:45.846212  1934 raft_consensus.cc:2243] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.846711  1934 raft_consensus.cc:2272] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.879693 11989 consensus_peers.cc:597] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.902889 11915 consensus_peers.cc:597] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.903077 11989 consensus_peers.cc:597] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.911016 11989 consensus_peers.cc:597] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.943213 11915 consensus_peers.cc:597] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.944800 11915 consensus_peers.cc:597] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.027714 11915 consensus_peers.cc:597] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.047324 11841 consensus_peers.cc:597] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.057679 11841 consensus_peers.cc:597] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.081655 11915 consensus_peers.cc:597] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.716152 12586 raft_consensus.cc:493] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.716789 12586 raft_consensus.cc:515] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:46.719980 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cc9444f841f4d768a714f7462f1cf6e" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:46.720104 12586 leader_election.cc:290] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
W20260709 13:18:46.724800 11841 leader_election.cc:336] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.725275 11841 leader_election.cc:304] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:46.726020 12586 raft_consensus.cc:2749] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.762158 12543 raft_consensus.cc:493] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.762903 12543 raft_consensus.cc:515] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:46.767864 12543 leader_election.cc:290] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:46.769964 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7991b50605d0412aa1b3b5e79de17e01" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:46.770766 12586 raft_consensus.cc:493] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
W20260709 13:18:46.772735 11989 leader_election.cc:336] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.775358 12586 raft_consensus.cc:515] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:46.775846 11989 leader_election.cc:304] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:46.777577 12548 raft_consensus.cc:2749] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.778582 12548 raft_consensus.cc:493] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.779078 12548 raft_consensus.cc:515] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:46.780761 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8e389bf22e48259f4d63c2c12f4713" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:46.781356 12548 leader_election.cc:290] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:46.777595 12586 leader_election.cc:290] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:46.784319 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf1f22d4f144109fe8d089d54dd5e6" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
W20260709 13:18:46.788153 11989 leader_election.cc:336] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.788590 11989 leader_election.cc:304] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
W20260709 13:18:46.789099 11841 leader_election.cc:336] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.791134 11841 leader_election.cc:304] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:46.791919 12586 raft_consensus.cc:2749] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.789316 12548 raft_consensus.cc:2749] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.802292 12515 raft_consensus.cc:493] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.802872 12515 raft_consensus.cc:515] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:46.806439 12515 leader_election.cc:290] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:46.807474 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eece1e771a0341b1bebc6fde110e6f8a" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:46.811050 12495 raft_consensus.cc:493] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.811653 12495 raft_consensus.cc:515] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:46.813795 12495 leader_election.cc:290] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
W20260709 13:18:46.817013 11915 leader_election.cc:336] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.817602 11915 leader_election.cc:304] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:46.820628 12495 raft_consensus.cc:2749] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.823655 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59c45da3f3f43a5b793c3305865da17" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:46.825201 12548 raft_consensus.cc:493] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
W20260709 13:18:46.824873 11915 leader_election.cc:336] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.826058 12548 raft_consensus.cc:515] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:46.828181 12548 leader_election.cc:290] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:46.829293 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e862ca999046aca1a257edebcdfea3" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
W20260709 13:18:46.832473 11989 leader_election.cc:336] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.832563 11915 leader_election.cc:304] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:46.832917 11989 leader_election.cc:304] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:46.833433 12495 raft_consensus.cc:2749] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.833686 12548 raft_consensus.cc:2749] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.842872 12586 raft_consensus.cc:493] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.843339 12586 raft_consensus.cc:515] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:46.845157 12586 leader_election.cc:290] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:46.845803 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7991b50605d0412aa1b3b5e79de17e01" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:46.848610 12022 raft_consensus.cc:2468] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:46.849820 11842 leader_election.cc:304] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
W20260709 13:18:46.850416 11841 leader_election.cc:336] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.850699 12586 raft_consensus.cc:2804] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:46.851109 12586 raft_consensus.cc:493] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.851504 12586 raft_consensus.cc:3060] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:46.857132 12586 raft_consensus.cc:515] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:46.859717 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7991b50605d0412aa1b3b5e79de17e01" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:46.859843 12543 raft_consensus.cc:493] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.860374 12022 raft_consensus.cc:3060] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:46.860479 12543 raft_consensus.cc:515] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:46.861150 12586 leader_election.cc:290] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:46.862816 12543 leader_election.cc:290] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:46.865383 12543 raft_consensus.cc:493] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.866127 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4758afc104744a481a25b59661b80fe" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:46.866039 12543 raft_consensus.cc:515] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:46.870019 12548 raft_consensus.cc:493] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.870901 12548 raft_consensus.cc:515] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:46.872768 12543 leader_election.cc:290] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:46.875645 12548 leader_election.cc:290] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:46.878002 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df332d97fcd742e3b0f2024da1850b81" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
W20260709 13:18:46.879639 11989 leader_election.cc:336] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.880669 11989 leader_election.cc:304] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:46.882408 12548 raft_consensus.cc:2749] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.883082 12022 raft_consensus.cc:2468] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 2.
I20260709 13:18:46.883605 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52730cf917140dfaced7ad6cf28f5f7" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
W20260709 13:18:46.885301 11989 leader_election.cc:336] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.886377 11989 leader_election.cc:304] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:46.887545 11842 leader_election.cc:304] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:46.888338 12586 raft_consensus.cc:2804] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:46.888851 12548 raft_consensus.cc:2749] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.890288 12586 raft_consensus.cc:697] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 LEADER]: Becoming Leader. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
W20260709 13:18:46.890866 11989 leader_election.cc:336] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.891258 11989 leader_election.cc:304] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:46.891319 12586 consensus_queue.cc:237] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:46.891853 12548 raft_consensus.cc:2749] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.892554 12564 raft_consensus.cc:493] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.893019 12564 raft_consensus.cc:515] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:46.893885 12495 raft_consensus.cc:493] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.894568 12564 leader_election.cc:290] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:46.896350 12548 raft_consensus.cc:493] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.894579 12495 raft_consensus.cc:515] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:46.896868 12548 raft_consensus.cc:515] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
W20260709 13:18:46.888065 11841 leader_election.cc:336] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.898847 12548 leader_election.cc:290] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:46.900543 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6ff283134a4463af9ad09ed3ac81ce" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:46.900907 12495 leader_election.cc:290] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
W20260709 13:18:46.905659 11915 leader_election.cc:336] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:18:46.912137 11841 leader_election.cc:336] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.913134 12548 raft_consensus.cc:493] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.913524 11841 leader_election.cc:304] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:46.913633 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f5eb834fe84f7cadb173cc0fc58b2f" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:46.913875 12548 raft_consensus.cc:515] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:46.911397 11696 catalog_manager.cc:5697] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d reported cstate change: term changed from 1 to 2, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130). New cstate: current_term: 2 leader_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:46.913002 12495 raft_consensus.cc:493] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.916229 12548 leader_election.cc:290] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:46.916316 12495 raft_consensus.cc:515] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:46.917305 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df332d97fcd742e3b0f2024da1850b81" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:46.920164 12022 raft_consensus.cc:2468] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:46.917908 12586 raft_consensus.cc:2749] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.921237 12543 raft_consensus.cc:493] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.921882 12543 raft_consensus.cc:515] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:46.924070 12543 leader_election.cc:290] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:46.924631 12495 leader_election.cc:290] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
W20260709 13:18:46.929461 11915 leader_election.cc:336] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.929584 12548 raft_consensus.cc:493] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.930276 12548 raft_consensus.cc:515] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:46.930682 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f1d538ab1446f182128209d64b34be" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:46.932628 12548 leader_election.cc:290] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:46.935151 11916 leader_election.cc:304] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: bdbe2261c337471ea4d0c980ebb80c72
W20260709 13:18:46.936909 11989 leader_election.cc:336] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.937039 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9288763b344f2fb95940d6a0ce7bcd" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:46.937968 12495 raft_consensus.cc:2804] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:46.938370 12495 raft_consensus.cc:493] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.938721 12495 raft_consensus.cc:3060] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:46.941180 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e862ca999046aca1a257edebcdfea3" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:46.941206 11989 leader_election.cc:304] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:46.942062 12022 raft_consensus.cc:2468] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:46.942229 12543 raft_consensus.cc:2749] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:46.942777  1934 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 11822)
I20260709 13:18:46.943580 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdcb9800b8894d978568cd9ad81bdd31" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:46.943925 12515 raft_consensus.cc:493] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.944522 12515 raft_consensus.cc:515] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
W20260709 13:18:46.945384 11989 leader_election.cc:336] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.945880 11989 leader_election.cc:304] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:46.946805 12515 leader_election.cc:290] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:46.946842 12543 raft_consensus.cc:2749] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.950495 12586 raft_consensus.cc:493] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.951073 12586 raft_consensus.cc:515] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:46.953672 12586 leader_election.cc:290] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:46.956092 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f5c73ecd474b45ae6c27ca1f1046a1" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:46.950258 12495 raft_consensus.cc:515] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
W20260709 13:18:46.959606 11989 leader_election.cc:336] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.959946 12495 leader_election.cc:290] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
W20260709 13:18:46.960731 11841 leader_election.cc:336] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.961462 11841 leader_election.cc:304] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:46.962415 12586 raft_consensus.cc:2749] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:46.965456 11915 leader_election.cc:336] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.967625 12586 raft_consensus.cc:493] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.968216 12586 raft_consensus.cc:515] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:46.968537 11916 leader_election.cc:304] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:46.969789 12515 raft_consensus.cc:2804] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:46.970173 12515 raft_consensus.cc:493] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.970443 12586 leader_election.cc:290] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:46.971704 11989 leader_election.cc:304] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:46.970534 12515 raft_consensus.cc:3060] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:46.975590 12543 raft_consensus.cc:2749] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:46.974428 11915 leader_election.cc:336] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.979676 12596 raft_consensus.cc:493] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.979910 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55c8d664ee74f0fbb31693f1b398fba" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:46.980212 12596 raft_consensus.cc:515] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:46.982524 12596 leader_election.cc:290] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:46.985960 12590 raft_consensus.cc:493] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.985986 12596 raft_consensus.cc:493] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.986533 12590 raft_consensus.cc:515] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:46.987262 12564 raft_consensus.cc:493] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:46.987778 12564 raft_consensus.cc:515] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:46.986734 12596 raft_consensus.cc:515] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:46.988798 12590 leader_election.cc:290] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
W20260709 13:18:46.989315 11841 leader_election.cc:336] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.989589 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f5c73ecd474b45ae6c27ca1f1046a1" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:46.989849 11841 leader_election.cc:304] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:46.990253 11869 raft_consensus.cc:2468] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:46.990739 12586 raft_consensus.cc:2749] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.990842 12596 leader_election.cc:290] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:46.991863 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9288763b344f2fb95940d6a0ce7bcd" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
W20260709 13:18:47.045812 11989 leader_election.cc:336] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.045897 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4758afc104744a481a25b59661b80fe" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:47.047484 12596 raft_consensus.cc:493] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.056402 12021 raft_consensus.cc:2468] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:47.056450 12596 raft_consensus.cc:515] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:47.058324 12515 raft_consensus.cc:515] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:47.050254 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83da445e9a4d483e8d2504e806a4461b" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:47.050704 11915 leader_election.cc:304] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
W20260709 13:18:47.068096 11915 leader_election.cc:336] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:46.992452 12022 raft_consensus.cc:2468] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 2.
I20260709 13:18:47.058732 12596 leader_election.cc:290] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:47.049271 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df332d97fcd742e3b0f2024da1850b81" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:47.059104 11989 leader_election.cc:304] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.060537 12564 leader_election.cc:290] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:47.062094 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25353af0207b4ec1959e0795ded4946c" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:47.066356 12565 raft_consensus.cc:493] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.072490 12021 raft_consensus.cc:2468] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:47.076576 11842 leader_election.cc:304] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:47.069662 12590 raft_consensus.cc:2804] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.078498 12590 raft_consensus.cc:493] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.078891 12590 raft_consensus.cc:3060] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.080719 12515 leader_election.cc:290] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:47.081573 12598 raft_consensus.cc:2749] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:47.077870 12565 raft_consensus.cc:515] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:47.069720 12016 raft_consensus.cc:3060] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:47.094483 11915 leader_election.cc:336] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:18:47.095207 11915 leader_election.cc:336] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.101513 12599 raft_consensus.cc:2804] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.102085 12599 raft_consensus.cc:493] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.102459 12599 raft_consensus.cc:3060] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.102835 12565 leader_election.cc:290] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:47.103397 12565 raft_consensus.cc:493] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.103843 12565 raft_consensus.cc:515] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:47.106092 12565 leader_election.cc:290] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:47.108093 12604 raft_consensus.cc:493] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.108668 12604 raft_consensus.cc:515] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:47.110772 12604 leader_election.cc:290] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:47.106382 12600 raft_consensus.cc:493] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
W20260709 13:18:47.114140 11915 leader_election.cc:336] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.114871 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f1d538ab1446f182128209d64b34be" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:47.115927 12515 raft_consensus.cc:493] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.116050 12565 raft_consensus.cc:493] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.116477 12515 raft_consensus.cc:515] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:47.116693 12565 raft_consensus.cc:515] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:47.117969 12590 raft_consensus.cc:515] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:47.118893 12515 leader_election.cc:290] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:47.118930 12565 leader_election.cc:290] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:47.119536 12602 raft_consensus.cc:493] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.120093 12590 leader_election.cc:290] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:47.120241 12016 raft_consensus.cc:2468] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 2.
I20260709 13:18:47.121383 12599 raft_consensus.cc:515] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:47.120644 12022 raft_consensus.cc:2468] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:47.120559 12600 raft_consensus.cc:515] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:47.124060 12600 leader_election.cc:290] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:47.120093 12602 raft_consensus.cc:515] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:47.125275 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdcb9800b8894d978568cd9ad81bdd31" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:47.126838 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25353af0207b4ec1959e0795ded4946c" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:47.126895 12015 raft_consensus.cc:2468] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
W20260709 13:18:47.125844 11915 leader_election.cc:336] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.126363 12599 leader_election.cc:290] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:47.128150 12602 leader_election.cc:290] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:47.129240 12604 raft_consensus.cc:493] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.129570 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e862ca999046aca1a257edebcdfea3" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:47.131522 12015 raft_consensus.cc:3060] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.131385 12604 raft_consensus.cc:515] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:47.133484 12604 leader_election.cc:290] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:47.135903 11916 leader_election.cc:304] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: bdbe2261c337471ea4d0c980ebb80c72
W20260709 13:18:47.136686 11989 leader_election.cc:336] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.136780 12602 raft_consensus.cc:2804] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.128641 11842 leader_election.cc:304] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:47.137705 12602 raft_consensus.cc:493] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
W20260709 13:18:47.138017 11915 leader_election.cc:336] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.138314 12602 raft_consensus.cc:3060] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.138551 11842 leader_election.cc:304] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:47.139635 12599 raft_consensus.cc:2804] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.139724 12600 raft_consensus.cc:2804] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.140069 12599 raft_consensus.cc:493] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.140237 12600 raft_consensus.cc:493] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.140520 12599 raft_consensus.cc:3060] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.140689 12600 raft_consensus.cc:3060] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.145174 11916 leader_election.cc:304] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.127655 12016 raft_consensus.cc:3060] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.147140 11916 leader_election.cc:304] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.146799 12590 raft_consensus.cc:2749] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:47.138573 11915 leader_election.cc:336] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.152748 12602 raft_consensus.cc:515] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:47.154505 12515 raft_consensus.cc:2804] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:47.153174 11915 leader_election.cc:336] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.154983 12515 raft_consensus.cc:493] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.155416 12515 raft_consensus.cc:3060] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:47.162523 11874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cc9444f841f4d768a714f7462f1cf6e" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:47.163226 11874 raft_consensus.cc:2468] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:47.162883 12515 raft_consensus.cc:515] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
W20260709 13:18:47.164915 11989 leader_election.cc:336] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.165580 11874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ca7758d7240519907444b2ba2c15f" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:47.166208 11874 raft_consensus.cc:2468] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:47.166608 12590 raft_consensus.cc:493] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.167129 12590 raft_consensus.cc:515] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:47.167560 11874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f5c73ecd474b45ae6c27ca1f1046a1" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:47.168231 11874 raft_consensus.cc:3060] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.169248 12590 leader_election.cc:290] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:47.171460 11916 leader_election.cc:304] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.172227 12603 raft_consensus.cc:2804] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.172730 12603 raft_consensus.cc:697] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:47.145620 12015 raft_consensus.cc:2468] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 2.
I20260709 13:18:47.167475 12599 raft_consensus.cc:515] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:47.175688 12515 leader_election.cc:290] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:47.176632 12599 leader_election.cc:290] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:47.173725 12603 consensus_queue.cc:237] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:47.178069 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdcb9800b8894d978568cd9ad81bdd31" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:47.178694 12015 raft_consensus.cc:3060] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.180102 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095174060bff4a6b8f891f171bb9cd10" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:47.180891 12600 raft_consensus.cc:515] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:47.181787 12602 leader_election.cc:290] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:47.183161 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ca7758d7240519907444b2ba2c15f" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:47.183619 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f1d538ab1446f182128209d64b34be" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:47.183122 12515 raft_consensus.cc:493] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.184122 12022 raft_consensus.cc:3060] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.184128 11950 raft_consensus.cc:2468] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:47.184599 12515 raft_consensus.cc:515] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:47.186793 12515 leader_election.cc:290] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:47.187547 11916 leader_election.cc:304] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.188905 12515 raft_consensus.cc:2804] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.189404 12515 raft_consensus.cc:697] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:47.190533 12515 consensus_queue.cc:237] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:47.192817 12604 raft_consensus.cc:493] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.193356 12604 raft_consensus.cc:515] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:47.195262 12604 leader_election.cc:290] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
W20260709 13:18:47.197443 11915 leader_election.cc:336] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.183357 12590 raft_consensus.cc:493] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
W20260709 13:18:47.203644 11915 leader_election.cc:336] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.203732 12590 raft_consensus.cc:515] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:47.201542 12016 raft_consensus.cc:2468] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 2.
I20260709 13:18:47.202986 11989 leader_election.cc:304] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.208443 12543 raft_consensus.cc:2749] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:47.186215 11874 raft_consensus.cc:2468] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 2.
I20260709 13:18:47.198882 12022 raft_consensus.cc:2468] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 2.
I20260709 13:18:47.209514 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52730cf917140dfaced7ad6cf28f5f7" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:47.209957 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf1f22d4f144109fe8d089d54dd5e6" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:47.183053 12600 leader_election.cc:290] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:47.207659 11842 leader_election.cc:304] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:47.210588 12021 raft_consensus.cc:2468] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:47.211150 12600 raft_consensus.cc:2804] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.210974 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59c45da3f3f43a5b793c3305865da17" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:47.211385 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4758afc104744a481a25b59661b80fe" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:47.212283 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9288763b344f2fb95940d6a0ce7bcd" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:47.212548 12020 raft_consensus.cc:3060] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.212852 12022 raft_consensus.cc:3060] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:47.213155 12021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd6d52d3b2649de89e331bbb75335a0" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:47.213793 12021 raft_consensus.cc:2468] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:47.211920 11842 leader_election.cc:304] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:47.206238 12015 raft_consensus.cc:2468] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 2.
I20260709 13:18:47.216038 11842 leader_election.cc:304] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:47.216830 12599 raft_consensus.cc:2804] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.217298 12599 raft_consensus.cc:697] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 LEADER]: Becoming Leader. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
I20260709 13:18:47.217442 12605 raft_consensus.cc:2804] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.218029 12605 raft_consensus.cc:697] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 LEADER]: Becoming Leader. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
I20260709 13:18:47.218266 12599 consensus_queue.cc:237] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:47.218827 12605 consensus_queue.cc:237] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:47.219981 11916 leader_election.cc:304] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.219424 11950 raft_consensus.cc:2468] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:47.221923 12602 raft_consensus.cc:2804] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.222343 12602 raft_consensus.cc:493] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.222419 12022 raft_consensus.cc:2468] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 3.
I20260709 13:18:47.222934 12602 raft_consensus.cc:3060] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.212769 12600 raft_consensus.cc:697] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 LEADER]: Becoming Leader. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
I20260709 13:18:47.224371 12600 consensus_queue.cc:237] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
W20260709 13:18:47.211826 11915 leader_election.cc:336] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:18:47.226854 11915 leader_election.cc:336] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.210237 12016 raft_consensus.cc:2468] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:47.230448 11916 leader_election.cc:304] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: 
I20260709 13:18:47.232026 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd6d52d3b2649de89e331bbb75335a0" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:47.232093 11916 leader_election.cc:304] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: bdbe2261c337471ea4d0c980ebb80c72
W20260709 13:18:47.232559 11989 leader_election.cc:336] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.233673 12543 raft_consensus.cc:493] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.232795 11947 raft_consensus.cc:2468] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:47.234323 12543 raft_consensus.cc:515] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:47.236888 12596 raft_consensus.cc:2804] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.238673 12596 raft_consensus.cc:493] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.239069 12596 raft_consensus.cc:3060] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.239789 12495 raft_consensus.cc:2804] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:47.236531 12543 leader_election.cc:290] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:47.249223 12020 raft_consensus.cc:2468] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 2.
W20260709 13:18:47.253015 11989 leader_election.cc:336] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.258078 11915 leader_election.cc:304] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.258363 12613 raft_consensus.cc:493] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.258975 12613 raft_consensus.cc:515] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:47.262395 11989 leader_election.cc:304] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.263769 12495 raft_consensus.cc:697] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 3 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:47.233673 11916 leader_election.cc:304] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.264820 12598 raft_consensus.cc:2804] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.265229 12598 raft_consensus.cc:493] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.264850 12495 consensus_queue.cc:237] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:47.265686 12598 raft_consensus.cc:3060] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.266119 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83da445e9a4d483e8d2504e806a4461b" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:47.266813 11945 raft_consensus.cc:2468] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 1.
I20260709 13:18:47.267860 11916 leader_election.cc:304] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: bdbe2261c337471ea4d0c980ebb80c72
W20260709 13:18:47.268505 11915 leader_election.cc:336] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.263785 12613 leader_election.cc:290] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:47.253213 12602 raft_consensus.cc:515] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:47.269381 12613 raft_consensus.cc:2804] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.269802 12613 raft_consensus.cc:493] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.270170 12603 raft_consensus.cc:2804] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.270686 12603 raft_consensus.cc:697] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:47.270198 12613 raft_consensus.cc:3060] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.271504 12603 consensus_queue.cc:237] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:47.260586 12515 raft_consensus.cc:2804] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.272455 12515 raft_consensus.cc:493] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.273207 12515 raft_consensus.cc:3060] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.276306 12602 leader_election.cc:290] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:47.277508 12598 raft_consensus.cc:515] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:47.279911 12598 leader_election.cc:290] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:47.280717 12590 leader_election.cc:290] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:47.259857 12596 raft_consensus.cc:515] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
W20260709 13:18:47.282675 11915 leader_election.cc:336] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.283195 12596 leader_election.cc:290] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:47.286764 11989 leader_election.cc:304] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: bdbe2261c337471ea4d0c980ebb80c72
W20260709 13:18:47.289393 11915 leader_election.cc:336] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.289536 12598 raft_consensus.cc:2804] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.291420 12598 raft_consensus.cc:493] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.291791 12598 raft_consensus.cc:3060] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.293038 12614 raft_consensus.cc:493] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.293697 12614 raft_consensus.cc:515] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
W20260709 13:18:47.295961 11915 leader_election.cc:336] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:18:47.297210 11989 leader_election.cc:336] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.297561 11696 catalog_manager.cc:5697] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 1 to 2, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 2 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:47.302371 12600 raft_consensus.cc:493] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.302076 11694 catalog_manager.cc:5697] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d reported cstate change: term changed from 1 to 2, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130). New cstate: current_term: 2 leader_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.303109 12600 raft_consensus.cc:515] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:47.304246 12598 raft_consensus.cc:515] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:47.305977 12600 leader_election.cc:290] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:47.306867 12598 leader_election.cc:290] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
W20260709 13:18:47.297573 12607 log.cc:927] Time spent T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:18:47.312179 11874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8e389bf22e48259f4d63c2c12f4713" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:47.312803 11874 raft_consensus.cc:2468] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
W20260709 13:18:47.318069 11989 leader_election.cc:336] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.318876 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6ff283134a4463af9ad09ed3ac81ce" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:47.319567 11869 raft_consensus.cc:2468] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:47.320324 12614 leader_election.cc:290] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
W20260709 13:18:47.325413 11915 leader_election.cc:336] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:18:47.329620 11916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.132:38909, user_credentials={real_user=slave}} blocked reactor thread for 61857.6us
I20260709 13:18:47.330674 11989 leader_election.cc:304] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.332541 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bf1f22d4f144109fe8d089d54dd5e6" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:47.333184 12020 raft_consensus.cc:3060] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.336712 11696 catalog_manager.cc:5697] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 1 to 2, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 2 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:47.338132 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd6d52d3b2649de89e331bbb75335a0" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:47.338320 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55c8d664ee74f0fbb31693f1b398fba" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:47.340718 11869 raft_consensus.cc:2468] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
I20260709 13:18:47.338675 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd6d52d3b2649de89e331bbb75335a0" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:47.341943 12016 raft_consensus.cc:2393] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 04f862d1b8824d7a81daa0cad52c5843 in current term 2: Already voted for candidate 1f7178f720eb4090a3593087331b82e9 in this term.
I20260709 13:18:47.342854 11950 raft_consensus.cc:2393] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f7178f720eb4090a3593087331b82e9 in current term 2: Already voted for candidate 04f862d1b8824d7a81daa0cad52c5843 in this term.
I20260709 13:18:47.343048 12020 raft_consensus.cc:2468] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 2.
I20260709 13:18:47.344189 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095174060bff4a6b8f891f171bb9cd10" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
W20260709 13:18:47.339855 11841 leader_election.cc:336] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.344859 12022 raft_consensus.cc:2468] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 1.
W20260709 13:18:47.345381 11841 leader_election.cc:336] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.336910 11694 catalog_manager.cc:5697] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d reported cstate change: term changed from 1 to 2, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130). New cstate: current_term: 2 leader_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.347874 11694 catalog_manager.cc:5697] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d reported cstate change: term changed from 1 to 2, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130). New cstate: current_term: 2 leader_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.355907 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eece1e771a0341b1bebc6fde110e6f8a" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:47.356505 12600 raft_consensus.cc:493] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.357115 11945 raft_consensus.cc:2468] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:47.357169 12600 raft_consensus.cc:515] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:47.348223 11916 leader_election.cc:304] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.359628 12600 leader_election.cc:290] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:47.360690 11916 leader_election.cc:304] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.369181 12603 raft_consensus.cc:2804] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.369726 12603 raft_consensus.cc:697] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:47.370648 12603 consensus_queue.cc:237] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:47.375144 11916 leader_election.cc:304] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.376011 12495 raft_consensus.cc:2804] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.376384 12495 raft_consensus.cc:493] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.348223 11989 leader_election.cc:304] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.361898 12614 raft_consensus.cc:2749] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:47.353178 11696 catalog_manager.cc:5697] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 2 to 3, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 3 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:47.354832 11915 leader_election.cc:304] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.377835 12596 raft_consensus.cc:2804] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.378201 11915 leader_election.cc:304] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.378885 12548 raft_consensus.cc:2749] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:47.379122 12612 raft_consensus.cc:2804] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.379546 12612 raft_consensus.cc:493] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.379894 12612 raft_consensus.cc:3060] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.352428 12613 raft_consensus.cc:515] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:47.368031 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f5eb834fe84f7cadb173cc0fc58b2f" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:47.380685 12022 raft_consensus.cc:2468] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 1.
I20260709 13:18:47.376757 12495 raft_consensus.cc:3060] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.345695 12515 raft_consensus.cc:515] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:47.383211 12515 leader_election.cc:290] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:47.378304 12596 raft_consensus.cc:697] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:47.386652 11842 leader_election.cc:304] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:47.386529 12596 consensus_queue.cc:237] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:47.387082 12613 leader_election.cc:290] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:47.379796 11915 leader_election.cc:304] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.389343 12599 raft_consensus.cc:2804] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.389945 12599 raft_consensus.cc:493] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.390311 12599 raft_consensus.cc:3060] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.348407 12598 raft_consensus.cc:2804] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.389467 11696 catalog_manager.cc:5697] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 1 to 2, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 2 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:47.392565 12022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52730cf917140dfaced7ad6cf28f5f7" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:47.390785 12598 raft_consensus.cc:493] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.393566 12598 raft_consensus.cc:3060] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.393316 12022 raft_consensus.cc:3060] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.394966 12613 raft_consensus.cc:2804] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.398434 12613 raft_consensus.cc:493] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.399048 12613 raft_consensus.cc:3060] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.392403 12612 raft_consensus.cc:515] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:47.395948 12495 raft_consensus.cc:515] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:47.402843 12612 leader_election.cc:290] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:47.410396 12495 leader_election.cc:290] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
W20260709 13:18:47.411379 11915 leader_election.cc:336] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:18:47.412187 11915 leader_election.cc:336] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.406869 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "095174060bff4a6b8f891f171bb9cd10" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:47.412921 12016 raft_consensus.cc:3060] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.416224 12613 raft_consensus.cc:515] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:47.418856 12613 leader_election.cc:290] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:47.419175 12598 raft_consensus.cc:515] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:47.421190 12016 raft_consensus.cc:2468] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 2.
I20260709 13:18:47.421442 12598 leader_election.cc:290] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
W20260709 13:18:47.422358 11915 leader_election.cc:336] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:18:47.422972 11915 leader_election.cc:336] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:18:47.426252 11915 leader_election.cc:336] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.428319 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83da445e9a4d483e8d2504e806a4461b" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:47.429023 11950 raft_consensus.cc:3060] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.434617 12599 raft_consensus.cc:515] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:47.437618 12020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f5eb834fe84f7cadb173cc0fc58b2f" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:18:47.438329 12020 raft_consensus.cc:3060] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.438668 11950 raft_consensus.cc:2468] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 2.
I20260709 13:18:47.439304 11696 catalog_manager.cc:5697] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 1 to 2, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 2 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:47.442144 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cc9444f841f4d768a714f7462f1cf6e" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:47.441443 11696 catalog_manager.cc:5697] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 1 to 2, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 2 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.442809 11869 raft_consensus.cc:3060] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.447088 11916 leader_election.cc:304] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.447992 12596 raft_consensus.cc:2804] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.448549 12596 raft_consensus.cc:697] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:47.449469 12596 consensus_queue.cc:237] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:47.450912 11869 raft_consensus.cc:2468] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 2.
I20260709 13:18:47.453227 11841 leader_election.cc:304] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.403338 12022 raft_consensus.cc:2468] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 2.
I20260709 13:18:47.406136 12015 raft_consensus.cc:1275] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Refusing update from remote peer 7283c2ba87e94087b9ac5dcb372c4e1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:47.456285 12605 consensus_queue.cc:1048] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:47.458280 11989 leader_election.cc:304] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: 
I20260709 13:18:47.460443 12548 raft_consensus.cc:2804] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.460973 12548 raft_consensus.cc:697] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [term 2 LEADER]: Becoming Leader. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Running, Role: LEADER
I20260709 13:18:47.461875 12548 consensus_queue.cc:237] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
W20260709 13:18:47.462752 11989 leader_election.cc:336] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.464192 11916 leader_election.cc:304] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.465102 12600 raft_consensus.cc:2804] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.465443 12596 raft_consensus.cc:2804] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.465682 12600 raft_consensus.cc:493] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.466285 12596 raft_consensus.cc:697] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:47.467267 12596 consensus_queue.cc:237] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:47.466313 12600 raft_consensus.cc:3060] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.483784 11696 catalog_manager.cc:5697] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 1 to 2, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 2 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:47.484835 11841 leader_election.cc:304] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:47.497008 12600 raft_consensus.cc:515] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:47.498194 12606 raft_consensus.cc:2804] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.498704 12606 raft_consensus.cc:493] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.499107 12606 raft_consensus.cc:3060] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.499500 12600 leader_election.cc:290] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:47.517436 11841 leader_election.cc:304] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:47.529469 12565 raft_consensus.cc:2804] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.529989 12565 raft_consensus.cc:493] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.530447 12565 raft_consensus.cc:3060] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:47.531109 11841 leader_election.cc:336] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.510334 12606 raft_consensus.cc:515] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:47.533646 12606 leader_election.cc:290] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:47.529996 11915 leader_election.cc:304] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.536837 12612 raft_consensus.cc:2804] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.537312 12612 raft_consensus.cc:493] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:18:47.537729 12612 raft_consensus.cc:3060] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.472420 12599 leader_election.cc:290] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:47.555711 12612 raft_consensus.cc:515] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
W20260709 13:18:47.534803 11841 leader_election.cc:336] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:18:47.572425 11841 leader_election.cc:336] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:18:47.575484 11841 leader_election.cc:336] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.545267 12565 raft_consensus.cc:515] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:47.584405 12015 raft_consensus.cc:1275] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Refusing update from remote peer 04f862d1b8824d7a81daa0cad52c5843: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:47.588167 11694 catalog_manager.cc:5697] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 reported cstate change: term changed from 1 to 2, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 1f7178f720eb4090a3593087331b82e9 (127.1.227.132). New cstate: current_term: 2 leader_uuid: "1f7178f720eb4090a3593087331b82e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:47.589715 12596 consensus_queue.cc:1048] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:47.590065 12565 leader_election.cc:290] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
W20260709 13:18:47.590950 11841 leader_election.cc:336] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.593973 11696 catalog_manager.cc:5697] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 1 to 2, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 2 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:47.594478 11841 leader_election.cc:336] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.592669 12020 raft_consensus.cc:2468] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 2.
W20260709 13:18:47.593250 11915 leader_election.cc:336] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.600360 11842 leader_election.cc:304] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:47.604187 12565 raft_consensus.cc:2804] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.606915 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ca7758d7240519907444b2ba2c15f" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:47.610214 11950 raft_consensus.cc:2393] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7283c2ba87e94087b9ac5dcb372c4e1d in current term 2: Already voted for candidate 04f862d1b8824d7a81daa0cad52c5843 in this term.
I20260709 13:18:47.611788 12612 leader_election.cc:290] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:47.608409 11989 leader_election.cc:304] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: bdbe2261c337471ea4d0c980ebb80c72
W20260709 13:18:47.607542 11915 consensus_peers.cc:597] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:47.614701 11874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ca7758d7240519907444b2ba2c15f" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:47.620429 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8e389bf22e48259f4d63c2c12f4713" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:47.620836 11874 raft_consensus.cc:2393] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 04f862d1b8824d7a81daa0cad52c5843 in current term 2: Already voted for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in this term.
I20260709 13:18:47.621115 11869 raft_consensus.cc:3060] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.616231 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6ff283134a4463af9ad09ed3ac81ce" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:47.621886 11871 raft_consensus.cc:3060] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.622509 12598 raft_consensus.cc:2804] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.623098 12598 raft_consensus.cc:697] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [term 2 LEADER]: Becoming Leader. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Running, Role: LEADER
I20260709 13:18:47.624053 12598 consensus_queue.cc:237] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:47.630491 11871 raft_consensus.cc:2468] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 2.
I20260709 13:18:47.635733 11869 raft_consensus.cc:2468] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 2.
I20260709 13:18:47.636643 12565 raft_consensus.cc:697] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 LEADER]: Becoming Leader. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
I20260709 13:18:47.637660 12565 consensus_queue.cc:237] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:47.658246 11696 catalog_manager.cc:5697] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 reported cstate change: term changed from 1 to 2, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 1f7178f720eb4090a3593087331b82e9 (127.1.227.132). New cstate: current_term: 2 leader_uuid: "1f7178f720eb4090a3593087331b82e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:47.672438 11695 catalog_manager.cc:5697] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d reported cstate change: term changed from 1 to 2, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130). New cstate: current_term: 2 leader_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.676889 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55c8d664ee74f0fbb31693f1b398fba" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:47.677629 11869 raft_consensus.cc:3060] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.683136 12015 raft_consensus.cc:1275] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Refusing update from remote peer 04f862d1b8824d7a81daa0cad52c5843: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:47.683257 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59c45da3f3f43a5b793c3305865da17" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:47.683899 11950 raft_consensus.cc:3060] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.684640 12020 raft_consensus.cc:1275] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Refusing update from remote peer 7283c2ba87e94087b9ac5dcb372c4e1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:47.686022 11841 leader_election.cc:336] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.686405 12565 consensus_queue.cc:1048] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:47.689097 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eece1e771a0341b1bebc6fde110e6f8a" candidate_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:47.689675 11947 raft_consensus.cc:3060] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.690697 12613 consensus_queue.cc:1048] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:47.696398 11869 raft_consensus.cc:2468] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 2.
I20260709 13:18:47.699636 11915 leader_election.cc:304] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.701066 12613 raft_consensus.cc:2749] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:47.702409 11915 leader_election.cc:304] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.704066 12596 raft_consensus.cc:2804] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.707530 12596 raft_consensus.cc:697] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:47.708268 12022 raft_consensus.cc:1275] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Refusing update from remote peer 04f862d1b8824d7a81daa0cad52c5843: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:47.709051 12596 consensus_queue.cc:237] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:47.712930 12613 consensus_queue.cc:1048] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:47.714171 11915 consensus_peers.cc:597] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:47.722172 11950 raft_consensus.cc:2468] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 2.
I20260709 13:18:47.722564 11915 leader_election.cc:304] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.722685 11947 raft_consensus.cc:2468] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7283c2ba87e94087b9ac5dcb372c4e1d in term 2.
I20260709 13:18:47.725764 12612 raft_consensus.cc:2804] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.726347 12612 raft_consensus.cc:697] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:47.727300 12612 consensus_queue.cc:237] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:47.766700 11695 catalog_manager.cc:5697] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 1 to 2, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 2 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.782927 12020 raft_consensus.cc:1275] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Refusing update from remote peer 7283c2ba87e94087b9ac5dcb372c4e1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:47.785610 12016 raft_consensus.cc:1275] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Refusing update from remote peer 04f862d1b8824d7a81daa0cad52c5843: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:47.788928 12586 consensus_queue.cc:1048] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:47.790717 12612 consensus_queue.cc:1048] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:47.813952 11841 leader_election.cc:304] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:47.813552 11694 catalog_manager.cc:5697] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 1 to 2, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 2 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:47.813596 11915 consensus_peers.cc:597] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:47.818516 11915 consensus_peers.cc:597] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:47.818619 12600 raft_consensus.cc:2804] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:18:47.819159 11915 consensus_peers.cc:597] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:47.819344 12600 raft_consensus.cc:697] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 LEADER]: Becoming Leader. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
W20260709 13:18:47.819692 11915 consensus_peers.cc:597] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:47.820622 12600 consensus_queue.cc:237] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:47.827576 11841 leader_election.cc:304] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
W20260709 13:18:47.837885 11841 leader_election.cc:336] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.830868 12599 raft_consensus.cc:2804] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:18:47.839082 11841 leader_election.cc:336] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.839257 12599 raft_consensus.cc:697] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 LEADER]: Becoming Leader. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
W20260709 13:18:47.839988 11841 leader_election.cc:336] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.840518 11841 leader_election.cc:304] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.840293 12599 consensus_queue.cc:237] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:47.841457 12605 raft_consensus.cc:2749] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:47.841679 11841 consensus_peers.cc:597] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:47.842195 11841 leader_election.cc:336] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.837570 11915 leader_election.cc:304] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:47.843659 12596 raft_consensus.cc:2804] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.844213 12596 raft_consensus.cc:697] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
W20260709 13:18:47.842900 11841 leader_election.cc:336] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:47.846002 12596 consensus_queue.cc:237] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:47.859599 11694 catalog_manager.cc:5697] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d reported cstate change: term changed from 1 to 2, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130). New cstate: current_term: 2 leader_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:47.868062 11841 consensus_peers.cc:597] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:47.869499 12016 raft_consensus.cc:1275] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Refusing update from remote peer 04f862d1b8824d7a81daa0cad52c5843: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:47.872294 12020 raft_consensus.cc:1275] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Refusing update from remote peer 7283c2ba87e94087b9ac5dcb372c4e1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:47.873929 12605 consensus_queue.cc:1048] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:47.875736 12495 consensus_queue.cc:1048] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:47.886036 11841 consensus_peers.cc:597] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:47.939339 12017 raft_consensus.cc:1275] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Refusing update from remote peer 04f862d1b8824d7a81daa0cad52c5843: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:47.942102 12602 consensus_queue.cc:1048] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:47.943351  1934 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 11822)
I20260709 13:18:47.944540 11947 raft_consensus.cc:1275] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Refusing update from remote peer 1f7178f720eb4090a3593087331b82e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:47.947485 12548 consensus_queue.cc:1048] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:47.950625 11841 consensus_peers.cc:597] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:47.973873 11695 catalog_manager.cc:5697] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d reported cstate change: term changed from 1 to 2, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130). New cstate: current_term: 2 leader_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:47.985816 11915 consensus_peers.cc:597] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:47.990688 11915 consensus_peers.cc:597] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:48.000332 11694 catalog_manager.cc:5697] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 1 to 2, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 2 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:48.026551 11871 raft_consensus.cc:1275] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Refusing update from remote peer 04f862d1b8824d7a81daa0cad52c5843: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:48.028267 12596 consensus_queue.cc:1048] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:48.045799 11989 consensus_peers.cc:597] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:48.046327 11989 consensus_peers.cc:597] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.046509 12020 raft_consensus.cc:1275] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Refusing update from remote peer 7283c2ba87e94087b9ac5dcb372c4e1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:48.053094 12017 raft_consensus.cc:1275] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Refusing update from remote peer 04f862d1b8824d7a81daa0cad52c5843: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:48.057943 12605 consensus_queue.cc:1048] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:48.069365 12640 consensus_queue.cc:1048] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:48.085493 11989 consensus_peers.cc:597] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.160696 11841 consensus_peers.cc:597] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:48.164047 11871 raft_consensus.cc:1275] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Refusing update from remote peer 04f862d1b8824d7a81daa0cad52c5843: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:48.165575 12603 consensus_queue.cc:1048] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:48.184896 11915 consensus_peers.cc:597] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.189299 11989 consensus_peers.cc:597] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:48.205192 11915 consensus_peers.cc:597] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:48.210718 11915 consensus_peers.cc:597] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.215780 11841 consensus_peers.cc:597] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.226843 11989 consensus_peers.cc:597] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.238059 11915 consensus_peers.cc:597] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.250972 11874 raft_consensus.cc:1275] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Refusing update from remote peer 04f862d1b8824d7a81daa0cad52c5843: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:48.252663 12603 consensus_queue.cc:1048] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:48.271202 11871 raft_consensus.cc:1275] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Refusing update from remote peer 04f862d1b8824d7a81daa0cad52c5843: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:48.271402 11874 raft_consensus.cc:1275] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Refusing update from remote peer 1f7178f720eb4090a3593087331b82e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:48.275764 11989 consensus_peers.cc:597] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.277261 12543 consensus_queue.cc:1048] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:48.287454 12603 consensus_queue.cc:1048] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:48.290758 11989 consensus_peers.cc:597] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.292284 11915 consensus_peers.cc:597] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:48.326565 11915 consensus_peers.cc:597] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:48.330158 11841 consensus_peers.cc:597] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:48.344074 11915 consensus_peers.cc:597] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.347328 11915 consensus_peers.cc:597] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.347543 11841 consensus_peers.cc:597] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.359521 11915 consensus_peers.cc:597] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.393106 11989 consensus_peers.cc:597] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.422370 11989 consensus_peers.cc:597] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.430424 11915 consensus_peers.cc:597] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.431797 11950 raft_consensus.cc:1275] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Refusing update from remote peer 7283c2ba87e94087b9ac5dcb372c4e1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:48.434407 12565 consensus_queue.cc:1048] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:48.435595 11989 consensus_peers.cc:597] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.440893 11915 consensus_peers.cc:597] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.466167 11841 consensus_peers.cc:597] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:48.471390 11950 raft_consensus.cc:1275] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Refusing update from remote peer 7283c2ba87e94087b9ac5dcb372c4e1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:48.473348 12565 consensus_queue.cc:1048] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:48.491714 11915 consensus_peers.cc:597] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.727639 11841 consensus_peers.cc:597] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.814044 11915 consensus_peers.cc:597] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.852139 11915 consensus_peers.cc:597] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.951074 11841 consensus_peers.cc:597] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.955901  1934 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 11822)
I20260709 13:18:49.024386 12598 raft_consensus.cc:493] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.028198 12598 raft_consensus.cc:515] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:49.031124 12598 leader_election.cc:290] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:49.407106 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd6d52d3b2649de89e331bbb75335a0" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:49.408653 11945 raft_consensus.cc:2468] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 2.
I20260709 13:18:49.459263 11989 leader_election.cc:304] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: 
I20260709 13:18:49.460736 12666 raft_consensus.cc:2804] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:49.461372 12666 raft_consensus.cc:493] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.461966 12666 raft_consensus.cc:3060] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:49.477423 12666 raft_consensus.cc:515] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
W20260709 13:18:49.480578 11989 leader_election.cc:336] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:49.480571 12666 leader_election.cc:290] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:49.490885 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd6d52d3b2649de89e331bbb75335a0" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:18:49.491567 11945 raft_consensus.cc:3060] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:49.497044 11989 leader_election.cc:336] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:49.506738 12664 raft_consensus.cc:493] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.507790 12664 raft_consensus.cc:515] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:49.512948 12664 leader_election.cc:290] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:49.515033 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ca7758d7240519907444b2ba2c15f" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:49.515715 11945 raft_consensus.cc:2468] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 3.
I20260709 13:18:49.516095 11873 raft_consensus.cc:2468] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 2.
I20260709 13:18:49.519161 11915 leader_election.cc:304] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:18:49.522197 12613 raft_consensus.cc:2804] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:49.522733 12613 raft_consensus.cc:493] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.523193 12613 raft_consensus.cc:3060] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:49.541042 11989 leader_election.cc:304] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: bdbe2261c337471ea4d0c980ebb80c72
W20260709 13:18:49.542649 11915 leader_election.cc:336] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:49.543789 12666 raft_consensus.cc:2804] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:49.544397 12666 raft_consensus.cc:697] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 3 LEADER]: Becoming Leader. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Running, Role: LEADER
I20260709 13:18:49.545658 12666 consensus_queue.cc:237] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:49.559808 12613 raft_consensus.cc:515] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:49.562956 12613 leader_election.cc:290] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 election: Requested vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:49.566074 11873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ca7758d7240519907444b2ba2c15f" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:18:49.566839 11873 raft_consensus.cc:3060] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:49.575659 11694 catalog_manager.cc:5697] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 reported cstate change: term changed from 1 to 3, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 1f7178f720eb4090a3593087331b82e9 (127.1.227.132). New cstate: current_term: 3 leader_uuid: "1f7178f720eb4090a3593087331b82e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:49.577557 11915 leader_election.cc:336] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:18:49.586982 11873 raft_consensus.cc:2468] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 3.
I20260709 13:18:49.589318 11915 leader_election.cc:304] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:18:49.590466 12657 raft_consensus.cc:2804] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:49.590986 12657 raft_consensus.cc:697] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 3 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:18:49.592123 12657 consensus_queue.cc:237] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:49.614310 11695 catalog_manager.cc:5697] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 reported cstate change: term changed from 1 to 3, leader changed from bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129) to 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131). New cstate: current_term: 3 leader_uuid: "04f862d1b8824d7a81daa0cad52c5843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:49.933485 11945 raft_consensus.cc:1275] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Refusing update from remote peer 1f7178f720eb4090a3593087331b82e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:49.935462 12663 consensus_queue.cc:1048] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:49.956549  1934 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 11822)
W20260709 13:18:49.958250 11989 consensus_peers.cc:597] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:50.013887 11915 consensus_peers.cc:597] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:50.034643 11871 raft_consensus.cc:1275] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 3 FOLLOWER]: Refusing update from remote peer 04f862d1b8824d7a81daa0cad52c5843: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:50.037897 12664 consensus_queue.cc:1048] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:50.042420 11841 consensus_peers.cc:597] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.064193 11915 consensus_peers.cc:597] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:50.089362 11730 debug-util.cc:398] Leaking SignalData structure 0x7b080004a740 after lost signal to thread 1937
W20260709 13:18:50.090884 11730 debug-util.cc:398] Leaking SignalData structure 0x7b0800342160 after lost signal to thread 11733
W20260709 13:18:50.092057 11730 debug-util.cc:398] Leaking SignalData structure 0x7b08001dd580 after lost signal to thread 11900
W20260709 13:18:50.093065 11730 debug-util.cc:398] Leaking SignalData structure 0x7b08002c7340 after lost signal to thread 11974
W20260709 13:18:50.094077 11730 debug-util.cc:398] Leaking SignalData structure 0x7b0800287ec0 after lost signal to thread 12048
W20260709 13:18:50.094532 11730 debug-util.cc:398] Leaking SignalData structure 0x7b08003ff400 after lost signal to thread 12594
W20260709 13:18:50.095039 11730 debug-util.cc:398] Leaking SignalData structure 0x7b0800378ec0 after lost signal to thread 12622
W20260709 13:18:50.095319 11730 debug-util.cc:398] Leaking SignalData structure 0x7b0800380aa0 after lost signal to thread 12628
W20260709 13:18:50.095604 11730 debug-util.cc:398] Leaking SignalData structure 0x7b080005d240 after lost signal to thread 12641
W20260709 13:18:50.095817 11730 debug-util.cc:398] Leaking SignalData structure 0x7b0800369000 after lost signal to thread 12642
W20260709 13:18:50.111459 11915 consensus_peers.cc:597] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.204247 11915 consensus_peers.cc:597] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.223503 11915 consensus_peers.cc:597] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.342399 11841 consensus_peers.cc:597] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.350546 11915 consensus_peers.cc:597] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.374799 11915 consensus_peers.cc:597] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.409256 11989 consensus_peers.cc:597] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.409273 11841 consensus_peers.cc:597] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.462414 11989 consensus_peers.cc:597] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.489630 11915 consensus_peers.cc:597] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.569635 11915 consensus_peers.cc:597] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.578769 11989 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111) [suppressed 411 similar messages]
W20260709 13:18:50.672363 11915 consensus_peers.cc:597] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.675349 11989 consensus_peers.cc:597] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.682574 11989 consensus_peers.cc:597] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.699596 11915 consensus_peers.cc:597] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.727866 11915 consensus_peers.cc:597] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.739349 11915 consensus_peers.cc:597] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.768734 11915 consensus_peers.cc:597] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.787670 11841 consensus_peers.cc:597] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.802845 11989 consensus_peers.cc:597] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.803778 11841 consensus_peers.cc:597] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.806455 11915 consensus_peers.cc:597] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.830286 11841 consensus_peers.cc:597] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.841131 11841 consensus_peers.cc:597] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.843523 11915 consensus_peers.cc:597] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.860808 11989 consensus_peers.cc:597] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.861229 11915 consensus_peers.cc:597] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.957109  1934 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 11822)
W20260709 13:18:50.959738 11989 consensus_peers.cc:597] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.981370 11841 consensus_peers.cc:597] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.992823 11989 consensus_peers.cc:597] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.012276 11915 consensus_peers.cc:597] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.029582 11989 consensus_peers.cc:597] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.070936 11989 consensus_peers.cc:597] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.113940 11915 consensus_peers.cc:597] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:51.159940 11841 consensus_peers.cc:597] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:51.223162 11915 consensus_peers.cc:597] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.234628 11841 consensus_peers.cc:597] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.313724 11841 consensus_peers.cc:597] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.336709 11915 consensus_peers.cc:597] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.358563 11915 consensus_peers.cc:597] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.573262 11915 consensus_peers.cc:597] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.856647 11989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:37961, user_credentials={real_user=slave}} blocked reactor thread for 70060.9us
W20260709 13:18:51.957695  1934 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 11822)
W20260709 13:18:52.452729 11915 consensus_peers.cc:597] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:52.483307 11915 consensus_peers.cc:597] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:52.538223 11915 consensus_peers.cc:597] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:52.553601 11915 consensus_peers.cc:597] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:52.643879 11915 consensus_peers.cc:597] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:52.695676 11989 consensus_peers.cc:597] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:52.729271 11915 consensus_peers.cc:597] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:52.741245 11841 consensus_peers.cc:597] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:52.768743 11841 consensus_peers.cc:597] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:52.883054 11989 consensus_peers.cc:597] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:52.905264 11841 consensus_peers.cc:597] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:52.958223  1934 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 11822)
W20260709 13:18:52.975167 11915 consensus_peers.cc:597] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:53.036890 11915 consensus_peers.cc:597] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.039453 11915 consensus_peers.cc:597] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.121841 11989 consensus_peers.cc:597] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.160521 11841 consensus_peers.cc:597] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:53.185482 11989 consensus_peers.cc:597] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.225605 11915 consensus_peers.cc:597] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.238178 11915 consensus_peers.cc:597] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:53.241427 11915 consensus_peers.cc:597] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.244583 11915 consensus_peers.cc:597] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:53.257337 11915 consensus_peers.cc:597] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:53.260010 11989 consensus_peers.cc:597] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.263615 11915 consensus_peers.cc:597] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:53.295502 11989 consensus_peers.cc:597] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:53.304710  1934 tablet_server.cc:196] TabletServer@127.1.227.129:0 shutdown complete.
W20260709 13:18:53.325405 11841 consensus_peers.cc:597] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.340844 11841 consensus_peers.cc:597] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:53.391578 11915 consensus_peers.cc:597] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.419317 11989 consensus_peers.cc:597] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:53.450467  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:53.461175 12693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:53.483062 11989 consensus_peers.cc:597] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.487464 12695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:53.495720 11915 consensus_peers.cc:597] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.500051 12692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:53.509197 11841 consensus_peers.cc:597] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.517030 11989 consensus_peers.cc:597] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:53.518244  1934 server_base.cc:1061] running on GCE node
I20260709 13:18:53.520931  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:53.521193  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:53.521425  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603133521405 us; error 0 us; skew 500 ppm
I20260709 13:18:53.522953  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:18:53.527222 11915 consensus_peers.cc:597] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:53.532740  1934 webserver.cc:533] Webserver started at http://127.1.227.129:37251/ using document root <none> and password file <none>
I20260709 13:18:53.533667  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:53.534044  1934 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:18:53.554143  1934 fs_manager.cc:714] Time spent opening directory manager: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:18:53.571903 12700 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
W20260709 13:18:53.572443 11915 consensus_peers.cc:597] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:53.573580  1934 fs_manager.cc:730] Time spent opening block manager: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:18:53.574110  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-0-root
uuid: "bdbe2261c337471ea4d0c980ebb80c72"
format_stamp: "Formatted at 2026-07-09 13:18:32 on dist-test-slave-lfdf"
I20260709 13:18:53.574684  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602825662285-1934-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:18:53.582347 11989 consensus_peers.cc:597] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:53.599225  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:53.601382  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:53.603297  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:53.608858 12707 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:18:53.686834 11989 consensus_peers.cc:597] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.727701 11841 consensus_peers.cc:597] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:53.729710 11915 consensus_peers.cc:597] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:53.737998 11915 consensus_peers.cc:597] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.742642 11841 consensus_peers.cc:597] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:53.783979 11915 consensus_peers.cc:597] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.813000 11841 consensus_peers.cc:597] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.867262 11841 consensus_peers.cc:597] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:53.952780  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:18:53.953193  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.346s	user 0.008s	sys 0.002s
I20260709 13:18:53.953557  1934 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:18:53.960585 12707 tablet_bootstrap.cc:492] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:53.990928 12707 tablet_bootstrap.cc:492] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:53.992256 12707 tablet_bootstrap.cc:492] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:53.993175 12707 ts_tablet_manager.cc:1403] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.008s
I20260709 13:18:53.996297 12707 raft_consensus.cc:359] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:53.997088 12707 raft_consensus.cc:740] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.997840 12707 consensus_queue.cc:260] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:54.028573 12707 ts_tablet_manager.cc:1434] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.035s	user 0.013s	sys 0.020s
I20260709 13:18:54.029542 12707 tablet_bootstrap.cc:492] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
W20260709 13:18:54.159783 11915 consensus_peers.cc:597] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:54.168022 12707 tablet_bootstrap.cc:492] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:54.169152 12707 tablet_bootstrap.cc:492] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:54.169905 12707 ts_tablet_manager.cc:1403] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.141s	user 0.038s	sys 0.074s
I20260709 13:18:54.174099 12707 raft_consensus.cc:359] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:54.174845 12707 raft_consensus.cc:740] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.175583 12707 consensus_queue.cc:260] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:54.177626 12707 ts_tablet_manager.cc:1434] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:18:54.178476 12707 tablet_bootstrap.cc:492] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:54.222486 12707 tablet_bootstrap.cc:492] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:54.223497 12707 tablet_bootstrap.cc:492] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:54.224187 12707 ts_tablet_manager.cc:1403] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.008s
I20260709 13:18:54.226913 12707 raft_consensus.cc:359] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:54.227648 12707 raft_consensus.cc:740] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.236012 12707 consensus_queue.cc:260] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:54.240361 12707 ts_tablet_manager.cc:1434] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:18:54.241793 12707 tablet_bootstrap.cc:492] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:54.277191 12707 tablet_bootstrap.cc:492] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:54.278815 12707 tablet_bootstrap.cc:492] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:54.279721 12707 ts_tablet_manager.cc:1403] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.004s
I20260709 13:18:54.282608 12707 raft_consensus.cc:359] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:54.283416 12707 raft_consensus.cc:740] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.284292 12707 consensus_queue.cc:260] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:54.286633 12707 ts_tablet_manager.cc:1434] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:54.287505 12707 tablet_bootstrap.cc:492] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:54.319976 12707 tablet_bootstrap.cc:492] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:54.321048 12707 tablet_bootstrap.cc:492] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:54.321910 12707 ts_tablet_manager.cc:1403] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.005s
I20260709 13:18:54.331039 12707 raft_consensus.cc:359] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:54.331862 12707 raft_consensus.cc:740] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.332805 12707 consensus_queue.cc:260] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:54.335201 12707 ts_tablet_manager.cc:1434] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:18:54.336167 12707 tablet_bootstrap.cc:492] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:54.369730 12707 tablet_bootstrap.cc:492] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:54.370764 12707 tablet_bootstrap.cc:492] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:54.371435 12707 ts_tablet_manager.cc:1403] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.006s
I20260709 13:18:54.374022 12707 raft_consensus.cc:359] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:54.374732 12707 raft_consensus.cc:740] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.375590 12707 consensus_queue.cc:260] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:54.377562 12707 ts_tablet_manager.cc:1434] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:54.378439 12707 tablet_bootstrap.cc:492] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:54.427902  1934 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:18:54.428069 12707 tablet_bootstrap.cc:492] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:54.428416  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.475s	user 0.315s	sys 0.001s
I20260709 13:18:54.429062 12707 tablet_bootstrap.cc:492] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:54.429847 12707 ts_tablet_manager.cc:1403] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.004s
I20260709 13:18:54.433429 12707 raft_consensus.cc:359] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:54.434151 12707 raft_consensus.cc:740] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.435175 12707 consensus_queue.cc:260] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:54.440506 12707 ts_tablet_manager.cc:1434] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:18:54.441346 12707 tablet_bootstrap.cc:492] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:54.459838 12707 tablet_bootstrap.cc:492] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:54.462481 12707 tablet_bootstrap.cc:492] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:54.463295 12707 ts_tablet_manager.cc:1403] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:18:54.466149 12707 raft_consensus.cc:359] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:54.467036 12707 raft_consensus.cc:740] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.467996 12707 consensus_queue.cc:260] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:54.474694 12707 ts_tablet_manager.cc:1434] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:18:54.475688 12707 tablet_bootstrap.cc:492] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:54.653544 12707 tablet_bootstrap.cc:492] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:54.661895 12707 tablet_bootstrap.cc:492] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:54.662717 12707 ts_tablet_manager.cc:1403] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.187s	user 0.078s	sys 0.074s
I20260709 13:18:54.665712 12707 raft_consensus.cc:359] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:54.666567 12707 raft_consensus.cc:740] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.668219 12707 consensus_queue.cc:260] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:54.687824 12707 ts_tablet_manager.cc:1434] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 13:18:54.688889 12707 tablet_bootstrap.cc:492] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:54.716192 12707 tablet_bootstrap.cc:492] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:54.717334 12707 tablet_bootstrap.cc:492] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:54.718111 12707 ts_tablet_manager.cc:1403] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.011s
I20260709 13:18:54.720930 12707 raft_consensus.cc:359] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:54.721763 12707 raft_consensus.cc:740] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.722724 12707 consensus_queue.cc:260] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:54.725462 12707 ts_tablet_manager.cc:1434] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:54.726420 12707 tablet_bootstrap.cc:492] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:54.756922 12707 tablet_bootstrap.cc:492] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:54.758176 12707 tablet_bootstrap.cc:492] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:54.760843 12707 ts_tablet_manager.cc:1403] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.004s
I20260709 13:18:54.764775 12707 raft_consensus.cc:359] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:54.765599 12707 raft_consensus.cc:740] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.766855 12707 consensus_queue.cc:260] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:54.770707 12707 ts_tablet_manager.cc:1434] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:18:54.771631 12707 tablet_bootstrap.cc:492] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:54.794960 12707 tablet_bootstrap.cc:492] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:54.796231 12707 tablet_bootstrap.cc:492] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:54.797283 12707 ts_tablet_manager.cc:1403] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.004s
I20260709 13:18:54.800160 12707 raft_consensus.cc:359] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:54.801024 12707 raft_consensus.cc:740] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.801986 12707 consensus_queue.cc:260] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:54.804517 12707 ts_tablet_manager.cc:1434] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:54.805471 12707 tablet_bootstrap.cc:492] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
W20260709 13:18:54.818290 11915 consensus_peers.cc:597] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:54.826263 12707 tablet_bootstrap.cc:492] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:54.827826 12707 tablet_bootstrap.cc:492] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:54.828717 12707 ts_tablet_manager.cc:1403] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.000s
I20260709 13:18:54.832095 12707 raft_consensus.cc:359] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:54.833065 12707 raft_consensus.cc:740] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.834134 12707 consensus_queue.cc:260] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:54.836994 12707 ts_tablet_manager.cc:1434] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:18:54.838073 12707 tablet_bootstrap.cc:492] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:54.876219 12707 tablet_bootstrap.cc:492] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:54.877437 12707 tablet_bootstrap.cc:492] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:54.878293 12707 ts_tablet_manager.cc:1403] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.040s	user 0.030s	sys 0.007s
I20260709 13:18:54.881242 12707 raft_consensus.cc:359] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:54.882076 12707 raft_consensus.cc:740] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.882874 12707 consensus_queue.cc:260] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:54.885445 12707 ts_tablet_manager.cc:1434] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:54.886490 12707 tablet_bootstrap.cc:492] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
W20260709 13:18:54.943205 11915 consensus_peers.cc:597] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:55.061547 12707 tablet_bootstrap.cc:492] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:55.062810 12707 tablet_bootstrap.cc:492] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:55.063635 12707 ts_tablet_manager.cc:1403] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.177s	user 0.069s	sys 0.100s
I20260709 13:18:55.067358 12707 raft_consensus.cc:359] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:55.068183 12707 raft_consensus.cc:740] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.069007 12707 consensus_queue.cc:260] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:55.071395 12707 ts_tablet_manager.cc:1434] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:18:55.077360 12707 tablet_bootstrap.cc:492] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
W20260709 13:18:55.123148 11841 consensus_peers.cc:597] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:55.148509 11989 consensus_peers.cc:597] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:55.149260 11915 consensus_peers.cc:597] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:55.164095 11915 consensus_peers.cc:597] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:55.171814 12707 tablet_bootstrap.cc:492] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:55.173180 12707 tablet_bootstrap.cc:492] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:55.174350 12707 ts_tablet_manager.cc:1403] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.102s	user 0.035s	sys 0.042s
I20260709 13:18:55.182291 12707 raft_consensus.cc:359] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:55.183198 12707 raft_consensus.cc:740] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.184092 12707 consensus_queue.cc:260] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
W20260709 13:18:55.205438 11915 consensus_peers.cc:597] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:55.215873 12707 ts_tablet_manager.cc:1434] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.002s
I20260709 13:18:55.222566 12707 tablet_bootstrap.cc:492] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
W20260709 13:18:55.223062 11841 consensus_peers.cc:597] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:55.246693 12707 tablet_bootstrap.cc:492] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:55.248080 12707 tablet_bootstrap.cc:492] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:55.248940 12707 ts_tablet_manager.cc:1403] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.003s
I20260709 13:18:55.253851 12713 raft_consensus.cc:493] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.252300 12707 raft_consensus.cc:359] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:55.254567 12707 raft_consensus.cc:740] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.254438 12713 raft_consensus.cc:515] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:55.255760 12707 consensus_queue.cc:260] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:55.257280 12713 leader_election.cc:290] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:55.274371 12707 ts_tablet_manager.cc:1434] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.010s
I20260709 13:18:55.277186 12707 tablet_bootstrap.cc:492] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:55.329198 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3910c15d144fd09ea36bd9f5344eef" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:55.349352 12707 tablet_bootstrap.cc:492] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:55.350665 12707 tablet_bootstrap.cc:492] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:55.351507 12707 ts_tablet_manager.cc:1403] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.075s	user 0.035s	sys 0.025s
I20260709 13:18:55.354787 12707 raft_consensus.cc:359] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:55.355264 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3910c15d144fd09ea36bd9f5344eef" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:55.355708 12707 raft_consensus.cc:740] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
W20260709 13:18:55.357089 11989 consensus_peers.cc:597] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:55.356678 12707 consensus_queue.cc:260] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:55.358019 12703 leader_election.cc:304] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdbe2261c337471ea4d0c980ebb80c72; no voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:55.364542 12777 raft_consensus.cc:2749] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:55.368311 12707 ts_tablet_manager.cc:1434] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:18:55.370671 12707 tablet_bootstrap.cc:492] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
W20260709 13:18:55.375156 11915 consensus_peers.cc:597] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:55.388983 12777 raft_consensus.cc:493] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.389657 12777 raft_consensus.cc:515] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:55.392269 12777 leader_election.cc:290] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:55.395193 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a598cfbb3c457eb5a8c9801d421a01" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:55.398634 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a598cfbb3c457eb5a8c9801d421a01" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:55.402330 12703 leader_election.cc:304] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdbe2261c337471ea4d0c980ebb80c72; no voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:55.403546 12777 raft_consensus.cc:2749] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:55.445305 11915 consensus_peers.cc:597] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:55.460028 11841 consensus_peers.cc:597] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:55.469717 12707 tablet_bootstrap.cc:492] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:55.471370 12707 tablet_bootstrap.cc:492] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:55.472404 12707 ts_tablet_manager.cc:1403] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.102s	user 0.047s	sys 0.023s
I20260709 13:18:55.476020 12707 raft_consensus.cc:359] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:55.477154 12707 raft_consensus.cc:740] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.478113 12707 consensus_queue.cc:260] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:55.480890 12707 ts_tablet_manager.cc:1434] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:18:55.481980 12707 tablet_bootstrap.cc:492] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:55.504110 12707 tablet_bootstrap.cc:492] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:55.505162 12707 tablet_bootstrap.cc:492] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
W20260709 13:18:55.505332 11915 consensus_peers.cc:597] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:55.506198 12707 ts_tablet_manager.cc:1403] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.003s
I20260709 13:18:55.508814 12707 raft_consensus.cc:359] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:55.509539 12707 raft_consensus.cc:740] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.510370 12707 consensus_queue.cc:260] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:55.512620 12707 ts_tablet_manager.cc:1434] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:18:55.513424 12707 tablet_bootstrap.cc:492] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
W20260709 13:18:55.531230 11841 consensus_peers.cc:597] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:55.535528 12707 tablet_bootstrap.cc:492] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:55.536533 12707 tablet_bootstrap.cc:492] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:55.537194 12707 ts_tablet_manager.cc:1403] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.000s
W20260709 13:18:55.539157 11915 consensus_peers.cc:597] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:55.540583 12707 raft_consensus.cc:359] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:55.545059  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.129:37961
I20260709 13:18:55.544991 12707 raft_consensus.cc:740] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.545378 12800 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.129:37961 every 8 connection(s)
W20260709 13:18:55.541627 11989 consensus_peers.cc:597] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:55.545706 11915 consensus_peers.cc:597] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:55.546169 12707 consensus_queue.cc:260] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:55.548923 12707 ts_tablet_manager.cc:1434] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:18:55.550074 12707 tablet_bootstrap.cc:492] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:55.550557 12777 raft_consensus.cc:493] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.551086 12777 raft_consensus.cc:515] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:55.556257 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fab9357d5e4c8093e8d5482cb5ed2b" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:55.557080 12777 leader_election.cc:290] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:55.592504 12777 raft_consensus.cc:493] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.593096 12777 raft_consensus.cc:515] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:55.595456 12777 leader_election.cc:290] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:55.597288 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7991b50605d0412aa1b3b5e79de17e01" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:55.622684 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7991b50605d0412aa1b3b5e79de17e01" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:55.622764 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fab9357d5e4c8093e8d5482cb5ed2b" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:55.624874 12704 leader_election.cc:304] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:55.625836 12777 raft_consensus.cc:2749] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:55.627260 12704 leader_election.cc:304] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdbe2261c337471ea4d0c980ebb80c72; no voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:55.628070 12777 raft_consensus.cc:2749] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:55.638677 12707 tablet_bootstrap.cc:492] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:55.639815 12707 tablet_bootstrap.cc:492] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:55.640513 12707 ts_tablet_manager.cc:1403] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.091s	user 0.022s	sys 0.027s
W20260709 13:18:55.648741 11989 consensus_peers.cc:597] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:55.650305 12707 raft_consensus.cc:359] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
W20260709 13:18:55.651897 11989 consensus_peers.cc:597] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:55.651942 12707 raft_consensus.cc:740] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.655244 12707 consensus_queue.cc:260] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:55.658442 12707 ts_tablet_manager.cc:1434] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:18:55.659057 12803 heartbeater.cc:344] Connected to a master server at 127.1.227.190:43207
I20260709 13:18:55.659545 12803 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:55.659718 12707 tablet_bootstrap.cc:492] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:55.661002 12803 heartbeater.cc:507] Master 127.1.227.190:43207 requested a full tablet report, sending...
I20260709 13:18:55.681301 11695 ts_manager.cc:194] Re-registered known tserver with Master: bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:18:55.681622 12777 raft_consensus.cc:493] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.682400 12777 raft_consensus.cc:515] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:55.685223 12777 leader_election.cc:290] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:18:55.688051 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9288763b344f2fb95940d6a0ce7bcd" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:55.688596 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9288763b344f2fb95940d6a0ce7bcd" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:55.690886 12703 leader_election.cc:304] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdbe2261c337471ea4d0c980ebb80c72; no voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9
I20260709 13:18:55.692027 12777 raft_consensus.cc:2749] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:55.693766 12766 raft_consensus.cc:3060] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:55.695412 11915 consensus_peers.cc:597] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:55.699656 12707 tablet_bootstrap.cc:492] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:55.700995 12707 tablet_bootstrap.cc:492] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:55.701704 12707 ts_tablet_manager.cc:1403] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.042s	user 0.024s	sys 0.014s
I20260709 13:18:55.705117 12707 raft_consensus.cc:359] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:55.706138 12707 raft_consensus.cc:740] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.707384 12707 consensus_queue.cc:260] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:55.709645 12707 ts_tablet_manager.cc:1434] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:18:55.710580 12707 tablet_bootstrap.cc:492] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:55.727854 12777 raft_consensus.cc:493] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.728721 12777 raft_consensus.cc:515] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:55.733034 12015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edba2429705947968300245b7a6049e1" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:18:55.737584 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edba2429705947968300245b7a6049e1" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:55.739233 12777 leader_election.cc:290] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:18:55.741418 12703 leader_election.cc:304] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdbe2261c337471ea4d0c980ebb80c72; no voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:55.749006 12777 raft_consensus.cc:2749] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:55.746989 11915 consensus_peers.cc:597] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:55.753958 12707 tablet_bootstrap.cc:492] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:55.755113 12707 tablet_bootstrap.cc:492] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:55.755779 12707 ts_tablet_manager.cc:1403] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.045s	user 0.024s	sys 0.014s
I20260709 13:18:55.760674 12707 raft_consensus.cc:359] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:55.761452 12707 raft_consensus.cc:740] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.763706 12707 consensus_queue.cc:260] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:55.765983 12707 ts_tablet_manager.cc:1434] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:18:55.766896 12707 tablet_bootstrap.cc:492] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
W20260709 13:18:55.767554 11915 consensus_peers.cc:597] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:55.769084 12764 raft_consensus.cc:3060] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:55.776679 12765 raft_consensus.cc:3060] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:55.828351 11915 consensus_peers.cc:597] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:55.847250 12707 tablet_bootstrap.cc:492] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:55.848941 12707 tablet_bootstrap.cc:492] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:55.849728 12707 ts_tablet_manager.cc:1403] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.083s	user 0.030s	sys 0.040s
I20260709 13:18:55.852579 12707 raft_consensus.cc:359] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:55.853327 12707 raft_consensus.cc:740] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.854326 12707 consensus_queue.cc:260] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:55.856760 12707 ts_tablet_manager.cc:1434] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:18:55.857626 12707 tablet_bootstrap.cc:492] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:55.863103 11695 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60490
I20260709 13:18:55.868968 12803 heartbeater.cc:499] Master 127.1.227.190:43207 was elected leader, sending a full tablet report...
I20260709 13:18:55.875157 12707 tablet_bootstrap.cc:492] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:55.876402 12707 tablet_bootstrap.cc:492] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:55.877241 12707 ts_tablet_manager.cc:1403] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 13:18:55.880007 12707 raft_consensus.cc:359] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:55.880861 12707 raft_consensus.cc:740] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.881611 12707 consensus_queue.cc:260] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:55.884107 12707 ts_tablet_manager.cc:1434] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:18:55.884989 12707 tablet_bootstrap.cc:492] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
W20260709 13:18:55.911806 11841 consensus_peers.cc:597] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:55.912808 11915 consensus_peers.cc:597] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:55.917599 12707 tablet_bootstrap.cc:492] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:55.918855 12707 tablet_bootstrap.cc:492] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:55.919543 12707 ts_tablet_manager.cc:1403] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.002s
I20260709 13:18:55.922297 12707 raft_consensus.cc:359] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:55.922981 12707 raft_consensus.cc:740] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.923811 12707 consensus_queue.cc:260] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:55.925625 12707 ts_tablet_manager.cc:1434] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:18:55.926014 12764 raft_consensus.cc:3060] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:55.926491 12707 tablet_bootstrap.cc:492] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:55.950124 12707 tablet_bootstrap.cc:492] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:55.951126 12707 tablet_bootstrap.cc:492] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:55.951813 12707 ts_tablet_manager.cc:1403] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.004s
I20260709 13:18:55.954530 12707 raft_consensus.cc:359] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:55.955250 12707 raft_consensus.cc:740] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.956178 12707 consensus_queue.cc:260] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:55.958107 12707 ts_tablet_manager.cc:1434] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:18:55.958878 12707 tablet_bootstrap.cc:492] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
W20260709 13:18:55.965072 11915 consensus_peers.cc:597] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:55.977708 12766 raft_consensus.cc:3060] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:55.981634 12707 tablet_bootstrap.cc:492] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:55.982682 12707 tablet_bootstrap.cc:492] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:55.983357 12707 ts_tablet_manager.cc:1403] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.007s
I20260709 13:18:55.990777 12707 raft_consensus.cc:359] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:55.991576 12707 raft_consensus.cc:740] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.992295 12707 consensus_queue.cc:260] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:56.002790 12755 raft_consensus.cc:3060] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:56.002907 12759 raft_consensus.cc:3060] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:56.014458 12707 ts_tablet_manager.cc:1434] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.004s
I20260709 13:18:56.016170 12707 tablet_bootstrap.cc:492] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:56.028082 12755 raft_consensus.cc:3060] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:56.035950 11989 consensus_peers.cc:597] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:56.039625 12777 raft_consensus.cc:493] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04f862d1b8824d7a81daa0cad52c5843)
I20260709 13:18:56.042146 12777 raft_consensus.cc:515] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:56.047560 12777 leader_election.cc:290] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:18:56.049310 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6ff283134a4463af9ad09ed3ac81ce" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" is_pre_election: true
I20260709 13:18:56.049544 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa6ff283134a4463af9ad09ed3ac81ce" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:18:56.051071 12707 tablet_bootstrap.cc:492] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:56.053013 12707 tablet_bootstrap.cc:492] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:56.053395 12703 leader_election.cc:304] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdbe2261c337471ea4d0c980ebb80c72; no voters: 04f862d1b8824d7a81daa0cad52c5843, 7283c2ba87e94087b9ac5dcb372c4e1d
I20260709 13:18:56.053849 12707 ts_tablet_manager.cc:1403] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.008s
I20260709 13:18:56.054719 12821 raft_consensus.cc:2749] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:56.056821 12707 raft_consensus.cc:359] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:56.061142 12766 raft_consensus.cc:3060] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:56.076460 11989 consensus_peers.cc:597] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:56.079774 12765 raft_consensus.cc:3060] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:56.057600 12707 raft_consensus.cc:740] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.089905 12707 consensus_queue.cc:260] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:56.092324 12707 ts_tablet_manager.cc:1434] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 13:18:56.093230 12707 tablet_bootstrap.cc:492] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:56.095968 12759 raft_consensus.cc:3060] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:56.178350 12755 raft_consensus.cc:3060] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:56.179150 12707 tablet_bootstrap.cc:492] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:56.180523 12707 tablet_bootstrap.cc:492] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:56.181254 12707 ts_tablet_manager.cc:1403] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.088s	user 0.024s	sys 0.024s
I20260709 13:18:56.184186 12707 raft_consensus.cc:359] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:56.184962 12707 raft_consensus.cc:740] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.185905 12707 consensus_queue.cc:260] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:56.190537 12707 ts_tablet_manager.cc:1434] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:18:56.191772 12707 tablet_bootstrap.cc:492] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:56.247022 12707 tablet_bootstrap.cc:492] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:56.248040 12707 tablet_bootstrap.cc:492] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:56.248747 12707 ts_tablet_manager.cc:1403] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.003s
I20260709 13:18:56.251230 12707 raft_consensus.cc:359] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:56.251919 12707 raft_consensus.cc:740] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.252696 12707 consensus_queue.cc:260] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:56.256623 12707 ts_tablet_manager.cc:1434] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:18:56.257619 12707 tablet_bootstrap.cc:492] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
W20260709 13:18:56.280805 11915 consensus_peers.cc:597] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:56.284400 12707 tablet_bootstrap.cc:492] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:56.285528 12707 tablet_bootstrap.cc:492] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:56.286212 12707 ts_tablet_manager.cc:1403] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.003s
I20260709 13:18:56.289155 12707 raft_consensus.cc:359] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:56.290035 12707 raft_consensus.cc:740] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.290830 12707 consensus_queue.cc:260] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:56.292376 12707 ts_tablet_manager.cc:1434] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:56.294354 12707 tablet_bootstrap.cc:492] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:56.308894 12707 tablet_bootstrap.cc:492] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:56.309705 12707 tablet_bootstrap.cc:492] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:56.310314 12707 ts_tablet_manager.cc:1403] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.001s
I20260709 13:18:56.312129 12707 raft_consensus.cc:359] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:56.312621 12707 raft_consensus.cc:740] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.313227 12707 consensus_queue.cc:260] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:56.315225 12707 ts_tablet_manager.cc:1434] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:18:56.316382 12707 tablet_bootstrap.cc:492] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:56.330261 12707 tablet_bootstrap.cc:492] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:56.331219 12707 tablet_bootstrap.cc:492] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:56.331928 12707 ts_tablet_manager.cc:1403] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 13:18:56.334290 12707 raft_consensus.cc:359] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:56.334928 12707 raft_consensus.cc:740] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.335590 12707 consensus_queue.cc:260] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:56.337888 12707 ts_tablet_manager.cc:1434] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:18:56.338788 12707 tablet_bootstrap.cc:492] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:56.356283 12707 tablet_bootstrap.cc:492] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:56.357223 12707 tablet_bootstrap.cc:492] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:56.357954 12707 ts_tablet_manager.cc:1403] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:18:56.360014 12707 raft_consensus.cc:359] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:56.360649 12707 raft_consensus.cc:740] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.361274 12707 consensus_queue.cc:260] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:56.362912 12707 ts_tablet_manager.cc:1434] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:18:56.363680 12707 tablet_bootstrap.cc:492] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:56.377241 12707 tablet_bootstrap.cc:492] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:56.378193 12707 tablet_bootstrap.cc:492] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:56.378793 12707 ts_tablet_manager.cc:1403] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.006s
I20260709 13:18:56.380826 12707 raft_consensus.cc:359] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:56.381529 12707 raft_consensus.cc:740] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.383021 12707 consensus_queue.cc:260] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:56.385394 12707 ts_tablet_manager.cc:1434] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:18:56.387326 12707 tablet_bootstrap.cc:492] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:56.407121 12707 tablet_bootstrap.cc:492] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:56.408187 12707 tablet_bootstrap.cc:492] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:56.408924 12707 ts_tablet_manager.cc:1403] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.003s
W20260709 13:18:56.410219 11915 consensus_peers.cc:597] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:56.411686 12707 raft_consensus.cc:359] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:56.412426 12707 raft_consensus.cc:740] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.413090 12707 consensus_queue.cc:260] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:56.415284 12707 ts_tablet_manager.cc:1434] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:18:56.416440 12707 tablet_bootstrap.cc:492] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:56.425594 12755 raft_consensus.cc:3060] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:56.434142 12759 raft_consensus.cc:3060] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:56.468278 12755 raft_consensus.cc:3060] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:56.491117 12707 tablet_bootstrap.cc:492] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:56.496376 12707 tablet_bootstrap.cc:492] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:56.497064 12707 ts_tablet_manager.cc:1403] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.081s	user 0.024s	sys 0.040s
I20260709 13:18:56.507066 12707 raft_consensus.cc:359] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:56.507946 12707 raft_consensus.cc:740] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.508627 12707 consensus_queue.cc:260] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:56.510667 12707 ts_tablet_manager.cc:1434] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:18:56.511349 12707 tablet_bootstrap.cc:492] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:56.556802 12755 raft_consensus.cc:3060] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:56.623910 12707 tablet_bootstrap.cc:492] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:56.624991 12707 tablet_bootstrap.cc:492] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:56.626626 12707 ts_tablet_manager.cc:1403] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.115s	user 0.049s	sys 0.053s
I20260709 13:18:56.629086 12707 raft_consensus.cc:359] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:56.629801 12707 raft_consensus.cc:740] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.630481 12707 consensus_queue.cc:260] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:56.633070 12707 ts_tablet_manager.cc:1434] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:18:56.633965 12707 tablet_bootstrap.cc:492] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:56.645197 12765 raft_consensus.cc:3060] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:56.658481 12707 tablet_bootstrap.cc:492] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:56.659622 12707 tablet_bootstrap.cc:492] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:56.660315 12707 ts_tablet_manager.cc:1403] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.005s
I20260709 13:18:56.663084 12707 raft_consensus.cc:359] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:56.663839 12707 raft_consensus.cc:740] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.664538 12707 consensus_queue.cc:260] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:56.665333 12764 raft_consensus.cc:3060] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:56.666834 12707 ts_tablet_manager.cc:1434] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:18:56.667793 12707 tablet_bootstrap.cc:492] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:56.717422 12766 raft_consensus.cc:3060] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:56.772655 12707 tablet_bootstrap.cc:492] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:56.773784 12707 tablet_bootstrap.cc:492] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:56.774504 12707 ts_tablet_manager.cc:1403] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.107s	user 0.046s	sys 0.056s
I20260709 13:18:56.779812 12707 raft_consensus.cc:359] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:56.780675 12707 raft_consensus.cc:740] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.781430 12707 consensus_queue.cc:260] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:18:56.783474 12707 ts_tablet_manager.cc:1434] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:18:56.784212 12707 tablet_bootstrap.cc:492] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:56.835595 12707 tablet_bootstrap.cc:492] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:56.850101 12707 tablet_bootstrap.cc:492] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:56.851114 12707 ts_tablet_manager.cc:1403] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.067s	user 0.030s	sys 0.014s
I20260709 13:18:56.854218 12707 raft_consensus.cc:359] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:56.855010 12707 raft_consensus.cc:740] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.855715 12707 consensus_queue.cc:260] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:56.857787 12707 ts_tablet_manager.cc:1434] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:18:56.858938 12707 tablet_bootstrap.cc:492] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:56.874737 12707 tablet_bootstrap.cc:492] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:56.875484 12707 tablet_bootstrap.cc:492] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:56.876114 12707 ts_tablet_manager.cc:1403] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 13:18:56.878415 12707 raft_consensus.cc:359] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:56.879086 12707 raft_consensus.cc:740] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.879753 12707 consensus_queue.cc:260] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:18:56.881590 12707 ts_tablet_manager.cc:1434] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:18:56.882359 12707 tablet_bootstrap.cc:492] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap starting.
I20260709 13:18:56.903987 12755 raft_consensus.cc:3060] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:56.904381 12707 tablet_bootstrap.cc:492] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:56.905237 12707 tablet_bootstrap.cc:492] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72: Bootstrap complete.
I20260709 13:18:56.905818 12707 ts_tablet_manager.cc:1403] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 13:18:56.907884 12707 raft_consensus.cc:359] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:56.908376 12707 raft_consensus.cc:740] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.909083 12707 consensus_queue.cc:260] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:18:56.911188 12707 ts_tablet_manager.cc:1434] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:18:56.931860 12765 raft_consensus.cc:3060] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:57.423492 12765 raft_consensus.cc:3060] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:04.322533 11842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:38909, user_credentials={real_user=slave}} blocked reactor thread for 52081.2us
W20260709 13:19:04.474342 11989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:43333, user_credentials={real_user=slave}} blocked reactor thread for 468215us
W20260709 13:19:05.086160 11897 debug-util.cc:398] Leaking SignalData structure 0x7b08002d64c0 after lost signal to thread 1937
W20260709 13:19:05.087250 11897 debug-util.cc:398] Leaking SignalData structure 0x7b08002b8180 after lost signal to thread 11733
W20260709 13:19:05.088632 11897 debug-util.cc:398] Leaking SignalData structure 0x7b08003b89c0 after lost signal to thread 11900
W20260709 13:19:05.090212 11897 debug-util.cc:398] Leaking SignalData structure 0x7b08002762c0 after lost signal to thread 11974
W20260709 13:19:05.091382 11897 debug-util.cc:398] Leaking SignalData structure 0x7b0800033040 after lost signal to thread 12048
W20260709 13:19:05.092758 11897 debug-util.cc:398] Leaking SignalData structure 0x7b080023bf80 after lost signal to thread 12800
I20260709 13:19:05.694232  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:05.774505 11947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ab10d5ae5884d03b62499dd736e479e"
dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
mode: GRACEFUL
new_leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:51390
I20260709 13:19:05.775496 11947 raft_consensus.cc:606] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Received request to transfer leadership to TS bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:05.778972 11947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34e862ca999046aca1a257edebcdfea3"
dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
mode: GRACEFUL
new_leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:51390
I20260709 13:19:05.779546 11947 raft_consensus.cc:606] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Received request to transfer leadership to TS bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:05.783298 11947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d66e54a11a44e09b15744ecdc4ae226"
dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
mode: GRACEFUL
new_leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:51390
I20260709 13:19:05.784320 11947 raft_consensus.cc:606] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Received request to transfer leadership to TS bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:05.786412 12869 raft_consensus.cc:993] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843: : Instructing follower bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:05.786970 12869 raft_consensus.cc:1081] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Signalling peer bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:05.790520 12757 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34e862ca999046aca1a257edebcdfea3"
dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:55900
I20260709 13:19:05.791193 12757 raft_consensus.cc:493] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:05.791680 12757 raft_consensus.cc:3060] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:05.806087 12757 raft_consensus.cc:515] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:05.809715 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e862ca999046aca1a257edebcdfea3" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:19:05.810521 11947 raft_consensus.cc:3055] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:05.810835 11947 raft_consensus.cc:740] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:19:05.811673 11947 consensus_queue.cc:260] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:05.814805 11947 raft_consensus.cc:3060] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:05.815614 12757 leader_election.cc:290] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 3 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:19:05.817348 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e862ca999046aca1a257edebcdfea3" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:19:05.818091 12024 raft_consensus.cc:3060] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:05.832705 12024 raft_consensus.cc:2468] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 3.
I20260709 13:19:05.834906 11947 raft_consensus.cc:2468] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 3.
I20260709 13:19:05.835850 12704 leader_election.cc:304] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:19:05.837890 12895 raft_consensus.cc:2804] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:05.846649 11871 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cd960dbe5b2404bbec84f15a3cc69f1"
dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
mode: GRACEFUL
new_leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:60010
I20260709 13:19:05.847316 11871 raft_consensus.cc:606] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Received request to transfer leadership to TS bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:05.848335 12895 raft_consensus.cc:697] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 3 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:19:05.849666 12895 consensus_queue.cc:237] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:05.851558 11947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb8e389bf22e48259f4d63c2c12f4713"
dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
mode: GRACEFUL
new_leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:51390
I20260709 13:19:05.852205 11947 raft_consensus.cc:606] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Received request to transfer leadership to TS bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:05.856050 11947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4fab9357d5e4c8093e8d5482cb5ed2b"
dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
mode: GRACEFUL
new_leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:51390
I20260709 13:19:05.856626 11947 raft_consensus.cc:606] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Received request to transfer leadership to TS bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:05.858477  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:05.860216  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:05.878064 11694 catalog_manager.cc:5697] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 2 to 3, leader changed from 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131) to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 3 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:05.935716 12883 raft_consensus.cc:993] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843: : Instructing follower bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:05.936362 12869 raft_consensus.cc:1081] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Signalling peer bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:05.938143 12758 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb8e389bf22e48259f4d63c2c12f4713"
dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:55900
I20260709 13:19:05.938695 12758 raft_consensus.cc:493] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:05.939074 12758 raft_consensus.cc:3060] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:05.945523 12758 raft_consensus.cc:515] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:05.947332 12758 leader_election.cc:290] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 3 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:19:05.948315 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8e389bf22e48259f4d63c2c12f4713" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:19:05.948573 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8e389bf22e48259f4d63c2c12f4713" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:19:05.948954 11871 raft_consensus.cc:3060] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:05.949250 11947 raft_consensus.cc:3055] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:05.949672 11947 raft_consensus.cc:740] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:19:05.950656 11947 consensus_queue.cc:260] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:05.951952 11947 raft_consensus.cc:3060] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:05.960376 11947 raft_consensus.cc:2468] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 3.
I20260709 13:19:05.961966 12703 leader_election.cc:304] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:19:05.963615 12895 raft_consensus.cc:2804] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:05.964114 12895 raft_consensus.cc:697] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 3 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:19:05.965032 12895 consensus_queue.cc:237] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:05.998425 11694 catalog_manager.cc:5697] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 2 to 3, leader changed from 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131) to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 3 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:06.006263 11871 raft_consensus.cc:2468] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 3.
I20260709 13:19:06.066515 12659 raft_consensus.cc:993] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d: : Instructing follower bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:06.067245 12879 raft_consensus.cc:1081] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Signalling peer bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:06.069046 12759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cd960dbe5b2404bbec84f15a3cc69f1"
dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:55904
I20260709 13:19:06.069550 12759 raft_consensus.cc:493] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:06.069911 12759 raft_consensus.cc:3060] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.078521 12759 raft_consensus.cc:515] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:06.080295 12759 leader_election.cc:290] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:19:06.081244 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd960dbe5b2404bbec84f15a3cc69f1" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:19:06.081948 11869 raft_consensus.cc:3055] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:06.082230 11869 raft_consensus.cc:740] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
I20260709 13:19:06.082939 11869 consensus_queue.cc:260] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:06.084022 11869 raft_consensus.cc:3060] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.089288 11869 raft_consensus.cc:2468] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 2.
I20260709 13:19:06.081615 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd960dbe5b2404bbec84f15a3cc69f1" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:19:06.089931 11947 raft_consensus.cc:3060] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.090711 12703 leader_election.cc:304] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:19:06.091660 12895 raft_consensus.cc:2804] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:06.092178 12895 raft_consensus.cc:697] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:19:06.093174 12895 consensus_queue.cc:237] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:06.096926 11947 raft_consensus.cc:2468] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 2.
I20260709 13:19:06.146946 11694 catalog_manager.cc:5697] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 1 to 2, leader changed from 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130) to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 2 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:06.186242 12869 raft_consensus.cc:993] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843: : Instructing follower bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:06.186751 12883 raft_consensus.cc:1081] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Signalling peer bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:06.191268 12764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d66e54a11a44e09b15744ecdc4ae226"
dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:55900
I20260709 13:19:06.191885 12764 raft_consensus.cc:493] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:06.192277 12764 raft_consensus.cc:3060] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.200733 12883 raft_consensus.cc:993] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843: : Instructing follower bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:06.201423 12883 raft_consensus.cc:1081] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Signalling peer bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:06.203487 12759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ab10d5ae5884d03b62499dd736e479e"
dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:55900
I20260709 13:19:06.204200 12759 raft_consensus.cc:493] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:06.204645 12759 raft_consensus.cc:3060] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.208932 12764 raft_consensus.cc:515] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:06.211318 12764 leader_election.cc:290] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:19:06.212158 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d66e54a11a44e09b15744ecdc4ae226" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:19:06.212755 11871 raft_consensus.cc:3060] T 5d66e54a11a44e09b15744ecdc4ae226 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.212972 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d66e54a11a44e09b15744ecdc4ae226" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:19:06.213503 11947 raft_consensus.cc:3055] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:06.213796 11947 raft_consensus.cc:740] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:19:06.214221 12759 raft_consensus.cc:515] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:06.214641 11947 consensus_queue.cc:260] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:06.215840 11947 raft_consensus.cc:3060] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.216794 12759 leader_election.cc:290] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:19:06.220121 11869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab10d5ae5884d03b62499dd736e479e" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:19:06.220749 11869 raft_consensus.cc:3060] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.220991 11871 raft_consensus.cc:2468] T 5d66e54a11a44e09b15744ecdc4ae226 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 2.
I20260709 13:19:06.223841 11947 raft_consensus.cc:2468] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 2.
I20260709 13:19:06.225001 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab10d5ae5884d03b62499dd736e479e" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:19:06.225584 11945 raft_consensus.cc:3055] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:06.225883 11945 raft_consensus.cc:740] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:19:06.226711 11945 consensus_queue.cc:260] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:06.227614 11945 raft_consensus.cc:3060] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.229415 11869 raft_consensus.cc:2468] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 2.
I20260709 13:19:06.231119 12703 leader_election.cc:304] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:19:06.231881 12895 raft_consensus.cc:2804] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:06.232338 12895 raft_consensus.cc:697] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:19:06.232445 12703 leader_election.cc:304] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:19:06.233290 12895 consensus_queue.cc:237] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:06.237054 12896 raft_consensus.cc:2804] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:06.237845 12896 raft_consensus.cc:697] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [term 2 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:19:06.239420 12896 consensus_queue.cc:237] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:06.261222 11694 catalog_manager.cc:5697] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 1 to 2, leader changed from 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131) to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 2 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:06.285220 11945 raft_consensus.cc:2468] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 2.
I20260709 13:19:06.293962 11694 catalog_manager.cc:5697] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 1 to 2, leader changed from 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131) to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 2 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:06.298676 12017 raft_consensus.cc:1275] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:06.300367 12896 consensus_queue.cc:1048] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:06.319890 12883 raft_consensus.cc:993] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843: : Instructing follower bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:06.320693 12884 raft_consensus.cc:1081] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Signalling peer bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:06.322747 12759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4fab9357d5e4c8093e8d5482cb5ed2b"
dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:55900
I20260709 13:19:06.323400 12759 raft_consensus.cc:493] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:06.323809 12759 raft_consensus.cc:3060] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.334645 11945 raft_consensus.cc:1275] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:06.336689 12907 consensus_queue.cc:1048] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:06.349387 12759 raft_consensus.cc:515] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:06.352643 12759 leader_election.cc:290] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:19:06.353603 12024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fab9357d5e4c8093e8d5482cb5ed2b" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:19:06.354306 12024 raft_consensus.cc:3060] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.361104 12024 raft_consensus.cc:2468] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 2.
I20260709 13:19:06.363148 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4fab9357d5e4c8093e8d5482cb5ed2b" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:19:06.364024 11947 raft_consensus.cc:3055] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:06.364392 11947 raft_consensus.cc:740] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:19:06.365571 11947 consensus_queue.cc:260] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:06.367057 11947 raft_consensus.cc:3060] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.368443 12704 leader_election.cc:304] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:19:06.369359 12907 raft_consensus.cc:2804] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:06.369835 12907 raft_consensus.cc:697] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [term 2 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:19:06.370749 12907 consensus_queue.cc:237] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:06.385632 11947 raft_consensus.cc:2468] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 2.
I20260709 13:19:06.399407 11694 catalog_manager.cc:5697] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 1 to 2, leader changed from 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131) to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 2 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.495018 11945 raft_consensus.cc:1275] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:06.496384 12907 consensus_queue.cc:1048] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:06.531453 11871 raft_consensus.cc:1275] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 3 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:06.536158 12895 consensus_queue.cc:1048] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:06.612744 11869 raft_consensus.cc:1275] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.614115 12895 consensus_queue.cc:1048] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:06.618518 11945 raft_consensus.cc:1275] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.620230 12895 consensus_queue.cc:1048] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:06.624423 11950 raft_consensus.cc:1275] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.625710 12895 consensus_queue.cc:1048] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:06.638108 11947 raft_consensus.cc:1275] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.641152 12907 consensus_queue.cc:1048] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:06.685638 11871 raft_consensus.cc:1275] T 5d66e54a11a44e09b15744ecdc4ae226 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.696511 12896 consensus_queue.cc:1048] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:19:06.750456 12703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:35995, user_credentials={real_user=slave}} blocked reactor thread for 49652.4us
I20260709 13:19:06.760515 11871 raft_consensus.cc:1275] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.772527 12924 consensus_queue.cc:1048] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:06.787797 12017 raft_consensus.cc:1275] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.789516 12923 consensus_queue.cc:1048] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:06.836097 11945 raft_consensus.cc:1275] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.845049 12924 consensus_queue.cc:1048] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:06.861377  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:06.956013  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:07.007766 11871 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43a598cfbb3c457eb5a8c9801d421a01"
dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
mode: GRACEFUL
new_leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:60010
I20260709 13:19:07.008306 11871 raft_consensus.cc:606] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Received request to transfer leadership to TS bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:07.011232 11945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52b7a6ebef9c43598294f430c70b2fb5"
dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
mode: GRACEFUL
new_leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:51390
I20260709 13:19:07.011821 11945 raft_consensus.cc:606] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Received request to transfer leadership to TS bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:07.014801 11945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f3910c15d144fd09ea36bd9f5344eef"
dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
mode: GRACEFUL
new_leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:51390
I20260709 13:19:07.015329 11945 raft_consensus.cc:606] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Received request to transfer leadership to TS bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:07.017894 11945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d52730cf917140dfaced7ad6cf28f5f7"
dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
mode: GRACEFUL
new_leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:51390
I20260709 13:19:07.018543 11945 raft_consensus.cc:606] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Received request to transfer leadership to TS bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:07.021852 11945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d55c8d664ee74f0fbb31693f1b398fba"
dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
mode: GRACEFUL
new_leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:51390
I20260709 13:19:07.022341 11945 raft_consensus.cc:606] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Received request to transfer leadership to TS bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:07.024750 11945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e38fc17625bd4a30b79f4a0bc2f8bf39"
dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
mode: GRACEFUL
new_leader_uuid: "1f7178f720eb4090a3593087331b82e9"
 from {username='slave'} at 127.0.0.1:51390
I20260709 13:19:07.025267 11945 raft_consensus.cc:606] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Received request to transfer leadership to TS 1f7178f720eb4090a3593087331b82e9
I20260709 13:19:07.026412  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:07.028229  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:07.173230 12904 raft_consensus.cc:993] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843: : Instructing follower bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:07.174274 12904 raft_consensus.cc:1081] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Signalling peer bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:07.175889 12759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d55c8d664ee74f0fbb31693f1b398fba"
dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:55900
I20260709 13:19:07.176453 12759 raft_consensus.cc:493] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:07.176833 12759 raft_consensus.cc:3060] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.183673 12759 raft_consensus.cc:515] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:07.185271 12759 leader_election.cc:290] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 3 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:19:07.186205 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55c8d664ee74f0fbb31693f1b398fba" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:19:07.186606 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55c8d664ee74f0fbb31693f1b398fba" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:19:07.186967 11868 raft_consensus.cc:3060] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.187635 11945 raft_consensus.cc:3055] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:07.188095 11945 raft_consensus.cc:740] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:19:07.188936 11945 consensus_queue.cc:260] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:07.190148 11945 raft_consensus.cc:3060] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.194968 11945 raft_consensus.cc:2468] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 3.
I20260709 13:19:07.196035 12703 leader_election.cc:304] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:19:07.196743 11868 raft_consensus.cc:2468] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 3.
I20260709 13:19:07.196779 12907 raft_consensus.cc:2804] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:07.197691 12907 raft_consensus.cc:697] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 3 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:19:07.198633 12907 consensus_queue.cc:237] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:07.214824 11695 catalog_manager.cc:5697] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 2 to 3, leader changed from 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131) to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 3 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:07.226488 12904 raft_consensus.cc:993] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843: : Instructing follower 1f7178f720eb4090a3593087331b82e9 to start an election
I20260709 13:19:07.227020 12884 raft_consensus.cc:1081] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Signalling peer 1f7178f720eb4090a3593087331b82e9 to start an election
I20260709 13:19:07.228952 12017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e38fc17625bd4a30b79f4a0bc2f8bf39"
dest_uuid: "1f7178f720eb4090a3593087331b82e9"
 from {username='slave'} at 127.0.0.1:47824
I20260709 13:19:07.229523 12017 raft_consensus.cc:493] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:07.229918 12017 raft_consensus.cc:3060] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.242661 12017 raft_consensus.cc:515] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:19:07.245677 12017 leader_election.cc:290] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:19:07.251103 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38fc17625bd4a30b79f4a0bc2f8bf39" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:19:07.251763 11950 raft_consensus.cc:3055] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:07.252095 11950 raft_consensus.cc:740] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:19:07.251125 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38fc17625bd4a30b79f4a0bc2f8bf39" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:19:07.253201 11868 raft_consensus.cc:3060] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.253155 11950 consensus_queue.cc:260] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:19:07.257085 11950 raft_consensus.cc:3060] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.265451 11868 raft_consensus.cc:2468] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 2.
I20260709 13:19:07.265452 11950 raft_consensus.cc:2468] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 2.
I20260709 13:19:07.267920 11989 leader_election.cc:304] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, 7283c2ba87e94087b9ac5dcb372c4e1d; no voters: 
I20260709 13:19:07.268954 12905 raft_consensus.cc:2804] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:07.269593 12905 raft_consensus.cc:697] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 [term 2 LEADER]: Becoming Leader. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Running, Role: LEADER
I20260709 13:19:07.270651 12905 consensus_queue.cc:237] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } }
I20260709 13:19:07.275358 12879 raft_consensus.cc:993] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d: : Instructing follower bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:07.275978 12879 raft_consensus.cc:1081] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Signalling peer bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:07.278613 12759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43a598cfbb3c457eb5a8c9801d421a01"
dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:55904
I20260709 13:19:07.279188 12759 raft_consensus.cc:493] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:07.279567 12759 raft_consensus.cc:3060] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.284440 11695 catalog_manager.cc:5697] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 reported cstate change: term changed from 1 to 2, leader changed from 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131) to 1f7178f720eb4090a3593087331b82e9 (127.1.227.132). New cstate: current_term: 2 leader_uuid: "1f7178f720eb4090a3593087331b82e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:07.304142 12904 raft_consensus.cc:993] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843: : Instructing follower bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:07.304710 12904 raft_consensus.cc:1081] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Signalling peer bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:07.304956 12759 raft_consensus.cc:515] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:19:07.307183 12759 leader_election.cc:290] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:19:07.316890 12752 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f3910c15d144fd09ea36bd9f5344eef"
dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:55900
I20260709 13:19:07.317554 12752 raft_consensus.cc:493] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:07.318019 12752 raft_consensus.cc:3060] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.319408 12883 raft_consensus.cc:993] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843: : Instructing follower bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:07.320014 12883 raft_consensus.cc:1081] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Signalling peer bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:07.322212 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a598cfbb3c457eb5a8c9801d421a01" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:19:07.322903 11945 raft_consensus.cc:3060] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.326748 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a598cfbb3c457eb5a8c9801d421a01" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:19:07.327453 11871 raft_consensus.cc:3055] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:07.327751 11871 raft_consensus.cc:740] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
I20260709 13:19:07.328711 11871 consensus_queue.cc:260] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:19:07.330049 11871 raft_consensus.cc:3060] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.333364 12764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d52730cf917140dfaced7ad6cf28f5f7"
dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:55900
I20260709 13:19:07.334313 12764 raft_consensus.cc:493] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:07.334810 12764 raft_consensus.cc:3060] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.349588 11945 raft_consensus.cc:2468] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 2.
I20260709 13:19:07.349629 12764 raft_consensus.cc:515] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:07.351697 12703 leader_election.cc:304] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:19:07.352648 12895 raft_consensus.cc:2804] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:07.353183 12895 raft_consensus.cc:697] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:19:07.354229 12895 consensus_queue.cc:237] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:19:07.355109 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52730cf917140dfaced7ad6cf28f5f7" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:19:07.355769 12017 raft_consensus.cc:3060] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.363622 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52730cf917140dfaced7ad6cf28f5f7" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:19:07.364410 11945 raft_consensus.cc:3055] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:07.364807 11945 raft_consensus.cc:740] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:19:07.368578 12764 leader_election.cc:290] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 3 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:19:07.376761 11945 consensus_queue.cc:260] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:07.435290 11945 raft_consensus.cc:3060] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.436630 12752 raft_consensus.cc:515] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:07.439119 12752 leader_election.cc:290] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:19:07.440697 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3910c15d144fd09ea36bd9f5344eef" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:19:07.441295 11868 raft_consensus.cc:3060] T 5f3910c15d144fd09ea36bd9f5344eef P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.442247 11871 raft_consensus.cc:2468] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 2.
W20260709 13:19:07.441490 11841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:35995, user_credentials={real_user=slave}} blocked reactor thread for 69398.4us
I20260709 13:19:07.448520 11868 raft_consensus.cc:2468] T 5f3910c15d144fd09ea36bd9f5344eef P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 2.
I20260709 13:19:07.449705 12703 leader_election.cc:304] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
W20260709 13:19:07.460470 11989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.131:35995, user_credentials={real_user=slave}} blocked reactor thread for 60106.2us
I20260709 13:19:07.464686 11947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f3910c15d144fd09ea36bd9f5344eef" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:19:07.466512 11947 raft_consensus.cc:3055] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:07.466902 11947 raft_consensus.cc:740] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:19:07.467742 11947 consensus_queue.cc:260] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:07.469185 11947 raft_consensus.cc:3060] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.478236 11947 raft_consensus.cc:2468] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 2.
I20260709 13:19:07.484619 12923 raft_consensus.cc:2804] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:07.485222 12923 raft_consensus.cc:697] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [term 2 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:19:07.486164 12923 consensus_queue.cc:237] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:07.488044 11945 raft_consensus.cc:2468] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 3.
I20260709 13:19:07.489866 12883 raft_consensus.cc:993] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843: : Instructing follower bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:07.490370 12883 raft_consensus.cc:1081] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Signalling peer bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:07.494735 12703 leader_election.cc:304] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:19:07.495553 12895 raft_consensus.cc:2804] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:07.496088 12895 raft_consensus.cc:697] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 3 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:19:07.497061 12895 consensus_queue.cc:237] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:07.497840 11695 catalog_manager.cc:5697] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 1 to 2, leader changed from 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130) to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 2 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:07.488083 12017 raft_consensus.cc:2468] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 3.
I20260709 13:19:07.519979 12764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52b7a6ebef9c43598294f430c70b2fb5"
dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:55900
I20260709 13:19:07.520697 12764 raft_consensus.cc:493] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:07.521116 12764 raft_consensus.cc:3060] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.529965 12764 raft_consensus.cc:515] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:07.531780 12764 leader_election.cc:290] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 election: Requested vote from peers 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333), 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995)
I20260709 13:19:07.540095 11868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b7a6ebef9c43598294f430c70b2fb5" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:19:07.540738 11868 raft_consensus.cc:3060] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.542037 11695 catalog_manager.cc:5697] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 1 to 2, leader changed from 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131) to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 2 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:07.543872 11695 catalog_manager.cc:5697] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 2 to 3, leader changed from 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131) to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 3 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:07.546509 11868 raft_consensus.cc:2468] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 2.
I20260709 13:19:07.550228 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52b7a6ebef9c43598294f430c70b2fb5" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:19:07.550776 11945 raft_consensus.cc:3055] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:07.551044 11945 raft_consensus.cc:740] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:19:07.551791 11945 consensus_queue.cc:260] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:07.552840 11945 raft_consensus.cc:3060] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.563001 11945 raft_consensus.cc:2468] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 2.
I20260709 13:19:07.565109 12703 leader_election.cc:304] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:19:07.565972 12923 raft_consensus.cc:2804] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:07.566494 12923 raft_consensus.cc:697] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:19:07.567375 12923 consensus_queue.cc:237] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:07.583915 11695 catalog_manager.cc:5697] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 1 to 2, leader changed from 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131) to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 2 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:07.625044 11945 raft_consensus.cc:1275] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:07.626447 12923 consensus_queue.cc:1048] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:07.642786 11868 raft_consensus.cc:1275] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [term 3 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:07.644492 12896 consensus_queue.cc:1048] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:07.862007 11945 raft_consensus.cc:1275] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Refusing update from remote peer 1f7178f720eb4090a3593087331b82e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:07.867062 12905 consensus_queue.cc:1048] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:07.868257 11871 raft_consensus.cc:1275] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Refusing update from remote peer 1f7178f720eb4090a3593087331b82e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:07.875398 12931 consensus_queue.cc:1048] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:07.910868 11945 raft_consensus.cc:1275] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:07.912390 12923 consensus_queue.cc:1048] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:07.933940 11868 raft_consensus.cc:1275] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:07.935462 12923 consensus_queue.cc:1048] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:07.958564 11945 raft_consensus.cc:1275] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:07.981467 12923 consensus_queue.cc:1048] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:07.985703 11871 raft_consensus.cc:1275] T 5f3910c15d144fd09ea36bd9f5344eef P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:07.990135 12907 consensus_queue.cc:1048] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:07.998468 12017 raft_consensus.cc:1275] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:07.999953 12923 consensus_queue.cc:1048] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:08.031241  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:08.139237 11871 raft_consensus.cc:1275] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:08.146729 11950 raft_consensus.cc:1275] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:08.160681 11945 raft_consensus.cc:1275] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:08.170684  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:08.182770 12895 consensus_queue.cc:1048] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:08.224843 12923 consensus_queue.cc:1048] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:08.229035 12923 consensus_queue.cc:1048] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:08.271018 11870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25353af0207b4ec1959e0795ded4946c"
dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
mode: GRACEFUL
new_leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:60010
I20260709 13:19:08.271874 11870 raft_consensus.cc:606] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 LEADER]: Received request to transfer leadership to TS bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:08.334728 12017 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dac39fc7f83141e0887192bc70b641b6"
dest_uuid: "1f7178f720eb4090a3593087331b82e9"
mode: GRACEFUL
new_leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:58896
I20260709 13:19:08.335397 12017 raft_consensus.cc:606] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Received request to transfer leadership to TS bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:08.342224 11945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4758afc104744a481a25b59661b80fe"
dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
mode: GRACEFUL
new_leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:51390
I20260709 13:19:08.342859 11945 raft_consensus.cc:606] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Received request to transfer leadership to TS bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:08.344354  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:08.346181  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:08.392583 12904 raft_consensus.cc:993] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843: : Instructing follower bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:08.393158 12883 raft_consensus.cc:1081] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Signalling peer bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:08.394690 12752 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4758afc104744a481a25b59661b80fe"
dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:55900
I20260709 13:19:08.395341 12752 raft_consensus.cc:493] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:08.395828 12752 raft_consensus.cc:3060] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:08.401988 12752 raft_consensus.cc:515] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:08.403929 12752 leader_election.cc:290] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 3 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909)
I20260709 13:19:08.404647 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4758afc104744a481a25b59661b80fe" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "04f862d1b8824d7a81daa0cad52c5843"
I20260709 13:19:08.405236 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4758afc104744a481a25b59661b80fe" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:19:08.405294 11945 raft_consensus.cc:3055] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:08.406065 12016 raft_consensus.cc:3060] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:08.406025 11945 raft_consensus.cc:740] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:19:08.407233 11945 consensus_queue.cc:260] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:08.408540 11945 raft_consensus.cc:3060] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:08.412822 12016 raft_consensus.cc:2468] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 3.
I20260709 13:19:08.414274 12704 leader_election.cc:304] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:19:08.415361 12923 raft_consensus.cc:2804] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:08.415899 12923 raft_consensus.cc:697] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 3 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:19:08.417162 12931 raft_consensus.cc:993] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9: : Instructing follower bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:08.416874 12923 consensus_queue.cc:237] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:08.417629 11945 raft_consensus.cc:2468] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 3.
I20260709 13:19:08.417704 12931 raft_consensus.cc:1081] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Signalling peer bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:08.426631 12764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dac39fc7f83141e0887192bc70b641b6"
dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:55912
I20260709 13:19:08.427292 12764 raft_consensus.cc:493] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:08.427728 12764 raft_consensus.cc:3060] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:08.442276 11698 catalog_manager.cc:5697] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 2 to 3, leader changed from 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131) to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 3 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:08.449668 12764 raft_consensus.cc:515] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:19:08.452951 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac39fc7f83141e0887192bc70b641b6" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:19:08.453184 12764 leader_election.cc:290] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:19:08.453424 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dac39fc7f83141e0887192bc70b641b6" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:19:08.454242 11870 raft_consensus.cc:3060] T dac39fc7f83141e0887192bc70b641b6 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:08.453608 12016 raft_consensus.cc:3055] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:08.454974 12016 raft_consensus.cc:740] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f7178f720eb4090a3593087331b82e9, State: Running, Role: LEADER
I20260709 13:19:08.455907 12016 consensus_queue.cc:260] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:19:08.458089 12016 raft_consensus.cc:3060] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:08.466674 11870 raft_consensus.cc:2468] T dac39fc7f83141e0887192bc70b641b6 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 2.
I20260709 13:19:08.468495 12703 leader_election.cc:304] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:19:08.470768 12895 raft_consensus.cc:2804] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:08.471542 12895 raft_consensus.cc:697] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:19:08.484647 12895 consensus_queue.cc:237] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:19:08.486265 12016 raft_consensus.cc:2468] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 2.
I20260709 13:19:08.515498 11698 catalog_manager.cc:5697] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 1 to 2, leader changed from 1f7178f720eb4090a3593087331b82e9 (127.1.227.132) to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 2 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:08.588001 12925 raft_consensus.cc:993] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d: : Instructing follower bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:08.588702 12957 raft_consensus.cc:1081] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 LEADER]: Signalling peer bdbe2261c337471ea4d0c980ebb80c72 to start an election
I20260709 13:19:08.590513 12764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25353af0207b4ec1959e0795ded4946c"
dest_uuid: "bdbe2261c337471ea4d0c980ebb80c72"
 from {username='slave'} at 127.0.0.1:55904
I20260709 13:19:08.591068 12764 raft_consensus.cc:493] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:08.591393 12764 raft_consensus.cc:3060] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:08.596735 12764 raft_consensus.cc:515] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:19:08.598424 12764 leader_election.cc:290] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 3 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:19:08.599228 12016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25353af0207b4ec1959e0795ded4946c" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:19:08.599496 11870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25353af0207b4ec1959e0795ded4946c" candidate_uuid: "bdbe2261c337471ea4d0c980ebb80c72" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d"
I20260709 13:19:08.600029 12016 raft_consensus.cc:3060] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:08.600203 11870 raft_consensus.cc:3055] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:08.600706 11870 raft_consensus.cc:740] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7283c2ba87e94087b9ac5dcb372c4e1d, State: Running, Role: LEADER
I20260709 13:19:08.601608 11870 consensus_queue.cc:260] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:19:08.603056 11870 raft_consensus.cc:3060] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:08.607185 12016 raft_consensus.cc:2468] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 3.
I20260709 13:19:08.610013 12704 leader_election.cc:304] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72; no voters: 
I20260709 13:19:08.611516 12895 raft_consensus.cc:2804] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:08.612324 12895 raft_consensus.cc:697] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 3 LEADER]: Becoming Leader. State: Replica: bdbe2261c337471ea4d0c980ebb80c72, State: Running, Role: LEADER
I20260709 13:19:08.613310 12895 consensus_queue.cc:237] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:19:08.621253 11870 raft_consensus.cc:2468] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdbe2261c337471ea4d0c980ebb80c72 in term 3.
I20260709 13:19:08.639775 11698 catalog_manager.cc:5697] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 reported cstate change: term changed from 2 to 3, leader changed from 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130) to bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129). New cstate: current_term: 3 leader_uuid: "bdbe2261c337471ea4d0c980ebb80c72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:08.957399 12016 raft_consensus.cc:1275] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:08.958717 12896 consensus_queue.cc:1048] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:09.018525 11945 raft_consensus.cc:1275] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:19:09.020417 11916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.132:38909, user_credentials={real_user=slave}} blocked reactor thread for 45481.2us
I20260709 13:19:09.021201 12895 consensus_queue.cc:1048] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:09.033886 12017 raft_consensus.cc:1275] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:09.039928 12896 consensus_queue.cc:1048] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:09.059669 11870 raft_consensus.cc:1275] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 3 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:09.072207 12895 consensus_queue.cc:1048] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:09.142016 12017 raft_consensus.cc:1275] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:09.151979 12979 consensus_queue.cc:1048] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:19:09.169406 11870 raft_consensus.cc:1275] T dac39fc7f83141e0887192bc70b641b6 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Refusing update from remote peer bdbe2261c337471ea4d0c980ebb80c72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:19:09.220765 12703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:43333, user_credentials={real_user=slave}} blocked reactor thread for 45062.4us
I20260709 13:19:09.221364 12895 consensus_queue.cc:1048] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:09.348856  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:09.543004  1934 tablet_server.cc:179] TabletServer@127.1.227.129:37961 shutting down...
W20260709 13:19:09.583308 11841 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 447 similar messages]
W20260709 13:19:09.612421 11841 consensus_peers.cc:597] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.613183 11915 consensus_peers.cc:597] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.615449 11915 consensus_peers.cc:597] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.613386 11841 consensus_peers.cc:597] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.622841 11915 consensus_peers.cc:597] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.625041 11915 consensus_peers.cc:597] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.629093 11915 consensus_peers.cc:597] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.630119  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:19:09.636085 11989 consensus_peers.cc:597] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.637507 11989 consensus_peers.cc:597] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.642035  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.643463  1934 raft_consensus.cc:2243] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.644518  1934 raft_consensus.cc:2272] T 78f88cc1e70b4b88986a3ff6b79770f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:09.648182 11989 consensus_peers.cc:597] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.649068  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.650454  1934 raft_consensus.cc:2243] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.651158  1934 raft_consensus.cc:2272] T 5595bb972e3e4574a1df19295132c9ae P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.655089  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.656282  1934 raft_consensus.cc:2243] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.657084  1934 raft_consensus.cc:2272] T df332d97fcd742e3b0f2024da1850b81 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.661144  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.662456  1934 raft_consensus.cc:2243] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.663375  1934 raft_consensus.cc:2272] T 095174060bff4a6b8f891f171bb9cd10 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.667013  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.668056  1934 raft_consensus.cc:2243] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.668774  1934 raft_consensus.cc:2272] T 58f5eb834fe84f7cadb173cc0fc58b2f P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.673012  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.674160  1934 raft_consensus.cc:2243] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.675067  1934 raft_consensus.cc:2272] T b8f1d538ab1446f182128209d64b34be P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.679018  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.680171  1934 raft_consensus.cc:2243] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.680963  1934 raft_consensus.cc:2272] T cdcb9800b8894d978568cd9ad81bdd31 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.685200  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.686241  1934 raft_consensus.cc:2243] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.687706  1934 raft_consensus.cc:2272] T 2ab10d5ae5884d03b62499dd736e479e P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.691191  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.692061  1934 raft_consensus.cc:2243] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.692695  1934 raft_consensus.cc:2272] T 72e185eb05f14f19978919c9f8e5906e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.696002  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.697038  1934 raft_consensus.cc:2243] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.698403  1934 raft_consensus.cc:2272] T d52730cf917140dfaced7ad6cf28f5f7 P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.702222  1934 tablet_replica.cc:333] stopping tablet replica
W20260709 13:19:09.702965 11841 consensus_peers.cc:597] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.703127  1934 raft_consensus.cc:2243] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.704525  1934 raft_consensus.cc:2272] T 52b7a6ebef9c43598294f430c70b2fb5 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.707964  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.708979  1934 raft_consensus.cc:2243] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.710525  1934 raft_consensus.cc:2272] T 9cd960dbe5b2404bbec84f15a3cc69f1 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.714330  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.715413  1934 raft_consensus.cc:2243] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.716076  1934 raft_consensus.cc:2272] T ea431ab44bd54c398da2f3469ac6685a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.719658  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.720652  1934 raft_consensus.cc:2243] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.722136  1934 raft_consensus.cc:2272] T bb8e389bf22e48259f4d63c2c12f4713 P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.725769  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.726686  1934 raft_consensus.cc:2243] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.727303  1934 raft_consensus.cc:2272] T 59a9704b659947e6988fc29f5296ec73 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.730716  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.731741  1934 raft_consensus.cc:2243] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.732513  1934 raft_consensus.cc:2272] T 86477bbe25284503970ce70bb1e26190 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.736075  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.737056  1934 raft_consensus.cc:2243] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.737809  1934 raft_consensus.cc:2272] T 9cc9444f841f4d768a714f7462f1cf6e P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:09.740132 11841 consensus_peers.cc:597] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.741673  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.742739  1934 raft_consensus.cc:2243] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.743387  1934 raft_consensus.cc:2272] T f59c45da3f3f43a5b793c3305865da17 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.747378  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.748308  1934 raft_consensus.cc:2243] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.750102  1934 raft_consensus.cc:2272] T 678fcf88b458421b960351bc865762c6 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.754276  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.755306  1934 raft_consensus.cc:2243] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.755924  1934 raft_consensus.cc:2272] T bc8dab527d374a47b91239feea9d8b3a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.759471  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.760324  1934 raft_consensus.cc:2243] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.761019  1934 raft_consensus.cc:2272] T e3fc72a3f0044004b68c29cd9bdbf7d2 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:09.761098 11915 consensus_peers.cc:597] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.764231  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.764853  1934 raft_consensus.cc:2243] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.765924  1934 raft_consensus.cc:2272] T 5d66e54a11a44e09b15744ecdc4ae226 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.769291  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.770349  1934 raft_consensus.cc:2243] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.771560  1934 raft_consensus.cc:2272] T 5f3910c15d144fd09ea36bd9f5344eef P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.774988  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.775938  1934 raft_consensus.cc:2243] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.776645  1934 raft_consensus.cc:2272] T 30bf1f22d4f144109fe8d089d54dd5e6 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.780128  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.781327  1934 raft_consensus.cc:2243] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:09.781908 11915 consensus_peers.cc:597] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.782111  1934 raft_consensus.cc:2272] T 4b8ca7758d7240519907444b2ba2c15f P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.789722  1934 tablet_replica.cc:333] stopping tablet replica
W20260709 13:19:09.790567 11915 consensus_peers.cc:597] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.790768  1934 raft_consensus.cc:2243] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.791460  1934 raft_consensus.cc:2272] T 9780438f22284df785414db0646df50e P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.795022  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.795892  1934 raft_consensus.cc:2243] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.798961  1934 raft_consensus.cc:2272] T f4758afc104744a481a25b59661b80fe P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:09.801273 11989 consensus_peers.cc:597] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.804673  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.806088  1934 raft_consensus.cc:2243] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.807097  1934 raft_consensus.cc:2272] T 2d9288763b344f2fb95940d6a0ce7bcd P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.810422  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.811321  1934 raft_consensus.cc:2243] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.812727  1934 raft_consensus.cc:2272] T 25353af0207b4ec1959e0795ded4946c P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.816840  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.817466  1934 raft_consensus.cc:2243] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.818059  1934 raft_consensus.cc:2272] T 276261d09b63498f8b2902647b4e2b4a P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.820521  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.821126  1934 raft_consensus.cc:2243] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.821538  1934 raft_consensus.cc:2272] T 8d4646ce4a654acda4a5971dbefc623f P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.824790  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.825527  1934 raft_consensus.cc:2243] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.826645  1934 raft_consensus.cc:2272] T 34e862ca999046aca1a257edebcdfea3 P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:09.827822 11989 consensus_peers.cc:597] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.829640  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.830358  1934 raft_consensus.cc:2243] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.831689  1934 raft_consensus.cc:2272] T 43a598cfbb3c457eb5a8c9801d421a01 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.835024  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.835685  1934 raft_consensus.cc:2243] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.836139  1934 raft_consensus.cc:2272] T 1ad333631d4d40a38cada3a3b76f5e52 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.839099  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.839766  1934 raft_consensus.cc:2243] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.840387  1934 raft_consensus.cc:2272] T eece1e771a0341b1bebc6fde110e6f8a P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.843122  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.843694  1934 raft_consensus.cc:2243] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.844202  1934 raft_consensus.cc:2272] T 83da445e9a4d483e8d2504e806a4461b P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.846993  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.847705  1934 raft_consensus.cc:2243] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.848290  1934 raft_consensus.cc:2272] T ecf7f7f507dd4bd797a1b9a3a85b82fe P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.851560  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.852290  1934 raft_consensus.cc:2243] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.852757  1934 raft_consensus.cc:2272] T edba2429705947968300245b7a6049e1 P bdbe2261c337471ea4d0c980ebb80c72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.855762  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.856446  1934 raft_consensus.cc:2243] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.857429  1934 raft_consensus.cc:2272] T d55c8d664ee74f0fbb31693f1b398fba P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.860589  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.861356  1934 raft_consensus.cc:2243] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.862159  1934 raft_consensus.cc:2272] T 47f5c73ecd474b45ae6c27ca1f1046a1 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.865907  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.866798  1934 raft_consensus.cc:2243] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.868278  1934 raft_consensus.cc:2272] T e4fab9357d5e4c8093e8d5482cb5ed2b P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:09.871060 11841 consensus_peers.cc:597] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.871732  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.873633  1934 raft_consensus.cc:2243] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.874668  1934 raft_consensus.cc:2272] T dac39fc7f83141e0887192bc70b641b6 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.878027  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.878698  1934 raft_consensus.cc:2243] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.879305  1934 raft_consensus.cc:2272] T 5dd6d52d3b2649de89e331bbb75335a0 P bdbe2261c337471ea4d0c980ebb80c72 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.882520  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.883312  1934 raft_consensus.cc:2243] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.883996  1934 raft_consensus.cc:2272] T fa6ff283134a4463af9ad09ed3ac81ce P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.887425  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:09.888142  1934 raft_consensus.cc:2243] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.888792  1934 raft_consensus.cc:2272] T 7991b50605d0412aa1b3b5e79de17e01 P bdbe2261c337471ea4d0c980ebb80c72 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:09.900333 11989 consensus_peers.cc:597] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.901245 11989 consensus_peers.cc:597] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.933096 11989 consensus_peers.cc:597] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.964484 11915 consensus_peers.cc:597] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.977671 11841 consensus_peers.cc:597] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:10.031337 11915 consensus_peers.cc:597] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:10.032132 11915 consensus_peers.cc:597] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:10.034679 11989 connection.cc:573] client connection to 127.1.227.129:37961 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:19:10.035732 11989 consensus_peers.cc:597] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:10.041451  1934 tablet_server.cc:196] TabletServer@127.1.227.129:37961 shutdown complete.
W20260709 13:19:10.068676 11915 consensus_peers.cc:597] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:10.075174 11989 consensus_peers.cc:597] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:10.081821 11915 consensus_peers.cc:597] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:10.094281 11841 consensus_peers.cc:597] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:10.094933 11841 consensus_peers.cc:597] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d -> Peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Couldn't send request to peer bdbe2261c337471ea4d0c980ebb80c72. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:10.203297  1934 tablet_server.cc:179] TabletServer@127.1.227.130:0 shutting down...
W20260709 13:19:10.251096 11915 consensus_peers.cc:597] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Couldn't send request to peer 7283c2ba87e94087b9ac5dcb372c4e1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:10.262656 11915 consensus_peers.cc:597] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Couldn't send request to peer 7283c2ba87e94087b9ac5dcb372c4e1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:10.265525 11989 consensus_peers.cc:597] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 -> Peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Couldn't send request to peer 7283c2ba87e94087b9ac5dcb372c4e1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:10.267705 11989 consensus_peers.cc:597] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 -> Peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Couldn't send request to peer 7283c2ba87e94087b9ac5dcb372c4e1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:10.306663  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:10.309578  1934 tablet_replica.cc:333] T 9780438f22284df785414db0646df50e P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.311708  1934 raft_consensus.cc:2243] T 9780438f22284df785414db0646df50e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.312436  1934 raft_consensus.cc:2272] T 9780438f22284df785414db0646df50e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.315999  1934 tablet_replica.cc:333] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.317034  1934 raft_consensus.cc:2243] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:10.319190  1934 raft_consensus.cc:2272] T eece1e771a0341b1bebc6fde110e6f8a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.322353  1934 tablet_replica.cc:333] T dac39fc7f83141e0887192bc70b641b6 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.323323  1934 raft_consensus.cc:2243] T dac39fc7f83141e0887192bc70b641b6 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.324015  1934 raft_consensus.cc:2272] T dac39fc7f83141e0887192bc70b641b6 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.326924  1934 tablet_replica.cc:333] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.327867  1934 raft_consensus.cc:2243] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.328506  1934 raft_consensus.cc:2272] T 4b8ca7758d7240519907444b2ba2c15f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:10.329793 11989 consensus_peers.cc:597] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 -> Peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Couldn't send request to peer 7283c2ba87e94087b9ac5dcb372c4e1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:10.331686  1934 tablet_replica.cc:333] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.332667  1934 raft_consensus.cc:2243] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:19:10.356055 11989 consensus_peers.cc:597] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 -> Peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Couldn't send request to peer 7283c2ba87e94087b9ac5dcb372c4e1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:10.356137  1934 raft_consensus.cc:2272] T 9c44d39672a741709a46194020f68692 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.360525  1934 tablet_replica.cc:333] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.361572  1934 raft_consensus.cc:2243] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.362313  1934 raft_consensus.cc:2272] T fa6ff283134a4463af9ad09ed3ac81ce P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:10.370558 11989 consensus_peers.cc:597] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 -> Peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Couldn't send request to peer 7283c2ba87e94087b9ac5dcb372c4e1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:10.381327 11989 consensus_peers.cc:597] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 -> Peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Couldn't send request to peer 7283c2ba87e94087b9ac5dcb372c4e1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:10.382593  1934 tablet_replica.cc:333] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.383800  1934 raft_consensus.cc:2243] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.384527  1934 raft_consensus.cc:2272] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.388247  1934 tablet_replica.cc:333] T bc8dab527d374a47b91239feea9d8b3a P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
W20260709 13:19:10.389174 11915 consensus_peers.cc:597] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 -> Peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Couldn't send request to peer 7283c2ba87e94087b9ac5dcb372c4e1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:10.389488  1934 raft_consensus.cc:2243] T bc8dab527d374a47b91239feea9d8b3a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.390277  1934 raft_consensus.cc:2272] T bc8dab527d374a47b91239feea9d8b3a P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.393569  1934 tablet_replica.cc:333] T 56ac6eddb0d84b0f921015c7d71e77a2 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.394747  1934 raft_consensus.cc:2243] T 56ac6eddb0d84b0f921015c7d71e77a2 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.395676  1934 raft_consensus.cc:2272] T 56ac6eddb0d84b0f921015c7d71e77a2 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.403007  1934 tablet_replica.cc:333] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.404132  1934 raft_consensus.cc:2243] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:10.405200  1934 raft_consensus.cc:2272] T 59a9704b659947e6988fc29f5296ec73 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.408288  1934 tablet_replica.cc:333] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.409147  1934 raft_consensus.cc:2243] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.409859  1934 raft_consensus.cc:2272] T 52b7a6ebef9c43598294f430c70b2fb5 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.412334  1934 tablet_replica.cc:333] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.413014  1934 raft_consensus.cc:2243] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.413559  1934 raft_consensus.cc:2272] T 25353af0207b4ec1959e0795ded4946c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.415947  1934 tablet_replica.cc:333] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.416550  1934 raft_consensus.cc:2243] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.417047  1934 raft_consensus.cc:2272] T bb8e389bf22e48259f4d63c2c12f4713 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.419286  1934 tablet_replica.cc:333] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.419850  1934 raft_consensus.cc:2243] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:10.420744  1934 raft_consensus.cc:2272] T ab5a46f525fd42468f042b3d38985f42 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.423007  1934 tablet_replica.cc:333] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.423781  1934 raft_consensus.cc:2243] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.424896  1934 raft_consensus.cc:2272] T 55421cf4fed64db6bb366de566968fd9 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.428067  1934 tablet_replica.cc:333] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.428967  1934 raft_consensus.cc:2243] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:10.430199  1934 raft_consensus.cc:2272] T 58f5eb834fe84f7cadb173cc0fc58b2f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.434031  1934 tablet_replica.cc:333] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.434842  1934 raft_consensus.cc:2243] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.435659  1934 raft_consensus.cc:2272] T 2ab10d5ae5884d03b62499dd736e479e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.438867  1934 tablet_replica.cc:333] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.439702  1934 raft_consensus.cc:2243] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:10.440995  1934 raft_consensus.cc:2272] T bce4185998b54aa3900c8c3e9a09d72c P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.443940  1934 tablet_replica.cc:333] T 78f88cc1e70b4b88986a3ff6b79770f7 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.444814  1934 raft_consensus.cc:2243] T 78f88cc1e70b4b88986a3ff6b79770f7 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.445490  1934 raft_consensus.cc:2272] T 78f88cc1e70b4b88986a3ff6b79770f7 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.448256  1934 tablet_replica.cc:333] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
W20260709 13:19:10.450667 11989 consensus_peers.cc:597] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 -> Peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Couldn't send request to peer 7283c2ba87e94087b9ac5dcb372c4e1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:10.451771  1934 raft_consensus.cc:2243] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:10.453684  1934 raft_consensus.cc:2272] T 7991b50605d0412aa1b3b5e79de17e01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.457003  1934 tablet_replica.cc:333] T 8d51c27f1d494f64980afcf1b0f89fff P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.457881  1934 raft_consensus.cc:2243] T 8d51c27f1d494f64980afcf1b0f89fff P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.458448  1934 raft_consensus.cc:2272] T 8d51c27f1d494f64980afcf1b0f89fff P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.461514  1934 tablet_replica.cc:333] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.462505  1934 raft_consensus.cc:2243] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:19:10.463217 11915 consensus_peers.cc:597] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Couldn't send request to peer 7283c2ba87e94087b9ac5dcb372c4e1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:10.463574  1934 raft_consensus.cc:2272] T 653023e6fbaf4ab0869ab68cd9436f6d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.466061  1934 tablet_replica.cc:333] T 5d66e54a11a44e09b15744ecdc4ae226 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.466643  1934 raft_consensus.cc:2243] T 5d66e54a11a44e09b15744ecdc4ae226 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.467139  1934 raft_consensus.cc:2272] T 5d66e54a11a44e09b15744ecdc4ae226 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.469255  1934 tablet_replica.cc:333] T 5f3910c15d144fd09ea36bd9f5344eef P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.469969  1934 raft_consensus.cc:2243] T 5f3910c15d144fd09ea36bd9f5344eef P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.470481  1934 raft_consensus.cc:2272] T 5f3910c15d144fd09ea36bd9f5344eef P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.472651  1934 tablet_replica.cc:333] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.473263  1934 raft_consensus.cc:2243] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.473716  1934 raft_consensus.cc:2272] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.475888  1934 tablet_replica.cc:333] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.476454  1934 raft_consensus.cc:2243] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:10.477284  1934 raft_consensus.cc:2272] T edba2429705947968300245b7a6049e1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.479508  1934 tablet_replica.cc:333] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.480057  1934 raft_consensus.cc:2243] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:10.480880  1934 raft_consensus.cc:2272] T cdcb9800b8894d978568cd9ad81bdd31 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.482964  1934 tablet_replica.cc:333] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.483563  1934 raft_consensus.cc:2243] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.484030  1934 raft_consensus.cc:2272] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.486325  1934 tablet_replica.cc:333] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.486881  1934 raft_consensus.cc:2243] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.487347  1934 raft_consensus.cc:2272] T 43a598cfbb3c457eb5a8c9801d421a01 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.490126  1934 tablet_replica.cc:333] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.491012  1934 raft_consensus.cc:2243] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:10.491868  1934 raft_consensus.cc:2272] T 1b38c8234f5f433bb73bb44a0950731d P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.493916  1934 tablet_replica.cc:333] T 5595bb972e3e4574a1df19295132c9ae P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.494414  1934 raft_consensus.cc:2243] T 5595bb972e3e4574a1df19295132c9ae P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.494861  1934 raft_consensus.cc:2272] T 5595bb972e3e4574a1df19295132c9ae P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.497076  1934 tablet_replica.cc:333] T d53b944cce3847bb8f603d0c64c6ae28 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.497623  1934 raft_consensus.cc:2243] T d53b944cce3847bb8f603d0c64c6ae28 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.498133  1934 raft_consensus.cc:2272] T d53b944cce3847bb8f603d0c64c6ae28 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.500231  1934 tablet_replica.cc:333] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.500789  1934 raft_consensus.cc:2243] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.501268  1934 raft_consensus.cc:2272] T d55c8d664ee74f0fbb31693f1b398fba P 7283c2ba87e94087b9ac5dcb372c4e1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.503437  1934 tablet_replica.cc:333] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.503966  1934 raft_consensus.cc:2243] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.504390  1934 raft_consensus.cc:2272] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.506433  1934 tablet_replica.cc:333] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.506966  1934 raft_consensus.cc:2243] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.507416  1934 raft_consensus.cc:2272] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.509320  1934 tablet_replica.cc:333] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.509909  1934 raft_consensus.cc:2243] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:10.510805  1934 raft_consensus.cc:2272] T b8f1d538ab1446f182128209d64b34be P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.512775  1934 tablet_replica.cc:333] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.513343  1934 raft_consensus.cc:2243] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:10.514201  1934 raft_consensus.cc:2272] T e6bd1a63e0aa46edbdec80ed32e8b876 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.516402  1934 tablet_replica.cc:333] T 8d4646ce4a654acda4a5971dbefc623f P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.516954  1934 raft_consensus.cc:2243] T 8d4646ce4a654acda4a5971dbefc623f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.517405  1934 raft_consensus.cc:2272] T 8d4646ce4a654acda4a5971dbefc623f P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.519837  1934 tablet_replica.cc:333] T 678fcf88b458421b960351bc865762c6 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.520543  1934 raft_consensus.cc:2243] T 678fcf88b458421b960351bc865762c6 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.521253  1934 raft_consensus.cc:2272] T 678fcf88b458421b960351bc865762c6 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.524189  1934 tablet_replica.cc:333] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.524889  1934 raft_consensus.cc:2243] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.525417  1934 raft_consensus.cc:2272] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.535168  1934 tablet_replica.cc:333] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.537009  1934 raft_consensus.cc:2243] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:10.538087 11989 consensus_peers.cc:597] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 -> Peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Couldn't send request to peer 7283c2ba87e94087b9ac5dcb372c4e1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:10.538677  1934 raft_consensus.cc:2272] T 9cc9444f841f4d768a714f7462f1cf6e P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.542928  1934 tablet_replica.cc:333] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.543720  1934 raft_consensus.cc:2243] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:10.544760  1934 raft_consensus.cc:2272] T f59c45da3f3f43a5b793c3305865da17 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.565703  1934 tablet_replica.cc:333] T 86477bbe25284503970ce70bb1e26190 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.566689  1934 raft_consensus.cc:2243] T 86477bbe25284503970ce70bb1e26190 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.567251  1934 raft_consensus.cc:2272] T 86477bbe25284503970ce70bb1e26190 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.570266  1934 tablet_replica.cc:333] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d: stopping tablet replica
I20260709 13:19:10.570958  1934 raft_consensus.cc:2243] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:10.571981  1934 raft_consensus.cc:2272] T be30dd74fd8242ba879069e4eec26f16 P 7283c2ba87e94087b9ac5dcb372c4e1d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:10.583500 11989 consensus_peers.cc:597] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 -> Peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Couldn't send request to peer 7283c2ba87e94087b9ac5dcb372c4e1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:10.652985 11989 consensus_peers.cc:597] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 -> Peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Couldn't send request to peer 7283c2ba87e94087b9ac5dcb372c4e1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:10.669436 11915 consensus_peers.cc:597] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 -> Peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Couldn't send request to peer 7283c2ba87e94087b9ac5dcb372c4e1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:10.682451 11989 connection.cc:769] client connection to 127.1.227.130:43333 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:19:10.684362 11989 consensus_peers.cc:597] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 -> Peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Couldn't send request to peer 7283c2ba87e94087b9ac5dcb372c4e1d. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:10.683655 11915 consensus_peers.cc:597] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 -> Peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Couldn't send request to peer 7283c2ba87e94087b9ac5dcb372c4e1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:10.714982 12997 raft_consensus.cc:493] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:19:10.715683 12997 raft_consensus.cc:515] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:19:10.718454 12997 leader_election.cc:290] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
W20260709 13:19:10.723367 11989 leader_election.cc:336] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:19:10.724063 11989 leader_election.cc:336] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Network error: Client connection negotiation failed: client connection to 127.1.227.130:43333: connect: Connection refused (error 111)
I20260709 13:19:10.724400 11989 leader_election.cc:304] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:10.724977 12997 raft_consensus.cc:2749] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:10.727646 12884 raft_consensus.cc:493] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:19:10.728127 12884 raft_consensus.cc:515] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:10.728890 12971 raft_consensus.cc:493] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:19:10.729465 12971 raft_consensus.cc:515] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:10.730160 12884 leader_election.cc:290] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:19:10.731674 12971 leader_election.cc:290] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
W20260709 13:19:10.741864 11989 consensus_peers.cc:597] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 -> Peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Couldn't send request to peer 7283c2ba87e94087b9ac5dcb372c4e1d. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:43333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:10.743520 11915 leader_election.cc:336] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:19:10.744160 11915 leader_election.cc:336] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:19:10.745536 11915 leader_election.cc:336] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Network error: Client connection negotiation failed: client connection to 127.1.227.130:43333: connect: Connection refused (error 111)
I20260709 13:19:10.746023 11915 leader_election.cc:304] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:10.746840 12971 raft_consensus.cc:2749] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:10.747766 11915 consensus_peers.cc:597] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 -> Peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Couldn't send request to peer 7283c2ba87e94087b9ac5dcb372c4e1d. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:43333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:10.748203 11915 leader_election.cc:336] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Network error: Client connection negotiation failed: client connection to 127.1.227.130:43333: connect: Connection refused (error 111)
I20260709 13:19:10.748638 11915 leader_election.cc:304] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:10.749403 12971 raft_consensus.cc:2749] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:10.866292 12971 raft_consensus.cc:493] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:19:10.866982 12971 raft_consensus.cc:515] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:10.870021 12971 leader_election.cc:290] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:19:10.875177  1934 tablet_server.cc:196] TabletServer@127.1.227.130:0 shutdown complete.
W20260709 13:19:10.876052 11915 leader_election.cc:336] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:19:10.877048 11915 leader_election.cc:336] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Network error: Client connection negotiation failed: client connection to 127.1.227.130:43333: connect: Connection refused (error 111)
I20260709 13:19:10.877440 11915 leader_election.cc:304] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:10.878127 12971 raft_consensus.cc:2749] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:10.908860 12971 raft_consensus.cc:493] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:19:10.909652 12971 raft_consensus.cc:515] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:10.910261 12970 raft_consensus.cc:493] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:19:10.910938 12970 raft_consensus.cc:515] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:10.912756 12971 leader_election.cc:290] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:19:10.913448 12970 leader_election.cc:290] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:19:10.915331 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4758afc104744a481a25b59661b80fe" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
W20260709 13:19:10.918740 11915 leader_election.cc:336] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:19:10.919370 11915 leader_election.cc:336] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:19:10.919699 11915 leader_election.cc:304] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:10.920310 12970 raft_consensus.cc:2749] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:10.920567 11915 leader_election.cc:336] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Network error: Client connection negotiation failed: client connection to 127.1.227.130:43333: connect: Connection refused (error 111)
I20260709 13:19:10.921099 11915 leader_election.cc:304] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:10.921773 12970 raft_consensus.cc:2749] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:10.974758 12931 raft_consensus.cc:493] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:19:10.975461 12931 raft_consensus.cc:515] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:10.978471 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4758afc104744a481a25b59661b80fe" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:19:10.979147 12993 raft_consensus.cc:493] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:19:10.979300 11950 raft_consensus.cc:2468] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f7178f720eb4090a3593087331b82e9 in term 3.
I20260709 13:19:10.979773 12993 raft_consensus.cc:515] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:10.977771 12931 leader_election.cc:290] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:19:10.982158 12993 leader_election.cc:290] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:19:10.983820 11950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52730cf917140dfaced7ad6cf28f5f7" candidate_uuid: "1f7178f720eb4090a3593087331b82e9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04f862d1b8824d7a81daa0cad52c5843" is_pre_election: true
I20260709 13:19:10.985562 11989 leader_election.cc:304] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: 
I20260709 13:19:10.986377 12993 raft_consensus.cc:2804] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:10.986729 12993 raft_consensus.cc:493] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:19:10.987043 12993 raft_consensus.cc:3060] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:10.987110  1934 tablet_server.cc:179] TabletServer@127.1.227.131:0 shutting down...
W20260709 13:19:10.990732 11989 leader_election.cc:336] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:19:10.991518 11989 leader_election.cc:336] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:19:10.991881 11989 leader_election.cc:304] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:10.992547 12931 raft_consensus.cc:2749] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:10.997512 12993 raft_consensus.cc:515] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:10.999775 12993 leader_election.cc:290] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 4 election: Requested vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:19:11.003652 12884 raft_consensus.cc:493] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:19:11.004261 12884 raft_consensus.cc:515] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:11.006608 12884 leader_election.cc:290] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:19:11.010571 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e862ca999046aca1a257edebcdfea3" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
I20260709 13:19:11.011356 12884 raft_consensus.cc:493] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
W20260709 13:19:11.011647 11989 leader_election.cc:336] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:19:11.012275 11915 leader_election.cc:336] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:19:11.012003 12884 raft_consensus.cc:515] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:11.013005 11916 leader_election.cc:304] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 1f7178f720eb4090a3593087331b82e9, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:11.014048 13000 raft_consensus.cc:2749] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:11.014345 11989 leader_election.cc:336] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:11.014809 11989 leader_election.cc:304] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:11.015329 12884 leader_election.cc:290] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:19:11.016382 12993 raft_consensus.cc:2749] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:11.020251 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52730cf917140dfaced7ad6cf28f5f7" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9" is_pre_election: true
W20260709 13:19:11.019465 11989 consensus_peers.cc:597] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 -> Peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Couldn't send request to peer 04f862d1b8824d7a81daa0cad52c5843. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:11.021044 12017 raft_consensus.cc:2468] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 3.
W20260709 13:19:11.029721 11915 leader_election.cc:336] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:19:11.032954 11916 leader_election.cc:304] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:11.034332 13000 raft_consensus.cc:2804] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:11.034868 13000 raft_consensus.cc:493] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:19:11.035374 13000 raft_consensus.cc:3060] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:11.045670 12884 raft_consensus.cc:493] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:19:11.046329 12884 raft_consensus.cc:515] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:11.048224 12884 leader_election.cc:290] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
W20260709 13:19:11.053438 11989 consensus_peers.cc:597] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 -> Peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Couldn't send request to peer 04f862d1b8824d7a81daa0cad52c5843. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:11.055970 11915 leader_election.cc:336] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Network error: Client connection negotiation failed: client connection to 127.1.227.130:43333: connect: Connection refused (error 111)
I20260709 13:19:11.056300 12971 raft_consensus.cc:493] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
W20260709 13:19:11.056804 11915 leader_election.cc:336] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:19:11.056907 12971 raft_consensus.cc:515] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:11.057281 11915 leader_election.cc:304] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:11.059104 12970 raft_consensus.cc:2749] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:11.059211 12971 leader_election.cc:290] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:19:11.063586  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:11.063261 13000 raft_consensus.cc:515] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:11.064731  1934 tablet_replica.cc:333] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.065858  1934 raft_consensus.cc:2243] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.066457 13000 leader_election.cc:290] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 4 election: Requested vote from peers 1f7178f720eb4090a3593087331b82e9 (127.1.227.132:38909), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:19:11.066496  1934 raft_consensus.cc:2272] T 83da445e9a4d483e8d2504e806a4461b P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.067497 12017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52730cf917140dfaced7ad6cf28f5f7" candidate_uuid: "04f862d1b8824d7a81daa0cad52c5843" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1f7178f720eb4090a3593087331b82e9"
I20260709 13:19:11.068199 12017 raft_consensus.cc:3060] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:11.071058  1934 tablet_replica.cc:333] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.072098  1934 raft_consensus.cc:2243] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.072752  1934 raft_consensus.cc:2272] T eece1e771a0341b1bebc6fde110e6f8a P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:11.073822 11915 leader_election.cc:336] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:19:11.074543 11915 leader_election.cc:336] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Network error: Client connection negotiation failed: client connection to 127.1.227.130:43333: connect: Connection refused (error 111)
I20260709 13:19:11.074882 11915 leader_election.cc:304] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:11.075543 12970 raft_consensus.cc:2749] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:11.076174  1934 tablet_replica.cc:333] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.076305 12017 raft_consensus.cc:2468] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f862d1b8824d7a81daa0cad52c5843 in term 4.
I20260709 13:19:11.077096  1934 raft_consensus.cc:2243] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:19:11.077754 11915 leader_election.cc:336] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:19:11.078127  1934 raft_consensus.cc:2272] T 1ad333631d4d40a38cada3a3b76f5e52 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.078693 11916 leader_election.cc:304] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843, 1f7178f720eb4090a3593087331b82e9; no voters: bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:11.079762 12970 raft_consensus.cc:2804] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:11.080300 12970 raft_consensus.cc:697] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 4 LEADER]: Becoming Leader. State: Replica: 04f862d1b8824d7a81daa0cad52c5843, State: Running, Role: LEADER
I20260709 13:19:11.081085  1934 tablet_replica.cc:333] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.081300 12970 consensus_queue.cc:237] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:11.082000  1934 raft_consensus.cc:2243] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.083143  1934 raft_consensus.cc:2272] T 4b8ca7758d7240519907444b2ba2c15f P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.086167  1934 tablet_replica.cc:333] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.087255  1934 raft_consensus.cc:2243] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.087786  1934 raft_consensus.cc:2272] T 9c44d39672a741709a46194020f68692 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.090139  1934 tablet_replica.cc:333] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.090741  1934 raft_consensus.cc:2243] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.091189  1934 raft_consensus.cc:2272] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.093294  1934 tablet_replica.cc:333] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.094144  1934 raft_consensus.cc:2243] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.095247  1934 raft_consensus.cc:2272] T 56ac6eddb0d84b0f921015c7d71e77a2 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.097713  1934 tablet_replica.cc:333] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.098551  1934 raft_consensus.cc:2243] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.099112  1934 raft_consensus.cc:2272] T bb8e389bf22e48259f4d63c2c12f4713 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.101112  1934 tablet_replica.cc:333] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.101783  1934 raft_consensus.cc:2243] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.102584  1934 raft_consensus.cc:2272] T 276261d09b63498f8b2902647b4e2b4a P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.104727 12931 raft_consensus.cc:493] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:19:11.104790  1934 tablet_replica.cc:333] T ab5a46f525fd42468f042b3d38985f42 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.105400 12931 raft_consensus.cc:515] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:11.105902  1934 raft_consensus.cc:2243] T ab5a46f525fd42468f042b3d38985f42 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.106603  1934 raft_consensus.cc:2272] T ab5a46f525fd42468f042b3d38985f42 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.107833 12931 leader_election.cc:290] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
I20260709 13:19:11.109712  1934 tablet_replica.cc:333] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.110728  1934 raft_consensus.cc:2243] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.111577  1934 pending_rounds.cc:70] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843: Trying to abort 1 pending ops.
I20260709 13:19:11.111860  1934 pending_rounds.cc:77] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305638506840002560 op_type: NO_OP noop_request { }
I20260709 13:19:11.112351  1934 raft_consensus.cc:2889] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:11.112712  1934 raft_consensus.cc:2272] T d52730cf917140dfaced7ad6cf28f5f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:11.112823 11989 leader_election.cc:336] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:19:11.113857 11989 leader_election.cc:336] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:11.114290 11989 leader_election.cc:304] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:11.115064 12931 raft_consensus.cc:2749] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:11.116305  1934 tablet_replica.cc:333] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.117105  1934 raft_consensus.cc:2243] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.117620  1934 raft_consensus.cc:2272] T 52b7a6ebef9c43598294f430c70b2fb5 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.120236  1934 tablet_replica.cc:333] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.120914  1934 raft_consensus.cc:2243] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.121613  1934 raft_consensus.cc:2272] T ea431ab44bd54c398da2f3469ac6685a P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.123593  1934 tablet_replica.cc:333] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.124145  1934 raft_consensus.cc:2243] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.124571  1934 raft_consensus.cc:2272] T f4758afc104744a481a25b59661b80fe P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.126528  1934 tablet_replica.cc:333] T bce4185998b54aa3900c8c3e9a09d72c P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.127115  1934 raft_consensus.cc:2243] T bce4185998b54aa3900c8c3e9a09d72c P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.127612  1934 raft_consensus.cc:2272] T bce4185998b54aa3900c8c3e9a09d72c P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.130123  1934 tablet_replica.cc:333] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.130965  1934 raft_consensus.cc:2243] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.131930  1934 raft_consensus.cc:2272] T 78f88cc1e70b4b88986a3ff6b79770f7 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.134718  1934 tablet_replica.cc:333] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.135355  1934 raft_consensus.cc:2243] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.136270  1934 raft_consensus.cc:2272] T df332d97fcd742e3b0f2024da1850b81 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.136978 12970 raft_consensus.cc:493] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:19:11.137526 12970 raft_consensus.cc:515] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } } peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } }
I20260709 13:19:11.139195  1934 tablet_replica.cc:333] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.139798 12970 leader_election.cc:290] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:19:11.140115  1934 raft_consensus.cc:2243] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.140688  1934 raft_consensus.cc:2272] T 8d51c27f1d494f64980afcf1b0f89fff P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.143651  1934 tablet_replica.cc:333] T 653023e6fbaf4ab0869ab68cd9436f6d P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
W20260709 13:19:11.144387 11915 leader_election.cc:336] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:19:11.144487  1934 raft_consensus.cc:2243] T 653023e6fbaf4ab0869ab68cd9436f6d P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:11.145407 11915 leader_election.cc:336] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Network error: Client connection negotiation failed: client connection to 127.1.227.130:43333: connect: Connection refused (error 111)
I20260709 13:19:11.145438  1934 raft_consensus.cc:2272] T 653023e6fbaf4ab0869ab68cd9436f6d P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.146104 11915 leader_election.cc:304] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f862d1b8824d7a81daa0cad52c5843; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:11.146907 12970 raft_consensus.cc:2749] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:11.147504 12931 raft_consensus.cc:493] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:19:11.148073 12931 raft_consensus.cc:515] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:19:11.148870  1934 tablet_replica.cc:333] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.149822  1934 raft_consensus.cc:2243] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.150328 12931 leader_election.cc:290] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:19:11.150926  1934 raft_consensus.cc:2272] T 72e185eb05f14f19978919c9f8e5906e P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:11.152570 11989 consensus_peers.cc:597] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 -> Peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Couldn't send request to peer 04f862d1b8824d7a81daa0cad52c5843. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:11.153792  1934 tablet_replica.cc:333] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.154670  1934 raft_consensus.cc:2243] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.155279  1934 raft_consensus.cc:2272] T 55421cf4fed64db6bb366de566968fd9 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:11.155987 11989 leader_election.cc:336] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:19:11.157903  1934 tablet_replica.cc:333] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
W20260709 13:19:11.158294 11989 leader_election.cc:336] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Network error: Client connection negotiation failed: client connection to 127.1.227.130:43333: connect: Connection refused (error 111)
I20260709 13:19:11.158726  1934 raft_consensus.cc:2243] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.158751 11989 leader_election.cc:304] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:11.159629 12931 raft_consensus.cc:2749] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:11.159729  1934 raft_consensus.cc:2272] T fa6ff283134a4463af9ad09ed3ac81ce P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.162209  1934 tablet_replica.cc:333] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.162895  1934 raft_consensus.cc:2243] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.163422  1934 raft_consensus.cc:2272] T 5dd6d52d3b2649de89e331bbb75335a0 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.166363  1934 tablet_replica.cc:333] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.167308  1934 raft_consensus.cc:2243] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:19:11.167985 11989 consensus_peers.cc:597] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 -> Peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Couldn't send request to peer 04f862d1b8824d7a81daa0cad52c5843. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:11.168370  1934 raft_consensus.cc:2272] T 2d9288763b344f2fb95940d6a0ce7bcd P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.170786  1934 tablet_replica.cc:333] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.171437  1934 raft_consensus.cc:2243] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.171872  1934 raft_consensus.cc:2272] T 5d66e54a11a44e09b15744ecdc4ae226 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.174038  1934 tablet_replica.cc:333] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.174541  1934 raft_consensus.cc:2243] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.175241  1934 raft_consensus.cc:2272] T 30bf1f22d4f144109fe8d089d54dd5e6 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.177338  1934 tablet_replica.cc:333] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.177994  1934 raft_consensus.cc:2243] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.178395  1934 raft_consensus.cc:2272] T 5f3910c15d144fd09ea36bd9f5344eef P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.180225  1934 tablet_replica.cc:333] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.180732  1934 raft_consensus.cc:2243] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.181111  1934 raft_consensus.cc:2272] T 2ab10d5ae5884d03b62499dd736e479e P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.183085  1934 tablet_replica.cc:333] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.183552  1934 raft_consensus.cc:2243] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.183925  1934 raft_consensus.cc:2272] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.185715  1934 tablet_replica.cc:333] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.186261  1934 raft_consensus.cc:2243] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.186638  1934 raft_consensus.cc:2272] T f59c45da3f3f43a5b793c3305865da17 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.188508  1934 tablet_replica.cc:333] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.189042  1934 raft_consensus.cc:2243] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.189955  1934 raft_consensus.cc:2272] T 5595bb972e3e4574a1df19295132c9ae P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.191789  1934 tablet_replica.cc:333] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.192354  1934 raft_consensus.cc:2243] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.192808  1934 raft_consensus.cc:2272] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.195315  1934 tablet_replica.cc:333] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.195990  1934 raft_consensus.cc:2243] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.196878  1934 raft_consensus.cc:2272] T d53b944cce3847bb8f603d0c64c6ae28 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.199656  1934 tablet_replica.cc:333] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.200387  1934 raft_consensus.cc:2243] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.200963  1934 raft_consensus.cc:2272] T d55c8d664ee74f0fbb31693f1b398fba P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.203748  1934 tablet_replica.cc:333] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.204521  1934 raft_consensus.cc:2243] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.205482  1934 raft_consensus.cc:2272] T 47f5c73ecd474b45ae6c27ca1f1046a1 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.207445  1934 tablet_replica.cc:333] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.207933  1934 raft_consensus.cc:2243] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.208727  1934 raft_consensus.cc:2272] T 095174060bff4a6b8f891f171bb9cd10 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.210996  1934 tablet_replica.cc:333] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.211505  1934 raft_consensus.cc:2243] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.211891  1934 raft_consensus.cc:2272] T be30dd74fd8242ba879069e4eec26f16 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.214351  1934 tablet_replica.cc:333] T e6bd1a63e0aa46edbdec80ed32e8b876 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.215072  1934 raft_consensus.cc:2243] T e6bd1a63e0aa46edbdec80ed32e8b876 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.215600  1934 raft_consensus.cc:2272] T e6bd1a63e0aa46edbdec80ed32e8b876 P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.218658  1934 tablet_replica.cc:333] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.219364  1934 raft_consensus.cc:2243] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.219923  1934 raft_consensus.cc:2272] T 9cd960dbe5b2404bbec84f15a3cc69f1 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:11.220821 11989 consensus_peers.cc:597] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 -> Peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Couldn't send request to peer 04f862d1b8824d7a81daa0cad52c5843. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:11.222394  1934 tablet_replica.cc:333] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.222997  1934 raft_consensus.cc:2243] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.223450  1934 raft_consensus.cc:2272] T 34e862ca999046aca1a257edebcdfea3 P 04f862d1b8824d7a81daa0cad52c5843 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.225340  1934 tablet_replica.cc:333] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.225987  1934 raft_consensus.cc:2243] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.226583  1934 raft_consensus.cc:2272] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.229242  1934 tablet_replica.cc:333] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.230002  1934 raft_consensus.cc:2243] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.230516  1934 raft_consensus.cc:2272] T 1b38c8234f5f433bb73bb44a0950731d P 04f862d1b8824d7a81daa0cad52c5843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.232792  1934 tablet_replica.cc:333] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.233294  1934 raft_consensus.cc:2243] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.233850  1934 raft_consensus.cc:2272] T 43a598cfbb3c457eb5a8c9801d421a01 P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.236428  1934 tablet_replica.cc:333] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843: stopping tablet replica
I20260709 13:19:11.236950  1934 raft_consensus.cc:2243] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.237494  1934 raft_consensus.cc:2272] T e4fab9357d5e4c8093e8d5482cb5ed2b P 04f862d1b8824d7a81daa0cad52c5843 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:11.266839 11989 consensus_peers.cc:597] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 -> Peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Couldn't send request to peer 04f862d1b8824d7a81daa0cad52c5843. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:11.314303 12993 raft_consensus.cc:493] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdbe2261c337471ea4d0c980ebb80c72)
I20260709 13:19:11.314941 12993 raft_consensus.cc:515] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f862d1b8824d7a81daa0cad52c5843" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 35995 } } peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } }
I20260709 13:19:11.316601 12993 leader_election.cc:290] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995), bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961)
W20260709 13:19:11.321209 11989 leader_election.cc:336] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Network error: Client connection negotiation failed: client connection to 127.1.227.131:35995: connect: Connection refused (error 111)
I20260709 13:19:11.322278  1934 tablet_server.cc:196] TabletServer@127.1.227.131:0 shutdown complete.
W20260709 13:19:11.322537 11989 leader_election.cc:336] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
I20260709 13:19:11.322986 11989 leader_election.cc:304] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 04f862d1b8824d7a81daa0cad52c5843, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:11.323742 12993 raft_consensus.cc:2749] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:11.390403  1934 tablet_server.cc:179] TabletServer@127.1.227.132:0 shutting down...
W20260709 13:19:11.398479 11989 consensus_peers.cc:597] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 -> Peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Couldn't send request to peer 04f862d1b8824d7a81daa0cad52c5843. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.131:35995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:11.447093  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:11.448312  1934 tablet_replica.cc:333] T 1ad333631d4d40a38cada3a3b76f5e52 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.449566  1934 raft_consensus.cc:2243] T 1ad333631d4d40a38cada3a3b76f5e52 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.450351  1934 raft_consensus.cc:2272] T 1ad333631d4d40a38cada3a3b76f5e52 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.453199  1934 tablet_replica.cc:333] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.454015  1934 raft_consensus.cc:2243] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.454591  1934 raft_consensus.cc:2272] T 30bf1f22d4f144109fe8d089d54dd5e6 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.456885  1934 tablet_replica.cc:333] T 9c44d39672a741709a46194020f68692 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.457528  1934 raft_consensus.cc:2243] T 9c44d39672a741709a46194020f68692 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.458027  1934 raft_consensus.cc:2272] T 9c44d39672a741709a46194020f68692 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.460711  1934 tablet_replica.cc:333] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.461436  1934 raft_consensus.cc:2243] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.462494  1934 raft_consensus.cc:2272] T bc8dab527d374a47b91239feea9d8b3a P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.465093  1934 tablet_replica.cc:333] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.466007  1934 raft_consensus.cc:2243] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.467021  1934 raft_consensus.cc:2272] T eeda29dd1f464af4b5c86ee8ec5bffc4 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.469790  1934 tablet_replica.cc:333] T 56ac6eddb0d84b0f921015c7d71e77a2 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
W20260709 13:19:11.469610 11989 consensus_peers.cc:597] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 -> Peer 04f862d1b8824d7a81daa0cad52c5843 (127.1.227.131:35995): Couldn't send request to peer 04f862d1b8824d7a81daa0cad52c5843. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.131:35995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:11.470681  1934 raft_consensus.cc:2243] T 56ac6eddb0d84b0f921015c7d71e77a2 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.471204  1934 raft_consensus.cc:2272] T 56ac6eddb0d84b0f921015c7d71e77a2 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.473320  1934 tablet_replica.cc:333] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.473841 12997 raft_consensus.cc:493] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7283c2ba87e94087b9ac5dcb372c4e1d)
I20260709 13:19:11.474118  1934 raft_consensus.cc:2243] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.474812  1934 raft_consensus.cc:2272] T dac39fc7f83141e0887192bc70b641b6 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.474552 12997 raft_consensus.cc:515] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:19:11.476682 12997 leader_election.cc:290] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:19:11.477953  1934 tablet_replica.cc:333] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.478883  1934 raft_consensus.cc:2243] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.479491  1934 raft_consensus.cc:2272] T d52730cf917140dfaced7ad6cf28f5f7 P 1f7178f720eb4090a3593087331b82e9 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:11.481156 11989 leader_election.cc:336] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:19:11.481984 11989 leader_election.cc:336] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Network error: Client connection negotiation failed: client connection to 127.1.227.130:43333: connect: Connection refused (error 111)
I20260709 13:19:11.482386 11989 leader_election.cc:304] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:11.482589  1934 tablet_replica.cc:333] T 59a9704b659947e6988fc29f5296ec73 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.483208 12997 raft_consensus.cc:2749] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:11.483516  1934 raft_consensus.cc:2243] T 59a9704b659947e6988fc29f5296ec73 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.484345  1934 raft_consensus.cc:2272] T 59a9704b659947e6988fc29f5296ec73 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.486855  1934 tablet_replica.cc:333] T 276261d09b63498f8b2902647b4e2b4a P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.487488  1934 raft_consensus.cc:2243] T 276261d09b63498f8b2902647b4e2b4a P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.487952  1934 raft_consensus.cc:2272] T 276261d09b63498f8b2902647b4e2b4a P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.490200  1934 tablet_replica.cc:333] T ab5a46f525fd42468f042b3d38985f42 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.490913  1934 raft_consensus.cc:2243] T ab5a46f525fd42468f042b3d38985f42 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.491391  1934 raft_consensus.cc:2272] T ab5a46f525fd42468f042b3d38985f42 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.493500  1934 tablet_replica.cc:333] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.494176  1934 raft_consensus.cc:2243] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.495011  1934 raft_consensus.cc:2272] T 9780438f22284df785414db0646df50e P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.497149  1934 tablet_replica.cc:333] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.497814  1934 raft_consensus.cc:2243] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.498313  1934 raft_consensus.cc:2272] T f4758afc104744a481a25b59661b80fe P 1f7178f720eb4090a3593087331b82e9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.500365  1934 tablet_replica.cc:333] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.500988  1934 raft_consensus.cc:2243] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.501928  1934 raft_consensus.cc:2272] T 765b55f8e8d24e2a9fa6860917b6c5d5 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.504022  1934 tablet_replica.cc:333] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.504638  1934 raft_consensus.cc:2243] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.505585  1934 raft_consensus.cc:2272] T 678fcf88b458421b960351bc865762c6 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.507714  1934 tablet_replica.cc:333] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.508332  1934 raft_consensus.cc:2243] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.509162  1934 raft_consensus.cc:2272] T 9cc9444f841f4d768a714f7462f1cf6e P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.511309  1934 tablet_replica.cc:333] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.511884  1934 raft_consensus.cc:2243] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.512339  1934 raft_consensus.cc:2272] T df332d97fcd742e3b0f2024da1850b81 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.514708  1934 tablet_replica.cc:333] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.515305  1934 raft_consensus.cc:2243] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.516126  1934 raft_consensus.cc:2272] T e3fc72a3f0044004b68c29cd9bdbf7d2 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.518213  1934 tablet_replica.cc:333] T d53b944cce3847bb8f603d0c64c6ae28 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.518798  1934 raft_consensus.cc:2243] T d53b944cce3847bb8f603d0c64c6ae28 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.519264  1934 raft_consensus.cc:2272] T d53b944cce3847bb8f603d0c64c6ae28 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.521410  1934 tablet_replica.cc:333] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.522014  1934 raft_consensus.cc:2243] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.522480  1934 raft_consensus.cc:2272] T 25353af0207b4ec1959e0795ded4946c P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.524461  1934 tablet_replica.cc:333] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.525023  1934 raft_consensus.cc:2243] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.525478  1934 raft_consensus.cc:2272] T 2d9288763b344f2fb95940d6a0ce7bcd P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.527456  1934 tablet_replica.cc:333] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.528050  1934 raft_consensus.cc:2243] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.528510  1934 raft_consensus.cc:2272] T 7991b50605d0412aa1b3b5e79de17e01 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.530633  1934 tablet_replica.cc:333] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.531229  1934 raft_consensus.cc:2243] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.532083  1934 raft_consensus.cc:2272] T 8d51c27f1d494f64980afcf1b0f89fff P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.534237  1934 tablet_replica.cc:333] T 653023e6fbaf4ab0869ab68cd9436f6d P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.534834  1934 raft_consensus.cc:2243] T 653023e6fbaf4ab0869ab68cd9436f6d P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.535279  1934 raft_consensus.cc:2272] T 653023e6fbaf4ab0869ab68cd9436f6d P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.537312  1934 tablet_replica.cc:333] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.538094  1934 raft_consensus.cc:2243] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.538635  1934 raft_consensus.cc:2272] T 58f5eb834fe84f7cadb173cc0fc58b2f P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.540699  1934 tablet_replica.cc:333] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.541311  1934 raft_consensus.cc:2243] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.542228  1934 raft_consensus.cc:2272] T 5dd6d52d3b2649de89e331bbb75335a0 P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.544480  1934 tablet_replica.cc:333] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.545233  1934 raft_consensus.cc:2243] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.546082  1934 raft_consensus.cc:2272] T 86477bbe25284503970ce70bb1e26190 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.548285  1934 tablet_replica.cc:333] T be30dd74fd8242ba879069e4eec26f16 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.548871  1934 raft_consensus.cc:2243] T be30dd74fd8242ba879069e4eec26f16 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.549345  1934 raft_consensus.cc:2272] T be30dd74fd8242ba879069e4eec26f16 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.551470  1934 tablet_replica.cc:333] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.552064  1934 raft_consensus.cc:2243] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.552958  1934 raft_consensus.cc:2272] T 8d4646ce4a654acda4a5971dbefc623f P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.555127  1934 tablet_replica.cc:333] T e6bd1a63e0aa46edbdec80ed32e8b876 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.555712  1934 raft_consensus.cc:2243] T e6bd1a63e0aa46edbdec80ed32e8b876 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.556155  1934 raft_consensus.cc:2272] T e6bd1a63e0aa46edbdec80ed32e8b876 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.558207  1934 tablet_replica.cc:333] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.558790  1934 raft_consensus.cc:2243] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.559250  1934 raft_consensus.cc:2272] T 095174060bff4a6b8f891f171bb9cd10 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.561282  1934 tablet_replica.cc:333] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.562059  1934 raft_consensus.cc:2243] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.562546  1934 raft_consensus.cc:2272] T bce4185998b54aa3900c8c3e9a09d72c P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.564756  1934 tablet_replica.cc:333] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.565358  1934 raft_consensus.cc:2243] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.566243  1934 raft_consensus.cc:2272] T 55421cf4fed64db6bb366de566968fd9 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.568392  1934 tablet_replica.cc:333] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.568832 12997 raft_consensus.cc:493] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7283c2ba87e94087b9ac5dcb372c4e1d)
I20260709 13:19:11.569083  1934 raft_consensus.cc:2243] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.569720  1934 raft_consensus.cc:2272] T 72e185eb05f14f19978919c9f8e5906e P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.569458 12997 raft_consensus.cc:515] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f7178f720eb4090a3593087331b82e9" member_type: VOTER last_known_addr { host: "127.1.227.132" port: 38909 } } peers { permanent_uuid: "bdbe2261c337471ea4d0c980ebb80c72" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 37961 } } peers { permanent_uuid: "7283c2ba87e94087b9ac5dcb372c4e1d" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 43333 } }
I20260709 13:19:11.571375 12997 leader_election.cc:290] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961), 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333)
I20260709 13:19:11.572518  1934 tablet_replica.cc:333] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.573449  1934 raft_consensus.cc:2243] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.574677  1934 raft_consensus.cc:2272] T 83da445e9a4d483e8d2504e806a4461b P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:11.576915 11989 leader_election.cc:336] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdbe2261c337471ea4d0c980ebb80c72 (127.1.227.129:37961): Network error: Client connection negotiation failed: client connection to 127.1.227.129:37961: connect: Connection refused (error 111)
W20260709 13:19:11.577572 11989 leader_election.cc:336] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7283c2ba87e94087b9ac5dcb372c4e1d (127.1.227.130:43333): Network error: Client connection negotiation failed: client connection to 127.1.227.130:43333: connect: Connection refused (error 111)
I20260709 13:19:11.577950  1934 tablet_replica.cc:333] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.577951 11989 leader_election.cc:304] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f7178f720eb4090a3593087331b82e9; no voters: 7283c2ba87e94087b9ac5dcb372c4e1d, bdbe2261c337471ea4d0c980ebb80c72
I20260709 13:19:11.578785  1934 raft_consensus.cc:2243] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.578855 12997 raft_consensus.cc:2749] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:11.579949  1934 raft_consensus.cc:2272] T ecf7f7f507dd4bd797a1b9a3a85b82fe P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.582176  1934 tablet_replica.cc:333] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.582674  1934 raft_consensus.cc:2243] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.583071  1934 raft_consensus.cc:2272] T edba2429705947968300245b7a6049e1 P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.584954  1934 tablet_replica.cc:333] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.585427  1934 raft_consensus.cc:2243] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.585855  1934 raft_consensus.cc:2272] T b8f1d538ab1446f182128209d64b34be P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.587726  1934 tablet_replica.cc:333] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.588202  1934 raft_consensus.cc:2243] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.588626  1934 raft_consensus.cc:2272] T 34e862ca999046aca1a257edebcdfea3 P 1f7178f720eb4090a3593087331b82e9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.590976  1934 tablet_replica.cc:333] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.591715  1934 raft_consensus.cc:2243] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.592921  1934 raft_consensus.cc:2272] T e38fc17625bd4a30b79f4a0bc2f8bf39 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.595585  1934 tablet_replica.cc:333] T 1b38c8234f5f433bb73bb44a0950731d P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.596136  1934 raft_consensus.cc:2243] T 1b38c8234f5f433bb73bb44a0950731d P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.596596  1934 raft_consensus.cc:2272] T 1b38c8234f5f433bb73bb44a0950731d P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.598577  1934 tablet_replica.cc:333] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.599099  1934 raft_consensus.cc:2243] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.599538  1934 raft_consensus.cc:2272] T e4fab9357d5e4c8093e8d5482cb5ed2b P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.601442  1934 tablet_replica.cc:333] T ea431ab44bd54c398da2f3469ac6685a P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.602035  1934 raft_consensus.cc:2243] T ea431ab44bd54c398da2f3469ac6685a P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.602476  1934 raft_consensus.cc:2272] T ea431ab44bd54c398da2f3469ac6685a P 1f7178f720eb4090a3593087331b82e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.604480  1934 tablet_replica.cc:333] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9: stopping tablet replica
I20260709 13:19:11.604977  1934 raft_consensus.cc:2243] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:11.605419  1934 raft_consensus.cc:2272] T cdcb9800b8894d978568cd9ad81bdd31 P 1f7178f720eb4090a3593087331b82e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.667145  1934 tablet_server.cc:196] TabletServer@127.1.227.132:0 shutdown complete.
I20260709 13:19:11.741485  1934 master.cc:562] Master@127.1.227.190:43207 shutting down...
I20260709 13:19:11.769982  1934 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:11.770581  1934 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:11.770889  1934 tablet_replica.cc:333] T 00000000000000000000000000000000 P 496d0644345c4a18bdbd5b9f5e543741: stopping tablet replica
I20260709 13:19:11.817950  1934 master.cc:584] Master@127.1.227.190:43207 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (39804 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:19:11.908448  1934 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.227.190:36593
I20260709 13:19:11.909618  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:11.915414 13004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:11.915601 13003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:11.916622 13006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:11.917856  1934 server_base.cc:1061] running on GCE node
I20260709 13:19:11.919005  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:11.919238  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:11.919423  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603151919400 us; error 0 us; skew 500 ppm
I20260709 13:19:11.919956  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:11.922719  1934 webserver.cc:533] Webserver started at http://127.1.227.190:41241/ using document root <none> and password file <none>
I20260709 13:19:11.923206  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:11.923419  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:11.923699  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:11.924829  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/master-0-root/instance:
uuid: "c1a3816440a0427b90f16878027fc373"
format_stamp: "Formatted at 2026-07-09 13:19:11 on dist-test-slave-lfdf"
I20260709 13:19:11.929437  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:19:11.932832 13011 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:11.933840  1934 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:19:11.934083  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/master-0-root
uuid: "c1a3816440a0427b90f16878027fc373"
format_stamp: "Formatted at 2026-07-09 13:19:11 on dist-test-slave-lfdf"
I20260709 13:19:11.934324  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:11.946892  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:11.948103  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:11.991613  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.190:36593
I20260709 13:19:11.991771 13062 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.190:36593 every 8 connection(s)
I20260709 13:19:11.996276 13063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.007850 13063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373: Bootstrap starting.
I20260709 13:19:12.013020 13063 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.017838 13063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373: No bootstrap required, opened a new log
I20260709 13:19:12.020258 13063 raft_consensus.cc:359] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1a3816440a0427b90f16878027fc373" member_type: VOTER }
I20260709 13:19:12.020793 13063 raft_consensus.cc:385] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.021068 13063 raft_consensus.cc:740] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1a3816440a0427b90f16878027fc373, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.021682 13063 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1a3816440a0427b90f16878027fc373" member_type: VOTER }
I20260709 13:19:12.022269 13063 raft_consensus.cc:399] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:12.022524 13063 raft_consensus.cc:493] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:12.022792 13063 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.027719 13063 raft_consensus.cc:515] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1a3816440a0427b90f16878027fc373" member_type: VOTER }
I20260709 13:19:12.028294 13063 leader_election.cc:304] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c1a3816440a0427b90f16878027fc373; no voters: 
I20260709 13:19:12.029506 13063 leader_election.cc:290] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:12.030041 13066 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:12.031556 13066 raft_consensus.cc:697] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373 [term 1 LEADER]: Becoming Leader. State: Replica: c1a3816440a0427b90f16878027fc373, State: Running, Role: LEADER
I20260709 13:19:12.032296 13066 consensus_queue.cc:237] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1a3816440a0427b90f16878027fc373" member_type: VOTER }
I20260709 13:19:12.032725 13063 sys_catalog.cc:565] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:12.037163 13068 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1a3816440a0427b90f16878027fc373. Latest consensus state: current_term: 1 leader_uuid: "c1a3816440a0427b90f16878027fc373" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1a3816440a0427b90f16878027fc373" member_type: VOTER } }
I20260709 13:19:12.037161 13067 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c1a3816440a0427b90f16878027fc373" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1a3816440a0427b90f16878027fc373" member_type: VOTER } }
I20260709 13:19:12.038090 13068 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:12.038116 13067 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:12.043270 13073 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:12.048350 13073 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:12.051121  1934 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:12.057826 13073 catalog_manager.cc:1383] Generated new cluster ID: 02c711c467e1414d8218c8052bd2723a
I20260709 13:19:12.058151 13073 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:12.073702 13073 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:12.075083 13073 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:12.091553 13073 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373: Generated new TSK 0
I20260709 13:19:12.092259 13073 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:12.120805  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:12.127637 13084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:12.128428 13085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:12.130203 13087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:12.130879  1934 server_base.cc:1061] running on GCE node
I20260709 13:19:12.131835  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:12.132022  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:12.132157  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603152132133 us; error 0 us; skew 500 ppm
I20260709 13:19:12.132670  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:12.135442  1934 webserver.cc:533] Webserver started at http://127.1.227.129:34537/ using document root <none> and password file <none>
I20260709 13:19:12.136070  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:12.136233  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:12.136555  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:12.137642  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/ts-0-root/instance:
uuid: "f76c489bb38b485fb100e70dd96ec2ba"
format_stamp: "Formatted at 2026-07-09 13:19:12 on dist-test-slave-lfdf"
I20260709 13:19:12.142513  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:19:12.146178 13092 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:12.147039  1934 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 13:19:12.147368  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/ts-0-root
uuid: "f76c489bb38b485fb100e70dd96ec2ba"
format_stamp: "Formatted at 2026-07-09 13:19:12 on dist-test-slave-lfdf"
I20260709 13:19:12.147694  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:12.164324  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:12.165598  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:12.167266  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:12.169674  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:12.169984  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:12.170226  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:12.170416  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:12.214493  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.129:39811
I20260709 13:19:12.214617 13154 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.129:39811 every 8 connection(s)
I20260709 13:19:12.219692  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:12.227106 13159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:12.229781 13160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:12.231015 13162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:12.231458  1934 server_base.cc:1061] running on GCE node
I20260709 13:19:12.232695  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:12.232925  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:12.233132  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603152233116 us; error 0 us; skew 500 ppm
I20260709 13:19:12.233788  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:12.234278 13155 heartbeater.cc:344] Connected to a master server at 127.1.227.190:36593
I20260709 13:19:12.234812 13155 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:12.235746 13155 heartbeater.cc:507] Master 127.1.227.190:36593 requested a full tablet report, sending...
I20260709 13:19:12.236738  1934 webserver.cc:533] Webserver started at http://127.1.227.130:40635/ using document root <none> and password file <none>
I20260709 13:19:12.237325  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:12.237552  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:12.237905  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:12.238550 13028 ts_manager.cc:194] Registered new tserver with Master: f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811)
I20260709 13:19:12.239423  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/ts-1-root/instance:
uuid: "b489b10f3a4e4265a5fcf5f934a97942"
format_stamp: "Formatted at 2026-07-09 13:19:12 on dist-test-slave-lfdf"
I20260709 13:19:12.241201 13028 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33546
I20260709 13:19:12.245505  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:19:12.249286 13167 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:12.250274  1934 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:19:12.250664  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/ts-1-root
uuid: "b489b10f3a4e4265a5fcf5f934a97942"
format_stamp: "Formatted at 2026-07-09 13:19:12 on dist-test-slave-lfdf"
I20260709 13:19:12.250953  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:12.286331  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:12.287611  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:12.289201  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:12.291462  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:12.291639  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:12.291952  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:12.292128  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:12.334105  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.130:41441
I20260709 13:19:12.334213 13229 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.130:41441 every 8 connection(s)
I20260709 13:19:12.339147  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:12.347185 13233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:12.348815 13234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:12.352677 13236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:12.353436  1934 server_base.cc:1061] running on GCE node
I20260709 13:19:12.354025 13230 heartbeater.cc:344] Connected to a master server at 127.1.227.190:36593
I20260709 13:19:12.354444 13230 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:12.354523  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:12.354879  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:12.355064  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603152355046 us; error 0 us; skew 500 ppm
I20260709 13:19:12.355343 13230 heartbeater.cc:507] Master 127.1.227.190:36593 requested a full tablet report, sending...
I20260709 13:19:12.355721  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:12.357914 13028 ts_manager.cc:194] Registered new tserver with Master: b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:12.358914  1934 webserver.cc:533] Webserver started at http://127.1.227.131:37475/ using document root <none> and password file <none>
I20260709 13:19:12.359625  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:12.359871  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:12.359843 13028 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33558
I20260709 13:19:12.360445  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:12.362043  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/ts-2-root/instance:
uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
format_stamp: "Formatted at 2026-07-09 13:19:12 on dist-test-slave-lfdf"
I20260709 13:19:12.367275  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:19:12.371245 13241 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:12.372227  1934 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:19:12.372490  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/ts-2-root
uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
format_stamp: "Formatted at 2026-07-09 13:19:12 on dist-test-slave-lfdf"
I20260709 13:19:12.372767  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:12.395442  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:12.396587  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:12.398087  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:12.400532  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:12.400717  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:12.401008  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:12.401191  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:12.444667  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.131:37279
I20260709 13:19:12.444716 13303 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.131:37279 every 8 connection(s)
I20260709 13:19:12.459417 13304 heartbeater.cc:344] Connected to a master server at 127.1.227.190:36593
I20260709 13:19:12.459825 13304 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:12.460585 13304 heartbeater.cc:507] Master 127.1.227.190:36593 requested a full tablet report, sending...
I20260709 13:19:12.462616 13028 ts_manager.cc:194] Registered new tserver with Master: b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131:37279)
I20260709 13:19:12.463179  1934 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01488609s
I20260709 13:19:12.464445 13028 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33560
I20260709 13:19:12.491159 13028 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33568:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:12.494117 13028 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:12.580484 13120 tablet_service.cc:1511] Processing CreateTablet for tablet 67065f76534041668d4e55a15e7bd8e5 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:19:12.582041 13120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67065f76534041668d4e55a15e7bd8e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.583949 13117 tablet_service.cc:1511] Processing CreateTablet for tablet 27466eac5d12402c9c072b968099f41c (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:19:12.585465 13117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27466eac5d12402c9c072b968099f41c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.586875 13118 tablet_service.cc:1511] Processing CreateTablet for tablet c08eb3df1f0748f792838c6295651f02 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:19:12.589360 13119 tablet_service.cc:1511] Processing CreateTablet for tablet 4263c3a1402d4df68c269f6f96a72eed (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:19:12.590983 13115 tablet_service.cc:1511] Processing CreateTablet for tablet 795b1f22991548dabf15d72b1ec2ea8a (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:19:12.592945 13115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795b1f22991548dabf15d72b1ec2ea8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.591797 13116 tablet_service.cc:1511] Processing CreateTablet for tablet cffd99ace5954094a63ebfb530b721c5 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:19:12.595470 13116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cffd99ace5954094a63ebfb530b721c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.596572 13119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4263c3a1402d4df68c269f6f96a72eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.598337 13118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c08eb3df1f0748f792838c6295651f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.610514 13195 tablet_service.cc:1511] Processing CreateTablet for tablet 67065f76534041668d4e55a15e7bd8e5 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:19:12.612100 13195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67065f76534041668d4e55a15e7bd8e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.612777 13191 tablet_service.cc:1511] Processing CreateTablet for tablet cffd99ace5954094a63ebfb530b721c5 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:19:12.614233 13191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cffd99ace5954094a63ebfb530b721c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.615082 13194 tablet_service.cc:1511] Processing CreateTablet for tablet 4263c3a1402d4df68c269f6f96a72eed (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:19:12.616560 13194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4263c3a1402d4df68c269f6f96a72eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.618930 13193 tablet_service.cc:1511] Processing CreateTablet for tablet c08eb3df1f0748f792838c6295651f02 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:19:12.620409 13193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c08eb3df1f0748f792838c6295651f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.623025 13192 tablet_service.cc:1511] Processing CreateTablet for tablet 27466eac5d12402c9c072b968099f41c (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:19:12.624528 13192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27466eac5d12402c9c072b968099f41c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.626709 13114 tablet_service.cc:1511] Processing CreateTablet for tablet 48e94b4a8b4f4edea04369f76f232b68 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:19:12.628294 13114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48e94b4a8b4f4edea04369f76f232b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.628599 13268 tablet_service.cc:1511] Processing CreateTablet for tablet 4263c3a1402d4df68c269f6f96a72eed (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:19:12.630064 13268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4263c3a1402d4df68c269f6f96a72eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.626703 13269 tablet_service.cc:1511] Processing CreateTablet for tablet 67065f76534041668d4e55a15e7bd8e5 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:19:12.631347 13269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67065f76534041668d4e55a15e7bd8e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.633456 13267 tablet_service.cc:1511] Processing CreateTablet for tablet c08eb3df1f0748f792838c6295651f02 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:19:12.634980 13267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c08eb3df1f0748f792838c6295651f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.651741 13266 tablet_service.cc:1511] Processing CreateTablet for tablet 27466eac5d12402c9c072b968099f41c (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:19:12.652895 13113 tablet_service.cc:1511] Processing CreateTablet for tablet 30a91e9e594646b2928a917b544163e8 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:19:12.654371 13113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a91e9e594646b2928a917b544163e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.655545 13265 tablet_service.cc:1511] Processing CreateTablet for tablet cffd99ace5954094a63ebfb530b721c5 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:19:12.653348 13266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27466eac5d12402c9c072b968099f41c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.658497 13265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cffd99ace5954094a63ebfb530b721c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.667809 13190 tablet_service.cc:1511] Processing CreateTablet for tablet 795b1f22991548dabf15d72b1ec2ea8a (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:19:12.669497 13190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795b1f22991548dabf15d72b1ec2ea8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.674223 13118 tablet_service.cc:1511] Processing CreateTablet for tablet f5f01ac121ea4e64b795c9abee9b3685 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:19:12.675855 13118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f01ac121ea4e64b795c9abee9b3685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.682513 13119 tablet_service.cc:1511] Processing CreateTablet for tablet 72d41d378d4e4e9cac7e8c42cee12675 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:19:12.684021 13119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72d41d378d4e4e9cac7e8c42cee12675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.683806 13264 tablet_service.cc:1511] Processing CreateTablet for tablet 795b1f22991548dabf15d72b1ec2ea8a (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:19:12.685230 13264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795b1f22991548dabf15d72b1ec2ea8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.691787 13189 tablet_service.cc:1511] Processing CreateTablet for tablet 48e94b4a8b4f4edea04369f76f232b68 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:19:12.693719 13189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48e94b4a8b4f4edea04369f76f232b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.700629 13263 tablet_service.cc:1511] Processing CreateTablet for tablet 48e94b4a8b4f4edea04369f76f232b68 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:19:12.702203 13263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48e94b4a8b4f4edea04369f76f232b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.720016 13320 tablet_bootstrap.cc:492] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942: Bootstrap starting.
I20260709 13:19:12.726679 13269 tablet_service.cc:1511] Processing CreateTablet for tablet 30a91e9e594646b2928a917b544163e8 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:19:12.727571 13193 tablet_service.cc:1511] Processing CreateTablet for tablet f5f01ac121ea4e64b795c9abee9b3685 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:19:12.727792 13262 tablet_service.cc:1511] Processing CreateTablet for tablet f5f01ac121ea4e64b795c9abee9b3685 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:19:12.728216 13269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a91e9e594646b2928a917b544163e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.729048 13262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f01ac121ea4e64b795c9abee9b3685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.711921 13195 tablet_service.cc:1511] Processing CreateTablet for tablet 30a91e9e594646b2928a917b544163e8 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:19:12.711908 13319 tablet_bootstrap.cc:492] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap starting.
I20260709 13:19:12.730314 13320 tablet_bootstrap.cc:654] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.729048 13193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f01ac121ea4e64b795c9abee9b3685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.735322 13195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a91e9e594646b2928a917b544163e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.744261 13192 tablet_service.cc:1511] Processing CreateTablet for tablet 72d41d378d4e4e9cac7e8c42cee12675 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:19:12.745772 13192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72d41d378d4e4e9cac7e8c42cee12675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.761497 13319 tablet_bootstrap.cc:654] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.767506 13267 tablet_service.cc:1511] Processing CreateTablet for tablet 72d41d378d4e4e9cac7e8c42cee12675 (DEFAULT_TABLE table=test-workload [id=3410950b3a834d91a1df56077a7d7451]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:19:12.775416 13267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72d41d378d4e4e9cac7e8c42cee12675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:12.806097 13322 tablet_bootstrap.cc:492] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a: Bootstrap starting.
I20260709 13:19:12.807783 13320 tablet_bootstrap.cc:492] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942: No bootstrap required, opened a new log
I20260709 13:19:12.807786 13319 tablet_bootstrap.cc:492] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba: No bootstrap required, opened a new log
I20260709 13:19:12.808856 13320 ts_tablet_manager.cc:1403] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942: Time spent bootstrapping tablet: real 0.095s	user 0.020s	sys 0.000s
I20260709 13:19:12.808908 13319 ts_tablet_manager.cc:1403] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba: Time spent bootstrapping tablet: real 0.097s	user 0.007s	sys 0.017s
I20260709 13:19:12.811765 13322 tablet_bootstrap.cc:654] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.812269 13319 raft_consensus.cc:359] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } } peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } }
I20260709 13:19:12.813086 13319 raft_consensus.cc:385] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.813386 13319 raft_consensus.cc:740] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76c489bb38b485fb100e70dd96ec2ba, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.814283 13319 consensus_queue.cc:260] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } } peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } }
I20260709 13:19:12.814390 13320 raft_consensus.cc:359] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.815671 13320 raft_consensus.cc:385] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.816170 13320 raft_consensus.cc:740] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.817503 13320 consensus_queue.cc:260] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.824443 13322 tablet_bootstrap.cc:492] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a: No bootstrap required, opened a new log
I20260709 13:19:12.824647 13319 ts_tablet_manager.cc:1434] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.013s
I20260709 13:19:12.825167 13322 ts_tablet_manager.cc:1403] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.010s
I20260709 13:19:12.825501 13155 heartbeater.cc:499] Master 127.1.227.190:36593 was elected leader, sending a full tablet report...
I20260709 13:19:12.825259 13320 ts_tablet_manager.cc:1434] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.005s
I20260709 13:19:12.825803 13230 heartbeater.cc:499] Master 127.1.227.190:36593 was elected leader, sending a full tablet report...
I20260709 13:19:12.826831 13320 tablet_bootstrap.cc:492] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942: Bootstrap starting.
I20260709 13:19:12.827716 13319 tablet_bootstrap.cc:492] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap starting.
I20260709 13:19:12.834606 13319 tablet_bootstrap.cc:654] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.836982 13322 raft_consensus.cc:359] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.837683 13322 raft_consensus.cc:385] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.838042 13322 raft_consensus.cc:740] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Initialized, Role: FOLLOWER
W20260709 13:19:12.838863 13231 tablet.cc:2406] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:19:12.839020 13322 consensus_queue.cc:260] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.840131 13320 tablet_bootstrap.cc:654] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.847791 13304 heartbeater.cc:499] Master 127.1.227.190:36593 was elected leader, sending a full tablet report...
I20260709 13:19:12.848888 13322 ts_tablet_manager.cc:1434] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a: Time spent starting tablet: real 0.023s	user 0.012s	sys 0.000s
I20260709 13:19:12.849161 13319 tablet_bootstrap.cc:492] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba: No bootstrap required, opened a new log
I20260709 13:19:12.849680 13319 ts_tablet_manager.cc:1403] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.009s
I20260709 13:19:12.850805 13322 tablet_bootstrap.cc:492] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a: Bootstrap starting.
I20260709 13:19:12.854233 13319 raft_consensus.cc:359] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.855422 13319 raft_consensus.cc:385] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.856230 13319 raft_consensus.cc:740] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76c489bb38b485fb100e70dd96ec2ba, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.857019 13319 consensus_queue.cc:260] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.860124 13319 ts_tablet_manager.cc:1434] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:19:12.860594 13322 tablet_bootstrap.cc:654] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.861137 13319 tablet_bootstrap.cc:492] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap starting.
I20260709 13:19:12.861370 13320 tablet_bootstrap.cc:492] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942: No bootstrap required, opened a new log
I20260709 13:19:12.861884 13320 ts_tablet_manager.cc:1403] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.006s
I20260709 13:19:12.865027 13320 raft_consensus.cc:359] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.869588 13320 raft_consensus.cc:385] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.869974 13320 raft_consensus.cc:740] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.870817 13320 consensus_queue.cc:260] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.872789 13320 ts_tablet_manager.cc:1434] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.003s
I20260709 13:19:12.873628 13320 tablet_bootstrap.cc:492] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942: Bootstrap starting.
I20260709 13:19:12.868631 13319 tablet_bootstrap.cc:654] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.882161 13320 tablet_bootstrap.cc:654] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.895020 13322 tablet_bootstrap.cc:492] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a: No bootstrap required, opened a new log
I20260709 13:19:12.895529 13322 ts_tablet_manager.cc:1403] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.019s
I20260709 13:19:12.897698 13319 tablet_bootstrap.cc:492] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba: No bootstrap required, opened a new log
I20260709 13:19:12.897709 13322 raft_consensus.cc:359] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } } peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } }
I20260709 13:19:12.898550 13319 ts_tablet_manager.cc:1403] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.016s
I20260709 13:19:12.898691 13322 raft_consensus.cc:385] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.899147 13322 raft_consensus.cc:740] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.899876 13322 consensus_queue.cc:260] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } } peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } }
I20260709 13:19:12.901885 13322 ts_tablet_manager.cc:1434] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:19:12.902825 13322 tablet_bootstrap.cc:492] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a: Bootstrap starting.
I20260709 13:19:12.901952 13319 raft_consensus.cc:359] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.903908 13319 raft_consensus.cc:385] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.904260 13319 raft_consensus.cc:740] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76c489bb38b485fb100e70dd96ec2ba, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.905133 13319 consensus_queue.cc:260] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.906553 13320 tablet_bootstrap.cc:492] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942: No bootstrap required, opened a new log
I20260709 13:19:12.907109 13320 ts_tablet_manager.cc:1403] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.008s
I20260709 13:19:12.909643 13322 tablet_bootstrap.cc:654] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.910589 13319 ts_tablet_manager.cc:1434] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:19:12.911896 13319 tablet_bootstrap.cc:492] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap starting.
I20260709 13:19:12.914121 13320 raft_consensus.cc:359] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.914954 13320 raft_consensus.cc:385] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.915269 13320 raft_consensus.cc:740] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.916227 13320 consensus_queue.cc:260] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.918607 13320 ts_tablet_manager.cc:1434] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:19:12.919754 13320 tablet_bootstrap.cc:492] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942: Bootstrap starting.
I20260709 13:19:12.923528 13319 tablet_bootstrap.cc:654] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.926477 13320 tablet_bootstrap.cc:654] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.931195 13322 tablet_bootstrap.cc:492] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a: No bootstrap required, opened a new log
I20260709 13:19:12.931732 13322 ts_tablet_manager.cc:1403] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.004s
I20260709 13:19:12.932889 13319 tablet_bootstrap.cc:492] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba: No bootstrap required, opened a new log
I20260709 13:19:12.933640 13319 ts_tablet_manager.cc:1403] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 13:19:12.934831 13322 raft_consensus.cc:359] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.935645 13322 raft_consensus.cc:385] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.936100 13322 raft_consensus.cc:740] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.936769 13320 tablet_bootstrap.cc:492] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942: No bootstrap required, opened a new log
I20260709 13:19:12.937523 13320 ts_tablet_manager.cc:1403] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 13:19:12.936928 13322 consensus_queue.cc:260] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.936955 13319 raft_consensus.cc:359] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.938100 13319 raft_consensus.cc:385] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.938441 13319 raft_consensus.cc:740] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76c489bb38b485fb100e70dd96ec2ba, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.939438 13322 ts_tablet_manager.cc:1434] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:19:12.939230 13319 consensus_queue.cc:260] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.940538 13322 tablet_bootstrap.cc:492] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a: Bootstrap starting.
I20260709 13:19:12.940901 13320 raft_consensus.cc:359] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } } peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } }
I20260709 13:19:12.941722 13320 raft_consensus.cc:385] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.942229 13320 raft_consensus.cc:740] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.943132 13320 consensus_queue.cc:260] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } } peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } }
I20260709 13:19:12.944619 13319 ts_tablet_manager.cc:1434] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:19:12.945828 13320 ts_tablet_manager.cc:1434] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:19:12.945844 13319 tablet_bootstrap.cc:492] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap starting.
I20260709 13:19:12.947187 13320 tablet_bootstrap.cc:492] T 795b1f22991548dabf15d72b1ec2ea8a P b489b10f3a4e4265a5fcf5f934a97942: Bootstrap starting.
I20260709 13:19:12.953980 13319 tablet_bootstrap.cc:654] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.960242 13320 tablet_bootstrap.cc:654] T 795b1f22991548dabf15d72b1ec2ea8a P b489b10f3a4e4265a5fcf5f934a97942: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.962755 13322 tablet_bootstrap.cc:654] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.966868 13319 tablet_bootstrap.cc:492] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba: No bootstrap required, opened a new log
I20260709 13:19:12.966868 13320 tablet_bootstrap.cc:492] T 795b1f22991548dabf15d72b1ec2ea8a P b489b10f3a4e4265a5fcf5f934a97942: No bootstrap required, opened a new log
I20260709 13:19:12.967536 13319 ts_tablet_manager.cc:1403] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.005s
I20260709 13:19:12.967587 13320 ts_tablet_manager.cc:1403] T 795b1f22991548dabf15d72b1ec2ea8a P b489b10f3a4e4265a5fcf5f934a97942: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 13:19:12.968104 13322 tablet_bootstrap.cc:492] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a: No bootstrap required, opened a new log
I20260709 13:19:12.968675 13322 ts_tablet_manager.cc:1403] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.004s
I20260709 13:19:12.971295 13319 raft_consensus.cc:359] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.971995 13319 raft_consensus.cc:385] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.971756 13320 raft_consensus.cc:359] T 795b1f22991548dabf15d72b1ec2ea8a P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.972769 13320 raft_consensus.cc:385] T 795b1f22991548dabf15d72b1ec2ea8a P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.972399 13319 raft_consensus.cc:740] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76c489bb38b485fb100e70dd96ec2ba, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.972383 13322 raft_consensus.cc:359] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.973097 13320 raft_consensus.cc:740] T 795b1f22991548dabf15d72b1ec2ea8a P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.973371 13322 raft_consensus.cc:385] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.973699 13322 raft_consensus.cc:740] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.973703 13319 consensus_queue.cc:260] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.974043 13320 consensus_queue.cc:260] T 795b1f22991548dabf15d72b1ec2ea8a P b489b10f3a4e4265a5fcf5f934a97942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.974815 13322 consensus_queue.cc:260] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:12.976775 13320 ts_tablet_manager.cc:1434] T 795b1f22991548dabf15d72b1ec2ea8a P b489b10f3a4e4265a5fcf5f934a97942: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:19:12.978264 13319 ts_tablet_manager.cc:1434] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.007s
I20260709 13:19:12.978737 13320 tablet_bootstrap.cc:492] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942: Bootstrap starting.
I20260709 13:19:12.979359 13319 tablet_bootstrap.cc:492] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap starting.
I20260709 13:19:12.985459 13326 raft_consensus.cc:493] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.986143 13322 ts_tablet_manager.cc:1434] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.002s
I20260709 13:19:12.986397 13320 tablet_bootstrap.cc:654] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.986109 13326 raft_consensus.cc:515] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } } peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } }
I20260709 13:19:12.987390 13322 tablet_bootstrap.cc:492] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a: Bootstrap starting.
I20260709 13:19:12.996930 13322 tablet_bootstrap.cc:654] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.999359 13326 leader_election.cc:290] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131:37279), f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811)
I20260709 13:19:13.000052 13326 raft_consensus.cc:493] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.000521 13326 raft_consensus.cc:515] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.008299 13326 leader_election.cc:290] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131:37279)
I20260709 13:19:13.011246 13322 tablet_bootstrap.cc:492] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a: No bootstrap required, opened a new log
I20260709 13:19:13.012130 13322 ts_tablet_manager.cc:1403] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.012s
I20260709 13:19:13.016314 13322 raft_consensus.cc:359] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.017442 13322 raft_consensus.cc:385] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.017874 13322 raft_consensus.cc:740] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.020673 13328 raft_consensus.cc:493] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.021296 13319 tablet_bootstrap.cc:654] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.021536 13328 raft_consensus.cc:515] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.033468 13328 leader_election.cc:290] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:13.019590 13322 consensus_queue.cc:260] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.034942 13328 raft_consensus.cc:493] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.035593 13328 raft_consensus.cc:515] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.039513 13328 leader_election.cc:290] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:13.036015 13320 tablet_bootstrap.cc:492] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942: No bootstrap required, opened a new log
I20260709 13:19:13.040601 13320 ts_tablet_manager.cc:1403] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.036s
W20260709 13:19:13.046105 13076 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:13.048395 13328 raft_consensus.cc:493] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.049057 13328 raft_consensus.cc:515] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.051373 13328 leader_election.cc:290] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:13.051488 13320 raft_consensus.cc:359] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.052297 13320 raft_consensus.cc:385] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.052632 13320 raft_consensus.cc:740] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.059844 13322 ts_tablet_manager.cc:1434] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a: Time spent starting tablet: real 0.047s	user 0.012s	sys 0.000s
I20260709 13:19:13.060998 13322 tablet_bootstrap.cc:492] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a: Bootstrap starting.
I20260709 13:19:13.062433 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67065f76534041668d4e55a15e7bd8e5" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba" is_pre_election: true
I20260709 13:19:13.063478 13130 raft_consensus.cc:2468] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 0.
I20260709 13:19:13.053526 13320 consensus_queue.cc:260] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.069144 13170 leader_election.cc:304] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b489b10f3a4e4265a5fcf5f934a97942, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:13.070169 13320 ts_tablet_manager.cc:1434] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:19:13.070344 13339 raft_consensus.cc:2804] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:13.070819 13339 raft_consensus.cc:493] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.071174 13339 raft_consensus.cc:3060] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.071328 13320 tablet_bootstrap.cc:492] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942: Bootstrap starting.
I20260709 13:19:13.068203 13129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263c3a1402d4df68c269f6f96a72eed" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba" is_pre_election: true
I20260709 13:19:13.073663 13129 raft_consensus.cc:2468] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 0.
I20260709 13:19:13.075012 13170 leader_election.cc:304] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b489b10f3a4e4265a5fcf5f934a97942, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:13.075899 13326 raft_consensus.cc:2804] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:13.076278 13326 raft_consensus.cc:493] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.076627 13326 raft_consensus.cc:3060] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.079037 13322 tablet_bootstrap.cc:654] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.080550 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c08eb3df1f0748f792838c6295651f02" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba" is_pre_election: true
I20260709 13:19:13.081377 13128 raft_consensus.cc:2468] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 0.
I20260709 13:19:13.082237 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27466eac5d12402c9c072b968099f41c" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba" is_pre_election: true
I20260709 13:19:13.082646 13127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795b1f22991548dabf15d72b1ec2ea8a" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba" is_pre_election: true
I20260709 13:19:13.083626 13127 raft_consensus.cc:2468] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 0.
I20260709 13:19:13.086048 13244 leader_election.cc:304] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:13.088378 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27466eac5d12402c9c072b968099f41c" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942" is_pre_election: true
I20260709 13:19:13.089155 13205 raft_consensus.cc:2468] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 0.
I20260709 13:19:13.091907 13319 tablet_bootstrap.cc:492] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba: No bootstrap required, opened a new log
I20260709 13:19:13.092501 13319 ts_tablet_manager.cc:1403] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba: Time spent bootstrapping tablet: real 0.113s	user 0.029s	sys 0.019s
I20260709 13:19:13.092636 13320 tablet_bootstrap.cc:654] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.094485 13242 leader_election.cc:304] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, b489b10f3a4e4265a5fcf5f934a97942; no voters: 
I20260709 13:19:13.095248 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795b1f22991548dabf15d72b1ec2ea8a" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942" is_pre_election: true
I20260709 13:19:13.095986 13204 raft_consensus.cc:2468] T 795b1f22991548dabf15d72b1ec2ea8a P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 0.
I20260709 13:19:13.096776 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c08eb3df1f0748f792838c6295651f02" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942" is_pre_election: true
I20260709 13:19:13.095654 13319 raft_consensus.cc:359] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.097386 13319 raft_consensus.cc:385] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.097424 13205 raft_consensus.cc:2468] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 0.
I20260709 13:19:13.097829 13319 raft_consensus.cc:740] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76c489bb38b485fb100e70dd96ec2ba, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.099036 13326 raft_consensus.cc:515] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.099154 13319 consensus_queue.cc:260] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.100430 13322 tablet_bootstrap.cc:492] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a: No bootstrap required, opened a new log
I20260709 13:19:13.100971 13322 ts_tablet_manager.cc:1403] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.000s
I20260709 13:19:13.101333 13326 leader_election.cc:290] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 1 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131:37279)
W20260709 13:19:13.102639 13244 leader_election.cc:343] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:13.103111 13127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263c3a1402d4df68c269f6f96a72eed" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:13.103796 13127 raft_consensus.cc:3060] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.103744 13244 leader_election.cc:304] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:13.104269 13322 raft_consensus.cc:359] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.105916 13322 raft_consensus.cc:385] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.106194 13328 raft_consensus.cc:2804] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:13.106318 13322 raft_consensus.cc:740] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.106974 13328 raft_consensus.cc:493] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.107506 13328 raft_consensus.cc:3060] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.107702 13322 consensus_queue.cc:260] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.118896 13320 tablet_bootstrap.cc:492] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942: No bootstrap required, opened a new log
I20260709 13:19:13.119544 13320 ts_tablet_manager.cc:1403] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.017s
I20260709 13:19:13.120412 13319 ts_tablet_manager.cc:1434] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:19:13.121569 13127 raft_consensus.cc:2468] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 1.
I20260709 13:19:13.122226 13348 raft_consensus.cc:2804] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:13.122668 13320 raft_consensus.cc:359] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.122704 13348 raft_consensus.cc:493] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.123363 13170 leader_election.cc:304] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b489b10f3a4e4265a5fcf5f934a97942, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:13.123427 13320 raft_consensus.cc:385] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.124724 13320 raft_consensus.cc:740] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.101346 13339 raft_consensus.cc:515] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } } peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } }
I20260709 13:19:13.125541 13320 consensus_queue.cc:260] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.124111 13348 raft_consensus.cc:3060] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.128379 13339 leader_election.cc:290] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 1 election: Requested vote from peers b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131:37279), f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811)
I20260709 13:19:13.128997 13339 raft_consensus.cc:2804] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:13.129447 13339 raft_consensus.cc:697] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 1 LEADER]: Becoming Leader. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Running, Role: LEADER
I20260709 13:19:13.130295 13339 consensus_queue.cc:237] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.133419 13351 raft_consensus.cc:2804] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:13.143567 13351 raft_consensus.cc:493] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.144137 13351 raft_consensus.cc:3060] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.121155 13328 raft_consensus.cc:515] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.137354 13279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67065f76534041668d4e55a15e7bd8e5" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" is_pre_election: true
I20260709 13:19:13.146320 13279 raft_consensus.cc:2468] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 0.
I20260709 13:19:13.139326 13278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263c3a1402d4df68c269f6f96a72eed" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" is_pre_election: true
I20260709 13:19:13.147791 13322 ts_tablet_manager.cc:1434] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a: Time spent starting tablet: real 0.047s	user 0.017s	sys 0.026s
I20260709 13:19:13.148017 13278 raft_consensus.cc:2468] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 0.
I20260709 13:19:13.140749 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263c3a1402d4df68c269f6f96a72eed" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
I20260709 13:19:13.148824 13127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67065f76534041668d4e55a15e7bd8e5" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:13.149473 13277 raft_consensus.cc:3060] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.149626 13127 raft_consensus.cc:3060] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.140882 13348 raft_consensus.cc:515] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.153219 13322 tablet_bootstrap.cc:492] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a: Bootstrap starting.
I20260709 13:19:13.156728 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795b1f22991548dabf15d72b1ec2ea8a" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:13.157456 13130 raft_consensus.cc:3060] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.162536 13348 leader_election.cc:290] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:13.163211 13322 tablet_bootstrap.cc:654] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.167441 13128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c08eb3df1f0748f792838c6295651f02" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:13.168287 13128 raft_consensus.cc:3060] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.169567 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795b1f22991548dabf15d72b1ec2ea8a" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
I20260709 13:19:13.170554 13205 raft_consensus.cc:3060] T 795b1f22991548dabf15d72b1ec2ea8a P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.176172 13352 raft_consensus.cc:493] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.142508 13276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67065f76534041668d4e55a15e7bd8e5" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
I20260709 13:19:13.177364 13276 raft_consensus.cc:3060] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.176532 13128 raft_consensus.cc:2468] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 1.
I20260709 13:19:13.166168 13130 raft_consensus.cc:2468] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 1.
I20260709 13:19:13.168215 13127 raft_consensus.cc:2468] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 1.
I20260709 13:19:13.182632 13244 leader_election.cc:304] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:13.183629 13244 leader_election.cc:304] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:13.184140 13322 tablet_bootstrap.cc:492] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a: No bootstrap required, opened a new log
I20260709 13:19:13.184741 13322 ts_tablet_manager.cc:1403] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.000s
I20260709 13:19:13.186031 13348 raft_consensus.cc:2804] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:13.187952 13322 raft_consensus.cc:359] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.188764 13322 raft_consensus.cc:385] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.189168 13322 raft_consensus.cc:740] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.189684 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c08eb3df1f0748f792838c6295651f02" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
I20260709 13:19:13.190706 13204 raft_consensus.cc:3060] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.190281 13322 consensus_queue.cc:260] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.191637 13170 leader_election.cc:304] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b489b10f3a4e4265a5fcf5f934a97942, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:13.142642 13319 tablet_bootstrap.cc:492] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap starting.
I20260709 13:19:13.193620 13276 raft_consensus.cc:2468] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 1.
I20260709 13:19:13.201200 13204 raft_consensus.cc:2468] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 1.
I20260709 13:19:13.199810 13320 ts_tablet_manager.cc:1434] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942: Time spent starting tablet: real 0.080s	user 0.035s	sys 0.035s
I20260709 13:19:13.206001 13320 tablet_bootstrap.cc:492] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942: Bootstrap starting.
I20260709 13:19:13.199188 13352 raft_consensus.cc:515] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.209012 13351 raft_consensus.cc:515] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.187525 13328 leader_election.cc:290] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:13.198937 13354 raft_consensus.cc:2804] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:13.212556 13354 raft_consensus.cc:697] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 LEADER]: Becoming Leader. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Running, Role: LEADER
I20260709 13:19:13.213591 13354 consensus_queue.cc:237] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } } peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } }
I20260709 13:19:13.185345 13277 raft_consensus.cc:2468] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 1.
I20260709 13:19:13.210924 13352 leader_election.cc:290] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:13.220435 13348 raft_consensus.cc:697] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Becoming Leader. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:13.218858 13205 raft_consensus.cc:2468] T 795b1f22991548dabf15d72b1ec2ea8a P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 1.
I20260709 13:19:13.222280 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffd99ace5954094a63ebfb530b721c5" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942" is_pre_election: true
I20260709 13:19:13.224236 13348 consensus_queue.cc:237] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.225013 13204 raft_consensus.cc:2468] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 0.
I20260709 13:19:13.228746 13242 leader_election.cc:304] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, b489b10f3a4e4265a5fcf5f934a97942; no voters: 
I20260709 13:19:13.221338 13357 raft_consensus.cc:2804] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:13.230006 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27466eac5d12402c9c072b968099f41c" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
I20260709 13:19:13.232514 13205 raft_consensus.cc:3060] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.235018 13319 tablet_bootstrap.cc:654] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.232482 13358 raft_consensus.cc:2804] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:13.238032 13358 raft_consensus.cc:493] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.238517 13358 raft_consensus.cc:3060] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.242633 13351 leader_election.cc:290] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:13.244408 13322 ts_tablet_manager.cc:1434] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a: Time spent starting tablet: real 0.059s	user 0.023s	sys 0.015s
I20260709 13:19:13.245229 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27466eac5d12402c9c072b968099f41c" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:13.246224 13130 raft_consensus.cc:3060] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.249439 13320 tablet_bootstrap.cc:654] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.244150 13127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffd99ace5954094a63ebfb530b721c5" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba" is_pre_election: true
I20260709 13:19:13.250442 13322 tablet_bootstrap.cc:492] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a: Bootstrap starting.
I20260709 13:19:13.256222 13127 raft_consensus.cc:2468] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 0.
I20260709 13:19:13.260334 13130 raft_consensus.cc:2468] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 1.
I20260709 13:19:13.256386 13357 raft_consensus.cc:697] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Becoming Leader. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:13.262300 13357 consensus_queue.cc:237] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.264014 13244 leader_election.cc:304] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:13.265048 13351 raft_consensus.cc:2804] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:13.265671 13351 raft_consensus.cc:697] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Becoming Leader. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:13.266551 13351 consensus_queue.cc:237] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.268035 13358 raft_consensus.cc:515] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.267300 13025 catalog_manager.cc:5697] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 reported cstate change: term changed from 0 to 1, leader changed from <none> to b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "b489b10f3a4e4265a5fcf5f934a97942" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:13.271381 13358 leader_election.cc:290] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:13.256079 13205 raft_consensus.cc:2468] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 1.
I20260709 13:19:13.272025 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffd99ace5954094a63ebfb530b721c5" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:13.276060 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffd99ace5954094a63ebfb530b721c5" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
I20260709 13:19:13.281159 13130 raft_consensus.cc:3060] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.282949 13320 tablet_bootstrap.cc:492] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942: No bootstrap required, opened a new log
I20260709 13:19:13.283643 13320 ts_tablet_manager.cc:1403] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.008s
I20260709 13:19:13.284809 13322 tablet_bootstrap.cc:654] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.282951 13319 tablet_bootstrap.cc:492] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba: No bootstrap required, opened a new log
I20260709 13:19:13.284548 13205 raft_consensus.cc:3060] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.291447 13320 raft_consensus.cc:359] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.292217 13320 raft_consensus.cc:385] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.292500 13320 raft_consensus.cc:740] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.293330 13319 ts_tablet_manager.cc:1403] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba: Time spent bootstrapping tablet: real 0.151s	user 0.017s	sys 0.002s
I20260709 13:19:13.294819 13023 catalog_manager.cc:5697] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131). New cstate: current_term: 1 leader_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.296363 13205 raft_consensus.cc:2468] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 1.
I20260709 13:19:13.296514 13319 raft_consensus.cc:359] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.297273 13319 raft_consensus.cc:385] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.298014 13242 leader_election.cc:304] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, b489b10f3a4e4265a5fcf5f934a97942; no voters: 
I20260709 13:19:13.300028 13320 consensus_queue.cc:260] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.301182 13348 raft_consensus.cc:2804] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:13.297724 13319 raft_consensus.cc:740] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76c489bb38b485fb100e70dd96ec2ba, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.301702 13348 raft_consensus.cc:697] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Becoming Leader. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:13.302959 13348 consensus_queue.cc:237] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.304369 13130 raft_consensus.cc:2468] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 1.
I20260709 13:19:13.313437 13320 ts_tablet_manager.cc:1434] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.002s
I20260709 13:19:13.314922 13320 tablet_bootstrap.cc:492] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942: Bootstrap starting.
I20260709 13:19:13.310619 13319 consensus_queue.cc:260] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.318440 13322 tablet_bootstrap.cc:492] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a: No bootstrap required, opened a new log
I20260709 13:19:13.319113 13322 ts_tablet_manager.cc:1403] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a: Time spent bootstrapping tablet: real 0.069s	user 0.007s	sys 0.011s
I20260709 13:19:13.320645 13320 tablet_bootstrap.cc:654] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.321185 13322 raft_consensus.cc:359] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.321801 13322 raft_consensus.cc:385] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.322099 13322 raft_consensus.cc:740] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.322880 13322 consensus_queue.cc:260] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.324944 13322 ts_tablet_manager.cc:1434] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:19:13.325963 13322 tablet_bootstrap.cc:492] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a: Bootstrap starting.
I20260709 13:19:13.330684 13319 ts_tablet_manager.cc:1434] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:19:13.332285 13028 catalog_manager.cc:5697] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 reported cstate change: term changed from 0 to 1, leader changed from <none> to b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "b489b10f3a4e4265a5fcf5f934a97942" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.334510 13319 tablet_bootstrap.cc:492] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap starting.
I20260709 13:19:13.334717 13320 tablet_bootstrap.cc:492] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942: No bootstrap required, opened a new log
I20260709 13:19:13.335354 13320 ts_tablet_manager.cc:1403] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:19:13.338541 13320 raft_consensus.cc:359] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.339352 13320 raft_consensus.cc:385] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.339684 13320 raft_consensus.cc:740] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.331688 13322 tablet_bootstrap.cc:654] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.340583 13320 consensus_queue.cc:260] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.342764 13320 ts_tablet_manager.cc:1434] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:13.344195 13320 tablet_bootstrap.cc:492] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942: Bootstrap starting.
I20260709 13:19:13.346549 13319 tablet_bootstrap.cc:654] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.354344 13320 tablet_bootstrap.cc:654] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.357043 13322 tablet_bootstrap.cc:492] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a: No bootstrap required, opened a new log
I20260709 13:19:13.357872 13322 ts_tablet_manager.cc:1403] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.002s
I20260709 13:19:13.362040 13319 tablet_bootstrap.cc:492] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba: No bootstrap required, opened a new log
I20260709 13:19:13.362764 13319 ts_tablet_manager.cc:1403] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.005s
I20260709 13:19:13.362102 13322 raft_consensus.cc:359] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.363682 13322 raft_consensus.cc:385] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.364197 13322 raft_consensus.cc:740] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.365640 13319 raft_consensus.cc:359] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.365317 13322 consensus_queue.cc:260] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.366412 13319 raft_consensus.cc:385] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.366796 13319 raft_consensus.cc:740] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76c489bb38b485fb100e70dd96ec2ba, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.367012 13023 catalog_manager.cc:5697] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131). New cstate: current_term: 1 leader_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.367817 13319 consensus_queue.cc:260] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.369568 13322 ts_tablet_manager.cc:1434] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:19:13.369251 13023 catalog_manager.cc:5697] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131). New cstate: current_term: 1 leader_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.370340 13319 ts_tablet_manager.cc:1434] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:19:13.370565 13348 raft_consensus.cc:493] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.371220 13322 tablet_bootstrap.cc:492] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a: Bootstrap starting.
I20260709 13:19:13.371140 13348 raft_consensus.cc:515] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.371381 13319 tablet_bootstrap.cc:492] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap starting.
I20260709 13:19:13.371158 13023 catalog_manager.cc:5697] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131). New cstate: current_term: 1 leader_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.375700 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f01ac121ea4e64b795c9abee9b3685" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942" is_pre_election: true
I20260709 13:19:13.375967 13348 leader_election.cc:290] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:13.376540 13205 raft_consensus.cc:2468] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 0.
I20260709 13:19:13.377760 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f01ac121ea4e64b795c9abee9b3685" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba" is_pre_election: true
I20260709 13:19:13.377988 13242 leader_election.cc:304] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, b489b10f3a4e4265a5fcf5f934a97942; no voters: 
I20260709 13:19:13.378811 13319 tablet_bootstrap.cc:654] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:13.379474 13244 leader_election.cc:343] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:13.380554 13348 raft_consensus.cc:2804] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:13.381033 13348 raft_consensus.cc:493] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.381428 13348 raft_consensus.cc:3060] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.382625 13322 tablet_bootstrap.cc:654] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.391798 13320 tablet_bootstrap.cc:492] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942: No bootstrap required, opened a new log
I20260709 13:19:13.392546 13320 ts_tablet_manager.cc:1403] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.016s
I20260709 13:19:13.395596 13319 tablet_bootstrap.cc:492] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba: No bootstrap required, opened a new log
I20260709 13:19:13.396152 13319 ts_tablet_manager.cc:1403] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.005s
I20260709 13:19:13.396401 13320 raft_consensus.cc:359] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.398808 13319 raft_consensus.cc:359] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.399472 13319 raft_consensus.cc:385] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.399734 13319 raft_consensus.cc:740] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76c489bb38b485fb100e70dd96ec2ba, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.400384 13319 consensus_queue.cc:260] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.400231 13348 raft_consensus.cc:515] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.402416 13319 ts_tablet_manager.cc:1434] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:19:13.404249 13348 leader_election.cc:290] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:13.397593 13320 raft_consensus.cc:385] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.406512 13319 tablet_bootstrap.cc:492] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap starting.
I20260709 13:19:13.406466 13320 raft_consensus.cc:740] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.407575 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f01ac121ea4e64b795c9abee9b3685" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:13.407500 13320 consensus_queue.cc:260] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.408274 13130 raft_consensus.cc:3060] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.410009 13320 ts_tablet_manager.cc:1434] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.001s
I20260709 13:19:13.411877 13322 tablet_bootstrap.cc:492] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a: No bootstrap required, opened a new log
I20260709 13:19:13.412467 13322 ts_tablet_manager.cc:1403] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.017s
I20260709 13:19:13.413069 13319 tablet_bootstrap.cc:654] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.414151 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f01ac121ea4e64b795c9abee9b3685" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
I20260709 13:19:13.414801 13205 raft_consensus.cc:3060] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.417730 13354 raft_consensus.cc:493] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.418339 13354 raft_consensus.cc:515] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.426513 13354 leader_election.cc:290] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131:37279)
I20260709 13:19:13.426643 13127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d41d378d4e4e9cac7e8c42cee12675" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba" is_pre_election: true
I20260709 13:19:13.427701 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d41d378d4e4e9cac7e8c42cee12675" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" is_pre_election: true
W20260709 13:19:13.428550 13170 leader_election.cc:343] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:13.429376 13168 leader_election.cc:343] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131:37279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:13.429843 13168 leader_election.cc:304] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b489b10f3a4e4265a5fcf5f934a97942; no voters: b3b320ba0cd44ab68a007567b6d07c1a, f76c489bb38b485fb100e70dd96ec2ba
I20260709 13:19:13.431100 13354 raft_consensus.cc:2749] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:13.432091 13205 raft_consensus.cc:2468] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 1.
I20260709 13:19:13.432335 13130 raft_consensus.cc:2468] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 1.
I20260709 13:19:13.433319 13322 raft_consensus.cc:359] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.434288 13322 raft_consensus.cc:385] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.433495 13242 leader_election.cc:304] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, b489b10f3a4e4265a5fcf5f934a97942; no voters: 
I20260709 13:19:13.434666 13322 raft_consensus.cc:740] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.435329 13348 raft_consensus.cc:2804] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:13.435819 13348 raft_consensus.cc:697] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Becoming Leader. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:13.436095 13322 consensus_queue.cc:260] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.436627 13319 tablet_bootstrap.cc:492] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba: No bootstrap required, opened a new log
I20260709 13:19:13.437974 13319 ts_tablet_manager.cc:1403] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.007s
I20260709 13:19:13.438321 13322 ts_tablet_manager.cc:1434] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260709 13:19:13.436688 13348 consensus_queue.cc:237] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.440886 13319 raft_consensus.cc:359] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.441673 13319 raft_consensus.cc:385] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.441988 13319 raft_consensus.cc:740] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76c489bb38b485fb100e70dd96ec2ba, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.442732 13319 consensus_queue.cc:260] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.445041 13319 ts_tablet_manager.cc:1434] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:19:13.449477 13025 catalog_manager.cc:5697] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131). New cstate: current_term: 1 leader_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.460762 13348 raft_consensus.cc:493] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.461267 13348 raft_consensus.cc:515] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.463160 13348 leader_election.cc:290] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:13.463873 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a91e9e594646b2928a917b544163e8" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba" is_pre_election: true
I20260709 13:19:13.464349 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a91e9e594646b2928a917b544163e8" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942" is_pre_election: true
I20260709 13:19:13.464635 13130 raft_consensus.cc:2468] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 0.
I20260709 13:19:13.465057 13205 raft_consensus.cc:2468] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 0.
I20260709 13:19:13.466297 13244 leader_election.cc:304] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, b489b10f3a4e4265a5fcf5f934a97942, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:13.467185 13348 raft_consensus.cc:2804] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:13.467518 13348 raft_consensus.cc:493] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.467813 13348 raft_consensus.cc:3060] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.469097 13354 raft_consensus.cc:493] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.469578 13354 raft_consensus.cc:515] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.472576 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e94b4a8b4f4edea04369f76f232b68" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba" is_pre_election: true
I20260709 13:19:13.472800 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e94b4a8b4f4edea04369f76f232b68" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" is_pre_election: true
I20260709 13:19:13.473305 13130 raft_consensus.cc:2468] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 0.
I20260709 13:19:13.472229 13354 leader_election.cc:290] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131:37279)
I20260709 13:19:13.473387 13277 raft_consensus.cc:2468] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 0.
I20260709 13:19:13.474730 13170 leader_election.cc:304] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b489b10f3a4e4265a5fcf5f934a97942, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:13.474989 13348 raft_consensus.cc:515] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.475638 13354 raft_consensus.cc:2804] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:13.476111 13354 raft_consensus.cc:493] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.476418 13354 raft_consensus.cc:3060] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.477216 13348 leader_election.cc:290] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:13.478461 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a91e9e594646b2928a917b544163e8" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
I20260709 13:19:13.478997 13130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a91e9e594646b2928a917b544163e8" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:13.479080 13205 raft_consensus.cc:3060] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.479684 13130 raft_consensus.cc:3060] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.484398 13205 raft_consensus.cc:2468] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 1.
I20260709 13:19:13.484203 13354 raft_consensus.cc:515] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.485502 13242 leader_election.cc:304] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, b489b10f3a4e4265a5fcf5f934a97942; no voters: 
I20260709 13:19:13.486248 13348 raft_consensus.cc:2804] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:13.486722 13348 raft_consensus.cc:697] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Becoming Leader. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:13.487331 13127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e94b4a8b4f4edea04369f76f232b68" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:13.487578 13348 consensus_queue.cc:237] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.487793 13130 raft_consensus.cc:2468] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 1.
I20260709 13:19:13.488025 13127 raft_consensus.cc:3060] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.488950 13354 leader_election.cc:290] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 1 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131:37279)
I20260709 13:19:13.490372 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e94b4a8b4f4edea04369f76f232b68" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
I20260709 13:19:13.491078 13277 raft_consensus.cc:3060] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.495431 13127 raft_consensus.cc:2468] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 1.
I20260709 13:19:13.496739 13025 catalog_manager.cc:5697] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131). New cstate: current_term: 1 leader_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.497821 13170 leader_election.cc:304] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b489b10f3a4e4265a5fcf5f934a97942, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:13.497916 13277 raft_consensus.cc:2468] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 1.
I20260709 13:19:13.498814 13354 raft_consensus.cc:2804] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:13.499435 13354 raft_consensus.cc:697] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 LEADER]: Becoming Leader. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Running, Role: LEADER
I20260709 13:19:13.500244 13354 consensus_queue.cc:237] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.510129 13025 catalog_manager.cc:5697] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 reported cstate change: term changed from 0 to 1, leader changed from <none> to b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "b489b10f3a4e4265a5fcf5f934a97942" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:13.579233 13354 consensus_queue.cc:1048] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:13.594660 13353 consensus_queue.cc:1048] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:13.630209 13353 consensus_queue.cc:1048] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:13.642670 13353 consensus_queue.cc:1048] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:13.713799 13348 raft_consensus.cc:493] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.714304 13348 raft_consensus.cc:515] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.716110 13348 leader_election.cc:290] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:13.717156 13205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d41d378d4e4e9cac7e8c42cee12675" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942" is_pre_election: true
I20260709 13:19:13.717187 13127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d41d378d4e4e9cac7e8c42cee12675" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba" is_pre_election: true
I20260709 13:19:13.717859 13205 raft_consensus.cc:2468] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 0.
I20260709 13:19:13.718083 13127 raft_consensus.cc:2468] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 0.
I20260709 13:19:13.718873 13242 leader_election.cc:304] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, b489b10f3a4e4265a5fcf5f934a97942; no voters: 
I20260709 13:19:13.719673 13348 raft_consensus.cc:2804] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:13.720058 13348 raft_consensus.cc:493] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.720345 13348 raft_consensus.cc:3060] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.725695 13348 raft_consensus.cc:515] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.727847 13348 leader_election.cc:290] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:13.728714 13127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d41d378d4e4e9cac7e8c42cee12675" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:13.729041 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d41d378d4e4e9cac7e8c42cee12675" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
I20260709 13:19:13.729403 13127 raft_consensus.cc:3060] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.729723 13204 raft_consensus.cc:3060] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.729446 13348 consensus_queue.cc:1048] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:13.737659 13127 raft_consensus.cc:2468] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 1.
I20260709 13:19:13.737953 13204 raft_consensus.cc:2468] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 1.
I20260709 13:19:13.739315 13244 leader_election.cc:304] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:13.740813 13351 raft_consensus.cc:2804] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:13.741400 13351 raft_consensus.cc:697] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Becoming Leader. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:13.742304 13351 consensus_queue.cc:237] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:13.747575 13351 consensus_queue.cc:1048] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:13.751509 13023 catalog_manager.cc:5697] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a reported cstate change: term changed from 0 to 1, leader changed from <none> to b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131). New cstate: current_term: 1 leader_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.768695 13351 consensus_queue.cc:1048] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:13.780424 13357 consensus_queue.cc:1048] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:13.783980 13357 consensus_queue.cc:1048] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:13.795307 13356 consensus_queue.cc:1048] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:13.800729 13356 consensus_queue.cc:1048] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:13.821480 13351 consensus_queue.cc:1048] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:13.842187 13351 consensus_queue.cc:1048] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:13.857280 13351 consensus_queue.cc:1048] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:13.869220  1934 ts_manager.cc:295] Set tserver state for f76c489bb38b485fb100e70dd96ec2ba to MAINTENANCE_MODE
I20260709 13:19:13.870101  1934 tablet_server.cc:179] TabletServer@127.1.227.129:0 shutting down...
I20260709 13:19:13.894511  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:13.895629  1934 tablet_replica.cc:333] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba: stopping tablet replica
I20260709 13:19:13.896314  1934 raft_consensus.cc:2243] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.896739  1934 raft_consensus.cc:2272] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.899019  1934 tablet_replica.cc:333] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba: stopping tablet replica
I20260709 13:19:13.899618  1934 raft_consensus.cc:2243] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.900067  1934 raft_consensus.cc:2272] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.902462  1934 tablet_replica.cc:333] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba: stopping tablet replica
I20260709 13:19:13.903028  1934 raft_consensus.cc:2243] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.903455  1934 raft_consensus.cc:2272] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.905841  1934 tablet_replica.cc:333] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba: stopping tablet replica
I20260709 13:19:13.906478  1934 raft_consensus.cc:2243] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.906898  1934 raft_consensus.cc:2272] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.908576  1934 tablet_replica.cc:333] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba: stopping tablet replica
I20260709 13:19:13.909103  1934 raft_consensus.cc:2243] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.909511  1934 raft_consensus.cc:2272] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.911909  1934 tablet_replica.cc:333] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba: stopping tablet replica
I20260709 13:19:13.912500  1934 raft_consensus.cc:2243] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.912899  1934 raft_consensus.cc:2272] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.914705  1934 tablet_replica.cc:333] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba: stopping tablet replica
I20260709 13:19:13.915248  1934 raft_consensus.cc:2243] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.915683  1934 raft_consensus.cc:2272] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.917923  1934 tablet_replica.cc:333] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba: stopping tablet replica
I20260709 13:19:13.918457  1934 raft_consensus.cc:2243] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.918874  1934 raft_consensus.cc:2272] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.921205  1934 tablet_replica.cc:333] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba: stopping tablet replica
I20260709 13:19:13.921716  1934 raft_consensus.cc:2243] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.922222  1934 raft_consensus.cc:2272] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.924502  1934 tablet_replica.cc:333] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba: stopping tablet replica
I20260709 13:19:13.925005  1934 raft_consensus.cc:2243] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.925419  1934 raft_consensus.cc:2272] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.956585  1934 tablet_server.cc:196] TabletServer@127.1.227.129:0 shutdown complete.
I20260709 13:19:14.018728 13351 consensus_queue.cc:1048] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:14.020908 13170 consensus_peers.cc:597] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:14.034969 13244 consensus_peers.cc:597] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:14.047336 13076 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:14.053112 13353 consensus_queue.cc:1048] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:14.067910 13170 consensus_peers.cc:597] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:14.186182 13244 consensus_peers.cc:597] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:14.188262 13244 consensus_peers.cc:597] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:14.217366 13170 consensus_peers.cc:597] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:14.249415 13244 consensus_peers.cc:597] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:14.288290 13358 consensus_queue.cc:1048] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:14.302417 13244 consensus_peers.cc:597] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:14.305946 13244 consensus_peers.cc:597] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:14.424857 13244 consensus_peers.cc:597] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:14.606701 13170 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111) [suppressed 192 similar messages]
W20260709 13:19:15.048647 13076 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:19:16.049686 13076 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:19:16.348920 13170 consensus_peers.cc:597] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.440119 13244 consensus_peers.cc:597] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.550935 13244 consensus_peers.cc:597] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.619436 13170 consensus_peers.cc:597] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.696693 13244 consensus_peers.cc:597] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.718158 13244 consensus_peers.cc:597] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.853847 13244 consensus_peers.cc:597] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.870081 13170 consensus_peers.cc:597] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.889518 13244 consensus_peers.cc:597] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:17.003173 13244 consensus_peers.cc:597] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:17.050715 13076 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:19:18.051867 13076 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:19:18.702885 13170 consensus_peers.cc:597] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:18.793030 13170 consensus_peers.cc:597] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:18.961833 13244 consensus_peers.cc:597] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:18.977563  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:18.984675 13412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:18.984748 13413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:18.986282 13415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:18.989094  1934 server_base.cc:1061] running on GCE node
I20260709 13:19:18.990603  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:18.990900  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:18.991127  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603158991099 us; error 0 us; skew 500 ppm
I20260709 13:19:18.991776  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:18.994374  1934 webserver.cc:533] Webserver started at http://127.1.227.129:34537/ using document root <none> and password file <none>
I20260709 13:19:18.994905  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:18.995123  1934 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:19:18.999341  1934 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:19:19.003415 13420 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:19.004326  1934 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:19:19.004673  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/ts-0-root
uuid: "f76c489bb38b485fb100e70dd96ec2ba"
format_stamp: "Formatted at 2026-07-09 13:19:12 on dist-test-slave-lfdf"
I20260709 13:19:19.005019  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602825662285-1934-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:19.025573  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:19.027223  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:19.029213  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:19.033994 13428 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:19:19.053334 13076 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:19:19.063751 13244 consensus_peers.cc:597] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:19.088268  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:19:19.088621  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.056s	user 0.003s	sys 0.000s
I20260709 13:19:19.088867  1934 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:19:19.093549 13428 tablet_bootstrap.cc:492] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap starting.
I20260709 13:19:19.107561 13428 tablet_bootstrap.cc:492] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:19.108438 13428 tablet_bootstrap.cc:492] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap complete.
I20260709 13:19:19.109095 13428 ts_tablet_manager.cc:1403] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:19:19.111785 13428 raft_consensus.cc:359] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.112489 13428 raft_consensus.cc:740] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76c489bb38b485fb100e70dd96ec2ba, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.113210 13428 consensus_queue.cc:260] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.115981 13428 ts_tablet_manager.cc:1434] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:19:19.116816 13428 tablet_bootstrap.cc:492] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap starting.
I20260709 13:19:19.131319 13428 tablet_bootstrap.cc:492] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:19.132186 13428 tablet_bootstrap.cc:492] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap complete.
I20260709 13:19:19.132884 13428 ts_tablet_manager.cc:1403] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:19:19.135394 13428 raft_consensus.cc:359] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } } peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } }
I20260709 13:19:19.136106 13428 raft_consensus.cc:740] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76c489bb38b485fb100e70dd96ec2ba, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.136680 13428 consensus_queue.cc:260] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } } peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } }
I20260709 13:19:19.138197 13428 ts_tablet_manager.cc:1434] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:19:19.138875 13428 tablet_bootstrap.cc:492] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap starting.
I20260709 13:19:19.142313  1934 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:19:19.142629  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.054s	user 0.053s	sys 0.000s
I20260709 13:19:19.149996 13428 tablet_bootstrap.cc:492] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:19.150861 13428 tablet_bootstrap.cc:492] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap complete.
I20260709 13:19:19.151449 13428 ts_tablet_manager.cc:1403] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:19:19.154078 13428 raft_consensus.cc:359] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.154829 13428 raft_consensus.cc:740] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76c489bb38b485fb100e70dd96ec2ba, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.155526 13428 consensus_queue.cc:260] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.157475 13428 ts_tablet_manager.cc:1434] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:19:19.158527 13428 tablet_bootstrap.cc:492] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap starting.
I20260709 13:19:19.169612 13428 tablet_bootstrap.cc:492] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:19.170472 13428 tablet_bootstrap.cc:492] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap complete.
I20260709 13:19:19.171205 13428 ts_tablet_manager.cc:1403] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:19:19.173588 13428 raft_consensus.cc:359] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.174358 13428 raft_consensus.cc:740] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76c489bb38b485fb100e70dd96ec2ba, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.175051 13428 consensus_queue.cc:260] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.176608 13428 ts_tablet_manager.cc:1434] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:19:19.177233 13428 tablet_bootstrap.cc:492] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap starting.
I20260709 13:19:19.188216 13428 tablet_bootstrap.cc:492] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:19.189086 13428 tablet_bootstrap.cc:492] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap complete.
I20260709 13:19:19.189826 13428 ts_tablet_manager.cc:1403] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:19:19.192142 13428 raft_consensus.cc:359] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.192795 13428 raft_consensus.cc:740] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76c489bb38b485fb100e70dd96ec2ba, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.193631 13428 consensus_queue.cc:260] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.195628 13428 ts_tablet_manager.cc:1434] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
W20260709 13:19:19.196053 13244 consensus_peers.cc:597] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:19.196491 13428 tablet_bootstrap.cc:492] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap starting.
I20260709 13:19:19.198522  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.129:39811
I20260709 13:19:19.198634 13490 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.129:39811 every 8 connection(s)
I20260709 13:19:19.202920  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:19.211036 13428 tablet_bootstrap.cc:492] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:19.212424 13428 tablet_bootstrap.cc:492] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap complete.
I20260709 13:19:19.213210 13428 ts_tablet_manager.cc:1403] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:19:19.216760 13428 raft_consensus.cc:359] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.217783 13428 raft_consensus.cc:740] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76c489bb38b485fb100e70dd96ec2ba, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.218928 13428 consensus_queue.cc:260] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.221975 13428 ts_tablet_manager.cc:1434] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:19:19.223124 13428 tablet_bootstrap.cc:492] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap starting.
I20260709 13:19:19.232991 13491 heartbeater.cc:344] Connected to a master server at 127.1.227.190:36593
I20260709 13:19:19.233501 13491 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:19.234485 13491 heartbeater.cc:507] Master 127.1.227.190:36593 requested a full tablet report, sending...
I20260709 13:19:19.236361 13277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72d41d378d4e4e9cac7e8c42cee12675"
dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
mode: GRACEFUL
new_leader_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
 from {username='slave'} at 127.0.0.1:36674
I20260709 13:19:19.237102 13277 raft_consensus.cc:606] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Received request to transfer leadership to TS b489b10f3a4e4265a5fcf5f934a97942
I20260709 13:19:19.239586 13428 tablet_bootstrap.cc:492] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:19.240322 13277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c08eb3df1f0748f792838c6295651f02"
dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
mode: GRACEFUL
new_leader_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
 from {username='slave'} at 127.0.0.1:36674
I20260709 13:19:19.240983 13277 raft_consensus.cc:606] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Received request to transfer leadership to TS b489b10f3a4e4265a5fcf5f934a97942
I20260709 13:19:19.242085 13428 tablet_bootstrap.cc:492] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap complete.
I20260709 13:19:19.242853 13428 ts_tablet_manager.cc:1403] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.006s
I20260709 13:19:19.244593 13277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cffd99ace5954094a63ebfb530b721c5"
dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
mode: GRACEFUL
new_leader_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
 from {username='slave'} at 127.0.0.1:36674
I20260709 13:19:19.245312 13277 raft_consensus.cc:606] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Received request to transfer leadership to TS b489b10f3a4e4265a5fcf5f934a97942
I20260709 13:19:19.245842 13028 ts_manager.cc:194] Re-registered known tserver with Master: f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811)
I20260709 13:19:19.245505 13428 raft_consensus.cc:359] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.246476 13428 raft_consensus.cc:740] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76c489bb38b485fb100e70dd96ec2ba, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.246719  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:19.247545  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:19.247370 13428 consensus_queue.cc:260] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.248304  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:19.249394 13428 ts_tablet_manager.cc:1434] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:19:19.250293 13428 tablet_bootstrap.cc:492] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap starting.
I20260709 13:19:19.259056 13426 raft_consensus.cc:993] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a: : Instructing follower b489b10f3a4e4265a5fcf5f934a97942 to start an election
I20260709 13:19:19.259586 13426 raft_consensus.cc:1081] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Signalling peer b489b10f3a4e4265a5fcf5f934a97942 to start an election
I20260709 13:19:19.263777 13204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c08eb3df1f0748f792838c6295651f02"
dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
 from {username='slave'} at 127.0.0.1:60196
I20260709 13:19:19.264679 13204 raft_consensus.cc:493] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:19.265169 13204 raft_consensus.cc:3060] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.276253 13028 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50736
I20260709 13:19:19.282393 13204 raft_consensus.cc:515] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.283182 13491 heartbeater.cc:499] Master 127.1.227.190:36593 was elected leader, sending a full tablet report...
I20260709 13:19:19.284785 13428 tablet_bootstrap.cc:492] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:19.286664 13428 tablet_bootstrap.cc:492] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap complete.
I20260709 13:19:19.287379 13428 ts_tablet_manager.cc:1403] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.016s
I20260709 13:19:19.288450 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c08eb3df1f0748f792838c6295651f02" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
W20260709 13:19:19.289822 13170 leader_election.cc:343] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:19.290337 13428 raft_consensus.cc:359] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.290740 13204 leader_election.cc:290] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 2 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131:37279)
I20260709 13:19:19.291109 13428 raft_consensus.cc:740] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76c489bb38b485fb100e70dd96ec2ba, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.291960 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c08eb3df1f0748f792838c6295651f02" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
I20260709 13:19:19.292618 13428 consensus_queue.cc:260] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.292665 13277 raft_consensus.cc:3055] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:19.293330 13277 raft_consensus.cc:740] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:19.294374 13428 ts_tablet_manager.cc:1434] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:19.294209 13277 consensus_queue.cc:260] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.295125 13428 tablet_bootstrap.cc:492] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap starting.
I20260709 13:19:19.295516 13277 raft_consensus.cc:3060] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.303246 13277 raft_consensus.cc:2468] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 2.
I20260709 13:19:19.304658 13168 leader_election.cc:304] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, b489b10f3a4e4265a5fcf5f934a97942; no voters: f76c489bb38b485fb100e70dd96ec2ba
I20260709 13:19:19.305572 13411 raft_consensus.cc:2804] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:19.306695 13411 raft_consensus.cc:697] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 LEADER]: Becoming Leader. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Running, Role: LEADER
I20260709 13:19:19.306859 13428 tablet_bootstrap.cc:492] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:19.307698 13411 consensus_queue.cc:237] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.308462 13428 tablet_bootstrap.cc:492] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap complete.
I20260709 13:19:19.309134 13428 ts_tablet_manager.cc:1403] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:19:19.311617 13428 raft_consensus.cc:359] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.312548 13428 raft_consensus.cc:740] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76c489bb38b485fb100e70dd96ec2ba, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.313489 13428 consensus_queue.cc:260] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.316095 13428 ts_tablet_manager.cc:1434] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:19.317018 13428 tablet_bootstrap.cc:492] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap starting.
I20260709 13:19:19.320379 13028 catalog_manager.cc:5697] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 reported cstate change: term changed from 1 to 2, leader changed from b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131) to b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130). New cstate: current_term: 2 leader_uuid: "b489b10f3a4e4265a5fcf5f934a97942" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.341699 13428 tablet_bootstrap.cc:492] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:19.343079 13428 tablet_bootstrap.cc:492] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba: Bootstrap complete.
I20260709 13:19:19.344019 13428 ts_tablet_manager.cc:1403] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba: Time spent bootstrapping tablet: real 0.027s	user 0.023s	sys 0.003s
I20260709 13:19:19.346675 13428 raft_consensus.cc:359] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.389850 13428 raft_consensus.cc:740] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76c489bb38b485fb100e70dd96ec2ba, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.391683 13428 consensus_queue.cc:260] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.398751 13428 ts_tablet_manager.cc:1434] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.007s
I20260709 13:19:19.433353 13426 raft_consensus.cc:993] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a: : Instructing follower b489b10f3a4e4265a5fcf5f934a97942 to start an election
I20260709 13:19:19.434393 13410 raft_consensus.cc:1081] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Signalling peer b489b10f3a4e4265a5fcf5f934a97942 to start an election
I20260709 13:19:19.436708 13204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72d41d378d4e4e9cac7e8c42cee12675"
dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
 from {username='slave'} at 127.0.0.1:60196
I20260709 13:19:19.437320 13204 raft_consensus.cc:493] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:19.437721 13204 raft_consensus.cc:3060] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.448056 13204 raft_consensus.cc:515] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.449930 13204 leader_election.cc:290] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 2 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131:37279)
I20260709 13:19:19.451445 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d41d378d4e4e9cac7e8c42cee12675" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:19.452279 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d41d378d4e4e9cac7e8c42cee12675" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
I20260709 13:19:19.453045 13465 raft_consensus.cc:3060] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.453302 13277 raft_consensus.cc:3055] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:19.453781 13277 raft_consensus.cc:740] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:19.455603 13277 consensus_queue.cc:260] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.459139 13277 raft_consensus.cc:3060] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.467037 13465 raft_consensus.cc:2468] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 2.
I20260709 13:19:19.468907 13170 leader_election.cc:304] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b489b10f3a4e4265a5fcf5f934a97942, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:19.470455 13411 raft_consensus.cc:2804] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:19.470948 13411 raft_consensus.cc:697] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 LEADER]: Becoming Leader. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Running, Role: LEADER
I20260709 13:19:19.472023 13411 consensus_queue.cc:237] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.472584 13277 raft_consensus.cc:2468] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 2.
I20260709 13:19:19.481344 13025 catalog_manager.cc:5697] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 reported cstate change: term changed from 1 to 2, leader changed from b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131) to b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130). New cstate: current_term: 2 leader_uuid: "b489b10f3a4e4265a5fcf5f934a97942" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.680615 13426 raft_consensus.cc:993] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a: : Instructing follower b489b10f3a4e4265a5fcf5f934a97942 to start an election
I20260709 13:19:19.681255 13410 raft_consensus.cc:1081] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Signalling peer b489b10f3a4e4265a5fcf5f934a97942 to start an election
I20260709 13:19:19.683146 13204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cffd99ace5954094a63ebfb530b721c5"
dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
 from {username='slave'} at 127.0.0.1:60196
I20260709 13:19:19.683702 13204 raft_consensus.cc:493] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:19.684055 13204 raft_consensus.cc:3060] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.692188 13204 raft_consensus.cc:515] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.693935 13204 leader_election.cc:290] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 2 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131:37279)
I20260709 13:19:19.695081 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffd99ace5954094a63ebfb530b721c5" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
I20260709 13:19:19.695349 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffd99ace5954094a63ebfb530b721c5" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:19.695837 13277 raft_consensus.cc:3055] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:19.695987 13465 raft_consensus.cc:3060] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.696247 13277 raft_consensus.cc:740] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:19.697523 13277 consensus_queue.cc:260] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.699198 13277 raft_consensus.cc:3060] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.705163 13465 raft_consensus.cc:2468] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 2.
I20260709 13:19:19.706780 13170 leader_election.cc:304] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b489b10f3a4e4265a5fcf5f934a97942, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:19.707710 13411 raft_consensus.cc:2804] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:19.707927 13277 raft_consensus.cc:2468] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 2.
I20260709 13:19:19.708205 13411 raft_consensus.cc:697] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 LEADER]: Becoming Leader. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Running, Role: LEADER
I20260709 13:19:19.709343 13411 consensus_queue.cc:237] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:19.717240 13025 catalog_manager.cc:5697] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 reported cstate change: term changed from 1 to 2, leader changed from b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131) to b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130). New cstate: current_term: 2 leader_uuid: "b489b10f3a4e4265a5fcf5f934a97942" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.719074 13277 raft_consensus.cc:1275] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Refusing update from remote peer b489b10f3a4e4265a5fcf5f934a97942: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.720453 13411 consensus_queue.cc:1048] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:19.737627 13465 raft_consensus.cc:3060] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.746985 13465 raft_consensus.cc:1275] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Refusing update from remote peer b489b10f3a4e4265a5fcf5f934a97942: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.748663 13411 consensus_queue.cc:1048] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:20.000483 13465 raft_consensus.cc:1275] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Refusing update from remote peer b489b10f3a4e4265a5fcf5f934a97942: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:20.002002 13411 consensus_queue.cc:1048] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:20.012754 13277 raft_consensus.cc:1275] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Refusing update from remote peer b489b10f3a4e4265a5fcf5f934a97942: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:20.014925 13521 consensus_queue.cc:1048] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:19:20.054682 13076 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:20.236745 13277 raft_consensus.cc:1275] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Refusing update from remote peer b489b10f3a4e4265a5fcf5f934a97942: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:20.238673 13521 consensus_queue.cc:1048] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:20.249758 13465 raft_consensus.cc:1275] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Refusing update from remote peer b489b10f3a4e4265a5fcf5f934a97942: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:20.252103 13411 consensus_queue.cc:1048] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:20.270062  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:20.290482 13204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4263c3a1402d4df68c269f6f96a72eed"
dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
mode: GRACEFUL
new_leader_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
 from {username='slave'} at 127.0.0.1:56696
I20260709 13:19:20.291198 13204 raft_consensus.cc:606] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 1 LEADER]: Received request to transfer leadership to TS b3b320ba0cd44ab68a007567b6d07c1a
I20260709 13:19:20.294086 13204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67065f76534041668d4e55a15e7bd8e5"
dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
mode: GRACEFUL
new_leader_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
 from {username='slave'} at 127.0.0.1:56696
I20260709 13:19:20.294585 13204 raft_consensus.cc:606] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 LEADER]: Received request to transfer leadership to TS b3b320ba0cd44ab68a007567b6d07c1a
I20260709 13:19:20.295658  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:19:20.296305  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:20.297094  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:20.523205 13411 raft_consensus.cc:993] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942: : Instructing follower b3b320ba0cd44ab68a007567b6d07c1a to start an election
I20260709 13:19:20.523808 13526 raft_consensus.cc:1081] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 1 LEADER]: Signalling peer b3b320ba0cd44ab68a007567b6d07c1a to start an election
I20260709 13:19:20.525419 13277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4263c3a1402d4df68c269f6f96a72eed"
dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
 from {username='slave'} at 127.0.0.1:49224
I20260709 13:19:20.525939 13277 raft_consensus.cc:493] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:20.526257 13277 raft_consensus.cc:3060] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.532704 13277 raft_consensus.cc:515] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:20.534912 13277 leader_election.cc:290] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 2 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:20.535583 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263c3a1402d4df68c269f6f96a72eed" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:20.536477 13465 raft_consensus.cc:3060] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.536497 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263c3a1402d4df68c269f6f96a72eed" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
I20260709 13:19:20.537452 13204 raft_consensus.cc:3055] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:20.537791 13204 raft_consensus.cc:740] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Running, Role: LEADER
I20260709 13:19:20.538615 13204 consensus_queue.cc:260] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:20.539721 13204 raft_consensus.cc:3060] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.542413 13465 raft_consensus.cc:2468] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 2.
I20260709 13:19:20.543740 13244 leader_election.cc:304] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:20.544625 13524 raft_consensus.cc:2804] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:20.545063 13524 raft_consensus.cc:697] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 2 LEADER]: Becoming Leader. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:20.545972 13204 raft_consensus.cc:2468] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 2.
I20260709 13:19:20.546094 13524 consensus_queue.cc:237] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:20.554864 13025 catalog_manager.cc:5697] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a reported cstate change: term changed from 1 to 2, leader changed from b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130) to b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131). New cstate: current_term: 2 leader_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:20.648348 13411 raft_consensus.cc:993] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942: : Instructing follower b3b320ba0cd44ab68a007567b6d07c1a to start an election
I20260709 13:19:20.648804 13411 raft_consensus.cc:1081] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 LEADER]: Signalling peer b3b320ba0cd44ab68a007567b6d07c1a to start an election
I20260709 13:19:20.650485 13277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67065f76534041668d4e55a15e7bd8e5"
dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
 from {username='slave'} at 127.0.0.1:49224
I20260709 13:19:20.651175 13277 raft_consensus.cc:493] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:20.651623 13277 raft_consensus.cc:3060] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.657296 13277 raft_consensus.cc:515] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } } peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } }
I20260709 13:19:20.659442 13277 leader_election.cc:290] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 2 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:20.660086 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67065f76534041668d4e55a15e7bd8e5" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:20.660609 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67065f76534041668d4e55a15e7bd8e5" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
I20260709 13:19:20.660782 13465 raft_consensus.cc:3060] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.661227 13204 raft_consensus.cc:3055] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:20.661556 13204 raft_consensus.cc:740] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Running, Role: LEADER
I20260709 13:19:20.662660 13204 consensus_queue.cc:260] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } } peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } }
I20260709 13:19:20.663838 13204 raft_consensus.cc:3060] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.667241 13465 raft_consensus.cc:2468] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 2.
I20260709 13:19:20.668494 13244 leader_election.cc:304] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:20.669265 13524 raft_consensus.cc:2804] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:20.670035 13524 raft_consensus.cc:697] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 LEADER]: Becoming Leader. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:20.670310 13204 raft_consensus.cc:2468] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 2.
I20260709 13:19:20.671519 13524 consensus_queue.cc:237] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } } peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } }
I20260709 13:19:20.679077 13025 catalog_manager.cc:5697] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a reported cstate change: term changed from 1 to 2, leader changed from b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130) to b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131). New cstate: current_term: 2 leader_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:20.948031 13465 raft_consensus.cc:1275] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Refusing update from remote peer b3b320ba0cd44ab68a007567b6d07c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:20.949433 13524 consensus_queue.cc:1048] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:20.961437 13204 raft_consensus.cc:1275] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Refusing update from remote peer b3b320ba0cd44ab68a007567b6d07c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:20.964329 13522 consensus_queue.cc:1048] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:19:21.055946 13076 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:21.075186 13465 raft_consensus.cc:1275] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Refusing update from remote peer b3b320ba0cd44ab68a007567b6d07c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:21.076936 13538 consensus_queue.cc:1048] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:21.088762 13204 raft_consensus.cc:1275] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Refusing update from remote peer b3b320ba0cd44ab68a007567b6d07c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:21.090999 13522 consensus_queue.cc:1048] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:21.303361  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:21.311681 13276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30a91e9e594646b2928a917b544163e8"
dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
mode: GRACEFUL
new_leader_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
 from {username='slave'} at 127.0.0.1:36674
I20260709 13:19:21.312427 13276 raft_consensus.cc:606] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Received request to transfer leadership to TS b489b10f3a4e4265a5fcf5f934a97942
I20260709 13:19:21.315622 13276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4263c3a1402d4df68c269f6f96a72eed"
dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
mode: GRACEFUL
new_leader_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
 from {username='slave'} at 127.0.0.1:36674
I20260709 13:19:21.316288 13276 raft_consensus.cc:606] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 2 LEADER]: Received request to transfer leadership to TS b489b10f3a4e4265a5fcf5f934a97942
I20260709 13:19:21.319105 13204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cffd99ace5954094a63ebfb530b721c5"
dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
mode: GRACEFUL
new_leader_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
 from {username='slave'} at 127.0.0.1:56696
I20260709 13:19:21.319607 13204 raft_consensus.cc:606] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 LEADER]: Received request to transfer leadership to TS b3b320ba0cd44ab68a007567b6d07c1a
I20260709 13:19:21.321053  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:21.321586  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:21.322216  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:21.368883 13524 raft_consensus.cc:993] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a: : Instructing follower b489b10f3a4e4265a5fcf5f934a97942 to start an election
I20260709 13:19:21.369639 13522 raft_consensus.cc:1081] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Signalling peer b489b10f3a4e4265a5fcf5f934a97942 to start an election
I20260709 13:19:21.371546 13204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30a91e9e594646b2928a917b544163e8"
dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
 from {username='slave'} at 127.0.0.1:60196
I20260709 13:19:21.372236 13204 raft_consensus.cc:493] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:21.372740 13204 raft_consensus.cc:3060] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:21.378787 13204 raft_consensus.cc:515] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:21.380520 13204 leader_election.cc:290] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 2 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131:37279)
I20260709 13:19:21.381713 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a91e9e594646b2928a917b544163e8" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:21.382344 13464 raft_consensus.cc:3060] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:21.382215 13276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a91e9e594646b2928a917b544163e8" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
I20260709 13:19:21.382862 13276 raft_consensus.cc:3055] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:21.383158 13276 raft_consensus.cc:740] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:21.384012 13276 consensus_queue.cc:260] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:21.385201 13276 raft_consensus.cc:3060] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:21.388890 13464 raft_consensus.cc:2468] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 2.
I20260709 13:19:21.390163 13170 leader_election.cc:304] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b489b10f3a4e4265a5fcf5f934a97942, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:21.391196 13411 raft_consensus.cc:2804] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:21.391688 13411 raft_consensus.cc:697] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 LEADER]: Becoming Leader. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Running, Role: LEADER
I20260709 13:19:21.392423 13276 raft_consensus.cc:2468] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 2.
I20260709 13:19:21.392691 13411 consensus_queue.cc:237] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:21.400098 13028 catalog_manager.cc:5697] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 reported cstate change: term changed from 1 to 2, leader changed from b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131) to b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130). New cstate: current_term: 2 leader_uuid: "b489b10f3a4e4265a5fcf5f934a97942" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:21.494282 13524 raft_consensus.cc:993] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a: : Instructing follower b489b10f3a4e4265a5fcf5f934a97942 to start an election
I20260709 13:19:21.494788 13524 raft_consensus.cc:1081] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 2 LEADER]: Signalling peer b489b10f3a4e4265a5fcf5f934a97942 to start an election
I20260709 13:19:21.496392 13204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4263c3a1402d4df68c269f6f96a72eed"
dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
 from {username='slave'} at 127.0.0.1:60196
I20260709 13:19:21.496886 13204 raft_consensus.cc:493] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:21.497186 13204 raft_consensus.cc:3060] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:21.502516 13204 raft_consensus.cc:515] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:21.504218 13204 leader_election.cc:290] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 3 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131:37279)
I20260709 13:19:21.505296 13276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263c3a1402d4df68c269f6f96a72eed" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
I20260709 13:19:21.505301 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263c3a1402d4df68c269f6f96a72eed" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:21.506172 13276 raft_consensus.cc:3055] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:21.506196 13464 raft_consensus.cc:3060] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:21.506711 13276 raft_consensus.cc:740] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:21.507629 13276 consensus_queue.cc:260] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:21.508924 13276 raft_consensus.cc:3060] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:21.514688 13464 raft_consensus.cc:2468] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 3.
I20260709 13:19:21.516141 13170 leader_election.cc:304] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b489b10f3a4e4265a5fcf5f934a97942, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:21.516809 13276 raft_consensus.cc:2468] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 3.
I20260709 13:19:21.517031 13411 raft_consensus.cc:2804] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:21.517665 13411 raft_consensus.cc:697] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 3 LEADER]: Becoming Leader. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Running, Role: LEADER
I20260709 13:19:21.518503 13411 consensus_queue.cc:237] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:21.524221 13028 catalog_manager.cc:5697] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 reported cstate change: term changed from 2 to 3, leader changed from b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131) to b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130). New cstate: current_term: 3 leader_uuid: "b489b10f3a4e4265a5fcf5f934a97942" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:21.685420 13411 raft_consensus.cc:993] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942: : Instructing follower b3b320ba0cd44ab68a007567b6d07c1a to start an election
I20260709 13:19:21.686012 13548 raft_consensus.cc:1081] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 LEADER]: Signalling peer b3b320ba0cd44ab68a007567b6d07c1a to start an election
I20260709 13:19:21.687693 13277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cffd99ace5954094a63ebfb530b721c5"
dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
 from {username='slave'} at 127.0.0.1:49224
I20260709 13:19:21.688187 13277 raft_consensus.cc:493] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:21.688468 13277 raft_consensus.cc:3060] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:21.693439 13277 raft_consensus.cc:515] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:21.695431 13277 leader_election.cc:290] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 3 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:21.695950 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffd99ace5954094a63ebfb530b721c5" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:21.696612 13464 raft_consensus.cc:3060] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:21.696477 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cffd99ace5954094a63ebfb530b721c5" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
I20260709 13:19:21.697221 13204 raft_consensus.cc:3055] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:21.697543 13204 raft_consensus.cc:740] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Running, Role: LEADER
I20260709 13:19:21.698328 13204 consensus_queue.cc:260] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:21.699556 13204 raft_consensus.cc:3060] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:21.704203 13464 raft_consensus.cc:2468] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 3.
I20260709 13:19:21.705425 13244 leader_election.cc:304] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:21.706172 13204 raft_consensus.cc:2468] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 3.
I20260709 13:19:21.706233 13524 raft_consensus.cc:2804] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:21.707056 13524 raft_consensus.cc:697] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 3 LEADER]: Becoming Leader. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:21.707932 13524 consensus_queue.cc:237] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:21.716284 13028 catalog_manager.cc:5697] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a reported cstate change: term changed from 2 to 3, leader changed from b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130) to b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131). New cstate: current_term: 3 leader_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:21.791384 13277 raft_consensus.cc:1275] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Refusing update from remote peer b489b10f3a4e4265a5fcf5f934a97942: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:21.792722 13548 consensus_queue.cc:1048] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:21.803083 13464 raft_consensus.cc:1275] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Refusing update from remote peer b489b10f3a4e4265a5fcf5f934a97942: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:21.804883 13548 consensus_queue.cc:1048] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:21.974349 13277 raft_consensus.cc:1275] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 3 FOLLOWER]: Refusing update from remote peer b489b10f3a4e4265a5fcf5f934a97942: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:21.975802 13548 consensus_queue.cc:1048] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:21.986123 13464 raft_consensus.cc:1275] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 3 FOLLOWER]: Refusing update from remote peer b489b10f3a4e4265a5fcf5f934a97942: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:21.987722 13548 consensus_queue.cc:1048] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:19:22.057049 13076 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:22.159063 13464 raft_consensus.cc:1275] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba [term 3 FOLLOWER]: Refusing update from remote peer b3b320ba0cd44ab68a007567b6d07c1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:22.160585 13524 consensus_queue.cc:1048] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:22.170068 13204 raft_consensus.cc:1275] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [term 3 FOLLOWER]: Refusing update from remote peer b3b320ba0cd44ab68a007567b6d07c1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:22.171885 13559 consensus_queue.cc:1048] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:22.328790  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:22.336818 13204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4263c3a1402d4df68c269f6f96a72eed"
dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
mode: GRACEFUL
new_leader_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
 from {username='slave'} at 127.0.0.1:56696
I20260709 13:19:22.337361 13204 raft_consensus.cc:606] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 3 LEADER]: Received request to transfer leadership to TS b3b320ba0cd44ab68a007567b6d07c1a
I20260709 13:19:22.339784 13204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48e94b4a8b4f4edea04369f76f232b68"
dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
mode: GRACEFUL
new_leader_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
 from {username='slave'} at 127.0.0.1:56696
I20260709 13:19:22.340236 13204 raft_consensus.cc:606] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 LEADER]: Received request to transfer leadership to TS b3b320ba0cd44ab68a007567b6d07c1a
I20260709 13:19:22.342763 13277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5f01ac121ea4e64b795c9abee9b3685"
dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
mode: GRACEFUL
new_leader_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
 from {username='slave'} at 127.0.0.1:36674
I20260709 13:19:22.343245 13277 raft_consensus.cc:606] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Received request to transfer leadership to TS b489b10f3a4e4265a5fcf5f934a97942
I20260709 13:19:22.344522  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:22.345085  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:22.345682  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:22.379226 13411 raft_consensus.cc:993] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942: : Instructing follower b3b320ba0cd44ab68a007567b6d07c1a to start an election
I20260709 13:19:22.379868 13548 raft_consensus.cc:1081] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 3 LEADER]: Signalling peer b3b320ba0cd44ab68a007567b6d07c1a to start an election
I20260709 13:19:22.381304 13277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4263c3a1402d4df68c269f6f96a72eed"
dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
 from {username='slave'} at 127.0.0.1:49224
I20260709 13:19:22.381898 13277 raft_consensus.cc:493] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:22.382206 13277 raft_consensus.cc:3060] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:22.387159 13277 raft_consensus.cc:515] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:22.388938 13277 leader_election.cc:290] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 4 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:22.389935 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263c3a1402d4df68c269f6f96a72eed" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
I20260709 13:19:22.389881 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263c3a1402d4df68c269f6f96a72eed" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:22.390640 13204 raft_consensus.cc:3055] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:22.390733 13464 raft_consensus.cc:3060] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:22.390940 13204 raft_consensus.cc:740] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Running, Role: LEADER
I20260709 13:19:22.391772 13204 consensus_queue.cc:260] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:22.392642 13204 raft_consensus.cc:3060] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:22.396881 13464 raft_consensus.cc:2468] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 4.
I20260709 13:19:22.396927 13204 raft_consensus.cc:2468] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 4.
I20260709 13:19:22.398126 13244 leader_election.cc:304] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:22.398933 13522 raft_consensus.cc:2804] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:22.399296 13522 raft_consensus.cc:697] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 4 LEADER]: Becoming Leader. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:22.400004 13522 consensus_queue.cc:237] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:22.406704 13025 catalog_manager.cc:5697] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a reported cstate change: term changed from 3 to 4, leader changed from b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130) to b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131). New cstate: current_term: 4 leader_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:22.727226 13548 raft_consensus.cc:993] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942: : Instructing follower b3b320ba0cd44ab68a007567b6d07c1a to start an election
I20260709 13:19:22.727749 13526 raft_consensus.cc:1081] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 LEADER]: Signalling peer b3b320ba0cd44ab68a007567b6d07c1a to start an election
I20260709 13:19:22.729367 13277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48e94b4a8b4f4edea04369f76f232b68"
dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
 from {username='slave'} at 127.0.0.1:49224
I20260709 13:19:22.729877 13277 raft_consensus.cc:493] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:22.730194 13277 raft_consensus.cc:3060] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:22.735167 13277 raft_consensus.cc:515] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:22.736752 13277 leader_election.cc:290] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 2 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:22.737716 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e94b4a8b4f4edea04369f76f232b68" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:22.738220 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e94b4a8b4f4edea04369f76f232b68" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
I20260709 13:19:22.738541 13464 raft_consensus.cc:3060] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:22.738889 13204 raft_consensus.cc:3055] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:22.739454 13204 raft_consensus.cc:740] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Running, Role: LEADER
I20260709 13:19:22.740237 13204 consensus_queue.cc:260] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:22.741189 13204 raft_consensus.cc:3060] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:22.745102 13464 raft_consensus.cc:2468] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 2.
I20260709 13:19:22.745896 13204 raft_consensus.cc:2468] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 2.
I20260709 13:19:22.746483 13244 leader_election.cc:304] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:22.747393 13522 raft_consensus.cc:2804] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:22.747826 13522 raft_consensus.cc:697] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 LEADER]: Becoming Leader. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:22.748628 13522 consensus_queue.cc:237] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:22.756775 13025 catalog_manager.cc:5697] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a reported cstate change: term changed from 1 to 2, leader changed from b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130) to b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131). New cstate: current_term: 2 leader_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:22.803797 13524 raft_consensus.cc:993] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a: : Instructing follower b489b10f3a4e4265a5fcf5f934a97942 to start an election
I20260709 13:19:22.804369 13522 raft_consensus.cc:1081] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Signalling peer b489b10f3a4e4265a5fcf5f934a97942 to start an election
I20260709 13:19:22.806133 13204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5f01ac121ea4e64b795c9abee9b3685"
dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
 from {username='slave'} at 127.0.0.1:60196
I20260709 13:19:22.806613 13204 raft_consensus.cc:493] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:22.806919 13204 raft_consensus.cc:3060] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:22.811576 13204 raft_consensus.cc:515] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:22.813489 13204 leader_election.cc:290] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 2 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131:37279)
I20260709 13:19:22.814401 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f01ac121ea4e64b795c9abee9b3685" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:22.814631 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f01ac121ea4e64b795c9abee9b3685" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
I20260709 13:19:22.815200 13464 raft_consensus.cc:3060] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:22.815320 13277 raft_consensus.cc:3055] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:22.815716 13277 raft_consensus.cc:740] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:22.816406 13277 consensus_queue.cc:260] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:22.817378 13277 raft_consensus.cc:3060] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:22.820947 13464 raft_consensus.cc:2468] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 2.
I20260709 13:19:22.822343 13277 raft_consensus.cc:2468] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 2.
I20260709 13:19:22.822296 13170 leader_election.cc:304] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b489b10f3a4e4265a5fcf5f934a97942, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:22.823421 13526 raft_consensus.cc:2804] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:22.824028 13526 raft_consensus.cc:697] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 LEADER]: Becoming Leader. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Running, Role: LEADER
I20260709 13:19:22.824819 13526 consensus_queue.cc:237] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:22.835935 13025 catalog_manager.cc:5697] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 reported cstate change: term changed from 1 to 2, leader changed from b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131) to b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130). New cstate: current_term: 2 leader_uuid: "b489b10f3a4e4265a5fcf5f934a97942" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:22.894479 13204 raft_consensus.cc:1275] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 4 FOLLOWER]: Refusing update from remote peer b3b320ba0cd44ab68a007567b6d07c1a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:22.895831 13522 consensus_queue.cc:1048] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:22.901347 13464 raft_consensus.cc:1275] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 4 FOLLOWER]: Refusing update from remote peer b3b320ba0cd44ab68a007567b6d07c1a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:22.903579 13522 consensus_queue.cc:1048] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:19:23.058202 13076 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:23.321897 13204 raft_consensus.cc:1275] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Refusing update from remote peer b3b320ba0cd44ab68a007567b6d07c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:23.323275 13524 consensus_queue.cc:1048] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:23.336018 13465 raft_consensus.cc:1275] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Refusing update from remote peer b3b320ba0cd44ab68a007567b6d07c1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:23.337584 13571 consensus_queue.cc:1048] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:19:23.352308  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:23.361001 13277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27466eac5d12402c9c072b968099f41c"
dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
mode: GRACEFUL
new_leader_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
 from {username='slave'} at 127.0.0.1:36674
I20260709 13:19:23.361704 13277 raft_consensus.cc:606] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Received request to transfer leadership to TS b489b10f3a4e4265a5fcf5f934a97942
I20260709 13:19:23.364574 13277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4263c3a1402d4df68c269f6f96a72eed"
dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
mode: GRACEFUL
new_leader_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
 from {username='slave'} at 127.0.0.1:36674
I20260709 13:19:23.365068 13277 raft_consensus.cc:606] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 4 LEADER]: Received request to transfer leadership to TS b489b10f3a4e4265a5fcf5f934a97942
I20260709 13:19:23.367821 13204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5f01ac121ea4e64b795c9abee9b3685"
dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
mode: GRACEFUL
new_leader_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
 from {username='slave'} at 127.0.0.1:56696
I20260709 13:19:23.368353 13204 raft_consensus.cc:606] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 LEADER]: Received request to transfer leadership to TS b3b320ba0cd44ab68a007567b6d07c1a
I20260709 13:19:23.369392 13277 raft_consensus.cc:1275] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Refusing update from remote peer b489b10f3a4e4265a5fcf5f934a97942: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:23.369894  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:23.370568  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:23.371244  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:23.371097 13526 consensus_queue.cc:1048] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:23.377775 13548 raft_consensus.cc:993] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942: : Instructing follower b3b320ba0cd44ab68a007567b6d07c1a to start an election
I20260709 13:19:23.378619 13526 raft_consensus.cc:1081] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 LEADER]: Signalling peer b3b320ba0cd44ab68a007567b6d07c1a to start an election
I20260709 13:19:23.381716 13276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5f01ac121ea4e64b795c9abee9b3685"
dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
 from {username='slave'} at 127.0.0.1:49224
I20260709 13:19:23.382356 13276 raft_consensus.cc:493] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:23.382732 13276 raft_consensus.cc:3060] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:23.382786 13465 raft_consensus.cc:1275] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Refusing update from remote peer b489b10f3a4e4265a5fcf5f934a97942: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:23.384661 13526 consensus_queue.cc:1048] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:23.390062 13276 raft_consensus.cc:515] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:23.392486 13276 leader_election.cc:290] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 3 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441)
I20260709 13:19:23.393456 13277 raft_consensus.cc:1240] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 3 FOLLOWER]: Rejecting Update request from peer b489b10f3a4e4265a5fcf5f934a97942 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:23.394220 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f01ac121ea4e64b795c9abee9b3685" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:23.393419 13204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f01ac121ea4e64b795c9abee9b3685" candidate_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
I20260709 13:19:23.394955 13465 raft_consensus.cc:3060] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:23.394963 13204 raft_consensus.cc:3055] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:23.395545 13204 raft_consensus.cc:740] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Running, Role: LEADER
I20260709 13:19:23.396423 13204 consensus_queue.cc:260] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:23.397514 13204 raft_consensus.cc:3060] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:23.401221 13465 raft_consensus.cc:2468] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 3.
I20260709 13:19:23.402420 13244 leader_election.cc:304] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3b320ba0cd44ab68a007567b6d07c1a, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:23.402944 13204 raft_consensus.cc:2468] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b320ba0cd44ab68a007567b6d07c1a in term 3.
I20260709 13:19:23.403173 13571 raft_consensus.cc:2804] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:23.403817 13571 raft_consensus.cc:697] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 3 LEADER]: Becoming Leader. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:23.404598 13571 consensus_queue.cc:237] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:23.412353 13025 catalog_manager.cc:5697] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a reported cstate change: term changed from 2 to 3, leader changed from b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130) to b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131). New cstate: current_term: 3 leader_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:23.450178 13522 raft_consensus.cc:993] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a: : Instructing follower b489b10f3a4e4265a5fcf5f934a97942 to start an election
I20260709 13:19:23.450664 13571 raft_consensus.cc:1081] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Signalling peer b489b10f3a4e4265a5fcf5f934a97942 to start an election
I20260709 13:19:23.452546 13204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27466eac5d12402c9c072b968099f41c"
dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
 from {username='slave'} at 127.0.0.1:60196
I20260709 13:19:23.453087 13204 raft_consensus.cc:493] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:23.453404 13204 raft_consensus.cc:3060] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:23.458011 13204 raft_consensus.cc:515] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:23.459545 13204 leader_election.cc:290] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 2 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131:37279)
I20260709 13:19:23.460577 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27466eac5d12402c9c072b968099f41c" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:23.460592 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27466eac5d12402c9c072b968099f41c" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
I20260709 13:19:23.461297 13465 raft_consensus.cc:3060] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:23.461448 13277 raft_consensus.cc:3055] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:23.461939 13277 raft_consensus.cc:740] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:23.462706 13277 consensus_queue.cc:260] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:23.463918 13277 raft_consensus.cc:3060] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:23.467195 13465 raft_consensus.cc:2468] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 2.
I20260709 13:19:23.468744 13170 leader_election.cc:304] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b489b10f3a4e4265a5fcf5f934a97942, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:23.469537 13277 raft_consensus.cc:2468] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 2.
I20260709 13:19:23.469614 13526 raft_consensus.cc:2804] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:23.470309 13526 raft_consensus.cc:697] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 [term 2 LEADER]: Becoming Leader. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Running, Role: LEADER
I20260709 13:19:23.471211 13526 consensus_queue.cc:237] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:23.479228 13025 catalog_manager.cc:5697] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 reported cstate change: term changed from 1 to 2, leader changed from b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131) to b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130). New cstate: current_term: 2 leader_uuid: "b489b10f3a4e4265a5fcf5f934a97942" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:23.845670 13465 raft_consensus.cc:1275] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba [term 3 FOLLOWER]: Refusing update from remote peer b3b320ba0cd44ab68a007567b6d07c1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:23.847153 13522 consensus_queue.cc:1048] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:23.857542 13205 raft_consensus.cc:1275] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [term 3 FOLLOWER]: Refusing update from remote peer b3b320ba0cd44ab68a007567b6d07c1a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:23.859021 13571 consensus_queue.cc:1048] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:23.867556 13522 raft_consensus.cc:993] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a: : Instructing follower b489b10f3a4e4265a5fcf5f934a97942 to start an election
I20260709 13:19:23.868139 13524 raft_consensus.cc:1081] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 4 LEADER]: Signalling peer b489b10f3a4e4265a5fcf5f934a97942 to start an election
I20260709 13:19:23.869702 13205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4263c3a1402d4df68c269f6f96a72eed"
dest_uuid: "b489b10f3a4e4265a5fcf5f934a97942"
 from {username='slave'} at 127.0.0.1:60196
I20260709 13:19:23.870314 13205 raft_consensus.cc:493] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:23.870689 13205 raft_consensus.cc:3060] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:23.877964 13205 raft_consensus.cc:515] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:23.879990 13205 leader_election.cc:290] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 5 election: Requested vote from peers f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811), b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131:37279)
I20260709 13:19:23.880299 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263c3a1402d4df68c269f6f96a72eed" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f76c489bb38b485fb100e70dd96ec2ba"
I20260709 13:19:23.880507 13277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263c3a1402d4df68c269f6f96a72eed" candidate_uuid: "b489b10f3a4e4265a5fcf5f934a97942" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b3b320ba0cd44ab68a007567b6d07c1a"
I20260709 13:19:23.881021 13277 raft_consensus.cc:3055] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:23.881021 13465 raft_consensus.cc:3060] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:23.881523 13277 raft_consensus.cc:740] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3b320ba0cd44ab68a007567b6d07c1a, State: Running, Role: LEADER
I20260709 13:19:23.882303 13277 consensus_queue.cc:260] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:23.883299 13277 raft_consensus.cc:3060] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:23.888562 13465 raft_consensus.cc:2468] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 5.
I20260709 13:19:23.889966 13277 raft_consensus.cc:2468] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b489b10f3a4e4265a5fcf5f934a97942 in term 5.
I20260709 13:19:23.890048 13170 leader_election.cc:304] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b489b10f3a4e4265a5fcf5f934a97942, f76c489bb38b485fb100e70dd96ec2ba; no voters: 
I20260709 13:19:23.890940 13548 raft_consensus.cc:2804] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:23.891422 13548 raft_consensus.cc:697] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 5 LEADER]: Becoming Leader. State: Replica: b489b10f3a4e4265a5fcf5f934a97942, State: Running, Role: LEADER
I20260709 13:19:23.892195 13548 consensus_queue.cc:237] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } }
I20260709 13:19:23.898711 13028 catalog_manager.cc:5697] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 reported cstate change: term changed from 4 to 5, leader changed from b3b320ba0cd44ab68a007567b6d07c1a (127.1.227.131) to b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130). New cstate: current_term: 5 leader_uuid: "b489b10f3a4e4265a5fcf5f934a97942" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b489b10f3a4e4265a5fcf5f934a97942" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 41441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:23.946511 13465 raft_consensus.cc:1275] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Refusing update from remote peer b489b10f3a4e4265a5fcf5f934a97942: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:23.947763 13548 consensus_queue.cc:1048] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:23.958513 13277 raft_consensus.cc:1275] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Refusing update from remote peer b489b10f3a4e4265a5fcf5f934a97942: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:23.959937 13548 consensus_queue.cc:1048] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:19:24.059338 13076 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:24.294201 13277 raft_consensus.cc:1275] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 5 FOLLOWER]: Refusing update from remote peer b489b10f3a4e4265a5fcf5f934a97942: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:19:24.295595 13526 consensus_queue.cc:1048] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3b320ba0cd44ab68a007567b6d07c1a" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 37279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:24.304837 13465 raft_consensus.cc:1275] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 5 FOLLOWER]: Refusing update from remote peer b489b10f3a4e4265a5fcf5f934a97942: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:19:24.306375 13582 consensus_queue.cc:1048] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76c489bb38b485fb100e70dd96ec2ba" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:24.381398  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:24.411247  1934 tablet_server.cc:179] TabletServer@127.1.227.129:39811 shutting down...
I20260709 13:19:24.437706  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:24.438581  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:24.439236  1934 raft_consensus.cc:2243] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.439711  1934 raft_consensus.cc:2272] T c08eb3df1f0748f792838c6295651f02 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.441987  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:24.442613  1934 raft_consensus.cc:2243] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.443297  1934 raft_consensus.cc:2272] T f5f01ac121ea4e64b795c9abee9b3685 P f76c489bb38b485fb100e70dd96ec2ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.446661  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:24.447314  1934 raft_consensus.cc:2243] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.447770  1934 raft_consensus.cc:2272] T 27466eac5d12402c9c072b968099f41c P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:24.450515 13170 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 91 similar messages]
I20260709 13:19:24.451480  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:24.452347  1934 raft_consensus.cc:2243] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.452812  1934 raft_consensus.cc:2272] T 795b1f22991548dabf15d72b1ec2ea8a P f76c489bb38b485fb100e70dd96ec2ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:24.454208 13170 consensus_peers.cc:597] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:24.455240  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:24.455927  1934 raft_consensus.cc:2243] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.456373  1934 raft_consensus.cc:2272] T 30a91e9e594646b2928a917b544163e8 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.458920  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:24.459600  1934 raft_consensus.cc:2243] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.460152  1934 raft_consensus.cc:2272] T 4263c3a1402d4df68c269f6f96a72eed P f76c489bb38b485fb100e70dd96ec2ba [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:24.463416 13244 consensus_peers.cc:597] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:24.463748  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:24.464447  1934 raft_consensus.cc:2243] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.465024  1934 raft_consensus.cc:2272] T 72d41d378d4e4e9cac7e8c42cee12675 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.468391  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:24.469107  1934 raft_consensus.cc:2243] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:24.469111 13170 consensus_peers.cc:597] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:24.469717  1934 raft_consensus.cc:2272] T 67065f76534041668d4e55a15e7bd8e5 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.472528  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:24.472986  1934 raft_consensus.cc:2243] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.473353  1934 raft_consensus.cc:2272] T cffd99ace5954094a63ebfb530b721c5 P f76c489bb38b485fb100e70dd96ec2ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.476013  1934 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:24.476548  1934 raft_consensus.cc:2243] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.476950  1934 raft_consensus.cc:2272] T 48e94b4a8b4f4edea04369f76f232b68 P f76c489bb38b485fb100e70dd96ec2ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.509042  1934 tablet_server.cc:196] TabletServer@127.1.227.129:39811 shutdown complete.
I20260709 13:19:24.539034  1934 tablet_server.cc:179] TabletServer@127.1.227.130:0 shutting down...
W20260709 13:19:24.544173 13244 consensus_peers.cc:597] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:24.565945  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:24.566840  1934 tablet_replica.cc:333] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942: stopping tablet replica
I20260709 13:19:24.567577  1934 raft_consensus.cc:2243] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.568490  1934 raft_consensus.cc:2272] T 72d41d378d4e4e9cac7e8c42cee12675 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.571259  1934 tablet_replica.cc:333] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942: stopping tablet replica
I20260709 13:19:24.572001  1934 raft_consensus.cc:2243] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.572486  1934 raft_consensus.cc:2272] T 48e94b4a8b4f4edea04369f76f232b68 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:24.575512 13242 consensus_peers.cc:597] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a -> Peer b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441): Couldn't send request to peer b489b10f3a4e4265a5fcf5f934a97942. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:24.575693  1934 tablet_replica.cc:333] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942: stopping tablet replica
I20260709 13:19:24.576464  1934 raft_consensus.cc:2243] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.576903  1934 raft_consensus.cc:2272] T cffd99ace5954094a63ebfb530b721c5 P b489b10f3a4e4265a5fcf5f934a97942 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.579144  1934 tablet_replica.cc:333] T 795b1f22991548dabf15d72b1ec2ea8a P b489b10f3a4e4265a5fcf5f934a97942: stopping tablet replica
I20260709 13:19:24.579694  1934 raft_consensus.cc:2243] T 795b1f22991548dabf15d72b1ec2ea8a P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.580142  1934 raft_consensus.cc:2272] T 795b1f22991548dabf15d72b1ec2ea8a P b489b10f3a4e4265a5fcf5f934a97942 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.582376  1934 tablet_replica.cc:333] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942: stopping tablet replica
I20260709 13:19:24.583014  1934 raft_consensus.cc:2243] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.583599  1934 raft_consensus.cc:2272] T 67065f76534041668d4e55a15e7bd8e5 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.586404  1934 tablet_replica.cc:333] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942: stopping tablet replica
I20260709 13:19:24.586946  1934 raft_consensus.cc:2243] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.587327  1934 raft_consensus.cc:2272] T f5f01ac121ea4e64b795c9abee9b3685 P b489b10f3a4e4265a5fcf5f934a97942 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.590235  1934 tablet_replica.cc:333] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942: stopping tablet replica
I20260709 13:19:24.590803  1934 raft_consensus.cc:2243] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.591619  1934 raft_consensus.cc:2272] T 27466eac5d12402c9c072b968099f41c P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.594113  1934 tablet_replica.cc:333] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942: stopping tablet replica
I20260709 13:19:24.594656  1934 raft_consensus.cc:2243] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.595413  1934 raft_consensus.cc:2272] T c08eb3df1f0748f792838c6295651f02 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.597476  1934 tablet_replica.cc:333] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942: stopping tablet replica
I20260709 13:19:24.598079  1934 raft_consensus.cc:2243] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.598783  1934 raft_consensus.cc:2272] T 30a91e9e594646b2928a917b544163e8 P b489b10f3a4e4265a5fcf5f934a97942 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.601362  1934 tablet_replica.cc:333] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942: stopping tablet replica
I20260709 13:19:24.601949  1934 raft_consensus.cc:2243] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.603070  1934 raft_consensus.cc:2272] T 4263c3a1402d4df68c269f6f96a72eed P b489b10f3a4e4265a5fcf5f934a97942 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.627606  1934 tablet_server.cc:196] TabletServer@127.1.227.130:0 shutdown complete.
W20260709 13:19:24.638203 13244 consensus_peers.cc:597] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a -> Peer f76c489bb38b485fb100e70dd96ec2ba (127.1.227.129:39811): Couldn't send request to peer f76c489bb38b485fb100e70dd96ec2ba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:39811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:24.654767  1934 tablet_server.cc:179] TabletServer@127.1.227.131:0 shutting down...
I20260709 13:19:24.683382  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:24.684120  1934 tablet_replica.cc:333] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a: stopping tablet replica
I20260709 13:19:24.684904  1934 raft_consensus.cc:2243] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.685458  1934 raft_consensus.cc:2272] T 72d41d378d4e4e9cac7e8c42cee12675 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.688697  1934 tablet_replica.cc:333] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a: stopping tablet replica
I20260709 13:19:24.689428  1934 raft_consensus.cc:2243] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.690304  1934 raft_consensus.cc:2272] T 48e94b4a8b4f4edea04369f76f232b68 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:24.690508 13242 consensus_peers.cc:597] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a -> Peer b489b10f3a4e4265a5fcf5f934a97942 (127.1.227.130:41441): Couldn't send request to peer b489b10f3a4e4265a5fcf5f934a97942. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:41441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:24.692553  1934 tablet_replica.cc:333] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a: stopping tablet replica
I20260709 13:19:24.693327  1934 raft_consensus.cc:2243] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.694209  1934 raft_consensus.cc:2272] T cffd99ace5954094a63ebfb530b721c5 P b3b320ba0cd44ab68a007567b6d07c1a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.696491  1934 tablet_replica.cc:333] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a: stopping tablet replica
I20260709 13:19:24.697074  1934 raft_consensus.cc:2243] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.697546  1934 raft_consensus.cc:2272] T 30a91e9e594646b2928a917b544163e8 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.699846  1934 tablet_replica.cc:333] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a: stopping tablet replica
I20260709 13:19:24.700438  1934 raft_consensus.cc:2243] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.700888  1934 raft_consensus.cc:2272] T 4263c3a1402d4df68c269f6f96a72eed P b3b320ba0cd44ab68a007567b6d07c1a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.703737  1934 tablet_replica.cc:333] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a: stopping tablet replica
I20260709 13:19:24.704429  1934 raft_consensus.cc:2243] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.704945  1934 raft_consensus.cc:2272] T c08eb3df1f0748f792838c6295651f02 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.707274  1934 tablet_replica.cc:333] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a: stopping tablet replica
I20260709 13:19:24.707829  1934 raft_consensus.cc:2243] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.708709  1934 raft_consensus.cc:2272] T 795b1f22991548dabf15d72b1ec2ea8a P b3b320ba0cd44ab68a007567b6d07c1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.711001  1934 tablet_replica.cc:333] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a: stopping tablet replica
I20260709 13:19:24.711576  1934 raft_consensus.cc:2243] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.712450  1934 raft_consensus.cc:2272] T 67065f76534041668d4e55a15e7bd8e5 P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.714627  1934 tablet_replica.cc:333] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a: stopping tablet replica
I20260709 13:19:24.715197  1934 raft_consensus.cc:2243] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.716025  1934 raft_consensus.cc:2272] T f5f01ac121ea4e64b795c9abee9b3685 P b3b320ba0cd44ab68a007567b6d07c1a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.718979  1934 tablet_replica.cc:333] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a: stopping tablet replica
I20260709 13:19:24.719506  1934 raft_consensus.cc:2243] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.719947  1934 raft_consensus.cc:2272] T 27466eac5d12402c9c072b968099f41c P b3b320ba0cd44ab68a007567b6d07c1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.753625  1934 tablet_server.cc:196] TabletServer@127.1.227.131:0 shutdown complete.
I20260709 13:19:24.778175  1934 master.cc:562] Master@127.1.227.190:36593 shutting down...
I20260709 13:19:24.805377  1934 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.806064  1934 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.806489  1934 tablet_replica.cc:333] T 00000000000000000000000000000000 P c1a3816440a0427b90f16878027fc373: stopping tablet replica
I20260709 13:19:24.828491  1934 master.cc:584] Master@127.1.227.190:36593 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12966 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:19:24.874768  1934 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.227.190:35035
I20260709 13:19:24.875941  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:24.882798 13591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:24.883160 13592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:24.883244 13594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:24.884945  1934 server_base.cc:1061] running on GCE node
I20260709 13:19:24.885896  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:24.886104  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:24.886262  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603164886246 us; error 0 us; skew 500 ppm
I20260709 13:19:24.886797  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:24.889232  1934 webserver.cc:533] Webserver started at http://127.1.227.190:45487/ using document root <none> and password file <none>
I20260709 13:19:24.889791  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:24.890039  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:24.890331  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:24.891490  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602825662285-1934-0/minicluster-data/master-0-root/instance:
uuid: "d29646db4a1f4d05bfe7b53bff4c2742"
format_stamp: "Formatted at 2026-07-09 13:19:24 on dist-test-slave-lfdf"
I20260709 13:19:24.895973  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:19:24.899457 13599 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:24.900676  1934 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:19:24.900990  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602825662285-1934-0/minicluster-data/master-0-root
uuid: "d29646db4a1f4d05bfe7b53bff4c2742"
format_stamp: "Formatted at 2026-07-09 13:19:24 on dist-test-slave-lfdf"
I20260709 13:19:24.901252  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602825662285-1934-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602825662285-1934-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602825662285-1934-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:24.943100  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:24.944376  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:24.986140  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.190:35035
I20260709 13:19:24.986255 13650 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.190:35035 every 8 connection(s)
I20260709 13:19:24.990149 13651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:25.002053 13651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742: Bootstrap starting.
I20260709 13:19:25.007186 13651 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.011941 13651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742: No bootstrap required, opened a new log
I20260709 13:19:25.014319 13651 raft_consensus.cc:359] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d29646db4a1f4d05bfe7b53bff4c2742" member_type: VOTER }
I20260709 13:19:25.014719 13651 raft_consensus.cc:385] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.014899 13651 raft_consensus.cc:740] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d29646db4a1f4d05bfe7b53bff4c2742, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.015403 13651 consensus_queue.cc:260] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d29646db4a1f4d05bfe7b53bff4c2742" member_type: VOTER }
I20260709 13:19:25.015848 13651 raft_consensus.cc:399] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:25.016048 13651 raft_consensus.cc:493] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:25.016280 13651 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.021375 13651 raft_consensus.cc:515] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d29646db4a1f4d05bfe7b53bff4c2742" member_type: VOTER }
I20260709 13:19:25.021977 13651 leader_election.cc:304] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d29646db4a1f4d05bfe7b53bff4c2742; no voters: 
I20260709 13:19:25.023274 13651 leader_election.cc:290] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:25.023659 13654 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:25.025295 13654 raft_consensus.cc:697] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742 [term 1 LEADER]: Becoming Leader. State: Replica: d29646db4a1f4d05bfe7b53bff4c2742, State: Running, Role: LEADER
I20260709 13:19:25.026110 13654 consensus_queue.cc:237] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d29646db4a1f4d05bfe7b53bff4c2742" member_type: VOTER }
I20260709 13:19:25.026309 13651 sys_catalog.cc:565] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:25.031937 13655 sys_catalog.cc:455] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d29646db4a1f4d05bfe7b53bff4c2742" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d29646db4a1f4d05bfe7b53bff4c2742" member_type: VOTER } }
I20260709 13:19:25.033226 13656 sys_catalog.cc:455] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d29646db4a1f4d05bfe7b53bff4c2742. Latest consensus state: current_term: 1 leader_uuid: "d29646db4a1f4d05bfe7b53bff4c2742" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d29646db4a1f4d05bfe7b53bff4c2742" member_type: VOTER } }
I20260709 13:19:25.034117 13655 sys_catalog.cc:458] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:25.034215 13656 sys_catalog.cc:458] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:25.036222 13663 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:25.041980 13663 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:25.044770  1934 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:25.051728 13663 catalog_manager.cc:1383] Generated new cluster ID: 86bd1919088e4828b2b0f97cb8f40708
I20260709 13:19:25.052075 13663 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:25.070154 13663 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:25.071750 13663 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:25.088725 13663 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742: Generated new TSK 0
I20260709 13:19:25.089313 13663 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:25.111982  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:25.118997 13672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:25.120462 13673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:25.122382 13675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:25.122437  1934 server_base.cc:1061] running on GCE node
I20260709 13:19:25.123744  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:25.123939  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:25.124132  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603165124118 us; error 0 us; skew 500 ppm
I20260709 13:19:25.124722  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:25.127295  1934 webserver.cc:533] Webserver started at http://127.1.227.129:37549/ using document root <none> and password file <none>
I20260709 13:19:25.127848  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:25.128063  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:25.128334  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:25.129477  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602825662285-1934-0/minicluster-data/ts-0-root/instance:
uuid: "8842e199254b4768ab201242f482a791"
format_stamp: "Formatted at 2026-07-09 13:19:25 on dist-test-slave-lfdf"
I20260709 13:19:25.134533  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:19:25.138319 13680 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:25.139201  1934 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:19:25.139598  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602825662285-1934-0/minicluster-data/ts-0-root
uuid: "8842e199254b4768ab201242f482a791"
format_stamp: "Formatted at 2026-07-09 13:19:25 on dist-test-slave-lfdf"
I20260709 13:19:25.139904  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602825662285-1934-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602825662285-1934-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602825662285-1934-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:25.167560  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:25.168766  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:25.170452  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:25.172928  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:25.173161  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:25.173421  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:25.173611  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:25.219298  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.129:41703
I20260709 13:19:25.219425 13742 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.129:41703 every 8 connection(s)
I20260709 13:19:25.225418  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:25.233879 13747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:25.235489 13748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:25.241024 13743 heartbeater.cc:344] Connected to a master server at 127.1.227.190:35035
I20260709 13:19:25.241798 13743 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:25.243105 13743 heartbeater.cc:507] Master 127.1.227.190:35035 requested a full tablet report, sending...
W20260709 13:19:25.245045 13750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:25.246560 13616 ts_manager.cc:194] Registered new tserver with Master: 8842e199254b4768ab201242f482a791 (127.1.227.129:41703)
I20260709 13:19:25.247156  1934 server_base.cc:1061] running on GCE node
I20260709 13:19:25.248140  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:25.248379  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:25.248560  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603165248538 us; error 0 us; skew 500 ppm
I20260709 13:19:25.249112 13616 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52810
I20260709 13:19:25.249238  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:25.252483  1934 webserver.cc:533] Webserver started at http://127.1.227.130:39927/ using document root <none> and password file <none>
I20260709 13:19:25.253026  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:25.253250  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:25.253523  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:25.254799  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602825662285-1934-0/minicluster-data/ts-1-root/instance:
uuid: "afe706ec6f1b4a91ac57d9450c1d0432"
format_stamp: "Formatted at 2026-07-09 13:19:25 on dist-test-slave-lfdf"
I20260709 13:19:25.259651  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:19:25.263473 13755 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:25.264416  1934 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:19:25.264743  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602825662285-1934-0/minicluster-data/ts-1-root
uuid: "afe706ec6f1b4a91ac57d9450c1d0432"
format_stamp: "Formatted at 2026-07-09 13:19:25 on dist-test-slave-lfdf"
I20260709 13:19:25.265002  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602825662285-1934-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602825662285-1934-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602825662285-1934-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:25.298491  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:25.299645  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:25.301084  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:25.303444  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:25.303685  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:25.303933  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:25.304112  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:25.346118  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.130:38885
I20260709 13:19:25.346230 13817 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.130:38885 every 8 connection(s)
I20260709 13:19:25.351166  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:25.358752 13821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:25.360411 13822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:25.364063  1934 server_base.cc:1061] running on GCE node
W20260709 13:19:25.364356 13824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:25.364845 13818 heartbeater.cc:344] Connected to a master server at 127.1.227.190:35035
I20260709 13:19:25.365363 13818 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:25.365707  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:25.366047  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:25.366255  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603165366236 us; error 0 us; skew 500 ppm
I20260709 13:19:25.366376 13818 heartbeater.cc:507] Master 127.1.227.190:35035 requested a full tablet report, sending...
I20260709 13:19:25.367056  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:25.368738 13616 ts_manager.cc:194] Registered new tserver with Master: afe706ec6f1b4a91ac57d9450c1d0432 (127.1.227.130:38885)
I20260709 13:19:25.370141  1934 webserver.cc:533] Webserver started at http://127.1.227.131:44237/ using document root <none> and password file <none>
I20260709 13:19:25.370378 13616 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52820
I20260709 13:19:25.370766  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:25.371059  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:25.371359  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:25.372609  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602825662285-1934-0/minicluster-data/ts-2-root/instance:
uuid: "a2b0f36e36294682a537b51a62b4fbe4"
format_stamp: "Formatted at 2026-07-09 13:19:25 on dist-test-slave-lfdf"
I20260709 13:19:25.377331  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:19:25.380869 13829 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:25.381875  1934 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:19:25.382174  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602825662285-1934-0/minicluster-data/ts-2-root
uuid: "a2b0f36e36294682a537b51a62b4fbe4"
format_stamp: "Formatted at 2026-07-09 13:19:25 on dist-test-slave-lfdf"
I20260709 13:19:25.382419  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602825662285-1934-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602825662285-1934-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602825662285-1934-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:25.417081  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:25.418584  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:25.419890  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:25.422302  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:25.422557  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:25.422818  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:25.423002  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:25.467803  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.131:34247
I20260709 13:19:25.468082 13891 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.131:34247 every 8 connection(s)
I20260709 13:19:25.483418 13892 heartbeater.cc:344] Connected to a master server at 127.1.227.190:35035
I20260709 13:19:25.483881 13892 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:25.484735 13892 heartbeater.cc:507] Master 127.1.227.190:35035 requested a full tablet report, sending...
I20260709 13:19:25.486981 13616 ts_manager.cc:194] Registered new tserver with Master: a2b0f36e36294682a537b51a62b4fbe4 (127.1.227.131:34247)
I20260709 13:19:25.487185  1934 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016166031s
I20260709 13:19:25.488519 13616 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52834
I20260709 13:19:25.514736 13616 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52840:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:25.517040 13616 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:25.575207 13783 tablet_service.cc:1511] Processing CreateTablet for tablet ccd69abb9a7b4ffeb3f617d838543e56 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=920b371f739b4218ba231a7db9e7e4ea]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:25.575484 13782 tablet_service.cc:1511] Processing CreateTablet for tablet 3ea2666c48c246dc9dd4b09492b79228 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=920b371f739b4218ba231a7db9e7e4ea]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:25.575982 13708 tablet_service.cc:1511] Processing CreateTablet for tablet ccd69abb9a7b4ffeb3f617d838543e56 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=920b371f739b4218ba231a7db9e7e4ea]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:25.576828 13783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd69abb9a7b4ffeb3f617d838543e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:25.577404 13708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd69abb9a7b4ffeb3f617d838543e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:25.577471 13782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ea2666c48c246dc9dd4b09492b79228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:25.585274 13707 tablet_service.cc:1511] Processing CreateTablet for tablet 3ea2666c48c246dc9dd4b09492b79228 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=920b371f739b4218ba231a7db9e7e4ea]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:25.586848 13707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ea2666c48c246dc9dd4b09492b79228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:25.587878 13856 tablet_service.cc:1511] Processing CreateTablet for tablet 3ea2666c48c246dc9dd4b09492b79228 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=920b371f739b4218ba231a7db9e7e4ea]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:25.589262 13856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ea2666c48c246dc9dd4b09492b79228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:25.586853 13857 tablet_service.cc:1511] Processing CreateTablet for tablet ccd69abb9a7b4ffeb3f617d838543e56 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=920b371f739b4218ba231a7db9e7e4ea]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:25.595366 13857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd69abb9a7b4ffeb3f617d838543e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:25.622520 13908 tablet_bootstrap.cc:492] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4: Bootstrap starting.
I20260709 13:19:25.625761 13909 tablet_bootstrap.cc:492] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791: Bootstrap starting.
I20260709 13:19:25.625011 13907 tablet_bootstrap.cc:492] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432: Bootstrap starting.
I20260709 13:19:25.632550 13908 tablet_bootstrap.cc:654] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.633699 13909 tablet_bootstrap.cc:654] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.637390 13907 tablet_bootstrap.cc:654] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.639274 13908 tablet_bootstrap.cc:492] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4: No bootstrap required, opened a new log
I20260709 13:19:25.639840 13908 ts_tablet_manager.cc:1403] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.003s
I20260709 13:19:25.643397 13907 tablet_bootstrap.cc:492] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432: No bootstrap required, opened a new log
I20260709 13:19:25.643442 13908 raft_consensus.cc:359] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.644112 13907 ts_tablet_manager.cc:1403] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 13:19:25.644471 13908 raft_consensus.cc:385] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.644811 13908 raft_consensus.cc:740] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2b0f36e36294682a537b51a62b4fbe4, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.645934 13909 tablet_bootstrap.cc:492] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791: No bootstrap required, opened a new log
I20260709 13:19:25.645788 13908 consensus_queue.cc:260] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.646543 13909 ts_tablet_manager.cc:1403] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 13:19:25.647612 13907 raft_consensus.cc:359] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.648718 13907 raft_consensus.cc:385] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.649137 13907 raft_consensus.cc:740] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afe706ec6f1b4a91ac57d9450c1d0432, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.649662 13909 raft_consensus.cc:359] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.650578 13909 raft_consensus.cc:385] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.651286 13909 raft_consensus.cc:740] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8842e199254b4768ab201242f482a791, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.650542 13907 consensus_queue.cc:260] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.652158 13909 consensus_queue.cc:260] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.653880 13892 heartbeater.cc:499] Master 127.1.227.190:35035 was elected leader, sending a full tablet report...
I20260709 13:19:25.654531 13908 ts_tablet_manager.cc:1434] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.008s
I20260709 13:19:25.655062 13818 heartbeater.cc:499] Master 127.1.227.190:35035 was elected leader, sending a full tablet report...
I20260709 13:19:25.656277 13907 ts_tablet_manager.cc:1434] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:19:25.657305 13907 tablet_bootstrap.cc:492] T ccd69abb9a7b4ffeb3f617d838543e56 P afe706ec6f1b4a91ac57d9450c1d0432: Bootstrap starting.
I20260709 13:19:25.657467 13908 tablet_bootstrap.cc:492] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4: Bootstrap starting.
I20260709 13:19:25.664100 13907 tablet_bootstrap.cc:654] T ccd69abb9a7b4ffeb3f617d838543e56 P afe706ec6f1b4a91ac57d9450c1d0432: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.664440 13908 tablet_bootstrap.cc:654] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.677546 13743 heartbeater.cc:499] Master 127.1.227.190:35035 was elected leader, sending a full tablet report...
I20260709 13:19:25.677997 13908 tablet_bootstrap.cc:492] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4: No bootstrap required, opened a new log
I20260709 13:19:25.678184 13909 ts_tablet_manager.cc:1434] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791: Time spent starting tablet: real 0.031s	user 0.019s	sys 0.012s
I20260709 13:19:25.678581 13908 ts_tablet_manager.cc:1403] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 13:19:25.680820 13907 tablet_bootstrap.cc:492] T ccd69abb9a7b4ffeb3f617d838543e56 P afe706ec6f1b4a91ac57d9450c1d0432: No bootstrap required, opened a new log
I20260709 13:19:25.681546 13907 ts_tablet_manager.cc:1403] T ccd69abb9a7b4ffeb3f617d838543e56 P afe706ec6f1b4a91ac57d9450c1d0432: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.009s
I20260709 13:19:25.681852 13908 raft_consensus.cc:359] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.682735 13908 raft_consensus.cc:385] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.683115 13909 tablet_bootstrap.cc:492] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791: Bootstrap starting.
I20260709 13:19:25.683111 13908 raft_consensus.cc:740] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2b0f36e36294682a537b51a62b4fbe4, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.684569 13908 consensus_queue.cc:260] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.687188 13908 ts_tablet_manager.cc:1434] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:25.686638 13907 raft_consensus.cc:359] T ccd69abb9a7b4ffeb3f617d838543e56 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.687772 13907 raft_consensus.cc:385] T ccd69abb9a7b4ffeb3f617d838543e56 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.688179 13907 raft_consensus.cc:740] T ccd69abb9a7b4ffeb3f617d838543e56 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afe706ec6f1b4a91ac57d9450c1d0432, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.689102 13907 consensus_queue.cc:260] T ccd69abb9a7b4ffeb3f617d838543e56 P afe706ec6f1b4a91ac57d9450c1d0432 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.691685 13907 ts_tablet_manager.cc:1434] T ccd69abb9a7b4ffeb3f617d838543e56 P afe706ec6f1b4a91ac57d9450c1d0432: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:19:25.692315 13909 tablet_bootstrap.cc:654] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.699404 13909 tablet_bootstrap.cc:492] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791: No bootstrap required, opened a new log
I20260709 13:19:25.699934 13909 ts_tablet_manager.cc:1403] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:19:25.703073 13909 raft_consensus.cc:359] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.703840 13909 raft_consensus.cc:385] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.704107 13909 raft_consensus.cc:740] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8842e199254b4768ab201242f482a791, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.704804 13909 consensus_queue.cc:260] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.706749 13909 ts_tablet_manager.cc:1434] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:25.712891 13913 raft_consensus.cc:493] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.712960 13915 raft_consensus.cc:493] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.713472 13913 raft_consensus.cc:515] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.713985 13915 raft_consensus.cc:515] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.717260 13913 leader_election.cc:290] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8842e199254b4768ab201242f482a791 (127.1.227.129:41703), afe706ec6f1b4a91ac57d9450c1d0432 (127.1.227.130:38885)
I20260709 13:19:25.717962 13915 leader_election.cc:290] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afe706ec6f1b4a91ac57d9450c1d0432 (127.1.227.130:38885), a2b0f36e36294682a537b51a62b4fbe4 (127.1.227.131:34247)
I20260709 13:19:25.731197 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd69abb9a7b4ffeb3f617d838543e56" candidate_uuid: "a2b0f36e36294682a537b51a62b4fbe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8842e199254b4768ab201242f482a791" is_pre_election: true
I20260709 13:19:25.732029 13718 raft_consensus.cc:2468] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2b0f36e36294682a537b51a62b4fbe4 in term 0.
I20260709 13:19:25.733403 13832 leader_election.cc:304] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8842e199254b4768ab201242f482a791, a2b0f36e36294682a537b51a62b4fbe4; no voters: 
I20260709 13:19:25.734390 13913 raft_consensus.cc:2804] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:25.734767 13913 raft_consensus.cc:493] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.735124 13913 raft_consensus.cc:3060] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.737704 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd69abb9a7b4ffeb3f617d838543e56" candidate_uuid: "8842e199254b4768ab201242f482a791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2b0f36e36294682a537b51a62b4fbe4" is_pre_election: true
I20260709 13:19:25.736021 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd69abb9a7b4ffeb3f617d838543e56" candidate_uuid: "a2b0f36e36294682a537b51a62b4fbe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" is_pre_election: true
I20260709 13:19:25.738781 13793 raft_consensus.cc:2468] T ccd69abb9a7b4ffeb3f617d838543e56 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2b0f36e36294682a537b51a62b4fbe4 in term 0.
I20260709 13:19:25.743198 13913 raft_consensus.cc:515] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.743649 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd69abb9a7b4ffeb3f617d838543e56" candidate_uuid: "8842e199254b4768ab201242f482a791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" is_pre_election: true
I20260709 13:19:25.744274 13793 raft_consensus.cc:2468] T ccd69abb9a7b4ffeb3f617d838543e56 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8842e199254b4768ab201242f482a791 in term 0.
I20260709 13:19:25.744570 13867 raft_consensus.cc:2393] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8842e199254b4768ab201242f482a791 in current term 1: Already voted for candidate a2b0f36e36294682a537b51a62b4fbe4 in this term.
I20260709 13:19:25.745445 13684 leader_election.cc:304] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8842e199254b4768ab201242f482a791, afe706ec6f1b4a91ac57d9450c1d0432; no voters: 
I20260709 13:19:25.746194 13913 leader_election.cc:290] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [CANDIDATE]: Term 1 election: Requested vote from peers 8842e199254b4768ab201242f482a791 (127.1.227.129:41703), afe706ec6f1b4a91ac57d9450c1d0432 (127.1.227.130:38885)
I20260709 13:19:25.746558 13915 raft_consensus.cc:2804] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:25.746994 13915 raft_consensus.cc:493] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.747294 13915 raft_consensus.cc:3060] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.747473 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd69abb9a7b4ffeb3f617d838543e56" candidate_uuid: "a2b0f36e36294682a537b51a62b4fbe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8842e199254b4768ab201242f482a791"
I20260709 13:19:25.747867 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd69abb9a7b4ffeb3f617d838543e56" candidate_uuid: "a2b0f36e36294682a537b51a62b4fbe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afe706ec6f1b4a91ac57d9450c1d0432"
I20260709 13:19:25.748512 13793 raft_consensus.cc:3060] T ccd69abb9a7b4ffeb3f617d838543e56 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.753016 13915 raft_consensus.cc:515] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.753916 13793 raft_consensus.cc:2468] T ccd69abb9a7b4ffeb3f617d838543e56 P afe706ec6f1b4a91ac57d9450c1d0432 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2b0f36e36294682a537b51a62b4fbe4 in term 1.
I20260709 13:19:25.754199 13718 raft_consensus.cc:2393] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a2b0f36e36294682a537b51a62b4fbe4 in current term 1: Already voted for candidate 8842e199254b4768ab201242f482a791 in this term.
I20260709 13:19:25.755095 13915 leader_election.cc:290] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [CANDIDATE]: Term 1 election: Requested vote from peers afe706ec6f1b4a91ac57d9450c1d0432 (127.1.227.130:38885), a2b0f36e36294682a537b51a62b4fbe4 (127.1.227.131:34247)
I20260709 13:19:25.755235 13833 leader_election.cc:304] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2b0f36e36294682a537b51a62b4fbe4, afe706ec6f1b4a91ac57d9450c1d0432; no voters: 
I20260709 13:19:25.756295 13913 raft_consensus.cc:2804] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:25.756376 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd69abb9a7b4ffeb3f617d838543e56" candidate_uuid: "8842e199254b4768ab201242f482a791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2b0f36e36294682a537b51a62b4fbe4"
I20260709 13:19:25.756561 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd69abb9a7b4ffeb3f617d838543e56" candidate_uuid: "8842e199254b4768ab201242f482a791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afe706ec6f1b4a91ac57d9450c1d0432"
I20260709 13:19:25.757368 13793 raft_consensus.cc:2393] T ccd69abb9a7b4ffeb3f617d838543e56 P afe706ec6f1b4a91ac57d9450c1d0432 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8842e199254b4768ab201242f482a791 in current term 1: Already voted for candidate a2b0f36e36294682a537b51a62b4fbe4 in this term.
I20260709 13:19:25.757825 13913 raft_consensus.cc:697] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 LEADER]: Becoming Leader. State: Replica: a2b0f36e36294682a537b51a62b4fbe4, State: Running, Role: LEADER
I20260709 13:19:25.758839 13913 consensus_queue.cc:237] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.764535 13683 leader_election.cc:304] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8842e199254b4768ab201242f482a791; no voters: a2b0f36e36294682a537b51a62b4fbe4, afe706ec6f1b4a91ac57d9450c1d0432
I20260709 13:19:25.765283 13915 raft_consensus.cc:2749] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:25.766824 13614 catalog_manager.cc:5697] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2b0f36e36294682a537b51a62b4fbe4 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "a2b0f36e36294682a537b51a62b4fbe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:25.943807 13915 raft_consensus.cc:493] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.944504 13915 raft_consensus.cc:515] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.946527 13915 leader_election.cc:290] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afe706ec6f1b4a91ac57d9450c1d0432 (127.1.227.130:38885), a2b0f36e36294682a537b51a62b4fbe4 (127.1.227.131:34247)
I20260709 13:19:25.947079 13914 raft_consensus.cc:493] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.947741 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea2666c48c246dc9dd4b09492b79228" candidate_uuid: "8842e199254b4768ab201242f482a791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" is_pre_election: true
I20260709 13:19:25.947767 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea2666c48c246dc9dd4b09492b79228" candidate_uuid: "8842e199254b4768ab201242f482a791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2b0f36e36294682a537b51a62b4fbe4" is_pre_election: true
I20260709 13:19:25.947655 13914 raft_consensus.cc:515] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.948628 13867 raft_consensus.cc:2468] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8842e199254b4768ab201242f482a791 in term 0.
I20260709 13:19:25.948861 13793 raft_consensus.cc:2468] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8842e199254b4768ab201242f482a791 in term 0.
I20260709 13:19:25.949791 13683 leader_election.cc:304] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8842e199254b4768ab201242f482a791, a2b0f36e36294682a537b51a62b4fbe4; no voters: 
I20260709 13:19:25.950711 13915 raft_consensus.cc:2804] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:25.951092 13915 raft_consensus.cc:493] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.951354 13914 leader_election.cc:290] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8842e199254b4768ab201242f482a791 (127.1.227.129:41703), a2b0f36e36294682a537b51a62b4fbe4 (127.1.227.131:34247)
I20260709 13:19:25.951542 13915 raft_consensus.cc:3060] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.959465 13915 raft_consensus.cc:515] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.962067 13915 leader_election.cc:290] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [CANDIDATE]: Term 1 election: Requested vote from peers afe706ec6f1b4a91ac57d9450c1d0432 (127.1.227.130:38885), a2b0f36e36294682a537b51a62b4fbe4 (127.1.227.131:34247)
I20260709 13:19:25.963048 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea2666c48c246dc9dd4b09492b79228" candidate_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8842e199254b4768ab201242f482a791" is_pre_election: true
I20260709 13:19:25.963213 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea2666c48c246dc9dd4b09492b79228" candidate_uuid: "8842e199254b4768ab201242f482a791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2b0f36e36294682a537b51a62b4fbe4"
I20260709 13:19:25.962440 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea2666c48c246dc9dd4b09492b79228" candidate_uuid: "8842e199254b4768ab201242f482a791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afe706ec6f1b4a91ac57d9450c1d0432"
I20260709 13:19:25.963910 13867 raft_consensus.cc:3060] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.963950 13718 raft_consensus.cc:2393] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate afe706ec6f1b4a91ac57d9450c1d0432 in current term 1: Already voted for candidate 8842e199254b4768ab201242f482a791 in this term.
I20260709 13:19:25.964087 13793 raft_consensus.cc:3060] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.966077 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea2666c48c246dc9dd4b09492b79228" candidate_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2b0f36e36294682a537b51a62b4fbe4" is_pre_election: true
I20260709 13:19:25.967808 13758 leader_election.cc:304] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afe706ec6f1b4a91ac57d9450c1d0432; no voters: 8842e199254b4768ab201242f482a791, a2b0f36e36294682a537b51a62b4fbe4
I20260709 13:19:25.971571 13793 raft_consensus.cc:2468] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8842e199254b4768ab201242f482a791 in term 1.
I20260709 13:19:25.971588 13867 raft_consensus.cc:2468] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8842e199254b4768ab201242f482a791 in term 1.
I20260709 13:19:25.972177 13914 raft_consensus.cc:2749] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:25.973253 13684 leader_election.cc:304] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8842e199254b4768ab201242f482a791, afe706ec6f1b4a91ac57d9450c1d0432; no voters: 
I20260709 13:19:25.974594 13915 raft_consensus.cc:2804] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:25.975710 13915 raft_consensus.cc:697] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 1 LEADER]: Becoming Leader. State: Replica: 8842e199254b4768ab201242f482a791, State: Running, Role: LEADER
I20260709 13:19:25.976617 13915 consensus_queue.cc:237] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:25.990495 13614 catalog_manager.cc:5697] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8842e199254b4768ab201242f482a791 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "8842e199254b4768ab201242f482a791" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:26.101588 13614 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52850:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:26.104054 13614 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:26.128180 13707 tablet_service.cc:1511] Processing CreateTablet for tablet 03f53162e6a64337a785db17f8010b67 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c52e06f2a5bb4a26a5c7142de48e8c66]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:26.129693 13707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f53162e6a64337a785db17f8010b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:26.129495 13782 tablet_service.cc:1511] Processing CreateTablet for tablet 03f53162e6a64337a785db17f8010b67 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c52e06f2a5bb4a26a5c7142de48e8c66]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:26.130853 13782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f53162e6a64337a785db17f8010b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:26.132514 13857 tablet_service.cc:1511] Processing CreateTablet for tablet 03f53162e6a64337a785db17f8010b67 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c52e06f2a5bb4a26a5c7142de48e8c66]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:26.133298 13708 tablet_service.cc:1511] Processing CreateTablet for tablet 9a20d4d050b343dd9c1643924182c261 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c52e06f2a5bb4a26a5c7142de48e8c66]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:26.133972 13857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f53162e6a64337a785db17f8010b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:26.134577 13708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a20d4d050b343dd9c1643924182c261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:26.149312 13907 tablet_bootstrap.cc:492] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432: Bootstrap starting.
I20260709 13:19:26.149402 13783 tablet_service.cc:1511] Processing CreateTablet for tablet 9a20d4d050b343dd9c1643924182c261 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c52e06f2a5bb4a26a5c7142de48e8c66]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:26.153053 13856 tablet_service.cc:1511] Processing CreateTablet for tablet 9a20d4d050b343dd9c1643924182c261 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c52e06f2a5bb4a26a5c7142de48e8c66]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:26.154799 13783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a20d4d050b343dd9c1643924182c261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:26.154980 13856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a20d4d050b343dd9c1643924182c261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:26.156488 13908 tablet_bootstrap.cc:492] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4: Bootstrap starting.
I20260709 13:19:26.162675 13907 tablet_bootstrap.cc:654] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.165089 13908 tablet_bootstrap.cc:654] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.171461 13909 tablet_bootstrap.cc:492] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791: Bootstrap starting.
I20260709 13:19:26.175479 13907 tablet_bootstrap.cc:492] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432: No bootstrap required, opened a new log
I20260709 13:19:26.176229 13907 ts_tablet_manager.cc:1403] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.005s
I20260709 13:19:26.180406 13908 tablet_bootstrap.cc:492] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4: No bootstrap required, opened a new log
I20260709 13:19:26.180385 13907 raft_consensus.cc:359] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.181214 13908 ts_tablet_manager.cc:1403] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.008s
I20260709 13:19:26.181434 13909 tablet_bootstrap.cc:654] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.181456 13907 raft_consensus.cc:385] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.182116 13907 raft_consensus.cc:740] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afe706ec6f1b4a91ac57d9450c1d0432, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.183109 13907 consensus_queue.cc:260] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.184614 13908 raft_consensus.cc:359] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.185415 13908 raft_consensus.cc:385] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.185727 13908 raft_consensus.cc:740] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2b0f36e36294682a537b51a62b4fbe4, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.186518 13908 consensus_queue.cc:260] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.187430 13922 consensus_queue.cc:1048] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:26.189049 13907 ts_tablet_manager.cc:1434] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:19:26.194003 13907 tablet_bootstrap.cc:492] T 9a20d4d050b343dd9c1643924182c261 P afe706ec6f1b4a91ac57d9450c1d0432: Bootstrap starting.
I20260709 13:19:26.202625 13907 tablet_bootstrap.cc:654] T 9a20d4d050b343dd9c1643924182c261 P afe706ec6f1b4a91ac57d9450c1d0432: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.230615 13913 consensus_queue.cc:1048] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:26.231256 13907 tablet_bootstrap.cc:492] T 9a20d4d050b343dd9c1643924182c261 P afe706ec6f1b4a91ac57d9450c1d0432: No bootstrap required, opened a new log
I20260709 13:19:26.231864 13908 ts_tablet_manager.cc:1434] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4: Time spent starting tablet: real 0.050s	user 0.024s	sys 0.024s
I20260709 13:19:26.233805 13908 tablet_bootstrap.cc:492] T 9a20d4d050b343dd9c1643924182c261 P a2b0f36e36294682a537b51a62b4fbe4: Bootstrap starting.
I20260709 13:19:26.234411 13909 tablet_bootstrap.cc:492] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791: No bootstrap required, opened a new log
I20260709 13:19:26.235008 13909 ts_tablet_manager.cc:1403] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.004s
I20260709 13:19:26.231971 13907 ts_tablet_manager.cc:1403] T 9a20d4d050b343dd9c1643924182c261 P afe706ec6f1b4a91ac57d9450c1d0432: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.015s
I20260709 13:19:26.239042 13909 raft_consensus.cc:359] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.239941 13909 raft_consensus.cc:385] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.240290 13909 raft_consensus.cc:740] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8842e199254b4768ab201242f482a791, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.241271 13909 consensus_queue.cc:260] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.247998 13908 tablet_bootstrap.cc:654] T 9a20d4d050b343dd9c1643924182c261 P a2b0f36e36294682a537b51a62b4fbe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.243247 13907 raft_consensus.cc:359] T 9a20d4d050b343dd9c1643924182c261 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.249378 13907 raft_consensus.cc:385] T 9a20d4d050b343dd9c1643924182c261 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.249797 13907 raft_consensus.cc:740] T 9a20d4d050b343dd9c1643924182c261 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afe706ec6f1b4a91ac57d9450c1d0432, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.250690 13907 consensus_queue.cc:260] T 9a20d4d050b343dd9c1643924182c261 P afe706ec6f1b4a91ac57d9450c1d0432 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.251598 13909 ts_tablet_manager.cc:1434] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.004s
I20260709 13:19:26.253201 13907 ts_tablet_manager.cc:1434] T 9a20d4d050b343dd9c1643924182c261 P afe706ec6f1b4a91ac57d9450c1d0432: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:19:26.253281 13909 tablet_bootstrap.cc:492] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791: Bootstrap starting.
I20260709 13:19:26.262022 13909 tablet_bootstrap.cc:654] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:26.267740 13909 tablet_bootstrap.cc:492] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791: No bootstrap required, opened a new log
I20260709 13:19:26.268281 13909 ts_tablet_manager.cc:1403] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.005s
I20260709 13:19:26.271567 13909 raft_consensus.cc:359] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.272220 13909 raft_consensus.cc:385] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.272523 13909 raft_consensus.cc:740] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8842e199254b4768ab201242f482a791, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.273180 13909 consensus_queue.cc:260] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.275357 13909 ts_tablet_manager.cc:1434] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:26.279260 13908 tablet_bootstrap.cc:492] T 9a20d4d050b343dd9c1643924182c261 P a2b0f36e36294682a537b51a62b4fbe4: No bootstrap required, opened a new log
I20260709 13:19:26.279879 13908 ts_tablet_manager.cc:1403] T 9a20d4d050b343dd9c1643924182c261 P a2b0f36e36294682a537b51a62b4fbe4: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.016s
I20260709 13:19:26.282682 13908 raft_consensus.cc:359] T 9a20d4d050b343dd9c1643924182c261 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.283334 13908 raft_consensus.cc:385] T 9a20d4d050b343dd9c1643924182c261 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:26.283634 13908 raft_consensus.cc:740] T 9a20d4d050b343dd9c1643924182c261 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2b0f36e36294682a537b51a62b4fbe4, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.284246 13908 consensus_queue.cc:260] T 9a20d4d050b343dd9c1643924182c261 P a2b0f36e36294682a537b51a62b4fbe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.285970 13908 ts_tablet_manager.cc:1434] T 9a20d4d050b343dd9c1643924182c261 P a2b0f36e36294682a537b51a62b4fbe4: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:19:26.288260 13926 raft_consensus.cc:493] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.288770 13926 raft_consensus.cc:515] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.290616 13926 leader_election.cc:290] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afe706ec6f1b4a91ac57d9450c1d0432 (127.1.227.130:38885), a2b0f36e36294682a537b51a62b4fbe4 (127.1.227.131:34247)
I20260709 13:19:26.291399 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a20d4d050b343dd9c1643924182c261" candidate_uuid: "8842e199254b4768ab201242f482a791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" is_pre_election: true
I20260709 13:19:26.292168 13793 raft_consensus.cc:2468] T 9a20d4d050b343dd9c1643924182c261 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8842e199254b4768ab201242f482a791 in term 0.
I20260709 13:19:26.292465 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a20d4d050b343dd9c1643924182c261" candidate_uuid: "8842e199254b4768ab201242f482a791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2b0f36e36294682a537b51a62b4fbe4" is_pre_election: true
I20260709 13:19:26.293061 13867 raft_consensus.cc:2468] T 9a20d4d050b343dd9c1643924182c261 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8842e199254b4768ab201242f482a791 in term 0.
I20260709 13:19:26.293515 13684 leader_election.cc:304] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8842e199254b4768ab201242f482a791, afe706ec6f1b4a91ac57d9450c1d0432; no voters: 
I20260709 13:19:26.294410 13926 raft_consensus.cc:2804] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:26.294813 13926 raft_consensus.cc:493] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.295192 13926 raft_consensus.cc:3060] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.301807 13926 raft_consensus.cc:515] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.303740 13926 leader_election.cc:290] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [CANDIDATE]: Term 1 election: Requested vote from peers afe706ec6f1b4a91ac57d9450c1d0432 (127.1.227.130:38885), a2b0f36e36294682a537b51a62b4fbe4 (127.1.227.131:34247)
I20260709 13:19:26.304546 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a20d4d050b343dd9c1643924182c261" candidate_uuid: "8842e199254b4768ab201242f482a791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afe706ec6f1b4a91ac57d9450c1d0432"
I20260709 13:19:26.304718 13867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a20d4d050b343dd9c1643924182c261" candidate_uuid: "8842e199254b4768ab201242f482a791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2b0f36e36294682a537b51a62b4fbe4"
I20260709 13:19:26.305320 13793 raft_consensus.cc:3060] T 9a20d4d050b343dd9c1643924182c261 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.305436 13867 raft_consensus.cc:3060] T 9a20d4d050b343dd9c1643924182c261 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.311264 13867 raft_consensus.cc:2468] T 9a20d4d050b343dd9c1643924182c261 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8842e199254b4768ab201242f482a791 in term 1.
I20260709 13:19:26.311564 13793 raft_consensus.cc:2468] T 9a20d4d050b343dd9c1643924182c261 P afe706ec6f1b4a91ac57d9450c1d0432 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8842e199254b4768ab201242f482a791 in term 1.
I20260709 13:19:26.312273 13683 leader_election.cc:304] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8842e199254b4768ab201242f482a791, a2b0f36e36294682a537b51a62b4fbe4; no voters: 
I20260709 13:19:26.313134 13926 raft_consensus.cc:2804] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:26.313591 13926 raft_consensus.cc:697] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [term 1 LEADER]: Becoming Leader. State: Replica: 8842e199254b4768ab201242f482a791, State: Running, Role: LEADER
I20260709 13:19:26.314365 13926 consensus_queue.cc:237] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.321944 13614 catalog_manager.cc:5697] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8842e199254b4768ab201242f482a791 (127.1.227.129). New cstate: current_term: 1 leader_uuid: "8842e199254b4768ab201242f482a791" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:26.374358 13913 raft_consensus.cc:493] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.375032 13913 raft_consensus.cc:515] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.377194 13913 leader_election.cc:290] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8842e199254b4768ab201242f482a791 (127.1.227.129:41703), afe706ec6f1b4a91ac57d9450c1d0432 (127.1.227.130:38885)
I20260709 13:19:26.377944 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f53162e6a64337a785db17f8010b67" candidate_uuid: "a2b0f36e36294682a537b51a62b4fbe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8842e199254b4768ab201242f482a791" is_pre_election: true
I20260709 13:19:26.378302 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f53162e6a64337a785db17f8010b67" candidate_uuid: "a2b0f36e36294682a537b51a62b4fbe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" is_pre_election: true
I20260709 13:19:26.378705 13718 raft_consensus.cc:2468] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2b0f36e36294682a537b51a62b4fbe4 in term 0.
I20260709 13:19:26.378970 13793 raft_consensus.cc:2468] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2b0f36e36294682a537b51a62b4fbe4 in term 0.
I20260709 13:19:26.379802 13832 leader_election.cc:304] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8842e199254b4768ab201242f482a791, a2b0f36e36294682a537b51a62b4fbe4; no voters: 
I20260709 13:19:26.380533 13913 raft_consensus.cc:2804] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:26.380862 13913 raft_consensus.cc:493] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.381162 13913 raft_consensus.cc:3060] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.386143 13913 raft_consensus.cc:515] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.387792 13913 leader_election.cc:290] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [CANDIDATE]: Term 1 election: Requested vote from peers 8842e199254b4768ab201242f482a791 (127.1.227.129:41703), afe706ec6f1b4a91ac57d9450c1d0432 (127.1.227.130:38885)
I20260709 13:19:26.388784 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f53162e6a64337a785db17f8010b67" candidate_uuid: "a2b0f36e36294682a537b51a62b4fbe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8842e199254b4768ab201242f482a791"
I20260709 13:19:26.388899 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f53162e6a64337a785db17f8010b67" candidate_uuid: "a2b0f36e36294682a537b51a62b4fbe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afe706ec6f1b4a91ac57d9450c1d0432"
I20260709 13:19:26.389362 13718 raft_consensus.cc:3060] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.389640 13793 raft_consensus.cc:3060] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:26.394846 13718 raft_consensus.cc:2468] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2b0f36e36294682a537b51a62b4fbe4 in term 1.
I20260709 13:19:26.395170 13793 raft_consensus.cc:2468] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2b0f36e36294682a537b51a62b4fbe4 in term 1.
I20260709 13:19:26.396122 13832 leader_election.cc:304] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8842e199254b4768ab201242f482a791, a2b0f36e36294682a537b51a62b4fbe4; no voters: 
I20260709 13:19:26.397104 13913 raft_consensus.cc:2804] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:26.397619 13913 raft_consensus.cc:697] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 LEADER]: Becoming Leader. State: Replica: a2b0f36e36294682a537b51a62b4fbe4, State: Running, Role: LEADER
I20260709 13:19:26.398509 13913 consensus_queue.cc:237] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.406500 13614 catalog_manager.cc:5697] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2b0f36e36294682a537b51a62b4fbe4 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "a2b0f36e36294682a537b51a62b4fbe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:26.440198 13867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccd69abb9a7b4ffeb3f617d838543e56"
dest_uuid: "a2b0f36e36294682a537b51a62b4fbe4"
mode: GRACEFUL
new_leader_uuid: "8842e199254b4768ab201242f482a791"
 from {username='slave'} at 127.0.0.1:54678
I20260709 13:19:26.440775 13867 raft_consensus.cc:606] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 LEADER]: Received request to transfer leadership to TS 8842e199254b4768ab201242f482a791
I20260709 13:19:26.452148 13926 consensus_queue.cc:1048] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:26.455626 13718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ea2666c48c246dc9dd4b09492b79228"
dest_uuid: "8842e199254b4768ab201242f482a791"
mode: GRACEFUL
new_leader_uuid: "a2b0f36e36294682a537b51a62b4fbe4"
 from {username='slave'} at 127.0.0.1:33300
I20260709 13:19:26.456331 13718 raft_consensus.cc:606] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 1 LEADER]: Received request to transfer leadership to TS a2b0f36e36294682a537b51a62b4fbe4
I20260709 13:19:26.466741 13866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03f53162e6a64337a785db17f8010b67"
dest_uuid: "a2b0f36e36294682a537b51a62b4fbe4"
mode: GRACEFUL
new_leader_uuid: "8842e199254b4768ab201242f482a791"
 from {username='slave'} at 127.0.0.1:54678
I20260709 13:19:26.467497 13866 raft_consensus.cc:606] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 LEADER]: Received request to transfer leadership to TS 8842e199254b4768ab201242f482a791
I20260709 13:19:26.467777 13926 consensus_queue.cc:1048] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:26.483843 13915 raft_consensus.cc:993] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791: : Instructing follower a2b0f36e36294682a537b51a62b4fbe4 to start an election
I20260709 13:19:26.484368 13926 raft_consensus.cc:1081] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 1 LEADER]: Signalling peer a2b0f36e36294682a537b51a62b4fbe4 to start an election
I20260709 13:19:26.485952 13866 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ea2666c48c246dc9dd4b09492b79228"
dest_uuid: "a2b0f36e36294682a537b51a62b4fbe4"
 from {username='slave'} at 127.0.0.1:54650
I20260709 13:19:26.486680 13866 raft_consensus.cc:493] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:26.487043 13866 raft_consensus.cc:3060] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.492996 13866 raft_consensus.cc:515] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.495347 13866 leader_election.cc:290] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 [CANDIDATE]: Term 2 election: Requested vote from peers 8842e199254b4768ab201242f482a791 (127.1.227.129:41703), afe706ec6f1b4a91ac57d9450c1d0432 (127.1.227.130:38885)
I20260709 13:19:26.496706 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea2666c48c246dc9dd4b09492b79228" candidate_uuid: "a2b0f36e36294682a537b51a62b4fbe4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "afe706ec6f1b4a91ac57d9450c1d0432"
I20260709 13:19:26.495990 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea2666c48c246dc9dd4b09492b79228" candidate_uuid: "a2b0f36e36294682a537b51a62b4fbe4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8842e199254b4768ab201242f482a791"
I20260709 13:19:26.497352 13793 raft_consensus.cc:3060] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.497767 13718 raft_consensus.cc:3055] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:26.498169 13718 raft_consensus.cc:740] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8842e199254b4768ab201242f482a791, State: Running, Role: LEADER
I20260709 13:19:26.499116 13718 consensus_queue.cc:260] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.500692 13718 raft_consensus.cc:3060] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.503919 13793 raft_consensus.cc:2468] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2b0f36e36294682a537b51a62b4fbe4 in term 2.
I20260709 13:19:26.505003 13833 leader_election.cc:304] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2b0f36e36294682a537b51a62b4fbe4, afe706ec6f1b4a91ac57d9450c1d0432; no voters: 
I20260709 13:19:26.505864 13913 raft_consensus.cc:2804] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:26.506426 13913 raft_consensus.cc:697] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 [term 2 LEADER]: Becoming Leader. State: Replica: a2b0f36e36294682a537b51a62b4fbe4, State: Running, Role: LEADER
I20260709 13:19:26.507447 13913 consensus_queue.cc:237] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.510551 13718 raft_consensus.cc:2468] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2b0f36e36294682a537b51a62b4fbe4 in term 2.
I20260709 13:19:26.516153 13613 catalog_manager.cc:5697] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 reported cstate change: term changed from 1 to 2, leader changed from 8842e199254b4768ab201242f482a791 (127.1.227.129) to a2b0f36e36294682a537b51a62b4fbe4 (127.1.227.131). New cstate: current_term: 2 leader_uuid: "a2b0f36e36294682a537b51a62b4fbe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:26.623112 13936 raft_consensus.cc:993] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4: : Instructing follower 8842e199254b4768ab201242f482a791 to start an election
I20260709 13:19:26.623572 13913 raft_consensus.cc:1081] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 LEADER]: Signalling peer 8842e199254b4768ab201242f482a791 to start an election
I20260709 13:19:26.625228 13718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccd69abb9a7b4ffeb3f617d838543e56"
dest_uuid: "8842e199254b4768ab201242f482a791"
 from {username='slave'} at 127.0.0.1:33278
I20260709 13:19:26.625792 13718 raft_consensus.cc:493] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:26.626116 13718 raft_consensus.cc:3060] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.632006 13718 raft_consensus.cc:515] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.634413 13718 leader_election.cc:290] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [CANDIDATE]: Term 2 election: Requested vote from peers afe706ec6f1b4a91ac57d9450c1d0432 (127.1.227.130:38885), a2b0f36e36294682a537b51a62b4fbe4 (127.1.227.131:34247)
I20260709 13:19:26.634716 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd69abb9a7b4ffeb3f617d838543e56" candidate_uuid: "8842e199254b4768ab201242f482a791" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "afe706ec6f1b4a91ac57d9450c1d0432"
I20260709 13:19:26.635008 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd69abb9a7b4ffeb3f617d838543e56" candidate_uuid: "8842e199254b4768ab201242f482a791" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2b0f36e36294682a537b51a62b4fbe4"
I20260709 13:19:26.635389 13793 raft_consensus.cc:3060] T ccd69abb9a7b4ffeb3f617d838543e56 P afe706ec6f1b4a91ac57d9450c1d0432 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.635702 13866 raft_consensus.cc:3055] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:26.636060 13866 raft_consensus.cc:740] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2b0f36e36294682a537b51a62b4fbe4, State: Running, Role: LEADER
I20260709 13:19:26.636898 13866 consensus_queue.cc:260] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.638340 13866 raft_consensus.cc:3060] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.642257 13793 raft_consensus.cc:2468] T ccd69abb9a7b4ffeb3f617d838543e56 P afe706ec6f1b4a91ac57d9450c1d0432 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8842e199254b4768ab201242f482a791 in term 2.
I20260709 13:19:26.643370 13684 leader_election.cc:304] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8842e199254b4768ab201242f482a791, afe706ec6f1b4a91ac57d9450c1d0432; no voters: 
I20260709 13:19:26.644212 13926 raft_consensus.cc:2804] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:26.644671 13926 raft_consensus.cc:697] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [term 2 LEADER]: Becoming Leader. State: Replica: 8842e199254b4768ab201242f482a791, State: Running, Role: LEADER
I20260709 13:19:26.645403 13926 consensus_queue.cc:237] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.646389 13866 raft_consensus.cc:2468] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8842e199254b4768ab201242f482a791 in term 2.
I20260709 13:19:26.653672 13616 catalog_manager.cc:5697] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 reported cstate change: term changed from 1 to 2, leader changed from a2b0f36e36294682a537b51a62b4fbe4 (127.1.227.131) to 8842e199254b4768ab201242f482a791 (127.1.227.129). New cstate: current_term: 2 leader_uuid: "8842e199254b4768ab201242f482a791" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:26.700074 13926 consensus_queue.cc:1048] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:26.714557 13926 consensus_queue.cc:1048] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:26.890482 13913 consensus_queue.cc:1048] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:26.901409 13936 consensus_queue.cc:1048] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:26.909722 13913 raft_consensus.cc:993] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4: : Instructing follower 8842e199254b4768ab201242f482a791 to start an election
I20260709 13:19:26.910213 13936 raft_consensus.cc:1081] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 LEADER]: Signalling peer 8842e199254b4768ab201242f482a791 to start an election
I20260709 13:19:26.911957 13718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03f53162e6a64337a785db17f8010b67"
dest_uuid: "8842e199254b4768ab201242f482a791"
 from {username='slave'} at 127.0.0.1:33278
I20260709 13:19:26.912556 13718 raft_consensus.cc:493] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:26.912932 13718 raft_consensus.cc:3060] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.918040 13718 raft_consensus.cc:515] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.919713 13718 leader_election.cc:290] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [CANDIDATE]: Term 2 election: Requested vote from peers afe706ec6f1b4a91ac57d9450c1d0432 (127.1.227.130:38885), a2b0f36e36294682a537b51a62b4fbe4 (127.1.227.131:34247)
I20260709 13:19:26.920825 13793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f53162e6a64337a785db17f8010b67" candidate_uuid: "8842e199254b4768ab201242f482a791" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "afe706ec6f1b4a91ac57d9450c1d0432"
I20260709 13:19:26.920997 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f53162e6a64337a785db17f8010b67" candidate_uuid: "8842e199254b4768ab201242f482a791" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2b0f36e36294682a537b51a62b4fbe4"
I20260709 13:19:26.921545 13793 raft_consensus.cc:3060] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.921618 13866 raft_consensus.cc:3055] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:26.922062 13866 raft_consensus.cc:740] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2b0f36e36294682a537b51a62b4fbe4, State: Running, Role: LEADER
I20260709 13:19:26.922734 13866 consensus_queue.cc:260] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.923624 13866 raft_consensus.cc:3060] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.928624 13793 raft_consensus.cc:2468] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8842e199254b4768ab201242f482a791 in term 2.
I20260709 13:19:26.929077 13866 raft_consensus.cc:2468] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8842e199254b4768ab201242f482a791 in term 2.
I20260709 13:19:26.930092 13684 leader_election.cc:304] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8842e199254b4768ab201242f482a791, afe706ec6f1b4a91ac57d9450c1d0432; no voters: 
I20260709 13:19:26.931089 13926 raft_consensus.cc:2804] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:26.931541 13926 raft_consensus.cc:697] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [term 2 LEADER]: Becoming Leader. State: Replica: 8842e199254b4768ab201242f482a791, State: Running, Role: LEADER
I20260709 13:19:26.932381 13926 consensus_queue.cc:237] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:26.939764 13613 catalog_manager.cc:5697] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 reported cstate change: term changed from 1 to 2, leader changed from a2b0f36e36294682a537b51a62b4fbe4 (127.1.227.131) to 8842e199254b4768ab201242f482a791 (127.1.227.129). New cstate: current_term: 2 leader_uuid: "8842e199254b4768ab201242f482a791" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:26.952996  1934 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:19:26.954820  1934 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:19:26.955440  1934 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:19:26.968538 13718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03f53162e6a64337a785db17f8010b67"
dest_uuid: "8842e199254b4768ab201242f482a791"
mode: GRACEFUL
new_leader_uuid: "afe706ec6f1b4a91ac57d9450c1d0432"
 from {username='slave'} at 127.0.0.1:39480
I20260709 13:19:26.969143 13718 raft_consensus.cc:606] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [term 2 LEADER]: Received request to transfer leadership to TS afe706ec6f1b4a91ac57d9450c1d0432
I20260709 13:19:26.970407  1934 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:19:27.041569 13866 raft_consensus.cc:1275] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 2 FOLLOWER]: Refusing update from remote peer 8842e199254b4768ab201242f482a791: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:27.043031 13926 consensus_queue.cc:1048] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:27.052356 13793 raft_consensus.cc:1275] T ccd69abb9a7b4ffeb3f617d838543e56 P afe706ec6f1b4a91ac57d9450c1d0432 [term 2 FOLLOWER]: Refusing update from remote peer 8842e199254b4768ab201242f482a791: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:27.054083 13915 consensus_queue.cc:1048] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:27.104908 13793 raft_consensus.cc:1275] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432 [term 2 FOLLOWER]: Refusing update from remote peer a2b0f36e36294682a537b51a62b4fbe4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:27.106832 13936 consensus_queue.cc:1048] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:27.115648 13718 raft_consensus.cc:1275] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 2 FOLLOWER]: Refusing update from remote peer a2b0f36e36294682a537b51a62b4fbe4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:27.117682 13936 consensus_queue.cc:1048] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:27.402979 13793 raft_consensus.cc:1275] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [term 2 FOLLOWER]: Refusing update from remote peer 8842e199254b4768ab201242f482a791: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:27.404597 13915 consensus_queue.cc:1048] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:27.410514 13950 raft_consensus.cc:993] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791: : Instructing follower afe706ec6f1b4a91ac57d9450c1d0432 to start an election
I20260709 13:19:27.411051 13926 raft_consensus.cc:1081] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [term 2 LEADER]: Signalling peer afe706ec6f1b4a91ac57d9450c1d0432 to start an election
I20260709 13:19:27.412849 13792 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03f53162e6a64337a785db17f8010b67"
dest_uuid: "afe706ec6f1b4a91ac57d9450c1d0432"
 from {username='slave'} at 127.0.0.1:39334
I20260709 13:19:27.413548 13792 raft_consensus.cc:493] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:27.414018 13792 raft_consensus.cc:3060] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:27.414739 13866 raft_consensus.cc:1275] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 2 FOLLOWER]: Refusing update from remote peer 8842e199254b4768ab201242f482a791: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:27.416712 13950 consensus_queue.cc:1048] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:27.423967 13792 raft_consensus.cc:515] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:27.426988 13792 leader_election.cc:290] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [CANDIDATE]: Term 3 election: Requested vote from peers 8842e199254b4768ab201242f482a791 (127.1.227.129:41703), a2b0f36e36294682a537b51a62b4fbe4 (127.1.227.131:34247)
I20260709 13:19:27.427345 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f53162e6a64337a785db17f8010b67" candidate_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8842e199254b4768ab201242f482a791"
I20260709 13:19:27.428037 13718 raft_consensus.cc:3055] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:27.428392 13718 raft_consensus.cc:740] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8842e199254b4768ab201242f482a791, State: Running, Role: LEADER
I20260709 13:19:27.428767 13866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f53162e6a64337a785db17f8010b67" candidate_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a2b0f36e36294682a537b51a62b4fbe4"
I20260709 13:19:27.429255 13718 consensus_queue.cc:260] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:27.429409 13866 raft_consensus.cc:3060] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:27.430753 13718 raft_consensus.cc:3060] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:27.438035 13718 raft_consensus.cc:2468] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afe706ec6f1b4a91ac57d9450c1d0432 in term 3.
I20260709 13:19:27.438035 13866 raft_consensus.cc:2468] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afe706ec6f1b4a91ac57d9450c1d0432 in term 3.
I20260709 13:19:27.439714 13758 leader_election.cc:304] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8842e199254b4768ab201242f482a791, afe706ec6f1b4a91ac57d9450c1d0432; no voters: 
I20260709 13:19:27.440681 13914 raft_consensus.cc:2804] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:27.441728 13914 raft_consensus.cc:697] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [term 3 LEADER]: Becoming Leader. State: Replica: afe706ec6f1b4a91ac57d9450c1d0432, State: Running, Role: LEADER
I20260709 13:19:27.442759 13914 consensus_queue.cc:237] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } }
I20260709 13:19:27.451738 13614 catalog_manager.cc:5697] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 reported cstate change: term changed from 2 to 3, leader changed from 8842e199254b4768ab201242f482a791 (127.1.227.129) to afe706ec6f1b4a91ac57d9450c1d0432 (127.1.227.130). New cstate: current_term: 3 leader_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8842e199254b4768ab201242f482a791" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afe706ec6f1b4a91ac57d9450c1d0432" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 38885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2b0f36e36294682a537b51a62b4fbe4" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 34247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:27.595732  1934 tablet_server.cc:179] TabletServer@127.1.227.129:0 shutting down...
I20260709 13:19:27.617884  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:27.618563  1934 tablet_replica.cc:333] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791: stopping tablet replica
I20260709 13:19:27.619059  1934 raft_consensus.cc:2243] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:27.619459  1934 raft_consensus.cc:2272] T 03f53162e6a64337a785db17f8010b67 P 8842e199254b4768ab201242f482a791 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:27.621519  1934 tablet_replica.cc:333] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791: stopping tablet replica
I20260709 13:19:27.622071  1934 raft_consensus.cc:2243] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:27.622778  1934 raft_consensus.cc:2272] T 9a20d4d050b343dd9c1643924182c261 P 8842e199254b4768ab201242f482a791 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:27.624994  1934 tablet_replica.cc:333] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791: stopping tablet replica
I20260709 13:19:27.625483  1934 raft_consensus.cc:2243] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:27.625921  1934 raft_consensus.cc:2272] T 3ea2666c48c246dc9dd4b09492b79228 P 8842e199254b4768ab201242f482a791 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:27.627923  1934 tablet_replica.cc:333] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791: stopping tablet replica
I20260709 13:19:27.628494  1934 raft_consensus.cc:2243] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:27.629278  1934 raft_consensus.cc:2272] T ccd69abb9a7b4ffeb3f617d838543e56 P 8842e199254b4768ab201242f482a791 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:27.653110  1934 tablet_server.cc:196] TabletServer@127.1.227.129:0 shutdown complete.
I20260709 13:19:27.666234  1934 tablet_server.cc:179] TabletServer@127.1.227.130:0 shutting down...
I20260709 13:19:27.686239  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:27.686820  1934 tablet_replica.cc:333] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432: stopping tablet replica
I20260709 13:19:27.687361  1934 raft_consensus.cc:2243] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:27.688002  1934 pending_rounds.cc:70] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432: Trying to abort 1 pending ops.
I20260709 13:19:27.688169  1934 pending_rounds.cc:77] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638573853155328 op_type: NO_OP noop_request { }
I20260709 13:19:27.688494  1934 raft_consensus.cc:2889] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:27.688760  1934 raft_consensus.cc:2272] T 03f53162e6a64337a785db17f8010b67 P afe706ec6f1b4a91ac57d9450c1d0432 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:27.691174  1934 tablet_replica.cc:333] T ccd69abb9a7b4ffeb3f617d838543e56 P afe706ec6f1b4a91ac57d9450c1d0432: stopping tablet replica
I20260709 13:19:27.691712  1934 raft_consensus.cc:2243] T ccd69abb9a7b4ffeb3f617d838543e56 P afe706ec6f1b4a91ac57d9450c1d0432 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:27.692131  1934 raft_consensus.cc:2272] T ccd69abb9a7b4ffeb3f617d838543e56 P afe706ec6f1b4a91ac57d9450c1d0432 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:27.694250  1934 tablet_replica.cc:333] T 9a20d4d050b343dd9c1643924182c261 P afe706ec6f1b4a91ac57d9450c1d0432: stopping tablet replica
I20260709 13:19:27.694752  1934 raft_consensus.cc:2243] T 9a20d4d050b343dd9c1643924182c261 P afe706ec6f1b4a91ac57d9450c1d0432 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:27.695182  1934 raft_consensus.cc:2272] T 9a20d4d050b343dd9c1643924182c261 P afe706ec6f1b4a91ac57d9450c1d0432 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:27.698017  1934 tablet_replica.cc:333] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432: stopping tablet replica
I20260709 13:19:27.698511  1934 raft_consensus.cc:2243] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:27.698944  1934 raft_consensus.cc:2272] T 3ea2666c48c246dc9dd4b09492b79228 P afe706ec6f1b4a91ac57d9450c1d0432 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:27.705446 13833 consensus_peers.cc:597] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 -> Peer afe706ec6f1b4a91ac57d9450c1d0432 (127.1.227.130:38885): Couldn't send request to peer afe706ec6f1b4a91ac57d9450c1d0432. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:27.722779  1934 tablet_server.cc:196] TabletServer@127.1.227.130:0 shutdown complete.
I20260709 13:19:27.734699  1934 tablet_server.cc:179] TabletServer@127.1.227.131:0 shutting down...
I20260709 13:19:27.753646  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:27.754310  1934 tablet_replica.cc:333] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4: stopping tablet replica
I20260709 13:19:27.754825  1934 raft_consensus.cc:2243] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:27.755242  1934 raft_consensus.cc:2272] T 03f53162e6a64337a785db17f8010b67 P a2b0f36e36294682a537b51a62b4fbe4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:27.757274  1934 tablet_replica.cc:333] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4: stopping tablet replica
I20260709 13:19:27.757869  1934 raft_consensus.cc:2243] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:27.758266  1934 raft_consensus.cc:2272] T ccd69abb9a7b4ffeb3f617d838543e56 P a2b0f36e36294682a537b51a62b4fbe4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:27.760599  1934 tablet_replica.cc:333] T 9a20d4d050b343dd9c1643924182c261 P a2b0f36e36294682a537b51a62b4fbe4: stopping tablet replica
I20260709 13:19:27.761071  1934 raft_consensus.cc:2243] T 9a20d4d050b343dd9c1643924182c261 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:27.761439  1934 raft_consensus.cc:2272] T 9a20d4d050b343dd9c1643924182c261 P a2b0f36e36294682a537b51a62b4fbe4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:27.763226  1934 tablet_replica.cc:333] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4: stopping tablet replica
I20260709 13:19:27.763669  1934 raft_consensus.cc:2243] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:27.764402  1934 raft_consensus.cc:2272] T 3ea2666c48c246dc9dd4b09492b79228 P a2b0f36e36294682a537b51a62b4fbe4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:27.788894  1934 tablet_server.cc:196] TabletServer@127.1.227.131:0 shutdown complete.
I20260709 13:19:27.802163  1934 master.cc:562] Master@127.1.227.190:35035 shutting down...
I20260709 13:19:27.819180  1934 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:27.819792  1934 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:27.820163  1934 tablet_replica.cc:333] T 00000000000000000000000000000000 P d29646db4a1f4d05bfe7b53bff4c2742: stopping tablet replica
I20260709 13:19:27.839670  1934 master.cc:584] Master@127.1.227.190:35035 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2992 ms)
[----------] 6 tests from LeaderRebalancerTest (342036 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:19:27.867352  1934 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.227.190:45179
I20260709 13:19:27.868494  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:27.873649 13964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:27.874008 13965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:27.875168 13967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:27.876494  1934 server_base.cc:1061] running on GCE node
I20260709 13:19:27.877331  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:27.877506  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:27.877671  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603167877657 us; error 0 us; skew 500 ppm
I20260709 13:19:27.878268  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:27.880586  1934 webserver.cc:533] Webserver started at http://127.1.227.190:44441/ using document root <none> and password file <none>
I20260709 13:19:27.881162  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:27.881422  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:27.881808  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:27.883015  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602825662285-1934-0/minicluster-data/master-0-root/instance:
uuid: "c26ce202eb194784a281ac2aa8ebdb5f"
format_stamp: "Formatted at 2026-07-09 13:19:27 on dist-test-slave-lfdf"
I20260709 13:19:27.887796  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:19:27.891420 13972 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:27.892244  1934 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:19:27.892607  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602825662285-1934-0/minicluster-data/master-0-root
uuid: "c26ce202eb194784a281ac2aa8ebdb5f"
format_stamp: "Formatted at 2026-07-09 13:19:27 on dist-test-slave-lfdf"
I20260709 13:19:27.892890  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602825662285-1934-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602825662285-1934-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602825662285-1934-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:27.906461  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:27.907557  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:27.944542  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.190:45179
I20260709 13:19:27.944679 14023 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.190:45179 every 8 connection(s)
I20260709 13:19:27.948477 14024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:27.959278 14024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f: Bootstrap starting.
I20260709 13:19:27.963766 14024 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:27.967804 14024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f: No bootstrap required, opened a new log
I20260709 13:19:27.969944 14024 raft_consensus.cc:359] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c26ce202eb194784a281ac2aa8ebdb5f" member_type: VOTER }
I20260709 13:19:27.970331 14024 raft_consensus.cc:385] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:27.970511 14024 raft_consensus.cc:740] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c26ce202eb194784a281ac2aa8ebdb5f, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.970985 14024 consensus_queue.cc:260] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c26ce202eb194784a281ac2aa8ebdb5f" member_type: VOTER }
I20260709 13:19:27.971412 14024 raft_consensus.cc:399] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:27.971604 14024 raft_consensus.cc:493] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:27.971810 14024 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:27.979455 14024 raft_consensus.cc:515] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c26ce202eb194784a281ac2aa8ebdb5f" member_type: VOTER }
I20260709 13:19:27.979967 14024 leader_election.cc:304] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c26ce202eb194784a281ac2aa8ebdb5f; no voters: 
I20260709 13:19:27.981173 14024 leader_election.cc:290] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:27.981530 14027 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:27.983193 14027 raft_consensus.cc:697] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f [term 1 LEADER]: Becoming Leader. State: Replica: c26ce202eb194784a281ac2aa8ebdb5f, State: Running, Role: LEADER
I20260709 13:19:27.984081 14024 sys_catalog.cc:565] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:27.984017 14027 consensus_queue.cc:237] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c26ce202eb194784a281ac2aa8ebdb5f" member_type: VOTER }
I20260709 13:19:27.987284 14028 sys_catalog.cc:455] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c26ce202eb194784a281ac2aa8ebdb5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c26ce202eb194784a281ac2aa8ebdb5f" member_type: VOTER } }
I20260709 13:19:27.987224 14029 sys_catalog.cc:455] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c26ce202eb194784a281ac2aa8ebdb5f. Latest consensus state: current_term: 1 leader_uuid: "c26ce202eb194784a281ac2aa8ebdb5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c26ce202eb194784a281ac2aa8ebdb5f" member_type: VOTER } }
I20260709 13:19:27.988168 14029 sys_catalog.cc:458] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:27.988845 14028 sys_catalog.cc:458] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:27.995689 14033 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:28.000932 14033 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:28.002142  1934 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:28.010337 14033 catalog_manager.cc:1383] Generated new cluster ID: cb0ac8852b65442688bdbffb1f44c36b
I20260709 13:19:28.010690 14033 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:28.054275 14033 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:28.055600 14033 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:28.067063 14033 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f: Generated new TSK 0
I20260709 13:19:28.067704 14033 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:28.134018  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:28.140229 14045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:28.141433 14046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:28.143841 14048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:28.143617  1934 server_base.cc:1061] running on GCE node
I20260709 13:19:28.146019  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:28.146220  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:28.146351  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603168146340 us; error 0 us; skew 500 ppm
I20260709 13:19:28.146838  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:28.149250  1934 webserver.cc:533] Webserver started at http://127.1.227.129:39329/ using document root <none> and password file <none>
I20260709 13:19:28.149714  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:28.149960  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:28.150183  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:28.151225  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602825662285-1934-0/minicluster-data/ts-0-root/instance:
uuid: "7ee834a1e7a84598895d25a0d704119d"
format_stamp: "Formatted at 2026-07-09 13:19:28 on dist-test-slave-lfdf"
I20260709 13:19:28.155916  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:19:28.159554 14053 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:28.160512  1934 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:19:28.161017  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602825662285-1934-0/minicluster-data/ts-0-root
uuid: "7ee834a1e7a84598895d25a0d704119d"
format_stamp: "Formatted at 2026-07-09 13:19:28 on dist-test-slave-lfdf"
I20260709 13:19:28.161335  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602825662285-1934-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602825662285-1934-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602825662285-1934-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:28.188607  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:28.190053  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:28.191671  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:28.194973  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:28.195385  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:28.195612  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:28.195761  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:28.237362  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.129:41823
I20260709 13:19:28.237525 14115 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.129:41823 every 8 connection(s)
I20260709 13:19:28.242524  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:28.249769 14120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:28.251341 14121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:28.254539  1934 server_base.cc:1061] running on GCE node
W20260709 13:19:28.256436 14123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:28.257068 14116 heartbeater.cc:344] Connected to a master server at 127.1.227.190:45179
I20260709 13:19:28.257490 14116 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:28.257601  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:28.258061  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:28.258263  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603168258244 us; error 0 us; skew 500 ppm
I20260709 13:19:28.258323 14116 heartbeater.cc:507] Master 127.1.227.190:45179 requested a full tablet report, sending...
I20260709 13:19:28.258924  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:28.260901 13989 ts_manager.cc:194] Registered new tserver with Master: 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823)
I20260709 13:19:28.262089  1934 webserver.cc:533] Webserver started at http://127.1.227.130:38091/ using document root <none> and password file <none>
I20260709 13:19:28.262818  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:28.263067  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:28.263379  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:28.263600 13989 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37600
I20260709 13:19:28.264983  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602825662285-1934-0/minicluster-data/ts-1-root/instance:
uuid: "5954043bd41748caa5fb81fecb7d6aba"
format_stamp: "Formatted at 2026-07-09 13:19:28 on dist-test-slave-lfdf"
I20260709 13:19:28.270172  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:19:28.274123 14128 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:28.275183  1934 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:19:28.275563  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602825662285-1934-0/minicluster-data/ts-1-root
uuid: "5954043bd41748caa5fb81fecb7d6aba"
format_stamp: "Formatted at 2026-07-09 13:19:28 on dist-test-slave-lfdf"
I20260709 13:19:28.275842  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602825662285-1934-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602825662285-1934-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602825662285-1934-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:28.292645  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:28.294078  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:28.296454  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:28.299114  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:28.299363  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:28.299608  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:28.299777  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:28.339752  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.130:45935
I20260709 13:19:28.339843 14190 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.130:45935 every 8 connection(s)
I20260709 13:19:28.344928  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:28.352209 14194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:28.354264 14195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:28.357805  1934 server_base.cc:1061] running on GCE node
W20260709 13:19:28.357672 14197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:28.358153 14191 heartbeater.cc:344] Connected to a master server at 127.1.227.190:45179
I20260709 13:19:28.358847 14191 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:28.359529  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:28.359892  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:28.359892 14191 heartbeater.cc:507] Master 127.1.227.190:45179 requested a full tablet report, sending...
I20260709 13:19:28.360543  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603168360518 us; error 0 us; skew 500 ppm
I20260709 13:19:28.361426  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:28.363016 13989 ts_manager.cc:194] Registered new tserver with Master: 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:28.364467  1934 webserver.cc:533] Webserver started at http://127.1.227.131:34077/ using document root <none> and password file <none>
I20260709 13:19:28.364741 13989 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37602
I20260709 13:19:28.365015  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:28.365242  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:28.365540  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:28.366916  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602825662285-1934-0/minicluster-data/ts-2-root/instance:
uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
format_stamp: "Formatted at 2026-07-09 13:19:28 on dist-test-slave-lfdf"
I20260709 13:19:28.371886  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:19:28.375552 14202 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:28.376570  1934 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:19:28.376895  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602825662285-1934-0/minicluster-data/ts-2-root
uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
format_stamp: "Formatted at 2026-07-09 13:19:28 on dist-test-slave-lfdf"
I20260709 13:19:28.377194  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602825662285-1934-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602825662285-1934-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602825662285-1934-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:28.398641  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:28.399725  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:28.401010  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:28.403496  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:28.403741  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:28.404035  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:28.404208  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:28.445533  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.131:46399
I20260709 13:19:28.445642 14264 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.131:46399 every 8 connection(s)
I20260709 13:19:28.459663 14265 heartbeater.cc:344] Connected to a master server at 127.1.227.190:45179
I20260709 13:19:28.460242 14265 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:28.461030 14265 heartbeater.cc:507] Master 127.1.227.190:45179 requested a full tablet report, sending...
I20260709 13:19:28.463428 13989 ts_manager.cc:194] Registered new tserver with Master: 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:28.463964  1934 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014732546s
I20260709 13:19:28.464920 13989 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37604
I20260709 13:19:28.490725 13989 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37618:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:28.493382 13989 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:28.570005 14156 tablet_service.cc:1511] Processing CreateTablet for tablet 4ddbce866d5b465ab05b190081a9516a (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:28.571516 14156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ddbce866d5b465ab05b190081a9516a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.575544 14155 tablet_service.cc:1511] Processing CreateTablet for tablet a8c53dc94e244a44a022082d00d2bd77 (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:28.577096 14155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c53dc94e244a44a022082d00d2bd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.578384 14226 tablet_service.cc:1511] Processing CreateTablet for tablet 9c271260327e424b981fe0fceeef802e (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:28.578806 14154 tablet_service.cc:1511] Processing CreateTablet for tablet 3fbda8f7a8ee472d98be2fe6e62a14c1 (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:28.579842 14226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c271260327e424b981fe0fceeef802e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.580181 14154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fbda8f7a8ee472d98be2fe6e62a14c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.582592 14081 tablet_service.cc:1511] Processing CreateTablet for tablet 4ddbce866d5b465ab05b190081a9516a (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:28.582855 14153 tablet_service.cc:1511] Processing CreateTablet for tablet 6b5bed5fb52d4094a3f9536ae4a44489 (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:28.583956 14081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ddbce866d5b465ab05b190081a9516a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.584264 14153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b5bed5fb52d4094a3f9536ae4a44489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.584087 14079 tablet_service.cc:1511] Processing CreateTablet for tablet 3fbda8f7a8ee472d98be2fe6e62a14c1 (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:28.586046 14080 tablet_service.cc:1511] Processing CreateTablet for tablet a8c53dc94e244a44a022082d00d2bd77 (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:28.586916 14225 tablet_service.cc:1511] Processing CreateTablet for tablet a51739f6e4b8497ebb8907b488a98ace (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:28.587177 14078 tablet_service.cc:1511] Processing CreateTablet for tablet 6b5bed5fb52d4094a3f9536ae4a44489 (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:28.588261 14225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a51739f6e4b8497ebb8907b488a98ace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.588570 14079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fbda8f7a8ee472d98be2fe6e62a14c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.590965 14227 tablet_service.cc:1511] Processing CreateTablet for tablet 6b5bed5fb52d4094a3f9536ae4a44489 (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:28.592394 14227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b5bed5fb52d4094a3f9536ae4a44489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.594197 14230 tablet_service.cc:1511] Processing CreateTablet for tablet 4ddbce866d5b465ab05b190081a9516a (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:28.594870 14228 tablet_service.cc:1511] Processing CreateTablet for tablet 3fbda8f7a8ee472d98be2fe6e62a14c1 (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:28.595638 14230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ddbce866d5b465ab05b190081a9516a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.597118 14229 tablet_service.cc:1511] Processing CreateTablet for tablet a8c53dc94e244a44a022082d00d2bd77 (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:28.594707 14078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b5bed5fb52d4094a3f9536ae4a44489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.598493 14229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c53dc94e244a44a022082d00d2bd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.599141 14080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c53dc94e244a44a022082d00d2bd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.599288 14228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fbda8f7a8ee472d98be2fe6e62a14c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.600000 14152 tablet_service.cc:1511] Processing CreateTablet for tablet 9c271260327e424b981fe0fceeef802e (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:28.601473 14152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c271260327e424b981fe0fceeef802e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.606910 14151 tablet_service.cc:1511] Processing CreateTablet for tablet a51739f6e4b8497ebb8907b488a98ace (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:28.608368 14151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a51739f6e4b8497ebb8907b488a98ace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.624465 14280 tablet_bootstrap.cc:492] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def: Bootstrap starting.
I20260709 13:19:28.626319 14281 tablet_bootstrap.cc:492] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d: Bootstrap starting.
I20260709 13:19:28.626941 14077 tablet_service.cc:1511] Processing CreateTablet for tablet 9c271260327e424b981fe0fceeef802e (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:28.628376 14077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c271260327e424b981fe0fceeef802e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.630939 14280 tablet_bootstrap.cc:654] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.632477 14281 tablet_bootstrap.cc:654] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.639240 14081 tablet_service.cc:1511] Processing CreateTablet for tablet a51739f6e4b8497ebb8907b488a98ace (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:28.640673 14081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a51739f6e4b8497ebb8907b488a98ace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.643183 14080 tablet_service.cc:1511] Processing CreateTablet for tablet 964474b1f4294f9aae36715d726b18ac (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:28.646438 14150 tablet_service.cc:1511] Processing CreateTablet for tablet 964474b1f4294f9aae36715d726b18ac (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:28.647914 14150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964474b1f4294f9aae36715d726b18ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.662453 14080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964474b1f4294f9aae36715d726b18ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.695466 14280 tablet_bootstrap.cc:492] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def: No bootstrap required, opened a new log
I20260709 13:19:28.696027 14280 ts_tablet_manager.cc:1403] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent bootstrapping tablet: real 0.072s	user 0.026s	sys 0.000s
I20260709 13:19:28.698444 14284 tablet_bootstrap.cc:492] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba: Bootstrap starting.
I20260709 13:19:28.699139 14280 raft_consensus.cc:359] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:28.699928 14280 raft_consensus.cc:385] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.700238 14280 raft_consensus.cc:740] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.702425 14280 consensus_queue.cc:260] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:28.707515 14227 tablet_service.cc:1511] Processing CreateTablet for tablet 964474b1f4294f9aae36715d726b18ac (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:28.709033 14227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964474b1f4294f9aae36715d726b18ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.711987 14153 tablet_service.cc:1511] Processing CreateTablet for tablet 016b3d69ae4b468cbfabb2e8d1b81f16 (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:28.713419 14153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 016b3d69ae4b468cbfabb2e8d1b81f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.708140 14077 tablet_service.cc:1511] Processing CreateTablet for tablet 016b3d69ae4b468cbfabb2e8d1b81f16 (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:28.733476 14265 heartbeater.cc:499] Master 127.1.227.190:45179 was elected leader, sending a full tablet report...
I20260709 13:19:28.733812 14281 tablet_bootstrap.cc:492] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d: No bootstrap required, opened a new log
I20260709 13:19:28.733897 14280 ts_tablet_manager.cc:1434] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent starting tablet: real 0.038s	user 0.016s	sys 0.014s
I20260709 13:19:28.734555 14281 ts_tablet_manager.cc:1403] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d: Time spent bootstrapping tablet: real 0.108s	user 0.008s	sys 0.009s
I20260709 13:19:28.735113 14280 tablet_bootstrap.cc:492] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def: Bootstrap starting.
I20260709 13:19:28.737557 14281 raft_consensus.cc:359] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:28.738325 14281 raft_consensus.cc:385] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.738621 14281 raft_consensus.cc:740] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.739446 14281 consensus_queue.cc:260] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:28.740979 14077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 016b3d69ae4b468cbfabb2e8d1b81f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.751947 14225 tablet_service.cc:1511] Processing CreateTablet for tablet 016b3d69ae4b468cbfabb2e8d1b81f16 (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:28.753340 14225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 016b3d69ae4b468cbfabb2e8d1b81f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.753491 14080 tablet_service.cc:1511] Processing CreateTablet for tablet b15d17578b03487ba9237d3c1c5c34c3 (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:28.754626 14280 tablet_bootstrap.cc:654] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.758564 14150 tablet_service.cc:1511] Processing CreateTablet for tablet b15d17578b03487ba9237d3c1c5c34c3 (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:28.759261 14080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b15d17578b03487ba9237d3c1c5c34c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.759953 14150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b15d17578b03487ba9237d3c1c5c34c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.764133 14227 tablet_service.cc:1511] Processing CreateTablet for tablet b15d17578b03487ba9237d3c1c5c34c3 (DEFAULT_TABLE table=test-workload [id=a751213b0ec74c3d837227ad14e25806]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:28.769948 14284 tablet_bootstrap.cc:654] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.771005 14227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b15d17578b03487ba9237d3c1c5c34c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:28.776149 14116 heartbeater.cc:499] Master 127.1.227.190:45179 was elected leader, sending a full tablet report...
I20260709 13:19:28.785523 14287 raft_consensus.cc:493] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.787524 14281 ts_tablet_manager.cc:1434] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d: Time spent starting tablet: real 0.053s	user 0.017s	sys 0.002s
I20260709 13:19:28.788755 14281 tablet_bootstrap.cc:492] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d: Bootstrap starting.
I20260709 13:19:28.786079 14287 raft_consensus.cc:515] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:28.799535 14280 tablet_bootstrap.cc:492] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def: No bootstrap required, opened a new log
I20260709 13:19:28.803689 14281 tablet_bootstrap.cc:654] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.804790 14280 ts_tablet_manager.cc:1403] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.006s
I20260709 13:19:28.808948 14280 raft_consensus.cc:359] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:28.824934 14280 raft_consensus.cc:385] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.825510 14280 raft_consensus.cc:740] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.826743 14280 consensus_queue.cc:260] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:28.827426 14287 leader_election.cc:290] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:28.830108 14280 ts_tablet_manager.cc:1434] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.002s
I20260709 13:19:28.838368 14280 tablet_bootstrap.cc:492] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def: Bootstrap starting.
I20260709 13:19:28.847013 14280 tablet_bootstrap.cc:654] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.861702 14280 tablet_bootstrap.cc:492] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def: No bootstrap required, opened a new log
I20260709 13:19:28.862622 14280 ts_tablet_manager.cc:1403] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.007s
I20260709 13:19:28.865302 14285 raft_consensus.cc:493] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.866063 14285 raft_consensus.cc:515] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:28.879578 14285 leader_election.cc:290] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:28.889235 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbda8f7a8ee472d98be2fe6e62a14c1" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d" is_pre_election: true
W20260709 13:19:28.891747 14203 leader_election.cc:343] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:28.896574 14280 raft_consensus.cc:359] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:28.897815 14280 raft_consensus.cc:385] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.898293 14280 raft_consensus.cc:740] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.899617 14280 consensus_queue.cc:260] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:28.906760 14280 ts_tablet_manager.cc:1434] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.001s
I20260709 13:19:28.908325 14280 tablet_bootstrap.cc:492] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def: Bootstrap starting.
I20260709 13:19:28.917026 14280 tablet_bootstrap.cc:654] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.927274 14284 tablet_bootstrap.cc:492] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba: No bootstrap required, opened a new log
I20260709 13:19:28.927851 14284 ts_tablet_manager.cc:1403] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba: Time spent bootstrapping tablet: real 0.230s	user 0.052s	sys 0.106s
I20260709 13:19:28.928128 14281 tablet_bootstrap.cc:492] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d: No bootstrap required, opened a new log
I20260709 13:19:28.928702 14281 ts_tablet_manager.cc:1403] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d: Time spent bootstrapping tablet: real 0.140s	user 0.060s	sys 0.067s
I20260709 13:19:28.930464 14280 tablet_bootstrap.cc:492] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def: No bootstrap required, opened a new log
I20260709 13:19:28.931118 14280 ts_tablet_manager.cc:1403] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 13:19:28.930805 14284 raft_consensus.cc:359] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:28.931598 14284 raft_consensus.cc:385] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.931936 14284 raft_consensus.cc:740] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.931784 14281 raft_consensus.cc:359] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:28.932696 14281 raft_consensus.cc:385] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.933029 14281 raft_consensus.cc:740] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.932962 14284 consensus_queue.cc:260] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:28.934036 14281 consensus_queue.cc:260] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:28.935250 14280 raft_consensus.cc:359] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:28.936062 14280 raft_consensus.cc:385] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.936403 14280 raft_consensus.cc:740] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.934468 14166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddbce866d5b465ab05b190081a9516a" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba" is_pre_election: true
I20260709 13:19:28.939528 14280 consensus_queue.cc:260] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:28.941203 14281 ts_tablet_manager.cc:1434] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:19:28.942387 14281 tablet_bootstrap.cc:492] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d: Bootstrap starting.
I20260709 13:19:28.941376 14240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddbce866d5b465ab05b190081a9516a" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" is_pre_election: true
W20260709 13:19:28.947008 14057 leader_election.cc:343] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:28.948635 14281 tablet_bootstrap.cc:654] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:28.951345 14056 leader_election.cc:343] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:28.952044 14056 leader_election.cc:304] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ee834a1e7a84598895d25a0d704119d; no voters: 56d11c1d43ec4f85956fcfa2d6b03def, 5954043bd41748caa5fb81fecb7d6aba
I20260709 13:19:28.953652 14287 raft_consensus.cc:2749] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:28.956550 14285 raft_consensus.cc:493] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.957305 14285 raft_consensus.cc:515] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:28.961166 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c53dc94e244a44a022082d00d2bd77" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d" is_pre_election: true
I20260709 13:19:28.961798 14285 leader_election.cc:290] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:28.962275 14091 raft_consensus.cc:2468] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 0.
I20260709 13:19:28.962458 14280 ts_tablet_manager.cc:1434] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:19:28.964032 14203 leader_election.cc:304] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:28.964597 14284 ts_tablet_manager.cc:1434] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba: Time spent starting tablet: real 0.036s	user 0.011s	sys 0.020s
I20260709 13:19:28.965571 14280 tablet_bootstrap.cc:492] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def: Bootstrap starting.
I20260709 13:19:28.967567 14285 raft_consensus.cc:2804] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:28.968156 14285 raft_consensus.cc:493] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.968595 14285 raft_consensus.cc:3060] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.970582 14166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbda8f7a8ee472d98be2fe6e62a14c1" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba" is_pre_election: true
I20260709 13:19:28.971416 14165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c53dc94e244a44a022082d00d2bd77" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba" is_pre_election: true
W20260709 13:19:28.972231 14205 leader_election.cc:343] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:28.972812 14205 leader_election.cc:304] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def; no voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d
I20260709 13:19:28.977085 14280 tablet_bootstrap.cc:654] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:28.983112 14285 raft_consensus.cc:515] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:28.985217 14281 tablet_bootstrap.cc:492] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d: No bootstrap required, opened a new log
I20260709 13:19:28.986058 14281 ts_tablet_manager.cc:1403] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.021s
I20260709 13:19:28.986953 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c53dc94e244a44a022082d00d2bd77" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:28.987736 14091 raft_consensus.cc:3060] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:28.990324 14281 raft_consensus.cc:359] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:28.991453 14281 raft_consensus.cc:385] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:28.993468 14281 raft_consensus.cc:740] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.994633 14281 consensus_queue.cc:260] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
W20260709 13:19:28.995779 14037 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:28.999737 14191 heartbeater.cc:499] Master 127.1.227.190:45179 was elected leader, sending a full tablet report...
I20260709 13:19:29.000137 14281 ts_tablet_manager.cc:1434] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:19:29.000164 14284 tablet_bootstrap.cc:492] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba: Bootstrap starting.
I20260709 13:19:29.001434 14281 tablet_bootstrap.cc:492] T a51739f6e4b8497ebb8907b488a98ace P 7ee834a1e7a84598895d25a0d704119d: Bootstrap starting.
I20260709 13:19:29.007530 14284 tablet_bootstrap.cc:654] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.008312 14281 tablet_bootstrap.cc:654] T a51739f6e4b8497ebb8907b488a98ace P 7ee834a1e7a84598895d25a0d704119d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.014680 14091 raft_consensus.cc:2468] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 1.
I20260709 13:19:29.016582 14203 leader_election.cc:304] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 7ee834a1e7a84598895d25a0d704119d; no voters: 
W20260709 13:19:29.024353 14205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.130:45935, user_credentials={real_user=slave}} blocked reactor thread for 52418.8us
W20260709 13:19:29.025612 14205 leader_election.cc:343] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:29.024485 14298 raft_consensus.cc:2749] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:29.025688 14285 leader_election.cc:290] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:29.028131 14165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c53dc94e244a44a022082d00d2bd77" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:29.028985 14285 raft_consensus.cc:2804] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:29.029549 14285 raft_consensus.cc:697] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Becoming Leader. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Running, Role: LEADER
W20260709 13:19:29.030925 14205 leader_election.cc:343] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:29.030670 14285 consensus_queue.cc:237] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.032689 14280 tablet_bootstrap.cc:492] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def: No bootstrap required, opened a new log
I20260709 13:19:29.033536 14280 ts_tablet_manager.cc:1403] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent bootstrapping tablet: real 0.068s	user 0.030s	sys 0.004s
I20260709 13:19:29.034101 14284 tablet_bootstrap.cc:492] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba: No bootstrap required, opened a new log
I20260709 13:19:29.034782 14284 ts_tablet_manager.cc:1403] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.004s
I20260709 13:19:29.039446 14284 raft_consensus.cc:359] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.040518 14284 raft_consensus.cc:385] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.040937 14284 raft_consensus.cc:740] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.042188 14284 consensus_queue.cc:260] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.043572 14281 tablet_bootstrap.cc:492] T a51739f6e4b8497ebb8907b488a98ace P 7ee834a1e7a84598895d25a0d704119d: No bootstrap required, opened a new log
I20260709 13:19:29.044220 14281 ts_tablet_manager.cc:1403] T a51739f6e4b8497ebb8907b488a98ace P 7ee834a1e7a84598895d25a0d704119d: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.025s
I20260709 13:19:29.044515 14280 raft_consensus.cc:359] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.044950 14284 ts_tablet_manager.cc:1434] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:19:29.045362 14280 raft_consensus.cc:385] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.045775 14280 raft_consensus.cc:740] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.046288 14284 tablet_bootstrap.cc:492] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba: Bootstrap starting.
I20260709 13:19:29.046609 14280 consensus_queue.cc:260] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.047823 14281 raft_consensus.cc:359] T a51739f6e4b8497ebb8907b488a98ace P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.048673 14281 raft_consensus.cc:385] T a51739f6e4b8497ebb8907b488a98ace P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.049085 14280 ts_tablet_manager.cc:1434] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.003s
I20260709 13:19:29.049024 14281 raft_consensus.cc:740] T a51739f6e4b8497ebb8907b488a98ace P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.050235 14280 tablet_bootstrap.cc:492] T a51739f6e4b8497ebb8907b488a98ace P 56d11c1d43ec4f85956fcfa2d6b03def: Bootstrap starting.
I20260709 13:19:29.050146 14281 consensus_queue.cc:260] T a51739f6e4b8497ebb8907b488a98ace P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.054319 14284 tablet_bootstrap.cc:654] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.055693 14281 ts_tablet_manager.cc:1434] T a51739f6e4b8497ebb8907b488a98ace P 7ee834a1e7a84598895d25a0d704119d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:19:29.056915 14281 tablet_bootstrap.cc:492] T 9c271260327e424b981fe0fceeef802e P 7ee834a1e7a84598895d25a0d704119d: Bootstrap starting.
I20260709 13:19:29.064102 14281 tablet_bootstrap.cc:654] T 9c271260327e424b981fe0fceeef802e P 7ee834a1e7a84598895d25a0d704119d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.066920 14284 tablet_bootstrap.cc:492] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba: No bootstrap required, opened a new log
I20260709 13:19:29.067587 14284 ts_tablet_manager.cc:1403] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.005s
I20260709 13:19:29.069500 13987 catalog_manager.cc:5697] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def reported cstate change: term changed from 0 to 1, leader changed from <none> to 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131). New cstate: current_term: 1 leader_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:29.071280 14284 raft_consensus.cc:359] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.072181 14284 raft_consensus.cc:385] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.072523 14284 raft_consensus.cc:740] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.073606 14284 consensus_queue.cc:260] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.075894 14280 tablet_bootstrap.cc:654] T a51739f6e4b8497ebb8907b488a98ace P 56d11c1d43ec4f85956fcfa2d6b03def: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.076941 14281 tablet_bootstrap.cc:492] T 9c271260327e424b981fe0fceeef802e P 7ee834a1e7a84598895d25a0d704119d: No bootstrap required, opened a new log
I20260709 13:19:29.077682 14281 ts_tablet_manager.cc:1403] T 9c271260327e424b981fe0fceeef802e P 7ee834a1e7a84598895d25a0d704119d: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:19:29.079867 14284 ts_tablet_manager.cc:1434] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:19:29.081342 14284 tablet_bootstrap.cc:492] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba: Bootstrap starting.
I20260709 13:19:29.081135 14281 raft_consensus.cc:359] T 9c271260327e424b981fe0fceeef802e P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.082254 14281 raft_consensus.cc:385] T 9c271260327e424b981fe0fceeef802e P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.082703 14281 raft_consensus.cc:740] T 9c271260327e424b981fe0fceeef802e P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.083637 14281 consensus_queue.cc:260] T 9c271260327e424b981fe0fceeef802e P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.089192 14281 ts_tablet_manager.cc:1434] T 9c271260327e424b981fe0fceeef802e P 7ee834a1e7a84598895d25a0d704119d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:19:29.090453 14284 tablet_bootstrap.cc:654] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.090787 14281 tablet_bootstrap.cc:492] T 964474b1f4294f9aae36715d726b18ac P 7ee834a1e7a84598895d25a0d704119d: Bootstrap starting.
I20260709 13:19:29.099375 14281 tablet_bootstrap.cc:654] T 964474b1f4294f9aae36715d726b18ac P 7ee834a1e7a84598895d25a0d704119d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.104437 14280 tablet_bootstrap.cc:492] T a51739f6e4b8497ebb8907b488a98ace P 56d11c1d43ec4f85956fcfa2d6b03def: No bootstrap required, opened a new log
I20260709 13:19:29.105242 14280 ts_tablet_manager.cc:1403] T a51739f6e4b8497ebb8907b488a98ace P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.000s
I20260709 13:19:29.108656 14284 tablet_bootstrap.cc:492] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba: No bootstrap required, opened a new log
I20260709 13:19:29.109256 14284 ts_tablet_manager.cc:1403] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.004s
I20260709 13:19:29.110028 14280 raft_consensus.cc:359] T a51739f6e4b8497ebb8907b488a98ace P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.111307 14280 raft_consensus.cc:385] T a51739f6e4b8497ebb8907b488a98ace P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.112002 14280 raft_consensus.cc:740] T a51739f6e4b8497ebb8907b488a98ace P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.112109 14284 raft_consensus.cc:359] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.113025 14284 raft_consensus.cc:385] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.113399 14284 raft_consensus.cc:740] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.113320 14280 consensus_queue.cc:260] T a51739f6e4b8497ebb8907b488a98ace P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.114683 14284 consensus_queue.cc:260] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.115521 14281 tablet_bootstrap.cc:492] T 964474b1f4294f9aae36715d726b18ac P 7ee834a1e7a84598895d25a0d704119d: No bootstrap required, opened a new log
I20260709 13:19:29.116183 14281 ts_tablet_manager.cc:1403] T 964474b1f4294f9aae36715d726b18ac P 7ee834a1e7a84598895d25a0d704119d: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.000s
I20260709 13:19:29.117622 14284 ts_tablet_manager.cc:1434] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:19:29.118952 14284 tablet_bootstrap.cc:492] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba: Bootstrap starting.
I20260709 13:19:29.119927 14280 ts_tablet_manager.cc:1434] T a51739f6e4b8497ebb8907b488a98ace P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:19:29.121143 14280 tablet_bootstrap.cc:492] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def: Bootstrap starting.
I20260709 13:19:29.122375 14281 raft_consensus.cc:359] T 964474b1f4294f9aae36715d726b18ac P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.124048 14281 raft_consensus.cc:385] T 964474b1f4294f9aae36715d726b18ac P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.124468 14281 raft_consensus.cc:740] T 964474b1f4294f9aae36715d726b18ac P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.125496 14281 consensus_queue.cc:260] T 964474b1f4294f9aae36715d726b18ac P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.126303 14284 tablet_bootstrap.cc:654] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.131917 14281 ts_tablet_manager.cc:1434] T 964474b1f4294f9aae36715d726b18ac P 7ee834a1e7a84598895d25a0d704119d: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.006s
I20260709 13:19:29.133662 14281 tablet_bootstrap.cc:492] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d: Bootstrap starting.
I20260709 13:19:29.144048 14281 tablet_bootstrap.cc:654] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.145149 14280 tablet_bootstrap.cc:654] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.150867 14280 tablet_bootstrap.cc:492] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def: No bootstrap required, opened a new log
I20260709 13:19:29.151383 14280 ts_tablet_manager.cc:1403] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 13:19:29.153913 14280 raft_consensus.cc:359] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.154734 14280 raft_consensus.cc:385] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.155037 14280 raft_consensus.cc:740] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.155889 14280 consensus_queue.cc:260] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.156355 14284 tablet_bootstrap.cc:492] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba: No bootstrap required, opened a new log
I20260709 13:19:29.157078 14284 ts_tablet_manager.cc:1403] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.017s
I20260709 13:19:29.157860 14281 tablet_bootstrap.cc:492] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d: No bootstrap required, opened a new log
I20260709 13:19:29.158493 14281 ts_tablet_manager.cc:1403] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.007s
I20260709 13:19:29.158857 14280 ts_tablet_manager.cc:1434] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:29.160086 14280 tablet_bootstrap.cc:492] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 56d11c1d43ec4f85956fcfa2d6b03def: Bootstrap starting.
I20260709 13:19:29.161669 14281 raft_consensus.cc:359] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.162639 14281 raft_consensus.cc:385] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.162083 14284 raft_consensus.cc:359] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.162987 14281 raft_consensus.cc:740] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.163503 14284 raft_consensus.cc:385] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.164139 14284 raft_consensus.cc:740] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.165171 14284 consensus_queue.cc:260] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.165189 14281 consensus_queue.cc:260] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.168280 14284 ts_tablet_manager.cc:1434] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.002s
I20260709 13:19:29.168560 14281 ts_tablet_manager.cc:1434] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:19:29.169605 14284 tablet_bootstrap.cc:492] T 4ddbce866d5b465ab05b190081a9516a P 5954043bd41748caa5fb81fecb7d6aba: Bootstrap starting.
I20260709 13:19:29.171388 14280 tablet_bootstrap.cc:654] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 56d11c1d43ec4f85956fcfa2d6b03def: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.173475 14281 tablet_bootstrap.cc:492] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d: Bootstrap starting.
I20260709 13:19:29.178815 14284 tablet_bootstrap.cc:654] T 4ddbce866d5b465ab05b190081a9516a P 5954043bd41748caa5fb81fecb7d6aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.181622 14281 tablet_bootstrap.cc:654] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.184893 14280 tablet_bootstrap.cc:492] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 56d11c1d43ec4f85956fcfa2d6b03def: No bootstrap required, opened a new log
I20260709 13:19:29.185631 14280 ts_tablet_manager.cc:1403] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.000s
I20260709 13:19:29.188879 14280 raft_consensus.cc:359] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.189759 14280 raft_consensus.cc:385] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.190181 14280 raft_consensus.cc:740] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.190982 14280 consensus_queue.cc:260] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.191974 14284 tablet_bootstrap.cc:492] T 4ddbce866d5b465ab05b190081a9516a P 5954043bd41748caa5fb81fecb7d6aba: No bootstrap required, opened a new log
I20260709 13:19:29.192581 14284 ts_tablet_manager.cc:1403] T 4ddbce866d5b465ab05b190081a9516a P 5954043bd41748caa5fb81fecb7d6aba: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.012s
I20260709 13:19:29.193146 14280 ts_tablet_manager.cc:1434] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:29.194278 14280 tablet_bootstrap.cc:492] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def: Bootstrap starting.
I20260709 13:19:29.196015 14284 raft_consensus.cc:359] T 4ddbce866d5b465ab05b190081a9516a P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.196830 14284 raft_consensus.cc:385] T 4ddbce866d5b465ab05b190081a9516a P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.197139 14284 raft_consensus.cc:740] T 4ddbce866d5b465ab05b190081a9516a P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.198081 14284 consensus_queue.cc:260] T 4ddbce866d5b465ab05b190081a9516a P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.199271 14281 tablet_bootstrap.cc:492] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d: No bootstrap required, opened a new log
I20260709 13:19:29.199872 14281 ts_tablet_manager.cc:1403] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.004s
I20260709 13:19:29.200631 14284 ts_tablet_manager.cc:1434] T 4ddbce866d5b465ab05b190081a9516a P 5954043bd41748caa5fb81fecb7d6aba: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 13:19:29.200665 14280 tablet_bootstrap.cc:654] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.202111 14284 tablet_bootstrap.cc:492] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba: Bootstrap starting.
I20260709 13:19:29.202972 14281 raft_consensus.cc:359] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.203841 14281 raft_consensus.cc:385] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.204160 14281 raft_consensus.cc:740] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.205148 14281 consensus_queue.cc:260] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.207501 14281 ts_tablet_manager.cc:1434] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:29.208532 14281 tablet_bootstrap.cc:492] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 7ee834a1e7a84598895d25a0d704119d: Bootstrap starting.
I20260709 13:19:29.215256 14281 tablet_bootstrap.cc:654] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 7ee834a1e7a84598895d25a0d704119d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.217224 14284 tablet_bootstrap.cc:654] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.228861 14280 tablet_bootstrap.cc:492] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def: No bootstrap required, opened a new log
I20260709 13:19:29.229316 14280 ts_tablet_manager.cc:1403] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.007s
I20260709 13:19:29.230129 14281 tablet_bootstrap.cc:492] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 7ee834a1e7a84598895d25a0d704119d: No bootstrap required, opened a new log
I20260709 13:19:29.230726 14281 ts_tablet_manager.cc:1403] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 7ee834a1e7a84598895d25a0d704119d: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.007s
I20260709 13:19:29.230742 14284 tablet_bootstrap.cc:492] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba: No bootstrap required, opened a new log
I20260709 13:19:29.231385 14284 ts_tablet_manager.cc:1403] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.012s
I20260709 13:19:29.231520 14280 raft_consensus.cc:359] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.232172 14280 raft_consensus.cc:385] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.232409 14280 raft_consensus.cc:740] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.233038 14280 consensus_queue.cc:260] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.233911 14281 raft_consensus.cc:359] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.234705 14281 raft_consensus.cc:385] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.234887 14280 ts_tablet_manager.cc:1434] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:19:29.234596 14284 raft_consensus.cc:359] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.235139 14281 raft_consensus.cc:740] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.235565 14284 raft_consensus.cc:385] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.236227 14285 raft_consensus.cc:493] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.236009 14281 consensus_queue.cc:260] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.236779 14287 raft_consensus.cc:493] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.236734 14285 raft_consensus.cc:515] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.237442 14287 raft_consensus.cc:515] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.239809 14287 leader_election.cc:290] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:29.241300 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b5bed5fb52d4094a3f9536ae4a44489" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d" is_pre_election: true
I20260709 13:19:29.242034 14165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbda8f7a8ee472d98be2fe6e62a14c1" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba" is_pre_election: true
I20260709 13:19:29.242370 14091 raft_consensus.cc:2468] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 0.
I20260709 13:19:29.243772 14240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbda8f7a8ee472d98be2fe6e62a14c1" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" is_pre_election: true
I20260709 13:19:29.244329 14203 leader_election.cc:304] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 7ee834a1e7a84598895d25a0d704119d; no voters: 
W20260709 13:19:29.245160 14056 leader_election.cc:343] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:29.245990 14296 raft_consensus.cc:493] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.246506 14296 raft_consensus.cc:515] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.246757 14301 raft_consensus.cc:2804] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:29.246671 14285 leader_election.cc:290] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:29.247471 14301 raft_consensus.cc:493] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.247901 14301 raft_consensus.cc:3060] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.236063 14284 raft_consensus.cc:740] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.248577 14165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b5bed5fb52d4094a3f9536ae4a44489" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba" is_pre_election: true
I20260709 13:19:29.249254 14165 raft_consensus.cc:2468] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 0.
I20260709 13:19:29.249142 14284 consensus_queue.cc:260] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.244421 14240 raft_consensus.cc:2468] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 0.
I20260709 13:19:29.252642 14057 leader_election.cc:304] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 7ee834a1e7a84598895d25a0d704119d; no voters: 5954043bd41748caa5fb81fecb7d6aba
I20260709 13:19:29.254633 14321 raft_consensus.cc:2804] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:29.255076 14321 raft_consensus.cc:493] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.255411 14321 raft_consensus.cc:3060] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.255721 14281 ts_tablet_manager.cc:1434] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 7ee834a1e7a84598895d25a0d704119d: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.015s
I20260709 13:19:29.255903 14301 raft_consensus.cc:515] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.263017 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b5bed5fb52d4094a3f9536ae4a44489" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:29.263950 14091 raft_consensus.cc:3060] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.264370 14165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b5bed5fb52d4094a3f9536ae4a44489" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:29.265008 14165 raft_consensus.cc:3060] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.272383 14296 leader_election.cc:290] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:29.276353 14091 raft_consensus.cc:2468] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 1.
I20260709 13:19:29.278137 14203 leader_election.cc:304] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:29.279114 14284 ts_tablet_manager.cc:1434] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba: Time spent starting tablet: real 0.047s	user 0.022s	sys 0.010s
I20260709 13:19:29.279239 14285 raft_consensus.cc:2804] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:29.279961 14285 raft_consensus.cc:697] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Becoming Leader. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Running, Role: LEADER
I20260709 13:19:29.280045 14165 raft_consensus.cc:2468] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 1.
I20260709 13:19:29.280558 14284 tablet_bootstrap.cc:492] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 5954043bd41748caa5fb81fecb7d6aba: Bootstrap starting.
I20260709 13:19:29.280966 14285 consensus_queue.cc:237] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.288472 14321 raft_consensus.cc:515] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.289049 14284 tablet_bootstrap.cc:654] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 5954043bd41748caa5fb81fecb7d6aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.289426 14322 raft_consensus.cc:493] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.263056 14301 leader_election.cc:290] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:29.290098 14322 raft_consensus.cc:515] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.297811 14322 leader_election.cc:290] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:29.302686 14165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbda8f7a8ee472d98be2fe6e62a14c1" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
W20260709 13:19:29.304385 14056 leader_election.cc:343] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:29.307480 14321 leader_election.cc:290] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 election: Requested vote from peers 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:29.307756 14240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbda8f7a8ee472d98be2fe6e62a14c1" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:29.309374 14240 raft_consensus.cc:3060] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.308439 14301 raft_consensus.cc:493] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.310197 14301 raft_consensus.cc:515] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.312235 14284 tablet_bootstrap.cc:492] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 5954043bd41748caa5fb81fecb7d6aba: No bootstrap required, opened a new log
I20260709 13:19:29.312805 14284 ts_tablet_manager.cc:1403] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 5954043bd41748caa5fb81fecb7d6aba: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.009s
I20260709 13:19:29.315029 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddbce866d5b465ab05b190081a9516a" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d" is_pre_election: true
I20260709 13:19:29.315761 14284 raft_consensus.cc:359] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.316272 14165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddbce866d5b465ab05b190081a9516a" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba" is_pre_election: true
I20260709 13:19:29.316579 14284 raft_consensus.cc:385] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.316896 14284 raft_consensus.cc:740] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.316987 14165 raft_consensus.cc:2468] T 4ddbce866d5b465ab05b190081a9516a P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 0.
I20260709 13:19:29.317694 14284 consensus_queue.cc:260] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.318598 14205 leader_election.cc:304] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 5954043bd41748caa5fb81fecb7d6aba; no voters: 
I20260709 13:19:29.319485 14298 raft_consensus.cc:2804] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:29.319609 14301 leader_election.cc:290] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:29.319924 14298 raft_consensus.cc:493] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.320057 14284 ts_tablet_manager.cc:1434] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 5954043bd41748caa5fb81fecb7d6aba: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:29.320370 14298 raft_consensus.cc:3060] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.321210 14284 tablet_bootstrap.cc:492] T b15d17578b03487ba9237d3c1c5c34c3 P 5954043bd41748caa5fb81fecb7d6aba: Bootstrap starting.
I20260709 13:19:29.315796 14091 raft_consensus.cc:2468] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 0.
I20260709 13:19:29.328481 14284 tablet_bootstrap.cc:654] T b15d17578b03487ba9237d3c1c5c34c3 P 5954043bd41748caa5fb81fecb7d6aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:29.330648 14296 raft_consensus.cc:493] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.331210 14296 raft_consensus.cc:515] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.333374 14296 leader_election.cc:290] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:29.338176 14239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964474b1f4294f9aae36715d726b18ac" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" is_pre_election: true
I20260709 13:19:29.338575 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964474b1f4294f9aae36715d726b18ac" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d" is_pre_election: true
I20260709 13:19:29.339001 14239 raft_consensus.cc:2468] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 0.
I20260709 13:19:29.340041 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51739f6e4b8497ebb8907b488a98ace" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d" is_pre_election: true
I20260709 13:19:29.340868 14090 raft_consensus.cc:2468] T a51739f6e4b8497ebb8907b488a98ace P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 0.
I20260709 13:19:29.341121 14237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016b3d69ae4b468cbfabb2e8d1b81f16" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" is_pre_election: true
I20260709 13:19:29.341856 14237 raft_consensus.cc:2468] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 0.
I20260709 13:19:29.342118 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016b3d69ae4b468cbfabb2e8d1b81f16" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d" is_pre_election: true
I20260709 13:19:29.340197 14238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51739f6e4b8497ebb8907b488a98ace" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" is_pre_election: true
I20260709 13:19:29.342796 14089 raft_consensus.cc:2468] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 0.
I20260709 13:19:29.342903 14238 raft_consensus.cc:2468] T a51739f6e4b8497ebb8907b488a98ace P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 0.
I20260709 13:19:29.343428 14240 raft_consensus.cc:2468] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 1.
I20260709 13:19:29.339215 14091 raft_consensus.cc:2468] T 964474b1f4294f9aae36715d726b18ac P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 0.
I20260709 13:19:29.344578 14132 leader_election.cc:304] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 5954043bd41748caa5fb81fecb7d6aba; no voters: 
I20260709 13:19:29.344578 14129 leader_election.cc:304] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:29.345870 14296 raft_consensus.cc:2804] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:29.345548 14057 leader_election.cc:304] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 7ee834a1e7a84598895d25a0d704119d; no voters: 5954043bd41748caa5fb81fecb7d6aba
I20260709 13:19:29.346290 14296 raft_consensus.cc:493] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.346642 14296 raft_consensus.cc:3060] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.347640 14321 raft_consensus.cc:2804] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:29.348480 14321 raft_consensus.cc:697] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [term 1 LEADER]: Becoming Leader. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Running, Role: LEADER
I20260709 13:19:29.336597 13989 catalog_manager.cc:5697] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def reported cstate change: term changed from 0 to 1, leader changed from <none> to 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131). New cstate: current_term: 1 leader_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:29.349781 14321 consensus_queue.cc:237] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.351647 14301 raft_consensus.cc:493] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.352154 14301 raft_consensus.cc:515] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.345650 14132 leader_election.cc:304] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 5954043bd41748caa5fb81fecb7d6aba; no voters: 
I20260709 13:19:29.356876 14322 raft_consensus.cc:2804] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:29.357439 14322 raft_consensus.cc:493] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.357929 14322 raft_consensus.cc:3060] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.359279 14301 leader_election.cc:290] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:29.359118 14296 raft_consensus.cc:515] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.361006 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c271260327e424b981fe0fceeef802e" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d" is_pre_election: true
I20260709 13:19:29.361721 14091 raft_consensus.cc:2468] T 9c271260327e424b981fe0fceeef802e P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 0.
I20260709 13:19:29.362895 14203 leader_election.cc:304] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:29.363281 14165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c271260327e424b981fe0fceeef802e" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba" is_pre_election: true
I20260709 13:19:29.364331 14165 raft_consensus.cc:2468] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 0.
I20260709 13:19:29.364786 14296 leader_election.cc:290] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:29.365404 14296 raft_consensus.cc:2804] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:29.365536 14301 raft_consensus.cc:2804] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:29.365816 14296 raft_consensus.cc:493] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.366035 14301 raft_consensus.cc:493] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.366259 14296 raft_consensus.cc:3060] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.366429 14301 raft_consensus.cc:3060] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.368310 14287 raft_consensus.cc:493] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.369150 14287 raft_consensus.cc:515] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.372567 14287 leader_election.cc:290] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:29.374683 14296 raft_consensus.cc:515] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.376230 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964474b1f4294f9aae36715d726b18ac" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:29.330685 14298 raft_consensus.cc:515] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.376637 14165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15d17578b03487ba9237d3c1c5c34c3" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba" is_pre_election: true
I20260709 13:19:29.382165 14284 tablet_bootstrap.cc:492] T b15d17578b03487ba9237d3c1c5c34c3 P 5954043bd41748caa5fb81fecb7d6aba: No bootstrap required, opened a new log
I20260709 13:19:29.382789 14284 ts_tablet_manager.cc:1403] T b15d17578b03487ba9237d3c1c5c34c3 P 5954043bd41748caa5fb81fecb7d6aba: Time spent bootstrapping tablet: real 0.062s	user 0.040s	sys 0.018s
W20260709 13:19:29.383584 14056 leader_election.cc:343] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:29.384487 14089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddbce866d5b465ab05b190081a9516a" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:29.385133 14089 raft_consensus.cc:3060] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.376893 14091 raft_consensus.cc:3060] T 964474b1f4294f9aae36715d726b18ac P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.386428 14301 raft_consensus.cc:515] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.389142 14284 raft_consensus.cc:359] T b15d17578b03487ba9237d3c1c5c34c3 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.389863 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016b3d69ae4b468cbfabb2e8d1b81f16" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:29.390147 14284 raft_consensus.cc:385] T b15d17578b03487ba9237d3c1c5c34c3 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:29.390525 14284 raft_consensus.cc:740] T b15d17578b03487ba9237d3c1c5c34c3 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.390563 14090 raft_consensus.cc:3060] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.391584 14284 consensus_queue.cc:260] T b15d17578b03487ba9237d3c1c5c34c3 P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.391085 14298 leader_election.cc:290] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:29.393608 14328 raft_consensus.cc:493] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.390393 14238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15d17578b03487ba9237d3c1c5c34c3" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" is_pre_election: true
I20260709 13:19:29.396247 14301 leader_election.cc:290] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:29.397363 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c271260327e424b981fe0fceeef802e" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:29.394358 14328 raft_consensus.cc:515] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.398396 14088 raft_consensus.cc:3060] T 9c271260327e424b981fe0fceeef802e P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.400933 14087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbda8f7a8ee472d98be2fe6e62a14c1" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d" is_pre_election: true
I20260709 13:19:29.401777 14328 leader_election.cc:290] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:29.402254 14238 raft_consensus.cc:2468] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 0.
I20260709 13:19:29.403930 14091 raft_consensus.cc:2468] T 964474b1f4294f9aae36715d726b18ac P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 1.
I20260709 13:19:29.404922 14237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964474b1f4294f9aae36715d726b18ac" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:29.406060 14129 leader_election.cc:304] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:29.405571 14237 raft_consensus.cc:3060] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.376922 14296 leader_election.cc:290] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:29.413129 14322 raft_consensus.cc:515] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.414381 14238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016b3d69ae4b468cbfabb2e8d1b81f16" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:29.415162 14328 raft_consensus.cc:2804] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:29.416077 14166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c271260327e424b981fe0fceeef802e" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:29.411772 14165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddbce866d5b465ab05b190081a9516a" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:29.390600 13989 catalog_manager.cc:5697] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ee834a1e7a84598895d25a0d704119d (127.1.227.129). New cstate: current_term: 1 leader_uuid: "7ee834a1e7a84598895d25a0d704119d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.424418 14057 leader_election.cc:304] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 7ee834a1e7a84598895d25a0d704119d; no voters: 5954043bd41748caa5fb81fecb7d6aba
I20260709 13:19:29.441428 14238 raft_consensus.cc:3060] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.444559 14237 raft_consensus.cc:2468] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 1.
I20260709 13:19:29.445818 14165 raft_consensus.cc:3060] T 4ddbce866d5b465ab05b190081a9516a P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.446094 14321 raft_consensus.cc:2804] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:29.446303 14166 raft_consensus.cc:3060] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.446682 14321 raft_consensus.cc:493] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.447114 14321 raft_consensus.cc:3060] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.449096 14090 raft_consensus.cc:2468] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 1.
I20260709 13:19:29.440539 14296 raft_consensus.cc:493] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.450462 14296 raft_consensus.cc:515] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.450699 14129 leader_election.cc:304] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:29.452917 14296 leader_election.cc:290] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:29.455114 14321 raft_consensus.cc:515] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.456533 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51739f6e4b8497ebb8907b488a98ace" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:29.457265 14091 raft_consensus.cc:3060] T a51739f6e4b8497ebb8907b488a98ace P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.458104 14321 leader_election.cc:290] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 election: Requested vote from peers 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:29.462078 14284 ts_tablet_manager.cc:1434] T b15d17578b03487ba9237d3c1c5c34c3 P 5954043bd41748caa5fb81fecb7d6aba: Time spent starting tablet: real 0.079s	user 0.016s	sys 0.042s
I20260709 13:19:29.453491 14296 raft_consensus.cc:2804] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:29.459570 14240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbda8f7a8ee472d98be2fe6e62a14c1" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" is_pre_election: true
I20260709 13:19:29.460805 14328 raft_consensus.cc:697] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Becoming Leader. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Running, Role: LEADER
I20260709 13:19:29.471763 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c53dc94e244a44a022082d00d2bd77" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d" is_pre_election: true
I20260709 13:19:29.473994 14237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15d17578b03487ba9237d3c1c5c34c3" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:29.474382 14090 raft_consensus.cc:2393] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5954043bd41748caa5fb81fecb7d6aba in current term 1: Already voted for candidate 56d11c1d43ec4f85956fcfa2d6b03def in this term.
I20260709 13:19:29.474653 14237 raft_consensus.cc:3060] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.479205 14322 leader_election.cc:290] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:29.479868 14164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15d17578b03487ba9237d3c1c5c34c3" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:29.480954 14164 raft_consensus.cc:3060] T b15d17578b03487ba9237d3c1c5c34c3 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.481003 14239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c53dc94e244a44a022082d00d2bd77" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" is_pre_election: true
I20260709 13:19:29.484223 14236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51739f6e4b8497ebb8907b488a98ace" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:29.485772 14236 raft_consensus.cc:3060] T a51739f6e4b8497ebb8907b488a98ace P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.494560 14240 raft_consensus.cc:2393] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5954043bd41748caa5fb81fecb7d6aba in current term 1: Already voted for candidate 7ee834a1e7a84598895d25a0d704119d in this term.
I20260709 13:19:29.498803 14238 raft_consensus.cc:2468] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 1.
I20260709 13:19:29.500159 14328 consensus_queue.cc:237] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.505324 14296 raft_consensus.cc:697] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Becoming Leader. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Running, Role: LEADER
I20260709 13:19:29.470135 14089 raft_consensus.cc:2468] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 1.
I20260709 13:19:29.545995 14132 leader_election.cc:304] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba; no voters: 56d11c1d43ec4f85956fcfa2d6b03def, 7ee834a1e7a84598895d25a0d704119d
I20260709 13:19:29.568667 14296 consensus_queue.cc:237] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.552645 14165 raft_consensus.cc:2468] T 4ddbce866d5b465ab05b190081a9516a P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 1.
W20260709 13:19:29.576601 14333 log.cc:927] Time spent T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:19:29.578613 14203 leader_election.cc:304] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:29.558128 14164 raft_consensus.cc:2468] T b15d17578b03487ba9237d3c1c5c34c3 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 1.
I20260709 13:19:29.550072 14129 leader_election.cc:304] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba; no voters: 56d11c1d43ec4f85956fcfa2d6b03def, 7ee834a1e7a84598895d25a0d704119d
I20260709 13:19:29.496187 14166 raft_consensus.cc:2468] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 1.
I20260709 13:19:29.563017 14236 raft_consensus.cc:2468] T a51739f6e4b8497ebb8907b488a98ace P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 1.
I20260709 13:19:29.583846 14056 leader_election.cc:304] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:29.585724 14321 raft_consensus.cc:2804] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:29.586369 14321 raft_consensus.cc:697] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [term 1 LEADER]: Becoming Leader. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Running, Role: LEADER
I20260709 13:19:29.587275 14301 consensus_queue.cc:1048] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:19:29.588238 14321 consensus_queue.cc:237] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.588945 14132 leader_election.cc:304] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 5954043bd41748caa5fb81fecb7d6aba; no voters: 
I20260709 13:19:29.582116 14298 raft_consensus.cc:2804] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:29.602458 14298 raft_consensus.cc:697] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Becoming Leader. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Running, Role: LEADER
I20260709 13:19:29.590379 14328 raft_consensus.cc:3060] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.592970 14205 leader_election.cc:304] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 5954043bd41748caa5fb81fecb7d6aba; no voters: 
I20260709 13:19:29.565091 14237 raft_consensus.cc:2468] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 1.
I20260709 13:19:29.594125 14332 raft_consensus.cc:3060] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:29.604148 14298 consensus_queue.cc:237] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.620901 14301 raft_consensus.cc:2804] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:29.621894 14301 raft_consensus.cc:697] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Becoming Leader. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Running, Role: LEADER
I20260709 13:19:29.621441 13989 catalog_manager.cc:5697] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba reported cstate change: term changed from 0 to 1, leader changed from <none> to 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130). New cstate: current_term: 1 leader_uuid: "5954043bd41748caa5fb81fecb7d6aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.624071 14301 consensus_queue.cc:237] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.624713 13989 catalog_manager.cc:5697] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba reported cstate change: term changed from 0 to 1, leader changed from <none> to 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130). New cstate: current_term: 1 leader_uuid: "5954043bd41748caa5fb81fecb7d6aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.626612 14088 raft_consensus.cc:2468] T 9c271260327e424b981fe0fceeef802e P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 1.
I20260709 13:19:29.631439 14296 raft_consensus.cc:2804] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:29.642338 14296 raft_consensus.cc:697] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Becoming Leader. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Running, Role: LEADER
I20260709 13:19:29.641413 13988 catalog_manager.cc:5697] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ee834a1e7a84598895d25a0d704119d (127.1.227.129). New cstate: current_term: 1 leader_uuid: "7ee834a1e7a84598895d25a0d704119d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.643500 14296 consensus_queue.cc:237] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:29.653149 14332 raft_consensus.cc:2749] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:29.661912 14301 consensus_queue.cc:1048] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:29.677249 14091 raft_consensus.cc:2468] T a51739f6e4b8497ebb8907b488a98ace P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 1.
W20260709 13:19:29.680109 14334 log.cc:927] Time spent T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba: Append to log took a long time: real 0.076s	user 0.006s	sys 0.000s
I20260709 13:19:29.682245 13989 catalog_manager.cc:5697] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def reported cstate change: term changed from 0 to 1, leader changed from <none> to 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131). New cstate: current_term: 1 leader_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:29.686802 14328 raft_consensus.cc:2749] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:29.699651 13988 catalog_manager.cc:5697] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba reported cstate change: term changed from 0 to 1, leader changed from <none> to 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130). New cstate: current_term: 1 leader_uuid: "5954043bd41748caa5fb81fecb7d6aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.704399 13989 catalog_manager.cc:5697] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def reported cstate change: term changed from 0 to 1, leader changed from <none> to 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131). New cstate: current_term: 1 leader_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:29.705288 14338 consensus_queue.cc:1048] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:29.719564 14298 consensus_queue.cc:1048] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:29.749173 14321 consensus_queue.cc:1048] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:29.762300 14321 consensus_queue.cc:1048] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:29.803911 14237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ddbce866d5b465ab05b190081a9516a"
dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
mode: GRACEFUL
new_leader_uuid: "7ee834a1e7a84598895d25a0d704119d"
 from {username='slave'} at 127.0.0.1:56662
I20260709 13:19:29.804634 14237 raft_consensus.cc:606] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Received request to transfer leadership to TS 7ee834a1e7a84598895d25a0d704119d
I20260709 13:19:29.811605 14237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8c53dc94e244a44a022082d00d2bd77"
dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
mode: GRACEFUL
new_leader_uuid: "7ee834a1e7a84598895d25a0d704119d"
 from {username='slave'} at 127.0.0.1:56662
I20260709 13:19:29.812199 14237 raft_consensus.cc:606] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Received request to transfer leadership to TS 7ee834a1e7a84598895d25a0d704119d
I20260709 13:19:29.821177 14237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b5bed5fb52d4094a3f9536ae4a44489"
dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
mode: GRACEFUL
new_leader_uuid: "7ee834a1e7a84598895d25a0d704119d"
 from {username='slave'} at 127.0.0.1:56662
I20260709 13:19:29.821830 14237 raft_consensus.cc:606] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Received request to transfer leadership to TS 7ee834a1e7a84598895d25a0d704119d
I20260709 13:19:29.827396 14237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c271260327e424b981fe0fceeef802e"
dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
mode: GRACEFUL
new_leader_uuid: "5954043bd41748caa5fb81fecb7d6aba"
 from {username='slave'} at 127.0.0.1:56662
I20260709 13:19:29.827983 14237 raft_consensus.cc:606] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Received request to transfer leadership to TS 5954043bd41748caa5fb81fecb7d6aba
I20260709 13:19:29.853459 14090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b15d17578b03487ba9237d3c1c5c34c3"
dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
mode: GRACEFUL
new_leader_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
 from {username='slave'} at 127.0.0.1:38134
I20260709 13:19:29.854141 14090 raft_consensus.cc:606] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [term 1 LEADER]: Received request to transfer leadership to TS 56d11c1d43ec4f85956fcfa2d6b03def
I20260709 13:19:29.940078 14296 consensus_queue.cc:1048] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:29.953581 14330 consensus_queue.cc:1048] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:29.983328 14330 consensus_queue.cc:1048] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:29.998044 14298 consensus_queue.cc:1048] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:30.000422 14330 consensus_queue.cc:1048] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:30.020249 14321 consensus_queue.cc:1048] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:30.022020 14298 consensus_queue.cc:1048] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:30.032965 14321 raft_consensus.cc:993] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d: : Instructing follower 56d11c1d43ec4f85956fcfa2d6b03def to start an election
I20260709 13:19:30.033492 14321 raft_consensus.cc:1081] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [term 1 LEADER]: Signalling peer 56d11c1d43ec4f85956fcfa2d6b03def to start an election
I20260709 13:19:30.036092 14236 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b15d17578b03487ba9237d3c1c5c34c3"
dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
 from {username='slave'} at 127.0.0.1:56640
I20260709 13:19:30.036763 14236 raft_consensus.cc:493] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:30.037177 14236 raft_consensus.cc:3060] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:30.038645 14321 consensus_queue.cc:1048] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:30.040333 14338 raft_consensus.cc:993] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def: : Instructing follower 7ee834a1e7a84598895d25a0d704119d to start an election
I20260709 13:19:30.040894 14338 raft_consensus.cc:1081] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Signalling peer 7ee834a1e7a84598895d25a0d704119d to start an election
I20260709 13:19:30.043051 14090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ddbce866d5b465ab05b190081a9516a"
dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
 from {username='slave'} at 127.0.0.1:38114
I20260709 13:19:30.043704 14090 raft_consensus.cc:493] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:30.044143 14090 raft_consensus.cc:3060] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:30.047649 14236 raft_consensus.cc:515] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:30.049304 14237 raft_consensus.cc:1240] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Rejecting Update request from peer 7ee834a1e7a84598895d25a0d704119d for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:30.051319 14236 leader_election.cc:290] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 2 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:30.052062 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15d17578b03487ba9237d3c1c5c34c3" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:30.052243 14321 consensus_queue.cc:1059] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:30.053176 14091 raft_consensus.cc:3055] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:30.053537 14091 raft_consensus.cc:740] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Running, Role: LEADER
I20260709 13:19:30.054327 14164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15d17578b03487ba9237d3c1c5c34c3" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:30.054399 14091 consensus_queue.cc:260] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:30.055966 14091 raft_consensus.cc:3060] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:30.056439 14090 raft_consensus.cc:515] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:30.055038 14164 raft_consensus.cc:3060] T b15d17578b03487ba9237d3c1c5c34c3 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:30.059348 14166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddbce866d5b465ab05b190081a9516a" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:30.059942 14166 raft_consensus.cc:3060] T 4ddbce866d5b465ab05b190081a9516a P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:30.069121 14296 consensus_queue.cc:1048] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:30.069442 14164 raft_consensus.cc:2468] T b15d17578b03487ba9237d3c1c5c34c3 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 2.
I20260709 13:19:30.069490 14091 raft_consensus.cc:2468] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 2.
W20260709 13:19:30.070400 14287 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:19:30.071094 14205 leader_election.cc:304] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 5954043bd41748caa5fb81fecb7d6aba; no voters: 
I20260709 13:19:30.072609 14298 raft_consensus.cc:2804] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:30.073123 14298 raft_consensus.cc:697] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 LEADER]: Becoming Leader. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Running, Role: LEADER
I20260709 13:19:30.074332 14298 consensus_queue.cc:237] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:30.074616 14236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddbce866d5b465ab05b190081a9516a" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:30.075488 14236 raft_consensus.cc:3055] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:30.075928 14236 raft_consensus.cc:740] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Running, Role: LEADER
I20260709 13:19:30.076954 14236 consensus_queue.cc:260] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:30.078537 14236 raft_consensus.cc:3060] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:30.071091 14090 leader_election.cc:290] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 2 election: Requested vote from peers 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:30.087244 13987 catalog_manager.cc:5697] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def reported cstate change: term changed from 1 to 2, leader changed from 7ee834a1e7a84598895d25a0d704119d (127.1.227.129) to 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131). New cstate: current_term: 2 leader_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.089080 14166 raft_consensus.cc:2468] T 4ddbce866d5b465ab05b190081a9516a P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 2.
I20260709 13:19:30.090345 14056 leader_election.cc:304] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:30.091701 14287 raft_consensus.cc:2804] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:30.091756 14298 consensus_queue.cc:1048] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:30.092502 14287 raft_consensus.cc:697] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [term 2 LEADER]: Becoming Leader. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Running, Role: LEADER
I20260709 13:19:30.093886 14287 consensus_queue.cc:237] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:30.100801 14236 raft_consensus.cc:2468] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 2.
I20260709 13:19:30.113916 14338 raft_consensus.cc:993] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def: : Instructing follower 5954043bd41748caa5fb81fecb7d6aba to start an election
I20260709 13:19:30.114452 14338 raft_consensus.cc:1081] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Signalling peer 5954043bd41748caa5fb81fecb7d6aba to start an election
I20260709 13:19:30.114840 14330 consensus_queue.cc:1048] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:30.114114 13987 catalog_manager.cc:5697] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d reported cstate change: term changed from 1 to 2, leader changed from 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131) to 7ee834a1e7a84598895d25a0d704119d (127.1.227.129). New cstate: current_term: 2 leader_uuid: "7ee834a1e7a84598895d25a0d704119d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:30.117312 14166 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c271260327e424b981fe0fceeef802e"
dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
 from {username='slave'} at 127.0.0.1:35192
I20260709 13:19:30.117923 14166 raft_consensus.cc:493] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:30.118294 14166 raft_consensus.cc:3060] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:30.126268 14166 raft_consensus.cc:515] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:30.129355 14164 raft_consensus.cc:1240] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Rejecting Update request from peer 56d11c1d43ec4f85956fcfa2d6b03def for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:30.136371 14338 consensus_queue.cc:1059] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:30.137276 14301 raft_consensus.cc:3055] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:30.137666 14301 raft_consensus.cc:740] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Running, Role: LEADER
I20260709 13:19:30.133642 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c271260327e424b981fe0fceeef802e" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:30.139142 14090 raft_consensus.cc:3060] T 9c271260327e424b981fe0fceeef802e P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:30.138507 14301 consensus_queue.cc:260] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:30.140918 14301 raft_consensus.cc:3060] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:30.143893 14338 consensus_queue.cc:1175] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7ee834a1e7a84598895d25a0d704119d" responder_term: 1 status { last_received { term: 0 index: 0 } last_committed_idx: 0 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:30.134182 14237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c271260327e424b981fe0fceeef802e" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:30.134402 14166 leader_election.cc:290] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 2 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:30.151865 14090 raft_consensus.cc:2468] T 9c271260327e424b981fe0fceeef802e P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 2.
I20260709 13:19:30.153358 14129 leader_election.cc:304] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:30.154284 14330 raft_consensus.cc:2804] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:30.154824 14330 raft_consensus.cc:697] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba [term 2 LEADER]: Becoming Leader. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Running, Role: LEADER
I20260709 13:19:30.155748 14330 consensus_queue.cc:237] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:30.163872 14237 raft_consensus.cc:2468] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 2.
I20260709 13:19:30.169426 13987 catalog_manager.cc:5697] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba reported cstate change: term changed from 1 to 2, leader changed from 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131) to 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130). New cstate: current_term: 2 leader_uuid: "5954043bd41748caa5fb81fecb7d6aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:30.193724 14338 raft_consensus.cc:993] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def: : Instructing follower 7ee834a1e7a84598895d25a0d704119d to start an election
I20260709 13:19:30.194243 14301 raft_consensus.cc:1081] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Signalling peer 7ee834a1e7a84598895d25a0d704119d to start an election
I20260709 13:19:30.195897 14090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8c53dc94e244a44a022082d00d2bd77"
dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
 from {username='slave'} at 127.0.0.1:38114
I20260709 13:19:30.196369 14090 raft_consensus.cc:493] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:30.196728 14090 raft_consensus.cc:3060] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:30.201821 14090 raft_consensus.cc:515] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:30.203511 14090 leader_election.cc:290] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 2 election: Requested vote from peers 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:30.204427 14166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c53dc94e244a44a022082d00d2bd77" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:30.204741 14237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c53dc94e244a44a022082d00d2bd77" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:30.205073 14166 raft_consensus.cc:3060] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:30.205367 14237 raft_consensus.cc:3055] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:30.205711 14237 raft_consensus.cc:740] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Running, Role: LEADER
I20260709 13:19:30.206620 14237 consensus_queue.cc:260] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:30.207619 14237 raft_consensus.cc:3060] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:30.210572 14166 raft_consensus.cc:2468] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 2.
I20260709 13:19:30.211768 14056 leader_election.cc:304] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:30.212471 14287 raft_consensus.cc:2804] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:30.212760 14237 raft_consensus.cc:2468] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 2.
I20260709 13:19:30.212888 14287 raft_consensus.cc:697] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d [term 2 LEADER]: Becoming Leader. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Running, Role: LEADER
I20260709 13:19:30.214000 14287 consensus_queue.cc:237] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:30.220680 13987 catalog_manager.cc:5697] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d reported cstate change: term changed from 1 to 2, leader changed from 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131) to 7ee834a1e7a84598895d25a0d704119d (127.1.227.129). New cstate: current_term: 2 leader_uuid: "7ee834a1e7a84598895d25a0d704119d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:30.302078 14338 raft_consensus.cc:993] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def: : Instructing follower 7ee834a1e7a84598895d25a0d704119d to start an election
I20260709 13:19:30.302631 14301 raft_consensus.cc:1081] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Signalling peer 7ee834a1e7a84598895d25a0d704119d to start an election
I20260709 13:19:30.304311 14090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b5bed5fb52d4094a3f9536ae4a44489"
dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
 from {username='slave'} at 127.0.0.1:38114
I20260709 13:19:30.304838 14090 raft_consensus.cc:493] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:30.305154 14090 raft_consensus.cc:3060] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:30.310642 14090 raft_consensus.cc:515] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:30.312456 14090 leader_election.cc:290] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 2 election: Requested vote from peers 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:30.313387 14166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b5bed5fb52d4094a3f9536ae4a44489" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:30.313591 14237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b5bed5fb52d4094a3f9536ae4a44489" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:30.314142 14166 raft_consensus.cc:3060] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:30.314299 14237 raft_consensus.cc:3055] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:30.314718 14237 raft_consensus.cc:740] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Running, Role: LEADER
I20260709 13:19:30.315475 14237 consensus_queue.cc:260] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:30.316461 14237 raft_consensus.cc:3060] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:30.319654 14166 raft_consensus.cc:2468] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 2.
I20260709 13:19:30.320856 14056 leader_election.cc:304] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:30.321673 14287 raft_consensus.cc:2804] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:30.321957 14237 raft_consensus.cc:2468] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 2.
I20260709 13:19:30.322208 14287 raft_consensus.cc:697] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [term 2 LEADER]: Becoming Leader. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Running, Role: LEADER
I20260709 13:19:30.323254 14287 consensus_queue.cc:237] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:30.329651 13987 catalog_manager.cc:5697] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d reported cstate change: term changed from 1 to 2, leader changed from 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131) to 7ee834a1e7a84598895d25a0d704119d (127.1.227.129). New cstate: current_term: 2 leader_uuid: "7ee834a1e7a84598895d25a0d704119d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:30.535203 14090 raft_consensus.cc:1275] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Refusing update from remote peer 56d11c1d43ec4f85956fcfa2d6b03def: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:30.536669 14301 consensus_queue.cc:1048] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:30.552564 14166 raft_consensus.cc:1275] T b15d17578b03487ba9237d3c1c5c34c3 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Refusing update from remote peer 56d11c1d43ec4f85956fcfa2d6b03def: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:30.554512 14301 consensus_queue.cc:1048] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:30.629184 14090 raft_consensus.cc:1275] T 9c271260327e424b981fe0fceeef802e P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Refusing update from remote peer 5954043bd41748caa5fb81fecb7d6aba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:30.631108 14330 consensus_queue.cc:1048] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:30.633427 14237 raft_consensus.cc:1275] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Refusing update from remote peer 7ee834a1e7a84598895d25a0d704119d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:30.634938 14321 consensus_queue.cc:1048] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:30.643623 14237 raft_consensus.cc:1275] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Refusing update from remote peer 5954043bd41748caa5fb81fecb7d6aba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:30.646122 14332 consensus_queue.cc:1048] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:30.654215 14166 raft_consensus.cc:1275] T 4ddbce866d5b465ab05b190081a9516a P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Refusing update from remote peer 7ee834a1e7a84598895d25a0d704119d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:30.656302 14287 consensus_queue.cc:1048] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:30.722316 14237 raft_consensus.cc:1275] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Refusing update from remote peer 7ee834a1e7a84598895d25a0d704119d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:30.723948 14287 consensus_queue.cc:1048] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:30.731002 14166 raft_consensus.cc:1275] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Refusing update from remote peer 7ee834a1e7a84598895d25a0d704119d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:30.732826 14321 consensus_queue.cc:1048] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:30.806210 14237 raft_consensus.cc:1275] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Refusing update from remote peer 7ee834a1e7a84598895d25a0d704119d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:30.807687 14358 consensus_queue.cc:1048] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:30.817546 14166 raft_consensus.cc:1275] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Refusing update from remote peer 7ee834a1e7a84598895d25a0d704119d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:30.819370 14367 consensus_queue.cc:1048] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:32.887151 13989 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37622:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:32.889475 13989 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:32.942035 14080 tablet_service.cc:1511] Processing CreateTablet for tablet 67a1f91874cd48feb2401b249e367f15 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:32.943907 14080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a1f91874cd48feb2401b249e367f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:32.945600 14225 tablet_service.cc:1511] Processing CreateTablet for tablet 67a1f91874cd48feb2401b249e367f15 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:32.946587 14077 tablet_service.cc:1511] Processing CreateTablet for tablet ddab0bf0adfd4b5eb476c08171adf368 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:32.947458 14150 tablet_service.cc:1511] Processing CreateTablet for tablet 67a1f91874cd48feb2401b249e367f15 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:32.948151 14077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddab0bf0adfd4b5eb476c08171adf368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:32.947955 14156 tablet_service.cc:1511] Processing CreateTablet for tablet ddab0bf0adfd4b5eb476c08171adf368 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:32.947508 14225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a1f91874cd48feb2401b249e367f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:32.949133 14150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a1f91874cd48feb2401b249e367f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:32.950013 14156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddab0bf0adfd4b5eb476c08171adf368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:32.957710 14227 tablet_service.cc:1511] Processing CreateTablet for tablet ddab0bf0adfd4b5eb476c08171adf368 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:32.959235 14227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddab0bf0adfd4b5eb476c08171adf368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:32.966168 14079 tablet_service.cc:1511] Processing CreateTablet for tablet a7aab7fb420049159a4bfcab7b889532 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:32.967707 14079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7aab7fb420049159a4bfcab7b889532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:32.967487 14154 tablet_service.cc:1511] Processing CreateTablet for tablet a7aab7fb420049159a4bfcab7b889532 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:32.969033 14154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7aab7fb420049159a4bfcab7b889532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:32.977880 14230 tablet_service.cc:1511] Processing CreateTablet for tablet a7aab7fb420049159a4bfcab7b889532 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:32.979504 14230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7aab7fb420049159a4bfcab7b889532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:32.984524 14081 tablet_service.cc:1511] Processing CreateTablet for tablet cf9eb0860bf04bfd98b9d06518d914e0 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:32.986078 14081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf9eb0860bf04bfd98b9d06518d914e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:32.985934 14153 tablet_service.cc:1511] Processing CreateTablet for tablet cf9eb0860bf04bfd98b9d06518d914e0 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:32.987470 14153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf9eb0860bf04bfd98b9d06518d914e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:33.000417 14229 tablet_service.cc:1511] Processing CreateTablet for tablet cf9eb0860bf04bfd98b9d06518d914e0 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:33.002214 14229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf9eb0860bf04bfd98b9d06518d914e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:33.004613 14152 tablet_service.cc:1511] Processing CreateTablet for tablet cb054fea3a604e4bb57f269232337582 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:33.006105 14152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb054fea3a604e4bb57f269232337582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:33.002702 14078 tablet_service.cc:1511] Processing CreateTablet for tablet cb054fea3a604e4bb57f269232337582 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:33.007593 14078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb054fea3a604e4bb57f269232337582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:33.010433 14226 tablet_service.cc:1511] Processing CreateTablet for tablet cb054fea3a604e4bb57f269232337582 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:33.011922 14226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb054fea3a604e4bb57f269232337582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:33.019685 14383 tablet_bootstrap.cc:492] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def: Bootstrap starting.
I20260709 13:19:33.033356 14384 tablet_bootstrap.cc:492] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba: Bootstrap starting.
I20260709 13:19:33.044831 14076 tablet_service.cc:1511] Processing CreateTablet for tablet 06079b87b1d2466285752dce5a5f3bf4 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
W20260709 13:19:33.047899 14037 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:33.054301 14154 tablet_service.cc:1511] Processing CreateTablet for tablet 06079b87b1d2466285752dce5a5f3bf4 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:33.055038 14075 tablet_service.cc:1511] Processing CreateTablet for tablet 7893d6268fbe402c9976a308df739123 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:33.056401 14384 tablet_bootstrap.cc:654] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.061873 14076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06079b87b1d2466285752dce5a5f3bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:33.063396 14075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7893d6268fbe402c9976a308df739123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:33.064745 14154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06079b87b1d2466285752dce5a5f3bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:33.065338 14385 tablet_bootstrap.cc:492] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d: Bootstrap starting.
I20260709 13:19:33.081149 14227 tablet_service.cc:1511] Processing CreateTablet for tablet 06079b87b1d2466285752dce5a5f3bf4 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:33.086766 14227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06079b87b1d2466285752dce5a5f3bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:33.073720 14230 tablet_service.cc:1511] Processing CreateTablet for tablet 7893d6268fbe402c9976a308df739123 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:33.095206 14230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7893d6268fbe402c9976a308df739123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:33.095705 14078 tablet_service.cc:1511] Processing CreateTablet for tablet 293bc98621164ca0b8519df20d82d270 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:33.097008 14078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 293bc98621164ca0b8519df20d82d270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:33.074841 14079 tablet_service.cc:1511] Processing CreateTablet for tablet dbe684d4341841fabe0c9407024aacb4 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:33.078006 14383 tablet_bootstrap.cc:654] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.081565 14156 tablet_service.cc:1511] Processing CreateTablet for tablet dbe684d4341841fabe0c9407024aacb4 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:33.099184 14156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe684d4341841fabe0c9407024aacb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:33.103736 14153 tablet_service.cc:1511] Processing CreateTablet for tablet 293bc98621164ca0b8519df20d82d270 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:33.089362 14385 tablet_bootstrap.cc:654] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.072506 14150 tablet_service.cc:1511] Processing CreateTablet for tablet 7893d6268fbe402c9976a308df739123 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:33.090764 14225 tablet_service.cc:1511] Processing CreateTablet for tablet dbe684d4341841fabe0c9407024aacb4 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:33.105104 14153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 293bc98621164ca0b8519df20d82d270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:33.107822 14150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7893d6268fbe402c9976a308df739123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:33.109064 14229 tablet_service.cc:1511] Processing CreateTablet for tablet 293bc98621164ca0b8519df20d82d270 (DEFAULT_TABLE table=soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:33.114524 14079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe684d4341841fabe0c9407024aacb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:33.114521 14225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe684d4341841fabe0c9407024aacb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:33.122537 14229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 293bc98621164ca0b8519df20d82d270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:33.136379 14383 tablet_bootstrap.cc:492] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def: No bootstrap required, opened a new log
I20260709 13:19:33.137272 14383 ts_tablet_manager.cc:1403] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent bootstrapping tablet: real 0.118s	user 0.000s	sys 0.021s
I20260709 13:19:33.141706 14385 tablet_bootstrap.cc:492] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d: No bootstrap required, opened a new log
I20260709 13:19:33.142340 14385 ts_tablet_manager.cc:1403] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.005s
I20260709 13:19:33.146624 14383 raft_consensus.cc:359] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.148478 14384 tablet_bootstrap.cc:492] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba: No bootstrap required, opened a new log
I20260709 13:19:33.145592 14385 raft_consensus.cc:359] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.150233 14384 ts_tablet_manager.cc:1403] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba: Time spent bootstrapping tablet: real 0.117s	user 0.028s	sys 0.004s
I20260709 13:19:33.150454 14385 raft_consensus.cc:385] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.150843 14385 raft_consensus.cc:740] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.153399 14384 raft_consensus.cc:359] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.154301 14384 raft_consensus.cc:385] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.154601 14384 raft_consensus.cc:740] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.155398 14384 consensus_queue.cc:260] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.155539 14385 consensus_queue.cc:260] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.157902 14383 raft_consensus.cc:385] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.158241 14383 raft_consensus.cc:740] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.159197 14383 consensus_queue.cc:260] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.161825 14383 ts_tablet_manager.cc:1434] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.005s
I20260709 13:19:33.165445 14384 ts_tablet_manager.cc:1434] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:19:33.166584 14384 tablet_bootstrap.cc:492] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba: Bootstrap starting.
I20260709 13:19:33.166918 14385 ts_tablet_manager.cc:1434] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:19:33.167974 14385 tablet_bootstrap.cc:492] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d: Bootstrap starting.
I20260709 13:19:33.170809 14383 tablet_bootstrap.cc:492] T ddab0bf0adfd4b5eb476c08171adf368 P 56d11c1d43ec4f85956fcfa2d6b03def: Bootstrap starting.
I20260709 13:19:33.179340 14385 tablet_bootstrap.cc:654] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.184073 14384 tablet_bootstrap.cc:654] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.185240 14383 tablet_bootstrap.cc:654] T ddab0bf0adfd4b5eb476c08171adf368 P 56d11c1d43ec4f85956fcfa2d6b03def: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.198833 14385 tablet_bootstrap.cc:492] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d: No bootstrap required, opened a new log
I20260709 13:19:33.199435 14385 ts_tablet_manager.cc:1403] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.011s
I20260709 13:19:33.203706 14385 raft_consensus.cc:359] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.204483 14385 raft_consensus.cc:385] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.204813 14385 raft_consensus.cc:740] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.205664 14385 consensus_queue.cc:260] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.208179 14385 ts_tablet_manager.cc:1434] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:33.209430 14385 tablet_bootstrap.cc:492] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d: Bootstrap starting.
I20260709 13:19:33.218891 14385 tablet_bootstrap.cc:654] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.226699 14384 tablet_bootstrap.cc:492] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba: No bootstrap required, opened a new log
I20260709 13:19:33.227242 14384 ts_tablet_manager.cc:1403] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.013s
I20260709 13:19:33.227382 14385 tablet_bootstrap.cc:492] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d: No bootstrap required, opened a new log
I20260709 13:19:33.227919 14385 ts_tablet_manager.cc:1403] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:19:33.228154 14383 tablet_bootstrap.cc:492] T ddab0bf0adfd4b5eb476c08171adf368 P 56d11c1d43ec4f85956fcfa2d6b03def: No bootstrap required, opened a new log
I20260709 13:19:33.228698 14383 ts_tablet_manager.cc:1403] T ddab0bf0adfd4b5eb476c08171adf368 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent bootstrapping tablet: real 0.058s	user 0.021s	sys 0.008s
I20260709 13:19:33.230386 14385 raft_consensus.cc:359] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.231071 14385 raft_consensus.cc:385] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.230774 14384 raft_consensus.cc:359] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.231355 14385 raft_consensus.cc:740] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.231571 14384 raft_consensus.cc:385] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.231990 14384 raft_consensus.cc:740] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.231725 14383 raft_consensus.cc:359] T ddab0bf0adfd4b5eb476c08171adf368 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.232493 14383 raft_consensus.cc:385] T ddab0bf0adfd4b5eb476c08171adf368 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.232127 14385 consensus_queue.cc:260] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.232790 14383 raft_consensus.cc:740] T ddab0bf0adfd4b5eb476c08171adf368 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.232810 14384 consensus_queue.cc:260] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.234669 14385 ts_tablet_manager.cc:1434] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:19:33.235702 14385 tablet_bootstrap.cc:492] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d: Bootstrap starting.
I20260709 13:19:33.242977 14383 consensus_queue.cc:260] T ddab0bf0adfd4b5eb476c08171adf368 P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.243561 14384 ts_tablet_manager.cc:1434] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba: Time spent starting tablet: real 0.016s	user 0.013s	sys 0.003s
I20260709 13:19:33.244212 14385 tablet_bootstrap.cc:654] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.244879 14384 tablet_bootstrap.cc:492] T a7aab7fb420049159a4bfcab7b889532 P 5954043bd41748caa5fb81fecb7d6aba: Bootstrap starting.
I20260709 13:19:33.252693 14384 tablet_bootstrap.cc:654] T a7aab7fb420049159a4bfcab7b889532 P 5954043bd41748caa5fb81fecb7d6aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.263661 14383 ts_tablet_manager.cc:1434] T ddab0bf0adfd4b5eb476c08171adf368 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:19:33.271224 14396 raft_consensus.cc:493] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.271836 14396 raft_consensus.cc:515] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.275491 14236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddab0bf0adfd4b5eb476c08171adf368" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" is_pre_election: true
I20260709 13:19:33.276150 14236 raft_consensus.cc:2468] T ddab0bf0adfd4b5eb476c08171adf368 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 0.
I20260709 13:19:33.277215 14383 tablet_bootstrap.cc:492] T a7aab7fb420049159a4bfcab7b889532 P 56d11c1d43ec4f85956fcfa2d6b03def: Bootstrap starting.
I20260709 13:19:33.277467 14132 leader_election.cc:304] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 5954043bd41748caa5fb81fecb7d6aba; no voters: 
I20260709 13:19:33.275518 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddab0bf0adfd4b5eb476c08171adf368" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d" is_pre_election: true
I20260709 13:19:33.279057 14090 raft_consensus.cc:2468] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 0.
I20260709 13:19:33.280790 14332 raft_consensus.cc:2804] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:33.281246 14332 raft_consensus.cc:493] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.281598 14332 raft_consensus.cc:3060] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.283959 14392 raft_consensus.cc:493] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.284749 14392 raft_consensus.cc:515] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.288095 14384 tablet_bootstrap.cc:492] T a7aab7fb420049159a4bfcab7b889532 P 5954043bd41748caa5fb81fecb7d6aba: No bootstrap required, opened a new log
I20260709 13:19:33.288655 14384 ts_tablet_manager.cc:1403] T a7aab7fb420049159a4bfcab7b889532 P 5954043bd41748caa5fb81fecb7d6aba: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.015s
I20260709 13:19:33.289965 14332 raft_consensus.cc:515] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.291924 14384 raft_consensus.cc:359] T a7aab7fb420049159a4bfcab7b889532 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.292708 14384 raft_consensus.cc:385] T a7aab7fb420049159a4bfcab7b889532 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.293098 14396 leader_election.cc:290] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:33.292996 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddab0bf0adfd4b5eb476c08171adf368" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:33.293771 14090 raft_consensus.cc:3060] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.293002 14384 raft_consensus.cc:740] T a7aab7fb420049159a4bfcab7b889532 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.294826 14384 consensus_queue.cc:260] T a7aab7fb420049159a4bfcab7b889532 P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.296391 14236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aab7fb420049159a4bfcab7b889532" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" is_pre_election: true
I20260709 13:19:33.298606 14384 ts_tablet_manager.cc:1434] T a7aab7fb420049159a4bfcab7b889532 P 5954043bd41748caa5fb81fecb7d6aba: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:19:33.299700 14384 tablet_bootstrap.cc:492] T cf9eb0860bf04bfd98b9d06518d914e0 P 5954043bd41748caa5fb81fecb7d6aba: Bootstrap starting.
I20260709 13:19:33.296494 14392 leader_election.cc:290] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:33.285601 14383 tablet_bootstrap.cc:654] T a7aab7fb420049159a4bfcab7b889532 P 56d11c1d43ec4f85956fcfa2d6b03def: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.305970 14166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aab7fb420049159a4bfcab7b889532" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba" is_pre_election: true
I20260709 13:19:33.306645 14166 raft_consensus.cc:2468] T a7aab7fb420049159a4bfcab7b889532 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 0.
I20260709 13:19:33.307762 14384 tablet_bootstrap.cc:654] T cf9eb0860bf04bfd98b9d06518d914e0 P 5954043bd41748caa5fb81fecb7d6aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.308000 14056 leader_election.cc:304] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:33.309043 14392 raft_consensus.cc:2804] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:33.309432 14392 raft_consensus.cc:493] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.309824 14392 raft_consensus.cc:3060] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.310663 14383 tablet_bootstrap.cc:492] T a7aab7fb420049159a4bfcab7b889532 P 56d11c1d43ec4f85956fcfa2d6b03def: No bootstrap required, opened a new log
I20260709 13:19:33.311035 14385 tablet_bootstrap.cc:492] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d: No bootstrap required, opened a new log
I20260709 13:19:33.311221 14383 ts_tablet_manager.cc:1403] T a7aab7fb420049159a4bfcab7b889532 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.002s
I20260709 13:19:33.311657 14385 ts_tablet_manager.cc:1403] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d: Time spent bootstrapping tablet: real 0.076s	user 0.033s	sys 0.041s
I20260709 13:19:33.314594 14383 raft_consensus.cc:359] T a7aab7fb420049159a4bfcab7b889532 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.314785 14385 raft_consensus.cc:359] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.315431 14383 raft_consensus.cc:385] T a7aab7fb420049159a4bfcab7b889532 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.315842 14383 raft_consensus.cc:740] T a7aab7fb420049159a4bfcab7b889532 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.315905 14385 raft_consensus.cc:385] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.316398 14385 raft_consensus.cc:740] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.316763 14383 consensus_queue.cc:260] T a7aab7fb420049159a4bfcab7b889532 P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.317323 14385 consensus_queue.cc:260] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.319299 14383 ts_tablet_manager.cc:1434] T a7aab7fb420049159a4bfcab7b889532 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:33.320205 14385 ts_tablet_manager.cc:1434] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:33.320307 14383 tablet_bootstrap.cc:492] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def: Bootstrap starting.
I20260709 13:19:33.321030 14090 raft_consensus.cc:2468] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 1.
I20260709 13:19:33.321595 14385 tablet_bootstrap.cc:492] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d: Bootstrap starting.
I20260709 13:19:33.328161 14383 tablet_bootstrap.cc:654] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.328219 14385 tablet_bootstrap.cc:654] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.328841 14392 raft_consensus.cc:515] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.331737 14166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aab7fb420049159a4bfcab7b889532" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
W20260709 13:19:33.332192 14057 leader_election.cc:343] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:33.332348 14166 raft_consensus.cc:3060] T a7aab7fb420049159a4bfcab7b889532 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.337713 14396 raft_consensus.cc:493] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.338343 14396 raft_consensus.cc:515] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.341320 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a1f91874cd48feb2401b249e367f15" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d" is_pre_election: true
I20260709 13:19:33.342077 14091 raft_consensus.cc:2468] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 0.
I20260709 13:19:33.343309 14129 leader_election.cc:304] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:33.343387 14236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddab0bf0adfd4b5eb476c08171adf368" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:33.344013 14236 raft_consensus.cc:3060] T ddab0bf0adfd4b5eb476c08171adf368 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.345172 14396 leader_election.cc:290] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:33.345798 14396 raft_consensus.cc:2804] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:33.346143 14396 raft_consensus.cc:493] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.346338 14237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a1f91874cd48feb2401b249e367f15" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" is_pre_election: true
I20260709 13:19:33.346508 14396 raft_consensus.cc:3060] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.347054 14237 raft_consensus.cc:2468] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 0.
I20260709 13:19:33.355443 14166 raft_consensus.cc:2468] T a7aab7fb420049159a4bfcab7b889532 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 1.
I20260709 13:19:33.356837 14056 leader_election.cc:304] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:33.357666 14367 raft_consensus.cc:2804] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:33.367431 14392 leader_election.cc:290] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 election: Requested vote from peers 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:33.371219 14237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7aab7fb420049159a4bfcab7b889532" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:33.372071 14237 raft_consensus.cc:3060] T a7aab7fb420049159a4bfcab7b889532 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.373884 14396 raft_consensus.cc:515] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.376094 14396 leader_election.cc:290] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:33.377868 14238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a1f91874cd48feb2401b249e367f15" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:33.378896 14238 raft_consensus.cc:3060] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.386674 14384 tablet_bootstrap.cc:492] T cf9eb0860bf04bfd98b9d06518d914e0 P 5954043bd41748caa5fb81fecb7d6aba: No bootstrap required, opened a new log
I20260709 13:19:33.387260 14384 ts_tablet_manager.cc:1403] T cf9eb0860bf04bfd98b9d06518d914e0 P 5954043bd41748caa5fb81fecb7d6aba: Time spent bootstrapping tablet: real 0.088s	user 0.007s	sys 0.014s
I20260709 13:19:33.388796 14332 leader_election.cc:290] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:33.390829 14384 raft_consensus.cc:359] T cf9eb0860bf04bfd98b9d06518d914e0 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.391551 14384 raft_consensus.cc:385] T cf9eb0860bf04bfd98b9d06518d914e0 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.391837 14384 raft_consensus.cc:740] T cf9eb0860bf04bfd98b9d06518d914e0 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.392599 14384 consensus_queue.cc:260] T cf9eb0860bf04bfd98b9d06518d914e0 P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.393023 14237 raft_consensus.cc:2468] T a7aab7fb420049159a4bfcab7b889532 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 1.
I20260709 13:19:33.393889 14238 raft_consensus.cc:2468] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 1.
I20260709 13:19:33.395364 14384 ts_tablet_manager.cc:1434] T cf9eb0860bf04bfd98b9d06518d914e0 P 5954043bd41748caa5fb81fecb7d6aba: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 13:19:33.396817 14384 tablet_bootstrap.cc:492] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba: Bootstrap starting.
I20260709 13:19:33.397274 14132 leader_election.cc:304] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 5954043bd41748caa5fb81fecb7d6aba; no voters: 
I20260709 13:19:33.398765 14332 raft_consensus.cc:2804] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:19:33.399405 14129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.227.129:41823, user_credentials={real_user=slave}} blocked reactor thread for 56176.6us
I20260709 13:19:33.399529 14332 raft_consensus.cc:697] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Becoming Leader. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Running, Role: LEADER
I20260709 13:19:33.401381 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a1f91874cd48feb2401b249e367f15" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:33.402125 14090 raft_consensus.cc:3060] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.402247 14236 raft_consensus.cc:2468] T ddab0bf0adfd4b5eb476c08171adf368 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 1.
I20260709 13:19:33.401067 14332 consensus_queue.cc:237] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.403630 14132 leader_election.cc:304] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 5954043bd41748caa5fb81fecb7d6aba; no voters: 
I20260709 13:19:33.405380 14367 raft_consensus.cc:697] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [term 1 LEADER]: Becoming Leader. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Running, Role: LEADER
I20260709 13:19:33.406486 14367 consensus_queue.cc:237] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.405046 14401 raft_consensus.cc:2804] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:33.407991 14401 raft_consensus.cc:697] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Becoming Leader. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Running, Role: LEADER
I20260709 13:19:33.410665 14090 raft_consensus.cc:2468] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 1.
I20260709 13:19:33.416831 14383 tablet_bootstrap.cc:492] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def: No bootstrap required, opened a new log
I20260709 13:19:33.417284 14384 tablet_bootstrap.cc:654] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.417436 14383 ts_tablet_manager.cc:1403] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent bootstrapping tablet: real 0.097s	user 0.031s	sys 0.062s
I20260709 13:19:33.417708 14385 tablet_bootstrap.cc:492] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d: No bootstrap required, opened a new log
I20260709 13:19:33.418350 14385 ts_tablet_manager.cc:1403] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d: Time spent bootstrapping tablet: real 0.097s	user 0.022s	sys 0.040s
I20260709 13:19:33.420902 14383 raft_consensus.cc:359] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.421708 14383 raft_consensus.cc:385] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.421459 14385 raft_consensus.cc:359] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.410702 14401 consensus_queue.cc:237] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.422544 14385 raft_consensus.cc:385] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.423014 14385 raft_consensus.cc:740] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.422140 14383 raft_consensus.cc:740] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.424401 14385 consensus_queue.cc:260] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.425261 14383 consensus_queue.cc:260] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.427139 14385 ts_tablet_manager.cc:1434] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:19:33.427716 14383 ts_tablet_manager.cc:1434] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:19:33.428424 14385 tablet_bootstrap.cc:492] T 293bc98621164ca0b8519df20d82d270 P 7ee834a1e7a84598895d25a0d704119d: Bootstrap starting.
I20260709 13:19:33.428795 14383 tablet_bootstrap.cc:492] T cb054fea3a604e4bb57f269232337582 P 56d11c1d43ec4f85956fcfa2d6b03def: Bootstrap starting.
I20260709 13:19:33.436215 14385 tablet_bootstrap.cc:654] T 293bc98621164ca0b8519df20d82d270 P 7ee834a1e7a84598895d25a0d704119d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.439199 14384 tablet_bootstrap.cc:492] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba: No bootstrap required, opened a new log
I20260709 13:19:33.439837 14384 ts_tablet_manager.cc:1403] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.006s
I20260709 13:19:33.447007 14383 tablet_bootstrap.cc:654] T cb054fea3a604e4bb57f269232337582 P 56d11c1d43ec4f85956fcfa2d6b03def: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.449505 14385 tablet_bootstrap.cc:492] T 293bc98621164ca0b8519df20d82d270 P 7ee834a1e7a84598895d25a0d704119d: No bootstrap required, opened a new log
I20260709 13:19:33.450258 14385 ts_tablet_manager.cc:1403] T 293bc98621164ca0b8519df20d82d270 P 7ee834a1e7a84598895d25a0d704119d: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.006s
I20260709 13:19:33.449656 13987 catalog_manager.cc:5697] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ee834a1e7a84598895d25a0d704119d (127.1.227.129). New cstate: current_term: 1 leader_uuid: "7ee834a1e7a84598895d25a0d704119d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:33.456360 14384 raft_consensus.cc:359] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.457135 14384 raft_consensus.cc:385] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.457461 14384 raft_consensus.cc:740] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.458264 14384 consensus_queue.cc:260] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.460193 14384 ts_tablet_manager.cc:1434] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:19:33.460158 14385 raft_consensus.cc:359] T 293bc98621164ca0b8519df20d82d270 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.461280 14385 raft_consensus.cc:385] T 293bc98621164ca0b8519df20d82d270 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.461524 14384 tablet_bootstrap.cc:492] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba: Bootstrap starting.
I20260709 13:19:33.461683 14385 raft_consensus.cc:740] T 293bc98621164ca0b8519df20d82d270 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.462889 14385 consensus_queue.cc:260] T 293bc98621164ca0b8519df20d82d270 P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.465617 14385 ts_tablet_manager.cc:1434] T 293bc98621164ca0b8519df20d82d270 P 7ee834a1e7a84598895d25a0d704119d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:19:33.467795 14401 raft_consensus.cc:493] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.468601 14401 raft_consensus.cc:515] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.471109 14384 tablet_bootstrap.cc:654] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.467208 14385 tablet_bootstrap.cc:492] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d: Bootstrap starting.
I20260709 13:19:33.473448 14237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293bc98621164ca0b8519df20d82d270" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" is_pre_election: true
I20260709 13:19:33.473778 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293bc98621164ca0b8519df20d82d270" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d" is_pre_election: true
I20260709 13:19:33.475435 14090 raft_consensus.cc:2468] T 293bc98621164ca0b8519df20d82d270 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 0.
W20260709 13:19:33.476428 14132 leader_election.cc:343] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:33.473562 14401 leader_election.cc:290] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:33.477077 14129 leader_election.cc:304] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d; no voters: 56d11c1d43ec4f85956fcfa2d6b03def
I20260709 13:19:33.478186 14401 raft_consensus.cc:2804] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:33.478753 14401 raft_consensus.cc:493] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.479487 14401 raft_consensus.cc:3060] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.482020 14383 tablet_bootstrap.cc:492] T cb054fea3a604e4bb57f269232337582 P 56d11c1d43ec4f85956fcfa2d6b03def: No bootstrap required, opened a new log
I20260709 13:19:33.482583 14383 ts_tablet_manager.cc:1403] T cb054fea3a604e4bb57f269232337582 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.021s
I20260709 13:19:33.483665 14385 tablet_bootstrap.cc:654] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.488005 14383 raft_consensus.cc:359] T cb054fea3a604e4bb57f269232337582 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.489096 14383 raft_consensus.cc:385] T cb054fea3a604e4bb57f269232337582 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.489476 14383 raft_consensus.cc:740] T cb054fea3a604e4bb57f269232337582 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.490434 14383 consensus_queue.cc:260] T cb054fea3a604e4bb57f269232337582 P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.491541 14401 raft_consensus.cc:515] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.495349 14237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293bc98621164ca0b8519df20d82d270" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
W20260709 13:19:33.496919 14132 leader_election.cc:343] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:33.500522 14401 leader_election.cc:290] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:33.500638 14383 ts_tablet_manager.cc:1434] T cb054fea3a604e4bb57f269232337582 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.006s
I20260709 13:19:33.501251 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293bc98621164ca0b8519df20d82d270" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:33.502066 14090 raft_consensus.cc:3060] T 293bc98621164ca0b8519df20d82d270 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.502322 14383 tablet_bootstrap.cc:492] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def: Bootstrap starting.
I20260709 13:19:33.504356 13986 catalog_manager.cc:5697] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba reported cstate change: term changed from 0 to 1, leader changed from <none> to 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130). New cstate: current_term: 1 leader_uuid: "5954043bd41748caa5fb81fecb7d6aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:33.505970 14285 raft_consensus.cc:493] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.506510 14285 raft_consensus.cc:515] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.506659 13986 catalog_manager.cc:5697] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba reported cstate change: term changed from 0 to 1, leader changed from <none> to 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130). New cstate: current_term: 1 leader_uuid: "5954043bd41748caa5fb81fecb7d6aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:33.510134 14166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf9eb0860bf04bfd98b9d06518d914e0" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba" is_pre_election: true
I20260709 13:19:33.510777 14166 raft_consensus.cc:2468] T cf9eb0860bf04bfd98b9d06518d914e0 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 0.
I20260709 13:19:33.511601 14285 leader_election.cc:290] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:33.512601 14205 leader_election.cc:304] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 5954043bd41748caa5fb81fecb7d6aba; no voters: 
I20260709 13:19:33.514292 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf9eb0860bf04bfd98b9d06518d914e0" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d" is_pre_election: true
I20260709 13:19:33.515594 14091 raft_consensus.cc:2468] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 0.
I20260709 13:19:33.515646 14285 raft_consensus.cc:2804] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:33.517791 14285 raft_consensus.cc:493] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.518139 14285 raft_consensus.cc:3060] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.519354 14385 tablet_bootstrap.cc:492] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d: No bootstrap required, opened a new log
I20260709 13:19:33.520046 14385 ts_tablet_manager.cc:1403] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.020s
I20260709 13:19:33.522585 14090 raft_consensus.cc:2468] T 293bc98621164ca0b8519df20d82d270 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 1.
I20260709 13:19:33.522822 14383 tablet_bootstrap.cc:654] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.523403 14385 raft_consensus.cc:359] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.529338 14385 raft_consensus.cc:385] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.529631 14385 raft_consensus.cc:740] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.530706 14384 tablet_bootstrap.cc:492] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba: No bootstrap required, opened a new log
I20260709 13:19:33.531286 14384 ts_tablet_manager.cc:1403] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba: Time spent bootstrapping tablet: real 0.070s	user 0.022s	sys 0.010s
I20260709 13:19:33.531054 14385 consensus_queue.cc:260] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.531035 14129 leader_election.cc:304] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d; no voters: 56d11c1d43ec4f85956fcfa2d6b03def
I20260709 13:19:33.533815 14385 ts_tablet_manager.cc:1434] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:19:33.533934 14401 raft_consensus.cc:2804] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:33.534534 14401 raft_consensus.cc:697] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Becoming Leader. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Running, Role: LEADER
I20260709 13:19:33.534884 14385 tablet_bootstrap.cc:492] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d: Bootstrap starting.
I20260709 13:19:33.534593 14384 raft_consensus.cc:359] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.535431 14384 raft_consensus.cc:385] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.535465 14401 consensus_queue.cc:237] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.535847 14384 raft_consensus.cc:740] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.536751 14384 consensus_queue.cc:260] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.539311 14384 ts_tablet_manager.cc:1434] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:33.540421 14384 tablet_bootstrap.cc:492] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba: Bootstrap starting.
I20260709 13:19:33.543253 14385 tablet_bootstrap.cc:654] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.544502 14383 tablet_bootstrap.cc:492] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def: No bootstrap required, opened a new log
I20260709 13:19:33.545058 14383 ts_tablet_manager.cc:1403] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.001s
I20260709 13:19:33.549518 14383 raft_consensus.cc:359] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.550613 14383 raft_consensus.cc:385] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.550905 14383 raft_consensus.cc:740] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.551604 14383 consensus_queue.cc:260] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.555851 14385 tablet_bootstrap.cc:492] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d: No bootstrap required, opened a new log
I20260709 13:19:33.556408 14385 ts_tablet_manager.cc:1403] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.010s
I20260709 13:19:33.558041 14285 raft_consensus.cc:515] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.559242 14385 raft_consensus.cc:359] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.559907 14384 tablet_bootstrap.cc:654] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.560009 14385 raft_consensus.cc:385] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.560421 14385 raft_consensus.cc:740] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.561103 14385 consensus_queue.cc:260] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.561578 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf9eb0860bf04bfd98b9d06518d914e0" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:33.562477 14091 raft_consensus.cc:3060] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.563644 14385 ts_tablet_manager.cc:1434] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:33.564323 14285 leader_election.cc:290] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:33.564560 14166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf9eb0860bf04bfd98b9d06518d914e0" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:33.565068 14385 tablet_bootstrap.cc:492] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d: Bootstrap starting.
I20260709 13:19:33.565227 14166 raft_consensus.cc:3060] T cf9eb0860bf04bfd98b9d06518d914e0 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.569541 14402 raft_consensus.cc:493] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.570155 14402 raft_consensus.cc:515] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.572731 14385 tablet_bootstrap.cc:654] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.573350 14402 leader_election.cc:290] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:33.573562 14237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7893d6268fbe402c9976a308df739123" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" is_pre_election: true
W20260709 13:19:33.575415 14057 leader_election.cc:343] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:33.577466 14164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7893d6268fbe402c9976a308df739123" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba" is_pre_election: true
I20260709 13:19:33.579046 14384 tablet_bootstrap.cc:492] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba: No bootstrap required, opened a new log
W20260709 13:19:33.579044 14056 leader_election.cc:343] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:33.579586 14384 ts_tablet_manager.cc:1403] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.008s
I20260709 13:19:33.579938 14056 leader_election.cc:304] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ee834a1e7a84598895d25a0d704119d; no voters: 56d11c1d43ec4f85956fcfa2d6b03def, 5954043bd41748caa5fb81fecb7d6aba
I20260709 13:19:33.581070 14402 raft_consensus.cc:2749] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:33.581346 14383 ts_tablet_manager.cc:1434] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.007s
I20260709 13:19:33.582453 14383 tablet_bootstrap.cc:492] T 7893d6268fbe402c9976a308df739123 P 56d11c1d43ec4f85956fcfa2d6b03def: Bootstrap starting.
I20260709 13:19:33.581135 14385 tablet_bootstrap.cc:492] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d: No bootstrap required, opened a new log
I20260709 13:19:33.584050 14385 ts_tablet_manager.cc:1403] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.004s
I20260709 13:19:33.586928 14385 raft_consensus.cc:359] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.587608 14385 raft_consensus.cc:385] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.587888 14385 raft_consensus.cc:740] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.588508 14385 consensus_queue.cc:260] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.589557 14384 raft_consensus.cc:359] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.590432 14384 raft_consensus.cc:385] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.590638 14385 ts_tablet_manager.cc:1434] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:19:33.590787 14384 raft_consensus.cc:740] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.591778 14384 consensus_queue.cc:260] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.593114 14383 tablet_bootstrap.cc:654] T 7893d6268fbe402c9976a308df739123 P 56d11c1d43ec4f85956fcfa2d6b03def: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.594340 14384 ts_tablet_manager.cc:1434] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:19:33.594352 13989 catalog_manager.cc:5697] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba reported cstate change: term changed from 0 to 1, leader changed from <none> to 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130). New cstate: current_term: 1 leader_uuid: "5954043bd41748caa5fb81fecb7d6aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:33.596611 14384 tablet_bootstrap.cc:492] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba: Bootstrap starting.
I20260709 13:19:33.601251 14166 raft_consensus.cc:2468] T cf9eb0860bf04bfd98b9d06518d914e0 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 1.
I20260709 13:19:33.601600 14402 raft_consensus.cc:493] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.603343 14384 tablet_bootstrap.cc:654] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.606139 14402 raft_consensus.cc:515] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.606827 14383 tablet_bootstrap.cc:492] T 7893d6268fbe402c9976a308df739123 P 56d11c1d43ec4f85956fcfa2d6b03def: No bootstrap required, opened a new log
I20260709 13:19:33.607430 14383 ts_tablet_manager.cc:1403] T 7893d6268fbe402c9976a308df739123 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.008s
I20260709 13:19:33.607319 14091 raft_consensus.cc:2468] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 1.
I20260709 13:19:33.608666 14203 leader_election.cc:304] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:33.609417 14164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb054fea3a604e4bb57f269232337582" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba" is_pre_election: true
I20260709 13:19:33.609700 14417 raft_consensus.cc:2804] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:33.611359 14402 leader_election.cc:290] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:33.610381 14164 raft_consensus.cc:2468] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 0.
I20260709 13:19:33.613147 14417 raft_consensus.cc:697] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Becoming Leader. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Running, Role: LEADER
I20260709 13:19:33.613364 14056 leader_election.cc:304] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:33.614318 14402 raft_consensus.cc:2804] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:33.614252 14417 consensus_queue.cc:237] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.614796 14402 raft_consensus.cc:493] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.615264 14402 raft_consensus.cc:3060] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.615963 14384 tablet_bootstrap.cc:492] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba: No bootstrap required, opened a new log
I20260709 13:19:33.616448 14384 ts_tablet_manager.cc:1403] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba: Time spent bootstrapping tablet: real 0.020s	user 0.003s	sys 0.012s
I20260709 13:19:33.618594 14237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb054fea3a604e4bb57f269232337582" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" is_pre_election: true
I20260709 13:19:33.619274 14237 raft_consensus.cc:2468] T cb054fea3a604e4bb57f269232337582 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 0.
I20260709 13:19:33.619092 14384 raft_consensus.cc:359] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.619947 14384 raft_consensus.cc:385] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.620232 14384 raft_consensus.cc:740] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.620891 14384 consensus_queue.cc:260] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.623001 14384 ts_tablet_manager.cc:1434] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:19:33.623927 14384 tablet_bootstrap.cc:492] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba: Bootstrap starting.
I20260709 13:19:33.623582 14383 raft_consensus.cc:359] T 7893d6268fbe402c9976a308df739123 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.624507 14402 raft_consensus.cc:515] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.627472 14402 leader_election.cc:290] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 election: Requested vote from peers 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:33.624500 14383 raft_consensus.cc:385] T 7893d6268fbe402c9976a308df739123 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.628649 14164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb054fea3a604e4bb57f269232337582" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:33.628925 14383 raft_consensus.cc:740] T 7893d6268fbe402c9976a308df739123 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.628639 14237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb054fea3a604e4bb57f269232337582" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:33.629400 14164 raft_consensus.cc:3060] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.629890 14237 raft_consensus.cc:3060] T cb054fea3a604e4bb57f269232337582 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.630479 14384 tablet_bootstrap.cc:654] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.631171 14383 consensus_queue.cc:260] T 7893d6268fbe402c9976a308df739123 P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.633627 14383 ts_tablet_manager.cc:1434] T 7893d6268fbe402c9976a308df739123 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent starting tablet: real 0.026s	user 0.000s	sys 0.007s
I20260709 13:19:33.634651 14285 raft_consensus.cc:493] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.635170 14285 raft_consensus.cc:515] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.637382 14285 leader_election.cc:290] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:33.637995 14237 raft_consensus.cc:2468] T cb054fea3a604e4bb57f269232337582 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 1.
I20260709 13:19:33.641266 14384 tablet_bootstrap.cc:492] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba: No bootstrap required, opened a new log
I20260709 13:19:33.641851 14384 ts_tablet_manager.cc:1403] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.006s
I20260709 13:19:33.642994 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06079b87b1d2466285752dce5a5f3bf4" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d" is_pre_election: true
I20260709 13:19:33.643685 14091 raft_consensus.cc:2468] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 0.
I20260709 13:19:33.643786 14164 raft_consensus.cc:2468] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 1.
I20260709 13:19:33.644716 14384 raft_consensus.cc:359] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.644932 14203 leader_election.cc:304] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:33.645448 14384 raft_consensus.cc:385] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.645810 14384 raft_consensus.cc:740] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.645864 14166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06079b87b1d2466285752dce5a5f3bf4" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba" is_pre_election: true
I20260709 13:19:33.646569 14384 consensus_queue.cc:260] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.645462 14056 leader_election.cc:304] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:33.649459 14384 ts_tablet_manager.cc:1434] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:33.650960 14402 raft_consensus.cc:2804] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:33.651239 14285 raft_consensus.cc:2804] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:33.651626 14285 raft_consensus.cc:493] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.652073 14285 raft_consensus.cc:3060] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.651552 14402 raft_consensus.cc:697] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [term 1 LEADER]: Becoming Leader. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Running, Role: LEADER
I20260709 13:19:33.654112 14402 consensus_queue.cc:237] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.646763 14166 raft_consensus.cc:2468] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 0.
I20260709 13:19:33.658988 14383 tablet_bootstrap.cc:492] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def: Bootstrap starting.
I20260709 13:19:33.660357 14285 raft_consensus.cc:515] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.663966 14164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06079b87b1d2466285752dce5a5f3bf4" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:33.664635 14164 raft_consensus.cc:3060] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.666244 14383 tablet_bootstrap.cc:654] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.666496 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06079b87b1d2466285752dce5a5f3bf4" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:33.667171 14091 raft_consensus.cc:3060] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.668490 13989 catalog_manager.cc:5697] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def reported cstate change: term changed from 0 to 1, leader changed from <none> to 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131). New cstate: current_term: 1 leader_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:33.673774 14285 leader_election.cc:290] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:33.675740 14383 tablet_bootstrap.cc:492] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def: No bootstrap required, opened a new log
I20260709 13:19:33.676288 14383 ts_tablet_manager.cc:1403] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.005s
I20260709 13:19:33.676270 14091 raft_consensus.cc:2468] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 1.
I20260709 13:19:33.677695 14203 leader_election.cc:304] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:33.678745 14285 raft_consensus.cc:2804] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:33.679320 14285 raft_consensus.cc:697] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Becoming Leader. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Running, Role: LEADER
I20260709 13:19:33.679557 14383 raft_consensus.cc:359] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.680318 14383 raft_consensus.cc:385] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.680387 14164 raft_consensus.cc:2468] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 1.
I20260709 13:19:33.680701 14383 raft_consensus.cc:740] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.680127 14285 consensus_queue.cc:237] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.681478 14383 consensus_queue.cc:260] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.683991 14383 ts_tablet_manager.cc:1434] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:33.683926 14332 raft_consensus.cc:493] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.685149 14383 tablet_bootstrap.cc:492] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def: Bootstrap starting.
I20260709 13:19:33.684489 13987 catalog_manager.cc:5697] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ee834a1e7a84598895d25a0d704119d (127.1.227.129). New cstate: current_term: 1 leader_uuid: "7ee834a1e7a84598895d25a0d704119d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:33.684654 14332 raft_consensus.cc:515] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.691627 14383 tablet_bootstrap.cc:654] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:33.695942 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7893d6268fbe402c9976a308df739123" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d" is_pre_election: true
I20260709 13:19:33.696913 14091 raft_consensus.cc:2468] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 0.
I20260709 13:19:33.698618 14129 leader_election.cc:304] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:33.700348 14332 leader_election.cc:290] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:33.701057 14332 raft_consensus.cc:2804] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:33.701493 14332 raft_consensus.cc:493] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.701941 14332 raft_consensus.cc:3060] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.703194 14383 tablet_bootstrap.cc:492] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def: No bootstrap required, opened a new log
I20260709 13:19:33.703648 14237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7893d6268fbe402c9976a308df739123" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" is_pre_election: true
I20260709 13:19:33.704265 14237 raft_consensus.cc:2468] T 7893d6268fbe402c9976a308df739123 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 0.
I20260709 13:19:33.703708 14383 ts_tablet_manager.cc:1403] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:19:33.708273 14383 raft_consensus.cc:359] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.708925 14383 raft_consensus.cc:385] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:33.709182 14383 raft_consensus.cc:740] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Initialized, Role: FOLLOWER
I20260709 13:19:33.709844 14383 consensus_queue.cc:260] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.713697 14383 ts_tablet_manager.cc:1434] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:19:33.715260 14332 raft_consensus.cc:515] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.717728 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7893d6268fbe402c9976a308df739123" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:33.718320 14091 raft_consensus.cc:3060] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.720280 14237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7893d6268fbe402c9976a308df739123" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:33.720932 14237 raft_consensus.cc:3060] T 7893d6268fbe402c9976a308df739123 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.721552 13989 catalog_manager.cc:5697] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def reported cstate change: term changed from 0 to 1, leader changed from <none> to 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131). New cstate: current_term: 1 leader_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:33.724540 14332 leader_election.cc:290] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:33.725880 14091 raft_consensus.cc:2468] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 1.
I20260709 13:19:33.728124 14237 raft_consensus.cc:2468] T 7893d6268fbe402c9976a308df739123 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 1.
I20260709 13:19:33.728989 14129 leader_election.cc:304] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:33.730185 14332 raft_consensus.cc:2804] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:33.730664 14332 raft_consensus.cc:697] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Becoming Leader. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Running, Role: LEADER
I20260709 13:19:33.731518 14332 consensus_queue.cc:237] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.739357 13987 catalog_manager.cc:5697] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba reported cstate change: term changed from 0 to 1, leader changed from <none> to 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130). New cstate: current_term: 1 leader_uuid: "5954043bd41748caa5fb81fecb7d6aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:33.809696 14402 consensus_queue.cc:1048] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:33.813894 14367 consensus_queue.cc:1048] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:33.823093 14424 raft_consensus.cc:493] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.823647 14424 raft_consensus.cc:515] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.826049 14424 leader_election.cc:290] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:33.830542 14402 raft_consensus.cc:493] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.831239 14402 raft_consensus.cc:515] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.832705 14401 consensus_queue.cc:1048] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:33.832922 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe684d4341841fabe0c9407024aacb4" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d" is_pre_election: true
I20260709 13:19:33.834306 14166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe684d4341841fabe0c9407024aacb4" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba" is_pre_election: true
I20260709 13:19:33.834458 14091 raft_consensus.cc:2468] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 0.
I20260709 13:19:33.835054 14166 raft_consensus.cc:2468] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 0.
I20260709 13:19:33.835618 14164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe684d4341841fabe0c9407024aacb4" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba" is_pre_election: true
I20260709 13:19:33.836316 14164 raft_consensus.cc:2468] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 0.
I20260709 13:19:33.836436 14203 leader_election.cc:304] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:33.837960 14285 raft_consensus.cc:2804] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:33.838325 14285 raft_consensus.cc:493] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.838677 14285 raft_consensus.cc:3060] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.838891 14236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe684d4341841fabe0c9407024aacb4" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" is_pre_election: true
I20260709 13:19:33.833671 14402 leader_election.cc:290] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:33.840696 14056 leader_election.cc:304] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:33.841639 14402 raft_consensus.cc:2804] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:33.842085 14402 raft_consensus.cc:493] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.842788 14402 raft_consensus.cc:3060] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.848255 14285 raft_consensus.cc:515] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.849817 14236 raft_consensus.cc:2393] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ee834a1e7a84598895d25a0d704119d in current term 1: Already voted for candidate 56d11c1d43ec4f85956fcfa2d6b03def in this term.
I20260709 13:19:33.856734 14285 leader_election.cc:290] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:33.858096 14396 consensus_queue.cc:1048] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:33.858333 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe684d4341841fabe0c9407024aacb4" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:33.853178 14402 raft_consensus.cc:515] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.858232 14164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe684d4341841fabe0c9407024aacb4" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:33.859490 14091 raft_consensus.cc:2393] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 56d11c1d43ec4f85956fcfa2d6b03def in current term 1: Already voted for candidate 7ee834a1e7a84598895d25a0d704119d in this term.
I20260709 13:19:33.859593 14164 raft_consensus.cc:3060] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:33.867735 14166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe684d4341841fabe0c9407024aacb4" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:33.871300 14164 raft_consensus.cc:2468] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 1.
I20260709 13:19:33.873513 14205 leader_election.cc:304] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 5954043bd41748caa5fb81fecb7d6aba; no voters: 7ee834a1e7a84598895d25a0d704119d
I20260709 13:19:33.875950 14285 raft_consensus.cc:2804] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:33.876708 14285 raft_consensus.cc:697] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Becoming Leader. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Running, Role: LEADER
I20260709 13:19:33.876897 14236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe684d4341841fabe0c9407024aacb4" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:33.878106 14285 consensus_queue.cc:237] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:33.878794 14402 leader_election.cc:290] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 election: Requested vote from peers 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:33.878762 14057 leader_election.cc:304] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ee834a1e7a84598895d25a0d704119d; no voters: 56d11c1d43ec4f85956fcfa2d6b03def, 5954043bd41748caa5fb81fecb7d6aba
I20260709 13:19:33.880236 14402 raft_consensus.cc:2749] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:33.894510 13989 catalog_manager.cc:5697] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def reported cstate change: term changed from 0 to 1, leader changed from <none> to 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131). New cstate: current_term: 1 leader_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:33.957191 14436 consensus_queue.cc:1048] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:33.968699 14436 consensus_queue.cc:1048] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:34.023841 14285 raft_consensus.cc:493] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.024385 14285 raft_consensus.cc:515] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.026093 14285 leader_election.cc:290] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:34.027103 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293bc98621164ca0b8519df20d82d270" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee834a1e7a84598895d25a0d704119d" is_pre_election: true
I20260709 13:19:34.027350 14164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293bc98621164ca0b8519df20d82d270" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5954043bd41748caa5fb81fecb7d6aba" is_pre_election: true
I20260709 13:19:34.027930 14091 raft_consensus.cc:2393] T 293bc98621164ca0b8519df20d82d270 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56d11c1d43ec4f85956fcfa2d6b03def in current term 1: Already voted for candidate 5954043bd41748caa5fb81fecb7d6aba in this term.
I20260709 13:19:34.029129 14205 leader_election.cc:304] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def; no voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d
I20260709 13:19:34.029891 14285 raft_consensus.cc:3060] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:34.035168 14285 raft_consensus.cc:2749] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:34.047159 14285 consensus_queue.cc:1048] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:34.058660 14424 consensus_queue.cc:1048] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:34.071125 14401 consensus_queue.cc:1048] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:34.084892 14401 consensus_queue.cc:1048] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:34.095582 14424 consensus_queue.cc:1048] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:34.107795 14424 consensus_queue.cc:1048] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:34.118386 14401 consensus_queue.cc:1048] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:34.132023 14401 consensus_queue.cc:1048] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:34.133308 14402 consensus_queue.cc:1048] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:34.154444 14367 consensus_queue.cc:1048] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:34.169870 14164 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67a1f91874cd48feb2401b249e367f15"
dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
mode: GRACEFUL
new_leader_uuid: "7ee834a1e7a84598895d25a0d704119d"
 from {username='slave'} at 127.0.0.1:35202
I20260709 13:19:34.170547 14164 raft_consensus.cc:606] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Received request to transfer leadership to TS 7ee834a1e7a84598895d25a0d704119d
I20260709 13:19:34.178648 14164 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddab0bf0adfd4b5eb476c08171adf368"
dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
mode: GRACEFUL
new_leader_uuid: "7ee834a1e7a84598895d25a0d704119d"
 from {username='slave'} at 127.0.0.1:35202
I20260709 13:19:34.179229 14164 raft_consensus.cc:606] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Received request to transfer leadership to TS 7ee834a1e7a84598895d25a0d704119d
I20260709 13:19:34.187595 14236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf9eb0860bf04bfd98b9d06518d914e0"
dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
mode: GRACEFUL
new_leader_uuid: "7ee834a1e7a84598895d25a0d704119d"
 from {username='slave'} at 127.0.0.1:56662
I20260709 13:19:34.188123 14236 raft_consensus.cc:606] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Received request to transfer leadership to TS 7ee834a1e7a84598895d25a0d704119d
I20260709 13:19:34.192880 14090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb054fea3a604e4bb57f269232337582"
dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
mode: GRACEFUL
new_leader_uuid: "5954043bd41748caa5fb81fecb7d6aba"
 from {username='slave'} at 127.0.0.1:38134
I20260709 13:19:34.193375 14090 raft_consensus.cc:606] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [term 1 LEADER]: Received request to transfer leadership to TS 5954043bd41748caa5fb81fecb7d6aba
I20260709 13:19:34.198757 14236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06079b87b1d2466285752dce5a5f3bf4"
dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
mode: GRACEFUL
new_leader_uuid: "5954043bd41748caa5fb81fecb7d6aba"
 from {username='slave'} at 127.0.0.1:56662
I20260709 13:19:34.199301 14236 raft_consensus.cc:606] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Received request to transfer leadership to TS 5954043bd41748caa5fb81fecb7d6aba
I20260709 13:19:34.206983 14236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbe684d4341841fabe0c9407024aacb4"
dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
mode: GRACEFUL
new_leader_uuid: "5954043bd41748caa5fb81fecb7d6aba"
 from {username='slave'} at 127.0.0.1:56662
I20260709 13:19:34.207494 14236 raft_consensus.cc:606] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Received request to transfer leadership to TS 5954043bd41748caa5fb81fecb7d6aba
I20260709 13:19:34.212525 14164 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "293bc98621164ca0b8519df20d82d270"
dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
mode: GRACEFUL
new_leader_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
 from {username='slave'} at 127.0.0.1:35202
I20260709 13:19:34.213085 14164 raft_consensus.cc:606] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Received request to transfer leadership to TS 56d11c1d43ec4f85956fcfa2d6b03def
I20260709 13:19:34.320995 14436 raft_consensus.cc:993] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba: : Instructing follower 7ee834a1e7a84598895d25a0d704119d to start an election
I20260709 13:19:34.321442 14401 raft_consensus.cc:1081] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Signalling peer 7ee834a1e7a84598895d25a0d704119d to start an election
I20260709 13:19:34.323113 14090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddab0bf0adfd4b5eb476c08171adf368"
dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
 from {username='slave'} at 127.0.0.1:38126
I20260709 13:19:34.323639 14090 raft_consensus.cc:493] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:34.323956 14090 raft_consensus.cc:3060] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.329090 14090 raft_consensus.cc:515] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.330829 14090 leader_election.cc:290] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 2 election: Requested vote from peers 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:34.331862 14166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddab0bf0adfd4b5eb476c08171adf368" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:34.332598 14166 raft_consensus.cc:3055] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:34.332537 14236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddab0bf0adfd4b5eb476c08171adf368" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:34.333109 14166 raft_consensus.cc:740] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Running, Role: LEADER
I20260709 13:19:34.333307 14236 raft_consensus.cc:3060] T ddab0bf0adfd4b5eb476c08171adf368 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.333954 14166 consensus_queue.cc:260] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.334924 14166 raft_consensus.cc:3060] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.339257 14236 raft_consensus.cc:2468] T ddab0bf0adfd4b5eb476c08171adf368 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 2.
I20260709 13:19:34.339766 14166 raft_consensus.cc:2468] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 2.
I20260709 13:19:34.340595 14057 leader_election.cc:304] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:34.341355 14367 raft_consensus.cc:2804] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:34.341845 14367 raft_consensus.cc:697] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d [term 2 LEADER]: Becoming Leader. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Running, Role: LEADER
I20260709 13:19:34.342559 14367 consensus_queue.cc:237] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.349301 13986 catalog_manager.cc:5697] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d reported cstate change: term changed from 1 to 2, leader changed from 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130) to 7ee834a1e7a84598895d25a0d704119d (127.1.227.129). New cstate: current_term: 2 leader_uuid: "7ee834a1e7a84598895d25a0d704119d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:34.357865 14285 consensus_queue.cc:1048] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:34.365998 14424 raft_consensus.cc:993] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def: : Instructing follower 5954043bd41748caa5fb81fecb7d6aba to start an election
I20260709 13:19:34.366485 14424 raft_consensus.cc:1081] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Signalling peer 5954043bd41748caa5fb81fecb7d6aba to start an election
I20260709 13:19:34.368741 14164 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbe684d4341841fabe0c9407024aacb4"
dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
 from {username='slave'} at 127.0.0.1:35192
I20260709 13:19:34.369359 14164 raft_consensus.cc:493] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:34.369724 14164 raft_consensus.cc:3060] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.373116 14417 consensus_queue.cc:1048] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:34.376979 14164 raft_consensus.cc:515] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.380306 14091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe684d4341841fabe0c9407024aacb4" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:34.380752 14164 leader_election.cc:290] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 2 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:34.382236 14237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe684d4341841fabe0c9407024aacb4" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:34.382911 14237 raft_consensus.cc:3055] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:34.383209 14237 raft_consensus.cc:740] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Running, Role: LEADER
I20260709 13:19:34.383975 14237 consensus_queue.cc:260] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.384850 14237 raft_consensus.cc:3060] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.390350 14237 raft_consensus.cc:2468] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 2.
I20260709 13:19:34.391469 14132 leader_election.cc:304] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 5954043bd41748caa5fb81fecb7d6aba; no voters: 7ee834a1e7a84598895d25a0d704119d
I20260709 13:19:34.392164 14436 raft_consensus.cc:2804] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:34.392628 14436 raft_consensus.cc:697] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba [term 2 LEADER]: Becoming Leader. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Running, Role: LEADER
I20260709 13:19:34.393416 14436 consensus_queue.cc:237] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.400890 13986 catalog_manager.cc:5697] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba reported cstate change: term changed from 1 to 2, leader changed from 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131) to 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130). New cstate: current_term: 2 leader_uuid: "5954043bd41748caa5fb81fecb7d6aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:34.467979 14285 raft_consensus.cc:993] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def: : Instructing follower 7ee834a1e7a84598895d25a0d704119d to start an election
I20260709 13:19:34.468446 14417 raft_consensus.cc:1081] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Signalling peer 7ee834a1e7a84598895d25a0d704119d to start an election
I20260709 13:19:34.470062 14090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf9eb0860bf04bfd98b9d06518d914e0"
dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
 from {username='slave'} at 127.0.0.1:38114
I20260709 13:19:34.470544 14090 raft_consensus.cc:493] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:34.470780 14090 raft_consensus.cc:3060] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.475585 14090 raft_consensus.cc:515] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.477039 14401 raft_consensus.cc:993] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba: : Instructing follower 56d11c1d43ec4f85956fcfa2d6b03def to start an election
I20260709 13:19:34.477542 14090 leader_election.cc:290] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 2 election: Requested vote from peers 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:34.477627 14436 raft_consensus.cc:1081] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Signalling peer 56d11c1d43ec4f85956fcfa2d6b03def to start an election
I20260709 13:19:34.477995 14164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf9eb0860bf04bfd98b9d06518d914e0" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:34.478307 14237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf9eb0860bf04bfd98b9d06518d914e0" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:34.478674 14164 raft_consensus.cc:3060] T cf9eb0860bf04bfd98b9d06518d914e0 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.478927 14237 raft_consensus.cc:3055] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:34.479377 14237 raft_consensus.cc:740] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Running, Role: LEADER
I20260709 13:19:34.480036 14236 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "293bc98621164ca0b8519df20d82d270"
dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
 from {username='slave'} at 127.0.0.1:56652
I20260709 13:19:34.480053 14237 consensus_queue.cc:260] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.480834 14236 raft_consensus.cc:493] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:34.481215 14236 raft_consensus.cc:3060] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.481572 14237 raft_consensus.cc:3060] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.485644 14164 raft_consensus.cc:2468] T cf9eb0860bf04bfd98b9d06518d914e0 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 2.
I20260709 13:19:34.487190 14056 leader_election.cc:304] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5954043bd41748caa5fb81fecb7d6aba, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:34.488189 14392 raft_consensus.cc:2804] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:34.488341 14237 raft_consensus.cc:2468] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 2.
I20260709 13:19:34.488461 14236 raft_consensus.cc:515] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.488773 14392 raft_consensus.cc:697] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d [term 2 LEADER]: Becoming Leader. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Running, Role: LEADER
I20260709 13:19:34.490443 14392 consensus_queue.cc:237] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.491559 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293bc98621164ca0b8519df20d82d270" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:34.492147 14090 raft_consensus.cc:3060] T 293bc98621164ca0b8519df20d82d270 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.495888 14164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293bc98621164ca0b8519df20d82d270" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:34.497094 14164 raft_consensus.cc:3055] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:34.497534 14164 raft_consensus.cc:740] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Running, Role: LEADER
I20260709 13:19:34.498522 14164 consensus_queue.cc:260] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.499766 14164 raft_consensus.cc:3060] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.500000 14090 raft_consensus.cc:2468] T 293bc98621164ca0b8519df20d82d270 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 2.
I20260709 13:19:34.500267 13987 catalog_manager.cc:5697] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d reported cstate change: term changed from 1 to 2, leader changed from 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131) to 7ee834a1e7a84598895d25a0d704119d (127.1.227.129). New cstate: current_term: 2 leader_uuid: "7ee834a1e7a84598895d25a0d704119d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:34.501313 14203 leader_election.cc:304] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:34.502310 14417 raft_consensus.cc:2804] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:34.502803 14417 raft_consensus.cc:697] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 LEADER]: Becoming Leader. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Running, Role: LEADER
I20260709 13:19:34.503582 14417 consensus_queue.cc:237] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.496500 14236 leader_election.cc:290] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 2 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:34.508559 14164 raft_consensus.cc:2468] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 2.
I20260709 13:19:34.512615 13986 catalog_manager.cc:5697] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def reported cstate change: term changed from 1 to 2, leader changed from 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130) to 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131). New cstate: current_term: 2 leader_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:34.523622 14396 raft_consensus.cc:993] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba: : Instructing follower 7ee834a1e7a84598895d25a0d704119d to start an election
I20260709 13:19:34.524222 14436 raft_consensus.cc:1081] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Signalling peer 7ee834a1e7a84598895d25a0d704119d to start an election
I20260709 13:19:34.525949 14090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67a1f91874cd48feb2401b249e367f15"
dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
 from {username='slave'} at 127.0.0.1:38126
I20260709 13:19:34.526537 14090 raft_consensus.cc:493] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:34.526924 14090 raft_consensus.cc:3060] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.532456 14090 raft_consensus.cc:515] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.534354 14090 leader_election.cc:290] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 2 election: Requested vote from peers 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:34.535145 14164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a1f91874cd48feb2401b249e367f15" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:34.535379 14236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a1f91874cd48feb2401b249e367f15" candidate_uuid: "7ee834a1e7a84598895d25a0d704119d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:34.535902 14164 raft_consensus.cc:3055] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:34.535982 14236 raft_consensus.cc:3060] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.536280 14164 raft_consensus.cc:740] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Running, Role: LEADER
I20260709 13:19:34.537201 14164 consensus_queue.cc:260] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.538321 14164 raft_consensus.cc:3060] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.541626 14236 raft_consensus.cc:2468] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 2.
I20260709 13:19:34.542881 14057 leader_election.cc:304] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:34.543650 14392 raft_consensus.cc:2804] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:34.544210 14392 raft_consensus.cc:697] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [term 2 LEADER]: Becoming Leader. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Running, Role: LEADER
I20260709 13:19:34.544487 14164 raft_consensus.cc:2468] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee834a1e7a84598895d25a0d704119d in term 2.
I20260709 13:19:34.545157 14392 consensus_queue.cc:237] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.552685 13986 catalog_manager.cc:5697] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d reported cstate change: term changed from 1 to 2, leader changed from 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130) to 7ee834a1e7a84598895d25a0d704119d (127.1.227.129). New cstate: current_term: 2 leader_uuid: "7ee834a1e7a84598895d25a0d704119d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:34.693495 14367 raft_consensus.cc:993] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d: : Instructing follower 5954043bd41748caa5fb81fecb7d6aba to start an election
I20260709 13:19:34.693980 14392 raft_consensus.cc:1081] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [term 1 LEADER]: Signalling peer 5954043bd41748caa5fb81fecb7d6aba to start an election
I20260709 13:19:34.695731 14164 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb054fea3a604e4bb57f269232337582"
dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
 from {username='slave'} at 127.0.0.1:35178
I20260709 13:19:34.696321 14164 raft_consensus.cc:493] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:34.696646 14164 raft_consensus.cc:3060] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.702890 14164 raft_consensus.cc:515] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.705233 14164 leader_election.cc:290] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 2 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:34.706120 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb054fea3a604e4bb57f269232337582" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:34.706269 14236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb054fea3a604e4bb57f269232337582" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:34.706858 14236 raft_consensus.cc:3060] T cb054fea3a604e4bb57f269232337582 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.706866 14090 raft_consensus.cc:3055] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:34.707599 14090 raft_consensus.cc:740] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Running, Role: LEADER
I20260709 13:19:34.708817 14090 consensus_queue.cc:260] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.710228 14090 raft_consensus.cc:3060] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.716001 14424 raft_consensus.cc:993] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def: : Instructing follower 5954043bd41748caa5fb81fecb7d6aba to start an election
I20260709 13:19:34.715669 14236 raft_consensus.cc:2468] T cb054fea3a604e4bb57f269232337582 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 2.
I20260709 13:19:34.717089 14424 raft_consensus.cc:1081] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Signalling peer 5954043bd41748caa5fb81fecb7d6aba to start an election
I20260709 13:19:34.717195 14090 raft_consensus.cc:2468] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 2.
I20260709 13:19:34.717823 14132 leader_election.cc:304] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 5954043bd41748caa5fb81fecb7d6aba; no voters: 
I20260709 13:19:34.718705 14436 raft_consensus.cc:2804] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:34.718953 14164 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06079b87b1d2466285752dce5a5f3bf4"
dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
 from {username='slave'} at 127.0.0.1:35192
I20260709 13:19:34.719244 14436 raft_consensus.cc:697] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba [term 2 LEADER]: Becoming Leader. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Running, Role: LEADER
I20260709 13:19:34.719563 14164 raft_consensus.cc:493] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:34.719976 14164 raft_consensus.cc:3060] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.720163 14436 consensus_queue.cc:237] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.726015 14164 raft_consensus.cc:515] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.728483 14164 leader_election.cc:290] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 2 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131:46399)
I20260709 13:19:34.728873 14236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06079b87b1d2466285752dce5a5f3bf4" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
I20260709 13:19:34.728969 13986 catalog_manager.cc:5697] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba reported cstate change: term changed from 1 to 2, leader changed from 7ee834a1e7a84598895d25a0d704119d (127.1.227.129) to 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130). New cstate: current_term: 2 leader_uuid: "5954043bd41748caa5fb81fecb7d6aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:34.729791 14236 raft_consensus.cc:3055] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:34.729769 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06079b87b1d2466285752dce5a5f3bf4" candidate_uuid: "5954043bd41748caa5fb81fecb7d6aba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:34.730540 14236 raft_consensus.cc:740] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Running, Role: LEADER
I20260709 13:19:34.731078 14090 raft_consensus.cc:3060] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.731494 14236 consensus_queue.cc:260] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.733227 14236 raft_consensus.cc:3060] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.741978 14090 raft_consensus.cc:2468] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 2.
I20260709 13:19:34.742296 14236 raft_consensus.cc:2468] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5954043bd41748caa5fb81fecb7d6aba in term 2.
I20260709 13:19:34.743500 14132 leader_election.cc:304] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 5954043bd41748caa5fb81fecb7d6aba; no voters: 
I20260709 13:19:34.744381 14436 raft_consensus.cc:2804] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:34.744910 14436 raft_consensus.cc:697] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [term 2 LEADER]: Becoming Leader. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Running, Role: LEADER
I20260709 13:19:34.745713 14436 consensus_queue.cc:237] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:34.754398 13986 catalog_manager.cc:5697] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba reported cstate change: term changed from 1 to 2, leader changed from 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131) to 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130). New cstate: current_term: 2 leader_uuid: "5954043bd41748caa5fb81fecb7d6aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:34.808269 14090 raft_consensus.cc:3060] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.814728 14090 raft_consensus.cc:1275] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Refusing update from remote peer 5954043bd41748caa5fb81fecb7d6aba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:34.816030 14436 consensus_queue.cc:1048] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:34.824868 14236 raft_consensus.cc:1275] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Refusing update from remote peer 5954043bd41748caa5fb81fecb7d6aba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:34.826412 14436 consensus_queue.cc:1048] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:34.851465 14164 raft_consensus.cc:1275] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Refusing update from remote peer 7ee834a1e7a84598895d25a0d704119d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:34.853165 14392 consensus_queue.cc:1048] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:34.863101 14236 raft_consensus.cc:1275] T ddab0bf0adfd4b5eb476c08171adf368 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Refusing update from remote peer 7ee834a1e7a84598895d25a0d704119d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:34.864389 14392 consensus_queue.cc:1048] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:34.911914 14164 raft_consensus.cc:1275] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Refusing update from remote peer 56d11c1d43ec4f85956fcfa2d6b03def: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:34.913208 14424 consensus_queue.cc:1048] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:34.920655 14090 raft_consensus.cc:1275] T 293bc98621164ca0b8519df20d82d270 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Refusing update from remote peer 56d11c1d43ec4f85956fcfa2d6b03def: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:34.922111 14285 consensus_queue.cc:1048] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:34.963738 14236 raft_consensus.cc:1275] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Refusing update from remote peer 7ee834a1e7a84598895d25a0d704119d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:34.965171 14392 consensus_queue.cc:1048] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:34.974136 14164 raft_consensus.cc:1275] T cf9eb0860bf04bfd98b9d06518d914e0 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Refusing update from remote peer 7ee834a1e7a84598895d25a0d704119d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:34.976825 14367 consensus_queue.cc:1048] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:35.118393 14164 raft_consensus.cc:1275] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Refusing update from remote peer 7ee834a1e7a84598895d25a0d704119d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:35.119760 14367 consensus_queue.cc:1048] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:35.128690 14236 raft_consensus.cc:1275] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Refusing update from remote peer 7ee834a1e7a84598895d25a0d704119d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:35.131414 14367 consensus_queue.cc:1048] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:35.141513 14236 raft_consensus.cc:1275] T cb054fea3a604e4bb57f269232337582 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Refusing update from remote peer 5954043bd41748caa5fb81fecb7d6aba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:35.142776 14436 consensus_queue.cc:1048] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:35.151501 14090 raft_consensus.cc:1275] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Refusing update from remote peer 5954043bd41748caa5fb81fecb7d6aba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:35.154510 14401 consensus_queue.cc:1048] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:35.173837 14090 raft_consensus.cc:1275] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Refusing update from remote peer 5954043bd41748caa5fb81fecb7d6aba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:35.175477 14460 consensus_queue.cc:1048] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:35.184696 14236 raft_consensus.cc:1275] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Refusing update from remote peer 5954043bd41748caa5fb81fecb7d6aba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:35.186383 14401 consensus_queue.cc:1048] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:37.216565 13989 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37622:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:19:37.237671 13989 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37622:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:19:37.269372  1934 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:19:37.402693 14494 tablet.cc:1724] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.513413 14511 tablet.cc:1724] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.520100 14513 tablet.cc:1724] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.523554 14510 tablet.cc:1724] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.526628 14514 tablet.cc:1724] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.543566 14516 tablet.cc:1724] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.508360 14499 tablet.cc:1724] T cb054fea3a604e4bb57f269232337582 P 56d11c1d43ec4f85956fcfa2d6b03def: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.554791 14511 tablet.cc:1724] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.613946 14159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06079b87b1d2466285752dce5a5f3bf4"
dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
mode: GRACEFUL
new_leader_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
 from {username='slave'} at 127.0.0.1:57192
W20260709 13:19:37.560528 14192 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:06079b87b1d2466285752dce5a5f3bf4)
I20260709 13:19:37.614683 14159 raft_consensus.cc:606] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [term 2 LEADER]: Received request to transfer leadership to TS 56d11c1d43ec4f85956fcfa2d6b03def
I20260709 13:19:37.615536 14517 tablet.cc:1724] T 7893d6268fbe402c9976a308df739123 P 56d11c1d43ec4f85956fcfa2d6b03def: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.565181 14524 tablet.cc:1724] T 293bc98621164ca0b8519df20d82d270 P 7ee834a1e7a84598895d25a0d704119d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:37.630924 14192 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:06079b87b1d2466285752dce5a5f3bf4)
I20260709 13:19:37.630499 14514 tablet.cc:1724] T ddab0bf0adfd4b5eb476c08171adf368 P 56d11c1d43ec4f85956fcfa2d6b03def: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:37.631986 14192 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:06079b87b1d2466285752dce5a5f3bf4)
I20260709 13:19:37.590962 14523 tablet.cc:1724] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.588932 14525 tablet.cc:1724] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.708920 14494 tablet.cc:1724] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.717281 14525 tablet.cc:1724] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.733566 14517 tablet.cc:1724] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:37.736320 14056 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.130:45935, user_credentials={real_user=slave}} blocked reactor thread for 64974.6us
I20260709 13:19:37.735214 14514 tablet.cc:1724] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.737309 14519 tablet.cc:1724] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.742169 14524 tablet.cc:1724] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.748128 14525 tablet.cc:1724] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.760350 14088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67a1f91874cd48feb2401b249e367f15"
dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
mode: GRACEFUL
new_leader_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
 from {username='slave'} at 127.0.0.1:50000
I20260709 13:19:37.761142 14088 raft_consensus.cc:606] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [term 2 LEADER]: Received request to transfer leadership to TS 56d11c1d43ec4f85956fcfa2d6b03def
I20260709 13:19:37.763000  1934 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:19:37.765014  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:37.774101 14513 tablet.cc:1724] T a7aab7fb420049159a4bfcab7b889532 P 5954043bd41748caa5fb81fecb7d6aba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.782572 14525 tablet.cc:1724] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.790458 14088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b5bed5fb52d4094a3f9536ae4a44489"
dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
mode: GRACEFUL
new_leader_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
 from {username='slave'} at 127.0.0.1:50000
I20260709 13:19:37.777727 14514 tablet.cc:1724] T a7aab7fb420049159a4bfcab7b889532 P 56d11c1d43ec4f85956fcfa2d6b03def: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.791173 14088 raft_consensus.cc:606] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [term 2 LEADER]: Received request to transfer leadership to TS 56d11c1d43ec4f85956fcfa2d6b03def
I20260709 13:19:37.764170 14523 tablet.cc:1724] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.793500 14510 tablet.cc:1724] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.794229 14516 tablet.cc:1724] T cf9eb0860bf04bfd98b9d06518d914e0 P 5954043bd41748caa5fb81fecb7d6aba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.798218 14165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "964474b1f4294f9aae36715d726b18ac"
dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
mode: GRACEFUL
new_leader_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:19:37.799027 14165 raft_consensus.cc:606] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Received request to transfer leadership to TS 56d11c1d43ec4f85956fcfa2d6b03def
I20260709 13:19:37.808499  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:19:37.809577  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:37.815137 14513 tablet.cc:1724] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:37.839174 13986 catalog_manager.cc:6242] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f: soft_deleted_table [id=fbb950d1aeeb43959f8e343c3d932f68] alter complete (version 1)
I20260709 13:19:37.914839 14496 raft_consensus.cc:993] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d: : Instructing follower 56d11c1d43ec4f85956fcfa2d6b03def to start an election
I20260709 13:19:37.915422 14538 raft_consensus.cc:1081] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [term 2 LEADER]: Signalling peer 56d11c1d43ec4f85956fcfa2d6b03def to start an election
I20260709 13:19:37.917399 14238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b5bed5fb52d4094a3f9536ae4a44489"
dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
 from {username='slave'} at 127.0.0.1:56640
I20260709 13:19:37.918228 14238 raft_consensus.cc:493] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:37.918555 14238 raft_consensus.cc:3060] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:37.924877 14238 raft_consensus.cc:515] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:37.927016 14238 leader_election.cc:290] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 3 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:37.927752 14088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b5bed5fb52d4094a3f9536ae4a44489" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:37.928139 14165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b5bed5fb52d4094a3f9536ae4a44489" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:37.928541 14088 raft_consensus.cc:3055] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:37.928879 14088 raft_consensus.cc:740] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Running, Role: LEADER
I20260709 13:19:37.928936 14165 raft_consensus.cc:3060] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:37.929877 14088 consensus_queue.cc:260] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:37.930878 14088 raft_consensus.cc:3060] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:37.934958 14165 raft_consensus.cc:2468] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 3.
I20260709 13:19:37.936254 14088 raft_consensus.cc:2468] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 3.
I20260709 13:19:37.936305 14205 leader_election.cc:304] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 5954043bd41748caa5fb81fecb7d6aba; no voters: 
I20260709 13:19:37.937691 14535 raft_consensus.cc:2804] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:37.938274 14535 raft_consensus.cc:697] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 3 LEADER]: Becoming Leader. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Running, Role: LEADER
I20260709 13:19:37.939028 14535 consensus_queue.cc:237] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:37.946839 13986 catalog_manager.cc:5697] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def reported cstate change: term changed from 2 to 3, leader changed from 7ee834a1e7a84598895d25a0d704119d (127.1.227.129) to 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131). New cstate: current_term: 3 leader_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:38.032459 14496 raft_consensus.cc:993] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d: : Instructing follower 56d11c1d43ec4f85956fcfa2d6b03def to start an election
I20260709 13:19:38.033196 14538 raft_consensus.cc:1081] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [term 2 LEADER]: Signalling peer 56d11c1d43ec4f85956fcfa2d6b03def to start an election
I20260709 13:19:38.035122 14234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67a1f91874cd48feb2401b249e367f15"
dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
 from {username='slave'} at 127.0.0.1:56640
I20260709 13:19:38.035652 14234 raft_consensus.cc:493] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:38.035948 14234 raft_consensus.cc:3060] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:38.041360 14234 raft_consensus.cc:515] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:38.043449 14234 leader_election.cc:290] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 3 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:38.044159 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a1f91874cd48feb2401b249e367f15" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:38.044869 14090 raft_consensus.cc:3055] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:38.044718 14165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a1f91874cd48feb2401b249e367f15" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:38.045302 14090 raft_consensus.cc:740] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ee834a1e7a84598895d25a0d704119d, State: Running, Role: LEADER
I20260709 13:19:38.045495 14165 raft_consensus.cc:3060] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:38.046135 14090 consensus_queue.cc:260] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:38.047358 14090 raft_consensus.cc:3060] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:38.052884 14165 raft_consensus.cc:2468] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 3.
I20260709 13:19:38.054142 14090 raft_consensus.cc:2468] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 3.
I20260709 13:19:38.054082 14205 leader_election.cc:304] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 5954043bd41748caa5fb81fecb7d6aba; no voters: 
I20260709 13:19:38.055019 14535 raft_consensus.cc:2804] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:38.055528 14535 raft_consensus.cc:697] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [term 3 LEADER]: Becoming Leader. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Running, Role: LEADER
I20260709 13:19:38.056397 14535 consensus_queue.cc:237] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:38.063364 13986 catalog_manager.cc:5697] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def reported cstate change: term changed from 2 to 3, leader changed from 7ee834a1e7a84598895d25a0d704119d (127.1.227.129) to 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131). New cstate: current_term: 3 leader_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:38.086040 14504 raft_consensus.cc:993] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba: : Instructing follower 56d11c1d43ec4f85956fcfa2d6b03def to start an election
I20260709 13:19:38.086665 14506 raft_consensus.cc:1081] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Signalling peer 56d11c1d43ec4f85956fcfa2d6b03def to start an election
I20260709 13:19:38.088253 14238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "964474b1f4294f9aae36715d726b18ac"
dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
 from {username='slave'} at 127.0.0.1:56652
I20260709 13:19:38.088761 14238 raft_consensus.cc:493] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:38.089123 14238 raft_consensus.cc:3060] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:38.096302 14238 raft_consensus.cc:515] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:38.098613 14238 leader_election.cc:290] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 2 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:38.098927 14504 raft_consensus.cc:993] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba: : Instructing follower 56d11c1d43ec4f85956fcfa2d6b03def to start an election
I20260709 13:19:38.099543 14506 raft_consensus.cc:1081] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [term 2 LEADER]: Signalling peer 56d11c1d43ec4f85956fcfa2d6b03def to start an election
I20260709 13:19:38.099903 14165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964474b1f4294f9aae36715d726b18ac" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:38.099546 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964474b1f4294f9aae36715d726b18ac" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:38.100575 14165 raft_consensus.cc:3055] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:38.100878 14090 raft_consensus.cc:3060] T 964474b1f4294f9aae36715d726b18ac P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:38.101626 14238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06079b87b1d2466285752dce5a5f3bf4"
dest_uuid: "56d11c1d43ec4f85956fcfa2d6b03def"
 from {username='slave'} at 127.0.0.1:56652
I20260709 13:19:38.102372 14238 raft_consensus.cc:493] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:38.102809 14238 raft_consensus.cc:3060] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:38.101007 14165 raft_consensus.cc:740] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Running, Role: LEADER
I20260709 13:19:38.104290 14165 consensus_queue.cc:260] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:38.105650 14165 raft_consensus.cc:3060] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:38.108512 14090 raft_consensus.cc:2468] T 964474b1f4294f9aae36715d726b18ac P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 2.
I20260709 13:19:38.109791 14203 leader_election.cc:304] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 7ee834a1e7a84598895d25a0d704119d; no voters: 
I20260709 13:19:38.110598 14535 raft_consensus.cc:2804] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:38.111073 14535 raft_consensus.cc:697] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 LEADER]: Becoming Leader. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Running, Role: LEADER
I20260709 13:19:38.110831 14238 raft_consensus.cc:515] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:38.112025 14535 consensus_queue.cc:237] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:38.112908 14165 raft_consensus.cc:2468] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 2.
I20260709 13:19:38.113946 14238 leader_election.cc:290] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 3 election: Requested vote from peers 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823), 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935)
I20260709 13:19:38.114027 14090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06079b87b1d2466285752dce5a5f3bf4" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "7ee834a1e7a84598895d25a0d704119d"
I20260709 13:19:38.114881 14090 raft_consensus.cc:3060] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:38.115607 14165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06079b87b1d2466285752dce5a5f3bf4" candidate_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "5954043bd41748caa5fb81fecb7d6aba"
I20260709 13:19:38.116185 14165 raft_consensus.cc:3055] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:38.116485 14165 raft_consensus.cc:740] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5954043bd41748caa5fb81fecb7d6aba, State: Running, Role: LEADER
I20260709 13:19:38.117221 14165 consensus_queue.cc:260] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:38.118185 14165 raft_consensus.cc:3060] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:38.123914 14165 raft_consensus.cc:2468] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 3.
I20260709 13:19:38.125023 14205 leader_election.cc:304] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56d11c1d43ec4f85956fcfa2d6b03def, 5954043bd41748caa5fb81fecb7d6aba; no voters: 
I20260709 13:19:38.125943 14535 raft_consensus.cc:2804] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:38.126447 14535 raft_consensus.cc:697] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 3 LEADER]: Becoming Leader. State: Replica: 56d11c1d43ec4f85956fcfa2d6b03def, State: Running, Role: LEADER
I20260709 13:19:38.126518 14090 raft_consensus.cc:2468] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56d11c1d43ec4f85956fcfa2d6b03def in term 3.
I20260709 13:19:38.127425 14535 consensus_queue.cc:237] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } }
I20260709 13:19:38.127521 13986 catalog_manager.cc:5697] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def reported cstate change: term changed from 1 to 2, leader changed from 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130) to 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131). New cstate: current_term: 2 leader_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:38.140632 13986 catalog_manager.cc:5697] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def reported cstate change: term changed from 2 to 3, leader changed from 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130) to 56d11c1d43ec4f85956fcfa2d6b03def (127.1.227.131). New cstate: current_term: 3 leader_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 46399 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:38.426122 14165 raft_consensus.cc:1275] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba [term 3 FOLLOWER]: Refusing update from remote peer 56d11c1d43ec4f85956fcfa2d6b03def: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:38.427536 14535 consensus_queue.cc:1048] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:38.439671 14090 raft_consensus.cc:1275] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [term 3 FOLLOWER]: Refusing update from remote peer 56d11c1d43ec4f85956fcfa2d6b03def: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:38.444829 14547 consensus_queue.cc:1048] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:38.533833 14165 raft_consensus.cc:1275] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 3 FOLLOWER]: Refusing update from remote peer 56d11c1d43ec4f85956fcfa2d6b03def: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:19:38.535424 14548 consensus_queue.cc:1048] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:38.544094 14090 raft_consensus.cc:1275] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [term 3 FOLLOWER]: Refusing update from remote peer 56d11c1d43ec4f85956fcfa2d6b03def: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:19:38.545727 14535 consensus_queue.cc:1048] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:38.669306 14163 raft_consensus.cc:1275] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [term 3 FOLLOWER]: Refusing update from remote peer 56d11c1d43ec4f85956fcfa2d6b03def: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:19:38.670922 14547 consensus_queue.cc:1048] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:38.672817 14090 raft_consensus.cc:1275] T 964474b1f4294f9aae36715d726b18ac P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Refusing update from remote peer 56d11c1d43ec4f85956fcfa2d6b03def: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:38.674392 14535 consensus_queue.cc:1048] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:38.676415 14090 raft_consensus.cc:1275] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d [term 3 FOLLOWER]: Refusing update from remote peer 56d11c1d43ec4f85956fcfa2d6b03def: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:19:38.678471 14535 consensus_queue.cc:1048] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee834a1e7a84598895d25a0d704119d" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 41823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:38.685541 14165 raft_consensus.cc:1275] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Refusing update from remote peer 56d11c1d43ec4f85956fcfa2d6b03def: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:38.688306 14535 consensus_queue.cc:1048] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def [LEADER]: Connected to new peer: Peer: permanent_uuid: "5954043bd41748caa5fb81fecb7d6aba" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:38.881510  1934 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:19:38.887174  1934 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:19:38.887583  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:38.892345  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:19:38.892741  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:39.928812  1934 tablet_server.cc:179] TabletServer@127.1.227.129:0 shutting down...
I20260709 13:19:39.966162  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:39.967244  1934 tablet_replica.cc:333] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d: stopping tablet replica
I20260709 13:19:39.968596  1934 raft_consensus.cc:2243] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:39.969758  1934 raft_consensus.cc:2272] T dbe684d4341841fabe0c9407024aacb4 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:39.973011  1934 tablet_replica.cc:333] T 293bc98621164ca0b8519df20d82d270 P 7ee834a1e7a84598895d25a0d704119d: stopping tablet replica
I20260709 13:19:39.974169  1934 raft_consensus.cc:2243] T 293bc98621164ca0b8519df20d82d270 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:39.975004  1934 raft_consensus.cc:2272] T 293bc98621164ca0b8519df20d82d270 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:39.978431  1934 tablet_replica.cc:333] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d: stopping tablet replica
I20260709 13:19:39.979410  1934 raft_consensus.cc:2243] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:39.980959  1934 raft_consensus.cc:2272] T cf9eb0860bf04bfd98b9d06518d914e0 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:39.983654  1934 tablet_replica.cc:333] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d: stopping tablet replica
I20260709 13:19:39.984701  1934 raft_consensus.cc:2243] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:39.986016  1934 raft_consensus.cc:2272] T ddab0bf0adfd4b5eb476c08171adf368 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:39.988633  1934 tablet_replica.cc:333] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d: stopping tablet replica
I20260709 13:19:39.989297  1934 raft_consensus.cc:2243] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:39.990577  1934 raft_consensus.cc:2272] T a7aab7fb420049159a4bfcab7b889532 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:39.993217  1934 tablet_replica.cc:333] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 7ee834a1e7a84598895d25a0d704119d: stopping tablet replica
I20260709 13:19:39.993892  1934 raft_consensus.cc:2243] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:39.994581  1934 raft_consensus.cc:2272] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:39.997272  1934 tablet_replica.cc:333] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d: stopping tablet replica
I20260709 13:19:39.997967  1934 raft_consensus.cc:2243] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:39.998497  1934 raft_consensus.cc:2272] T 06079b87b1d2466285752dce5a5f3bf4 P 7ee834a1e7a84598895d25a0d704119d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.001041  1934 tablet_replica.cc:333] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d: stopping tablet replica
I20260709 13:19:40.001724  1934 raft_consensus.cc:2243] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.002317  1934 raft_consensus.cc:2272] T 67a1f91874cd48feb2401b249e367f15 P 7ee834a1e7a84598895d25a0d704119d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.004879  1934 tablet_replica.cc:333] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d: stopping tablet replica
I20260709 13:19:40.005576  1934 raft_consensus.cc:2243] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.006230  1934 raft_consensus.cc:2272] T 7893d6268fbe402c9976a308df739123 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.008795  1934 tablet_replica.cc:333] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d: stopping tablet replica
I20260709 13:19:40.009486  1934 raft_consensus.cc:2243] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.010562  1934 raft_consensus.cc:2272] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.014104  1934 tablet_replica.cc:333] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d: stopping tablet replica
I20260709 13:19:40.014786  1934 raft_consensus.cc:2243] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.015405  1934 raft_consensus.cc:2272] T b15d17578b03487ba9237d3c1c5c34c3 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.018700  1934 tablet_replica.cc:333] T 964474b1f4294f9aae36715d726b18ac P 7ee834a1e7a84598895d25a0d704119d: stopping tablet replica
I20260709 13:19:40.019369  1934 raft_consensus.cc:2243] T 964474b1f4294f9aae36715d726b18ac P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.019953  1934 raft_consensus.cc:2272] T 964474b1f4294f9aae36715d726b18ac P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.022576  1934 tablet_replica.cc:333] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d: stopping tablet replica
I20260709 13:19:40.023214  1934 raft_consensus.cc:2243] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.023885  1934 raft_consensus.cc:2272] T cb054fea3a604e4bb57f269232337582 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.026547  1934 tablet_replica.cc:333] T 9c271260327e424b981fe0fceeef802e P 7ee834a1e7a84598895d25a0d704119d: stopping tablet replica
I20260709 13:19:40.027259  1934 raft_consensus.cc:2243] T 9c271260327e424b981fe0fceeef802e P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.027889  1934 raft_consensus.cc:2272] T 9c271260327e424b981fe0fceeef802e P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.031795  1934 tablet_replica.cc:333] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d: stopping tablet replica
I20260709 13:19:40.032505  1934 raft_consensus.cc:2243] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.034036  1934 raft_consensus.cc:2272] T a8c53dc94e244a44a022082d00d2bd77 P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.037047  1934 tablet_replica.cc:333] T a51739f6e4b8497ebb8907b488a98ace P 7ee834a1e7a84598895d25a0d704119d: stopping tablet replica
I20260709 13:19:40.037806  1934 raft_consensus.cc:2243] T a51739f6e4b8497ebb8907b488a98ace P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.038410  1934 raft_consensus.cc:2272] T a51739f6e4b8497ebb8907b488a98ace P 7ee834a1e7a84598895d25a0d704119d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.041102  1934 tablet_replica.cc:333] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d: stopping tablet replica
I20260709 13:19:40.041834  1934 raft_consensus.cc:2243] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.042532  1934 raft_consensus.cc:2272] T 6b5bed5fb52d4094a3f9536ae4a44489 P 7ee834a1e7a84598895d25a0d704119d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.046420  1934 tablet_replica.cc:333] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d: stopping tablet replica
I20260709 13:19:40.047423  1934 raft_consensus.cc:2243] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:19:40.048197 14552 consensus_queue.cc:1175] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "56d11c1d43ec4f85956fcfa2d6b03def" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
W20260709 13:19:40.049495 14129 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
I20260709 13:19:40.049512  1934 raft_consensus.cc:2272] T 4ddbce866d5b465ab05b190081a9516a P 7ee834a1e7a84598895d25a0d704119d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.053406 14129 consensus_peers.cc:597] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba -> Peer 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823): Couldn't send request to peer 7ee834a1e7a84598895d25a0d704119d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.081269 14129 consensus_peers.cc:597] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba -> Peer 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823): Couldn't send request to peer 7ee834a1e7a84598895d25a0d704119d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.099678 14203 consensus_peers.cc:597] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def -> Peer 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823): Couldn't send request to peer 7ee834a1e7a84598895d25a0d704119d. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:41823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.100267 14203 consensus_peers.cc:597] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def -> Peer 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823): Couldn't send request to peer 7ee834a1e7a84598895d25a0d704119d. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:41823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.107062  1934 tablet_server.cc:196] TabletServer@127.1.227.129:0 shutdown complete.
I20260709 13:19:40.162516  1934 tablet_server.cc:179] TabletServer@127.1.227.130:0 shutting down...
W20260709 13:19:40.172809 14203 consensus_peers.cc:597] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def -> Peer 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823): Couldn't send request to peer 7ee834a1e7a84598895d25a0d704119d. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:41823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.213982  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:40.215042  1934 tablet_replica.cc:333] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba: stopping tablet replica
I20260709 13:19:40.216333  1934 raft_consensus.cc:2243] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.217514  1934 raft_consensus.cc:2272] T dbe684d4341841fabe0c9407024aacb4 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.218088 14205 consensus_peers.cc:597] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def -> Peer 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935): Couldn't send request to peer 5954043bd41748caa5fb81fecb7d6aba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.220707  1934 tablet_replica.cc:333] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba: stopping tablet replica
I20260709 13:19:40.221908  1934 raft_consensus.cc:2243] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.222812  1934 raft_consensus.cc:2272] T 293bc98621164ca0b8519df20d82d270 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.225678  1934 tablet_replica.cc:333] T cf9eb0860bf04bfd98b9d06518d914e0 P 5954043bd41748caa5fb81fecb7d6aba: stopping tablet replica
I20260709 13:19:40.226662  1934 raft_consensus.cc:2243] T cf9eb0860bf04bfd98b9d06518d914e0 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.227432  1934 raft_consensus.cc:2272] T cf9eb0860bf04bfd98b9d06518d914e0 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.230717  1934 tablet_replica.cc:333] T a7aab7fb420049159a4bfcab7b889532 P 5954043bd41748caa5fb81fecb7d6aba: stopping tablet replica
I20260709 13:19:40.231601  1934 raft_consensus.cc:2243] T a7aab7fb420049159a4bfcab7b889532 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.232246  1934 raft_consensus.cc:2272] T a7aab7fb420049159a4bfcab7b889532 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.235814  1934 tablet_replica.cc:333] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba: stopping tablet replica
I20260709 13:19:40.236647  1934 raft_consensus.cc:2243] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.237442  1934 raft_consensus.cc:2272] T ddab0bf0adfd4b5eb476c08171adf368 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.239494 14129 consensus_peers.cc:597] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba -> Peer 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823): Couldn't send request to peer 7ee834a1e7a84598895d25a0d704119d. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:41823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.240813  1934 tablet_replica.cc:333] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba: stopping tablet replica
I20260709 13:19:40.241520  1934 raft_consensus.cc:2243] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:40.242202 14203 consensus_peers.cc:597] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def -> Peer 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823): Couldn't send request to peer 7ee834a1e7a84598895d25a0d704119d. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:41823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.242292  1934 raft_consensus.cc:2272] T 06079b87b1d2466285752dce5a5f3bf4 P 5954043bd41748caa5fb81fecb7d6aba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.245362  1934 tablet_replica.cc:333] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba: stopping tablet replica
I20260709 13:19:40.246351  1934 raft_consensus.cc:2243] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.247149  1934 raft_consensus.cc:2272] T 67a1f91874cd48feb2401b249e367f15 P 5954043bd41748caa5fb81fecb7d6aba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.249862  1934 tablet_replica.cc:333] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba: stopping tablet replica
I20260709 13:19:40.250459  1934 raft_consensus.cc:2243] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.251533  1934 raft_consensus.cc:2272] T 7893d6268fbe402c9976a308df739123 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.254041  1934 tablet_replica.cc:333] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 5954043bd41748caa5fb81fecb7d6aba: stopping tablet replica
I20260709 13:19:40.254544  1934 raft_consensus.cc:2243] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.254943  1934 raft_consensus.cc:2272] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.257084  1934 tablet_replica.cc:333] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba: stopping tablet replica
I20260709 13:19:40.257577  1934 raft_consensus.cc:2243] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.258718  1934 raft_consensus.cc:2272] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.260983  1934 tablet_replica.cc:333] T 4ddbce866d5b465ab05b190081a9516a P 5954043bd41748caa5fb81fecb7d6aba: stopping tablet replica
I20260709 13:19:40.261544  1934 raft_consensus.cc:2243] T 4ddbce866d5b465ab05b190081a9516a P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.262055  1934 raft_consensus.cc:2272] T 4ddbce866d5b465ab05b190081a9516a P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.264183  1934 tablet_replica.cc:333] T b15d17578b03487ba9237d3c1c5c34c3 P 5954043bd41748caa5fb81fecb7d6aba: stopping tablet replica
I20260709 13:19:40.264708  1934 raft_consensus.cc:2243] T b15d17578b03487ba9237d3c1c5c34c3 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.265237  1934 raft_consensus.cc:2272] T b15d17578b03487ba9237d3c1c5c34c3 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.268162  1934 tablet_replica.cc:333] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba: stopping tablet replica
I20260709 13:19:40.268720  1934 raft_consensus.cc:2243] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.269418  1934 raft_consensus.cc:2272] T 964474b1f4294f9aae36715d726b18ac P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.271126 14203 consensus_peers.cc:597] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def -> Peer 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823): Couldn't send request to peer 7ee834a1e7a84598895d25a0d704119d. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:41823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.272156  1934 tablet_replica.cc:333] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba: stopping tablet replica
I20260709 13:19:40.272794  1934 raft_consensus.cc:2243] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.273380  1934 raft_consensus.cc:2272] T a8c53dc94e244a44a022082d00d2bd77 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.275761  1934 tablet_replica.cc:333] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba: stopping tablet replica
I20260709 13:19:40.276348  1934 raft_consensus.cc:2243] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.277208  1934 raft_consensus.cc:2272] T a51739f6e4b8497ebb8907b488a98ace P 5954043bd41748caa5fb81fecb7d6aba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.280030  1934 tablet_replica.cc:333] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba: stopping tablet replica
I20260709 13:19:40.280670  1934 raft_consensus.cc:2243] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.281327  1934 raft_consensus.cc:2272] T 6b5bed5fb52d4094a3f9536ae4a44489 P 5954043bd41748caa5fb81fecb7d6aba [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.283221 14205 consensus_peers.cc:597] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def -> Peer 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935): Couldn't send request to peer 5954043bd41748caa5fb81fecb7d6aba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.284334  1934 tablet_replica.cc:333] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba: stopping tablet replica
I20260709 13:19:40.284943  1934 raft_consensus.cc:2243] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.285986  1934 raft_consensus.cc:2272] T cb054fea3a604e4bb57f269232337582 P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.288554  1934 tablet_replica.cc:333] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba: stopping tablet replica
I20260709 13:19:40.289150  1934 raft_consensus.cc:2243] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.290601  1934 raft_consensus.cc:2272] T 9c271260327e424b981fe0fceeef802e P 5954043bd41748caa5fb81fecb7d6aba [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.291953 14205 consensus_peers.cc:597] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def -> Peer 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935): Couldn't send request to peer 5954043bd41748caa5fb81fecb7d6aba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.295136 14203 consensus_peers.cc:597] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def -> Peer 7ee834a1e7a84598895d25a0d704119d (127.1.227.129:41823): Couldn't send request to peer 7ee834a1e7a84598895d25a0d704119d. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:41823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.336158  1934 tablet_server.cc:196] TabletServer@127.1.227.130:0 shutdown complete.
I20260709 13:19:40.376986  1934 tablet_server.cc:179] TabletServer@127.1.227.131:0 shutting down...
W20260709 13:19:40.378805 14205 consensus_peers.cc:597] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def -> Peer 5954043bd41748caa5fb81fecb7d6aba (127.1.227.130:45935): Couldn't send request to peer 5954043bd41748caa5fb81fecb7d6aba. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:45935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.409621  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:40.410590  1934 tablet_replica.cc:333] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def: stopping tablet replica
I20260709 13:19:40.411506  1934 raft_consensus.cc:2243] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.412442  1934 raft_consensus.cc:2272] T 293bc98621164ca0b8519df20d82d270 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.414770  1934 tablet_replica.cc:333] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def: stopping tablet replica
I20260709 13:19:40.415369  1934 raft_consensus.cc:2243] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.415907  1934 raft_consensus.cc:2272] T dbe684d4341841fabe0c9407024aacb4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.418284  1934 tablet_replica.cc:333] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def: stopping tablet replica
I20260709 13:19:40.418856  1934 raft_consensus.cc:2243] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.419430  1934 raft_consensus.cc:2272] T cf9eb0860bf04bfd98b9d06518d914e0 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.421581  1934 tablet_replica.cc:333] T a7aab7fb420049159a4bfcab7b889532 P 56d11c1d43ec4f85956fcfa2d6b03def: stopping tablet replica
I20260709 13:19:40.422178  1934 raft_consensus.cc:2243] T a7aab7fb420049159a4bfcab7b889532 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.422703  1934 raft_consensus.cc:2272] T a7aab7fb420049159a4bfcab7b889532 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.424784  1934 tablet_replica.cc:333] T ddab0bf0adfd4b5eb476c08171adf368 P 56d11c1d43ec4f85956fcfa2d6b03def: stopping tablet replica
I20260709 13:19:40.425375  1934 raft_consensus.cc:2243] T ddab0bf0adfd4b5eb476c08171adf368 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.426010  1934 raft_consensus.cc:2272] T ddab0bf0adfd4b5eb476c08171adf368 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.428114  1934 tablet_replica.cc:333] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 56d11c1d43ec4f85956fcfa2d6b03def: stopping tablet replica
I20260709 13:19:40.428642  1934 raft_consensus.cc:2243] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.429088  1934 raft_consensus.cc:2272] T 016b3d69ae4b468cbfabb2e8d1b81f16 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.431327  1934 tablet_replica.cc:333] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def: stopping tablet replica
I20260709 13:19:40.431891  1934 raft_consensus.cc:2243] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.432768  1934 raft_consensus.cc:2272] T b15d17578b03487ba9237d3c1c5c34c3 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.435230  1934 tablet_replica.cc:333] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def: stopping tablet replica
I20260709 13:19:40.435794  1934 raft_consensus.cc:2243] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.436661  1934 raft_consensus.cc:2272] T 964474b1f4294f9aae36715d726b18ac P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.438783  1934 tablet_replica.cc:333] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def: stopping tablet replica
I20260709 13:19:40.439433  1934 raft_consensus.cc:2243] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.439946  1934 raft_consensus.cc:2272] T 4ddbce866d5b465ab05b190081a9516a P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.442176  1934 tablet_replica.cc:333] T cb054fea3a604e4bb57f269232337582 P 56d11c1d43ec4f85956fcfa2d6b03def: stopping tablet replica
I20260709 13:19:40.442728  1934 raft_consensus.cc:2243] T cb054fea3a604e4bb57f269232337582 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.443236  1934 raft_consensus.cc:2272] T cb054fea3a604e4bb57f269232337582 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.445290  1934 tablet_replica.cc:333] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def: stopping tablet replica
I20260709 13:19:40.445894  1934 raft_consensus.cc:2243] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.446376  1934 raft_consensus.cc:2272] T 9c271260327e424b981fe0fceeef802e P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.448470  1934 tablet_replica.cc:333] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def: stopping tablet replica
I20260709 13:19:40.448987  1934 raft_consensus.cc:2243] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.449441  1934 raft_consensus.cc:2272] T a8c53dc94e244a44a022082d00d2bd77 P 56d11c1d43ec4f85956fcfa2d6b03def [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.451581  1934 tablet_replica.cc:333] T a51739f6e4b8497ebb8907b488a98ace P 56d11c1d43ec4f85956fcfa2d6b03def: stopping tablet replica
I20260709 13:19:40.452091  1934 raft_consensus.cc:2243] T a51739f6e4b8497ebb8907b488a98ace P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.452554  1934 raft_consensus.cc:2272] T a51739f6e4b8497ebb8907b488a98ace P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.454582  1934 tablet_replica.cc:333] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def: stopping tablet replica
I20260709 13:19:40.455207  1934 raft_consensus.cc:2243] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.456710  1934 raft_consensus.cc:2272] T 6b5bed5fb52d4094a3f9536ae4a44489 P 56d11c1d43ec4f85956fcfa2d6b03def [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.460005  1934 tablet_replica.cc:333] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def: stopping tablet replica
I20260709 13:19:40.460578  1934 raft_consensus.cc:2243] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.461695  1934 raft_consensus.cc:2272] T 06079b87b1d2466285752dce5a5f3bf4 P 56d11c1d43ec4f85956fcfa2d6b03def [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.464097  1934 tablet_replica.cc:333] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def: stopping tablet replica
I20260709 13:19:40.464569  1934 raft_consensus.cc:2243] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.465358  1934 raft_consensus.cc:2272] T 67a1f91874cd48feb2401b249e367f15 P 56d11c1d43ec4f85956fcfa2d6b03def [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.467460  1934 tablet_replica.cc:333] T 7893d6268fbe402c9976a308df739123 P 56d11c1d43ec4f85956fcfa2d6b03def: stopping tablet replica
I20260709 13:19:40.468000  1934 raft_consensus.cc:2243] T 7893d6268fbe402c9976a308df739123 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.468546  1934 raft_consensus.cc:2272] T 7893d6268fbe402c9976a308df739123 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.470675  1934 tablet_replica.cc:333] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def: stopping tablet replica
I20260709 13:19:40.471115  1934 raft_consensus.cc:2243] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.471498  1934 raft_consensus.cc:2272] T 3fbda8f7a8ee472d98be2fe6e62a14c1 P 56d11c1d43ec4f85956fcfa2d6b03def [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.513115  1934 tablet_server.cc:196] TabletServer@127.1.227.131:0 shutdown complete.
I20260709 13:19:40.555377  1934 master.cc:562] Master@127.1.227.190:45179 shutting down...
I20260709 13:19:40.582159  1934 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.582913  1934 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.583299  1934 tablet_replica.cc:333] T 00000000000000000000000000000000 P c26ce202eb194784a281ac2aa8ebdb5f: stopping tablet replica
I20260709 13:19:40.605507  1934 master.cc:584] Master@127.1.227.190:45179 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12801 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:19:40.669454  1934 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.1.227.190:33079
I20260709 13:19:40.670701  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:40.677067 14563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:40.678596 14564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:40.679473 14566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:40.680213  1934 server_base.cc:1061] running on GCE node
I20260709 13:19:40.681098  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:40.681273  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:40.681398  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603180681386 us; error 0 us; skew 500 ppm
I20260709 13:19:40.681917  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:40.684422  1934 webserver.cc:533] Webserver started at http://127.1.227.190:40877/ using document root <none> and password file <none>
I20260709 13:19:40.684850  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:40.685000  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:40.685207  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:40.686372  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602825662285-1934-0/minicluster-data/master-0-root/instance:
uuid: "37f589ca53e941d2a97ee38062ec8bf5"
format_stamp: "Formatted at 2026-07-09 13:19:40 on dist-test-slave-lfdf"
I20260709 13:19:40.690747  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:19:40.694111 14571 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:40.694855  1934 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:19:40.695127  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602825662285-1934-0/minicluster-data/master-0-root
uuid: "37f589ca53e941d2a97ee38062ec8bf5"
format_stamp: "Formatted at 2026-07-09 13:19:40 on dist-test-slave-lfdf"
I20260709 13:19:40.695405  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602825662285-1934-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602825662285-1934-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602825662285-1934-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:40.711143  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:40.712419  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:40.756202  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.190:33079
I20260709 13:19:40.756345 14622 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.190:33079 every 8 connection(s)
I20260709 13:19:40.760531 14623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:40.777395 14623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5: Bootstrap starting.
I20260709 13:19:40.782920 14623 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:40.787690 14623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5: No bootstrap required, opened a new log
I20260709 13:19:40.790297 14623 raft_consensus.cc:359] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37f589ca53e941d2a97ee38062ec8bf5" member_type: VOTER }
I20260709 13:19:40.790777 14623 raft_consensus.cc:385] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:40.791050 14623 raft_consensus.cc:740] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37f589ca53e941d2a97ee38062ec8bf5, State: Initialized, Role: FOLLOWER
I20260709 13:19:40.791755 14623 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37f589ca53e941d2a97ee38062ec8bf5" member_type: VOTER }
I20260709 13:19:40.792272 14623 raft_consensus.cc:399] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:40.792526 14623 raft_consensus.cc:493] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:40.792829 14623 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:40.798542 14623 raft_consensus.cc:515] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37f589ca53e941d2a97ee38062ec8bf5" member_type: VOTER }
I20260709 13:19:40.799157 14623 leader_election.cc:304] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 37f589ca53e941d2a97ee38062ec8bf5; no voters: 
I20260709 13:19:40.800390 14623 leader_election.cc:290] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:40.801003 14626 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:40.802451 14626 raft_consensus.cc:697] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5 [term 1 LEADER]: Becoming Leader. State: Replica: 37f589ca53e941d2a97ee38062ec8bf5, State: Running, Role: LEADER
I20260709 13:19:40.803220 14626 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37f589ca53e941d2a97ee38062ec8bf5" member_type: VOTER }
I20260709 13:19:40.803970 14623 sys_catalog.cc:565] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:40.807962 14627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37f589ca53e941d2a97ee38062ec8bf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37f589ca53e941d2a97ee38062ec8bf5" member_type: VOTER } }
I20260709 13:19:40.808087 14628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37f589ca53e941d2a97ee38062ec8bf5. Latest consensus state: current_term: 1 leader_uuid: "37f589ca53e941d2a97ee38062ec8bf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37f589ca53e941d2a97ee38062ec8bf5" member_type: VOTER } }
I20260709 13:19:40.808794 14627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:40.809301 14628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:40.817371 14632 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:40.822379 14632 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:40.823733  1934 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:40.832268 14632 catalog_manager.cc:1383] Generated new cluster ID: 258064f7a0bd44fc8ca8cb5837755c4d
I20260709 13:19:40.832571 14632 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:40.846067 14632 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:40.847555 14632 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:40.862787 14632 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5: Generated new TSK 0
I20260709 13:19:40.863520 14632 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:40.890551  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:40.897646 14644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:40.898488 14645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:40.901378  1934 server_base.cc:1061] running on GCE node
W20260709 13:19:40.901432 14647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:40.902525  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:40.902745  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:40.902913  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603180902897 us; error 0 us; skew 500 ppm
I20260709 13:19:40.903442  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:40.905797  1934 webserver.cc:533] Webserver started at http://127.1.227.129:39973/ using document root <none> and password file <none>
I20260709 13:19:40.906272  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:40.906461  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:40.906685  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:40.907732  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602825662285-1934-0/minicluster-data/ts-0-root/instance:
uuid: "31f7375d88974b7a9c775ec640ca368e"
format_stamp: "Formatted at 2026-07-09 13:19:40 on dist-test-slave-lfdf"
I20260709 13:19:40.912405  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:19:40.915815 14652 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:40.916679  1934 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:19:40.916997  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602825662285-1934-0/minicluster-data/ts-0-root
uuid: "31f7375d88974b7a9c775ec640ca368e"
format_stamp: "Formatted at 2026-07-09 13:19:40 on dist-test-slave-lfdf"
I20260709 13:19:40.917269  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602825662285-1934-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602825662285-1934-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602825662285-1934-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:40.933063  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:40.934248  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:40.935674  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:40.938117  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:40.938328  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:40.938634  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:40.938805  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:40.983192  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.129:45945
I20260709 13:19:40.983405 14714 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.129:45945 every 8 connection(s)
I20260709 13:19:40.988392  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:40.996927 14719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:40.997907 14720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:41.002027  1934 server_base.cc:1061] running on GCE node
W20260709 13:19:41.002177 14722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:41.003892  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:19:41.004205 14715 heartbeater.cc:344] Connected to a master server at 127.1.227.190:33079
W20260709 13:19:41.004230  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:41.004698  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603181004676 us; error 0 us; skew 500 ppm
I20260709 13:19:41.004877 14715 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:41.005417  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:41.005826 14715 heartbeater.cc:507] Master 127.1.227.190:33079 requested a full tablet report, sending...
I20260709 13:19:41.008538 14588 ts_manager.cc:194] Registered new tserver with Master: 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945)
I20260709 13:19:41.008558  1934 webserver.cc:533] Webserver started at http://127.1.227.130:33459/ using document root <none> and password file <none>
I20260709 13:19:41.009306  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:41.009560  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:41.009907  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:41.010618 14588 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45710
I20260709 13:19:41.011368  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602825662285-1934-0/minicluster-data/ts-1-root/instance:
uuid: "ed4f059a209b4924865bad4ae2d019b3"
format_stamp: "Formatted at 2026-07-09 13:19:41 on dist-test-slave-lfdf"
I20260709 13:19:41.017021  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:19:41.021286 14727 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:41.022235  1934 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:19:41.022567  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602825662285-1934-0/minicluster-data/ts-1-root
uuid: "ed4f059a209b4924865bad4ae2d019b3"
format_stamp: "Formatted at 2026-07-09 13:19:41 on dist-test-slave-lfdf"
I20260709 13:19:41.022861  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602825662285-1934-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602825662285-1934-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602825662285-1934-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:41.041232  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:41.042611  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:41.044216  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:41.046566  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:41.046813  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:41.047060  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:41.047231  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:41.090896  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.130:36115
I20260709 13:19:41.091068 14789 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.130:36115 every 8 connection(s)
I20260709 13:19:41.096262  1934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:41.104681 14793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:41.104940 14794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:41.108909  1934 server_base.cc:1061] running on GCE node
W20260709 13:19:41.108987 14796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:41.110049 14790 heartbeater.cc:344] Connected to a master server at 127.1.227.190:33079
I20260709 13:19:41.110347  1934 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:19:41.110488 14790 heartbeater.cc:461] Registering TS with master...
W20260709 13:19:41.110661  1934 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:41.110930  1934 hybrid_clock.cc:648] HybridClock initialized: now 1783603181110914 us; error 0 us; skew 500 ppm
I20260709 13:19:41.111454 14790 heartbeater.cc:507] Master 127.1.227.190:33079 requested a full tablet report, sending...
I20260709 13:19:41.111510  1934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:41.113878 14588 ts_manager.cc:194] Registered new tserver with Master: ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:41.114511  1934 webserver.cc:533] Webserver started at http://127.1.227.131:40971/ using document root <none> and password file <none>
I20260709 13:19:41.115041  1934 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:41.115243  1934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:41.115520  1934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:41.115460 14588 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45712
I20260709 13:19:41.117126  1934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602825662285-1934-0/minicluster-data/ts-2-root/instance:
uuid: "712448581a8b4362b83305434a66cb99"
format_stamp: "Formatted at 2026-07-09 13:19:41 on dist-test-slave-lfdf"
I20260709 13:19:41.121999  1934 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 13:19:41.125527 14801 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:41.126544  1934 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:19:41.126896  1934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602825662285-1934-0/minicluster-data/ts-2-root
uuid: "712448581a8b4362b83305434a66cb99"
format_stamp: "Formatted at 2026-07-09 13:19:41 on dist-test-slave-lfdf"
I20260709 13:19:41.127218  1934 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602825662285-1934-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602825662285-1934-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkR2sJH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602825662285-1934-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:41.141230  1934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:41.142906  1934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:41.144753  1934 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:41.147325  1934 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:41.147578  1934 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:41.147821  1934 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:41.148002  1934 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:41.190140  1934 rpc_server.cc:307] RPC server started. Bound to: 127.1.227.131:42327
I20260709 13:19:41.190248 14863 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.227.131:42327 every 8 connection(s)
I20260709 13:19:41.204957 14864 heartbeater.cc:344] Connected to a master server at 127.1.227.190:33079
I20260709 13:19:41.205385 14864 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:41.206254 14864 heartbeater.cc:507] Master 127.1.227.190:33079 requested a full tablet report, sending...
I20260709 13:19:41.208456 14588 ts_manager.cc:194] Registered new tserver with Master: 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:41.208591  1934 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015422063s
I20260709 13:19:41.210119 14588 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45720
I20260709 13:19:41.237969 14588 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45722:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:41.240821 14588 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:41.322636 14680 tablet_service.cc:1511] Processing CreateTablet for tablet 0aec1fdac1b04898b1c639e2b1c21c17 (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:41.324223 14680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aec1fdac1b04898b1c639e2b1c21c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.325999 14679 tablet_service.cc:1511] Processing CreateTablet for tablet 918c48b8a8eb447c9d860cf67355b424 (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:41.327667 14679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918c48b8a8eb447c9d860cf67355b424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.335659 14829 tablet_service.cc:1511] Processing CreateTablet for tablet 0aec1fdac1b04898b1c639e2b1c21c17 (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:41.337231 14829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aec1fdac1b04898b1c639e2b1c21c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.338074 14755 tablet_service.cc:1511] Processing CreateTablet for tablet 0aec1fdac1b04898b1c639e2b1c21c17 (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:41.339017 14754 tablet_service.cc:1511] Processing CreateTablet for tablet 918c48b8a8eb447c9d860cf67355b424 (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:41.339570 14755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aec1fdac1b04898b1c639e2b1c21c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.340415 14754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918c48b8a8eb447c9d860cf67355b424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.341723 14828 tablet_service.cc:1511] Processing CreateTablet for tablet 918c48b8a8eb447c9d860cf67355b424 (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:41.343380 14828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918c48b8a8eb447c9d860cf67355b424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.357450 14678 tablet_service.cc:1511] Processing CreateTablet for tablet 9570777dd39b42e5bfbae3c29b91b002 (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:41.359025 14678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9570777dd39b42e5bfbae3c29b91b002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.358803 14753 tablet_service.cc:1511] Processing CreateTablet for tablet 9570777dd39b42e5bfbae3c29b91b002 (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:41.360234 14753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9570777dd39b42e5bfbae3c29b91b002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.364459 14827 tablet_service.cc:1511] Processing CreateTablet for tablet 9570777dd39b42e5bfbae3c29b91b002 (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:41.366079 14827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9570777dd39b42e5bfbae3c29b91b002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.371181 14752 tablet_service.cc:1511] Processing CreateTablet for tablet f538e262460d404a82ac501bf33a5078 (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:41.372656 14752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f538e262460d404a82ac501bf33a5078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.371433 14679 tablet_service.cc:1511] Processing CreateTablet for tablet f538e262460d404a82ac501bf33a5078 (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:41.378968 14826 tablet_service.cc:1511] Processing CreateTablet for tablet f538e262460d404a82ac501bf33a5078 (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:41.380446 14826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f538e262460d404a82ac501bf33a5078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.380811 14679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f538e262460d404a82ac501bf33a5078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.390836 14680 tablet_service.cc:1511] Processing CreateTablet for tablet 33e22b8497214cde9d1b23a71ef8101a (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:41.392004 14879 tablet_bootstrap.cc:492] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e: Bootstrap starting.
I20260709 13:19:41.393587 14825 tablet_service.cc:1511] Processing CreateTablet for tablet 33e22b8497214cde9d1b23a71ef8101a (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:41.391928 14753 tablet_service.cc:1511] Processing CreateTablet for tablet 33e22b8497214cde9d1b23a71ef8101a (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:41.398831 14677 tablet_service.cc:1511] Processing CreateTablet for tablet 728b17d23bff40d99b022d71c68dc2b0 (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:41.398873 14680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33e22b8497214cde9d1b23a71ef8101a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.399166 14825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33e22b8497214cde9d1b23a71ef8101a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.410563 14677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 728b17d23bff40d99b022d71c68dc2b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.412635 14753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33e22b8497214cde9d1b23a71ef8101a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.418610 14880 tablet_bootstrap.cc:492] T 0aec1fdac1b04898b1c639e2b1c21c17 P ed4f059a209b4924865bad4ae2d019b3: Bootstrap starting.
I20260709 13:19:41.428910 14755 tablet_service.cc:1511] Processing CreateTablet for tablet 728b17d23bff40d99b022d71c68dc2b0 (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:41.430392 14755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 728b17d23bff40d99b022d71c68dc2b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.443902 14879 tablet_bootstrap.cc:654] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.446082 14826 tablet_service.cc:1511] Processing CreateTablet for tablet 728b17d23bff40d99b022d71c68dc2b0 (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:41.446789 14678 tablet_service.cc:1511] Processing CreateTablet for tablet cba0f563382046f7a0f5abc6d64d060c (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:41.447678 14826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 728b17d23bff40d99b022d71c68dc2b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.448369 14678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba0f563382046f7a0f5abc6d64d060c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.449536 14880 tablet_bootstrap.cc:654] T 0aec1fdac1b04898b1c639e2b1c21c17 P ed4f059a209b4924865bad4ae2d019b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.457010 14824 tablet_service.cc:1511] Processing CreateTablet for tablet cba0f563382046f7a0f5abc6d64d060c (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:41.458555 14824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba0f563382046f7a0f5abc6d64d060c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.458714 14753 tablet_service.cc:1511] Processing CreateTablet for tablet cba0f563382046f7a0f5abc6d64d060c (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:41.460170 14753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba0f563382046f7a0f5abc6d64d060c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.460278 14676 tablet_service.cc:1511] Processing CreateTablet for tablet 5235e6ffdc5245a59381b4d7078959b0 (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:41.461848 14676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5235e6ffdc5245a59381b4d7078959b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.463553 14754 tablet_service.cc:1511] Processing CreateTablet for tablet 5235e6ffdc5245a59381b4d7078959b0 (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:41.465031 14754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5235e6ffdc5245a59381b4d7078959b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.484721 14879 tablet_bootstrap.cc:492] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e: No bootstrap required, opened a new log
I20260709 13:19:41.485492 14879 ts_tablet_manager.cc:1403] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e: Time spent bootstrapping tablet: real 0.132s	user 0.020s	sys 0.005s
I20260709 13:19:41.488512 14879 raft_consensus.cc:359] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.489342 14879 raft_consensus.cc:385] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.489704 14879 raft_consensus.cc:740] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.490723 14879 consensus_queue.cc:260] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.493142 14828 tablet_service.cc:1511] Processing CreateTablet for tablet 5235e6ffdc5245a59381b4d7078959b0 (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:41.494588 14828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5235e6ffdc5245a59381b4d7078959b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.496167 14752 tablet_service.cc:1511] Processing CreateTablet for tablet b3e28b5bed5a4cb184329986f01360ad (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:41.497124 14881 tablet_bootstrap.cc:492] T 0aec1fdac1b04898b1c639e2b1c21c17 P 712448581a8b4362b83305434a66cb99: Bootstrap starting.
I20260709 13:19:41.497704 14752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e28b5bed5a4cb184329986f01360ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.514719 14880 tablet_bootstrap.cc:492] T 0aec1fdac1b04898b1c639e2b1c21c17 P ed4f059a209b4924865bad4ae2d019b3: No bootstrap required, opened a new log
I20260709 13:19:41.515336 14880 ts_tablet_manager.cc:1403] T 0aec1fdac1b04898b1c639e2b1c21c17 P ed4f059a209b4924865bad4ae2d019b3: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.011s
I20260709 13:19:41.532879 14881 tablet_bootstrap.cc:654] T 0aec1fdac1b04898b1c639e2b1c21c17 P 712448581a8b4362b83305434a66cb99: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.535370 14715 heartbeater.cc:499] Master 127.1.227.190:33079 was elected leader, sending a full tablet report...
I20260709 13:19:41.537066 14879 ts_tablet_manager.cc:1434] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.020s
I20260709 13:19:41.535337 14884 raft_consensus.cc:493] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.539144 14879 tablet_bootstrap.cc:492] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e: Bootstrap starting.
I20260709 13:19:41.539486 14884 raft_consensus.cc:515] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.546459 14884 leader_election.cc:290] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:41.547688 14879 tablet_bootstrap.cc:654] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.547545 14880 raft_consensus.cc:359] T 0aec1fdac1b04898b1c639e2b1c21c17 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.548815 14880 raft_consensus.cc:385] T 0aec1fdac1b04898b1c639e2b1c21c17 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.549275 14880 raft_consensus.cc:740] T 0aec1fdac1b04898b1c639e2b1c21c17 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.550271 14880 consensus_queue.cc:260] T 0aec1fdac1b04898b1c639e2b1c21c17 P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.534560 14826 tablet_service.cc:1511] Processing CreateTablet for tablet b3e28b5bed5a4cb184329986f01360ad (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:41.559214 14826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e28b5bed5a4cb184329986f01360ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.552248 14679 tablet_service.cc:1511] Processing CreateTablet for tablet b3e28b5bed5a4cb184329986f01360ad (DEFAULT_TABLE table=test-workload [id=72a53f6844834b1b9112d1344b73aa74]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:41.567834 14790 heartbeater.cc:499] Master 127.1.227.190:33079 was elected leader, sending a full tablet report...
I20260709 13:19:41.579749 14880 ts_tablet_manager.cc:1434] T 0aec1fdac1b04898b1c639e2b1c21c17 P ed4f059a209b4924865bad4ae2d019b3: Time spent starting tablet: real 0.064s	user 0.009s	sys 0.000s
I20260709 13:19:41.581465 14880 tablet_bootstrap.cc:492] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3: Bootstrap starting.
I20260709 13:19:41.621944 14679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e28b5bed5a4cb184329986f01360ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.624847 14879 tablet_bootstrap.cc:492] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e: No bootstrap required, opened a new log
I20260709 13:19:41.632822 14879 ts_tablet_manager.cc:1403] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e: Time spent bootstrapping tablet: real 0.094s	user 0.023s	sys 0.031s
I20260709 13:19:41.635426 14880 tablet_bootstrap.cc:654] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.635869 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918c48b8a8eb447c9d860cf67355b424" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99" is_pre_election: true
I20260709 13:19:41.637131 14879 raft_consensus.cc:359] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
W20260709 13:19:41.637888 14654 leader_election.cc:343] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:41.638144 14879 raft_consensus.cc:385] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.638612 14879 raft_consensus.cc:740] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.639915 14879 consensus_queue.cc:260] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.649863 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918c48b8a8eb447c9d860cf67355b424" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3" is_pre_election: true
I20260709 13:19:41.650179 14879 ts_tablet_manager.cc:1434] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 13:19:41.651669 14881 tablet_bootstrap.cc:492] T 0aec1fdac1b04898b1c639e2b1c21c17 P 712448581a8b4362b83305434a66cb99: No bootstrap required, opened a new log
W20260709 13:19:41.652141 14655 leader_election.cc:343] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:41.652752 14655 leader_election.cc:304] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e; no voters: 712448581a8b4362b83305434a66cb99, ed4f059a209b4924865bad4ae2d019b3
I20260709 13:19:41.653920 14884 raft_consensus.cc:2749] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:41.654253 14880 tablet_bootstrap.cc:492] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3: No bootstrap required, opened a new log
I20260709 13:19:41.652280 14881 ts_tablet_manager.cc:1403] T 0aec1fdac1b04898b1c639e2b1c21c17 P 712448581a8b4362b83305434a66cb99: Time spent bootstrapping tablet: real 0.156s	user 0.007s	sys 0.012s
I20260709 13:19:41.654809 14880 ts_tablet_manager.cc:1403] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.003s
I20260709 13:19:41.657830 14881 raft_consensus.cc:359] T 0aec1fdac1b04898b1c639e2b1c21c17 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.658056 14880 raft_consensus.cc:359] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.658540 14879 tablet_bootstrap.cc:492] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e: Bootstrap starting.
I20260709 13:19:41.658620 14881 raft_consensus.cc:385] T 0aec1fdac1b04898b1c639e2b1c21c17 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.658799 14880 raft_consensus.cc:385] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.659410 14881 raft_consensus.cc:740] T 0aec1fdac1b04898b1c639e2b1c21c17 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.659476 14880 raft_consensus.cc:740] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.660308 14881 consensus_queue.cc:260] T 0aec1fdac1b04898b1c639e2b1c21c17 P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.660308 14880 consensus_queue.cc:260] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.665031 14879 tablet_bootstrap.cc:654] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.666853 14880 ts_tablet_manager.cc:1434] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 13:19:41.668285 14880 tablet_bootstrap.cc:492] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3: Bootstrap starting.
I20260709 13:19:41.676614 14880 tablet_bootstrap.cc:654] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.678012 14879 tablet_bootstrap.cc:492] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e: No bootstrap required, opened a new log
I20260709 13:19:41.678627 14879 ts_tablet_manager.cc:1403] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 13:19:41.678785 14864 heartbeater.cc:499] Master 127.1.227.190:33079 was elected leader, sending a full tablet report...
I20260709 13:19:41.679561 14881 ts_tablet_manager.cc:1434] T 0aec1fdac1b04898b1c639e2b1c21c17 P 712448581a8b4362b83305434a66cb99: Time spent starting tablet: real 0.025s	user 0.011s	sys 0.011s
I20260709 13:19:41.680632 14881 tablet_bootstrap.cc:492] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99: Bootstrap starting.
I20260709 13:19:41.681771 14879 raft_consensus.cc:359] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.682586 14879 raft_consensus.cc:385] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.682883 14879 raft_consensus.cc:740] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.683681 14879 consensus_queue.cc:260] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.686034 14879 ts_tablet_manager.cc:1434] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:19:41.687076 14879 tablet_bootstrap.cc:492] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e: Bootstrap starting.
I20260709 13:19:41.688237 14881 tablet_bootstrap.cc:654] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.694497 14879 tablet_bootstrap.cc:654] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.700757 14881 tablet_bootstrap.cc:492] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99: No bootstrap required, opened a new log
I20260709 13:19:41.701517 14881 ts_tablet_manager.cc:1403] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.001s
I20260709 13:19:41.706079 14881 raft_consensus.cc:359] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.707090 14881 raft_consensus.cc:385] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.707456 14881 raft_consensus.cc:740] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.708638 14881 consensus_queue.cc:260] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.711635 14881 ts_tablet_manager.cc:1434] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:19:41.712989 14881 tablet_bootstrap.cc:492] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99: Bootstrap starting.
I20260709 13:19:41.718905 14879 tablet_bootstrap.cc:492] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e: No bootstrap required, opened a new log
I20260709 13:19:41.719641 14879 ts_tablet_manager.cc:1403] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.013s
I20260709 13:19:41.719990 14880 tablet_bootstrap.cc:492] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3: No bootstrap required, opened a new log
I20260709 13:19:41.720564 14880 ts_tablet_manager.cc:1403] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3: Time spent bootstrapping tablet: real 0.053s	user 0.021s	sys 0.012s
I20260709 13:19:41.722668 14881 tablet_bootstrap.cc:654] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.722862 14879 raft_consensus.cc:359] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.723634 14879 raft_consensus.cc:385] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.723598 14880 raft_consensus.cc:359] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.724181 14879 raft_consensus.cc:740] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.724618 14880 raft_consensus.cc:385] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.724967 14880 raft_consensus.cc:740] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.725117 14879 consensus_queue.cc:260] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.725716 14880 consensus_queue.cc:260] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.728333 14880 ts_tablet_manager.cc:1434] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.008s
I20260709 13:19:41.728327 14879 ts_tablet_manager.cc:1434] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:41.729455 14880 tablet_bootstrap.cc:492] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3: Bootstrap starting.
I20260709 13:19:41.730386 14879 tablet_bootstrap.cc:492] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e: Bootstrap starting.
I20260709 13:19:41.734403 14881 tablet_bootstrap.cc:492] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99: No bootstrap required, opened a new log
I20260709 13:19:41.735050 14881 ts_tablet_manager.cc:1403] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 13:19:41.736681 14880 tablet_bootstrap.cc:654] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.737385 14879 tablet_bootstrap.cc:654] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.738194 14881 raft_consensus.cc:359] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.741308 14881 raft_consensus.cc:385] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.741602 14881 raft_consensus.cc:740] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.742595 14881 consensus_queue.cc:260] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.745797 14881 ts_tablet_manager.cc:1434] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:19:41.747267 14881 tablet_bootstrap.cc:492] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99: Bootstrap starting.
I20260709 13:19:41.756733 14881 tablet_bootstrap.cc:654] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.788671 14884 raft_consensus.cc:493] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.789567 14884 raft_consensus.cc:515] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.792371 14881 tablet_bootstrap.cc:492] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99: No bootstrap required, opened a new log
I20260709 13:19:41.792407 14880 tablet_bootstrap.cc:492] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3: No bootstrap required, opened a new log
I20260709 13:19:41.792807 14879 tablet_bootstrap.cc:492] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e: No bootstrap required, opened a new log
I20260709 13:19:41.793021 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aec1fdac1b04898b1c639e2b1c21c17" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3" is_pre_election: true
I20260709 13:19:41.793211 14881 ts_tablet_manager.cc:1403] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.023s
I20260709 13:19:41.793412 14879 ts_tablet_manager.cc:1403] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e: Time spent bootstrapping tablet: real 0.063s	user 0.039s	sys 0.018s
I20260709 13:19:41.793306 14880 ts_tablet_manager.cc:1403] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3: Time spent bootstrapping tablet: real 0.064s	user 0.038s	sys 0.025s
I20260709 13:19:41.795275 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aec1fdac1b04898b1c639e2b1c21c17" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99" is_pre_election: true
I20260709 13:19:41.795965 14839 raft_consensus.cc:2468] T 0aec1fdac1b04898b1c639e2b1c21c17 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 0.
I20260709 13:19:41.796743 14881 raft_consensus.cc:359] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.797328 14654 leader_election.cc:304] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, 712448581a8b4362b83305434a66cb99; no voters: 
I20260709 13:19:41.797698 14884 leader_election.cc:290] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:41.797713 14881 raft_consensus.cc:385] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.797232 14880 raft_consensus.cc:359] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.798363 14881 raft_consensus.cc:740] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.798475 14880 raft_consensus.cc:385] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.798776 14765 raft_consensus.cc:2468] T 0aec1fdac1b04898b1c639e2b1c21c17 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 0.
I20260709 13:19:41.798985 14880 raft_consensus.cc:740] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.798399 14884 raft_consensus.cc:2804] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:41.799399 14881 consensus_queue.cc:260] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.799949 14884 raft_consensus.cc:493] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.800401 14884 raft_consensus.cc:3060] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:41.799995 14880 consensus_queue.cc:260] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.802661 14880 ts_tablet_manager.cc:1434] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:41.803714 14880 tablet_bootstrap.cc:492] T f538e262460d404a82ac501bf33a5078 P ed4f059a209b4924865bad4ae2d019b3: Bootstrap starting.
I20260709 13:19:41.796888 14879 raft_consensus.cc:359] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.805753 14879 raft_consensus.cc:385] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.806102 14879 raft_consensus.cc:740] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.806993 14879 consensus_queue.cc:260] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.809810 14879 ts_tablet_manager.cc:1434] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:19:41.810734 14880 tablet_bootstrap.cc:654] T f538e262460d404a82ac501bf33a5078 P ed4f059a209b4924865bad4ae2d019b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.810977 14879 tablet_bootstrap.cc:492] T cba0f563382046f7a0f5abc6d64d060c P 31f7375d88974b7a9c775ec640ca368e: Bootstrap starting.
I20260709 13:19:41.813828 14881 ts_tablet_manager.cc:1434] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
W20260709 13:19:41.818301 14636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:41.821386 14884 raft_consensus.cc:515] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.825800 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aec1fdac1b04898b1c639e2b1c21c17" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:41.826423 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aec1fdac1b04898b1c639e2b1c21c17" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:41.826637 14884 leader_election.cc:290] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 election: Requested vote from peers ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:41.827195 14765 raft_consensus.cc:3060] T 0aec1fdac1b04898b1c639e2b1c21c17 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:41.827586 14881 tablet_bootstrap.cc:492] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99: Bootstrap starting.
I20260709 13:19:41.828356 14879 tablet_bootstrap.cc:654] T cba0f563382046f7a0f5abc6d64d060c P 31f7375d88974b7a9c775ec640ca368e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.826547 14839 raft_consensus.cc:3060] T 0aec1fdac1b04898b1c639e2b1c21c17 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:41.837831 14881 tablet_bootstrap.cc:654] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.841533 14879 tablet_bootstrap.cc:492] T cba0f563382046f7a0f5abc6d64d060c P 31f7375d88974b7a9c775ec640ca368e: No bootstrap required, opened a new log
I20260709 13:19:41.842183 14879 ts_tablet_manager.cc:1403] T cba0f563382046f7a0f5abc6d64d060c P 31f7375d88974b7a9c775ec640ca368e: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.006s
I20260709 13:19:41.845120 14765 raft_consensus.cc:2468] T 0aec1fdac1b04898b1c639e2b1c21c17 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 1.
I20260709 13:19:41.845896 14839 raft_consensus.cc:2468] T 0aec1fdac1b04898b1c639e2b1c21c17 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 1.
I20260709 13:19:41.845758 14879 raft_consensus.cc:359] T cba0f563382046f7a0f5abc6d64d060c P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.846870 14879 raft_consensus.cc:385] T cba0f563382046f7a0f5abc6d64d060c P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.847457 14879 raft_consensus.cc:740] T cba0f563382046f7a0f5abc6d64d060c P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.847802 14654 leader_election.cc:304] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, 712448581a8b4362b83305434a66cb99; no voters: 
I20260709 13:19:41.848697 14892 raft_consensus.cc:493] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.848286 14879 consensus_queue.cc:260] T cba0f563382046f7a0f5abc6d64d060c P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.848832 14884 raft_consensus.cc:2804] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:41.849187 14892 raft_consensus.cc:515] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.850972 14879 ts_tablet_manager.cc:1434] T cba0f563382046f7a0f5abc6d64d060c P 31f7375d88974b7a9c775ec640ca368e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:19:41.852227 14879 tablet_bootstrap.cc:492] T 33e22b8497214cde9d1b23a71ef8101a P 31f7375d88974b7a9c775ec640ca368e: Bootstrap starting.
I20260709 13:19:41.852313 14885 raft_consensus.cc:493] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.852716 14880 tablet_bootstrap.cc:492] T f538e262460d404a82ac501bf33a5078 P ed4f059a209b4924865bad4ae2d019b3: No bootstrap required, opened a new log
I20260709 13:19:41.852962 14885 raft_consensus.cc:515] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.855860 14885 leader_election.cc:290] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:41.853394 14880 ts_tablet_manager.cc:1403] T f538e262460d404a82ac501bf33a5078 P ed4f059a209b4924865bad4ae2d019b3: Time spent bootstrapping tablet: real 0.050s	user 0.029s	sys 0.008s
I20260709 13:19:41.857904 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235e6ffdc5245a59381b4d7078959b0" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99" is_pre_election: true
W20260709 13:19:41.859601 14654 leader_election.cc:343] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:41.860704 14879 tablet_bootstrap.cc:654] T 33e22b8497214cde9d1b23a71ef8101a P 31f7375d88974b7a9c775ec640ca368e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.862382 14892 leader_election.cc:290] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:41.862963 14880 raft_consensus.cc:359] T f538e262460d404a82ac501bf33a5078 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.864290 14880 raft_consensus.cc:385] T f538e262460d404a82ac501bf33a5078 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.864684 14880 raft_consensus.cc:740] T f538e262460d404a82ac501bf33a5078 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.865731 14880 consensus_queue.cc:260] T f538e262460d404a82ac501bf33a5078 P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.868391 14880 ts_tablet_manager.cc:1434] T f538e262460d404a82ac501bf33a5078 P ed4f059a209b4924865bad4ae2d019b3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:19:41.869542 14880 tablet_bootstrap.cc:492] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3: Bootstrap starting.
I20260709 13:19:41.878373 14880 tablet_bootstrap.cc:654] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.896564 14881 tablet_bootstrap.cc:492] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99: No bootstrap required, opened a new log
I20260709 13:19:41.897594 14881 ts_tablet_manager.cc:1403] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.000s
I20260709 13:19:41.900180 14880 tablet_bootstrap.cc:492] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3: No bootstrap required, opened a new log
I20260709 13:19:41.901423 14880 ts_tablet_manager.cc:1403] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3: Time spent bootstrapping tablet: real 0.032s	user 0.023s	sys 0.005s
I20260709 13:19:41.901973 14881 raft_consensus.cc:359] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.903147 14881 raft_consensus.cc:385] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.903551 14881 raft_consensus.cc:740] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.904727 14881 consensus_queue.cc:260] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.908422 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235e6ffdc5245a59381b4d7078959b0" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3" is_pre_election: true
I20260709 13:19:41.912982 14885 raft_consensus.cc:493] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:41.917726 14655 leader_election.cc:343] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:41.921154 14655 leader_election.cc:304] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e; no voters: 712448581a8b4362b83305434a66cb99, ed4f059a209b4924865bad4ae2d019b3
I20260709 13:19:41.922573 14904 raft_consensus.cc:2749] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:41.920115 14881 ts_tablet_manager.cc:1434] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.001s
I20260709 13:19:41.916764 14885 raft_consensus.cc:515] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.917004 14884 raft_consensus.cc:697] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [term 1 LEADER]: Becoming Leader. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Running, Role: LEADER
I20260709 13:19:41.925056 14880 raft_consensus.cc:359] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.929543 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f538e262460d404a82ac501bf33a5078" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3" is_pre_election: true
I20260709 13:19:41.929347 14884 consensus_queue.cc:237] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.933645 14765 raft_consensus.cc:2468] T f538e262460d404a82ac501bf33a5078 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 0.
I20260709 13:19:41.926793 14885 leader_election.cc:290] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:41.927678 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f538e262460d404a82ac501bf33a5078" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99" is_pre_election: true
I20260709 13:19:41.935158 14880 raft_consensus.cc:385] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.935289 14839 raft_consensus.cc:2468] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 0.
I20260709 13:19:41.935577 14880 raft_consensus.cc:740] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.935636 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f538e262460d404a82ac501bf33a5078" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3" is_pre_election: true
I20260709 13:19:41.936419 14765 raft_consensus.cc:2468] T f538e262460d404a82ac501bf33a5078 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 0.
I20260709 13:19:41.926024 14881 tablet_bootstrap.cc:492] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99: Bootstrap starting.
I20260709 13:19:41.936759 14654 leader_election.cc:304] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, 712448581a8b4362b83305434a66cb99; no voters: 
I20260709 13:19:41.937461 14804 leader_election.cc:304] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 712448581a8b4362b83305434a66cb99, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:41.937821 14885 raft_consensus.cc:2804] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:41.938318 14885 raft_consensus.cc:493] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.938462 14892 raft_consensus.cc:2804] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:41.938058 14880 consensus_queue.cc:260] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.938717 14885 raft_consensus.cc:3060] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:41.938951 14892 raft_consensus.cc:493] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.939420 14892 raft_consensus.cc:3060] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:41.928542 14879 tablet_bootstrap.cc:492] T 33e22b8497214cde9d1b23a71ef8101a P 31f7375d88974b7a9c775ec640ca368e: No bootstrap required, opened a new log
I20260709 13:19:41.940831 14879 ts_tablet_manager.cc:1403] T 33e22b8497214cde9d1b23a71ef8101a P 31f7375d88974b7a9c775ec640ca368e: Time spent bootstrapping tablet: real 0.089s	user 0.046s	sys 0.024s
I20260709 13:19:41.943136 14880 ts_tablet_manager.cc:1434] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:19:41.944336 14880 tablet_bootstrap.cc:492] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3: Bootstrap starting.
I20260709 13:19:41.947746 14892 raft_consensus.cc:515] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.948125 14885 raft_consensus.cc:515] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.951112 14880 tablet_bootstrap.cc:654] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.951484 14881 tablet_bootstrap.cc:654] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.952514 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f538e262460d404a82ac501bf33a5078" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:41.953274 14765 raft_consensus.cc:3060] T f538e262460d404a82ac501bf33a5078 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:41.950596 14879 raft_consensus.cc:359] T 33e22b8497214cde9d1b23a71ef8101a P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.953922 14879 raft_consensus.cc:385] T 33e22b8497214cde9d1b23a71ef8101a P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.954284 14879 raft_consensus.cc:740] T 33e22b8497214cde9d1b23a71ef8101a P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.955107 14879 consensus_queue.cc:260] T 33e22b8497214cde9d1b23a71ef8101a P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.957705 14879 ts_tablet_manager.cc:1434] T 33e22b8497214cde9d1b23a71ef8101a P 31f7375d88974b7a9c775ec640ca368e: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:19:41.958839 14879 tablet_bootstrap.cc:492] T 728b17d23bff40d99b022d71c68dc2b0 P 31f7375d88974b7a9c775ec640ca368e: Bootstrap starting.
I20260709 13:19:41.961887 14765 raft_consensus.cc:2468] T f538e262460d404a82ac501bf33a5078 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 1.
I20260709 13:19:41.963575 14804 leader_election.cc:304] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 712448581a8b4362b83305434a66cb99, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:41.964385 14880 tablet_bootstrap.cc:492] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3: No bootstrap required, opened a new log
I20260709 13:19:41.965225 14880 ts_tablet_manager.cc:1403] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 13:19:41.967386 14690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f538e262460d404a82ac501bf33a5078" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e" is_pre_election: true
I20260709 13:19:41.968291 14690 raft_consensus.cc:2393] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 712448581a8b4362b83305434a66cb99 in current term 1: Already voted for candidate 31f7375d88974b7a9c775ec640ca368e in this term.
I20260709 13:19:41.968809 14879 tablet_bootstrap.cc:654] T 728b17d23bff40d99b022d71c68dc2b0 P 31f7375d88974b7a9c775ec640ca368e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.969395 14689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f538e262460d404a82ac501bf33a5078" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:41.970299 14689 raft_consensus.cc:2393] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 712448581a8b4362b83305434a66cb99 in current term 1: Already voted for candidate 31f7375d88974b7a9c775ec640ca368e in this term.
I20260709 13:19:41.970100 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f538e262460d404a82ac501bf33a5078" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:41.971433 14839 raft_consensus.cc:2393] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 31f7375d88974b7a9c775ec640ca368e in current term 1: Already voted for candidate 712448581a8b4362b83305434a66cb99 in this term.
I20260709 13:19:41.972142 14885 leader_election.cc:290] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 election: Requested vote from peers ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:41.973165 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f538e262460d404a82ac501bf33a5078" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:41.974035 14765 raft_consensus.cc:2393] T f538e262460d404a82ac501bf33a5078 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 31f7375d88974b7a9c775ec640ca368e in current term 1: Already voted for candidate 712448581a8b4362b83305434a66cb99 in this term.
I20260709 13:19:41.975140 14655 leader_election.cc:304] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e; no voters: 712448581a8b4362b83305434a66cb99, ed4f059a209b4924865bad4ae2d019b3
I20260709 13:19:41.975692 14881 tablet_bootstrap.cc:492] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99: No bootstrap required, opened a new log
I20260709 13:19:41.975891 14885 raft_consensus.cc:2749] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:41.976344 14881 ts_tablet_manager.cc:1403] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.000s
I20260709 13:19:41.975139 14880 raft_consensus.cc:359] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.977373 14880 raft_consensus.cc:385] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.977701 14880 raft_consensus.cc:740] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.978608 14880 consensus_queue.cc:260] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.979996 14881 raft_consensus.cc:359] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.980786 14881 raft_consensus.cc:385] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.981088 14881 raft_consensus.cc:740] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.981812 14880 ts_tablet_manager.cc:1434] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.004s
I20260709 13:19:41.982069 14881 consensus_queue.cc:260] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.983620 14880 tablet_bootstrap.cc:492] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3: Bootstrap starting.
I20260709 13:19:41.986084 14892 leader_election.cc:290] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:41.986380 14887 raft_consensus.cc:493] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.986752 14892 raft_consensus.cc:493] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.986797 14913 raft_consensus.cc:2804] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:41.987048 14887 raft_consensus.cc:515] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.987365 14892 raft_consensus.cc:515] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:41.990077 14892 leader_election.cc:290] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:41.991024 14689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9570777dd39b42e5bfbae3c29b91b002" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e" is_pre_election: true
I20260709 13:19:41.993080 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9570777dd39b42e5bfbae3c29b91b002" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3" is_pre_election: true
I20260709 13:19:41.994025 14765 raft_consensus.cc:2468] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 0.
I20260709 13:19:41.997076 14804 leader_election.cc:304] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 712448581a8b4362b83305434a66cb99, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:41.999361 14892 raft_consensus.cc:2804] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:42.000000 14892 raft_consensus.cc:493] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.000471 14892 raft_consensus.cc:3060] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.007463 14915 raft_consensus.cc:493] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.008107 14915 raft_consensus.cc:515] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.008630 14881 ts_tablet_manager.cc:1434] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99: Time spent starting tablet: real 0.032s	user 0.015s	sys 0.011s
I20260709 13:19:42.009975 14881 tablet_bootstrap.cc:492] T cba0f563382046f7a0f5abc6d64d060c P 712448581a8b4362b83305434a66cb99: Bootstrap starting.
I20260709 13:19:41.999470 14887 leader_election.cc:290] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:41.987439 14913 raft_consensus.cc:697] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Becoming Leader. State: Replica: 712448581a8b4362b83305434a66cb99, State: Running, Role: LEADER
I20260709 13:19:42.016203 14689 raft_consensus.cc:2468] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 0.
I20260709 13:19:42.016719 14880 tablet_bootstrap.cc:654] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.017877 14887 raft_consensus.cc:493] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.018342 14879 tablet_bootstrap.cc:492] T 728b17d23bff40d99b022d71c68dc2b0 P 31f7375d88974b7a9c775ec640ca368e: No bootstrap required, opened a new log
I20260709 13:19:42.019052 14879 ts_tablet_manager.cc:1403] T 728b17d23bff40d99b022d71c68dc2b0 P 31f7375d88974b7a9c775ec640ca368e: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.003s
I20260709 13:19:42.018414 14887 raft_consensus.cc:515] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.027359 14887 leader_election.cc:290] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:42.027957 14879 raft_consensus.cc:359] T 728b17d23bff40d99b022d71c68dc2b0 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.028738 14879 raft_consensus.cc:385] T 728b17d23bff40d99b022d71c68dc2b0 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.029016 14879 raft_consensus.cc:740] T 728b17d23bff40d99b022d71c68dc2b0 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.027413 14913 consensus_queue.cc:237] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.029690 14879 consensus_queue.cc:260] T 728b17d23bff40d99b022d71c68dc2b0 P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.034673 14881 tablet_bootstrap.cc:654] T cba0f563382046f7a0f5abc6d64d060c P 712448581a8b4362b83305434a66cb99: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.041577 14879 ts_tablet_manager.cc:1434] T 728b17d23bff40d99b022d71c68dc2b0 P 31f7375d88974b7a9c775ec640ca368e: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:19:42.044930 14689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e22b8497214cde9d1b23a71ef8101a" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e" is_pre_election: true
I20260709 13:19:42.045691 14689 raft_consensus.cc:2468] T 33e22b8497214cde9d1b23a71ef8101a P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 0.
I20260709 13:19:42.047062 14880 tablet_bootstrap.cc:492] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3: No bootstrap required, opened a new log
I20260709 13:19:42.047676 14880 ts_tablet_manager.cc:1403] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.006s
I20260709 13:19:42.048923 14803 leader_election.cc:304] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, 712448581a8b4362b83305434a66cb99; no voters: 
I20260709 13:19:42.050536 14880 raft_consensus.cc:359] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.051275 14880 raft_consensus.cc:385] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.051543 14880 raft_consensus.cc:740] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.052110 14892 raft_consensus.cc:515] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.052407 14880 consensus_queue.cc:260] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.052436 14914 raft_consensus.cc:2804] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:42.053395 14879 tablet_bootstrap.cc:492] T b3e28b5bed5a4cb184329986f01360ad P 31f7375d88974b7a9c775ec640ca368e: Bootstrap starting.
I20260709 13:19:42.053766 14914 raft_consensus.cc:493] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.054065 14915 leader_election.cc:290] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:42.054183 14914 raft_consensus.cc:3060] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.055167 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e22b8497214cde9d1b23a71ef8101a" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3" is_pre_election: true
I20260709 13:19:42.055888 14765 raft_consensus.cc:2468] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 0.
I20260709 13:19:42.056169 14881 tablet_bootstrap.cc:492] T cba0f563382046f7a0f5abc6d64d060c P 712448581a8b4362b83305434a66cb99: No bootstrap required, opened a new log
I20260709 13:19:42.056859 14881 ts_tablet_manager.cc:1403] T cba0f563382046f7a0f5abc6d64d060c P 712448581a8b4362b83305434a66cb99: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.004s
I20260709 13:19:42.060017 14892 leader_election.cc:290] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:42.060814 14689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9570777dd39b42e5bfbae3c29b91b002" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:42.061677 14689 raft_consensus.cc:3060] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.070122 14887 raft_consensus.cc:493] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.071161 14887 raft_consensus.cc:515] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.100270 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9570777dd39b42e5bfbae3c29b91b002" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:42.100998 14765 raft_consensus.cc:3060] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.102417 14881 raft_consensus.cc:359] T cba0f563382046f7a0f5abc6d64d060c P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.103380 14881 raft_consensus.cc:385] T cba0f563382046f7a0f5abc6d64d060c P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.103751 14881 raft_consensus.cc:740] T cba0f563382046f7a0f5abc6d64d060c P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.104571 14881 consensus_queue.cc:260] T cba0f563382046f7a0f5abc6d64d060c P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.107138 14881 ts_tablet_manager.cc:1434] T cba0f563382046f7a0f5abc6d64d060c P 712448581a8b4362b83305434a66cb99: Time spent starting tablet: real 0.050s	user 0.022s	sys 0.019s
I20260709 13:19:42.108269 14881 tablet_bootstrap.cc:492] T 5235e6ffdc5245a59381b4d7078959b0 P 712448581a8b4362b83305434a66cb99: Bootstrap starting.
I20260709 13:19:42.109392 14585 catalog_manager.cc:5697] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 712448581a8b4362b83305434a66cb99 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "712448581a8b4362b83305434a66cb99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:42.110628 14887 leader_election.cc:290] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:42.111894 14880 ts_tablet_manager.cc:1434] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.003s
I20260709 13:19:42.115275 14881 tablet_bootstrap.cc:654] T 5235e6ffdc5245a59381b4d7078959b0 P 712448581a8b4362b83305434a66cb99: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.117033 14765 raft_consensus.cc:2468] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 1.
I20260709 13:19:42.117765 14880 tablet_bootstrap.cc:492] T b3e28b5bed5a4cb184329986f01360ad P ed4f059a209b4924865bad4ae2d019b3: Bootstrap starting.
I20260709 13:19:42.125756 14879 tablet_bootstrap.cc:654] T b3e28b5bed5a4cb184329986f01360ad P 31f7375d88974b7a9c775ec640ca368e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.129289 14588 catalog_manager.cc:5697] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e reported cstate change: term changed from 0 to 1, leader changed from <none> to 31f7375d88974b7a9c775ec640ca368e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "31f7375d88974b7a9c775ec640ca368e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:42.136895 14804 leader_election.cc:304] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 712448581a8b4362b83305434a66cb99, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:42.138170 14892 raft_consensus.cc:2804] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:42.138808 14892 raft_consensus.cc:697] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Becoming Leader. State: Replica: 712448581a8b4362b83305434a66cb99, State: Running, Role: LEADER
I20260709 13:19:42.139952 14892 consensus_queue.cc:237] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.157912 14887 raft_consensus.cc:493] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.158530 14887 raft_consensus.cc:515] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.159713 14690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba0f563382046f7a0f5abc6d64d060c" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e" is_pre_election: true
I20260709 13:19:42.160528 14690 raft_consensus.cc:2468] T cba0f563382046f7a0f5abc6d64d060c P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 0.
I20260709 13:19:42.160689 14887 leader_election.cc:290] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:42.161873 14688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9570777dd39b42e5bfbae3c29b91b002" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e" is_pre_election: true
I20260709 13:19:42.159791 14687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235e6ffdc5245a59381b4d7078959b0" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e" is_pre_election: true
I20260709 13:19:42.163846 14687 raft_consensus.cc:2468] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 0.
I20260709 13:19:42.165323 14729 leader_election.cc:304] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:42.166642 14687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918c48b8a8eb447c9d860cf67355b424" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e" is_pre_election: true
I20260709 13:19:42.166898 14729 leader_election.cc:304] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:42.167613 14687 raft_consensus.cc:2468] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 0.
I20260709 13:19:42.167888 14917 raft_consensus.cc:2804] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:42.168406 14917 raft_consensus.cc:493] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.168751 14917 raft_consensus.cc:3060] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.170018 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba0f563382046f7a0f5abc6d64d060c" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99" is_pre_election: true
I20260709 13:19:42.170732 14839 raft_consensus.cc:2468] T cba0f563382046f7a0f5abc6d64d060c P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 0.
I20260709 13:19:42.171406 14914 raft_consensus.cc:515] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.175930 14689 raft_consensus.cc:2468] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 1.
I20260709 13:19:42.173637 14914 leader_election.cc:290] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:42.177106 14881 tablet_bootstrap.cc:492] T 5235e6ffdc5245a59381b4d7078959b0 P 712448581a8b4362b83305434a66cb99: No bootstrap required, opened a new log
I20260709 13:19:42.176862 14917 raft_consensus.cc:515] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.177852 14881 ts_tablet_manager.cc:1403] T 5235e6ffdc5245a59381b4d7078959b0 P 712448581a8b4362b83305434a66cb99: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.019s
I20260709 13:19:42.178026 14880 tablet_bootstrap.cc:654] T b3e28b5bed5a4cb184329986f01360ad P ed4f059a209b4924865bad4ae2d019b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.178216 14887 raft_consensus.cc:2804] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:42.178623 14887 raft_consensus.cc:493] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.178997 14887 raft_consensus.cc:3060] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.180788 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9570777dd39b42e5bfbae3c29b91b002" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99" is_pre_election: true
I20260709 13:19:42.180987 14881 raft_consensus.cc:359] T 5235e6ffdc5245a59381b4d7078959b0 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.181789 14881 raft_consensus.cc:385] T 5235e6ffdc5245a59381b4d7078959b0 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.182129 14881 raft_consensus.cc:740] T 5235e6ffdc5245a59381b4d7078959b0 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.182288 14838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235e6ffdc5245a59381b4d7078959b0" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99" is_pre_election: true
I20260709 13:19:42.183025 14881 consensus_queue.cc:260] T 5235e6ffdc5245a59381b4d7078959b0 P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.183949 14838 raft_consensus.cc:2468] T 5235e6ffdc5245a59381b4d7078959b0 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 0.
I20260709 13:19:42.185233 14881 ts_tablet_manager.cc:1434] T 5235e6ffdc5245a59381b4d7078959b0 P 712448581a8b4362b83305434a66cb99: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:19:42.185406 14729 leader_election.cc:304] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:42.186477 14881 tablet_bootstrap.cc:492] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99: Bootstrap starting.
I20260709 13:19:42.186872 14687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e22b8497214cde9d1b23a71ef8101a" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:42.187501 14687 raft_consensus.cc:3060] T 33e22b8497214cde9d1b23a71ef8101a P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.188649 14917 leader_election.cc:290] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:42.189523 14917 raft_consensus.cc:2804] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:42.190018 14917 raft_consensus.cc:493] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.190454 14917 raft_consensus.cc:3060] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.193331 14881 tablet_bootstrap.cc:654] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.194943 14892 raft_consensus.cc:493] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.195497 14892 raft_consensus.cc:515] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.198647 14588 catalog_manager.cc:5697] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 712448581a8b4362b83305434a66cb99 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "712448581a8b4362b83305434a66cb99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:42.203800 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918c48b8a8eb447c9d860cf67355b424" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99" is_pre_election: true
I20260709 13:19:42.204587 14837 raft_consensus.cc:2468] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 0.
I20260709 13:19:42.206583 14881 tablet_bootstrap.cc:492] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99: No bootstrap required, opened a new log
I20260709 13:19:42.211412 14689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918c48b8a8eb447c9d860cf67355b424" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e" is_pre_election: true
I20260709 13:19:42.212013 14881 ts_tablet_manager.cc:1403] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.008s
I20260709 13:19:42.212183 14689 raft_consensus.cc:2468] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 0.
I20260709 13:19:42.207652 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e22b8497214cde9d1b23a71ef8101a" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:42.213333 14765 raft_consensus.cc:3060] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.213717 14689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba0f563382046f7a0f5abc6d64d060c" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:42.214371 14689 raft_consensus.cc:3060] T cba0f563382046f7a0f5abc6d64d060c P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.214624 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918c48b8a8eb447c9d860cf67355b424" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3" is_pre_election: true
I20260709 13:19:42.208321 14879 tablet_bootstrap.cc:492] T b3e28b5bed5a4cb184329986f01360ad P 31f7375d88974b7a9c775ec640ca368e: No bootstrap required, opened a new log
I20260709 13:19:42.215997 14879 ts_tablet_manager.cc:1403] T b3e28b5bed5a4cb184329986f01360ad P 31f7375d88974b7a9c775ec640ca368e: Time spent bootstrapping tablet: real 0.163s	user 0.015s	sys 0.012s
I20260709 13:19:42.216812 14729 leader_election.cc:304] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4f059a209b4924865bad4ae2d019b3; no voters: 31f7375d88974b7a9c775ec640ca368e, 712448581a8b4362b83305434a66cb99
I20260709 13:19:42.216881 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba0f563382046f7a0f5abc6d64d060c" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:42.217955 14837 raft_consensus.cc:3060] T cba0f563382046f7a0f5abc6d64d060c P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.215190 14881 raft_consensus.cc:359] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.215811 14803 leader_election.cc:304] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, 712448581a8b4362b83305434a66cb99; no voters: 
I20260709 13:19:42.210747 14892 leader_election.cc:290] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:42.219435 14930 raft_consensus.cc:2749] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:42.219653 14914 raft_consensus.cc:2804] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:42.220054 14914 raft_consensus.cc:493] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.220389 14914 raft_consensus.cc:3060] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.219101 14881 raft_consensus.cc:385] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.222559 14881 raft_consensus.cc:740] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.223315 14881 consensus_queue.cc:260] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.219125 14879 raft_consensus.cc:359] T b3e28b5bed5a4cb184329986f01360ad P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.225101 14879 raft_consensus.cc:385] T b3e28b5bed5a4cb184329986f01360ad P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.225453 14879 raft_consensus.cc:740] T b3e28b5bed5a4cb184329986f01360ad P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.226552 14913 raft_consensus.cc:493] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.226437 14879 consensus_queue.cc:260] T b3e28b5bed5a4cb184329986f01360ad P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.227065 14913 raft_consensus.cc:515] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.228384 14914 raft_consensus.cc:515] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.229305 14913 leader_election.cc:290] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:42.230275 14688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e28b5bed5a4cb184329986f01360ad" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e" is_pre_election: true
I20260709 13:19:42.230994 14688 raft_consensus.cc:2468] T b3e28b5bed5a4cb184329986f01360ad P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 0.
I20260709 13:19:42.231361 14690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918c48b8a8eb447c9d860cf67355b424" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:42.231647 14763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e28b5bed5a4cb184329986f01360ad" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3" is_pre_election: true
I20260709 13:19:42.231993 14690 raft_consensus.cc:3060] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:42.234130 14804 leader_election.cc:343] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:42.234942 14803 leader_election.cc:304] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, 712448581a8b4362b83305434a66cb99; no voters: ed4f059a209b4924865bad4ae2d019b3
I20260709 13:19:42.238186 14879 ts_tablet_manager.cc:1434] T b3e28b5bed5a4cb184329986f01360ad P 31f7375d88974b7a9c775ec640ca368e: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 13:19:42.239667 14881 ts_tablet_manager.cc:1434] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 13:19:42.238823 14913 raft_consensus.cc:2804] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:42.238619 14887 raft_consensus.cc:515] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.242044 14913 raft_consensus.cc:493] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.241480 14765 raft_consensus.cc:2468] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 1.
I20260709 13:19:42.243394 14913 raft_consensus.cc:3060] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.244619 14804 leader_election.cc:304] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 712448581a8b4362b83305434a66cb99, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:42.245817 14887 leader_election.cc:290] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:42.246042 14688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235e6ffdc5245a59381b4d7078959b0" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:42.246886 14688 raft_consensus.cc:3060] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.247215 14917 raft_consensus.cc:515] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.248270 14764 raft_consensus.cc:2393] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 712448581a8b4362b83305434a66cb99 in current term 1: Already voted for candidate ed4f059a209b4924865bad4ae2d019b3 in this term.
I20260709 13:19:42.249289 14917 leader_election.cc:290] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:42.250854 14686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918c48b8a8eb447c9d860cf67355b424" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:42.251577 14838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235e6ffdc5245a59381b4d7078959b0" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:42.252081 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918c48b8a8eb447c9d860cf67355b424" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:42.252247 14837 raft_consensus.cc:2468] T cba0f563382046f7a0f5abc6d64d060c P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 1.
I20260709 13:19:42.253057 14839 raft_consensus.cc:2393] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ed4f059a209b4924865bad4ae2d019b3 in current term 1: Already voted for candidate 712448581a8b4362b83305434a66cb99 in this term.
I20260709 13:19:42.252233 14838 raft_consensus.cc:3060] T 5235e6ffdc5245a59381b4d7078959b0 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.253937 14892 raft_consensus.cc:2804] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:42.254609 14892 raft_consensus.cc:697] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Becoming Leader. State: Replica: 712448581a8b4362b83305434a66cb99, State: Running, Role: LEADER
I20260709 13:19:42.256433 14689 raft_consensus.cc:2468] T cba0f563382046f7a0f5abc6d64d060c P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 1.
I20260709 13:19:42.249347 14690 raft_consensus.cc:2468] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 1.
I20260709 13:19:42.257613 14729 leader_election.cc:304] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 712448581a8b4362b83305434a66cb99, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:42.259786 14803 leader_election.cc:304] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, 712448581a8b4362b83305434a66cb99; no voters: 
I20260709 13:19:42.260736 14915 raft_consensus.cc:2804] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:42.261103 14687 raft_consensus.cc:2468] T 33e22b8497214cde9d1b23a71ef8101a P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 1.
I20260709 13:19:42.262434 14892 consensus_queue.cc:237] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.263191 14729 leader_election.cc:304] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4f059a209b4924865bad4ae2d019b3; no voters: 31f7375d88974b7a9c775ec640ca368e, 712448581a8b4362b83305434a66cb99
I20260709 13:19:42.264184 14887 raft_consensus.cc:2804] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:42.264756 14887 raft_consensus.cc:697] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Becoming Leader. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Running, Role: LEADER
I20260709 13:19:42.264875 14930 raft_consensus.cc:2749] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:42.265800 14887 consensus_queue.cc:237] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.270659 14688 raft_consensus.cc:2468] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 1.
I20260709 13:19:42.272441 14838 raft_consensus.cc:2468] T 5235e6ffdc5245a59381b4d7078959b0 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 1.
I20260709 13:19:42.272518 14729 leader_election.cc:304] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:42.273792 14917 raft_consensus.cc:2804] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:42.274544 14917 raft_consensus.cc:697] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Becoming Leader. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Running, Role: LEADER
I20260709 13:19:42.275589 14917 consensus_queue.cc:237] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.277302 14914 leader_election.cc:290] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:42.279474 14880 tablet_bootstrap.cc:492] T b3e28b5bed5a4cb184329986f01360ad P ed4f059a209b4924865bad4ae2d019b3: No bootstrap required, opened a new log
I20260709 13:19:42.279191 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918c48b8a8eb447c9d860cf67355b424" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:42.281478 14880 ts_tablet_manager.cc:1403] T b3e28b5bed5a4cb184329986f01360ad P ed4f059a209b4924865bad4ae2d019b3: Time spent bootstrapping tablet: real 0.164s	user 0.019s	sys 0.022s
I20260709 13:19:42.281950 14765 raft_consensus.cc:2393] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 712448581a8b4362b83305434a66cb99 in current term 1: Already voted for candidate ed4f059a209b4924865bad4ae2d019b3 in this term.
I20260709 13:19:42.284785 14880 raft_consensus.cc:359] T b3e28b5bed5a4cb184329986f01360ad P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.285645 14880 raft_consensus.cc:385] T b3e28b5bed5a4cb184329986f01360ad P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.286062 14880 raft_consensus.cc:740] T b3e28b5bed5a4cb184329986f01360ad P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.286546 14915 raft_consensus.cc:697] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Becoming Leader. State: Replica: 712448581a8b4362b83305434a66cb99, State: Running, Role: LEADER
I20260709 13:19:42.287233 14880 consensus_queue.cc:260] T b3e28b5bed5a4cb184329986f01360ad P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.287895 14915 consensus_queue.cc:237] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.293280 14880 ts_tablet_manager.cc:1434] T b3e28b5bed5a4cb184329986f01360ad P ed4f059a209b4924865bad4ae2d019b3: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 13:19:42.292305 14913 raft_consensus.cc:515] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.299029 14913 leader_election.cc:290] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:42.300061 14688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e28b5bed5a4cb184329986f01360ad" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:42.301002 14688 raft_consensus.cc:3060] T b3e28b5bed5a4cb184329986f01360ad P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.303323 14588 catalog_manager.cc:5697] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "ed4f059a209b4924865bad4ae2d019b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:42.307067 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e28b5bed5a4cb184329986f01360ad" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:42.307737 14765 raft_consensus.cc:3060] T b3e28b5bed5a4cb184329986f01360ad P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.313254 14688 raft_consensus.cc:2468] T b3e28b5bed5a4cb184329986f01360ad P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 1.
I20260709 13:19:42.314879 14803 leader_election.cc:304] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, 712448581a8b4362b83305434a66cb99; no voters: 
I20260709 13:19:42.316035 14913 raft_consensus.cc:2804] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:42.316686 14913 raft_consensus.cc:697] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Becoming Leader. State: Replica: 712448581a8b4362b83305434a66cb99, State: Running, Role: LEADER
I20260709 13:19:42.317732 14913 consensus_queue.cc:237] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.318307 14587 catalog_manager.cc:5697] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 712448581a8b4362b83305434a66cb99 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "712448581a8b4362b83305434a66cb99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:42.319012 14765 raft_consensus.cc:2468] T b3e28b5bed5a4cb184329986f01360ad P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 1.
I20260709 13:19:42.329453 14588 catalog_manager.cc:5697] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "ed4f059a209b4924865bad4ae2d019b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:42.339051 14587 catalog_manager.cc:5697] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 712448581a8b4362b83305434a66cb99 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "712448581a8b4362b83305434a66cb99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:42.340957 14587 catalog_manager.cc:5697] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 712448581a8b4362b83305434a66cb99 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "712448581a8b4362b83305434a66cb99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:42.362226 14887 raft_consensus.cc:493] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.362872 14887 raft_consensus.cc:515] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.364797 14887 leader_election.cc:290] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:42.365845 14688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728b17d23bff40d99b022d71c68dc2b0" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e" is_pre_election: true
I20260709 13:19:42.366466 14838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728b17d23bff40d99b022d71c68dc2b0" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99" is_pre_election: true
I20260709 13:19:42.366703 14688 raft_consensus.cc:2468] T 728b17d23bff40d99b022d71c68dc2b0 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 0.
I20260709 13:19:42.367192 14838 raft_consensus.cc:2468] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 0.
I20260709 13:19:42.367942 14729 leader_election.cc:304] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:42.368994 14887 raft_consensus.cc:2804] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:42.369343 14887 raft_consensus.cc:493] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.369659 14887 raft_consensus.cc:3060] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.374717 14887 raft_consensus.cc:515] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.376374 14887 leader_election.cc:290] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:42.377354 14688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728b17d23bff40d99b022d71c68dc2b0" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:42.377552 14838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728b17d23bff40d99b022d71c68dc2b0" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:42.378044 14688 raft_consensus.cc:3060] T 728b17d23bff40d99b022d71c68dc2b0 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.378299 14838 raft_consensus.cc:3060] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.383278 14688 raft_consensus.cc:2468] T 728b17d23bff40d99b022d71c68dc2b0 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 1.
I20260709 13:19:42.383379 14838 raft_consensus.cc:2468] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 1.
I20260709 13:19:42.384517 14729 leader_election.cc:304] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:42.385355 14887 raft_consensus.cc:2804] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:42.385941 14887 raft_consensus.cc:697] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Becoming Leader. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Running, Role: LEADER
I20260709 13:19:42.386677 14887 consensus_queue.cc:237] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.395287 14587 catalog_manager.cc:5697] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "ed4f059a209b4924865bad4ae2d019b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:42.428450 14884 consensus_queue.cc:1048] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:42.442900 14885 consensus_queue.cc:1048] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:42.478579 14838 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "918c48b8a8eb447c9d860cf67355b424"
dest_uuid: "712448581a8b4362b83305434a66cb99"
mode: GRACEFUL
new_leader_uuid: "31f7375d88974b7a9c775ec640ca368e"
 from {username='slave'} at 127.0.0.1:50772
I20260709 13:19:42.479254 14838 raft_consensus.cc:606] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Received request to transfer leadership to TS 31f7375d88974b7a9c775ec640ca368e
I20260709 13:19:42.484359 14838 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9570777dd39b42e5bfbae3c29b91b002"
dest_uuid: "712448581a8b4362b83305434a66cb99"
mode: GRACEFUL
new_leader_uuid: "31f7375d88974b7a9c775ec640ca368e"
 from {username='slave'} at 127.0.0.1:50772
I20260709 13:19:42.484894 14838 raft_consensus.cc:606] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Received request to transfer leadership to TS 31f7375d88974b7a9c775ec640ca368e
I20260709 13:19:42.489894 14838 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f538e262460d404a82ac501bf33a5078"
dest_uuid: "712448581a8b4362b83305434a66cb99"
mode: GRACEFUL
new_leader_uuid: "31f7375d88974b7a9c775ec640ca368e"
 from {username='slave'} at 127.0.0.1:50772
I20260709 13:19:42.490468 14838 raft_consensus.cc:606] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Received request to transfer leadership to TS 31f7375d88974b7a9c775ec640ca368e
I20260709 13:19:42.495256 14838 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33e22b8497214cde9d1b23a71ef8101a"
dest_uuid: "712448581a8b4362b83305434a66cb99"
mode: GRACEFUL
new_leader_uuid: "ed4f059a209b4924865bad4ae2d019b3"
 from {username='slave'} at 127.0.0.1:50772
I20260709 13:19:42.495756 14838 raft_consensus.cc:606] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Received request to transfer leadership to TS ed4f059a209b4924865bad4ae2d019b3
I20260709 13:19:42.500980 14913 consensus_queue.cc:1048] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:42.516736 14892 consensus_queue.cc:1048] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:42.525920 14892 raft_consensus.cc:993] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99: : Instructing follower 31f7375d88974b7a9c775ec640ca368e to start an election
I20260709 13:19:42.526479 14915 raft_consensus.cc:1081] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Signalling peer 31f7375d88974b7a9c775ec640ca368e to start an election
I20260709 13:19:42.528321 14688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f538e262460d404a82ac501bf33a5078"
dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
 from {username='slave'} at 127.0.0.1:50504
I20260709 13:19:42.529137 14688 raft_consensus.cc:493] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:42.529592 14688 raft_consensus.cc:3060] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.534739 14688 raft_consensus.cc:515] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.536566 14688 leader_election.cc:290] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 2 election: Requested vote from peers ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:42.537716 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f538e262460d404a82ac501bf33a5078" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:42.538259 14838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f538e262460d404a82ac501bf33a5078" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:42.538607 14765 raft_consensus.cc:3060] T f538e262460d404a82ac501bf33a5078 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.539043 14838 raft_consensus.cc:3055] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:42.539459 14838 raft_consensus.cc:740] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Running, Role: LEADER
I20260709 13:19:42.540443 14838 consensus_queue.cc:260] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.541989 14838 raft_consensus.cc:3060] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.544891 14765 raft_consensus.cc:2468] T f538e262460d404a82ac501bf33a5078 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 2.
I20260709 13:19:42.546087 14655 leader_election.cc:304] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:42.546852 14885 raft_consensus.cc:2804] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:42.547396 14885 raft_consensus.cc:697] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [term 2 LEADER]: Becoming Leader. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Running, Role: LEADER
I20260709 13:19:42.548332 14885 consensus_queue.cc:237] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.549088 14838 raft_consensus.cc:2468] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 2.
I20260709 13:19:42.555773 14587 catalog_manager.cc:5697] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e reported cstate change: term changed from 1 to 2, leader changed from 712448581a8b4362b83305434a66cb99 (127.1.227.131) to 31f7375d88974b7a9c775ec640ca368e (127.1.227.129). New cstate: current_term: 2 leader_uuid: "31f7375d88974b7a9c775ec640ca368e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:42.651800 14887 consensus_queue.cc:1048] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:42.663425 14917 consensus_queue.cc:1048] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:42.665380 14915 consensus_queue.cc:1048] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:42.679265 14915 consensus_queue.cc:1048] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:42.688246 14892 raft_consensus.cc:993] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99: : Instructing follower ed4f059a209b4924865bad4ae2d019b3 to start an election
I20260709 13:19:42.688735 14892 raft_consensus.cc:1081] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Signalling peer ed4f059a209b4924865bad4ae2d019b3 to start an election
I20260709 13:19:42.690589 14765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33e22b8497214cde9d1b23a71ef8101a"
dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
 from {username='slave'} at 127.0.0.1:35230
I20260709 13:19:42.691193 14765 raft_consensus.cc:493] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:42.691984 14765 raft_consensus.cc:3060] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.697525 14765 raft_consensus.cc:515] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.699556 14765 leader_election.cc:290] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 2 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:42.700332 14689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e22b8497214cde9d1b23a71ef8101a" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:42.700976 14689 raft_consensus.cc:3060] T 33e22b8497214cde9d1b23a71ef8101a P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.701095 14838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e22b8497214cde9d1b23a71ef8101a" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:42.701848 14838 raft_consensus.cc:3055] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:42.702179 14838 raft_consensus.cc:740] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Running, Role: LEADER
I20260709 13:19:42.703241 14838 consensus_queue.cc:260] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.704530 14838 raft_consensus.cc:3060] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.708595 14689 raft_consensus.cc:2468] T 33e22b8497214cde9d1b23a71ef8101a P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 2.
I20260709 13:19:42.709863 14729 leader_election.cc:304] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:42.710657 14887 raft_consensus.cc:2804] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:42.711125 14887 raft_consensus.cc:697] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 [term 2 LEADER]: Becoming Leader. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Running, Role: LEADER
I20260709 13:19:42.711884 14838 raft_consensus.cc:2468] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 2.
I20260709 13:19:42.711948 14887 consensus_queue.cc:237] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.720134 14892 consensus_queue.cc:1048] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:42.720119 14588 catalog_manager.cc:5697] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 reported cstate change: term changed from 1 to 2, leader changed from 712448581a8b4362b83305434a66cb99 (127.1.227.131) to ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130). New cstate: current_term: 2 leader_uuid: "ed4f059a209b4924865bad4ae2d019b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:42.729180 14915 raft_consensus.cc:993] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99: : Instructing follower 31f7375d88974b7a9c775ec640ca368e to start an election
I20260709 13:19:42.729669 14914 raft_consensus.cc:1081] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Signalling peer 31f7375d88974b7a9c775ec640ca368e to start an election
I20260709 13:19:42.732308 14689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9570777dd39b42e5bfbae3c29b91b002"
dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
 from {username='slave'} at 127.0.0.1:50504
I20260709 13:19:42.734385 14915 consensus_queue.cc:1048] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:42.735285 14689 raft_consensus.cc:493] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:42.735797 14689 raft_consensus.cc:3060] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.745857 14689 raft_consensus.cc:515] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.750020 14689 leader_election.cc:290] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 2 election: Requested vote from peers ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:42.750623 14838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9570777dd39b42e5bfbae3c29b91b002" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:42.750644 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9570777dd39b42e5bfbae3c29b91b002" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:42.751333 14838 raft_consensus.cc:3055] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:42.751609 14765 raft_consensus.cc:3060] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.751786 14838 raft_consensus.cc:740] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Running, Role: LEADER
I20260709 13:19:42.752764 14838 consensus_queue.cc:260] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.753944 14838 raft_consensus.cc:3060] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.757526 14765 raft_consensus.cc:2468] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 2.
I20260709 13:19:42.758769 14655 leader_election.cc:304] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:42.759205 14838 raft_consensus.cc:2468] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 2.
I20260709 13:19:42.759464 14885 raft_consensus.cc:2804] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:42.760002 14885 raft_consensus.cc:697] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e [term 2 LEADER]: Becoming Leader. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Running, Role: LEADER
I20260709 13:19:42.760875 14885 consensus_queue.cc:237] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.767483 14588 catalog_manager.cc:5697] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e reported cstate change: term changed from 1 to 2, leader changed from 712448581a8b4362b83305434a66cb99 (127.1.227.131) to 31f7375d88974b7a9c775ec640ca368e (127.1.227.129). New cstate: current_term: 2 leader_uuid: "31f7375d88974b7a9c775ec640ca368e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:42.792189 14915 consensus_queue.cc:1048] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:42.804347 14914 consensus_queue.cc:1048] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:42.809092 14914 consensus_queue.cc:1048] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:42.813730 14915 raft_consensus.cc:993] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99: : Instructing follower 31f7375d88974b7a9c775ec640ca368e to start an election
I20260709 13:19:42.814349 14914 raft_consensus.cc:1081] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Signalling peer 31f7375d88974b7a9c775ec640ca368e to start an election
I20260709 13:19:42.816555 14689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "918c48b8a8eb447c9d860cf67355b424"
dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
 from {username='slave'} at 127.0.0.1:50504
I20260709 13:19:42.817234 14689 raft_consensus.cc:493] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:42.817669 14689 raft_consensus.cc:3060] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.827895 14915 consensus_queue.cc:1048] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:42.829834 14689 raft_consensus.cc:515] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.832671 14689 leader_election.cc:290] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 2 election: Requested vote from peers ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:42.833256 14838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918c48b8a8eb447c9d860cf67355b424" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:42.834009 14838 raft_consensus.cc:3055] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:42.834367 14838 raft_consensus.cc:740] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Running, Role: LEADER
I20260709 13:19:42.835423 14838 consensus_queue.cc:260] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.836774 14838 raft_consensus.cc:3060] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.834193 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918c48b8a8eb447c9d860cf67355b424" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:42.838754 14764 raft_consensus.cc:3060] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.846990 14764 raft_consensus.cc:2468] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 2.
I20260709 13:19:42.848649 14655 leader_election.cc:304] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:42.849578 14885 raft_consensus.cc:2804] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:42.850099 14885 raft_consensus.cc:697] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 2 LEADER]: Becoming Leader. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Running, Role: LEADER
I20260709 13:19:42.850746 14838 raft_consensus.cc:2468] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 2.
I20260709 13:19:42.850970 14885 consensus_queue.cc:237] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:42.858695 14887 consensus_queue.cc:1048] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:42.860644 14588 catalog_manager.cc:5697] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e reported cstate change: term changed from 1 to 2, leader changed from 712448581a8b4362b83305434a66cb99 (127.1.227.131) to 31f7375d88974b7a9c775ec640ca368e (127.1.227.129). New cstate: current_term: 2 leader_uuid: "31f7375d88974b7a9c775ec640ca368e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:42.874531 14917 consensus_queue.cc:1048] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:42.888751 14930 consensus_queue.cc:1048] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:42.901711 14887 consensus_queue.cc:1048] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:43.082772 14764 raft_consensus.cc:1275] T f538e262460d404a82ac501bf33a5078 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Refusing update from remote peer 31f7375d88974b7a9c775ec640ca368e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:43.084394 14961 consensus_queue.cc:1048] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:43.092777 14838 raft_consensus.cc:1275] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Refusing update from remote peer 31f7375d88974b7a9c775ec640ca368e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:43.094930 14884 consensus_queue.cc:1048] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:43.187734 14689 raft_consensus.cc:1275] T 33e22b8497214cde9d1b23a71ef8101a P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Refusing update from remote peer ed4f059a209b4924865bad4ae2d019b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:43.189384 14917 consensus_queue.cc:1048] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:43.197671 14838 raft_consensus.cc:1275] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Refusing update from remote peer ed4f059a209b4924865bad4ae2d019b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:43.199848 14887 consensus_queue.cc:1048] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:43.223784 14838 raft_consensus.cc:1275] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Refusing update from remote peer 31f7375d88974b7a9c775ec640ca368e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:43.225530 14884 consensus_queue.cc:1048] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:43.233430 14765 raft_consensus.cc:1275] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Refusing update from remote peer 31f7375d88974b7a9c775ec640ca368e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:43.235283 14885 consensus_queue.cc:1048] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:43.308177 14765 raft_consensus.cc:1275] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Refusing update from remote peer 31f7375d88974b7a9c775ec640ca368e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:43.309590 14884 consensus_queue.cc:1048] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:43.319636 14838 raft_consensus.cc:1275] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Refusing update from remote peer 31f7375d88974b7a9c775ec640ca368e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:43.320988 14885 consensus_queue.cc:1048] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:45.546696 14588 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45726:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:45.548950 14588 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:45.602037 14679 tablet_service.cc:1511] Processing CreateTablet for tablet 405cddebb82545cd91123089b4e65aba (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:45.603359 14679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 405cddebb82545cd91123089b4e65aba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.603056 14752 tablet_service.cc:1511] Processing CreateTablet for tablet 405cddebb82545cd91123089b4e65aba (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:45.604521 14752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 405cddebb82545cd91123089b4e65aba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.605894 14677 tablet_service.cc:1511] Processing CreateTablet for tablet 16bf6bbe8d044b08b8be9a53b89b20f3 (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:45.606328 14826 tablet_service.cc:1511] Processing CreateTablet for tablet 405cddebb82545cd91123089b4e65aba (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:45.607406 14677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16bf6bbe8d044b08b8be9a53b89b20f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.607586 14826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 405cddebb82545cd91123089b4e65aba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.612037 14753 tablet_service.cc:1511] Processing CreateTablet for tablet 67e28ee13ebc4ea78b56e302d4a8e13f (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:45.612336 14754 tablet_service.cc:1511] Processing CreateTablet for tablet 16bf6bbe8d044b08b8be9a53b89b20f3 (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:45.614202 14753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67e28ee13ebc4ea78b56e302d4a8e13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.616660 14828 tablet_service.cc:1511] Processing CreateTablet for tablet 16bf6bbe8d044b08b8be9a53b89b20f3 (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:45.617151 14680 tablet_service.cc:1511] Processing CreateTablet for tablet 67e28ee13ebc4ea78b56e302d4a8e13f (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:45.619024 14680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67e28ee13ebc4ea78b56e302d4a8e13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.621232 14828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16bf6bbe8d044b08b8be9a53b89b20f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.629045 14754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16bf6bbe8d044b08b8be9a53b89b20f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.649009 14824 tablet_service.cc:1511] Processing CreateTablet for tablet 67e28ee13ebc4ea78b56e302d4a8e13f (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:45.650537 14824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67e28ee13ebc4ea78b56e302d4a8e13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.665439 14678 tablet_service.cc:1511] Processing CreateTablet for tablet cff4e84064674eea87324bb89f7e6e60 (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:45.667330 14678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff4e84064674eea87324bb89f7e6e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.668814 14755 tablet_service.cc:1511] Processing CreateTablet for tablet cff4e84064674eea87324bb89f7e6e60 (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:45.670491 14755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff4e84064674eea87324bb89f7e6e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.675606 14975 tablet_bootstrap.cc:492] T 405cddebb82545cd91123089b4e65aba P 712448581a8b4362b83305434a66cb99: Bootstrap starting.
I20260709 13:19:45.684707 14975 tablet_bootstrap.cc:654] T 405cddebb82545cd91123089b4e65aba P 712448581a8b4362b83305434a66cb99: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.677882 14976 tablet_bootstrap.cc:492] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e: Bootstrap starting.
I20260709 13:19:45.691720 14826 tablet_service.cc:1511] Processing CreateTablet for tablet cff4e84064674eea87324bb89f7e6e60 (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:45.693181 14826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff4e84064674eea87324bb89f7e6e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.697456 14976 tablet_bootstrap.cc:654] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.710374 14679 tablet_service.cc:1511] Processing CreateTablet for tablet 94cd096fb1b44314998a5ca9c10d8b92 (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:45.712087 14679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94cd096fb1b44314998a5ca9c10d8b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.716244 14974 tablet_bootstrap.cc:492] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3: Bootstrap starting.
I20260709 13:19:45.741393 14755 tablet_service.cc:1511] Processing CreateTablet for tablet 94cd096fb1b44314998a5ca9c10d8b92 (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:45.742072 14975 tablet_bootstrap.cc:492] T 405cddebb82545cd91123089b4e65aba P 712448581a8b4362b83305434a66cb99: No bootstrap required, opened a new log
I20260709 13:19:45.742914 14975 ts_tablet_manager.cc:1403] T 405cddebb82545cd91123089b4e65aba P 712448581a8b4362b83305434a66cb99: Time spent bootstrapping tablet: real 0.068s	user 0.009s	sys 0.007s
I20260709 13:19:45.743108 14755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94cd096fb1b44314998a5ca9c10d8b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.747942 14974 tablet_bootstrap.cc:654] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.749974 14824 tablet_service.cc:1511] Processing CreateTablet for tablet 94cd096fb1b44314998a5ca9c10d8b92 (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:45.747577 14975 raft_consensus.cc:359] T 405cddebb82545cd91123089b4e65aba P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.755268 14753 tablet_service.cc:1511] Processing CreateTablet for tablet 555dfb56b5c6475da7c3298fa816df94 (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:45.754433 14824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94cd096fb1b44314998a5ca9c10d8b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.757910 14753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 555dfb56b5c6475da7c3298fa816df94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.757714 14826 tablet_service.cc:1511] Processing CreateTablet for tablet 555dfb56b5c6475da7c3298fa816df94 (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:45.758635 14677 tablet_service.cc:1511] Processing CreateTablet for tablet 6458b7b4a6834d48a65fec81a668a7fe (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:45.759984 14677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6458b7b4a6834d48a65fec81a668a7fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.766983 14679 tablet_service.cc:1511] Processing CreateTablet for tablet 555dfb56b5c6475da7c3298fa816df94 (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:45.768544 14679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 555dfb56b5c6475da7c3298fa816df94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.769014 14754 tablet_service.cc:1511] Processing CreateTablet for tablet 6458b7b4a6834d48a65fec81a668a7fe (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:45.770635 14754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6458b7b4a6834d48a65fec81a668a7fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.756631 14975 raft_consensus.cc:385] T 405cddebb82545cd91123089b4e65aba P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.774109 14975 raft_consensus.cc:740] T 405cddebb82545cd91123089b4e65aba P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.776867 14829 tablet_service.cc:1511] Processing CreateTablet for tablet 6458b7b4a6834d48a65fec81a668a7fe (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:45.777827 14680 tablet_service.cc:1511] Processing CreateTablet for tablet b99e798b90d641cc955df72a9a6938f9 (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:45.779253 14680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b99e798b90d641cc955df72a9a6938f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.780160 14752 tablet_service.cc:1511] Processing CreateTablet for tablet b99e798b90d641cc955df72a9a6938f9 (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:45.781713 14752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b99e798b90d641cc955df72a9a6938f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.790169 14826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 555dfb56b5c6475da7c3298fa816df94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.791033 14975 consensus_queue.cc:260] T 405cddebb82545cd91123089b4e65aba P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.792316 14829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6458b7b4a6834d48a65fec81a668a7fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.793428 14976 tablet_bootstrap.cc:492] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e: No bootstrap required, opened a new log
I20260709 13:19:45.794183 14976 ts_tablet_manager.cc:1403] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.026s
I20260709 13:19:45.807245 14975 ts_tablet_manager.cc:1434] T 405cddebb82545cd91123089b4e65aba P 712448581a8b4362b83305434a66cb99: Time spent starting tablet: real 0.064s	user 0.009s	sys 0.000s
I20260709 13:19:45.808434 14975 tablet_bootstrap.cc:492] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99: Bootstrap starting.
I20260709 13:19:45.797494 14976 raft_consensus.cc:359] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.822382 14976 raft_consensus.cc:385] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.822743 14976 raft_consensus.cc:740] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.823514 14976 consensus_queue.cc:260] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.833446 14974 tablet_bootstrap.cc:492] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3: No bootstrap required, opened a new log
I20260709 13:19:45.834086 14974 ts_tablet_manager.cc:1403] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3: Time spent bootstrapping tablet: real 0.118s	user 0.008s	sys 0.024s
I20260709 13:19:45.837569 14752 tablet_service.cc:1511] Processing CreateTablet for tablet 3b074124b1dd46e39f36bb85084c8d10 (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:45.838991 14752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b074124b1dd46e39f36bb85084c8d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.839358 14827 tablet_service.cc:1511] Processing CreateTablet for tablet 3b074124b1dd46e39f36bb85084c8d10 (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:45.840821 14827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b074124b1dd46e39f36bb85084c8d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.851193 14828 tablet_service.cc:1511] Processing CreateTablet for tablet b99e798b90d641cc955df72a9a6938f9 (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:45.852809 14828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b99e798b90d641cc955df72a9a6938f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.853703 14679 tablet_service.cc:1511] Processing CreateTablet for tablet 3b074124b1dd46e39f36bb85084c8d10 (DEFAULT_TABLE table=soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:45.856577 14976 ts_tablet_manager.cc:1434] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e: Time spent starting tablet: real 0.062s	user 0.003s	sys 0.004s
I20260709 13:19:45.837409 14974 raft_consensus.cc:359] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.863744 14974 raft_consensus.cc:385] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.858964 14975 tablet_bootstrap.cc:654] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.864553 14974 raft_consensus.cc:740] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.865711 14974 consensus_queue.cc:260] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.867770 14976 tablet_bootstrap.cc:492] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e: Bootstrap starting.
I20260709 13:19:45.868173 14974 ts_tablet_manager.cc:1434] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
W20260709 13:19:45.869671 14636 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:45.870572 14974 tablet_bootstrap.cc:492] T 16bf6bbe8d044b08b8be9a53b89b20f3 P ed4f059a209b4924865bad4ae2d019b3: Bootstrap starting.
I20260709 13:19:45.870743 14679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b074124b1dd46e39f36bb85084c8d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.893424 14974 tablet_bootstrap.cc:654] T 16bf6bbe8d044b08b8be9a53b89b20f3 P ed4f059a209b4924865bad4ae2d019b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.893514 14976 tablet_bootstrap.cc:654] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.896458 14975 tablet_bootstrap.cc:492] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99: No bootstrap required, opened a new log
I20260709 13:19:45.897162 14975 ts_tablet_manager.cc:1403] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99: Time spent bootstrapping tablet: real 0.089s	user 0.011s	sys 0.003s
I20260709 13:19:45.900199 14974 tablet_bootstrap.cc:492] T 16bf6bbe8d044b08b8be9a53b89b20f3 P ed4f059a209b4924865bad4ae2d019b3: No bootstrap required, opened a new log
I20260709 13:19:45.900691 14974 ts_tablet_manager.cc:1403] T 16bf6bbe8d044b08b8be9a53b89b20f3 P ed4f059a209b4924865bad4ae2d019b3: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.004s
I20260709 13:19:45.902664 14975 raft_consensus.cc:359] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.903580 14975 raft_consensus.cc:385] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.904013 14975 raft_consensus.cc:740] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.903595 14974 raft_consensus.cc:359] T 16bf6bbe8d044b08b8be9a53b89b20f3 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.904525 14974 raft_consensus.cc:385] T 16bf6bbe8d044b08b8be9a53b89b20f3 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.904841 14974 raft_consensus.cc:740] T 16bf6bbe8d044b08b8be9a53b89b20f3 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.904986 14975 consensus_queue.cc:260] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.905658 14974 consensus_queue.cc:260] T 16bf6bbe8d044b08b8be9a53b89b20f3 P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.906915 14976 tablet_bootstrap.cc:492] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e: No bootstrap required, opened a new log
I20260709 13:19:45.907450 14976 ts_tablet_manager.cc:1403] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.011s
I20260709 13:19:45.907567 14975 ts_tablet_manager.cc:1434] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:19:45.910190 14974 ts_tablet_manager.cc:1434] T 16bf6bbe8d044b08b8be9a53b89b20f3 P ed4f059a209b4924865bad4ae2d019b3: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:19:45.911336 14974 tablet_bootstrap.cc:492] T 67e28ee13ebc4ea78b56e302d4a8e13f P ed4f059a209b4924865bad4ae2d019b3: Bootstrap starting.
I20260709 13:19:45.914371 14975 tablet_bootstrap.cc:492] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99: Bootstrap starting.
I20260709 13:19:45.918395 14974 tablet_bootstrap.cc:654] T 67e28ee13ebc4ea78b56e302d4a8e13f P ed4f059a209b4924865bad4ae2d019b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.918814 14976 raft_consensus.cc:359] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.919744 14976 raft_consensus.cc:385] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.920063 14976 raft_consensus.cc:740] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.920892 14976 consensus_queue.cc:260] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.922392 14975 tablet_bootstrap.cc:654] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.928217 14976 ts_tablet_manager.cc:1434] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e: Time spent starting tablet: real 0.020s	user 0.001s	sys 0.005s
I20260709 13:19:45.929582 14976 tablet_bootstrap.cc:492] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e: Bootstrap starting.
I20260709 13:19:45.939043 14975 tablet_bootstrap.cc:492] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99: No bootstrap required, opened a new log
W20260709 13:19:45.940124 14791 tablet.cc:2406] T 16bf6bbe8d044b08b8be9a53b89b20f3 P ed4f059a209b4924865bad4ae2d019b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:19:45.939781 14975 ts_tablet_manager.cc:1403] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.008s
I20260709 13:19:45.941313 14976 tablet_bootstrap.cc:654] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.943466 14975 raft_consensus.cc:359] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.944021 14975 raft_consensus.cc:385] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.944205 14975 raft_consensus.cc:740] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.944893 14975 consensus_queue.cc:260] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.947279 14974 tablet_bootstrap.cc:492] T 67e28ee13ebc4ea78b56e302d4a8e13f P ed4f059a209b4924865bad4ae2d019b3: No bootstrap required, opened a new log
I20260709 13:19:45.947474 14975 ts_tablet_manager.cc:1434] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:45.947875 14974 ts_tablet_manager.cc:1403] T 67e28ee13ebc4ea78b56e302d4a8e13f P ed4f059a209b4924865bad4ae2d019b3: Time spent bootstrapping tablet: real 0.037s	user 0.021s	sys 0.008s
I20260709 13:19:45.948640 14975 tablet_bootstrap.cc:492] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99: Bootstrap starting.
I20260709 13:19:45.951097 14976 tablet_bootstrap.cc:492] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e: No bootstrap required, opened a new log
I20260709 13:19:45.951223 14974 raft_consensus.cc:359] T 67e28ee13ebc4ea78b56e302d4a8e13f P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.951771 14976 ts_tablet_manager.cc:1403] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.001s
I20260709 13:19:45.952126 14974 raft_consensus.cc:385] T 67e28ee13ebc4ea78b56e302d4a8e13f P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.952459 14974 raft_consensus.cc:740] T 67e28ee13ebc4ea78b56e302d4a8e13f P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.953230 14974 consensus_queue.cc:260] T 67e28ee13ebc4ea78b56e302d4a8e13f P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.955700 14974 ts_tablet_manager.cc:1434] T 67e28ee13ebc4ea78b56e302d4a8e13f P ed4f059a209b4924865bad4ae2d019b3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:45.955623 14976 raft_consensus.cc:359] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.956548 14976 raft_consensus.cc:385] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.956887 14976 raft_consensus.cc:740] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.957336 14974 tablet_bootstrap.cc:492] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3: Bootstrap starting.
I20260709 13:19:45.957815 14976 consensus_queue.cc:260] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.960760 14975 tablet_bootstrap.cc:654] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.963317 14976 ts_tablet_manager.cc:1434] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:19:45.964622 14976 tablet_bootstrap.cc:492] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e: Bootstrap starting.
I20260709 13:19:45.964713 14974 tablet_bootstrap.cc:654] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.978893 14976 tablet_bootstrap.cc:654] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.986769 14975 tablet_bootstrap.cc:492] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99: No bootstrap required, opened a new log
I20260709 13:19:45.986769 14976 tablet_bootstrap.cc:492] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e: No bootstrap required, opened a new log
I20260709 13:19:45.987404 14975 ts_tablet_manager.cc:1403] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.007s
I20260709 13:19:45.987407 14976 ts_tablet_manager.cc:1403] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.005s
I20260709 13:19:45.991443 14975 raft_consensus.cc:359] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.992046 14974 tablet_bootstrap.cc:492] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3: No bootstrap required, opened a new log
I20260709 13:19:45.992336 14975 raft_consensus.cc:385] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.992705 14974 ts_tablet_manager.cc:1403] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.007s
I20260709 13:19:45.992713 14975 raft_consensus.cc:740] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.993763 14975 consensus_queue.cc:260] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.993963 14976 raft_consensus.cc:359] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.994911 14976 raft_consensus.cc:385] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.995276 14976 raft_consensus.cc:740] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.996174 14975 ts_tablet_manager.cc:1434] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:45.996062 14976 consensus_queue.cc:260] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:45.999150 14976 ts_tablet_manager.cc:1434] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:19:46.000545 14975 tablet_bootstrap.cc:492] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99: Bootstrap starting.
I20260709 13:19:46.000679 14976 tablet_bootstrap.cc:492] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e: Bootstrap starting.
I20260709 13:19:46.006196 14974 raft_consensus.cc:359] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.007167 14974 raft_consensus.cc:385] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.007531 14974 raft_consensus.cc:740] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.008486 14974 consensus_queue.cc:260] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.009353 14975 tablet_bootstrap.cc:654] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.009507 14976 tablet_bootstrap.cc:654] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.016335 14974 ts_tablet_manager.cc:1434] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.001s
I20260709 13:19:46.017766 14974 tablet_bootstrap.cc:492] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3: Bootstrap starting.
I20260709 13:19:46.035106 14930 raft_consensus.cc:493] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.035773 14930 raft_consensus.cc:515] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.037104 14975 tablet_bootstrap.cc:492] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99: No bootstrap required, opened a new log
I20260709 13:19:46.040406 14975 ts_tablet_manager.cc:1403] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.009s
I20260709 13:19:46.041893 14963 raft_consensus.cc:493] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.042821 14963 raft_consensus.cc:515] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.043547 14975 raft_consensus.cc:359] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.044384 14975 raft_consensus.cc:385] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.044674 14975 raft_consensus.cc:740] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.046347 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e28ee13ebc4ea78b56e302d4a8e13f" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3" is_pre_election: true
I20260709 13:19:46.047173 14765 raft_consensus.cc:2468] T 67e28ee13ebc4ea78b56e302d4a8e13f P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 0.
I20260709 13:19:46.048703 14804 leader_election.cc:304] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 712448581a8b4362b83305434a66cb99, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:46.048961 14974 tablet_bootstrap.cc:654] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.049089 14975 consensus_queue.cc:260] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.040395 14976 tablet_bootstrap.cc:492] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e: No bootstrap required, opened a new log
I20260709 13:19:46.050608 14976 ts_tablet_manager.cc:1403] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.010s
I20260709 13:19:46.051656 14963 leader_election.cc:290] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:46.055591 14963 raft_consensus.cc:2804] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:46.063131 14963 raft_consensus.cc:493] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.063715 14963 raft_consensus.cc:3060] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.053700 14976 raft_consensus.cc:359] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.067521 14976 raft_consensus.cc:385] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.067934 14688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e28ee13ebc4ea78b56e302d4a8e13f" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e" is_pre_election: true
I20260709 13:19:46.068763 14688 raft_consensus.cc:2468] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 0.
I20260709 13:19:46.054075 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4e84064674eea87324bb89f7e6e60" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99" is_pre_election: true
I20260709 13:19:46.069964 14839 raft_consensus.cc:2468] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 0.
I20260709 13:19:46.051651 14689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4e84064674eea87324bb89f7e6e60" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e" is_pre_election: true
I20260709 13:19:46.071211 14689 raft_consensus.cc:2468] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 0.
I20260709 13:19:46.073500 14729 leader_election.cc:304] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:46.052058 14930 leader_election.cc:290] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:46.075214 14930 raft_consensus.cc:2804] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:46.075932 14930 raft_consensus.cc:493] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.076880 14930 raft_consensus.cc:3060] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.068020 14976 raft_consensus.cc:740] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.091845 14976 consensus_queue.cc:260] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.095155 14976 ts_tablet_manager.cc:1434] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.001s
I20260709 13:19:46.097013 14995 raft_consensus.cc:493] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.097637 14995 raft_consensus.cc:515] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.099674 14930 raft_consensus.cc:515] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.100112 14995 leader_election.cc:290] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:46.102581 14976 tablet_bootstrap.cc:492] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e: Bootstrap starting.
I20260709 13:19:46.102734 14689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405cddebb82545cd91123089b4e65aba" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e" is_pre_election: true
I20260709 13:19:46.103472 14689 raft_consensus.cc:2468] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 0.
I20260709 13:19:46.106706 14930 leader_election.cc:290] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:46.107826 14963 raft_consensus.cc:515] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.109086 14975 ts_tablet_manager.cc:1434] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99: Time spent starting tablet: real 0.068s	user 0.011s	sys 0.047s
I20260709 13:19:46.109480 14838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4e84064674eea87324bb89f7e6e60" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:46.108256 14729 leader_election.cc:304] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:46.110267 14975 tablet_bootstrap.cc:492] T 555dfb56b5c6475da7c3298fa816df94 P 712448581a8b4362b83305434a66cb99: Bootstrap starting.
I20260709 13:19:46.111552 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405cddebb82545cd91123089b4e65aba" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99" is_pre_election: true
I20260709 13:19:46.113117 14839 raft_consensus.cc:2468] T 405cddebb82545cd91123089b4e65aba P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 0.
I20260709 13:19:46.097133 14992 raft_consensus.cc:493] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.115787 14992 raft_consensus.cc:515] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.116297 14963 leader_election.cc:290] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:46.112315 14689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4e84064674eea87324bb89f7e6e60" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:46.114195 14995 raft_consensus.cc:2804] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:46.117246 14995 raft_consensus.cc:493] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.117326 14689 raft_consensus.cc:3060] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.117684 14995 raft_consensus.cc:3060] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.118130 14688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e28ee13ebc4ea78b56e302d4a8e13f" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:46.112142 14885 raft_consensus.cc:493] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.119813 14885 raft_consensus.cc:515] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.118772 14688 raft_consensus.cc:3060] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.122264 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e28ee13ebc4ea78b56e302d4a8e13f" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:46.122943 14765 raft_consensus.cc:3060] T 67e28ee13ebc4ea78b56e302d4a8e13f P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.112041 14976 tablet_bootstrap.cc:654] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.124691 14885 leader_election.cc:290] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:46.125468 14838 raft_consensus.cc:3060] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.125479 14995 raft_consensus.cc:515] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.126626 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cd096fb1b44314998a5ca9c10d8b92" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3" is_pre_election: true
I20260709 13:19:46.127974 14995 leader_election.cc:290] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:46.130123 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405cddebb82545cd91123089b4e65aba" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:46.130827 14837 raft_consensus.cc:3060] T 405cddebb82545cd91123089b4e65aba P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.131793 14975 tablet_bootstrap.cc:654] T 555dfb56b5c6475da7c3298fa816df94 P 712448581a8b4362b83305434a66cb99: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.134027 14838 raft_consensus.cc:2468] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 1.
I20260709 13:19:46.136274 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cd096fb1b44314998a5ca9c10d8b92" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99" is_pre_election: true
I20260709 13:19:46.140560 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4e84064674eea87324bb89f7e6e60" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3" is_pre_election: true
I20260709 13:19:46.141638 14764 raft_consensus.cc:2393] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 712448581a8b4362b83305434a66cb99 in current term 1: Already voted for candidate ed4f059a209b4924865bad4ae2d019b3 in this term.
I20260709 13:19:46.143158 14689 raft_consensus.cc:2468] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 1.
W20260709 13:19:46.134060 14655 leader_election.cc:343] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.147490 14729 leader_election.cc:304] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:46.148058 14974 tablet_bootstrap.cc:492] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3: No bootstrap required, opened a new log
I20260709 13:19:46.148595 14995 raft_consensus.cc:2804] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:46.148765 14974 ts_tablet_manager.cc:1403] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3: Time spent bootstrapping tablet: real 0.131s	user 0.035s	sys 0.014s
I20260709 13:19:46.149190 14995 raft_consensus.cc:697] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Becoming Leader. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Running, Role: LEADER
I20260709 13:19:46.150204 14995 consensus_queue.cc:237] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.152259 14974 raft_consensus.cc:359] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.153084 14974 raft_consensus.cc:385] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.153385 14974 raft_consensus.cc:740] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.157503 14687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4e84064674eea87324bb89f7e6e60" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e" is_pre_election: true
I20260709 13:19:46.158488 14687 raft_consensus.cc:2393] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 712448581a8b4362b83305434a66cb99 in current term 1: Already voted for candidate ed4f059a209b4924865bad4ae2d019b3 in this term.
I20260709 13:19:46.160514 14803 leader_election.cc:304] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 712448581a8b4362b83305434a66cb99; no voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3
I20260709 13:19:46.162261 14963 raft_consensus.cc:2749] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:46.162508 14654 leader_election.cc:343] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.163029 14654 leader_election.cc:304] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e; no voters: 712448581a8b4362b83305434a66cb99, ed4f059a209b4924865bad4ae2d019b3
I20260709 13:19:46.163753 14885 raft_consensus.cc:2749] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:46.167829 14837 raft_consensus.cc:2468] T 405cddebb82545cd91123089b4e65aba P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 1.
I20260709 13:19:46.169495 14729 leader_election.cc:304] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 712448581a8b4362b83305434a66cb99, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:46.170441 14995 raft_consensus.cc:2804] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:46.167068 14974 consensus_queue.cc:260] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.171067 14995 raft_consensus.cc:697] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Becoming Leader. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Running, Role: LEADER
I20260709 13:19:46.171574 14765 raft_consensus.cc:2468] T 67e28ee13ebc4ea78b56e302d4a8e13f P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 1.
I20260709 13:19:46.139240 14992 leader_election.cc:290] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:46.171978 14995 consensus_queue.cc:237] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.174104 14689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405cddebb82545cd91123089b4e65aba" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:46.175493 14689 raft_consensus.cc:3060] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.175652 14804 leader_election.cc:304] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 712448581a8b4362b83305434a66cb99, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:46.174561 14974 ts_tablet_manager.cc:1434] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.001s
I20260709 13:19:46.177603 14974 tablet_bootstrap.cc:492] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3: Bootstrap starting.
I20260709 13:19:46.178153 14976 tablet_bootstrap.cc:492] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e: No bootstrap required, opened a new log
I20260709 13:19:46.171509 14688 raft_consensus.cc:2468] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 1.
I20260709 13:19:46.178614 14976 ts_tablet_manager.cc:1403] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e: Time spent bootstrapping tablet: real 0.082s	user 0.008s	sys 0.009s
I20260709 13:19:46.180171 14992 raft_consensus.cc:2804] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:46.182305 14992 raft_consensus.cc:697] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Becoming Leader. State: Replica: 712448581a8b4362b83305434a66cb99, State: Running, Role: LEADER
I20260709 13:19:46.180912 14976 raft_consensus.cc:359] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.183281 14976 raft_consensus.cc:385] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.183602 14976 raft_consensus.cc:740] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.184325 14976 consensus_queue.cc:260] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.183789 14992 consensus_queue.cc:237] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.186023 14975 tablet_bootstrap.cc:492] T 555dfb56b5c6475da7c3298fa816df94 P 712448581a8b4362b83305434a66cb99: No bootstrap required, opened a new log
I20260709 13:19:46.186601 14975 ts_tablet_manager.cc:1403] T 555dfb56b5c6475da7c3298fa816df94 P 712448581a8b4362b83305434a66cb99: Time spent bootstrapping tablet: real 0.077s	user 0.017s	sys 0.012s
I20260709 13:19:46.190042 14975 raft_consensus.cc:359] T 555dfb56b5c6475da7c3298fa816df94 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.190804 14975 raft_consensus.cc:385] T 555dfb56b5c6475da7c3298fa816df94 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.191097 14975 raft_consensus.cc:740] T 555dfb56b5c6475da7c3298fa816df94 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.192214 14975 consensus_queue.cc:260] T 555dfb56b5c6475da7c3298fa816df94 P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.194736 14975 ts_tablet_manager.cc:1434] T 555dfb56b5c6475da7c3298fa816df94 P 712448581a8b4362b83305434a66cb99: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:46.195832 14975 tablet_bootstrap.cc:492] T 94cd096fb1b44314998a5ca9c10d8b92 P 712448581a8b4362b83305434a66cb99: Bootstrap starting.
I20260709 13:19:46.196115 14974 tablet_bootstrap.cc:654] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.198101 14689 raft_consensus.cc:2468] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 1.
I20260709 13:19:46.200740 14587 catalog_manager.cc:5697] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "ed4f059a209b4924865bad4ae2d019b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:46.202451 14587 catalog_manager.cc:5697] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "ed4f059a209b4924865bad4ae2d019b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:46.203287 14976 ts_tablet_manager.cc:1434] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:19:46.204422 14976 tablet_bootstrap.cc:492] T 6458b7b4a6834d48a65fec81a668a7fe P 31f7375d88974b7a9c775ec640ca368e: Bootstrap starting.
I20260709 13:19:46.210789 14975 tablet_bootstrap.cc:654] T 94cd096fb1b44314998a5ca9c10d8b92 P 712448581a8b4362b83305434a66cb99: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.213316 14976 tablet_bootstrap.cc:654] T 6458b7b4a6834d48a65fec81a668a7fe P 31f7375d88974b7a9c775ec640ca368e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.215251 14588 catalog_manager.cc:5697] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 712448581a8b4362b83305434a66cb99 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "712448581a8b4362b83305434a66cb99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:46.223191 14974 tablet_bootstrap.cc:492] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3: No bootstrap required, opened a new log
I20260709 13:19:46.223755 14974 ts_tablet_manager.cc:1403] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.008s
I20260709 13:19:46.224126 14976 tablet_bootstrap.cc:492] T 6458b7b4a6834d48a65fec81a668a7fe P 31f7375d88974b7a9c775ec640ca368e: No bootstrap required, opened a new log
I20260709 13:19:46.225239 14976 ts_tablet_manager.cc:1403] T 6458b7b4a6834d48a65fec81a668a7fe P 31f7375d88974b7a9c775ec640ca368e: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.006s
I20260709 13:19:46.227712 14974 raft_consensus.cc:359] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.228960 14974 raft_consensus.cc:385] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.229353 14974 raft_consensus.cc:740] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.229396 14976 raft_consensus.cc:359] T 6458b7b4a6834d48a65fec81a668a7fe P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.230523 14976 raft_consensus.cc:385] T 6458b7b4a6834d48a65fec81a668a7fe P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.230355 14974 consensus_queue.cc:260] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.230991 14976 raft_consensus.cc:740] T 6458b7b4a6834d48a65fec81a668a7fe P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.232316 14976 consensus_queue.cc:260] T 6458b7b4a6834d48a65fec81a668a7fe P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.233702 14974 ts_tablet_manager.cc:1434] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:19:46.234946 14974 tablet_bootstrap.cc:492] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3: Bootstrap starting.
I20260709 13:19:46.242522 14976 ts_tablet_manager.cc:1434] T 6458b7b4a6834d48a65fec81a668a7fe P 31f7375d88974b7a9c775ec640ca368e: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:19:46.242784 14974 tablet_bootstrap.cc:654] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.243820 14976 tablet_bootstrap.cc:492] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e: Bootstrap starting.
I20260709 13:19:46.248045 14975 tablet_bootstrap.cc:492] T 94cd096fb1b44314998a5ca9c10d8b92 P 712448581a8b4362b83305434a66cb99: No bootstrap required, opened a new log
I20260709 13:19:46.248617 14975 ts_tablet_manager.cc:1403] T 94cd096fb1b44314998a5ca9c10d8b92 P 712448581a8b4362b83305434a66cb99: Time spent bootstrapping tablet: real 0.053s	user 0.020s	sys 0.010s
I20260709 13:19:46.249949 14992 raft_consensus.cc:493] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.250521 14992 raft_consensus.cc:515] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.251674 14976 tablet_bootstrap.cc:654] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.252070 14975 raft_consensus.cc:359] T 94cd096fb1b44314998a5ca9c10d8b92 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.252712 14992 leader_election.cc:290] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:46.252903 14975 raft_consensus.cc:385] T 94cd096fb1b44314998a5ca9c10d8b92 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.253228 14975 raft_consensus.cc:740] T 94cd096fb1b44314998a5ca9c10d8b92 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.257094 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bf6bbe8d044b08b8be9a53b89b20f3" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3" is_pre_election: true
I20260709 13:19:46.257876 14765 raft_consensus.cc:2468] T 16bf6bbe8d044b08b8be9a53b89b20f3 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 0.
I20260709 13:19:46.257496 14975 consensus_queue.cc:260] T 94cd096fb1b44314998a5ca9c10d8b92 P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.259115 14689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bf6bbe8d044b08b8be9a53b89b20f3" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e" is_pre_election: true
I20260709 13:19:46.259799 14689 raft_consensus.cc:2468] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 0.
I20260709 13:19:46.259999 14975 ts_tablet_manager.cc:1434] T 94cd096fb1b44314998a5ca9c10d8b92 P 712448581a8b4362b83305434a66cb99: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:19:46.261080 14975 tablet_bootstrap.cc:492] T b99e798b90d641cc955df72a9a6938f9 P 712448581a8b4362b83305434a66cb99: Bootstrap starting.
I20260709 13:19:46.261170 14804 leader_election.cc:304] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 712448581a8b4362b83305434a66cb99, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:46.262457 14963 raft_consensus.cc:2804] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:46.262840 14963 raft_consensus.cc:493] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.263190 14963 raft_consensus.cc:3060] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.270318 14976 tablet_bootstrap.cc:492] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e: No bootstrap required, opened a new log
I20260709 13:19:46.270982 14976 ts_tablet_manager.cc:1403] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.004s
I20260709 13:19:46.274351 14976 raft_consensus.cc:359] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.275396 14976 raft_consensus.cc:385] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.275806 14976 raft_consensus.cc:740] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.276178 14975 tablet_bootstrap.cc:654] T b99e798b90d641cc955df72a9a6938f9 P 712448581a8b4362b83305434a66cb99: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.276955 14976 consensus_queue.cc:260] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.280712 14976 ts_tablet_manager.cc:1434] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:19:46.282393 14976 tablet_bootstrap.cc:492] T 3b074124b1dd46e39f36bb85084c8d10 P 31f7375d88974b7a9c775ec640ca368e: Bootstrap starting.
I20260709 13:19:46.278931 14963 raft_consensus.cc:515] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.292223 14976 tablet_bootstrap.cc:654] T 3b074124b1dd46e39f36bb85084c8d10 P 31f7375d88974b7a9c775ec640ca368e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.294652 14885 raft_consensus.cc:493] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.295717 14885 raft_consensus.cc:515] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.300047 14689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bf6bbe8d044b08b8be9a53b89b20f3" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:46.300191 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b99e798b90d641cc955df72a9a6938f9" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3" is_pre_election: true
I20260709 13:19:46.301095 14689 raft_consensus.cc:3060] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.301471 14765 raft_consensus.cc:2468] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 0.
I20260709 13:19:46.303851 14655 leader_election.cc:304] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:46.305102 14980 raft_consensus.cc:2804] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:46.305680 14980 raft_consensus.cc:493] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.306102 14980 raft_consensus.cc:3060] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.312016 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b99e798b90d641cc955df72a9a6938f9" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99" is_pre_election: true
I20260709 13:19:46.313392 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bf6bbe8d044b08b8be9a53b89b20f3" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:46.314394 14765 raft_consensus.cc:3060] T 16bf6bbe8d044b08b8be9a53b89b20f3 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:46.314666 14654 leader_election.cc:343] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.316287 14885 leader_election.cc:290] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:46.325080 14963 leader_election.cc:290] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:46.327527 15012 raft_consensus.cc:493] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.328176 15012 raft_consensus.cc:515] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.333333 15012 leader_election.cc:290] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:46.338914 14974 tablet_bootstrap.cc:492] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3: No bootstrap required, opened a new log
I20260709 13:19:46.339747 14974 ts_tablet_manager.cc:1403] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.000s
I20260709 13:19:46.332100 14689 raft_consensus.cc:2468] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 1.
I20260709 13:19:46.343355 14803 leader_election.cc:304] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, 712448581a8b4362b83305434a66cb99; no voters: 
I20260709 13:19:46.346698 14992 raft_consensus.cc:2804] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:46.347422 14992 raft_consensus.cc:697] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Becoming Leader. State: Replica: 712448581a8b4362b83305434a66cb99, State: Running, Role: LEADER
I20260709 13:19:46.348624 14992 consensus_queue.cc:237] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.351560 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555dfb56b5c6475da7c3298fa816df94" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3" is_pre_election: true
I20260709 13:19:46.353473 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555dfb56b5c6475da7c3298fa816df94" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99" is_pre_election: true
I20260709 13:19:46.354598 14837 raft_consensus.cc:2468] T 555dfb56b5c6475da7c3298fa816df94 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 0.
I20260709 13:19:46.356591 14654 leader_election.cc:304] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, 712448581a8b4362b83305434a66cb99; no voters: 
W20260709 13:19:46.357720 14655 leader_election.cc:343] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.357808 15012 raft_consensus.cc:2804] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:46.358500 15012 raft_consensus.cc:493] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.358978 15012 raft_consensus.cc:3060] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.359540 14765 raft_consensus.cc:2468] T 16bf6bbe8d044b08b8be9a53b89b20f3 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 1.
I20260709 13:19:46.361603 14974 raft_consensus.cc:359] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.368930 14974 raft_consensus.cc:385] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.368795 14980 raft_consensus.cc:515] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.369508 14974 raft_consensus.cc:740] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.370538 14974 consensus_queue.cc:260] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.373790 14975 tablet_bootstrap.cc:492] T b99e798b90d641cc955df72a9a6938f9 P 712448581a8b4362b83305434a66cb99: No bootstrap required, opened a new log
I20260709 13:19:46.373881 14974 ts_tablet_manager.cc:1434] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3: Time spent starting tablet: real 0.034s	user 0.011s	sys 0.000s
I20260709 13:19:46.374399 14975 ts_tablet_manager.cc:1403] T b99e798b90d641cc955df72a9a6938f9 P 712448581a8b4362b83305434a66cb99: Time spent bootstrapping tablet: real 0.114s	user 0.030s	sys 0.052s
I20260709 13:19:46.375375 14974 tablet_bootstrap.cc:492] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3: Bootstrap starting.
I20260709 13:19:46.375422 14765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b99e798b90d641cc955df72a9a6938f9" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:46.376338 14765 raft_consensus.cc:3060] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.377573 14975 raft_consensus.cc:359] T b99e798b90d641cc955df72a9a6938f9 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.378356 14975 raft_consensus.cc:385] T b99e798b90d641cc955df72a9a6938f9 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.378665 14975 raft_consensus.cc:740] T b99e798b90d641cc955df72a9a6938f9 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.379365 14975 consensus_queue.cc:260] T b99e798b90d641cc955df72a9a6938f9 P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.372087 14980 leader_election.cc:290] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 election: Requested vote from peers ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:46.385805 14974 tablet_bootstrap.cc:654] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.385665 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b99e798b90d641cc955df72a9a6938f9" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:46.387208 14837 raft_consensus.cc:3060] T b99e798b90d641cc955df72a9a6938f9 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.387296 14975 ts_tablet_manager.cc:1434] T b99e798b90d641cc955df72a9a6938f9 P 712448581a8b4362b83305434a66cb99: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:19:46.388630 14995 raft_consensus.cc:493] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.389060 14976 tablet_bootstrap.cc:492] T 3b074124b1dd46e39f36bb85084c8d10 P 31f7375d88974b7a9c775ec640ca368e: No bootstrap required, opened a new log
I20260709 13:19:46.389645 14976 ts_tablet_manager.cc:1403] T 3b074124b1dd46e39f36bb85084c8d10 P 31f7375d88974b7a9c775ec640ca368e: Time spent bootstrapping tablet: real 0.108s	user 0.038s	sys 0.015s
I20260709 13:19:46.389189 14995 raft_consensus.cc:515] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.388605 14975 tablet_bootstrap.cc:492] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99: Bootstrap starting.
I20260709 13:19:46.392495 15012 raft_consensus.cc:515] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.398203 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555dfb56b5c6475da7c3298fa816df94" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:46.398149 14976 raft_consensus.cc:359] T 3b074124b1dd46e39f36bb85084c8d10 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.398780 14689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555dfb56b5c6475da7c3298fa816df94" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e" is_pre_election: true
I20260709 13:19:46.398975 14764 raft_consensus.cc:3060] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.398980 14976 raft_consensus.cc:385] T 3b074124b1dd46e39f36bb85084c8d10 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.399755 14689 raft_consensus.cc:2393] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed4f059a209b4924865bad4ae2d019b3 in current term 1: Already voted for candidate 31f7375d88974b7a9c775ec640ca368e in this term.
I20260709 13:19:46.400413 14838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555dfb56b5c6475da7c3298fa816df94" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99" is_pre_election: true
I20260709 13:19:46.400664 14976 raft_consensus.cc:740] T 3b074124b1dd46e39f36bb85084c8d10 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.401145 14838 raft_consensus.cc:2468] T 555dfb56b5c6475da7c3298fa816df94 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 0.
I20260709 13:19:46.401440 14976 consensus_queue.cc:260] T 3b074124b1dd46e39f36bb85084c8d10 P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.402776 14729 leader_election.cc:304] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 712448581a8b4362b83305434a66cb99, ed4f059a209b4924865bad4ae2d019b3; no voters: 31f7375d88974b7a9c775ec640ca368e
I20260709 13:19:46.403827 14976 ts_tablet_manager.cc:1434] T 3b074124b1dd46e39f36bb85084c8d10 P 31f7375d88974b7a9c775ec640ca368e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:19:46.399506 14995 leader_election.cc:290] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:46.410306 14975 tablet_bootstrap.cc:654] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.411769 14838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555dfb56b5c6475da7c3298fa816df94" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:46.412446 14838 raft_consensus.cc:3060] T 555dfb56b5c6475da7c3298fa816df94 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.413836 14765 raft_consensus.cc:2468] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 1.
I20260709 13:19:46.419044 14655 leader_election.cc:304] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:46.419718 14838 raft_consensus.cc:2468] T 555dfb56b5c6475da7c3298fa816df94 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 1.
I20260709 13:19:46.420260 14980 raft_consensus.cc:2804] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:46.420882 14654 leader_election.cc:304] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, 712448581a8b4362b83305434a66cb99; no voters: 
I20260709 13:19:46.421046 14980 raft_consensus.cc:697] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [term 1 LEADER]: Becoming Leader. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Running, Role: LEADER
I20260709 13:19:46.421715 14885 raft_consensus.cc:2804] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:46.422152 14980 consensus_queue.cc:237] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.415001 15012 leader_election.cc:290] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 1 election: Requested vote from peers ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:46.427824 14764 raft_consensus.cc:2468] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 1.
I20260709 13:19:46.429040 14930 raft_consensus.cc:2764] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:19:46.417900 14837 raft_consensus.cc:2468] T b99e798b90d641cc955df72a9a6938f9 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 1.
I20260709 13:19:46.436334 14885 raft_consensus.cc:697] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 1 LEADER]: Becoming Leader. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Running, Role: LEADER
I20260709 13:19:46.437536 14885 consensus_queue.cc:237] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.442387 14974 tablet_bootstrap.cc:492] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3: No bootstrap required, opened a new log
I20260709 13:19:46.442979 14974 ts_tablet_manager.cc:1403] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.014s
I20260709 13:19:46.446017 14974 raft_consensus.cc:359] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.446919 14974 raft_consensus.cc:385] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.445152 14586 catalog_manager.cc:5697] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 712448581a8b4362b83305434a66cb99 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "712448581a8b4362b83305434a66cb99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:46.447180 14974 raft_consensus.cc:740] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.447906 14974 consensus_queue.cc:260] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.449659 14974 ts_tablet_manager.cc:1434] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:19:46.450789 14974 tablet_bootstrap.cc:492] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3: Bootstrap starting.
I20260709 13:19:46.451232 14975 tablet_bootstrap.cc:492] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99: No bootstrap required, opened a new log
I20260709 13:19:46.451790 14975 ts_tablet_manager.cc:1403] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.013s
I20260709 13:19:46.456913 14974 tablet_bootstrap.cc:654] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.461925 14974 tablet_bootstrap.cc:492] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3: No bootstrap required, opened a new log
I20260709 13:19:46.462391 14974 ts_tablet_manager.cc:1403] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 13:19:46.462164 14587 catalog_manager.cc:5697] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e reported cstate change: term changed from 0 to 1, leader changed from <none> to 31f7375d88974b7a9c775ec640ca368e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "31f7375d88974b7a9c775ec640ca368e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:46.464432 14975 raft_consensus.cc:359] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.465124 14974 raft_consensus.cc:359] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.465898 14974 raft_consensus.cc:385] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.466147 14974 raft_consensus.cc:740] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.466820 14974 consensus_queue.cc:260] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.468919 14974 ts_tablet_manager.cc:1434] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:19:46.465126 14975 raft_consensus.cc:385] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.469919 14975 raft_consensus.cc:740] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.470607 14975 consensus_queue.cc:260] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.472772 14975 ts_tablet_manager.cc:1434] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:19:46.480854 14586 catalog_manager.cc:5697] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e reported cstate change: term changed from 0 to 1, leader changed from <none> to 31f7375d88974b7a9c775ec640ca368e (127.1.227.129). New cstate: current_term: 1 leader_uuid: "31f7375d88974b7a9c775ec640ca368e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:46.503225 14930 raft_consensus.cc:493] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.503861 14930 raft_consensus.cc:515] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.505725 14930 leader_election.cc:290] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:46.506899 14689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b074124b1dd46e39f36bb85084c8d10" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e" is_pre_election: true
I20260709 13:19:46.507177 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b074124b1dd46e39f36bb85084c8d10" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99" is_pre_election: true
I20260709 13:19:46.507668 14689 raft_consensus.cc:2468] T 3b074124b1dd46e39f36bb85084c8d10 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 0.
I20260709 13:19:46.507828 14837 raft_consensus.cc:2468] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 0.
I20260709 13:19:46.508910 14729 leader_election.cc:304] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:46.509567 14930 raft_consensus.cc:2804] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:46.510007 14930 raft_consensus.cc:493] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.510277 14930 raft_consensus.cc:3060] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.514394 14992 raft_consensus.cc:493] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.515019 14992 raft_consensus.cc:515] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.515471 14930 raft_consensus.cc:515] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.517168 14992 leader_election.cc:290] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:46.518007 14689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458b7b4a6834d48a65fec81a668a7fe" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e" is_pre_election: true
I20260709 13:19:46.518299 14930 leader_election.cc:290] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:46.518745 14689 raft_consensus.cc:2468] T 6458b7b4a6834d48a65fec81a668a7fe P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 0.
I20260709 13:19:46.519454 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458b7b4a6834d48a65fec81a668a7fe" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3" is_pre_election: true
I20260709 13:19:46.519740 14688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b074124b1dd46e39f36bb85084c8d10" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:46.520139 14764 raft_consensus.cc:2468] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 0.
I20260709 13:19:46.520058 14803 leader_election.cc:304] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, 712448581a8b4362b83305434a66cb99; no voters: 
I20260709 13:19:46.520447 14688 raft_consensus.cc:3060] T 3b074124b1dd46e39f36bb85084c8d10 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.521179 14992 raft_consensus.cc:2804] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:46.521550 14992 raft_consensus.cc:493] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.521906 14992 raft_consensus.cc:3060] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.522357 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b074124b1dd46e39f36bb85084c8d10" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:46.522980 14837 raft_consensus.cc:3060] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.527792 14688 raft_consensus.cc:2468] T 3b074124b1dd46e39f36bb85084c8d10 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 1.
I20260709 13:19:46.529138 14729 leader_election.cc:304] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:46.529532 14992 raft_consensus.cc:515] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.529980 14930 raft_consensus.cc:2804] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:46.530558 14930 raft_consensus.cc:697] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Becoming Leader. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Running, Role: LEADER
I20260709 13:19:46.531299 14930 consensus_queue.cc:237] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.532662 14837 raft_consensus.cc:2468] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 1.
I20260709 13:19:46.532805 14992 leader_election.cc:290] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:46.533182 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458b7b4a6834d48a65fec81a668a7fe" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:46.532708 14688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458b7b4a6834d48a65fec81a668a7fe" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:46.533864 14764 raft_consensus.cc:3060] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.534189 14688 raft_consensus.cc:3060] T 6458b7b4a6834d48a65fec81a668a7fe P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.540570 14688 raft_consensus.cc:2468] T 6458b7b4a6834d48a65fec81a668a7fe P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 1.
I20260709 13:19:46.541579 14803 leader_election.cc:304] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, 712448581a8b4362b83305434a66cb99; no voters: 
I20260709 13:19:46.542353 14992 raft_consensus.cc:2804] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:46.542287 14764 raft_consensus.cc:2468] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 1.
I20260709 13:19:46.542950 14992 raft_consensus.cc:697] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Becoming Leader. State: Replica: 712448581a8b4362b83305434a66cb99, State: Running, Role: LEADER
I20260709 13:19:46.542236 14586 catalog_manager.cc:5697] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "ed4f059a209b4924865bad4ae2d019b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:46.543850 14992 consensus_queue.cc:237] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.552274 14587 catalog_manager.cc:5697] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 712448581a8b4362b83305434a66cb99 (127.1.227.131). New cstate: current_term: 1 leader_uuid: "712448581a8b4362b83305434a66cb99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:46.553520 14930 raft_consensus.cc:493] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.554108 14930 raft_consensus.cc:515] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.555866 14930 leader_election.cc:290] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:46.556802 14688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cd096fb1b44314998a5ca9c10d8b92" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e" is_pre_election: true
I20260709 13:19:46.557019 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cd096fb1b44314998a5ca9c10d8b92" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99" is_pre_election: true
I20260709 13:19:46.557782 14688 raft_consensus.cc:2468] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 0.
I20260709 13:19:46.557852 14837 raft_consensus.cc:2468] T 94cd096fb1b44314998a5ca9c10d8b92 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 0.
I20260709 13:19:46.559116 14729 leader_election.cc:304] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 712448581a8b4362b83305434a66cb99, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:46.560274 14930 raft_consensus.cc:2804] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:46.560659 14930 raft_consensus.cc:493] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.561024 14930 raft_consensus.cc:3060] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.565251 14995 consensus_queue.cc:1048] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:46.567981 14930 raft_consensus.cc:515] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.570284 14930 leader_election.cc:290] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:46.571127 14688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cd096fb1b44314998a5ca9c10d8b92" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:46.571466 14838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cd096fb1b44314998a5ca9c10d8b92" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:46.572016 14838 raft_consensus.cc:3060] T 94cd096fb1b44314998a5ca9c10d8b92 P 712448581a8b4362b83305434a66cb99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.571811 14688 raft_consensus.cc:3060] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.581517 14838 raft_consensus.cc:2468] T 94cd096fb1b44314998a5ca9c10d8b92 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 1.
I20260709 13:19:46.582437 14688 raft_consensus.cc:2468] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 1.
I20260709 13:19:46.582860 14729 leader_election.cc:304] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 712448581a8b4362b83305434a66cb99, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:46.582872 14998 consensus_queue.cc:1048] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:46.584542 14930 raft_consensus.cc:2804] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:46.585067 14930 raft_consensus.cc:697] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Becoming Leader. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Running, Role: LEADER
I20260709 13:19:46.585985 14930 consensus_queue.cc:237] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.601140 14587 catalog_manager.cc:5697] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130). New cstate: current_term: 1 leader_uuid: "ed4f059a209b4924865bad4ae2d019b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:46.665692 14764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "405cddebb82545cd91123089b4e65aba"
dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
mode: GRACEFUL
new_leader_uuid: "31f7375d88974b7a9c775ec640ca368e"
 from {username='slave'} at 127.0.0.1:33584
I20260709 13:19:46.666242 14764 raft_consensus.cc:606] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Received request to transfer leadership to TS 31f7375d88974b7a9c775ec640ca368e
I20260709 13:19:46.671756 14837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16bf6bbe8d044b08b8be9a53b89b20f3"
dest_uuid: "712448581a8b4362b83305434a66cb99"
mode: GRACEFUL
new_leader_uuid: "31f7375d88974b7a9c775ec640ca368e"
 from {username='slave'} at 127.0.0.1:50772
I20260709 13:19:46.672574 14837 raft_consensus.cc:606] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Received request to transfer leadership to TS 31f7375d88974b7a9c775ec640ca368e
I20260709 13:19:46.678284 14837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67e28ee13ebc4ea78b56e302d4a8e13f"
dest_uuid: "712448581a8b4362b83305434a66cb99"
mode: GRACEFUL
new_leader_uuid: "31f7375d88974b7a9c775ec640ca368e"
 from {username='slave'} at 127.0.0.1:50772
I20260709 13:19:46.679001 14837 raft_consensus.cc:606] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Received request to transfer leadership to TS 31f7375d88974b7a9c775ec640ca368e
I20260709 13:19:46.684458 14764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cff4e84064674eea87324bb89f7e6e60"
dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
mode: GRACEFUL
new_leader_uuid: "31f7375d88974b7a9c775ec640ca368e"
 from {username='slave'} at 127.0.0.1:33584
I20260709 13:19:46.685016 14764 raft_consensus.cc:606] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Received request to transfer leadership to TS 31f7375d88974b7a9c775ec640ca368e
I20260709 13:19:46.702638 14992 consensus_queue.cc:1048] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:46.702708 14688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "555dfb56b5c6475da7c3298fa816df94"
dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
mode: GRACEFUL
new_leader_uuid: "ed4f059a209b4924865bad4ae2d019b3"
 from {username='slave'} at 127.0.0.1:56334
I20260709 13:19:46.703519 14688 raft_consensus.cc:606] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 1 LEADER]: Received request to transfer leadership to TS ed4f059a209b4924865bad4ae2d019b3
I20260709 13:19:46.710215 14838 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6458b7b4a6834d48a65fec81a668a7fe"
dest_uuid: "712448581a8b4362b83305434a66cb99"
mode: GRACEFUL
new_leader_uuid: "ed4f059a209b4924865bad4ae2d019b3"
 from {username='slave'} at 127.0.0.1:50772
I20260709 13:19:46.711014 14838 raft_consensus.cc:606] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Received request to transfer leadership to TS ed4f059a209b4924865bad4ae2d019b3
I20260709 13:19:46.715606 14963 consensus_queue.cc:1048] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:46.722875 14688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b99e798b90d641cc955df72a9a6938f9"
dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
mode: GRACEFUL
new_leader_uuid: "ed4f059a209b4924865bad4ae2d019b3"
 from {username='slave'} at 127.0.0.1:56334
I20260709 13:19:46.723502 14688 raft_consensus.cc:606] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [term 1 LEADER]: Received request to transfer leadership to TS ed4f059a209b4924865bad4ae2d019b3
I20260709 13:19:46.727008 14994 raft_consensus.cc:993] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99: : Instructing follower 31f7375d88974b7a9c775ec640ca368e to start an election
I20260709 13:19:46.727505 14963 raft_consensus.cc:1081] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Signalling peer 31f7375d88974b7a9c775ec640ca368e to start an election
I20260709 13:19:46.729390 14689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67e28ee13ebc4ea78b56e302d4a8e13f"
dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
 from {username='slave'} at 127.0.0.1:50504
I20260709 13:19:46.730151 14689 raft_consensus.cc:493] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:46.731863 14764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b074124b1dd46e39f36bb85084c8d10"
dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
mode: GRACEFUL
new_leader_uuid: "712448581a8b4362b83305434a66cb99"
 from {username='slave'} at 127.0.0.1:33584
I20260709 13:19:46.732611 14764 raft_consensus.cc:606] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Received request to transfer leadership to TS 712448581a8b4362b83305434a66cb99
I20260709 13:19:46.731941 14689 raft_consensus.cc:3060] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:46.734791 14930 consensus_queue.cc:1048] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:46.739810 14689 raft_consensus.cc:515] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.742393 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e28ee13ebc4ea78b56e302d4a8e13f" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:46.742981 14764 raft_consensus.cc:3060] T 67e28ee13ebc4ea78b56e302d4a8e13f P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:46.743481 14930 raft_consensus.cc:993] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3: : Instructing follower 31f7375d88974b7a9c775ec640ca368e to start an election
I20260709 13:19:46.744031 14930 raft_consensus.cc:1081] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Signalling peer 31f7375d88974b7a9c775ec640ca368e to start an election
I20260709 13:19:46.744869 14930 consensus_queue.cc:1048] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:46.749491 14963 consensus_queue.cc:1048] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:46.751538 14688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "405cddebb82545cd91123089b4e65aba"
dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
 from {username='slave'} at 127.0.0.1:50506
I20260709 13:19:46.752272 14688 raft_consensus.cc:493] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:46.752700 14688 raft_consensus.cc:3060] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:46.754173 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e28ee13ebc4ea78b56e302d4a8e13f" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:46.754863 14837 raft_consensus.cc:3055] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:46.755228 14837 raft_consensus.cc:740] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Running, Role: LEADER
I20260709 13:19:46.756261 14837 consensus_queue.cc:260] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.758859 14837 raft_consensus.cc:3060] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:46.761180 14764 raft_consensus.cc:2468] T 67e28ee13ebc4ea78b56e302d4a8e13f P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 2.
I20260709 13:19:46.762352 14689 leader_election.cc:290] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 2 election: Requested vote from peers ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:46.762246 14688 raft_consensus.cc:515] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.762892 14655 leader_election.cc:304] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:46.764257 14885 raft_consensus.cc:2804] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:46.764789 14885 raft_consensus.cc:697] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e [term 2 LEADER]: Becoming Leader. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Running, Role: LEADER
I20260709 13:19:46.765609 14885 consensus_queue.cc:237] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.771059 14688 leader_election.cc:290] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 2 election: Requested vote from peers ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:46.772650 14838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405cddebb82545cd91123089b4e65aba" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:46.774149 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405cddebb82545cd91123089b4e65aba" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:46.773339 14838 raft_consensus.cc:3060] T 405cddebb82545cd91123089b4e65aba P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:46.774819 14764 raft_consensus.cc:3055] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:46.775173 14764 raft_consensus.cc:740] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Running, Role: LEADER
I20260709 13:19:46.775974 14764 consensus_queue.cc:260] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.777294 14764 raft_consensus.cc:3060] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:46.782821 14838 raft_consensus.cc:2468] T 405cddebb82545cd91123089b4e65aba P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 2.
I20260709 13:19:46.786067 14585 catalog_manager.cc:5697] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e reported cstate change: term changed from 1 to 2, leader changed from 712448581a8b4362b83305434a66cb99 (127.1.227.131) to 31f7375d88974b7a9c775ec640ca368e (127.1.227.129). New cstate: current_term: 2 leader_uuid: "31f7375d88974b7a9c775ec640ca368e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:46.787997 14654 leader_election.cc:304] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, 712448581a8b4362b83305434a66cb99; no voters: 
I20260709 13:19:46.788961 14980 raft_consensus.cc:2804] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:46.789489 14980 raft_consensus.cc:697] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e [term 2 LEADER]: Becoming Leader. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Running, Role: LEADER
I20260709 13:19:46.789517 14764 raft_consensus.cc:2468] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 2.
I20260709 13:19:46.790464 14980 consensus_queue.cc:237] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.785836 14837 raft_consensus.cc:2468] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 2.
I20260709 13:19:46.803951 14963 consensus_queue.cc:1048] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:46.818164 14585 catalog_manager.cc:5697] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e reported cstate change: term changed from 1 to 2, leader changed from ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130) to 31f7375d88974b7a9c775ec640ca368e (127.1.227.129). New cstate: current_term: 2 leader_uuid: "31f7375d88974b7a9c775ec640ca368e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:46.820751 14963 raft_consensus.cc:993] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99: : Instructing follower 31f7375d88974b7a9c775ec640ca368e to start an election
I20260709 13:19:46.821270 14963 raft_consensus.cc:1081] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Signalling peer 31f7375d88974b7a9c775ec640ca368e to start an election
I20260709 13:19:46.823101 14688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16bf6bbe8d044b08b8be9a53b89b20f3"
dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
 from {username='slave'} at 127.0.0.1:50504
I20260709 13:19:46.823625 14688 raft_consensus.cc:493] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:46.823948 14688 raft_consensus.cc:3060] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:46.829572 14688 raft_consensus.cc:515] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.831386 14688 leader_election.cc:290] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 2 election: Requested vote from peers ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:46.832091 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bf6bbe8d044b08b8be9a53b89b20f3" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:46.832749 14764 raft_consensus.cc:3060] T 16bf6bbe8d044b08b8be9a53b89b20f3 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:46.832837 14838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bf6bbe8d044b08b8be9a53b89b20f3" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:46.833500 14838 raft_consensus.cc:3055] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:46.833874 14838 raft_consensus.cc:740] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Running, Role: LEADER
I20260709 13:19:46.834669 14838 consensus_queue.cc:260] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.835880 14838 raft_consensus.cc:3060] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:46.838820 14764 raft_consensus.cc:2468] T 16bf6bbe8d044b08b8be9a53b89b20f3 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 2.
I20260709 13:19:46.839916 14655 leader_election.cc:304] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:46.840638 14885 raft_consensus.cc:2804] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:46.841048 14885 raft_consensus.cc:697] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e [term 2 LEADER]: Becoming Leader. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Running, Role: LEADER
I20260709 13:19:46.841796 14838 raft_consensus.cc:2468] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 2.
I20260709 13:19:46.841822 14885 consensus_queue.cc:237] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.848914 14585 catalog_manager.cc:5697] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e reported cstate change: term changed from 1 to 2, leader changed from 712448581a8b4362b83305434a66cb99 (127.1.227.131) to 31f7375d88974b7a9c775ec640ca368e (127.1.227.129). New cstate: current_term: 2 leader_uuid: "31f7375d88974b7a9c775ec640ca368e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:46.849325 14885 consensus_queue.cc:1048] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:46.857435 14980 raft_consensus.cc:993] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e: : Instructing follower ed4f059a209b4924865bad4ae2d019b3 to start an election
I20260709 13:19:46.857982 14980 raft_consensus.cc:1081] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 1 LEADER]: Signalling peer ed4f059a209b4924865bad4ae2d019b3 to start an election
I20260709 13:19:46.863595 14764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "555dfb56b5c6475da7c3298fa816df94"
dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
 from {username='slave'} at 127.0.0.1:35214
I20260709 13:19:46.864236 14764 raft_consensus.cc:493] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:46.864653 14764 raft_consensus.cc:3060] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:46.867947 15016 consensus_queue.cc:1048] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:46.873196 14764 raft_consensus.cc:515] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.877704 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555dfb56b5c6475da7c3298fa816df94" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:46.880206 14688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "555dfb56b5c6475da7c3298fa816df94" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:46.880985 14688 raft_consensus.cc:3055] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:46.881299 14688 raft_consensus.cc:740] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Running, Role: LEADER
I20260709 13:19:46.882149 14688 consensus_queue.cc:260] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.883143 14688 raft_consensus.cc:3060] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:46.885658 14764 leader_election.cc:290] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 2 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:46.891500 14688 raft_consensus.cc:2468] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 2.
I20260709 13:19:46.892813 14729 leader_election.cc:304] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 712448581a8b4362b83305434a66cb99
I20260709 13:19:46.893702 14930 raft_consensus.cc:2804] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:46.894256 14930 raft_consensus.cc:697] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [term 2 LEADER]: Becoming Leader. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Running, Role: LEADER
I20260709 13:19:46.895085 14930 consensus_queue.cc:237] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.901849 14585 catalog_manager.cc:5697] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 reported cstate change: term changed from 1 to 2, leader changed from 31f7375d88974b7a9c775ec640ca368e (127.1.227.129) to ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130). New cstate: current_term: 2 leader_uuid: "ed4f059a209b4924865bad4ae2d019b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:46.917999 14930 consensus_queue.cc:1048] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:46.918215 15016 consensus_queue.cc:1048] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:46.928062 14998 raft_consensus.cc:993] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3: : Instructing follower 712448581a8b4362b83305434a66cb99 to start an election
I20260709 13:19:46.928581 14998 raft_consensus.cc:1081] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Signalling peer 712448581a8b4362b83305434a66cb99 to start an election
I20260709 13:19:46.933658 14837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b074124b1dd46e39f36bb85084c8d10"
dest_uuid: "712448581a8b4362b83305434a66cb99"
 from {username='slave'} at 127.0.0.1:50764
I20260709 13:19:46.934253 14837 raft_consensus.cc:493] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:46.934659 14837 raft_consensus.cc:3060] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:46.936337 14930 consensus_queue.cc:1048] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:46.939178 14980 raft_consensus.cc:993] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e: : Instructing follower ed4f059a209b4924865bad4ae2d019b3 to start an election
I20260709 13:19:46.939680 14980 raft_consensus.cc:1081] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [term 1 LEADER]: Signalling peer ed4f059a209b4924865bad4ae2d019b3 to start an election
I20260709 13:19:46.942555 14763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b99e798b90d641cc955df72a9a6938f9"
dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
 from {username='slave'} at 127.0.0.1:35214
I20260709 13:19:46.942744 14963 consensus_queue.cc:1048] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:46.943233 14763 raft_consensus.cc:493] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:46.943686 14763 raft_consensus.cc:3060] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:46.945262 14837 raft_consensus.cc:515] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.948235 14689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b074124b1dd46e39f36bb85084c8d10" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:46.948819 14689 raft_consensus.cc:3060] T 3b074124b1dd46e39f36bb85084c8d10 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:46.948808 15016 consensus_queue.cc:1048] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:46.958724 14837 leader_election.cc:290] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 2 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:46.959048 14992 raft_consensus.cc:993] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99: : Instructing follower ed4f059a209b4924865bad4ae2d019b3 to start an election
I20260709 13:19:46.959568 14992 raft_consensus.cc:1081] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Signalling peer ed4f059a209b4924865bad4ae2d019b3 to start an election
I20260709 13:19:46.960080 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b074124b1dd46e39f36bb85084c8d10" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:46.962147 14762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6458b7b4a6834d48a65fec81a668a7fe"
dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
 from {username='slave'} at 127.0.0.1:35230
I20260709 13:19:46.963128 14762 raft_consensus.cc:493] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:46.963552 14762 raft_consensus.cc:3060] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:46.964989 14689 raft_consensus.cc:2468] T 3b074124b1dd46e39f36bb85084c8d10 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 2.
I20260709 13:19:46.966224 14803 leader_election.cc:304] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, 712448581a8b4362b83305434a66cb99; no voters: 
I20260709 13:19:46.972731 14688 raft_consensus.cc:1240] T 3b074124b1dd46e39f36bb85084c8d10 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Rejecting Update request from peer ed4f059a209b4924865bad4ae2d019b3 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:19:46.975795 14992 raft_consensus.cc:2804] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:46.976589 14992 raft_consensus.cc:697] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 [term 2 LEADER]: Becoming Leader. State: Replica: 712448581a8b4362b83305434a66cb99, State: Running, Role: LEADER
I20260709 13:19:46.960777 14764 raft_consensus.cc:3055] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:46.978137 14764 raft_consensus.cc:740] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Running, Role: LEADER
I20260709 13:19:46.978708 15045 consensus_queue.cc:1048] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:46.979460 14764 consensus_queue.cc:260] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.958331 14763 raft_consensus.cc:515] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.985778 14765 raft_consensus.cc:1240] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Rejecting Update request from peer 31f7375d88974b7a9c775ec640ca368e for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:46.986125 14992 consensus_queue.cc:237] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.993476 15016 consensus_queue.cc:1059] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:46.995148 15016 raft_consensus.cc:3055] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:46.995669 15016 raft_consensus.cc:740] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Running, Role: LEADER
I20260709 13:19:46.996892 15016 consensus_queue.cc:260] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:46.999156 15016 raft_consensus.cc:3060] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:47.007515 14763 leader_election.cc:290] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 2 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:46.981348 14764 raft_consensus.cc:3060] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:47.011130 14688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b99e798b90d641cc955df72a9a6938f9" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:47.014184 14838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b99e798b90d641cc955df72a9a6938f9" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:47.014822 14838 raft_consensus.cc:3060] T b99e798b90d641cc955df72a9a6938f9 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:47.016084 14764 raft_consensus.cc:2468] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 2.
I20260709 13:19:47.017342 14762 raft_consensus.cc:515] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:47.013402 14585 catalog_manager.cc:5697] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 reported cstate change: term changed from 1 to 2, leader changed from ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130) to 712448581a8b4362b83305434a66cb99 (127.1.227.131). New cstate: current_term: 2 leader_uuid: "712448581a8b4362b83305434a66cb99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:47.018633 14761 raft_consensus.cc:1240] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Rejecting Update request from peer 712448581a8b4362b83305434a66cb99 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:47.019738 14762 leader_election.cc:290] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 2 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:47.021544 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458b7b4a6834d48a65fec81a668a7fe" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:47.022157 14837 raft_consensus.cc:3055] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:47.022404 14837 raft_consensus.cc:740] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 712448581a8b4362b83305434a66cb99, State: Running, Role: LEADER
I20260709 13:19:47.023211 14837 consensus_queue.cc:260] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:47.024626 14837 raft_consensus.cc:3060] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:47.030803 14689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458b7b4a6834d48a65fec81a668a7fe" candidate_uuid: "ed4f059a209b4924865bad4ae2d019b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:47.031445 14689 raft_consensus.cc:3060] T 6458b7b4a6834d48a65fec81a668a7fe P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:47.034497 14838 raft_consensus.cc:2468] T b99e798b90d641cc955df72a9a6938f9 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 2.
I20260709 13:19:47.035867 14729 leader_election.cc:304] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 712448581a8b4362b83305434a66cb99, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:47.036778 14998 raft_consensus.cc:2804] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:47.037343 14998 raft_consensus.cc:697] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 [term 2 LEADER]: Becoming Leader. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Running, Role: LEADER
I20260709 13:19:47.038352 14998 consensus_queue.cc:237] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:47.039487 14689 raft_consensus.cc:2468] T 6458b7b4a6834d48a65fec81a668a7fe P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 2.
I20260709 13:19:47.043179 14729 leader_election.cc:304] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:47.043946 14998 raft_consensus.cc:2804] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:47.044621 14998 raft_consensus.cc:697] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 [term 2 LEADER]: Becoming Leader. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Running, Role: LEADER
I20260709 13:19:47.046018 14998 consensus_queue.cc:237] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:47.047863 14837 raft_consensus.cc:2468] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 2.
I20260709 13:19:47.045972 14688 raft_consensus.cc:2468] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4f059a209b4924865bad4ae2d019b3 in term 2.
I20260709 13:19:47.047940 14586 catalog_manager.cc:5697] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 reported cstate change: term changed from 1 to 2, leader changed from 31f7375d88974b7a9c775ec640ca368e (127.1.227.129) to ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130). New cstate: current_term: 2 leader_uuid: "ed4f059a209b4924865bad4ae2d019b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.062815 14586 catalog_manager.cc:5697] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 reported cstate change: term changed from 1 to 2, leader changed from 712448581a8b4362b83305434a66cb99 (127.1.227.131) to ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130). New cstate: current_term: 2 leader_uuid: "ed4f059a209b4924865bad4ae2d019b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.065980 14930 raft_consensus.cc:993] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3: : Instructing follower 31f7375d88974b7a9c775ec640ca368e to start an election
I20260709 13:19:47.066604 14998 raft_consensus.cc:1081] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Signalling peer 31f7375d88974b7a9c775ec640ca368e to start an election
I20260709 13:19:47.068522 14688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cff4e84064674eea87324bb89f7e6e60"
dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
 from {username='slave'} at 127.0.0.1:50506
I20260709 13:19:47.069024 14688 raft_consensus.cc:493] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:47.069361 14688 raft_consensus.cc:3060] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:47.074661 14998 consensus_queue.cc:1048] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:47.080338 14688 raft_consensus.cc:515] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:47.082448 14688 leader_election.cc:290] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 2 election: Requested vote from peers ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115), 712448581a8b4362b83305434a66cb99 (127.1.227.131:42327)
I20260709 13:19:47.083441 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4e84064674eea87324bb89f7e6e60" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "712448581a8b4362b83305434a66cb99"
I20260709 13:19:47.085202 14837 raft_consensus.cc:3060] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:47.083901 14761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff4e84064674eea87324bb89f7e6e60" candidate_uuid: "31f7375d88974b7a9c775ec640ca368e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:47.086730 14761 raft_consensus.cc:3055] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:47.087098 14761 raft_consensus.cc:740] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Running, Role: LEADER
I20260709 13:19:47.087916 14761 consensus_queue.cc:260] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:47.089099 14761 raft_consensus.cc:3060] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:47.092314 14998 consensus_queue.cc:1048] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:47.093840 14837 raft_consensus.cc:2468] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 2.
I20260709 13:19:47.095278 14654 leader_election.cc:304] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, 712448581a8b4362b83305434a66cb99; no voters: 
I20260709 13:19:47.096199 15016 raft_consensus.cc:2804] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:47.096688 15016 raft_consensus.cc:697] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e [term 2 LEADER]: Becoming Leader. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Running, Role: LEADER
I20260709 13:19:47.097560 15016 consensus_queue.cc:237] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:47.103359 14761 raft_consensus.cc:2468] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f7375d88974b7a9c775ec640ca368e in term 2.
I20260709 13:19:47.107169 14586 catalog_manager.cc:5697] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e reported cstate change: term changed from 1 to 2, leader changed from ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130) to 31f7375d88974b7a9c775ec640ca368e (127.1.227.129). New cstate: current_term: 2 leader_uuid: "31f7375d88974b7a9c775ec640ca368e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.202236 14838 raft_consensus.cc:1275] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Refusing update from remote peer 31f7375d88974b7a9c775ec640ca368e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:47.203689 15016 consensus_queue.cc:1048] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:47.211578 14761 raft_consensus.cc:1275] T 67e28ee13ebc4ea78b56e302d4a8e13f P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Refusing update from remote peer 31f7375d88974b7a9c775ec640ca368e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:47.213110 15016 consensus_queue.cc:1048] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:47.325150 14689 raft_consensus.cc:1275] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Refusing update from remote peer ed4f059a209b4924865bad4ae2d019b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:47.326784 14998 consensus_queue.cc:1048] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:47.335083 14838 raft_consensus.cc:3060] T 555dfb56b5c6475da7c3298fa816df94 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:47.342875 14838 raft_consensus.cc:1275] T 555dfb56b5c6475da7c3298fa816df94 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Refusing update from remote peer ed4f059a209b4924865bad4ae2d019b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:47.344394 14995 consensus_queue.cc:1048] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:47.346125 14764 raft_consensus.cc:1275] T 16bf6bbe8d044b08b8be9a53b89b20f3 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Refusing update from remote peer 31f7375d88974b7a9c775ec640ca368e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:47.347826 15016 consensus_queue.cc:1048] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:47.356168 14838 raft_consensus.cc:1275] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Refusing update from remote peer 31f7375d88974b7a9c775ec640ca368e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:47.356298 14764 raft_consensus.cc:1275] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Refusing update from remote peer 31f7375d88974b7a9c775ec640ca368e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:47.357900 14885 consensus_queue.cc:1048] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:47.358385 15012 consensus_queue.cc:1048] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:47.378652 14838 raft_consensus.cc:1275] T 405cddebb82545cd91123089b4e65aba P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Refusing update from remote peer 31f7375d88974b7a9c775ec640ca368e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:47.380478 15012 consensus_queue.cc:1048] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:47.399101 14689 raft_consensus.cc:1275] T 3b074124b1dd46e39f36bb85084c8d10 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Refusing update from remote peer 712448581a8b4362b83305434a66cb99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:47.400429 14994 consensus_queue.cc:1048] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:47.410888 14764 raft_consensus.cc:1275] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Refusing update from remote peer 712448581a8b4362b83305434a66cb99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:47.412993 14992 consensus_queue.cc:1048] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:47.514014 14689 raft_consensus.cc:1275] T 6458b7b4a6834d48a65fec81a668a7fe P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Refusing update from remote peer ed4f059a209b4924865bad4ae2d019b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:47.515671 14995 consensus_queue.cc:1048] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:47.524425 14838 raft_consensus.cc:1275] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Refusing update from remote peer ed4f059a209b4924865bad4ae2d019b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:47.526283 14930 consensus_queue.cc:1048] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:47.588299 14838 raft_consensus.cc:1275] T b99e798b90d641cc955df72a9a6938f9 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Refusing update from remote peer ed4f059a209b4924865bad4ae2d019b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:47.589589 14930 consensus_queue.cc:1048] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:47.598266 14689 raft_consensus.cc:1275] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Refusing update from remote peer ed4f059a209b4924865bad4ae2d019b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:47.601274 14930 consensus_queue.cc:1048] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:47.652364 14764 raft_consensus.cc:1275] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Refusing update from remote peer 31f7375d88974b7a9c775ec640ca368e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:47.654017 15012 consensus_queue.cc:1048] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:47.665421 14838 raft_consensus.cc:1275] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Refusing update from remote peer 31f7375d88974b7a9c775ec640ca368e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:47.666668 15016 consensus_queue.cc:1048] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e [LEADER]: Connected to new peer: Peer: permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:49.738442 14587 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45726:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:19:49.776459 14587 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45726:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:19:49.900380  1934 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:49.909560 15069 log.cc:927] Time spent T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:19:50.081530 14803 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:45945, user_credentials={real_user=slave}} blocked reactor thread for 74899.8us
W20260709 13:19:50.149030 15086 log.cc:927] Time spent T 405cddebb82545cd91123089b4e65aba P 712448581a8b4362b83305434a66cb99: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:19:50.190681 15095 tablet.cc:1724] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.191685 15097 tablet.cc:1724] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.192710 15109 tablet.cc:1724] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:50.198812 14729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.227.129:45945, user_credentials={real_user=slave}} blocked reactor thread for 43996.8us
I20260709 13:19:50.228663 15118 tablet.cc:1724] T 405cddebb82545cd91123089b4e65aba P 712448581a8b4362b83305434a66cb99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.275570 15120 tablet.cc:1724] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.290197 15115 tablet.cc:1724] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.334079 15117 tablet.cc:1724] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.290112 15114 tablet.cc:1724] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.342018 15118 tablet.cc:1724] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.370592 15124 tablet.cc:1724] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.377242 15095 tablet.cc:1724] T 16bf6bbe8d044b08b8be9a53b89b20f3 P ed4f059a209b4924865bad4ae2d019b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.410532 15129 tablet.cc:1724] T 67e28ee13ebc4ea78b56e302d4a8e13f P ed4f059a209b4924865bad4ae2d019b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.419871 15117 tablet.cc:1724] T 555dfb56b5c6475da7c3298fa816df94 P 712448581a8b4362b83305434a66cb99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.437295 15095 tablet.cc:1724] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.437876 15123 tablet.cc:1724] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.428959 15122 tablet.cc:1724] T 94cd096fb1b44314998a5ca9c10d8b92 P 712448581a8b4362b83305434a66cb99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.447885 15118 tablet.cc:1724] T b99e798b90d641cc955df72a9a6938f9 P 712448581a8b4362b83305434a66cb99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.454231 14762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "728b17d23bff40d99b022d71c68dc2b0"
dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
mode: GRACEFUL
new_leader_uuid: "712448581a8b4362b83305434a66cb99"
 from {username='slave'} at 127.0.0.1:33596
I20260709 13:19:50.455152 14762 raft_consensus.cc:606] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Received request to transfer leadership to TS 712448581a8b4362b83305434a66cb99
I20260709 13:19:50.469400 15123 tablet.cc:1724] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.470167 15097 tablet.cc:1724] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.476825 15124 tablet.cc:1724] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.466704 15109 tablet.cc:1724] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.481487 15115 tablet.cc:1724] T 3b074124b1dd46e39f36bb85084c8d10 P 31f7375d88974b7a9c775ec640ca368e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.428231 15120 tablet.cc:1724] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.500419 15122 tablet.cc:1724] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.507437 15114 tablet.cc:1724] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.513578 15095 tablet.cc:1724] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.531112 14688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "918c48b8a8eb447c9d860cf67355b424"
dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
mode: GRACEFUL
new_leader_uuid: "712448581a8b4362b83305434a66cb99"
 from {username='slave'} at 127.0.0.1:56336
I20260709 13:19:50.531852 14688 raft_consensus.cc:606] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 2 LEADER]: Received request to transfer leadership to TS 712448581a8b4362b83305434a66cb99
I20260709 13:19:50.533620  1934 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:19:50.534407  1934 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:50.537854 15115 tablet.cc:1724] T 6458b7b4a6834d48a65fec81a668a7fe P 31f7375d88974b7a9c775ec640ca368e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:50.565191 14587 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5: soft_deleted_table [id=53321d219a9f4878a0894a9ced198b00] alter complete (version 1)
I20260709 13:19:50.735386 15112 raft_consensus.cc:993] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e: : Instructing follower 712448581a8b4362b83305434a66cb99 to start an election
I20260709 13:19:50.736057 15090 raft_consensus.cc:1081] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 2 LEADER]: Signalling peer 712448581a8b4362b83305434a66cb99 to start an election
I20260709 13:19:50.737849 14838 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "918c48b8a8eb447c9d860cf67355b424"
dest_uuid: "712448581a8b4362b83305434a66cb99"
 from {username='slave'} at 127.0.0.1:50760
I20260709 13:19:50.738394 14838 raft_consensus.cc:493] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:50.738713 14838 raft_consensus.cc:3060] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:50.744784 14838 raft_consensus.cc:515] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:50.746882 14838 leader_election.cc:290] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 3 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:50.748119 14688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918c48b8a8eb447c9d860cf67355b424" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:50.748315 14762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918c48b8a8eb447c9d860cf67355b424" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:50.749305 14688 raft_consensus.cc:3055] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:50.749862 14688 raft_consensus.cc:740] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31f7375d88974b7a9c775ec640ca368e, State: Running, Role: LEADER
I20260709 13:19:50.750006 14762 raft_consensus.cc:3060] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:50.751123 14688 consensus_queue.cc:260] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:50.752570 14688 raft_consensus.cc:3060] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:50.757236 14762 raft_consensus.cc:2468] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 3.
I20260709 13:19:50.758778 14804 leader_election.cc:304] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 712448581a8b4362b83305434a66cb99, ed4f059a209b4924865bad4ae2d019b3; no voters: 
I20260709 13:19:50.759060 14688 raft_consensus.cc:2468] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 3.
I20260709 13:19:50.760077 14992 raft_consensus.cc:2804] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:50.760687 14992 raft_consensus.cc:697] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 3 LEADER]: Becoming Leader. State: Replica: 712448581a8b4362b83305434a66cb99, State: Running, Role: LEADER
I20260709 13:19:50.761689 14992 consensus_queue.cc:237] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:50.771275 14586 catalog_manager.cc:5697] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 reported cstate change: term changed from 2 to 3, leader changed from 31f7375d88974b7a9c775ec640ca368e (127.1.227.129) to 712448581a8b4362b83305434a66cb99 (127.1.227.131). New cstate: current_term: 3 leader_uuid: "712448581a8b4362b83305434a66cb99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:50.972203 15136 raft_consensus.cc:993] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3: : Instructing follower 712448581a8b4362b83305434a66cb99 to start an election
I20260709 13:19:50.972848 15113 raft_consensus.cc:1081] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Signalling peer 712448581a8b4362b83305434a66cb99 to start an election
I20260709 13:19:50.975090 14837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "728b17d23bff40d99b022d71c68dc2b0"
dest_uuid: "712448581a8b4362b83305434a66cb99"
 from {username='slave'} at 127.0.0.1:50764
I20260709 13:19:50.975664 14837 raft_consensus.cc:493] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:50.976017 14837 raft_consensus.cc:3060] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:50.981299 14837 raft_consensus.cc:515] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:50.982801 14837 leader_election.cc:290] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 2 election: Requested vote from peers 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945), ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115)
I20260709 13:19:50.983882 14688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728b17d23bff40d99b022d71c68dc2b0" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31f7375d88974b7a9c775ec640ca368e"
I20260709 13:19:50.984028 14762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728b17d23bff40d99b022d71c68dc2b0" candidate_uuid: "712448581a8b4362b83305434a66cb99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed4f059a209b4924865bad4ae2d019b3"
I20260709 13:19:50.984510 14688 raft_consensus.cc:3060] T 728b17d23bff40d99b022d71c68dc2b0 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:50.984668 14762 raft_consensus.cc:3055] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:50.985059 14762 raft_consensus.cc:740] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed4f059a209b4924865bad4ae2d019b3, State: Running, Role: LEADER
I20260709 13:19:50.985795 14762 consensus_queue.cc:260] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:50.987066 14762 raft_consensus.cc:3060] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:50.989862 14688 raft_consensus.cc:2468] T 728b17d23bff40d99b022d71c68dc2b0 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 2.
I20260709 13:19:50.991248 14803 leader_election.cc:304] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f7375d88974b7a9c775ec640ca368e, 712448581a8b4362b83305434a66cb99; no voters: 
I20260709 13:19:50.992118 14992 raft_consensus.cc:2804] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:50.992636 14992 raft_consensus.cc:697] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 [term 2 LEADER]: Becoming Leader. State: Replica: 712448581a8b4362b83305434a66cb99, State: Running, Role: LEADER
I20260709 13:19:50.993398 14762 raft_consensus.cc:2468] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712448581a8b4362b83305434a66cb99 in term 2.
I20260709 13:19:50.993597 14992 consensus_queue.cc:237] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } }
I20260709 13:19:51.001763 14586 catalog_manager.cc:5697] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 reported cstate change: term changed from 1 to 2, leader changed from ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130) to 712448581a8b4362b83305434a66cb99 (127.1.227.131). New cstate: current_term: 2 leader_uuid: "712448581a8b4362b83305434a66cb99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712448581a8b4362b83305434a66cb99" member_type: VOTER last_known_addr { host: "127.1.227.131" port: 42327 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:51.280206 14688 raft_consensus.cc:1275] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 3 FOLLOWER]: Refusing update from remote peer 712448581a8b4362b83305434a66cb99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:51.281442 14992 consensus_queue.cc:1048] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:51.293897 14762 raft_consensus.cc:1275] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [term 3 FOLLOWER]: Refusing update from remote peer 712448581a8b4362b83305434a66cb99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:51.295274 15087 consensus_queue.cc:1048] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:51.464969 14690 raft_consensus.cc:1275] T 728b17d23bff40d99b022d71c68dc2b0 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Refusing update from remote peer 712448581a8b4362b83305434a66cb99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:51.466378 15140 consensus_queue.cc:1048] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f7375d88974b7a9c775ec640ca368e" member_type: VOTER last_known_addr { host: "127.1.227.129" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:51.477854 14762 raft_consensus.cc:1275] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Refusing update from remote peer 712448581a8b4362b83305434a66cb99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:51.479614 14992 consensus_queue.cc:1048] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4f059a209b4924865bad4ae2d019b3" member_type: VOTER last_known_addr { host: "127.1.227.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:51.594538  1934 tablet_server.cc:179] TabletServer@127.1.227.129:0 shutting down...
W20260709 13:19:51.610998 14729 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
W20260709 13:19:51.616185 14729 consensus_peers.cc:597] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 -> Peer 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945): Couldn't send request to peer 31f7375d88974b7a9c775ec640ca368e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:51.632668  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:51.633550  1934 tablet_replica.cc:333] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e: stopping tablet replica
I20260709 13:19:51.634366  1934 raft_consensus.cc:2243] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.634902  1934 raft_consensus.cc:2272] T 94cd096fb1b44314998a5ca9c10d8b92 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.637101  1934 tablet_replica.cc:333] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e: stopping tablet replica
I20260709 13:19:51.637771  1934 raft_consensus.cc:2243] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:51.638599  1934 raft_consensus.cc:2272] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.640729  1934 tablet_replica.cc:333] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e: stopping tablet replica
I20260709 13:19:51.641316  1934 raft_consensus.cc:2243] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.641829  1934 raft_consensus.cc:2272] T 555dfb56b5c6475da7c3298fa816df94 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.643889  1934 tablet_replica.cc:333] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e: stopping tablet replica
I20260709 13:19:51.644475  1934 raft_consensus.cc:2243] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:51.645255  1934 raft_consensus.cc:2272] T 67e28ee13ebc4ea78b56e302d4a8e13f P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.647538  1934 tablet_replica.cc:333] T 728b17d23bff40d99b022d71c68dc2b0 P 31f7375d88974b7a9c775ec640ca368e: stopping tablet replica
I20260709 13:19:51.648154  1934 raft_consensus.cc:2243] T 728b17d23bff40d99b022d71c68dc2b0 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.648614  1934 raft_consensus.cc:2272] T 728b17d23bff40d99b022d71c68dc2b0 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.651595  1934 tablet_replica.cc:333] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e: stopping tablet replica
I20260709 13:19:51.652277  1934 raft_consensus.cc:2243] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:51.653149  1934 raft_consensus.cc:2272] T f538e262460d404a82ac501bf33a5078 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.655328  1934 tablet_replica.cc:333] T 6458b7b4a6834d48a65fec81a668a7fe P 31f7375d88974b7a9c775ec640ca368e: stopping tablet replica
I20260709 13:19:51.655886  1934 raft_consensus.cc:2243] T 6458b7b4a6834d48a65fec81a668a7fe P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.656342  1934 raft_consensus.cc:2272] T 6458b7b4a6834d48a65fec81a668a7fe P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.659173  1934 tablet_replica.cc:333] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e: stopping tablet replica
I20260709 13:19:51.660033  1934 raft_consensus.cc:2243] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:51.661195  1934 raft_consensus.cc:2272] T 405cddebb82545cd91123089b4e65aba P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.664178  1934 tablet_replica.cc:333] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e: stopping tablet replica
I20260709 13:19:51.665107  1934 raft_consensus.cc:2243] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:51.666098  1934 raft_consensus.cc:2272] T 9570777dd39b42e5bfbae3c29b91b002 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.668673  1934 tablet_replica.cc:333] T 3b074124b1dd46e39f36bb85084c8d10 P 31f7375d88974b7a9c775ec640ca368e: stopping tablet replica
I20260709 13:19:51.669360  1934 raft_consensus.cc:2243] T 3b074124b1dd46e39f36bb85084c8d10 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.669947  1934 raft_consensus.cc:2272] T 3b074124b1dd46e39f36bb85084c8d10 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.672379  1934 tablet_replica.cc:333] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e: stopping tablet replica
I20260709 13:19:51.673022  1934 raft_consensus.cc:2243] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:51.674062  1934 raft_consensus.cc:2272] T cff4e84064674eea87324bb89f7e6e60 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.676353  1934 tablet_replica.cc:333] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e: stopping tablet replica
I20260709 13:19:51.676994  1934 raft_consensus.cc:2243] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.677521  1934 raft_consensus.cc:2272] T b99e798b90d641cc955df72a9a6938f9 P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.680536  1934 tablet_replica.cc:333] T b3e28b5bed5a4cb184329986f01360ad P 31f7375d88974b7a9c775ec640ca368e: stopping tablet replica
I20260709 13:19:51.681423  1934 raft_consensus.cc:2243] T b3e28b5bed5a4cb184329986f01360ad P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.682122  1934 raft_consensus.cc:2272] T b3e28b5bed5a4cb184329986f01360ad P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.685865  1934 tablet_replica.cc:333] T 33e22b8497214cde9d1b23a71ef8101a P 31f7375d88974b7a9c775ec640ca368e: stopping tablet replica
I20260709 13:19:51.686695  1934 raft_consensus.cc:2243] T 33e22b8497214cde9d1b23a71ef8101a P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.687352  1934 raft_consensus.cc:2272] T 33e22b8497214cde9d1b23a71ef8101a P 31f7375d88974b7a9c775ec640ca368e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.689697  1934 tablet_replica.cc:333] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e: stopping tablet replica
I20260709 13:19:51.690268  1934 raft_consensus.cc:2243] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:51.691051  1934 raft_consensus.cc:2272] T 0aec1fdac1b04898b1c639e2b1c21c17 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.693164  1934 tablet_replica.cc:333] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e: stopping tablet replica
I20260709 13:19:51.693823  1934 raft_consensus.cc:2243] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.694373  1934 raft_consensus.cc:2272] T 5235e6ffdc5245a59381b4d7078959b0 P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.697079  1934 tablet_replica.cc:333] T cba0f563382046f7a0f5abc6d64d060c P 31f7375d88974b7a9c775ec640ca368e: stopping tablet replica
I20260709 13:19:51.697609  1934 raft_consensus.cc:2243] T cba0f563382046f7a0f5abc6d64d060c P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.698045  1934 raft_consensus.cc:2272] T cba0f563382046f7a0f5abc6d64d060c P 31f7375d88974b7a9c775ec640ca368e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.700057  1934 tablet_replica.cc:333] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e: stopping tablet replica
I20260709 13:19:51.700562  1934 raft_consensus.cc:2243] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.700985  1934 raft_consensus.cc:2272] T 918c48b8a8eb447c9d860cf67355b424 P 31f7375d88974b7a9c775ec640ca368e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:51.705647 14729 consensus_peers.cc:597] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 -> Peer 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945): Couldn't send request to peer 31f7375d88974b7a9c775ec640ca368e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:51.746312  1934 tablet_server.cc:196] TabletServer@127.1.227.129:0 shutdown complete.
W20260709 13:19:51.758093 14803 consensus_peers.cc:597] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 -> Peer 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945): Couldn't send request to peer 31f7375d88974b7a9c775ec640ca368e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:45945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:51.762176 14729 consensus_peers.cc:597] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 -> Peer 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945): Couldn't send request to peer 31f7375d88974b7a9c775ec640ca368e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:45945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:51.788941 14729 consensus_peers.cc:597] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 -> Peer 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945): Couldn't send request to peer 31f7375d88974b7a9c775ec640ca368e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:45945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:51.791268  1934 tablet_server.cc:179] TabletServer@127.1.227.130:0 shutting down...
W20260709 13:19:51.800112 14729 consensus_peers.cc:597] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 -> Peer 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945): Couldn't send request to peer 31f7375d88974b7a9c775ec640ca368e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:45945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:51.824468  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:51.825270  1934 tablet_replica.cc:333] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3: stopping tablet replica
I20260709 13:19:51.825992  1934 raft_consensus.cc:2243] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:51.826830  1934 raft_consensus.cc:2272] T 94cd096fb1b44314998a5ca9c10d8b92 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.829061  1934 tablet_replica.cc:333] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3: stopping tablet replica
I20260709 13:19:51.829802  1934 raft_consensus.cc:2243] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.830345  1934 raft_consensus.cc:2272] T 3b074124b1dd46e39f36bb85084c8d10 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.832387  1934 tablet_replica.cc:333] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3: stopping tablet replica
I20260709 13:19:51.832990  1934 raft_consensus.cc:2243] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.833473  1934 raft_consensus.cc:2272] T cff4e84064674eea87324bb89f7e6e60 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.835528  1934 tablet_replica.cc:333] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3: stopping tablet replica
I20260709 13:19:51.836123  1934 raft_consensus.cc:2243] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:51.837024  1934 raft_consensus.cc:2272] T 555dfb56b5c6475da7c3298fa816df94 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.839409  1934 tablet_replica.cc:333] T 67e28ee13ebc4ea78b56e302d4a8e13f P ed4f059a209b4924865bad4ae2d019b3: stopping tablet replica
I20260709 13:19:51.840051  1934 raft_consensus.cc:2243] T 67e28ee13ebc4ea78b56e302d4a8e13f P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.840521  1934 raft_consensus.cc:2272] T 67e28ee13ebc4ea78b56e302d4a8e13f P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.842626  1934 tablet_replica.cc:333] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3: stopping tablet replica
I20260709 13:19:51.843225  1934 raft_consensus.cc:2243] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:51.844161  1934 raft_consensus.cc:2272] T 5235e6ffdc5245a59381b4d7078959b0 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.846452  1934 tablet_replica.cc:333] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3: stopping tablet replica
I20260709 13:19:51.847013  1934 raft_consensus.cc:2243] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.847450  1934 raft_consensus.cc:2272] T 728b17d23bff40d99b022d71c68dc2b0 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.850620  1934 tablet_replica.cc:333] T f538e262460d404a82ac501bf33a5078 P ed4f059a209b4924865bad4ae2d019b3: stopping tablet replica
I20260709 13:19:51.851231  1934 raft_consensus.cc:2243] T f538e262460d404a82ac501bf33a5078 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.851744  1934 raft_consensus.cc:2272] T f538e262460d404a82ac501bf33a5078 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.853914  1934 tablet_replica.cc:333] T 16bf6bbe8d044b08b8be9a53b89b20f3 P ed4f059a209b4924865bad4ae2d019b3: stopping tablet replica
I20260709 13:19:51.854511  1934 raft_consensus.cc:2243] T 16bf6bbe8d044b08b8be9a53b89b20f3 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.854983  1934 raft_consensus.cc:2272] T 16bf6bbe8d044b08b8be9a53b89b20f3 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.857009  1934 tablet_replica.cc:333] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3: stopping tablet replica
I20260709 13:19:51.857591  1934 raft_consensus.cc:2243] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:51.858508  1934 raft_consensus.cc:2272] T cba0f563382046f7a0f5abc6d64d060c P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.860685  1934 tablet_replica.cc:333] T 0aec1fdac1b04898b1c639e2b1c21c17 P ed4f059a209b4924865bad4ae2d019b3: stopping tablet replica
I20260709 13:19:51.861393  1934 raft_consensus.cc:2243] T 0aec1fdac1b04898b1c639e2b1c21c17 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.861975  1934 raft_consensus.cc:2272] T 0aec1fdac1b04898b1c639e2b1c21c17 P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.864171  1934 tablet_replica.cc:333] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3: stopping tablet replica
I20260709 13:19:51.864753  1934 raft_consensus.cc:2243] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:51.865618  1934 raft_consensus.cc:2272] T 33e22b8497214cde9d1b23a71ef8101a P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.867774  1934 tablet_replica.cc:333] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3: stopping tablet replica
I20260709 13:19:51.868364  1934 raft_consensus.cc:2243] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.868810  1934 raft_consensus.cc:2272] T 918c48b8a8eb447c9d860cf67355b424 P ed4f059a209b4924865bad4ae2d019b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.872028  1934 tablet_replica.cc:333] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3: stopping tablet replica
I20260709 13:19:51.872601  1934 raft_consensus.cc:2243] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:51.873427  1934 raft_consensus.cc:2272] T 6458b7b4a6834d48a65fec81a668a7fe P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.875521  1934 tablet_replica.cc:333] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3: stopping tablet replica
I20260709 13:19:51.876087  1934 raft_consensus.cc:2243] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.876573  1934 raft_consensus.cc:2272] T 405cddebb82545cd91123089b4e65aba P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.878669  1934 tablet_replica.cc:333] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3: stopping tablet replica
I20260709 13:19:51.879204  1934 raft_consensus.cc:2243] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.879662  1934 raft_consensus.cc:2272] T 9570777dd39b42e5bfbae3c29b91b002 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.881825  1934 tablet_replica.cc:333] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3: stopping tablet replica
I20260709 13:19:51.882320  1934 raft_consensus.cc:2243] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:51.883175  1934 raft_consensus.cc:2272] T b99e798b90d641cc955df72a9a6938f9 P ed4f059a209b4924865bad4ae2d019b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.885114  1934 tablet_replica.cc:333] T b3e28b5bed5a4cb184329986f01360ad P ed4f059a209b4924865bad4ae2d019b3: stopping tablet replica
I20260709 13:19:51.885571  1934 raft_consensus.cc:2243] T b3e28b5bed5a4cb184329986f01360ad P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.886082  1934 raft_consensus.cc:2272] T b3e28b5bed5a4cb184329986f01360ad P ed4f059a209b4924865bad4ae2d019b3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:51.916240 14803 consensus_peers.cc:597] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 -> Peer 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945): Couldn't send request to peer 31f7375d88974b7a9c775ec640ca368e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:45945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:51.920430 14804 consensus_peers.cc:597] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 -> Peer ed4f059a209b4924865bad4ae2d019b3 (127.1.227.130:36115): Couldn't send request to peer ed4f059a209b4924865bad4ae2d019b3. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.130:36115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:51.926363  1934 tablet_server.cc:196] TabletServer@127.1.227.130:0 shutdown complete.
W20260709 13:19:51.950947 14803 consensus_peers.cc:597] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 -> Peer 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945): Couldn't send request to peer 31f7375d88974b7a9c775ec640ca368e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:45945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:51.962970  1934 tablet_server.cc:179] TabletServer@127.1.227.131:0 shutting down...
I20260709 13:19:51.994716  1934 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:51.995558  1934 tablet_replica.cc:333] T 94cd096fb1b44314998a5ca9c10d8b92 P 712448581a8b4362b83305434a66cb99: stopping tablet replica
I20260709 13:19:51.996647  1934 raft_consensus.cc:2243] T 94cd096fb1b44314998a5ca9c10d8b92 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:51.997359  1934 raft_consensus.cc:2272] T 94cd096fb1b44314998a5ca9c10d8b92 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:51.999603  1934 tablet_replica.cc:333] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99: stopping tablet replica
I20260709 13:19:52.000248  1934 raft_consensus.cc:2243] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.000769  1934 raft_consensus.cc:2272] T 16bf6bbe8d044b08b8be9a53b89b20f3 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.003011  1934 tablet_replica.cc:333] T 555dfb56b5c6475da7c3298fa816df94 P 712448581a8b4362b83305434a66cb99: stopping tablet replica
I20260709 13:19:52.003664  1934 raft_consensus.cc:2243] T 555dfb56b5c6475da7c3298fa816df94 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.004153  1934 raft_consensus.cc:2272] T 555dfb56b5c6475da7c3298fa816df94 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.006485  1934 tablet_replica.cc:333] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99: stopping tablet replica
I20260709 13:19:52.007392  1934 raft_consensus.cc:2243] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.008224  1934 raft_consensus.cc:2272] T 67e28ee13ebc4ea78b56e302d4a8e13f P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.012012  1934 tablet_replica.cc:333] T 5235e6ffdc5245a59381b4d7078959b0 P 712448581a8b4362b83305434a66cb99: stopping tablet replica
I20260709 13:19:52.012722  1934 raft_consensus.cc:2243] T 5235e6ffdc5245a59381b4d7078959b0 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.013240  1934 raft_consensus.cc:2272] T 5235e6ffdc5245a59381b4d7078959b0 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:52.013612 14803 consensus_peers.cc:597] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 -> Peer 31f7375d88974b7a9c775ec640ca368e (127.1.227.129:45945): Couldn't send request to peer 31f7375d88974b7a9c775ec640ca368e. Status: Network error: Client connection negotiation failed: client connection to 127.1.227.129:45945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:52.015569  1934 tablet_replica.cc:333] T cba0f563382046f7a0f5abc6d64d060c P 712448581a8b4362b83305434a66cb99: stopping tablet replica
I20260709 13:19:52.016351  1934 raft_consensus.cc:2243] T cba0f563382046f7a0f5abc6d64d060c P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.016880  1934 raft_consensus.cc:2272] T cba0f563382046f7a0f5abc6d64d060c P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.019335  1934 tablet_replica.cc:333] T 0aec1fdac1b04898b1c639e2b1c21c17 P 712448581a8b4362b83305434a66cb99: stopping tablet replica
I20260709 13:19:52.019971  1934 raft_consensus.cc:2243] T 0aec1fdac1b04898b1c639e2b1c21c17 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.020452  1934 raft_consensus.cc:2272] T 0aec1fdac1b04898b1c639e2b1c21c17 P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.022691  1934 tablet_replica.cc:333] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99: stopping tablet replica
I20260709 13:19:52.023272  1934 raft_consensus.cc:2243] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.023774  1934 raft_consensus.cc:2272] T 33e22b8497214cde9d1b23a71ef8101a P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.025977  1934 tablet_replica.cc:333] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99: stopping tablet replica
I20260709 13:19:52.026546  1934 raft_consensus.cc:2243] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:52.027347  1934 raft_consensus.cc:2272] T 918c48b8a8eb447c9d860cf67355b424 P 712448581a8b4362b83305434a66cb99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.030316  1934 tablet_replica.cc:333] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99: stopping tablet replica
I20260709 13:19:52.030959  1934 raft_consensus.cc:2243] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.031481  1934 raft_consensus.cc:2272] T 6458b7b4a6834d48a65fec81a668a7fe P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.033484  1934 tablet_replica.cc:333] T 405cddebb82545cd91123089b4e65aba P 712448581a8b4362b83305434a66cb99: stopping tablet replica
I20260709 13:19:52.034083  1934 raft_consensus.cc:2243] T 405cddebb82545cd91123089b4e65aba P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.034564  1934 raft_consensus.cc:2272] T 405cddebb82545cd91123089b4e65aba P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.036541  1934 tablet_replica.cc:333] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99: stopping tablet replica
I20260709 13:19:52.037093  1934 raft_consensus.cc:2243] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.037583  1934 raft_consensus.cc:2272] T 9570777dd39b42e5bfbae3c29b91b002 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.039677  1934 tablet_replica.cc:333] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99: stopping tablet replica
I20260709 13:19:52.040181  1934 raft_consensus.cc:2243] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:52.041002  1934 raft_consensus.cc:2272] T 728b17d23bff40d99b022d71c68dc2b0 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.043450  1934 tablet_replica.cc:333] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99: stopping tablet replica
I20260709 13:19:52.044010  1934 raft_consensus.cc:2243] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.044505  1934 raft_consensus.cc:2272] T f538e262460d404a82ac501bf33a5078 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.046916  1934 tablet_replica.cc:333] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99: stopping tablet replica
I20260709 13:19:52.047459  1934 raft_consensus.cc:2243] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:52.048246  1934 raft_consensus.cc:2272] T 3b074124b1dd46e39f36bb85084c8d10 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.050979  1934 tablet_replica.cc:333] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99: stopping tablet replica
I20260709 13:19:52.051540  1934 raft_consensus.cc:2243] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.052026  1934 raft_consensus.cc:2272] T cff4e84064674eea87324bb89f7e6e60 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.054237  1934 tablet_replica.cc:333] T b99e798b90d641cc955df72a9a6938f9 P 712448581a8b4362b83305434a66cb99: stopping tablet replica
I20260709 13:19:52.054764  1934 raft_consensus.cc:2243] T b99e798b90d641cc955df72a9a6938f9 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.055245  1934 raft_consensus.cc:2272] T b99e798b90d641cc955df72a9a6938f9 P 712448581a8b4362b83305434a66cb99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.057379  1934 tablet_replica.cc:333] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99: stopping tablet replica
I20260709 13:19:52.057911  1934 raft_consensus.cc:2243] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:52.058748  1934 raft_consensus.cc:2272] T b3e28b5bed5a4cb184329986f01360ad P 712448581a8b4362b83305434a66cb99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.100414  1934 tablet_server.cc:196] TabletServer@127.1.227.131:0 shutdown complete.
I20260709 13:19:52.136261  1934 master.cc:562] Master@127.1.227.190:33079 shutting down...
I20260709 13:19:52.159318  1934 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:52.159904  1934 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.160243  1934 tablet_replica.cc:333] T 00000000000000000000000000000000 P 37f589ca53e941d2a97ee38062ec8bf5: stopping tablet replica
I20260709 13:19:52.181582  1934 master.cc:584] Master@127.1.227.190:33079 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11568 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24370 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (366407 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:19:52.240675  1934 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 428 messages since previous log ~14 seconds ago
I20260709 13:19:52.240873  1934 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 428 messages since previous log ~14 seconds ago
I20260709 13:19:52.241012  1934 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 426 messages since previous log ~14 seconds ago
I20260709 13:19:52.241189  1934 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:19:52.241341  1934 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:19:52.241500  1934 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 6 messages since previous log ~142 seconds ago
I20260709 13:19:52.241694  1934 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 9 messages since previous log ~0 seconds ago
I20260709 13:19:52.241995  1934 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
